Tutorials › Physiologically-Based Pharmacokinetics (PBPK) › Comparing Cohort Designs for Population Exposure Prediction

Genetic Polymorphisms and Virtual Populations · Tutorial 662 of 799

Comparing Cohort Designs for Population Exposure Prediction

Learn to match a pharmacogenetic cohort design and allocation to the exposure summary you need, while distinguishing sampling variability from deterministic approximation error.

Advanced 10 min read

What You'll Learn

  • Define population exposure summaries using genotype probabilities and conditional exposure distributions.
  • Derive and compare the uncertainty of random and genotype-stratified estimates of a population mean.
  • Allocate PBPK simulations across genotype strata under a fixed computational budget.
  • Use weighted deterministic cohorts while recognizing their approximation error and limitations.
  • Select and diagnose a design for means, quantiles, and tail probabilities.

Why Cohort Design Depends on the Target

A pharmacogenetic PBPK cohort is a computational representation of a target population. Its design affects which people are simulated, how their results are weighted, and how accurately a chosen population exposure summary is estimated. A cohort that estimates the overall mean efficiently may still represent an exposure tail or a rare genotype poorly. The choice should therefore start with the estimand—the population quantity of interest—and then account for genotype frequencies, within-genotype variability, and the simulation budget.

Let \(G\) denote genotype category, with target-population probability \(p_g=P(G=g)\), and let \(X\) denote the remaining subject characteristics, such as physiology or covariates. For a specified regimen and PBPK model, let \(Y=f(G,X)\) be an exposure metric, measured in stated units. The target mean exposure is an average over both genotype and the distribution of characteristics within each genotype.

Definition: Write \(\mu_g=E(Y\mid G=g)\) for the mean exposure in genotype stratum \(g\), and \(\sigma_g^2=\operatorname{Var}(Y\mid G=g)\) for its variance. If the genotype probabilities are known, the population mean is \(\theta=E(Y)=\sum_g p_g\mu_g\). The population exposure distribution is \(F(y)=\sum_g p_gF_g(y)\), where \(F_g(y)=P(Y\leq y\mid G=g)\).

These expressions assume that the genotype categories cover the target population, their probabilities are appropriate for that population, and each conditional distribution represents the target characteristics within its genotype. They also assume a specified PBPK model, regimen, and exposure definition. A simulated estimate describes the modelled target population under those inputs; it is not automatically an estimate of a clinical outcome beyond the model.

Three Ways to Construct a Cohort

In a random cohort, each virtual subject is sampled from the joint target population: genotype is sampled according to \(p_g\), then other characteristics are sampled from their distribution conditional on genotype. The ordinary sample mean gives each subject equal weight. This design is simple and naturally reflects population frequencies in expectation, but a finite cohort may contain few subjects from a rare genotype.

In a stratified cohort, the analyst fixes a sample size \(n_g\) for each genotype and samples subjects within each stratum. If genotype probabilities are known, the overall mean must use population weights, not the simulated proportions:

$$ \hat{\theta}_{\mathrm{str}}=\sum_g p_g\bar{Y}_g,\qquad \bar{Y}_g=\frac{1}{n_g}\sum_{i=1}^{n_g}Y_{gi}. $$

With independent, representative draws within strata, this estimator is unbiased for \(\theta\). Its variance is \(\sum_g p_g^2\sigma_g^2/n_g\). Stratification gives control over how many simulations represent each genotype, but an unweighted mean of all stratified subjects generally targets the wrong genotype mixture.

In a deterministic cohort, the analyst chooses a fixed set of representative inputs and weights rather than drawing subjects randomly. For example, points \(x_{gj}\) with weights \(w_{gj}\) can approximate the conditional distribution within genotype \(g\), where \(w_{gj}\geq0\) and \(\sum_jw_{gj}=1\). The estimate is

$$ \hat{\theta}_{\mathrm{det}}=\sum_g p_g\sum_jw_{gj}f(g,x_{gj}). $$

Such a design can be reproducible and avoid Monte Carlo sampling variability. It is nevertheless an approximation to the required population average unless the weighted points integrate the PBPK output exactly. Its approximation error is not an ordinary sampling standard error and cannot be removed just by applying a sample-mean standard error formula.

Why Stratification Can Improve a Mean Estimate

For an independent random cohort of size \(N\), each subject is drawn from the full population. The sample mean is unbiased and has variance \(\operatorname{Var}(Y)/N\). The law of total variance separates this into variation between genotype means and variation within genotypes:

$$ \operatorname{Var}(Y)=\sum_g p_g\sigma_g^2+\sum_g p_g(\mu_g-\theta)^2. $$

In a stratified cohort, the genotype counts are fixed rather than fluctuating. Only within-genotype sampling contributes to the variance of the weighted estimator. This gives \(\operatorname{Var}(\hat{\theta}_{\mathrm{str}})=\sum_g p_g^2\sigma_g^2/n_g\). The comparison explains why stratification can be more precise for a mean, especially when genotype means differ or a random cohort would represent rare genotypes inconsistently. It does not guarantee that every particular stratified cohort is more accurate than every random cohort.

For a fixed total number of simulations \(N=\sum_g n_g\), the continuous allocation minimizing the stratified mean variance is \(n_g\propto p_g\sigma_g\), provided the \(\sigma_g\) values are known and simulations have equal cost. In practice, allocation must use whole numbers and may require minimum stratum sizes. If costs differ by genotype, the best allocation changes; a rare but expensive stratum may not receive the same number of simulations as under equal costs.

Worked Example: Estimating a Mean From a Stratified Cohort

Suppose a hypothetical target population has three genotype categories with probabilities \(0.70\), \(0.20\), and \(0.10\). A stratified simulation gives exposure values, in mg·h/L, of \(8,10,12\) in category A; \(15,19\) in B; and \(24,30\) in C. Assume the values are representative draws within their respective strata.

The stratum means are \(\bar{Y}_A=10\), \(\bar{Y}_B=17\), and \(\bar{Y}_C=27\) mg·h/L. The properly weighted estimate is

$$ \hat{\theta}_{\mathrm{str}} =0.70(10)+0.20(17)+0.10(27) =7.00+3.40+2.70 =13.10\ \text{mg·h/L}. $$

The stratum sample variances are \(s_A^2=4\), \(s_B^2=8\), and \(s_C^2=18\), each in \((\text{mg·h/L})^2\). Substituting these estimates in the stratified variance formula gives

$$ \widehat{\operatorname{Var}}(\hat{\theta}_{\mathrm{str}}) =\frac{0.70^2(4)}{3}+\frac{0.20^2(8)}{2}+\frac{0.10^2(18)}{2} =0.9033\ (\text{mg·h/L})^2, \qquad SE\approx\sqrt{0.9033}=0.9504\ \text{mg·h/L}. $$

This standard error quantifies estimated sampling variability under the assumed stratified sampling scheme. The unweighted mean of the seven simulated subjects is \(118/7=16.86\) mg·h/L, which does not estimate the target mean here: the cohort contains far more category B and C subjects, proportionally, than the target population does.

Allocating Simulations Under a Budget

Proportional allocation, \(n_g\approx Np_g\), makes the simulated genotype proportions resemble the target population and is a useful default when within-genotype variances are similar. For estimating a mean, Neyman allocation instead assigns simulations in proportion to \(p_g\sigma_g\). It places more simulations in strata that are both prevalent and variable. The allocation depends on the estimand: the variance-minimizing allocation for a mean need not be best for a tail probability or a rare-genotype estimate.

Worked Example: Comparing Allocations for a Fixed Budget

Consider a hypothetical cohort budget of \(N=12\) simulations, genotype probabilities \(0.70,0.20,0.10\), and conditional exposure standard deviations \(2,4,6\) mg·h/L. Assume equal simulation costs and use these standard deviations as planning values.

A rounded proportional allocation is \((n_A,n_B,n_C)=(8,2,2)\). Its estimated variance for the weighted mean is

$$ \frac{0.70^2(2^2)}{8}+\frac{0.20^2(4^2)}{2}+\frac{0.10^2(6^2)}{2} =0.245+0.320+0.180 =0.745\ (\text{mg·h/L})^2. $$

For Neyman allocation, the relative allocation weights are \(p_g\sigma_g\), namely \(1.4,0.8,0.6\), which sum to \(2.8\). Multiplying each weight by 12 gives \(6,3.43,2.57\); a feasible rounded allocation is \((6,4,2)\). Its variance is

$$ \frac{0.70^2(2^2)}{6}+\frac{0.20^2(4^2)}{4}+\frac{0.10^2(6^2)}{2} =0.3267+0.1600+0.1800 =0.6667\ (\text{mg·h/L})^2, $$

The corresponding estimated standard errors are \(\sqrt{0.745}=0.8631\) mg·h/L and \(\sqrt{0.6667}=0.8165\) mg·h/L. Under these planning assumptions, Neyman allocation gives the smaller estimated variance for the mean. This advantage depends on the variances being reasonably known and the mean being the priority; it is not a universal ranking of designs.

Choosing Designs for Distributions and Deterministic Integration

A population quantile or exceedance probability depends on the whole exposure distribution, not just its mean. For a threshold \(c\), the target exceedance probability is \(P(Y>c)=\sum_gp_gP(Y>c\mid G=g)\). A stratified estimate can estimate each conditional exceedance proportion and combine them using \(p_g\). To estimate a population quantile, first form the weighted population distribution and then find its quantile; averaging genotype-specific quantiles generally does not produce the population quantile. Random cohorts can estimate these summaries too, but rare strata and extreme tails may be represented by very few subjects. Deterministic weighted points can approximate a distribution, but a sparse set of points may poorly resolve a tail or make the estimated quantile jump abruptly.

A deterministic design is most defensible when points and weights are chosen to approximate the relevant input distribution and the resulting PBPK outputs are checked for sensitivity to that approximation. Evaluating the model only at average inputs is not generally equivalent to averaging the model output: PBPK relationships are often nonlinear.

Worked Example: Weighted Deterministic Points and a Tail Summary

Suppose, hypothetically, a deterministic cohort has two exposure points in each of two genotype categories. Category A has population probability \(0.75\), and its exposure points are \(8\) and \(12\) mg·h/L with weights \(0.5\) each. Category B has probability \(0.25\), with points \(20\) and \(32\) mg·h/L, also weighted \(0.5\) each.

The weighted mean is

$$ 0.75[0.5(8)+0.5(12)]+0.25[0.5(20)+0.5(32)] =0.75(10)+0.25(26) =14.0\ \text{mg·h/L}. $$

For a threshold of \(18\) mg·h/L, neither A point exceeds the threshold and both B points do. Thus the weighted exceedance estimate is \(0.75(0)+0.25(1)=0.25\), or 25%. The weighted distribution places cumulative probability \(0.375\) at 8 and \(0.75\) at 12 mg·h/L, so its median, defined as the smallest exposure at which cumulative probability is at least 0.5, is 12 mg·h/L. The weighted average of the two genotype-specific medians would be \(0.75(10)+0.25(26)=14\) mg·h/L, which is not the population median.

Even a correctly weighted deterministic cohort can miss features between its selected points. For example, if the PBPK exposure is dose divided by clearance, evaluating at a mean clearance of \(2\) L/h for a 10 mg dose gives \(5\) mg·h/L. Averaging exposures at clearances of \(1\) and \(3\) L/h with equal weights instead gives \([10+3.333]/2=6.667\) mg·h/L. The difference arises because the model output is nonlinear in clearance.

Diagnostics, Trade-Offs, and a Common Pitfall

Before running a cohort, specify the estimand, target genotype probabilities, within-genotype sampling distributions, and simulation budget. Afterward, check the realized genotype counts and weights, the number of simulations in rare strata, and whether within-stratum covariates cover their intended ranges. For random cohorts, repeat simulations or increase cohort size to assess Monte Carlo stability. For stratified cohorts, inspect stratum-specific variability and confirm that the weighted estimate and its standard error use the target \(p_g\). For deterministic cohorts, compare estimates under denser or alternative weighted points; stability across such checks is evidence of numerical robustness, not proof that the approximation is exact.

Random sampling is simple and flexible, but may waste a fixed budget on overrepresented common strata when a rare stratum matters. Stratification controls representation and can improve precision for weighted summaries, but requires correct weights and adequate within-stratum sampling. Deterministic designs are reproducible and can be efficient for smooth averages, but require careful point selection and do not provide a conventional sampling-based uncertainty estimate. In all three designs, uncertainty in the PBPK model, genotype frequencies, or target covariate distributions is distinct from Monte Carlo variability and is not resolved merely by increasing the virtual-cohort size.

  • Common mistake: Treating every subject in an intentionally oversampled stratified cohort as equally representative of the target population. This weights genotypes according to their cohort counts, not according to their population probabilities.
  • Correction: For a population mean with known genotype probabilities, calculate \(\sum_gp_g\bar{Y}_g\). For distributional summaries, combine conditional distributions or proportions with those same target weights before calculating the summary.
  • Another warning: A deterministic cohort has no random sampling error conditional on its chosen points, but it can still have substantial integration error. Repeating the same deterministic calculation does not diagnose that error.
Key takeaway: Choose the cohort design for the target summary and the computational budget. Use random sampling for direct population draws, stratification when controlled genotype representation and weighted estimation are useful, and deterministic points when their weighted integration is appropriate and approximation error is checked.

Check Your Understanding

Answer each question, then compare with the brief solutions below.

  1. A target population has genotype probabilities \(0.8\) and \(0.2\), with conditional mean exposures of 5 and 15 mg·h/L. What is the population mean?
  2. Why can a stratified cohort with equal numbers from two genotypes not generally be summarized by its unweighted mean?
  3. For the same simulation budget, which genotype strata receive more simulations under Neyman allocation: those with large \(p_g\sigma_g\) or small \(p_g\sigma_g\)?
  4. What is one limitation of using a deterministic cohort to estimate an extreme exposure quantile?

Solutions. (1) \(0.8(5)+0.2(15)=7.0\) mg·h/L. (2) Equal cohort counts imply equal cohort weights, whereas the target population weights are 0.8 and 0.2; use the known target probabilities to weight stratum summaries. (3) Strata with larger \(p_g\sigma_g\) receive more simulations for a mean under equal costs and the stated assumptions. (4) Its selected points may not resolve the tail adequately, so the estimated quantile can be sensitive to point placement or miss relevant tail behavior.