Tutorials › Bioavailability and Bioequivalence › Predicting Population Bioequivalence From Exposure Distributions

Model-Based Bioequivalence · Tutorial 305 of 399

Predicting Population Bioequivalence From Exposure Distributions

You will define and estimate a population coverage probability from paired model predictions, assess its simulation precision, and recognize the assumptions needed to interpret it.

Advanced 12 min read

What You'll Learn

  • Define the target-population fraction whose test-to-reference exposure ratio lies within specified bounds.
  • Explain why a paired distribution of test and reference predictions is needed to calculate that fraction.
  • Estimate the fraction using model-based simulation and calculate its Monte Carlo standard error.
  • Relate a lognormal ratio model to an analytic probability calculation.
  • Diagnose unstable or unrepresentative simulations and separate simulation error from model uncertainty.
  • Distinguish population coverage from a geometric mean ratio comparison.

From Model Predictions to Population Coverage

A geometric mean ratio summarizes the center of a test-to-reference exposure comparison. It does not, by itself, say what fraction of people in a target population are predicted to have ratios within specified bounds. Two populations can have the same geometric mean ratio but very different spreads, and therefore different fractions inside the bounds. Model-based simulation can estimate that fraction by generating exposure predictions for representative virtual subjects under both formulations.

The target quantity must be defined before simulating. Specify the exposure endpoint, the population to which the result applies, the test-to-reference ratio, and the lower and upper bounds. The calculation then asks how often a virtual subject’s predicted ratio falls within those bounds. This is a population coverage estimand: it describes a proportion under a specified population distribution and model. It is not, by itself, the separate moment-based regulatory criterion sometimes called population bioequivalence.

Definition: Let \(Y_T(Z)\) and \(Y_R(Z)\) be the predicted exposure response for the test and reference formulations, respectively, for a target-population profile \(Z\). For positive responses, define the ratio \(R(Z)=Y_T(Z)/Y_R(Z)\). Given prespecified limits \(L\) and \(U\), with \(0<L<U\), the population coverage probability is \(p_{\mathrm{cov}}=P(L\le R(Z)\le U)\), where probability is taken over the specified target-population distribution of \(Z\). It is the proportion of target-population profiles whose predicted ratios satisfy both limits.

The paired notation matters. The ratio compares predictions for the same simulated profile under test and reference. A model therefore needs a defensible way to represent both outcomes for that profile, such as shared covariates and shared subject-level characteristics. Two unrelated samples of test and reference predictions provide marginal distributions, but do not by themselves define which test response should be divided by which reference response. The pairing rule is part of the estimand and model assumptions, not a harmless computational detail.

This tutorial concerns ratios of model-predicted exposures such as AUC or Cmax, not observed concentration at a single time. The endpoint, limits, and target population must be specified on the relevant scale. Limits may be stated as ratios or as equivalent log-ratio bounds: if \(X(Z)=\log R(Z)\), then the event is \(\log L\le X(Z)\le\log U\). Equality at a boundary is included in the definition; for continuous distributions it has probability zero.

Assumptions Before Simulation

A numerical estimate is only meaningful relative to the model and population used to produce it. Before simulating, establish the following conditions:

  • Target-population representation. The distribution used to generate profiles reflects the intended population, including relevant covariates and any modeled subject-level variation. A sample from a narrow or unrepresentative covariate range does not automatically represent the target population.
  • Valid exposure predictions. The structural and formulation components of the pharmacokinetic model must generate plausible predictions for each formulation over the relevant range. Exposure responses must be positive for ratios to be defined.
  • Defensible pairing. Test and reference predictions must correspond to the same simulated profile, with shared characteristics assigned consistently. Any formulation-specific differences in the model must match the scientific question. This calculation does not establish that an unmodeled source of subject-by-formulation variation is absent.
  • Prespecified decision bounds and endpoint. The limits and exposure metric should be fixed before interpreting the simulated coverage. Changing them after seeing the results changes the estimand.
  • Adequate simulation. Simulated profiles must be drawn according to the intended population distribution, and enough draws must be used to make Monte Carlo error small for the intended precision.

These assumptions are distinct from the mechanics of counting ratios. A very large simulation can reduce random simulation error, but it cannot repair a misspecified structural model, an incorrect target population, or an unjustified pairing rule.

Estimating the Proportion

Suppose \(Z_1,\ldots,Z_M\) are independently generated profiles from the target-population distribution. For each profile, predict the exposure under both formulations and calculate \(R_i=Y_T(Z_i)/Y_R(Z_i)\). Record an indicator \(I_i\), equal to 1 when \(L\le R_i\le U\), and 0 otherwise. The estimated coverage is the average of these indicators.

$$ \hat{p}_{\mathrm{cov}}=\frac{1}{M}\sum_{i=1}^{M} I_i =\frac{\#\{i:L\le R_i\le U\}}{M}. $$

The justification is direct. Under independent draws from the stated population and model, each indicator is a Bernoulli random variable with \(P(I_i=1)=p_{\mathrm{cov}}\). Its expected value is \(p_{\mathrm{cov}}\). By linearity of expectation, the expected average of \(M\) indicators is also \(p_{\mathrm{cov}}\), so the simulated proportion is unbiased for the model-implied coverage. Independence gives variance \(p_{\mathrm{cov}}(1-p_{\mathrm{cov}})/M\); replacing the unknown probability with its estimate yields the usual Monte Carlo standard error.

$$ SE_{\mathrm{MC}}(\hat{p}_{\mathrm{cov}}) \approx \sqrt{\frac{\hat{p}_{\mathrm{cov}}(1-\hat{p}_{\mathrm{cov}})}{M}}. $$

This standard error describes variation from generating a finite number of simulation draws, conditional on the fitted model and its parameters. It is not a confidence interval for the true population coverage that includes uncertainty in model parameters or model structure. If the model parameters were estimated from data, that additional uncertainty requires a separate method.

Worked Example: Counting Ratios Within the Limits

Consider a hypothetical model simulation for a specified target population and exposure endpoint. The prespecified ratio limits are \(L=0.80\) and \(U=1.25\). Ten paired test and reference predictions produce these ratios: 0.91, 1.03, 1.17, 0.78, 1.24, 1.31, 0.86, 1.00, 1.22, and 0.79. Assume these profiles were independently sampled from the specified target distribution and that the model supplies valid paired predictions.

Seven ratios fall within the inclusive bounds: 0.91, 1.03, 1.17, 1.24, 0.86, 1.00, and 1.22. The values 0.78 and 0.79 are below the lower limit, and 1.31 is above the upper limit. Therefore,

$$ \hat{p}_{\mathrm{cov}}=\frac{7}{10}=0.700. $$

The simulated estimate is 70.0% of profiles. Its approximate Monte Carlo standard error is

$$ SE_{\mathrm{MC}}=\sqrt{\frac{0.700(1-0.700)}{10}} =\sqrt{0.021}=0.145. $$

The standard error is large because only ten profiles were simulated. The estimate describes this hypothetical simulation; it is not evidence that exactly 70.0% of the target population meets the bounds. The model and population assumptions also remain essential to its interpretation.

Using a Distributional Model

When the log ratio has a tractable distribution, coverage can sometimes be calculated directly rather than estimated by simulation. This also provides a useful check on a simulation implementation. If \(X=\log R\) follows a normal distribution with mean \(\mu_X\) and standard deviation \(\sigma_X\), then the log ratio has distribution \(X\sim N(\mu_X,\sigma_X^2)\), and the coverage is the probability between the log-transformed limits. Let \(\Phi\) denote the cumulative distribution function of a standard normal variable. Standardizing each limit gives

$$ p_{\mathrm{cov}} =P(\log L\le X\le\log U) =\Phi\left(\frac{\log U-\mu_X}{\sigma_X}\right) -\Phi\left(\frac{\log L-\mu_X}{\sigma_X}\right). $$

The subtraction follows because the event \(X\le\log U\) includes all values below the upper bound, including those below the lower bound. Subtracting \(P(X<\log L)\) leaves only the probability between the two limits. This formula relies on the normal log-ratio assumption; it is not automatically appropriate for every exposure distribution.

Worked Example: Calculating Coverage Under a Lognormal Ratio Model

Suppose, hypothetically, that the model implies \(X=\log R\sim N(0.020,0.12^2)\) for the target population, with prespecified ratio limits of 0.80 and 1.25. Thus the log-ratio mean is 0.020 and its standard deviation is 0.12. Assume the normal distribution adequately represents the paired log ratios and that the target population is correctly specified.

The transformed limits are \(\log(0.80)=-0.2231\) and \(\log(1.25)=0.2231\). The standardized values are

$$ z_L=\frac{-0.2231-0.020}{0.12}=-2.026, \qquad z_U=\frac{0.2231-0.020}{0.12}=1.693. $$

Using standard normal cumulative probabilities, \(\Phi(1.693)\approx0.9547\) and \(\Phi(-2.026)\approx0.0214\). Therefore,

$$ p_{\mathrm{cov}}=0.9547-0.0214=0.9333. $$

Under these assumptions, approximately 93.3% of target-population profiles have predicted ratios between 0.80 and 1.25. This is a distributional probability, not a statement that the geometric mean ratio alone is within the bounds. The assumed log-ratio mean corresponds to a geometric mean ratio of \(\exp(0.020)\approx1.020\), but the coverage calculation also depends on the spread, here 0.12 on the log scale.

Simulation Precision, Diagnostics, and Alternatives

A simulation result should be checked both for numerical precision and for scientific plausibility. First inspect the generated target profiles: compare their key covariate distributions with the intended population and check that the simulated range is plausible. Then inspect paired predictions and ratios for nonpositive values, extreme values, or patterns suggesting that the model is being used outside its supported range. A coding check should confirm that each test prediction is divided by the reference prediction for the same profile, and that the bounds are applied on the intended scale.

Monte Carlo stability can be assessed by increasing \(M\), repeating the simulation with independent random draws, or examining the Monte Carlo standard error. If the estimate changes materially between runs or its simulation error is too large for the intended interpretation, increase the number of draws. When draws are weighted, stratified, or otherwise dependent, the simple Bernoulli standard error above may not apply unchanged; the calculation must reflect the actual simulation design.

A useful alternative is the analytic calculation for a specified ratio distribution, as in the previous example. It avoids random simulation error when its distributional assumptions are appropriate. Model-simulated distributions are more flexible when the response ratio is generated from covariates or a more complex pharmacokinetic model, but they still depend on correct model specification and adequate sampling.

The geometric mean ratio comparison taught in the earlier material on estimating geometric mean ratios summarizes the center of the comparison. It is useful for that purpose, but it is not a substitute for coverage: a central estimate does not tell how much probability lies inside two limits. Conversely, a coverage estimate does not replace every other bioequivalence summary or decision criterion. The estimand answers a particular question about the proportion of the specified population whose predicted ratios meet specified bounds.

For example, with \(M=1000\), a simulated estimate of 0.922 has approximate Monte Carlo standard error \(\sqrt{0.922(0.078)/1000}=0.00848\), or 0.848 percentage points. A rough normal interval based only on simulation error is \(0.922\pm1.96(0.00848)\), approximately 0.905 to 0.939. Even if a hypothetical target coverage were 0.90, this interval would address only finite simulation noise conditional on the model. It does not establish that the model is correct or account for uncertainty in its fitted parameters.

Worked Example: Interpreting Monte Carlo Error

In a hypothetical run, 922 of \(M=1000\) independently simulated target profiles have ratios within the prespecified limits. Assume the profile-generation scheme and paired predictions meet the conditions for the Bernoulli standard error. The estimate is

$$ \hat{p}_{\mathrm{cov}}=\frac{922}{1000}=0.922. $$

Its approximate Monte Carlo standard error is

$$ SE_{\mathrm{MC}}=\sqrt{\frac{0.922(1-0.922)}{1000}} =\sqrt{0.000071916}=0.00848. $$

This corresponds to about 0.848 percentage points of simulation error. For a rough 95% interval for the simulation probability, conditional on the model, calculate \(0.922\pm1.96(0.00848)\), giving approximately 0.905 to 0.939. If a hypothetical coverage target were 0.90, the point estimate and this approximate simulation-only interval are above that target. That observation does not include model-parameter uncertainty, and it is not a general bioequivalence decision unless the target and decision rule are justified in advance.

Common Pitfalls and Limits

  • Using marginal predictions as if they were paired. Dividing unrelated test and reference predictions creates a ratio distribution that depends on an arbitrary pairing. Generate both predictions for the same profile under a scientifically specified pairing rule.
  • Equating a geometric mean ratio with population coverage. The center does not determine the spread or the fraction inside the bounds. Calculate the coverage probability directly from the distribution of ratios.
  • Treating simulation error as total uncertainty. More simulated profiles reduce Monte Carlo error, not uncertainty caused by estimated parameters, model misspecification, or an incorrect target population.
  • Changing the scale or limits silently. Ratio bounds \(L,U\) correspond to log bounds \(\log L,\log U\). Applying ratio limits directly to log ratios is incorrect.

The main limitation is that the result is model-implied and population-specific. Changing the covariate distribution, endpoint, pairing assumptions, or limits can change the estimated fraction. A precise estimate under an inappropriate model is still an inappropriate estimate. The result should therefore be reported with its endpoint, target population, limits, model assumptions, simulated proportion, and Monte Carlo precision.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. With limits 0.80 and 1.25, what is the estimated coverage if 840 of 1000 simulated paired ratios are within the limits?
  2. Why is it not sufficient to simulate one test population and one independent reference population and divide their predictions in arbitrary pairs?
  3. A log-ratio model has \(\mu_X=0\), \(\sigma_X=0.10\), and limits 0.80 to 1.25. Write the expression for coverage using \(\Phi\). No numerical evaluation is required.
  4. What kind of uncertainty does the standard error \(\sqrt{\hat{p}_{\mathrm{cov}}(1-\hat{p}_{\mathrm{cov}})/M}\) describe, and what does it omit?

Solutions. (1) The estimate is \(840/1000=0.840\), or 84.0%. (2) Arbitrary pairing does not represent the same target profile under both formulations and therefore does not define the intended paired ratio distribution. (3) The expression is \(\Phi(\log(1.25)/0.10)-\Phi(\log(0.80)/0.10)\). (4) It estimates finite Monte Carlo sampling error conditional on the model and parameters; it omits uncertainty in those parameters and uncertainty about model structure and target-population specification.