Tutorials › Bioavailability and Bioequivalence › Population Predictions Versus Individual Predictions

Model-Based Bioequivalence · Tutorial 301 of 399

Population Predictions Versus Individual Predictions

Learn to choose and interpret model predictions according to whether the target is a typical subject, an observed individual, or the population distribution.

Advanced 10 min read

What You'll Learn

  • Define fixed-effects, empirical Bayes individual, and marginal population predictions
  • Distinguish predictions on the log-concentration scale from means on the concentration scale
  • Derive a marginal mean for a model with normally distributed random effects
  • Calculate and interpret a subject-specific empirical Bayes prediction
  • Match the prediction target to the bioequivalence question
  • Recognize shrinkage, extrapolation, and plug-in prediction limitations

Why the Prediction Target Matters

A pharmacokinetic model can produce several different predictions for the same formulation and sampling time. One may describe the model’s typical subject, another may use one participant’s observed concentrations to estimate that participant’s random effects, and a third may average predictions over the population distribution of random effects. These are different targets, not interchangeable computational versions of the same quantity.

The distinction matters when model predictions are used to describe exposure or compare formulations. The model may predict concentrations from which AUC or Cmax can be derived, but the interpretation of those derived quantities still depends on whose predictions are being summarized. A typical-subject prediction is not automatically a population average, and a subject-specific prediction is not automatically an estimate of the population’s average response.

Definition: A fixed-effects prediction evaluates the model using its estimated fixed effects and sets the random effects to their reference value, usually zero. An empirical Bayes individual prediction evaluates the model using fixed effects and an estimated random-effect value for a particular individual, informed by that individual’s data. A marginal population prediction averages the model prediction over the population distribution of random effects.

A Model That Makes the Distinctions Explicit

Let \(C_{if}(t)\) denote concentration for individual \(i\), formulation \(f\), at time \(t\). A general nonlinear mixed-effects model can be written as

$$ C_{if}(t)=h(f,t,x_i;\beta,b_i)+\varepsilon_{if}(t), \qquad b_i\sim G(0,\Omega). $$

Here \(h\) is the structural concentration model, \(x_i\) represents measured individual characteristics, \(\beta\) contains fixed effects, \(b_i\) contains individual random effects, and \(\varepsilon_{if}(t)\) is residual error. The random effects have population distribution \(G\), with mean zero and covariance matrix \(\Omega\). This formulation assumes that the structural model is appropriate, the random-effects distribution is specified adequately, and the residual model describes remaining observation error. The way predictions are formed does not make a misspecified model valid.

For clarity, the definitions below refer to the model’s structural prediction \(h\), before adding a new residual error. A prediction of a future measured concentration can also account for residual error, but that adds observation-level variability and is a different target.

$$ \begin{aligned} \text{Fixed-effects prediction:}\quad &\widehat C_{\mathrm{FE}}(f,t,x_i) =h(f,t,x_i;\widehat\beta,0),\\ \text{Empirical Bayes individual prediction:}\quad &\widehat C_{\mathrm{EB},i}(f,t) =h(f,t,x_i;\widehat\beta,\widehat b_i),\\ \text{Marginal population prediction:}\quad &\widehat C_{\mathrm{M}}(f,t,x) =\int h(f,t,x;\widehat\beta,b)\,d\widehat G(b). \end{aligned} $$

The empirical Bayes estimate \(\widehat b_i\) is typically obtained from the conditional distribution of the random effects given the individual’s data and the fitted model. It is shrunk toward the population mean when that individual’s data are limited or noisy. The marginal prediction instead averages across the distribution of individuals, including their random-effect variation.

The zero-random-effect prediction is often called a typical-subject prediction. It is a useful reference, but the individual with \(b_i=0\) need not exist in the sample, and this prediction is generally not the population mean on the concentration scale.

Why Marginal and Fixed-Effects Predictions Can Differ

If the model is linear in a random effect and the response is also on that linear scale, averaging over a zero-mean random effect can leave the mean unchanged. Nonlinear transformations change that result. In pharmacokinetic models, concentrations are often positive and a model may be specified for log concentration. Even if the random effect has mean zero on the log scale, exponentiating a typical log prediction does not generally give the arithmetic mean concentration.

For example, suppose the log concentration at a specified formulation and time is

$$ \log C=\eta+b,\qquad b\sim N(0,\omega^2). $$

The fixed-effects prediction on the concentration scale is \(\exp(\eta)\), corresponding to \(b=0\). To obtain the marginal arithmetic mean, average \(\exp(\eta+b)\) over the distribution of \(b\). Since a normal random variable \(b\) with mean zero and variance \(\omega^2\) satisfies \(E[\exp(b)]=\exp(\omega^2/2)\), it follows that

$$ E(C)=\exp(\eta)E[\exp(b)] =\exp\left(\eta+\frac{\omega^2}{2}\right). $$

Thus the marginal arithmetic mean exceeds the fixed-effects prediction whenever \(\omega^2>0\) in this model. The fixed-effects prediction is the median of this lognormal concentration distribution, while the marginal prediction is its arithmetic mean. The result depends on the model and scale: it should not be generalized to every possible structural model without checking how the random effects enter.

Worked Example: A Fixed-Effects Concentration Prediction

Suppose a hypothetical model for concentration is

$$ \log C_{if}(t)=\log(8)-0.5t+\log(1.10)I(f=\mathrm{Test})+b_i, $$

where \(C\) is in mg/L, \(t\) is in hours, \(I(f=\mathrm{Test})\) equals 1 for the test formulation and 0 for reference, and \(b_i\) is a mean-zero subject random effect. Find the fixed-effects prediction at \(t=2\) hours for each formulation.

For the reference formulation, set \(I=0\) and \(b_i=0\):

$$ \widehat C_{\mathrm{FE,Ref}}(2) =\exp\{\log(8)-0.5(2)\} =8e^{-1} \approx 2.943\ \mathrm{mg/L}. $$

For the test formulation, set \(I=1\) and \(b_i=0\):

$$ \widehat C_{\mathrm{FE,Test}}(2) =\exp\{\log(8)-1+\log(1.10)\} =8e^{-1}(1.10) \approx 3.237\ \mathrm{mg/L}. $$

The fixed-effects prediction is the model’s prediction for a subject whose random effect is zero. The test-to-reference ratio at this time for that prediction is \(3.237/2.943\approx1.100\). This calculation alone does not describe the distribution of individual ratios or the marginal arithmetic mean concentrations.

Empirical Bayes Predictions Use Individual Data

An empirical Bayes prediction answers a conditional question: given the fitted population model and the available observations for a particular individual, what random-effect value is estimated for that person, and what model prediction follows from it? It is not simply the observed concentration copied back into the model. The estimate balances the individual’s data against the population distribution, with the balance determined by the relative sizes of between-individual and residual variability.

A simple normal model makes this shrinkage visible. Suppose \(d_{ij}=y_{ij}-\mu\) are residuals from the fixed prediction on a log scale, and

$$ d_{ij}=b_i+\varepsilon_{ij},\qquad b_i\sim N(0,\omega^2),\qquad \varepsilon_{ij}\sim N(0,\sigma^2), $$

with independent residuals conditional on \(b_i\). For known variance components and \(n_i\) observations, the conditional mean of \(b_i\) is

$$ E(b_i\mid d_{i1},\ldots,d_{in_i}) = \frac{\omega^2}{\omega^2+\sigma^2/n_i}\bar d_i, \qquad \bar d_i=\frac{1}{n_i}\sum_{j=1}^{n_i}d_{ij}. $$

The multiplier is between zero and one. When residual variance is large relative to random-effect variance, the individual data provide weak evidence for a departure from zero, so the estimate is strongly shrunk. With more observations, \(\sigma^2/n_i\) decreases and the data can support a less-shrunk estimate. In a real analysis the variance components are estimated, so the resulting empirical Bayes prediction also inherits uncertainty from fitting the population model.

Worked Example: Shrinkage in an Individual Prediction

Consider the normal model above with \(\omega^2=0.16\), \(\sigma^2=0.09\), and two hypothetical log-scale residuals for one individual, \(d_{i1}=0.40\) and \(d_{i2}=0.20\). At the target formulation and time, suppose the fixed-effects log prediction is \(\mu=\log(4)\), with concentration measured in mg/L. Calculate the empirical Bayes prediction using the conditional mean of \(b_i\).

The individual’s mean residual is \(\bar d_i=(0.40+0.20)/2=0.30\). The shrinkage multiplier and conditional mean are

$$ \frac{0.16}{0.16+0.09/2} =\frac{0.16}{0.205} \approx0.7805, \qquad \widehat b_i=0.7805(0.30)\approx0.2341. $$

The individual log-scale prediction is \(\log(4)+0.2341\). On the concentration scale this is

$$ \widehat C_{\mathrm{EB},i} =\exp\{\log(4)+0.2341\} =4\exp(0.2341) \approx5.055\ \mathrm{mg/L}. $$

The estimate is above the fixed-effects prediction of 4 mg/L, but the residual mean of 0.30 is not used without adjustment: shrinkage gives an estimated random effect of about 0.2341. This is a plug-in individual prediction. It does not include the full uncertainty in the individual’s random effect or in the fitted model.

Marginal Predictions Average Across Individuals

A marginal prediction integrates the structural prediction over the population distribution of random effects. It answers what the model predicts after averaging across individuals, for a specified formulation, time, and covariate profile. When the model is nonlinear in the random effects, the integral may not have a closed form and may need numerical quadrature or another integration method. The distribution being averaged over must be the fitted population distribution, not the set of empirical Bayes estimates treated as if they were known population values.

Worked Example: Fixed Typical Value Versus Marginal Mean

Suppose, hypothetically, that at a particular formulation and time the model is

$$ \log C=\log(10)-1+b,\qquad b\sim N(0,0.25), $$

where concentration is in mg/L and \(0.25\) is the variance of the random effect on the log scale. Compare the fixed-effects concentration prediction with the marginal arithmetic mean.

At \(b=0\), the fixed-effects prediction is

$$ \widehat C_{\mathrm{FE}} =\exp\{\log(10)-1\} =10e^{-1} \approx3.679\ \mathrm{mg/L}. $$

The random effect has variance \(\omega^2=0.25\), so the normal-lognormal result gives

$$ E(C)=\exp\left\{\log(10)-1+\frac{0.25}{2}\right\} =10e^{-0.875} \approx4.169\ \mathrm{mg/L}. $$

The marginal mean is higher because exponentiation is nonlinear and the concentration distribution is right-skewed. The value 3.679 mg/L is the median of the modeled concentration distribution, not its arithmetic mean. Both summaries are valid, but they answer different questions.

Choosing a Prediction for a Bioequivalence Question

The appropriate prediction is determined by the estimand: the quantity the analysis is intended to describe. The earlier material on model-based bioequivalence estimands establishes that the target must be specified before interpreting a model contrast. Prediction type is one part of that specification.

PredictionQuestion it answersImportant qualification
Fixed-effectsWhat does the fitted model predict for the reference individual with random effects set to zero?In a nonlinear model, this is not generally a population arithmetic mean.
Empirical Bayes individualWhat does the fitted model predict for this individual after using their observed data?It is conditional on the individual’s data and is subject to shrinkage and estimation uncertainty.
Marginal populationWhat is the model prediction averaged over the population distribution of random effects?The averaging scale matters; for concentrations, an arithmetic mean differs from a mean on the log scale.

A fixed-effects contrast is often useful for describing a model’s typical-subject formulation effect. An empirical Bayes contrast can describe how the model predicts a particular participant under different formulations, if the design and data support that individual-level target. A marginal contrast is relevant when the question concerns the modeled population average. These choices do not by themselves establish bioequivalence; the intended target and decision rule must both be appropriate to the scientific question.

For a paired crossover comparison, care is needed in constructing individual predictions. If the aim is to compare formulations for the same individual, that individual’s shared random effects should be held consistently across the two formulation predictions. If a formulation-by-subject random effect is part of the model, its role also has to match the target. Otherwise, a calculated difference may mix formulation change with an inconsistent change in the assumed individual. Prediction calculations should follow the model structure rather than silently changing random effects between conditions.

Diagnostics, Failure Modes, and Limitations

Predictions are only as credible as the model and the data supporting them. Useful checks depend on the target:

  • Fixed-effects prediction: check whether the chosen covariate values and times are within the range adequately represented by the data. A neat prediction at an unsupported time or covariate profile may be extrapolation, not reliable evidence.
  • Empirical Bayes prediction: inspect how much information each individual contributes and whether estimates are excessively shrunk. Very sparse data can make individual predictions resemble the population typical prediction, even when the true individual response differs.
  • Marginal prediction: verify the random-effects distribution, covariance structure, and integration calculation. In a nonlinear model, replacing the integral with the prediction at mean random effects can produce a biased target.
  • All predictions: assess structural fit and residual patterns. A wrong absorption or disposition structure can yield misleading concentrations and derived exposure quantities even if numerical calculations are exact.

A frequent mistake is to call \(\exp(\eta)\) the population mean concentration whenever the model is written for log concentration. This is the typical-subject prediction and, under the normal random-intercept model, the median; the population arithmetic mean is \(\exp(\eta+\omega^2/2)\). A second mistake is to interpret empirical Bayes estimates as direct observations of each person’s true parameters. They are conditional estimates, typically shrunk and uncertain. A third is to assume that the marginal mean is always the right target: it is right only when the scientific question calls for that population average.

These prediction types are not substitutes for uncertainty intervals. A plug-in predicted curve does not show uncertainty in fixed effects, random effects, residual error, or model structure. Likewise, prediction differences do not automatically give a formal equivalence conclusion. They are summaries generated under a model, and their scope should be stated precisely.

Key takeaway: Fixed-effects predictions describe a reference or typical subject, empirical Bayes predictions condition on an individual’s data, and marginal predictions average over the population random-effects distribution. Always name the target, response scale, and conditioning information before interpreting a prediction.

Check Your Understanding

Answer each question, then compare with the solutions below.

  1. In a model with \(\log C=\eta+b\), where \(b\sim N(0,0.36)\), what is the fixed-effects prediction on the concentration scale, and what is the marginal arithmetic mean?
  2. Why can an empirical Bayes random-effect estimate be close to zero even when an individual’s observed concentrations are somewhat above the model’s fixed-effects predictions?
  3. A question asks for the model-predicted mean concentration across the target population. Which prediction type is appropriate, and what must be averaged over?
  4. True or false: setting all random effects to zero always gives the population mean response.
  5. What should be held consistent when comparing two formulations for one individual in a model with shared subject random effects?

Solutions. (1) The fixed-effects prediction is \(\exp(\eta)\). The marginal arithmetic mean is \(\exp(\eta+0.36/2)=\exp(\eta+0.18)\), which is about \(1.197\exp(\eta)\). (2) The estimate is shrunk toward the population mean of zero; this is more pronounced with few observations or large residual variance relative to between-individual variance. (3) Use a marginal population prediction and average the structural prediction over the fitted random-effects distribution. (4) False. In nonlinear models, evaluating at mean random effects need not equal averaging the response over the random-effects distribution. (5) Use the same shared subject random effects for both formulation predictions; include any formulation-specific random effects according to the specified model and target.