Why the Prediction Target Matters
A pharmacokinetic model can produce several different predictions for the same formulation and sampling time. One may describe the model’s typical subject, another may use one participant’s observed concentrations to estimate that participant’s random effects, and a third may average predictions over the population distribution of random effects. These are different targets, not interchangeable computational versions of the same quantity.
The distinction matters when model predictions are used to describe exposure or compare formulations. The model may predict concentrations from which AUC or Cmax can be derived, but the interpretation of those derived quantities still depends on whose predictions are being summarized. A typical-subject prediction is not automatically a population average, and a subject-specific prediction is not automatically an estimate of the population’s average response.
A Model That Makes the Distinctions Explicit
Let \(C_{if}(t)\) denote concentration for individual \(i\), formulation \(f\), at time \(t\). A general nonlinear mixed-effects model can be written as
Here \(h\) is the structural concentration model, \(x_i\) represents measured individual characteristics, \(\beta\) contains fixed effects, \(b_i\) contains individual random effects, and \(\varepsilon_{if}(t)\) is residual error. The random effects have population distribution \(G\), with mean zero and covariance matrix \(\Omega\). This formulation assumes that the structural model is appropriate, the random-effects distribution is specified adequately, and the residual model describes remaining observation error. The way predictions are formed does not make a misspecified model valid.
For clarity, the definitions below refer to the model’s structural prediction \(h\), before adding a new residual error. A prediction of a future measured concentration can also account for residual error, but that adds observation-level variability and is a different target.
The empirical Bayes estimate \(\widehat b_i\) is typically obtained from the conditional distribution of the random effects given the individual’s data and the fitted model. It is shrunk toward the population mean when that individual’s data are limited or noisy. The marginal prediction instead averages across the distribution of individuals, including their random-effect variation.
The zero-random-effect prediction is often called a typical-subject prediction. It is a useful reference, but the individual with \(b_i=0\) need not exist in the sample, and this prediction is generally not the population mean on the concentration scale.
Why Marginal and Fixed-Effects Predictions Can Differ
If the model is linear in a random effect and the response is also on that linear scale, averaging over a zero-mean random effect can leave the mean unchanged. Nonlinear transformations change that result. In pharmacokinetic models, concentrations are often positive and a model may be specified for log concentration. Even if the random effect has mean zero on the log scale, exponentiating a typical log prediction does not generally give the arithmetic mean concentration.
For example, suppose the log concentration at a specified formulation and time is
The fixed-effects prediction on the concentration scale is \(\exp(\eta)\), corresponding to \(b=0\). To obtain the marginal arithmetic mean, average \(\exp(\eta+b)\) over the distribution of \(b\). Since a normal random variable \(b\) with mean zero and variance \(\omega^2\) satisfies \(E[\exp(b)]=\exp(\omega^2/2)\), it follows that
Thus the marginal arithmetic mean exceeds the fixed-effects prediction whenever \(\omega^2>0\) in this model. The fixed-effects prediction is the median of this lognormal concentration distribution, while the marginal prediction is its arithmetic mean. The result depends on the model and scale: it should not be generalized to every possible structural model without checking how the random effects enter.
Worked Example: A Fixed-Effects Concentration Prediction
Suppose a hypothetical model for concentration is
where \(C\) is in mg/L, \(t\) is in hours, \(I(f=\mathrm{Test})\) equals 1 for the test formulation and 0 for reference, and \(b_i\) is a mean-zero subject random effect. Find the fixed-effects prediction at \(t=2\) hours for each formulation.
For the reference formulation, set \(I=0\) and \(b_i=0\):
For the test formulation, set \(I=1\) and \(b_i=0\):
The fixed-effects prediction is the model’s prediction for a subject whose random effect is zero. The test-to-reference ratio at this time for that prediction is \(3.237/2.943\approx1.100\). This calculation alone does not describe the distribution of individual ratios or the marginal arithmetic mean concentrations.
Empirical Bayes Predictions Use Individual Data
An empirical Bayes prediction answers a conditional question: given the fitted population model and the available observations for a particular individual, what random-effect value is estimated for that person, and what model prediction follows from it? It is not simply the observed concentration copied back into the model. The estimate balances the individual’s data against the population distribution, with the balance determined by the relative sizes of between-individual and residual variability.
A simple normal model makes this shrinkage visible. Suppose \(d_{ij}=y_{ij}-\mu\) are residuals from the fixed prediction on a log scale, and
with independent residuals conditional on \(b_i\). For known variance components and \(n_i\) observations, the conditional mean of \(b_i\) is
The multiplier is between zero and one. When residual variance is large relative to random-effect variance, the individual data provide weak evidence for a departure from zero, so the estimate is strongly shrunk. With more observations, \(\sigma^2/n_i\) decreases and the data can support a less-shrunk estimate. In a real analysis the variance components are estimated, so the resulting empirical Bayes prediction also inherits uncertainty from fitting the population model.
Worked Example: Shrinkage in an Individual Prediction
Consider the normal model above with \(\omega^2=0.16\), \(\sigma^2=0.09\), and two hypothetical log-scale residuals for one individual, \(d_{i1}=0.40\) and \(d_{i2}=0.20\). At the target formulation and time, suppose the fixed-effects log prediction is \(\mu=\log(4)\), with concentration measured in mg/L. Calculate the empirical Bayes prediction using the conditional mean of \(b_i\).
The individual’s mean residual is \(\bar d_i=(0.40+0.20)/2=0.30\). The shrinkage multiplier and conditional mean are
The individual log-scale prediction is \(\log(4)+0.2341\). On the concentration scale this is
The estimate is above the fixed-effects prediction of 4 mg/L, but the residual mean of 0.30 is not used without adjustment: shrinkage gives an estimated random effect of about 0.2341. This is a plug-in individual prediction. It does not include the full uncertainty in the individual’s random effect or in the fitted model.
Marginal Predictions Average Across Individuals
A marginal prediction integrates the structural prediction over the population distribution of random effects. It answers what the model predicts after averaging across individuals, for a specified formulation, time, and covariate profile. When the model is nonlinear in the random effects, the integral may not have a closed form and may need numerical quadrature or another integration method. The distribution being averaged over must be the fitted population distribution, not the set of empirical Bayes estimates treated as if they were known population values.
Worked Example: Fixed Typical Value Versus Marginal Mean
Suppose, hypothetically, that at a particular formulation and time the model is
where concentration is in mg/L and \(0.25\) is the variance of the random effect on the log scale. Compare the fixed-effects concentration prediction with the marginal arithmetic mean.
At \(b=0\), the fixed-effects prediction is
The random effect has variance \(\omega^2=0.25\), so the normal-lognormal result gives
The marginal mean is higher because exponentiation is nonlinear and the concentration distribution is right-skewed. The value 3.679 mg/L is the median of the modeled concentration distribution, not its arithmetic mean. Both summaries are valid, but they answer different questions.
Choosing a Prediction for a Bioequivalence Question
The appropriate prediction is determined by the estimand: the quantity the analysis is intended to describe. The earlier material on model-based bioequivalence estimands establishes that the target must be specified before interpreting a model contrast. Prediction type is one part of that specification.
| Prediction | Question it answers | Important qualification |
|---|---|---|
| Fixed-effects | What does the fitted model predict for the reference individual with random effects set to zero? | In a nonlinear model, this is not generally a population arithmetic mean. |
| Empirical Bayes individual | What does the fitted model predict for this individual after using their observed data? | It is conditional on the individual’s data and is subject to shrinkage and estimation uncertainty. |
| Marginal population | What is the model prediction averaged over the population distribution of random effects? | The averaging scale matters; for concentrations, an arithmetic mean differs from a mean on the log scale. |
A fixed-effects contrast is often useful for describing a model’s typical-subject formulation effect. An empirical Bayes contrast can describe how the model predicts a particular participant under different formulations, if the design and data support that individual-level target. A marginal contrast is relevant when the question concerns the modeled population average. These choices do not by themselves establish bioequivalence; the intended target and decision rule must both be appropriate to the scientific question.
For a paired crossover comparison, care is needed in constructing individual predictions. If the aim is to compare formulations for the same individual, that individual’s shared random effects should be held consistently across the two formulation predictions. If a formulation-by-subject random effect is part of the model, its role also has to match the target. Otherwise, a calculated difference may mix formulation change with an inconsistent change in the assumed individual. Prediction calculations should follow the model structure rather than silently changing random effects between conditions.
Diagnostics, Failure Modes, and Limitations
Predictions are only as credible as the model and the data supporting them. Useful checks depend on the target:
- Fixed-effects prediction: check whether the chosen covariate values and times are within the range adequately represented by the data. A neat prediction at an unsupported time or covariate profile may be extrapolation, not reliable evidence.
- Empirical Bayes prediction: inspect how much information each individual contributes and whether estimates are excessively shrunk. Very sparse data can make individual predictions resemble the population typical prediction, even when the true individual response differs.
- Marginal prediction: verify the random-effects distribution, covariance structure, and integration calculation. In a nonlinear model, replacing the integral with the prediction at mean random effects can produce a biased target.
- All predictions: assess structural fit and residual patterns. A wrong absorption or disposition structure can yield misleading concentrations and derived exposure quantities even if numerical calculations are exact.
A frequent mistake is to call \(\exp(\eta)\) the population mean concentration whenever the model is written for log concentration. This is the typical-subject prediction and, under the normal random-intercept model, the median; the population arithmetic mean is \(\exp(\eta+\omega^2/2)\). A second mistake is to interpret empirical Bayes estimates as direct observations of each person’s true parameters. They are conditional estimates, typically shrunk and uncertain. A third is to assume that the marginal mean is always the right target: it is right only when the scientific question calls for that population average.
These prediction types are not substitutes for uncertainty intervals. A plug-in predicted curve does not show uncertainty in fixed effects, random effects, residual error, or model structure. Likewise, prediction differences do not automatically give a formal equivalence conclusion. They are summaries generated under a model, and their scope should be stated precisely.
Check Your Understanding
Answer each question, then compare with the solutions below.
- In a model with \(\log C=\eta+b\), where \(b\sim N(0,0.36)\), what is the fixed-effects prediction on the concentration scale, and what is the marginal arithmetic mean?
- Why can an empirical Bayes random-effect estimate be close to zero even when an individual’s observed concentrations are somewhat above the model’s fixed-effects predictions?
- A question asks for the model-predicted mean concentration across the target population. Which prediction type is appropriate, and what must be averaged over?
- True or false: setting all random effects to zero always gives the population mean response.
- What should be held consistent when comparing two formulations for one individual in a model with shared subject random effects?
Solutions. (1) The fixed-effects prediction is \(\exp(\eta)\). The marginal arithmetic mean is \(\exp(\eta+0.36/2)=\exp(\eta+0.18)\), which is about \(1.197\exp(\eta)\). (2) The estimate is shrunk toward the population mean of zero; this is more pronounced with few observations or large residual variance relative to between-individual variance. (3) Use a marginal population prediction and average the structural prediction over the fitted random-effects distribution. (4) False. In nonlinear models, evaluating at mean random effects need not equal averaging the response over the random-effects distribution. (5) Use the same shared subject random effects for both formulation predictions; include any formulation-specific random effects according to the specified model and target.