Tutorials › Nonlinear Mixed-Effects Models (NLME) › Defining Parameter Uncertainty in Nonlinear Mixed-Effects Models

Bootstrap, Profile Likelihood and Parameter Uncertainty · Tutorial 608 of 797

Defining Parameter Uncertainty in Nonlinear Mixed-Effects Models

Learn to identify the exact population or derived quantity an NLME confidence interval describes, and why that target matters for interpretation.

Advanced 11 min read

What You'll Learn

  • Distinguish population fixed effects from between-subject variability and residual error
  • Identify whether an interval targets a variance, standard deviation, covariance, or correlation
  • Separate uncertainty in population parameters from uncertainty about an individual’s random effect
  • Recognize when a pharmacokinetic quantity is derived from several fitted parameters
  • Interpret confidence intervals in context, including their units and constraints
  • Detect common target mismatches and weakly identified parameters

What Does a Parameter Confidence Interval Describe?

An NLME model can estimate several kinds of quantities at once. A confidence interval for a population typical clearance, a confidence interval for between-subject variability in clearance, and a prediction interval for one patient’s clearance do not answer the same question. Before interpreting any interval, identify the exact quantity it targets.

For subject \(i\) at observation \(j\), a general model can be written as

$$ y_{ij}=f(t_{ij},D_{ij};\theta,\eta_i)+\varepsilon_{ij}, \qquad \eta_i\sim N(0,\Omega). $$

Here \(y_{ij}\) is the observation, \(f\) is the structural model, \(t_{ij}\) and \(D_{ij}\) represent the observation time and dosing information, \(\theta\) contains population fixed effects, and \(\eta_i\) contains subject-specific random effects. The covariance matrix \(\Omega\) describes between-subject variation and association among those random effects. The residual error \(\varepsilon_{ij}\) describes observation-level variation not accounted for by the structural and random-effects parts of the model. A complete fitted model may also have residual-error parameters.

Definition: A parameter confidence interval is an interval procedure intended, under its stated assumptions and repeated sampling from the model, to cover a specified fixed population quantity at a stated rate. A 95% confidence procedure has 95% coverage in repeated samples under those assumptions. The interval targets the named quantity, not an unspecified notion of “model uncertainty.”

In a frequentist interpretation, once the data have been observed, the parameter is treated as fixed and the computed interval is fixed. The 95% refers to the long-run coverage of the procedure, not to a 95% probability that this particular interval contains the parameter. The interval is also conditional on the chosen model, its assumptions, and the analysis design; it does not automatically account for uncertainty about whether the model form is correct.

Population Effects, Variability, and Individual Effects

A population fixed effect describes a feature of the population model. For example, \(\theta_{\mathrm{CL}}\) might be the typical clearance on the model’s parameter scale, or a fixed-effect coefficient might describe the change in log clearance associated with a covariate. The meaning depends on the structural model and parameterization.

By contrast, a random effect \(\eta_i\) represents a subject’s deviation from the population relationship. In the model above, the \(\eta_i\) values vary across subjects, while \(\Omega\) is a population-level covariance parameter. The fitted estimate of a subject’s random effect is not itself a population parameter. Nor is its uncertainty interval interchangeable with a confidence interval for a component of \(\Omega\).

Residual-error parameters are another target class. They describe the assumed observation-level error distribution, not between-subject differences in clearance or volume. Thus, an interval for a residual standard deviation and one for a random-effect standard deviation refer to different sources of variation, even if both are reported in similar units.

Key distinction: Population uncertainty concerns how precisely the data estimate a fixed population quantity such as \(\theta\), \(\Omega\), or a residual-error parameter. Between-subject variability describes differences among subjects under the model. Individual uncertainty concerns a subject-specific random effect or future outcome. These are related, but not interchangeable.

Worked Example: A Population Clearance Effect

Suppose a hypothetical model reports typical clearance \(\theta_{\mathrm{CL}}=5.0\) L/h with a 95% confidence interval of 4.4 to 5.8 L/h. The interval targets the population typical clearance, not the clearance of every individual.

The point estimate is centered within the interval only approximately: \((4.4+5.8)/2=5.1\) L/h, which need not equal 5.0 L/h. The interval’s width is \(5.8-4.4=1.4\) L/h. Under the assumptions of the interval procedure, repeated intervals constructed in the same way would cover the true population typical clearance about 95% of the time.

The 1.4 L/h width does not mean that 95% of subjects have clearances between 4.4 and 5.8 L/h. That would be a statement about the distribution of individual clearances, not uncertainty in the population typical value. An individual prediction interval would require a different target and would reflect between-subject variability as well as relevant observation-level uncertainty.

Variance Components, Standard Deviations, and Correlations

For a random effect with variance \(\omega^2\), the corresponding standard deviation is \(\omega=\sqrt{\omega^2}\). The variance is in squared units of the random effect; the standard deviation is in the original units. If random effects act on a log scale, those units are log-scale units, and the standard deviation is not directly a clearance standard deviation in L/h.

For two random effects with variances \(\omega_1^2\) and \(\omega_2^2\), and covariance \(\omega_{12}\), their correlation is

$$ \rho_{12}=\frac{\omega_{12}}{\sqrt{\omega_1^2\omega_2^2}}. $$

A variance, covariance, and correlation are distinct fitted-model quantities. Variances and covariances have scale-dependent units; correlation is dimensionless and constrained to \([-1,1]\). An interval for a variance does not automatically provide an interval for its standard deviation or for a correlation. Each requires its own target and appropriate treatment of the parameter’s constraints.

Worked Example: Identifying a Random-Effects Correlation

Consider a hypothetical model with random effects on log clearance and log volume. Suppose the estimated variance for log clearance is \(0.16\), the estimated variance for log volume is \(0.09\), and their estimated covariance is \(0.06\). These values form a valid two-dimensional covariance matrix because the variances are positive and its determinant is positive:

$$ 0.16(0.09)-(0.06)^2=0.0144-0.0036=0.0108>0. $$

The estimated correlation is

$$ \hat{\rho}_{\mathrm{CL,V}}=\frac{0.06}{\sqrt{0.16(0.09)}}=\frac{0.06}{\sqrt{0.0144}}=\frac{0.06}{0.12}=0.50. $$

The estimate 0.50 describes positive association between the two random effects in the population model. If a hypothetical 95% interval for this correlation were \(-0.08\) to \(0.78\), that interval would target the population correlation, not either variance or covariance. Because it includes zero, it is compatible with no correlation under the interval procedure; it does not establish that the true correlation is zero.

Derived Pharmacokinetic Quantities

Some quantities of pharmacokinetic interest are functions of fitted parameters rather than parameters estimated independently. Examples include a treatment-group clearance ratio, an individual arithmetic mean derived from a lognormal model, or a half-life calculated from clearance and volume. An interval for such a quantity targets the function itself. It is not necessarily equivalent to an interval for any one input parameter.

For example, suppose individual clearance follows a lognormal random-effects model:

$$ \log(\mathrm{CL}_i)=\mu_{\mathrm{CL}}+\eta_i,\qquad \eta_i\sim N(0,\omega_{\mathrm{CL}}^2). $$

Then \(\exp(\mu_{\mathrm{CL}})\) is the median individual clearance (and the typical value under this parameterization), whereas the arithmetic population mean depends on both \(\mu_{\mathrm{CL}}\) and \(\omega_{\mathrm{CL}}^2\). This distinction matters because a confidence interval for \(\mu_{\mathrm{CL}}\) does not, by itself, give an interval for the arithmetic mean individual clearance.

Worked Example: Typical Clearance Versus Mean Individual Clearance

Assume a hypothetical lognormal clearance model with \(\mu_{\mathrm{CL}}=\log(5.0)\) and \(\omega_{\mathrm{CL}}^2=0.25\). The typical clearance is

$$ \exp(\mu_{\mathrm{CL}})=\exp(\log(5.0))=5.0\ \mathrm{L/h}. $$

The arithmetic mean individual clearance is instead

$$ E(\mathrm{CL}_i)=\exp\left(\mu_{\mathrm{CL}}+\frac{\omega_{\mathrm{CL}}^2}{2}\right) =\exp\left(\log(5.0)+\frac{0.25}{2}\right) =5.0\exp(0.125)\approx 5.666\ \mathrm{L/h}. $$

The two point estimates differ because the distribution is right-skewed. A hypothetical interval of 4.4 to 5.8 L/h for typical clearance targets \(\exp(\mu_{\mathrm{CL}})\); a hypothetical interval of 4.8 to 6.8 L/h for the arithmetic mean targets \(\exp(\mu_{\mathrm{CL}}+\omega_{\mathrm{CL}}^2/2)\). The latter depends on uncertainty in both \(\mu_{\mathrm{CL}}\) and \(\omega_{\mathrm{CL}}^2\), including their estimation dependence. It cannot be identified merely by relabeling an interval for typical clearance.

Why Derived Quantities Depend on Multiple Estimates

The dependence in the previous example follows directly from the lognormal model. If \(Z\sim N(0,\omega^2)\), its exponential moment is \(E[\exp(Z)]=\exp(\omega^2/2)\). Therefore,

$$ E(\mathrm{CL}_i) =E\{\exp(\mu_{\mathrm{CL}}+\eta_i)\} =\exp(\mu_{\mathrm{CL}})E\{\exp(\eta_i)\} =\exp\left(\mu_{\mathrm{CL}}+\frac{\omega_{\mathrm{CL}}^2}{2}\right). $$

This derivation shows why the interval target must be stated precisely: the arithmetic mean is a function of two population parameters, while the typical value is a function of one. In general, if a quantity of interest is \(g(\phi)\), where \(\phi\) is a vector of fitted population parameters, an interval for one component of \(\phi\) is not automatically an interval for \(g(\phi)\). The uncertainty calculation must correspond to the complete function and its inputs.

Worked Example: A Covariate Effect as a Clearance Ratio

Suppose a hypothetical model gives the log-clearance coefficient for a treatment indicator as \(\theta_{\mathrm{trt}}=-0.223\), with a 95% interval from \(-0.400\) to \(-0.050\). In a log-linear model, the treatment-to-reference typical clearance ratio is \(\exp(\theta_{\mathrm{trt}})\). Its point estimate is

$$ \exp(-0.223)\approx 0.800. $$

Applying the same increasing exponential function to the endpoints gives the interval for the ratio:

$$ \left(\exp(-0.400),\exp(-0.050)\right)\approx(0.6703,0.9512). $$

The ratio estimate means the treatment group’s typical clearance is estimated to be 0.800 times the reference group’s, or about 20.0% lower, under this model. The interval targets the typical clearance ratio, a dimensionless derived quantity. It is not an interval for the log coefficient measured in log units, nor is it an interval for individual treatment effects.

Assumptions, Diagnostics, and Limits

An interval’s interpretation requires that the fitted model and the interval procedure be appropriate for the target. At a minimum, the population structure, random-effects distribution, residual-error model, and independence assumptions must be defensible for the data and design. The target must also be identifiable: the observations need to contain enough information to distinguish it from competing parameters. These assumptions do not become true merely because an estimation program returns an interval.

Warning signs include estimates on or near a parameter boundary, extremely wide intervals, strong dependence between parameters, unstable estimates across reasonable model fits, and intervals that conflict with the parameter’s allowed range. A variance cannot be negative and a correlation cannot fall outside \([-1,1]\); an interval extending into impossible values is a reason to question the approximation or procedure, not to interpret those values literally. Sparse sampling, weak information about a random-effect distribution, or confounding between fixed effects can also make a target poorly determined.

The main alternatives in interpretation are not competing labels for the same interval. A confidence interval for a population quantity describes uncertainty in its estimation; a prediction interval describes a future or individual outcome under a specified model; and an interval for an individual random effect concerns a subject-specific latent quantity. These may be reported together, but each answers a different question. Likewise, an interval for a directly fitted parameter and one for a derived PK quantity differ by their target, even if they are based on the same fitted model.

A confidence interval is conditional on the model and does not quantify every source of scientific uncertainty. It does not, by itself, account for model-selection uncertainty, misspecification, or uncertainty about whether the selected population is relevant to a new setting. Reporting the target, scale, units, and population interpretation makes these limits visible.

Common Mistakes

  • Calling a population interval an individual range. An interval for typical clearance is not the range expected to contain most patients’ clearances; that requires a distributional or predictive quantity.
  • Confusing variability with uncertainty. A large random-effects variance indicates substantial population heterogeneity, not necessarily imprecise estimation of that variance. Conversely, an imprecise variance estimate can occur even when the estimated variability is modest.
  • Reporting a derived quantity without naming its inputs. A mean individual clearance under a lognormal model depends on both the typical log clearance and its random-effect variance.
  • Ignoring scale and units. A variance on a log scale is not a clearance variance in \((\mathrm{L/h})^2\), and a correlation has no units.
  • Reading an interval as a probability statement about the fixed parameter. A 95% confidence procedure has long-run 95% coverage under its assumptions; it does not assign a 95% probability to the parameter being in the observed interval.
Key takeaway: Before interpreting any NLME interval, name its target: a population fixed effect, a variance or correlation, a residual-error parameter, an individual quantity, or a derived pharmacokinetic function. Then state its scale, units, and population meaning.

Check Your Understanding

For each question, identify the target and distinguish it from the nearest competing quantity.

  1. A 95% interval is reported for a population variance of log clearance. Is it an interval for individual clearances?
  2. A fitted model reports a covariance between random effects for log clearance and log volume. What additional quantities are needed to express their correlation?
  3. In a lognormal clearance model, why is an interval for typical clearance not automatically an interval for the arithmetic mean individual clearance?
  4. A 95% interval for a treatment coefficient on log clearance is reported. What does the exponentiated interval target in a log-linear model?

Solutions. (1) No. It targets the population variance of the random effect on the log-clearance scale; individual clearances vary across subjects and are not bounded by that confidence interval. (2) The two random-effect variances are needed: divide the covariance by the square root of their product to obtain the correlation. (3) The arithmetic mean is \(\exp(\mu_{\mathrm{CL}}+\omega_{\mathrm{CL}}^2/2)\), so it depends on both the typical log clearance and the random-effect variance. (4) It targets the treatment-to-reference ratio of typical clearances, a dimensionless derived quantity, rather than the log coefficient itself.