Tutorials › Nonlinear Mixed-Effects Models (NLME) › Reading Parameter Dependence in Simulated Outcomes

Simulation From Fitted Models · Tutorial 699 of 797

Reading Parameter Dependence in Simulated Outcomes

Trace how dependence among fitted parameters carries through a model into simulated concentrations and derived exposure measures, while keeping each simulated parameter vector intact.

Intermediate 12 min read

What You'll Learn

  • Explain why fitted parameters must be drawn and used as paired vectors.
  • Trace clearance–volume dependence into concentration at a specified time.
  • Use log-scale covariance to assess variability in the elimination rate and its relation to AUC.
  • Distinguish changes caused by parameter dependence from changes in marginal parameter uncertainty.
  • Recognize when derived measures are or are not affected by dependence.
  • Diagnose broken pairings and understand the limits of finite simulation draws.

Why Parameter Dependence Matters

A fitted model does not usually estimate each parameter in isolation. For example, the data may support several combinations of clearance and volume that produce similar concentration profiles. A parameter-uncertainty simulation represents that joint uncertainty by drawing a complete parameter vector for each replicate. If the entries are separated, shuffled independently, or replaced by their marginal averages, the resulting combinations may no longer reflect the fitted model’s uncertainty.

The practical question is not simply whether two parameter estimates are correlated. It is how their dependence carries through the model’s equations into a prediction, such as concentration at a particular time, or a derived measure, such as area under the concentration-time curve (AUC). The direction and size of the effect depend on the model and the outcome being calculated. Some outcomes are sensitive to the dependence; others depend on only one parameter and are unchanged by it.

Definition: A paired parameter draw is one draw of the full fitted parameter vector, with all its components kept together. If \(\theta^{(m)}\) denotes the vector for replicate \(m\), each model prediction for that replicate is calculated using that same \(\theta^{(m)}\). Dependence is preserved when the simulated vectors retain the joint distribution represented by the fitted uncertainty draws.

Here, \(\theta\) denotes the fitted parameters being propagated, such as population fixed effects. A subject-specific prediction may also use a random-effect draw, but the focus here is the dependence among fitted parameters. To isolate its effect, examples first calculate a typical model prediction without residual error or a new subject’s random effects. Those additional sources of variation can be included in a larger simulation, but they should not be confused with parameter dependence.

From Parameter Pairing to a Concentration Profile

Consider a one-compartment model after an intravenous bolus dose \(D\), with clearance \(CL\) and volume \(V\). For positive \(CL\) and \(V\), the concentration at time \(t\) is

$$ C(t;CL,V)=\frac{D}{V}\exp\left(-\frac{CL}{V}t\right). $$

The equation contains both parameters in two different ways: \(V\) determines the initial concentration \(D/V\), while the ratio \(CL/V\) determines the elimination rate. A change in their dependence can therefore change the profile even when the marginal set of clearance values and the marginal set of volume values are unchanged.

The model assumes the stated dose and dosing time, linear one-compartment elimination, and positive parameters. It also treats the calculated profile as a structural prediction: no residual error or additional subject variability is added. In an applied simulation, the fitted model and the intended prediction target must justify these choices.

Worked Example: Paired and Independently Combined Draws

Suppose the dose is \(100\) mg, and two hypothetical fitted-parameter draws are \((CL,V)=(4\ \mathrm{L/h},20\ \mathrm{L})\) and \((6\ \mathrm{L/h},30\ \mathrm{L})\). Each has \(CL/V=0.2\ \mathrm{h}^{-1}\). Calculate concentration at \(t=2\) h using the paired draws, then compare with a simulation that combines the same marginal values in all possible combinations.

For the first paired draw, \(C(2)= (100/20)\exp[-(4/20)(2)]=5\exp(-0.4)\approx 3.352\ \mathrm{mg/L}\). For the second, \(C(2)=(100/30)\exp[-(6/30)(2)]=(10/3)\exp(-0.4)\approx 2.234\ \mathrm{mg/L}\). The mean calculated from the unrounded concentrations is approximately \((3.351600+2.234400)/2=2.793\ \mathrm{mg/L}\).

The marginal clearance values are \(4\) and \(6\ \mathrm{L/h}\), and the marginal volume values are \(20\) and \(30\ \mathrm{L}\). Combining those marginals independently gives four equally weighted combinations. Their concentrations at 2 h are approximately \(3.352\), \(2.553\), \(2.744\), and \(2.234\ \mathrm{mg/L}\), corresponding respectively to \((4,20),(4,30),(6,20),(6,30)\). Their mean, calculated from the unrounded concentrations, is approximately \(2.721\ \mathrm{mg/L}\).

The paired draws have perfect positive association in this small constructed example; the four-combination calculation represents independence, not the same paired uncertainty. Both calculations use the same marginal parameter values, but produce different mean concentrations at 2 h. This illustrates the effect of dependence after a nonlinear model transformation. It does not imply that the paired mean is always greater: the result depends on the model, time, and joint parameter distribution.

A Short Covariance Derivation

The ratio \(CL/V\) is especially important because it controls the exponential decline. On a log scale, its natural logarithm is a difference. Let \(X=\log(CL)\) and \(Y=\log(V)\). Then \(\log(CL/V)=X-Y\). For any two random variables with finite variances,

$$ \operatorname{Var}(X-Y) =\operatorname{Var}(X)+\operatorname{Var}(Y)-2\operatorname{Cov}(X,Y). $$

This follows by expanding the variance: \(\operatorname{Var}(X-Y)=E[((X-E[X])-(Y-E[Y]))^2]\). Expanding the square gives the two variance terms minus twice \(E[(X-E[X])(Y-E[Y])]\), which is \(\operatorname{Cov}(X,Y)\). Thus, positive covariance on the log scale can reduce uncertainty in the log elimination rate; negative covariance can increase it. This conclusion concerns variability in the ratio, not a guarantee about every point on the concentration curve.

Worked Example: Dependence and Uncertainty in the Elimination Rate

Suppose the hypothetical fitted uncertainty has standard deviations \(0.20\) for \(\log(CL)\) and \(0.30\) for \(\log(V)\), with correlation \(0.80\). Find the standard deviation of \(\log(CL/V)\), and compare it with the value under zero correlation while holding those marginal standard deviations fixed.

The covariance under correlation \(0.80\) is \(0.80(0.20)(0.30)=0.048\). Therefore, \(\operatorname{Var}[\log(CL/V)]=0.20^2+0.30^2-2(0.048)=0.034\), and its standard deviation is \(\sqrt{0.034}\approx 0.1844\).

If the correlation were zero, the covariance would be zero, giving variance \(0.20^2+0.30^2=0.130\) and standard deviation \(\sqrt{0.130}\approx 0.3606\). With these same marginal uncertainties, positive dependence substantially reduces variability in the log clearance-to-volume ratio. This calculation assumes the stated covariance applies on the log scale; it should not be substituted for covariance on the original scale.

Dependence Can Matter Differently for AUC

For the same bolus model, the concentration-time AUC from time zero to infinity is \(\mathrm{AUC}_{0-\infty}=D/CL\), assuming linear elimination and complete integration to infinity. Volume is absent from this expression. Consequently, dependence between clearance and volume cannot change the AUC calculated for a given clearance draw, or the marginal distribution of AUC, provided the clearance draws themselves are unchanged. However, dependence can change how AUC co-varies with features of the concentration profile, including the elimination rate.

Worked Example: AUC and the Profile Can Tell Different Stories

Use the two parameter draws from the earlier example, with \(D=100\) mg. For \((CL,V)=(4,20)\), AUC is \(100/4=25.00\ \mathrm{mg\cdot h/L}\). For \((6,30)\), AUC is \(100/6\approx16.67\ \mathrm{mg\cdot h/L}\). The mean from these two paired AUC values is approximately \(20.83\ \mathrm{mg\cdot h/L}\).

Under the four equally weighted combinations, each clearance value appears twice. The AUC values are therefore \(25.00,25.00,16.67,16.67\ \mathrm{mg\cdot h/L}\), with mean approximately \(20.83\ \mathrm{mg\cdot h/L}\) as well. Pairing changes the concentration mean at 2 h in the previous calculation, but not this AUC mean: in this model AUC depends only on clearance, and the clearance marginal was held fixed.

This is a model-specific result, not a general rule that exposure measures ignore parameter dependence. In another model, an exposure measure may depend on several parameters, or on a nonlinear combination of them. The relevant check is to write the model expression for the particular outcome and identify which parameters enter it.

How to Read and Check Simulated Dependence

A useful reading strategy is to follow the same parameter vector from draw to outcome. For each replicate, record the parameters used, calculate the profile or derived quantity, and then compare outcomes across draws. This makes it possible to see whether a feature of the outcome moves with one parameter, with a parameter ratio, or with a joint combination.

1
Inspect the joint draws.
Check parameter scales, units, marginal ranges, and dependence on the scale on which draws were generated. For transformed parameters, interpret dependence on that transformed scale before translating it to the original scale.
2
Keep each vector intact.
For replicate \(m\), calculate all predictions using \(\theta^{(m)}\). Do not independently reshuffle components unless independence is the intended and justified model for parameter uncertainty.
3
Trace the outcome equation.
Identify which parameters enter directly and which enter through a ratio, product, or other nonlinear expression. Check whether dependence can affect the outcome’s marginal behavior, its association with another outcome, or neither.
4
Compare like with like.
When assessing dependence, hold the marginal draws and model settings fixed while changing only the pairing. A difference then reflects the altered joint arrangement, subject to Monte Carlo variation and the particular sample of draws.

Diagnostics include checking that simulated vectors have the intended empirical correlations and marginal summaries, confirming parameter units and transformations, and verifying selected predictions against hand calculations. A broken pairing may be hard to spot from marginal histograms alone: those can look correct even when the joint dependence has been destroyed. Conversely, a small number of draws can show unstable empirical correlations, so the observed sample correlation need not equal the fitted target exactly.

Alternatives, Limitations, and Common Pitfalls

ApproachWhat it representsMain caution
Paired joint drawsThe fitted joint parameter uncertainty, if the draw method and fitted model support that interpretationRequires valid joint draws and careful preservation of each vector
Independent marginal drawsThe same parameter marginals combined under an independence assumptionCan create combinations inconsistent with the fitted dependence
One-at-a-time parameter changesA local sensitivity to changing one parameter while holding others fixedDoes not represent joint uncertainty or parameter dependence

Paired draws may come from an estimated covariance distribution, a bootstrap, or posterior draws. These sources need not have identical interpretations, and the simulated outcomes are only as credible as the uncertainty representation and structural model used. Parameter dependence does not repair model misspecification, identify parameters that the data do not identify, or account automatically for process variability, random effects, covariate uncertainty, or dosing uncertainty.

  • Mistake: “The marginal distributions are right, so the simulation is right.” Correct marginals do not preserve a joint distribution. Keep the components of each fitted draw together.
  • Mistake: “Positive correlation always increases concentration.” The effect depends on how parameters enter the model and on the time or outcome considered. Trace the equation rather than infer the result from the sign alone.
  • Mistake: “AUC and every concentration summary must change together.” A derived quantity can depend on fewer parameters than the profile. Check its defining expression before interpreting the effect of dependence.
  • Mistake: “Empirical correlation must exactly equal the fitted correlation.” Finite draws fluctuate. Look for gross mismatches and implementation errors, while allowing sampling variation.
Key takeaway: Simulated outcomes inherit the dependence encoded in their parameter vectors. Preserve paired draws, then use the model equation for the specific concentration or exposure outcome to determine whether and how that dependence matters.

Check Your Understanding

Answer each question before reading the brief solutions.

  1. In the bolus model, which parameter combination determines the exponential elimination rate?
  2. If the marginal clearance and volume draws are retained but independently reshuffled, what feature of the fitted draws may be lost?
  3. For \(\log(CL)\) and \(\log(V)\), both with variance \(0.04\) and covariance \(0.01\), calculate \(\operatorname{Var}[\log(CL/V)]\).
  4. In the stated bolus model, why does changing clearance–volume pairing leave the marginal AUC values unchanged when the clearance draws are fixed?

Solutions. (1) The rate is \(CL/V\), with units \(\mathrm{h}^{-1}\). (2) Their joint dependence, including the association relevant to ratios such as \(CL/V\), may be lost. (3) The variance is \(0.04+0.04-2(0.01)=0.06\). (4) AUC is \(D/CL\) and does not involve \(V\), so the same clearance draws give the same AUC values, although the concentration profile may change.