Tutorials › Pharmacokinetic-Pharmacodynamic (PK/PD) Modeling › Common Errors in Sequential PK/PD Estimation

Sequential Versus Simultaneous PK/PD Estimation · Tutorial 420 of 598

Common Errors in Sequential PK/PD Estimation

Learn how to diagnose and correct common errors that can distort sequential PK/PD estimates, standard errors, and predictions.

Advanced 12 min read

What You'll Learn

  • Distinguish measured concentrations from concentrations predicted by a fitted PK model.
  • Propagate uncertainty in predicted concentrations, including covariance among PK parameter estimates.
  • Recognize when changed PK inputs or PD specifications require refitting.
  • Separate uncertainty conditional on fitted PK parameters from marginal uncertainty.
  • Diagnose common shortcuts and choose appropriate checks or uncertainty methods.

Why Small Shortcuts Can Change a Staged Analysis

In a sequential analysis, PK parameters are estimated first, and the resulting concentration predictions are then used in a PD analysis. This workflow can be practical, but it creates several opportunities to mistake an intermediate estimate for data known without error. A PD fit may look numerically precise while ignoring uncertainty inherited from the PK stage, or it may no longer correspond to the model that the analyst intends to report.

This tutorial focuses on four recurring errors: treating predicted concentrations as observed without uncertainty, omitting covariance among PK parameter estimates, reusing fitted values after changing the model or inputs without refitting, and reporting conditional uncertainty as though it were marginal. None of these errors means sequential estimation is inherently invalid. The correction is to state what is being conditioned on, keep the likelihood and model consistent, and carry forward uncertainty appropriate to the inferential target.

Set Up the Staged Model Before Diagnosing It

Let \(C_i^{\mathrm{obs}}\) denote an observed concentration for individual \(i\), and let \(C_i(\theta)\) be the concentration predicted by a PK model with parameter vector \(\theta\). The PK stage estimates \(\theta\) from PK data. The PD model then relates a response \(Y_j\) to an exposure such as \(C_j(\theta)\), with PD parameter vector \(\psi\). For example, a response model may be written \(Y_j=f(C_j(\theta),\psi)+\epsilon_j\).

A basic staged PD fit substitutes the PK estimate \(\hat\theta\) and treats the resulting concentrations \(C_j(\hat\theta)\) as fixed. The PD estimate is therefore conditional on the selected PK model and its fitted parameter values. It is not automatically equivalent to a joint analysis of the PK and PD observations, and the usual PD standard error from that fit does not automatically include uncertainty in \(\hat\theta\).

Definition: A plug-in concentration is a model prediction \(C_j(\hat\theta)\) substituted into the PD model in place of an unknown or unobserved concentration. It is an estimate, not a directly observed concentration. A conditional estimate or interval treats the fitted PK quantities as fixed; a marginal result accounts for their uncertainty as well as the uncertainty represented in the PD stage.

The calculations below assume the PK and PD models are specified, the relevant likelihood or error model is appropriate, and the estimates are in a region where local uncertainty approximations are meaningful. When using a first-order delta method, the prediction function must be differentiable near \(\hat\theta\), and the estimated covariance matrix must reasonably describe uncertainty in \(\hat\theta\). These assumptions should be examined rather than inferred from a successful optimizer run.

Error 1: Treating a Predicted Concentration as Observed

Predicted concentrations often appear in a data table beside measured responses, which can make them look like ordinary covariates. But \(C_j(\hat\theta)\) depends on estimated PK parameters. Treating it as error-free can make PD uncertainty conditional on one PK estimate appear to be the full uncertainty. It can also change PD estimates: the direction and size of any change depend on the model and error structure, so it is not correct to claim that plug-in use always biases a PD parameter in one particular direction.

A useful first-order calculation shows how PK parameter uncertainty affects a predicted concentration. If \(\hat\theta\) has estimated covariance matrix \(\widehat{\operatorname{Cov}}(\hat\theta)\), then for a differentiable concentration function,

$$ \widehat{\operatorname{Var}}\{C(t;\hat\theta)\} \approx \nabla_\theta C(t;\hat\theta)^\mathsf{T} \widehat{\operatorname{Cov}}(\hat\theta) \nabla_\theta C(t;\hat\theta). $$

The gradient describes how the prediction changes with each PK parameter. The covariance matrix describes both the variances of the parameter estimates and their covariances. Dropping either information can give a misleading uncertainty estimate.

Worked Example: Propagating PK Parameter Covariance

Suppose a hypothetical one-compartment concentration prediction is \(C(t)=A\exp(-kt)\), where \(A\) is in mg/L and \(k\) is in h\(^{-1}\). At \(t=5\) h, let \(\hat A=10\) mg/L and \(\hat k=0.200\) h\(^{-1}\). Suppose the estimated variances are \(\widehat{\operatorname{Var}}(\hat A)=0.640\) (mg/L)\(^2\) and \(\widehat{\operatorname{Var}}(\hat k)=0.000900\) h\(^{-2}\), and the estimated covariance is \(\widehat{\operatorname{Cov}}(\hat A,\hat k)=-0.0120\) mg/L·h\(^{-1}\). These hypothetical values form a valid covariance matrix because \(0.640(0.000900)-(-0.0120)^2=0.000432>0\).

The predicted concentration is \(10\exp(-0.200\times5)=3.6788\) mg/L. The gradient with respect to \((A,k)\) is

$$ \nabla C= \left( \frac{\partial C}{\partial A}, \frac{\partial C}{\partial k} \right) = \left(\exp(-kt),-tA\exp(-kt)\right) = (0.367879,-18.39397). $$

Using the delta method, the variance is the sum of the two variance contributions and the covariance contribution:

$$ \begin{aligned} \widehat{\operatorname{Var}}(\hat C) &\approx (0.367879)^2(0.640) +(-18.39397)^2(0.000900)\\ &\quad+2(0.367879)(-18.39397)(-0.0120)\\ &\approx 0.086615+0.304504+0.162402\\ &=0.553521\ \text{(mg/L)}^2. \end{aligned} $$

Thus the approximate standard error is \(\sqrt{0.553521}=0.7440\) mg/L. If the covariance were incorrectly set to zero, the variance would instead be \(0.086615+0.304504=0.391119\) (mg/L)\(^2\), giving a standard error of \(0.6254\) mg/L. In this example, the negative parameter covariance contributes positively to prediction variance because the two prediction derivatives have opposite signs. The covariance term can either increase or decrease uncertainty; its sign must be calculated from the derivatives and covariance, not guessed from the covariance alone.

Error 2: Ignoring Covariance Among PK Estimates

PK parameter estimates are often correlated. For instance, different combinations of clearance and volume may describe similar concentration profiles over a limited sampling window. A PD exposure prediction that depends on both parameters can therefore inherit uncertainty from their joint movement. Computing a separate contribution from each parameter variance and adding those contributions is correct only when the relevant covariances are zero, or when the derivatives make their covariance contributions zero.

More generally, for a scalar prediction \(g(\theta)\), the first-order variance approximation is

$$ \widehat{\operatorname{Var}}\{g(\hat\theta)\} \approx \sum_r \left(\frac{\partial g}{\partial\theta_r}\right)^2 \widehat{\operatorname{Var}}(\hat\theta_r) + 2\sum_{r<s} \frac{\partial g}{\partial\theta_r} \frac{\partial g}{\partial\theta_s} \widehat{\operatorname{Cov}}(\hat\theta_r,\hat\theta_s). $$

This formula follows by approximating \(g(\hat\theta)\) near the estimate: \(g(\hat\theta)\approx g(\theta)+\nabla g^\mathsf{T}(\hat\theta-\theta)\). Taking the variance of the linear expression gives \(\nabla g^\mathsf{T}\operatorname{Cov}(\hat\theta)\nabla g\), which expands into the variance and covariance terms above. The approximation is local; it may be inadequate for strongly nonlinear predictions, parameters near boundaries, or highly asymmetric uncertainty.

A practical diagnostic is to inspect the full PK covariance or correlation matrix and identify which parameters influence the PD exposure or prediction. If the matrix is unavailable, a standard error computed from parameter variances alone is not a complete propagation of uncertainty. A parameter bootstrap or simulation from the fitted joint parameter distribution can retain the dependence structure, subject to the validity of the fitted model and resampling procedure.

Error 3: Reusing Fitted Values Without Refitting

A fit is tied to its data, model, and fixed inputs. If the PK model changes, the predicted concentrations generally need to be recalculated. If those concentrations change, PD parameters estimated using them generally need to be refitted. Likewise, changing the PD model, response data, or weighting scheme requires fitting the revised PD model rather than carrying over its previous estimates as if they still optimized the new objective.

Worked Example: Refit the PD Parameter After Updating Concentrations

Suppose two hypothetical PD responses are 20% and 30%, and an Emax model with fixed \(EC_{50}=1\) mg/L is used: \(Y_j=E_{\max}q_j+\epsilon_j\), where \(q_j=C_j/(EC_{50}+C_j)\). Assume equal-variance least squares, so the fitted \(E_{\max}\) is \(\sum_jq_jY_j/\sum_jq_j^2\). An initial PK model predicts concentrations of 1 and 3 mg/L. The corresponding \(q\) values are 0.5000 and 0.7500, giving

$$ \hat E_{\max} = \frac{(0.5000)(20)+(0.7500)(30)} {(0.5000)^2+(0.7500)^2} = \frac{32.50}{0.8125} =40.00\%. $$

Now suppose a revised PK fit predicts concentrations of 2 and 6 mg/L. The new \(q\) values are \(2/3\) and \(6/7\). Holding the old estimate at 40.00% would not minimize the least-squares objective for these updated inputs. Refitting gives

$$ \hat E_{\max,\mathrm{new}} = \frac{(2/3)(20)+(6/7)(30)} {(2/3)^2+(6/7)^2} = \frac{820/21}{520/441} = 33.12\%. $$

The difference does not establish which PK model is preferable. It shows that the PD estimate depends on the concentration inputs and must be recomputed when those inputs change. If the intended analysis is joint, the relevant PK and PD likelihood contributions must be optimized together rather than treating a previous staged estimate as the joint solution.

A useful check is to record the exact PK model version, parameter estimates, and prediction settings used for each PD fit. If any of these change, regenerate the concentrations and refit the PD model. When comparing analyses, evaluate each fit using a clearly defined objective for the same underlying observations; a PD-only objective conditional on fixed concentrations is not automatically comparable to a joint likelihood.

Error 4: Reporting Conditional Uncertainty as Marginal

A PD standard error computed with \(C_j(\hat\theta)\) fixed describes uncertainty conditional on those fitted PK quantities, under the PD model and its assumptions. It does not include uncertainty from estimating \(\theta\). A marginal prediction or interval that is intended to reflect both PK and PD uncertainty must include both sources. This distinction is especially important when the PK data are sparse or the PD response is sensitive to exposure.

The law of total variance makes the distinction precise. For a response \(Y\) and uncertain concentration \(C\),

$$ \operatorname{Var}(Y) = \operatorname{E}\{\operatorname{Var}(Y\mid C)\} + \operatorname{Var}\{\operatorname{E}(Y\mid C)\}. $$

The first term is average variability conditional on concentration; the second is variability in the conditional mean as concentration varies. Additional uncertainty in PD parameters can also contribute. The terms cannot in general be combined by simply adding standard errors; variances and relevant covariances must be handled on a common scale.

Worked Example: Conditional and Marginal Predictive Uncertainty

Suppose a hypothetical PD response follows \(Y=2C+\epsilon\), with \(C\) measured in mg/L, response in response units, and \(\epsilon\sim N(0,3^2)\) response-units squared. Treat the slope of 2 response units per mg/L as fixed for this calculation. Suppose the PK prediction for a new observation is represented by \(C\sim N(5,1^2)\), independently of \(\epsilon\). Conditional on \(C=5\), the predicted mean is \(2(5)=10\) response units and the residual standard deviation is 3 response units.

For a marginal prediction, \(Y=2C+\epsilon\) has mean \(2(5)=10\) and variance

$$ \operatorname{Var}(Y)=2^2\operatorname{Var}(C)+\operatorname{Var}(\epsilon) =4(1)+9=13\ \text{response-units}^2. $$

The marginal standard deviation is \(\sqrt{13}=3.606\) response units. Under the stated normal and independence assumptions, a 95% conditional prediction interval at \(C=5\) is \(10\pm1.96(3)=[4.120,15.88]\) response units. The corresponding marginal prediction interval is \(10\pm1.96(3.606)=[2.932,17.07]\) response units. The wider marginal interval includes uncertainty in the PK prediction; it is not a 95% probability statement about a fixed unknown response mean.

In a real PK/PD analysis, uncertainty may also involve estimated PD parameters, correlations between PK and PD estimates, residual error structure, and the distinction between uncertainty about a mean response and prediction of a new individual response. State which quantity an interval describes and which sources of uncertainty it includes. Bootstrap uncertainty for staged and joint fits, likelihood profiles, or Bayesian inference may be appropriate when a local normal approximation is not adequate, but each method still depends on its assumptions and implementation.

Diagnostics, Alternatives, and Limitations

The errors above can be difficult to spot from a successful fit summary alone. Check the analysis path, not only the final parameter table. In particular, compare measured concentrations and model-predicted concentrations in the records supplied to the PD stage; confirm whether the reported standard errors condition on PK estimates; inspect the complete covariance matrix; and verify that the PD fit was rerun after any change to PK predictions or model specification. Residual diagnostics from staged PK/PD fits can reveal response patterns not captured by the assumed PD model, but good residual behavior does not by itself show that PK uncertainty was propagated.

ApproachWhat is treated as uncertain?Key caution
Plug-in sequential fitPD quantities conditional on fitted PK valuesDo not present conditional uncertainty as if it included PK estimation.
Sequential fit with uncertainty propagationPK uncertainty is carried into PD results by an approximation or resamplingCheck whether parameter dependence and nonlinearities are retained.
Joint estimationPK and PD parameters are estimated in one likelihood or inferential modelJoint estimation does not repair misspecification, weak identification, or unsuitable error assumptions.

No single approach eliminates all limitations. A delta-method calculation can be efficient but unreliable for highly nonlinear predictions or weakly identified parameters. Resampling can preserve complex dependence, but only if the resampling scheme reflects the data-generating and estimation process. Joint estimation can propagate uncertainty coherently under its model, but may be computationally demanding and can be sensitive to model misspecification. The appropriate interpretation depends on the stated estimand and the information in the PK and PD data.

Common Mistakes

  • Wrong: “The concentration is in the PD data set, so it is observed without error.” Correction: Identify whether each value was measured or predicted; a plug-in prediction carries uncertainty from the PK fit.
  • Wrong: “Adding the separate parameter-variance contributions is enough.” Correction: Include covariance terms unless they are known to be zero or irrelevant to the prediction.
  • Wrong: “The old PD estimate remains valid after I update the PK model.” Correction: Recalculate the concentrations and refit the PD model using the revised inputs.
  • Wrong: “The PD standard error is the overall uncertainty.” Correction: State whether it is conditional on fitted PK values or includes PK uncertainty.
Key takeaway: In sequential PK/PD estimation, a predicted concentration is an estimated input. Preserve PK parameter covariance, refit whenever relevant inputs or specifications change, and label uncertainty as conditional or marginal according to what it actually includes.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A PK prediction depends on two estimated parameters with nonzero covariance. What information is needed for a first-order variance approximation of that prediction?
  2. A PD model is refitted using concentrations from an updated PK model, but the analyst keeps the previous PD parameter estimate. What is the error?
  3. In the worked predictive example, what is the conditional response variance at \(C=5\), and what is the marginal response variance?
  4. When may a staged PD standard error be described as conditional on PK estimates?

Solutions. (1) Use the gradient of the prediction with respect to both parameters, both parameter variances, and their covariance in \(\nabla g^\mathsf{T}\widehat{\operatorname{Cov}}(\hat\theta)\nabla g\). (2) The old estimate need not minimize the revised PD objective because the concentrations changed; refit the PD model using the updated inputs. (3) Conditional variance is \(3^2=9\) response-units squared. Marginal variance is \(2^2(1)+9=13\) response-units squared, including concentration uncertainty. (4) It is conditional when the calculation treats fitted PK quantities as fixed and does not propagate their estimation uncertainty; report that condition explicitly.

Clinical Biostats