Tutorials › Pharmacokinetic-Pharmacodynamic (PK/PD) Modeling › Worked Example: Two-Stage Versus Joint Emax Estimation

Sequential Versus Simultaneous PK/PD Estimation · Tutorial 416 of 598

Worked Example: Two-Stage Versus Joint Emax Estimation

Fit one simulated PK/PD data set by two-stage and joint Emax methods, then compare their estimates, uncertainty, and interval coverage.

Advanced 10 min read

What You'll Learn

  • State the Gaussian PK and PD assumptions used for a two-stage versus joint Emax comparison.
  • Calculate a conditional two-stage Emax estimate from PK-first concentrations.
  • Construct a joint likelihood that retains uncertainty in the individual PK scales.
  • Verify a joint fit using its likelihood score equations.
  • Compare model-based standard errors and confidence intervals under the two methods.
  • Distinguish interval coverage in one simulated replicate from coverage across repeated simulations.

Why Compare the Estimation Strategies?

An Emax estimate can depend on how uncertainty in concentration is handled. In a two-stage analysis, PK data are fitted first, and the resulting concentration estimates are treated as fixed when estimating the PD parameters. A joint analysis instead estimates the PK and PD parameters together from their likelihood contributions. The two procedures can therefore produce different estimates and uncertainty, even when they use the same observations and structural Emax relationship.

The earlier material on sequential versus simultaneous estimation establishes why neither strategy is automatically superior: the result depends on the information in each data stream and on the model assumptions. Here, a compact simulated example makes the comparison explicit. It uses three independent subjects, one PK summary observation per subject, and one PD observation per subject. This is a deliberately simplified model for illustrating the estimation calculation, not a general design recommendation.

Definition: In this example, the PK observation \(C_i^{\mathrm{obs}}\) estimates a subject-specific concentration scale \(A_i\), measured in mg/L. The PD mean is \(E_{\max}f(A_i)\), where \(f(A_i)=A_i/(EC_{50}+A_i)\). The two-stage method first estimates each \(A_i\) using PK data alone and then estimates \(E_{\max}\) conditional on those estimates. The joint method estimates all \(A_i\) values and \(E_{\max}\) together.

Model and Assumptions

For subject \(i\), assume the PK observation and PD observation follow

$$ C_i^{\mathrm{obs}}\mid A_i\sim N(A_i,\sigma_C^2), \qquad Y_i\mid A_i,E_{\max}\sim N\left(E_{\max}\frac{A_i}{EC_{50}+A_i},\sigma_Y^2\right). $$

The PK and PD errors are independent conditional on the parameters, and observations from different subjects are independent. The concentration scales satisfy \(A_i>0\), \(E_{\max}>0\), and \(EC_{50}\) is fixed and known. For the numerical example, \(EC_{50}=2\) mg/L, \(\sigma_C=1\) mg/L, and \(\sigma_Y=0.5\) response units. Treating both residual variances as known keeps the uncertainty comparison focused on the consequence of carrying PK uncertainty forward. In an application, residual variances and other model parameters may also need estimation.

When \(C_i^{\mathrm{obs}}>0\), the two-stage PK estimate under this one-observation normal model is \(\hat A_{i,\mathrm{seq}}=C_i^{\mathrm{obs}}\). If \(C_i^{\mathrm{obs}}\leq 0\), the constrained estimate under the closure \(A_i\geq 0\) is 0; under the stated strict constraint \(A_i>0\), no maximum-likelihood estimate is attained. The second stage uses \(f_i=f(\hat A_{i,\mathrm{seq}})\) and fits \(Y_i=E_{\max}f_i+\epsilon_i\), with independent \(\epsilon_i\sim N(0,\sigma_Y^2)\). This is a zero-baseline Emax model: there is no \(E_0\) term.

$$ \hat E_{\max,\mathrm{seq}} = \frac{\sum_i f_iY_i}{\sum_i f_i^2}. $$

This is the unconstrained least-squares estimate and, under the stated normal model with fixed \(f_i\), it is the maximum-likelihood estimate when it is positive, as it is for the supplied data. If it is nonpositive, the strict constraint \(E_{\max}>0\) yields no attained maximum-likelihood estimate: the likelihood approaches its supremum as \(E_{\max}\to0^+\). It does not account for uncertainty in the PK estimates when calculating its standard error.

Worked Example: Calculate the Two-Stage Estimate

Suppose the simulated observations are as follows. Concentrations are in mg/L and responses are in response units.

Subject\(C_i^{\mathrm{obs}}\) (mg/L)\(Y_i\) (response units)
14.66676.3667
22.00005.0000
37.80008.2500

The first-stage estimates are the PK observations themselves. Therefore \(f_1=4.6667/(2+4.6667)=0.7000\), \(f_2=2/(2+2)=0.5000\), and \(f_3=7.8/(2+7.8)=0.795918\). Substituting these fractions and the responses gives

$$ \hat E_{\max,\mathrm{seq}} = \frac{(4.6667/6.6667)(6.3667)+(2/4)(5.0000)+(7.8/9.8)(8.2500)} {(4.6667/6.6667)^2+(2/4)^2+(7.8/9.8)^2} = \frac{13.5230261}{1.37348815} \approx 9.8458\ \text{response units}. $$

The arithmetic uses the unrounded concentration fractions until the final display. This estimate is conditional on the three PK-derived fractions being exact. Its fitted responses are approximately 6.8920, 4.9229, and 7.8364 response units, respectively.

The Joint Likelihood and Its Score Equations

The joint likelihood retains both data sources. Omitting constants that do not depend on the parameters, its negative log-likelihood is

$$ \ell(A_1,A_2,A_3,E_{\max}) = \sum_i\left[ \frac{(C_i^{\mathrm{obs}}-A_i)^2}{2\sigma_C^2} + \frac{\{Y_i-E_{\max}f(A_i)\}^2}{2\sigma_Y^2} \right]. $$

Minimizing this quantity allows PD observations to inform the fitted \(A_i\) values as well as \(E_{\max}\). That is the defining distinction in this comparison; it does not mean the PK data are discarded or that the PD data directly measure concentration.

A short score derivation provides a useful check on a joint fit. Write \(r_i=E_{\max}f(A_i)-Y_i\), the fitted-minus-observed PD residual. Differentiating the negative log-likelihood with respect to \(E_{\max}\) and \(A_i\) gives

$$ \frac{\partial\ell}{\partial E_{\max}} = \sum_i\frac{r_i f(A_i)}{\sigma_Y^2}, \qquad \frac{\partial\ell}{\partial A_i} = \frac{A_i-C_i^{\mathrm{obs}}}{\sigma_C^2} + \frac{r_iE_{\max}f'(A_i)}{\sigma_Y^2}, \qquad f'(A_i)=\frac{EC_{50}}{(EC_{50}+A_i)^2}. $$

At an interior maximum, both derivatives must be zero. In particular, the second equation shows how the PK estimate can shift: a nonzero PD residual contributes to the score for \(A_i\). The PK and PD score contributions must balance, rather than the PK-only score being zero at the final joint estimate.

Worked Example: Verify a Joint Fit

For the same data, take \(A_1=4\), \(A_2=2\), \(A_3=8\) mg/L and \(E_{\max}=10\) response units. With \(EC_{50}=2\) mg/L, the fractions are \(2/3\), \(1/2\), and \(4/5\). Thus the fitted PD means are 6.6667, 5.0000, and 8.0000 response units. The fitted-minus-observed residuals are \(r_1=0.3000\), \(r_2=0\), and \(r_3=-0.2500\).

The \(E_{\max}\) score is zero:

$$ \sum_i\frac{r_if(A_i)}{0.5^2} = \frac{0.3000(2/3)+0(1/2)-0.2500(4/5)}{0.25} = \frac{0.2000-0.2000}{0.25} =0. $$

For subject 1, \(f'(4)=2/6^2=0.055556\). Its \(A_1\) score is \((4-4.6667)/1+0.3000(10)(0.055556)/0.25\), approximately \(-0.6667+0.6667=0\). For subject 2, both score contributions are zero. For subject 3, \(f'(8)=2/10^2=0.020000\), and the score is \((8-7.8000)/1+(-0.2500)(10)(0.020000)/0.25=0.2000-0.2000=0\). Thus these rounded values give scores approximately zero, rather than satisfying all four equations exactly for the printed data. They represent an approximate joint fit; their likelihood and uncertainty interpretation still relies on the stated model.

Comparing Standard Errors and Interval Coverage

For the two-stage estimate, the conditional model-based standard error is \(\sigma_Y/\sqrt{\sum_i f_i^2}\). It treats the PK-derived fractions as fixed. Using the values above,

$$ SE_{\mathrm{seq}} = \frac{0.5}{\sqrt{1.373488}} \approx 0.4266\ \text{response units}. $$

A joint standard error accounts for the fact that the \(A_i\) values are also estimated. One standard large-sample calculation uses the expected Fisher information, evaluated at the joint fit. Its \(E_{\max}\)-by-\(E_{\max}\) element is \(\sum_i f_i^2/\sigma_Y^2\). The cross-information for \(E_{\max}\) and \(A_i\) is \(E_{\max}f_if'(A_i)/\sigma_Y^2\), and the \(A_i\)-by-\(A_i\) element is \(1/\sigma_C^2+E_{\max}^2f'(A_i)^2/\sigma_Y^2\). Eliminating the nuisance \(A_i\) parameters gives the profile information

$$ I_{\mathrm{prof}} = \sum_i\frac{f_i^2}{\sigma_Y^2} - \sum_i \frac{\left\{E_{\max}f_if'(A_i)/\sigma_Y^2\right\}^2} {1/\sigma_C^2+E_{\max}^2f'(A_i)^2/\sigma_Y^2}. $$

This expression is the Schur complement of the \(A_i\) information block: when nuisance parameters are estimated, their information contribution is removed from the information available for \(E_{\max}\). For the joint fit, the first term is \(5.33778\). The three subtracted terms are approximately \(0.9822\), \(0.8621\), and \(0.3531\), giving \(I_{\mathrm{prof}}\approx3.1404\) and

$$ SE_{\mathrm{joint}}=\frac{1}{\sqrt{I_{\mathrm{prof}}}} \approx0.5643\ \text{response units}. $$

Using a normal approximation, the two-sided 95% Wald intervals are \(\hat E_{\max}\pm1.96SE\). The two-stage interval is \(9.8458\pm1.96(0.4266)\), or approximately 9.010 to 10.682 response units. The joint interval is \(10.000\pm1.96(0.5643)\), or approximately 8.894 to 11.106 response units. The joint interval is wider here because the PK scales are uncertain and are estimated jointly rather than treated as known.

The data were constructed with a true \(E_{\max}\) of 10 response units. Both intervals contain that value, so each has coverage in this particular simulated replicate. That statement is not an estimate of either method’s long-run coverage. Coverage is the proportion of intervals that contain the true parameter across repeated data sets generated under specified conditions. A single interval can include the truth even when a method is poorly calibrated, or miss it even when its long-run coverage is close to 95%.

Diagnostics, Alternatives, and Limitations

A fitted number alone is not enough to establish that either strategy is working well. For a joint fit, check convergence from multiple reasonable starting values, inspect the score or gradient at the reported solution, and verify that fitted PK and PD means are plausible. Examine standardized residuals against fitted values and relevant design variables. Strong patterns, outliers, or residual spread inconsistent with the assumed variances can indicate model misspecification. A nearly flat likelihood profile or an information matrix close to singular indicates weak identification; in that situation, a Wald standard error may be misleading.

For a two-stage analysis, inspect the PK fits and the PD residuals, but also remember what its reported second-stage standard error omits: uncertainty in the first-stage estimates. A narrow conditional interval is not evidence that the full procedure has equivalent repeated-sampling precision or coverage. Resampling or simulation that repeats both stages can assess the full procedure’s uncertainty, provided the resampling or simulation represents the intended sampling process.

ApproachWhat is fittedKey interpretationMain caution
Two-stagePK first; PD conditional on PK estimatesPD estimate conditional on the estimated concentrations used in stage twoPlug-in uncertainty is omitted by the conditional standard error
Joint likelihoodPK and PD parameters togetherEstimates use both likelihood contributions under the specified joint modelDepends on adequate identification, correct likelihood, and reliable optimization

Neither method is universally preferable. Joint fitting can propagate concentration uncertainty, but that benefit depends on a credible PK model and sufficient information to estimate the coupled parameters. Two-stage fitting may be operationally convenient, but treating uncertain exposure estimates as fixed can understate uncertainty and can affect estimates when the exposure-response function is nonlinear. The simple example also omits concentration-time profiles, between-subject random effects, estimated residual variances, and uncertainty in \(EC_{50}\). Its numerical standard errors are illustrative large-sample calculations; with only three subjects, their normal approximation should not be taken as a dependable small-sample interval procedure.

Common Mistake

Wrong reasoning: “The two-stage standard error is smaller, so two-stage estimation is more precise.” The calculation above treats the PK fractions as known; it does not measure uncertainty for the complete two-stage procedure. Conversely, the wider joint interval does not prove that joint estimation is always less precise or that the two-stage estimate is biased. The correction is to identify what uncertainty each reported standard error includes, then compare procedures under the same data-generating assumptions—ideally over repeated simulated data sets when evaluating bias, precision, and coverage.

Key takeaway: In this simulated data set, two-stage estimation gives \(E_{\max}\approx9.8458\) response units and a conditional standard error of \(0.4266\); joint estimation gives \(E_{\max}=10.000\) response units and an information-based standard error of \(0.5643\). Both 95% intervals cover the known simulated truth in this replicate, but repeated-simulation coverage cannot be inferred from one data set.

Check Your Understanding

Answer each question, then compare with the solutions below.

  1. Why does the two-stage standard error in this example not include uncertainty in the PK estimates?
  2. What does the joint score equation for \(A_i\) show when the PD residual is nonzero?
  3. For subject 2 in the joint fit, calculate \(f(A_2)\) and its fitted PD mean.
  4. Both intervals contain the true simulated \(E_{\max}\). Does this establish 95% coverage? Why or why not?
  5. Name one diagnostic that could reveal a poorly identified joint fit.

Solutions. 1. The second stage conditions on the PK-derived fractions as though they were fixed, so its conditional standard error accounts only for PD residual variation. 2. The PK and PD score contributions must balance; consequently, PD information can shift the joint estimate of \(A_i\) away from the PK-only estimate. 3. \(f(A_2)=2/(2+2)=0.5\), so the fitted mean is \(10(0.5)=5\) response units. 4. No. It records coverage for one replicate only; nominal coverage is assessed over repeated data sets generated under specified conditions. 5. A flat likelihood profile, a nearly singular information matrix, or estimates that change substantially with starting values can signal weak identification or optimization problems.

Clinical Biostats