Tutorials › Adaptive Clinical Trial Design › Exposure-Response Models for Adaptive Decisions

Adaptive Designs With Pharmacometric Models · Tutorial 511 of 799

Exposure-Response Models for Adaptive Decisions

Build nonlinear efficacy and toxicity models from exposure, quantify prediction uncertainty, and use prespecified interim criteria without overstating what the models establish.

Advanced 11 min read

What You'll Learn

  • Specify Emax and Hill models for continuous efficacy responses and interpret their parameters and units.
  • Model a binary toxicity outcome with logistic regression as a function of exposure.
  • Use the delta method to quantify uncertainty in nonlinear model predictions.
  • Apply prespecified efficacy and toxicity gates to interim estimates and confidence limits.
  • Diagnose weak exposure support, misspecification, and misleading extrapolation.
  • Distinguish pointwise uncertainty statements from joint confidence claims.

From Exposure to an Interim Decision

An adaptive trial may measure drug exposure before all clinical outcomes are available. A useful exposure-response model connects that measured exposure to a clinical outcome and expresses uncertainty in the connection. At an interim analysis, the model can help assess whether an exposure range is promising enough to continue studying, while also checking whether toxicity appears unacceptably high.

Exposure-response modeling is not the same as comparing randomized dose groups. Participants assigned the same dose can have different exposures, and exposure may be associated with characteristics that also relate to outcome. A fitted exposure-response curve is therefore a model for the outcome conditional on exposure and any included covariates; it is not automatically a causal effect of increasing an individual's exposure. Conclusions depend on the design, the measured data, the model, and the range of exposure actually observed.

Definition: An exposure-response model specifies how the distribution of a clinical outcome depends on a participant's drug exposure, possibly conditional on covariates. An efficacy model describes an efficacy endpoint, such as mean improvement from baseline. A toxicity model describes the probability of a specified adverse outcome over a defined observation window.

Nonlinear Efficacy Curves

A common model for a continuous efficacy endpoint is the Emax curve. Let \(C\) denote exposure in a stated unit, and let \(Y\) be an efficacy outcome measured so that larger values indicate greater benefit. The mean response at exposure \(C\) is

$$ E(Y\mid C)=E_0+\frac{E_{\max}C}{EC_{50}+C}. $$

Here, \(E_0\) is the mean response at zero exposure, \(E_{\max}\) is the additional response approached as exposure becomes large, and \(EC_{50}\) is the exposure at which half of that additional response is reached. If \(Y\) is measured in points and \(C\) in mg/L, then \(E_0\) and \(E_{\max}\) are in points and \(EC_{50}\) is in mg/L. The model presumes nonnegative exposure, a positive \(EC_{50}\), and a saturating response of this specified form.

The Hill version permits the curve's steepness to vary:

$$ E(Y\mid C)=E_0+\frac{E_{\max}C^h}{EC_{50}^h+C^h}, \qquad h>0. $$

The Hill coefficient \(h\) changes how sharply response rises around \(EC_{50}\); the other parameters retain their interpretations. These curves are useful when a straight line is implausible, for example when response increases at low exposure but levels off at higher exposure. They should not be chosen merely because a nonlinear curve can fit a small interim data set more closely.

Worked Example: Interpreting an Emax Efficacy Model

Suppose a hypothetical interim analysis estimates the mean improvement in a clinical score, in points, by \(E(Y\mid C)=20+30C/(5+C)\), with \(C\) measured in mg/L. The fitted model is assumed to be appropriate over the exposure range being considered.

At \(C=2\) mg/L, the predicted mean improvement is \(20+30(2)/(5+2)=20+60/7=28.57\) points. At \(C=5\) mg/L it is \(20+30(5)/(5+5)=35.00\) points. At \(C=10\) mg/L it is \(20+300/15=40.00\) points. The corresponding model predictions rise by less at higher exposures, consistent with saturation.

The marginal change in the predicted mean per unit of exposure is the derivative \(\frac{dE(Y\mid C)}{dC}=E_{\max}EC_{50}/(EC_{50}+C)^2\). At 5 mg/L this is \(30(5)/(5+5)^2=1.50\) points per mg/L. This is a local slope of the fitted curve, not a constant effect across exposure levels. The model's asymptotic mean as exposure increases is \(20+30=50\) points, not an estimate of a response observed at a particular finite exposure.

Modeling Toxicity Probabilities

For a binary toxicity endpoint, a standard choice is logistic regression. Let \(T=1\) indicate that a participant experiences the defined toxicity during the chosen observation window, and let \(p(C)=P(T=1\mid C)\). A logit model with log exposure is

$$ \operatorname{logit}\{p(C)\} =\log\left(\frac{p(C)}{1-p(C)}\right) =\beta_0+\beta_1\log(C). $$

This specification requires positive exposure. The intercept \(\beta_0\) is the log odds at \(C=1\) in the chosen exposure unit; \(\beta_1\) is the change in log odds for a one-unit increase in \(\log(C)\). The probability is obtained by the inverse-logit transformation \(p(C)=1/\{1+\exp[-(\beta_0+\beta_1\log C)]\}\). A positive \(\beta_1\) corresponds to increasing modeled toxicity probability with exposure. Changing the exposure unit changes the intercept, so the unit must be stated and used consistently.

Both model types require assumptions. Outcomes should be defined consistently, and observations must be appropriately independent conditional on the model and covariates, or their dependence must be modeled. The chosen mean curve or probability link must adequately describe the relationship over the decision-relevant range. Measurements need to be sufficiently reliable, and the observed exposure range must support the predictions being used. For a continuous outcome, uncertainty calculations also depend on the assumed or estimated residual variability. For binary outcomes, the toxicity window and event definition must be fixed; a participant whose window is incomplete cannot simply be treated as event-free.

Worked Example: Toxicity Probability and Its Uncertainty

Consider hypothetical toxicity data analyzed with \(\operatorname{logit}\{p(C)\}=\beta_0+\beta_1\log(C)\). Suppose the interim estimates are \(\hat{\beta}_0=-3.000\) and \(\hat{\beta}_1=0.479\). Their estimated covariance matrix, in the order intercept then slope, has variances 0.09 and 0.04 and covariance \(-0.03\). Assume the model is adequate near \(C=4\) mg/L, exposure is positive, and the covariance matrix is estimated from the interim data.

At 4 mg/L, \(\log(4)=1.3863\), so the fitted log odds are \(-3.000+0.479(1.3863)=-2.3360\). The predicted probability is \(1/\{1+\exp(2.3360)\}\), approximately 0.0882. Thus the fitted toxicity probability at 4 mg/L is about 8.82% for the defined observation window.

For a pointwise confidence interval, first quantify uncertainty on the logit scale. The estimated variance of the fitted log odds is

$$ \widehat{\operatorname{Var}}\{\hat{\beta}_0+\hat{\beta}_1x\} =0.09+0.04x^2+2x(-0.03),\qquad x=\log(4). $$

Substitution gives \(0.09+0.04(1.3863)^2+2(1.3863)(-0.03)=0.09+0.0769-0.0832=0.0837\), and the standard error is \(\sqrt{0.083695}\approx0.2893\). A normal-approximation 95% interval on the logit scale is \(-2.3360\pm1.96(0.2893)\), approximately \([-2.903,-1.769]\). Applying the increasing inverse-logit function to the unrounded endpoints gives an approximate pointwise 95% confidence interval of 0.0520 to 0.1456 for the toxicity probability at 4 mg/L.

This is a confidence interval for the probability at one specified exposure, under the model and its approximation. It is not a 95% probability that the fixed probability lies inside this particular interval, and it does not account for uncertainty about whether the logistic curve itself is correctly specified.

Uncertainty and Interim Gates

An interim decision should be tied to a prespecified clinical criterion, not just to whether a fitted curve looks favorable. For example, a protocol could require a lower confidence limit for mean efficacy to exceed a clinically relevant threshold and an upper confidence limit for toxicity probability to remain below a safety threshold. The limits make uncertainty visible: a favorable point estimate alone may be too imprecise to justify continuing with an exposure range.

For nonlinear predictions, the delta method provides a first-order approximation to their standard errors. Let \(\hat{\theta}\) be a vector of fitted model parameters, with estimated covariance matrix \(\widehat{\Sigma}\), and let \(g(\hat{\theta})\) be the model prediction at a fixed exposure. A first-order Taylor expansion around the true parameter vector gives the approximate variance

$$ \widehat{\operatorname{Var}}\{g(\hat{\theta})\} \approx \nabla g(\hat{\theta})^{\mathsf T} \widehat{\Sigma} \nabla g(\hat{\theta}). $$

The gradient contains the partial derivatives of the prediction with respect to each fitted parameter. The covariance terms matter: adding parameter variances while ignoring covariance can materially misstate prediction uncertainty. For a probability modeled on the logit scale, one can first form a confidence interval for the linear predictor and then transform both endpoints; for a continuous mean, the gradient is taken for that mean prediction. These are approximate procedures, especially when samples are small, estimates are near parameter boundaries, or the model is weakly identified.

Worked Example: Applying an Interim Efficacy and Toxicity Gate

Continue with the hypothetical Emax fit \(E(Y\mid C)=E_0+E_{\max}C/(EC_{50}+C)\), whose estimates are \(E_0=20\), \(E_{\max}=30\), and \(EC_{50}=5\). At 4 mg/L, the fitted mean improvement is \(20+30(4)/(5+4)=33.33\) points. Suppose the estimated standard errors of these three parameters are 1, 2, and 0.5, respectively, and, for this illustration, their estimated covariances are zero. Assume the outcome and exposure units and the model assumptions above apply at this exposure.

For \(g=E_0+E_{\max}C/(EC_{50}+C)\), the gradient at 4 mg/L is \((1,\;4/9,\;-30(4)/9^2)=(1,\;0.4444,\;-1.4815)\). The delta-method variance is \(1^2(1^2)+(0.4444)^2(2^2)+(-1.4815)^2(0.5^2)=1+0.7901+0.5487=2.339\). Thus \(SE\approx\sqrt{2.339}=1.529\) points, and a normal-approximation pointwise 95% interval for the mean is \(33.33\pm1.96(1.529)\), or approximately 30.34 to 36.33 points.

Suppose a hypothetical prespecified interim rule requires the lower 95% limit for mean improvement to exceed 30 points and the upper 95% limit for toxicity probability to be below 0.15. The efficacy lower limit, 30.34 points, exceeds its threshold; the toxicity upper limit from the preceding example, 0.1456, is below 0.15. Under this explicitly defined rule, both pointwise gates pass at 4 mg/L. This is not a claim that the probability of meeting both conditions is 95%: two separate pointwise 95% intervals do not generally provide 95% joint coverage. A joint guarantee would require an appropriately calibrated rule, such as a multiplicity adjustment or a joint procedure.

Justifying the Uncertainty Calculation

The delta-method expression follows from approximating a smooth prediction function by its linear change near the fitted parameters. Write the estimation error as \(\hat{\theta}-\theta\). A first-order Taylor expansion gives \(g(\hat{\theta})\approx g(\theta)+\nabla g(\theta)^{\mathsf T}(\hat{\theta}-\theta)\). If \(\hat{\theta}\) is approximately unbiased with covariance matrix \(\Sigma\), the constant \(g(\theta)\) contributes no variance, and the variance of the linear term is

$$ \operatorname{Var}\{\nabla g(\theta)^{\mathsf T}(\hat{\theta}-\theta)\} =\nabla g(\theta)^{\mathsf T}\Sigma\nabla g(\theta). $$

Replacing the unknown gradient and covariance matrix with their fitted estimates yields the stated approximation. The approximation is most credible when the estimator is approximately normal, the prediction function is smooth near the estimate, and the data identify the parameters. It can be unreliable if a parameter estimate is on a boundary, the curve's plateau is not observed, or the estimate of \(EC_{50}\) is extremely uncertain.

Diagnostics, Alternatives, and Limits

Before using a curve for adaptation, examine whether the data support its shape and predictions. Plot individual exposure and outcome information alongside the fitted curve, inspect residuals for systematic patterns, and check whether predicted toxicity probabilities are compatible with observed event frequencies across exposure ranges. Look for sparse exposure regions, influential observations, convergence warnings, implausible parameter estimates, and wide or asymmetric uncertainty. A smooth fitted line does not repair a lack of data at the exposure where the decision will be made.

The Emax model is compact and interpretable when a saturating response is plausible. A Hill curve is more flexible but requires estimating an additional shape parameter and can be unstable with limited data. A linear model is simpler and may be a reasonable local approximation over a narrow observed range, but it can predict continuing benefit or harm beyond that range even when the true relationship levels off. Splines can represent more varied shapes, but their predictions depend on knot and boundary choices and may be difficult to interpret in sparse regions. For toxicity, the logistic model is common, while other links can be considered if justified and prespecified; changing the link after seeing interim outcomes can make the decision procedure difficult to interpret.

A key failure mode is extrapolation: using a model fitted at low exposures to declare a high, unobserved exposure safe or effective. Another is treating all observed exposure differences as if they arose from random assignment. Exposure can reflect adherence, metabolism, disease severity, or other participant characteristics, so conditional associations need not equal the effect of an intervention that changes exposure. At an adaptive interim, the available data and the choice to continue may also depend on earlier decisions. The analysis plan should specify the model, interim timing, endpoints, and decision rule in advance, and the operating characteristics of the full adaptive procedure should be assessed under plausible data-generating conditions.

The comparison is not simply “nonlinear is better than linear.” A model should be as flexible as the scientific question and data can support, with uncertainty and diagnostics reported at the exposures that matter. Model-based gates can structure an interim discussion, but they do not remove uncertainty, prove causal effects, or guarantee that later data will confirm the interim pattern.

Common mistake: “The fitted toxicity probability is under the safety threshold, so this exposure is safe.” A point estimate ignores uncertainty and model assumptions. Compare a prespecified uncertainty bound with the threshold, verify that the exposure is supported by data, and state that the result is conditional on the model and observation window. Even an upper confidence limit below a threshold is not proof of zero risk.

Check Your Understanding

Answer each question, then compare your reasoning with the brief solutions.

  1. For an Emax model, what does \(EC_{50}\) mean, and why is it not necessarily the exposure giving half of the total predicted mean response?
  2. Why must the covariance between the intercept and slope be included when calculating uncertainty for a logistic prediction?
  3. A fitted efficacy mean is 12 points with standard error 2 points. What is its approximate normal 95% interval, and does its lower limit exceed a 9-point criterion?
  4. What is a principal concern in using an exposure-response curve to decide about exposure values far beyond those observed?
  5. Do two separate pointwise 95% confidence intervals automatically give a joint 95% confidence statement for efficacy and toxicity gates?

Solutions. (1) \(EC_{50}\) is the exposure producing half of the Emax increment above \(E_0\). The total mean includes \(E_0\), so half of the total mean is generally a different value. (2) The variance of a linear combination includes twice the coefficient product times the covariance; omitting it can overstate or understate uncertainty. (3) \(12\pm1.96(2)=[8.08,15.92]\) points approximately; 8.08 is below 9, so the lower limit does not exceed the criterion. (4) Extrapolation may impose an unsupported curve shape where the data provide little or no information. (5) No. Separate marginal coverage does not in general imply 95% simultaneous coverage.

Clinical Biostats