Tutorials › Quantitative Systems Pharmacology (QSP) › Predictions Beyond the Calibration Dose Range

Propagating Uncertainty to Clinical Predictions · Tutorial 736 of 799

Predictions Beyond the Calibration Dose Range

You will learn to evaluate dose extrapolations by checking mechanistic saturation, quantifying uncertainty, and comparing the endpoint predictions implied by plausible assumptions.

Advanced 12 min read

What You'll Learn

  • Define extrapolation relative to the dose range used for calibration.
  • Use a saturating pathway model to calculate predictions beyond that range.
  • Approximate how parameter uncertainty contributes to prediction uncertainty.
  • Compare endpoint distributions under alternative extrapolation assumptions.
  • Identify diagnostics, failure modes, and limits on extrapolated predictions.

Why Predictions Beyond the Calibration Range Need Extra Scrutiny

A QSP model may be asked to predict a clinical outcome at a dose that was not represented in the data used for calibration. The model can still return a numerical prediction, but numerical precision is not evidence that the prediction is reliable. Beyond the observed range, the result depends increasingly on how the model represents mechanisms that the calibration data may not distinguish, such as pathway saturation, exposure scaling, or a downstream bottleneck.

The key question is not simply whether a dose is high or low. It is whether the processes that determine the endpoint are constrained well enough at that dose. A dose-response curve may appear well supported where observations are available while its high-dose plateau, slope, or patient-level variability remains uncertain. The appropriate output is therefore an evaluation of the prediction and its assumptions, not an unqualified point estimate.

Definition: Let the calibration dose range be the interval from the lowest to the highest dose represented in the data used to calibrate a model. A prediction is an extrapolation when it is made at a dose outside that interval. The prediction is conditional on the model structure, parameter values or distributions, and other assumptions used to generate it.

Extrapolation is not automatically invalid: a mechanistic model can support predictions beyond observed doses when its relevant mechanisms are sufficiently constrained. But the further the prediction is from the calibration range, the more important it is to assess whether the assumed mechanism remains plausible and whether alternative assumptions lead to materially different endpoint distributions. An uncertainty interval generated under one model does not, by itself, account for uncertainty about whether that model structure is appropriate.

Saturation in a Mechanistic Dose-Response Relationship

A simple saturating relationship illustrates why dose distance alone does not determine the prediction. Suppose the endpoint is a reduction in a clinical biomarker, measured in mg/dL, and let its mean predicted reduction at dose \(D\) be

$$ f(D;E_{\max},K)=E_{\max}\frac{D}{K+D}. $$

Here \(E_{\max}\) is the maximum reduction under the model, and \(K\) is the dose at which the modeled reduction is half of that maximum. This form assumes that the relevant driver increases with dose in the way represented by \(D\), that the response approaches a single plateau, and that the parameters remain applicable at the prediction dose. It is a simplified pathway representation, not a guarantee that dose itself is the correct driver: if exposure is not proportional to dose, the model should represent the exposure relationship rather than silently treating the two as interchangeable.

The fraction \(D/(K+D)\) approaches 1 as \(D\) increases, so the predicted effect approaches \(E_{\max}\). This can make the mean response less sensitive to additional dose at high doses. However, uncertainty in \(E_{\max}\), in the pathway producing the plateau, or in whether the plateau is reached can remain consequential. Saturation of the mean effect does not imply certainty about the endpoint distribution.

Worked Example: Calculating a Prediction Above the Observed Doses

Suppose hypothetical calibration observations were collected at doses from 10 to 40 mg. A fitted saturating relationship for biomarker reduction is \(f(D)=30D/(20+D)\), where \(E_{\max}=30\) mg/dL and \(K=20\) mg. Calculate the modeled reduction at 40 mg and at 80 mg, which is outside the calibration range.

At 40 mg, the calibration-range boundary, the model predicts

$$ f(40)=30\frac{40}{20+40} =30\frac{40}{60} =20\text{ mg/dL}. $$

At 80 mg, the extrapolated prediction is

$$ f(80)=30\frac{80}{20+80} =30\frac{80}{100} =24\text{ mg/dL}. $$

The modeled pathway fraction increases from \(40/60=0.667\) at 40 mg to \(80/100=0.800\) at 80 mg. Thus, doubling the dose does not double the predicted reduction: it raises the prediction from 20 to 24 mg/dL, toward the model’s 30 mg/dL asymptote. This arithmetic describes the fitted model; it does not establish that the asymptote or its applicability at 80 mg is supported by the calibration data.

How Parameter Uncertainty Changes With Dose

An extrapolated prediction should propagate uncertainty in the parameters that determine its shape. A local approximation shows how this uncertainty depends on dose. For the saturating function above, the partial derivatives are

$$ \frac{\partial f}{\partial E_{\max}}=\frac{D}{K+D}, \qquad \frac{\partial f}{\partial K}=-\frac{E_{\max}D}{(K+D)^2}. $$

For small parameter uncertainty, the first-order delta method approximates the variance of \(f\) by the gradient multiplied by the parameter covariance matrix and its transpose. If \(E_{\max}\) and \(K\) are independent, this reduces to

$$ \operatorname{Var}(f(D))\approx \left(\frac{D}{K+D}\right)^2\operatorname{Var}(E_{\max}) + \left(\frac{E_{\max}D}{(K+D)^2}\right)^2\operatorname{Var}(K). $$

This formula is a local approximation, not a complete predictive distribution. It makes two useful features explicit: uncertainty in the maximum effect can matter increasingly as the pathway approaches saturation, while sensitivity to \(K\) can be greatest at intermediate doses and diminish at very high doses. Correlation between parameters adds a covariance term; it must not be ignored if the parameter estimates are correlated. Patient variability and residual variability would also need to be included for a full clinical prediction.

Worked Example: Comparing Parameter Uncertainty at Calibration and Extrapolation Doses

Continue with the hypothetical model \(f(D)=E_{\max}D/(K+D)\). Suppose the parameter estimates are \(E_{\max}=30\) mg/dL and \(K=20\) mg, with standard deviations 3 mg/dL and 5 mg, respectively. For this calculation, assume the parameters are independent and consider only parameter uncertainty. Compare the approximate prediction standard deviation at 20 mg, within the calibration range, with that at 80 mg, outside it.

At 20 mg, the derivatives are \(20/40=0.5\) and \(-30(20)/(40^2)=-0.375\). The approximate variance is

$$ (0.5)^2(3^2)+(0.375)^2(5^2) =2.25+3.516 =5.766\text{ (mg/dL)}^2. $$

The corresponding approximate standard deviation is \(\sqrt{5.766}=2.401\) mg/dL. At 80 mg, the derivatives are \(80/100=0.8\) and \(-30(80)/(100^2)=-0.24\), giving

$$ (0.8)^2(3^2)+(0.24)^2(5^2) =5.760+1.440 =7.200\text{ (mg/dL)}^2, \qquad \sqrt{7.200}=2.683\text{ mg/dL}. $$

Under these assumptions, parameter uncertainty alone is wider at 80 mg than at 20 mg, even though the mean response is approaching saturation. The calculation is not a full prediction interval and does not show that uncertainty must always increase with dose. It omits other sources of variation, relies on a local approximation, and assumes independent parameters. Its value is to reveal which parameters contribute to uncertainty at the chosen dose.

Check Whether the Extrapolation Assumptions Matter

Different mechanistic assumptions can be compatible with observations in the calibration range yet imply different predictions beyond it. A useful sensitivity analysis compares endpoint predictions under plausible alternatives, while holding the calibration information and intended prediction context in view. Alternatives might represent different degrees of pathway saturation, a different high-dose maximum, or a different mapping from dose to the relevant exposure. The comparison should be explicit about which assumption changes; it should not imply that all alternatives have equal support.

The following example uses equally weighted parameter draws to make the distributional comparison transparent. These weights are stipulated for illustration. In an actual analysis, the draws and weights should reflect the uncertainty representation used in the model; an empirical fraction from an arbitrary set of draws is not automatically a calibrated clinical probability.

Worked Example: Comparing Extrapolated Endpoint Distributions Under Two Assumptions

Suppose a hypothetical study has mean biomarker reductions near 9, 15, and 21 mg/dL at 10, 20, and 40 mg, respectively, with enough observation variability that two candidate saturation assumptions are both considered compatible with those data. For each assumption, use three equally weighted parameter draws. Each pair below gives \(E_{\max}\) in mg/dL and \(K\) in mg.

Assumption A has draws \((28,18)\), \((30,20)\), and \((32,22)\). Assumption B has draws \((42,37)\), \((45,40)\), and \((48,43)\). Both use \(f(D)=E_{\max}D/(K+D)\). At 40 mg, the three predictions under A are \(28(40)/58=19.31\), \(30(40)/60=20.00\), and \(32(40)/62=20.65\) mg/dL. Under B, they are \(42(40)/77=21.82\), \(45(40)/80=22.50\), and \(48(40)/83=23.13\) mg/dL. These predictions are close enough to illustrate how calibration-range data may not fully determine the high-dose behavior.

At the extrapolated dose of 80 mg, the predictions under A are

$$ \frac{28(80)}{18+80}=22.86,\qquad \frac{30(80)}{20+80}=24.00,\qquad \frac{32(80)}{22+80}=25.10\text{ mg/dL}. $$

Their equally weighted mean is \((22.86+24.00+25.10)/3=23.99\) mg/dL, and their median is 24.00 mg/dL. Under B, the predictions are

$$ \frac{42(80)}{37+80}=28.72,\qquad \frac{45(80)}{40+80}=30.00,\qquad \frac{48(80)}{43+80}=31.22\text{ mg/dL}. $$

Their equally weighted mean is \((28.72+30.00+31.22)/3=29.98\) mg/dL, and their median is 30.00 mg/dL. In these three-draw ensembles, none of A’s predictions reaches 28 mg/dL, whereas all three of B’s do. This is a difference between illustrative model-conditional distributions, not evidence that the true clinical probability of a reduction of at least 28 mg/dL is zero under A or one under B. The example shows why reporting a single extrapolated mean can conceal consequential sensitivity to the assumed high-dose pathway behavior.

Diagnostics, Alternatives, and Limitations

Diagnostics should target the reasoning that supports the extrapolation. Inspect the fitted dose-response shape across the calibration range and check whether predicted pathway states behave plausibly as dose increases. Examine parameter uncertainty and covariance, whether the prediction is near a modeled saturation region, and whether the dose-to-exposure relationship is expected to remain valid. Compare endpoint distributions—not only means—under scientifically defensible alternative assumptions. A large shift in a clinically important tail or threshold probability may matter even when the mean changes modestly.

Warning signs include a prediction that depends strongly on a poorly constrained \(E_{\max}\), an assumed plateau not approached in the calibration data, implausible pathway states, or abrupt changes in the endpoint distribution when a reasonable alternative is used. A narrow uncertainty interval is also suspect if it reflects parameter uncertainty under one fixed structure while omitting plausible alternatives. Conversely, widening uncertainty mechanically with distance from the observed doses is not justified: uncertainty should arise from the model and its uncertain inputs, not from an arbitrary rule based only on distance.

The main alternatives answer different questions. A saturating model can encode a hypothesized pathway limit and may be more plausible than a linear response at high doses, but its plateau is an assumption unless the data constrain it. A linear model is simple and may describe a limited dose range, but extending a constant slope indefinitely can imply biologically implausible effects. A more detailed mechanistic model can represent exposure, pathway components, and bottlenecks, but added detail does not ensure better extrapolation if its parameters are weakly identified. The appropriate comparison is therefore about both mechanistic plausibility and how well each alternative is constrained for the intended prediction.

These assessments do not establish that a model is qualified for a particular decision, nor do they remove uncertainty about unrepresented mechanisms. They clarify what the prediction depends on. If plausible assumptions produce materially different distributions, that sensitivity is part of the result and should be communicated alongside the model-conditional prediction.

Common pitfall: “The model predicts a plateau, so the high-dose response is well determined.” A plateau in the equation only constrains predictions conditional on that equation and its parameters. If the calibration data do not identify the plateau or distinguish alternative pathway assumptions, the extrapolated endpoint can remain highly uncertain. Check parameter uncertainty and compare plausible structures before interpreting the plateau as evidence.

Check Your Understanding

Answer each question, then compare with the brief solutions below.

  1. A model is calibrated using doses from 5 to 30 mg. Is a prediction at 30 mg an extrapolation? What about a prediction at 45 mg?
  2. For \(f(D)=24D/(12+D)\), calculate the modeled response at 36 mg and state the limiting response as dose increases.
  3. In a first-order uncertainty calculation, what additional term is needed if \(E_{\max}\) and \(K\) are correlated?
  4. Two plausible models give the same predicted mean at an extrapolated dose but different probabilities of exceeding a clinical threshold. What should be reported?

Solutions. (1) The 30 mg prediction is at the upper boundary of the calibration range, so it is not outside that range; 45 mg is an extrapolation. (2) \(f(36)=24(36)/(12+36)=864/48=18\) response units, and the limiting response is 24 units. (3) Include the covariance contribution \(2(\partial f/\partial E_{\max})(\partial f/\partial K)\operatorname{Cov}(E_{\max},K)\), evaluated at the parameter values used in the approximation. (4) Report the threshold probabilities and the distributions or summaries needed to show their difference, identify the assumptions behind each model, and avoid presenting either model-conditional probability as assumption-free.

Clinical Biostats