Tutorials › Quantitative Systems Pharmacology (QSP) › Worked Example: Tumor Response Intervals Across Doses

Propagating Uncertainty to Clinical Predictions · Tutorial 742 of 799

Worked Example: Tumor Response Intervals Across Doses

Learn to simulate tumor responses across doses with uncertain QSP parameters, calculate central prediction intervals, and distinguish interval overlap from the distribution of paired dose differences.

Advanced 10 min read

What You'll Learn

  • Define a dose-specific tumor response as percent change from baseline at a fixed time.
  • Propagate joint uncertainty in tumor-growth and drug-effect parameters through a QSP model.
  • Calculate central percentile intervals from simulated tumor-response values.
  • Compare dose-specific intervals without treating their overlap as a test of equal response.
  • Use matched virtual-patient draws to estimate a distribution of dose contrasts.
  • Identify simulation and interpretation pitfalls that can make response intervals misleading.

From Uncertain Parameters to Tumor-Response Intervals

A QSP model can predict a tumor-size change for a specified dose and time, but uncertain growth and drug-effect parameters mean that prediction is not a single certain outcome. A dose-specific response interval summarizes the spread in predicted changes when the model is evaluated across a distribution of plausible parameter values or virtual patients. It is therefore important to state what uncertainty the interval represents and which population and treatment conditions it applies to.

The worked calculations below use a deliberately simple hypothetical model. It is not intended to describe any actual drug or cancer. The purpose is to show how a model prediction becomes a response interval, how intervals at two doses can overlap, and why the distribution of paired dose differences is often more informative for comparing doses.

Definition: For baseline tumor size \(T_0\) and modeled tumor size \(T(D,t)\) at dose \(D\) and time \(t\), the percent change from baseline is \(R(D,t)=100\{T(D,t)-T_0\}/T_0\). Negative values represent tumor shrinkage; positive values represent growth. A central \(100(1-\alpha)\%\) prediction interval for \(R(D,t)\) is the interval between the \(\alpha/2\) and \(1-\alpha/2\) quantiles of the specified predictive distribution of responses.

A Hypothetical Tumor-Growth Model

Suppose tumor size follows exponential growth with a dose-dependent reduction in net growth rate. Let \(g\) be the tumor-growth rate without treatment, \(k\) the maximum drug-effect rate, and \(C(D)\) a dimensionless exposure index for dose \(D\). The drug effect is represented by a saturating function with dimensionless half-effect value \(EC_{50}\). The model is

$$ \frac{dT}{dt} = \left[g-k\frac{C(D)}{EC_{50}+C(D)}\right]T, \qquad T(D,t)=T_0\exp\left\{\left[g-k\frac{C(D)}{EC_{50}+C(D)}\right]t\right\}. $$

Here \(g\) and \(k\) have units of week\(^{-1}\), while \(C(D)\) and \(EC_{50}\) are dimensionless. For the examples, set \(C(D)=D/(100\text{ mg})\), \(EC_{50}=1\), and evaluate the model at week 8. At a fixed parameter draw, the net rate is \(r(D)=g-kC(D)/(EC_{50}+C(D))\). The resulting response is \(100\{\exp[r(D)t]-1\}\), so it does not depend on the chosen value of \(T_0\) when expressed as a percent change.

To form a predictive distribution, draw parameter values from a specified joint distribution representing the intended patient population and parameter uncertainty, then evaluate the model at each draw. The draws should preserve relevant dependence among parameters: independently sampling correlated parameters can create implausible combinations and distort the tails. The examples use matched draws across doses, so each virtual patient retains the same growth and drug-effect parameters when evaluated at both doses.

Assumptions for interpretation: The interval describes model-predicted percent changes at the stated time, under the stated dosing and exposure assumptions, for the distribution used to generate the virtual patients. It includes only uncertainty actually represented in that distribution. Unless residual or measurement variability is added explicitly, it is not an interval for observed tumor measurements. It is also not a confidence interval for a population mean.

Worked Example: Calculating One Virtual Patient’s Response

Consider a hypothetical virtual patient with \(T_0=100\) mm, \(g=0.01800\) week\(^{-1}\), and \(k=0.08303\) week\(^{-1}\). At \(D=100\) mg, \(C(D)=1\), so the treated net growth rate is

$$ r(100)=0.01800-0.08303\frac{1}{1+1} =0.01800-0.041515 =-0.023515\ \text{week}^{-1}. $$

At week 8, the predicted tumor size is

$$ T(100,8)=100\exp(-0.023515\times 8) =100\exp(-0.18812) \approx 82.85\ \text{mm}. $$

The percent change is \(100(82.85-100)/100\approx -17.15\%\). The negative sign indicates shrinkage: this parameter draw predicts a tumor about 17.15% smaller than baseline at week 8. It is one model prediction for one draw, not an estimate of the response for every patient.

Constructing and Reading a Percentile Interval

In practice, a simulation might use thousands of parameter draws. For each draw \(m\), calculate \(R_m(D,t)\), then sort the resulting values from smallest to largest. A central 80% interval uses the 10th and 90th percentiles. One transparent finite-sample convention is linear interpolation: for \(M\) sorted values \(x_{(1)},\ldots,x_{(M)}\), calculate \(h=1+(M-1)p\) for percentile \(p\). Interpolate between the sorted observations bracketing \(h\). This convention is used in the small demonstration below; software packages may use other documented quantile conventions.

A short justification for the percentile construction is that the interval endpoints are chosen to leave equal probability in the two tails of the predictive distribution: \(P(R<q_{0.10})\) is approximately 0.10 and \(P(R>q_{0.90})\) is approximately 0.10. Thus the central interval covers approximately 80% of that distribution. With a finite simulation, its endpoints are estimates of those quantiles and can vary across Monte Carlo runs.

Worked Example: A Central 80% Interval at 100 mg

Suppose a small, purely hypothetical simulation produces these five week-8 responses at 100 mg, in increasing order: \(-17.16\%\), \(-14.86\%\), \(-14.20\%\), \(-12.493\%\), and \(-11.74\%\). These five draws are used only to make the arithmetic visible; five draws are far too few for a stable clinical prediction interval.

For the 10th percentile, \(h=1+(5-1)(0.10)=1.4\). Interpolate 40% of the way from the first to the second ordered value:

$$ q_{0.10} = -17.16+0.4[-14.86-(-17.16)] = -17.16+0.92 = -16.24\%. $$

For the 90th percentile, \(h=1+(5-1)(0.90)=4.6\). Interpolate 60% of the way from the fourth to the fifth value:

$$ q_{0.90} = -12.493+0.6[-11.74-(-12.493)] = -12.493+0.4518 = -12.0412\% \approx -12.04\%. $$

The resulting central 80% interval is approximately \([-16.24\%,-12.04\%]\). In context, this is an estimated interval covering the central 80% of the model-predicted week-8 percent changes under the specified simulation distribution. It does not mean there is an 80% probability that a fixed, unknown response parameter lies in this particular interval.

Comparing Doses: Marginal Intervals and Paired Contrasts

Now suppose the same five matched virtual-patient draws are evaluated at 120 mg. Their hypothetical week-8 responses are \(-20.00\%\), \(-17.20\%\), \(-16.00\%\), \(-14.00\%\), and \(-13.00\%\), respectively. Applying the same interpolation rule gives a 10th percentile of \(-20.00+0.4(2.80)=-18.88\%\). The 90th percentile is \(-14.00+0.6(1.00)=-13.40\%\). Thus the central 80% interval at 120 mg is \([-18.88\%,-13.40\%]\).

The dose-specific intervals overlap from \(-16.24\%\) to \(-13.40\%\). That overlap describes shared portions of the two marginal predictive distributions. It is not, by itself, a test of whether the doses have the same effect, and it does not establish equivalence. Nor does the absence of overlap, in another analysis, automatically supply a formal test or decision rule. The intervals summarize outcomes at each dose separately; a direct dose comparison concerns differences between outcomes.

Because the draws are matched, calculate each virtual patient’s contrast as the 120 mg response minus the 100 mg response. The five contrasts are \(-2.84\), \(-2.34\), \(-1.80\), \(-1.507\), and \(-1.26\) percentage points. Their central 80% interval, using the stated interpolation rule, is \([-2.64,-1.3588]\), or approximately \([-2.64,-1.36]\) percentage points. For these illustrative draws, the higher dose predicts greater shrinkage for each matched virtual patient, with the central 80% of paired differences between about 1.36 and 2.64 percentage points more negative. The small number of draws makes this an arithmetic demonstration, not a reliable estimate of clinical uncertainty.

Worked Example: Calculating the Paired Dose-Contrast Interval

Using the five matched responses above, subtract the 100 mg response from the 120 mg response for each draw. For the first draw, \(-20.00-(-17.16)=-2.84\) percentage points; for the other draws, the contrasts are \(-2.34\), \(-1.80\), \(-1.507\), and \(-1.26\) percentage points. They are already in increasing order.

The 10th percentile is \(-2.84+0.4[-2.34-(-2.84)]=-2.64\) percentage points. The 90th percentile is \(-1.507+0.6[-1.26-(-1.507)]=-1.3588\) percentage points. The central 80% contrast interval is therefore approximately \([-2.64,-1.36]\) percentage points. Because the contrast is defined as response at 120 mg minus response at 100 mg, negative values indicate more shrinkage at 120 mg. The calculation depends on preserving the matched draw pairing; pairing unrelated draws would answer a different question and could inflate or reduce contrast variability.

Diagnostics, Alternatives, and Limitations

A response interval is only useful if the simulation and its interpretation are credible. First check that every draw uses the same baseline definition, time horizon, dose regimen, and endpoint calculation. Verify units in the rate equation, and inspect predicted tumor sizes and percent changes for impossible values or numerical failures. In this simple model, tumor size remains positive because it is an exponential; a numerical implementation that produces negative size signals a problem.

Next assess Monte Carlo stability. Recompute quantiles using larger simulation batches or independent runs and check whether the endpoints move materially. Tail quantiles generally require more draws to estimate stably than central summaries. Inspect extreme draws and confirm that the parameter sampling preserves the intended joint distribution. A visually smooth dose-response band is not evidence that the tails are stable. If uncertainty in model discrepancy, adherence, or measurement is relevant to the prediction target, it must be represented or the interval should be described as excluding it.

Several alternatives answer different questions. A single median or mean response is a compact summary, but it conceals dispersion and tail behavior. A normal approximation, such as one based on the mean and standard deviation of simulated responses, can be efficient when the distribution is roughly symmetric and well behaved; percentile intervals are less dependent on that shape assumption but require adequate simulation in the tails. A delta-method approximation can be useful for local uncertainty propagation, but nonlinear transformations or skewed response distributions can make a percentile simulation more informative. These approaches do not change what the prediction distribution represents.

For comparing doses, report both marginal response intervals when the absolute predicted outcomes matter and a paired contrast distribution when the same virtual patients can be evaluated under each dose. The contrast retains within-patient dependence and directly expresses the modeled dose difference. It still inherits the assumptions and uncertainties of the model and parameter distribution; it does not show that changing the dose causes the predicted difference in real patients unless the model and its intended use support that interpretation.

Common pitfall: “The 80% intervals overlap, so the doses are not different,” or “they do not overlap, so the higher dose is proven superior.” Neither conclusion follows from interval overlap alone. State what each interval summarizes, and use a defined paired contrast or an appropriate decision criterion for the dose-comparison question.

Check Your Understanding

Use the definitions and calculations in this tutorial. The answers follow the questions so the arithmetic and interpretation can be checked directly.

  1. If \(T_0=80\) mm and \(T(D,8)=72\) mm, what is the percent change, and what does its sign indicate?
  2. What does a central 80% predictive interval describe, and why is it not a confidence interval for the mean response?
  3. For the 100 mg results in the worked example, why is the 90th-percentile endpoint interpolated between the fourth and fifth ordered values?
  4. What is the meaning of a negative paired contrast defined as response at the higher dose minus response at the lower dose?
  5. Why should matched virtual-patient draws be retained when estimating a paired dose contrast?

Solutions. (1) The percent change is \(100(72-80)/80=-10\%\), indicating a tumor 10% smaller than baseline. (2) It describes the central 80% of the specified predictive distribution of model responses; it is not a confidence interval for the mean because it summarizes individual predicted outcomes, not uncertainty in an estimated mean. (3) With five values and \(p=0.90\), \(h=1+(5-1)(0.90)=4.6\), so linear interpolation is 60% of the way from the fourth to the fifth value. (4) The higher-dose response is more negative, meaning greater predicted shrinkage at the higher dose for that draw. (5) Matching preserves each virtual patient’s parameter values across doses, so the contrast reflects a within-patient model comparison rather than the extra variation introduced by unrelated draws.

Clinical Biostats