Tutorials › Quantitative Systems Pharmacology (QSP) › Defining the Predictive Target for a QSP Model

Propagating Uncertainty to Clinical Predictions · Tutorial 716 of 799

Defining the Predictive Target for a QSP Model

Specify a clinical prediction precisely and distinguish the simulated individual outcome from the population summary or treatment contrast built from it.

Advanced 10 min read

What You'll Learn

  • Specify the intervention, target population, endpoint, and prediction horizon as parts of a clinical prediction target.
  • Define an individual outcome as a function of a simulated QSP state trajectory.
  • Distinguish a single virtual patient prediction from a summary over a target population.
  • Construct a treatment contrast using the same population and endpoint under both interventions.
  • Recognize how changes in endpoint definition, time horizon, or population change the target.
  • Identify target-definition errors that can make a simulation answer the wrong clinical question.

From a QSP trajectory to a clinical prediction

A QSP model can generate detailed trajectories for many biological states, but a trajectory is not yet a clinical prediction. A clinical question concerns a specified intervention in a specified population, measured by a defined endpoint at a defined time or over a defined interval. These choices determine what quantity the model is being asked to predict.

For example, a model may simulate a biomarker every hour after dosing. The intended clinical question might instead concern the average biomarker reduction at week 12, the proportion of patients whose value falls below a threshold, or the difference in that proportion between two regimens. These are distinct targets, even if they are calculated from the same simulated state trajectories.

Definition: A predictive target is a precisely specified quantity that a QSP model is intended to predict. It identifies (1) the intervention or interventions, (2) the target population, (3) the endpoint and its calculation, (4) the prediction time or horizon, and (5) the summary of interest, such as an individual outcome, a population summary, or a treatment contrast.

Let \(a\) denote a clinical intervention, including the relevant dose, route, schedule, and treatment duration. Let \(i\) identify an individual in the target population, and let \(z_i\) denote that individual's relevant characteristics, such as baseline measurements and covariates. For a specified model and parameter set, write the simulated QSP state trajectory as \(x_i(t;a)\), where \(t\) is time since the start of the intervention. The trajectory is conditional on the individual, the intervention, the model, and the specified inputs.

An endpoint is a defined function of the trajectory and other relevant individual information. Write it as \(Y_i(a;H)\), where \(H\) denotes the prediction time or horizon. The endpoint function may use the state at a single time, a change from baseline, an integral over time, or a threshold applied to a continuous state. Its definition must make clear the units and direction of benefit or harm.

Define the target before calculating it

The population specification states who is represented by the prediction. It should identify the intended eligibility criteria and, where relevant, the distribution of characteristics that defines the target population. A virtual population can represent a finite set of weighted individuals, or it can approximate a broader target distribution. In either case, the summary must use weights that correspond to the population being described.

The intervention specification should be concrete enough to reproduce in the model. “Treatment” is not sufficient if dose, route, timing, duration, or comparator could change the prediction. Likewise, “response” is not a complete endpoint unless the response threshold, measurement scale, and assessment time are stated. If treatment discontinuation, rescue medication, or another clinical event affects the question, the target must state how that event is handled; otherwise different analysts may calculate different quantities from the same trajectories.

For a population summary, let \(w_i\) be the target-population weight for individual \(i\), with \(w_i \geq 0\) and \(\sum_i w_i=1\). A weighted mean outcome under intervention \(a\) is

$$ \psi(a;H)=\sum_{i=1}^{N} w_iY_i(a;H). $$

This is one possible target, not a default that is appropriate for every question. A clinically relevant summary could instead be a weighted proportion meeting a response definition, a median, or a specified quantile. The choice should follow the clinical question and the endpoint scale. If the population is represented as a distribution rather than a finite list, the corresponding population summary is an expectation with respect to that target distribution.

A treatment contrast compares outcomes under two specified interventions. For a mean difference, define

$$ \Delta(H)=\psi(a_1;H)-\psi(a_0;H). $$

The order matters: this definition makes positive values correspond to a larger mean endpoint under \(a_1\). If a larger endpoint represents worse health, a positive contrast may indicate harm rather than benefit. State the units and direction when interpreting the result.

Worked examples: translating trajectories into targets

Worked Example: Mean Percent Reduction at a Fixed Visit

Hypothetical scenario. A model is used to predict the week-12 reduction in a biomarker under a specified oral regimen for a target population represented by three equally weighted virtual patients. Their baseline biomarker values are 100, 120, and 80 units. Their simulated week-12 values under the regimen are 72, 96, and 68 units.

The individual endpoint is defined as percent reduction from baseline, so it is unitless and positive values indicate a decrease:

$$ Y_i(a;12)=100\frac{B_i(0)-B_i(12;a)}{B_i(0)}. $$

For the three patients, the calculations are \(100(100-72)/100=28\%\), \(100(120-96)/120=20\%\), and \(100(80-68)/80=15\%\). With equal weights \(w_i=1/3\), the target is the mean individual percent reduction:

$$ \psi(a;12)=\frac{28+20+15}{3}=21\%. $$

Thus, the model predicts a mean week-12 reduction of 21% for this specified virtual population under this regimen. The endpoint is the mean of patient-level percent reductions; it is not necessarily equal to the percent reduction calculated from the mean baseline and mean week-12 biomarker values.

Worked Example: A Trajectory-Based Endpoint Over a Defined Horizon

Hypothetical scenario. For one virtual patient, a simulated biomarker concentration is 10 units at hour 0, 6 units at hour 4, and 4 units at hour 8. The target is the time-averaged concentration over the interval from 0 to 8 hours, using linear interpolation between the simulated time points.

First calculate the area under the trajectory with the trapezoidal rule. Each trapezoid has area equal to the interval width multiplied by the average of its endpoint values:

$$ \mathrm{AUC}_{0-8} =\frac{10+6}{2}(4-0)+\frac{6+4}{2}(8-4) =32+20=52\ \text{unit}\cdot\text{hour}. $$

The requested endpoint is the time average, not the area itself. Dividing by the horizon gives

$$ Y_i(a;8)=\frac{\mathrm{AUC}_{0-8}}{8-0} =\frac{52\ \text{unit}\cdot\text{hour}}{8\ \text{hour}} =6.5\ \text{units}. $$

The prediction is therefore 6.5 units for this individual over the specified 8-hour horizon. Reporting 52 unit·hours as though it were the time-averaged concentration would answer a different question and use different units.

Worked Example: Mean Difference Between Two Regimens

Hypothetical scenario. A four-person virtual population is evaluated under both a control regimen \(a_0\) and an active regimen \(a_1\). The endpoint is improvement at week 8 in a score measured in points, with higher improvement defined as better. The paired simulated outcomes are:

Virtual patientControl \(Y_i(a_0;8)\), pointsActive \(Y_i(a_1;8)\), points
159
2710
338
4912

With equal weights, the mean under control is \((5+7+3+9)/4=6\) points, and the mean under the active regimen is \((9+10+8+12)/4=9.75\) points. The active-minus-control mean contrast is

$$ \Delta(8)=9.75-6=3.75\ \text{points}. $$

The individual differences are 4, 3, 5, and 3 points; their mean is \((4+3+5+3)/4=3.75\) points, which agrees with the difference in means. In this hypothetical model comparison, the active regimen predicts 3.75 points more mean improvement at week 8 than control in this target population. This is a model-based contrast, not by itself evidence that the same effect will occur in a clinical trial.

Why the contrast requires a shared target

The equality between the mean of individual differences and the difference of means follows directly when the same individuals and weights are used under both interventions. For each individual, define \(D_i=Y_i(a_1;H)-Y_i(a_0;H)\). Then

$$ \begin{aligned} \sum_{i=1}^{N}w_iD_i &=\sum_{i=1}^{N}w_i\{Y_i(a_1;H)-Y_i(a_0;H)\}\\ &=\sum_{i=1}^{N}w_iY_i(a_1;H)-\sum_{i=1}^{N}w_iY_i(a_0;H)\\ &=\psi(a_1;H)-\psi(a_0;H). \end{aligned} $$

The common weights make the comparison refer to one target population. If the two means are instead calculated with different population weights, their difference combines a treatment change with a population-composition change. It is no longer the stated treatment contrast for a shared population.

This distinction matters even when two analyses use the same model and endpoint. One may ask for the average outcome under a regimen; another may ask for the treatment contrast in the same population; a third may ask for an individual prediction. Those quantities have different meanings and may lead to different clinical conclusions. The earlier material on virtual population generation addresses how a population can be constructed; the predictive target specifies which population and which summary the clinical question requires.

Diagnostics, alternatives, and limitations

A useful target-definition check is to write the question in one sentence that names the population, intervention, endpoint, and time horizon, then write the mathematical quantity that corresponds to that sentence. The following warning signs suggest that the target is incomplete or inconsistent:

  • The intervention is described only as “drug” or “treatment,” without a dose and schedule where these affect the simulation.
  • The endpoint is named without its scale, baseline reference, threshold, or method of summarizing a trajectory.
  • The horizon is ambiguous, such as “long-term” without a specific time or interval.
  • The population used for a treatment contrast differs between the two regimens.
  • The interpretation says “benefit” without checking whether higher endpoint values mean improvement or worsening.
  • The reported units do not match the endpoint calculation, such as reporting an area under a curve as a concentration.

The main alternatives are not competing calculation algorithms so much as different target choices. An individual prediction answers what the model predicts for a particular virtual patient. A population summary describes outcomes across a specified population. A treatment contrast compares two interventions for a specified endpoint and population. A trajectory summary, such as an area or time average, is useful when the time course matters; a fixed-time value is more direct when the clinical question concerns a prespecified visit. Each is appropriate only when it matches the intended decision or clinical question.

A target cannot resolve limitations in the model or in the population it represents. A precisely stated endpoint may still depend on uncertain biological assumptions, incomplete clinical mechanisms, or a virtual population that does not adequately represent the intended patients. Furthermore, the target definition alone does not establish how uncertainty in inputs should be propagated or how well predictions are calibrated. It defines what is to be predicted; it does not guarantee that the model predicts it accurately.

Common pitfall: treating a model output as the clinical target

Common mistake: “The model predicts the biomarker at every time point, so the clinical prediction is the simulated trajectory.” A trajectory is an input to endpoint calculation, not necessarily the clinical target. Correction: State how the trajectory becomes the endpoint, for whom it is summarized, under which intervention, and over what time horizon. If the question is a week-12 mean change, do not substitute an early-time value or an unrequested trajectory-wide summary.

A related error is to change the endpoint after inspecting the simulated results—for example, selecting the visit or response threshold that makes a regimen look most favorable. A predictive target should be specified from the clinical question before interpreting the simulation. Otherwise, the reported quantity may not answer the question originally posed.

Check Your Understanding

For each question, identify the target and check the stated calculation. Solutions follow the questions.

  1. A target population has two equally weighted virtual patients. Their simulated baseline and week-4 biomarker values under a regimen are 50 and 40 units for patient 1, and 100 and 80 units for patient 2. What is the mean individual percent reduction?
  2. A model predicts a concentration of 8 units at hour 0 and 4 units at hour 2. Under linear interpolation, calculate the time-averaged concentration over those 2 hours.
  3. For three equally weighted virtual patients, mean endpoint values are 12 points under \(a_1\) and 9 points under \(a_0\). Define the contrast as active minus control. What is its value and interpretation if higher values are better?
  4. Why is subtracting a control mean calculated in one target population from an active-treatment mean calculated in a different target population potentially misleading?
  5. A report gives an AUC of 30 unit·hours over a 6-hour interval but calls the endpoint “time-averaged concentration.” What value and units should be reported?

Solutions. (1) Patient 1 has reduction \(100(50-40)/50=20\%\); patient 2 has reduction \(100(100-80)/100=20\%\). The equally weighted mean individual reduction is \((20+20)/2=20\%\). (2) With linear interpolation, the area is \((8+4)(2)/2=12\) unit·hours, so the time average is \(12/2=6\) units. (3) The contrast is \(12-9=3\) points; the active regimen has a mean endpoint 3 points higher in the specified shared population. (4) Different weights or membership mean the difference mixes intervention effects with differences in population composition, so it is not the contrast for one common target population. (5) Divide the AUC by the horizon: \(30\ \text{unit}\cdot\text{hours}/6\ \text{hours}=5\) units.

Clinical Biostats