From an Exposure-Response Model to Patient Outcomes
An exposure-response model becomes useful for trial planning when it can produce outcomes for the kinds of patients who may enter a proposed trial. The simulation needs more than a fitted curve: it needs regimen-specific exposures, patient covariates, a rule for calculating the model-predicted response, and—when predicting realized outcomes—a rule for generating residual variation around that response.
The handoff is conditional on the model being used in the right context. The exposure metric must match the one used to fit the exposure-response relationship; the covariates must have consistent definitions and units; and the model’s outcome, time point, and population must correspond to the trial question. The simulator then applies that model to each simulated patient, rather than treating a group-level prediction as if it were every patient’s outcome.
Specify the Patient-Level Calculation
Let \(C_i\) denote the exposure metric for patient \(i\), \(X_i\) the patient’s covariates, and \(\hat{\theta}\) the estimated exposure-response parameters. A simulator first calculates a model-predicted outcome, or a parameter of the outcome distribution, from \(C_i\) and \(X_i\). It then follows the fitted model’s outcome scale and distribution to generate a realized outcome if that is the desired simulation target.
For a continuous outcome with a normal residual model, one common specification is:
Here \(m(C_i, X_i; \hat{\theta})\) is the predicted conditional mean, and \(\hat{\sigma}\) is the estimated residual standard deviation on the outcome scale. This specification assumes that the residuals follow the stated distribution and, if the model assumes constant residual variance, have the same variance across the simulated patients. Residuals should only be generated in a way consistent with the fitted model’s assumptions.
For a binary outcome, the model may instead specify a probability. For example, with a logistic model, \(\operatorname{logit}(p_i)=\eta_i\), where \(p_i=P(Y_i=1\mid C_i,X_i)\) and \(\operatorname{logit}(p)=\log(p/(1-p))\). The simulator converts \(\eta_i\) to \(p_i\), then generates a binary outcome from a Bernoulli distribution with that probability. The link scale is not the outcome scale: a residual term should not be added to \(p_i\) unless that is what the model specifies.
The exposure inputs must come from a representation appropriate to the trial question. They may be individual exposure predictions supplied by a linked pharmacokinetic component, or prespecified exposure values for a demonstration. In either case, the simulator must use the same metric and units as the exposure-response model. If the model was fitted using AUC in a particular time interval, substituting a concentration or an AUC over a different interval changes the model input and invalidates the handoff.
Worked Example: Simulating a Continuous Outcome With a Covariate
Suppose a hypothetical fitted model predicts a clinical score at a specified visit as \(m(C_i,R_i)=10+6C_i/(4+C_i)-2R_i\), where \(C_i\) is exposure in mg·h/L and \(R_i=1\) indicates renal impairment (otherwise \(R_i=0\)). The estimated residual standard deviation is 2 score points. For four simulated patients, the exposure and covariate values are \((2,0),(4,0),(4,1),(8,1)\). Assume, for this illustration, normal residuals with mean 0 and standard deviation 2.
For the first patient, the predicted score is \(10+6(2)/(4+2)-2(0)=12\). For the second it is \(10+6(4)/(4+4)-2(0)=13\). For the third it is \(10+6(4)/(4+4)-2(1)=11\). For the fourth it is \(10+6(8)/(4+8)-2(1)=12\).
These are conditional mean predictions, not yet simulated realized scores. For a concrete hypothetical residual draw, suppose the four residuals are \(-1,0.5,2,-0.5\) score points. The simulated scores are therefore \(11,13.5,13,11.5\), respectively. Their simulated mean is \((11+13.5+13+11.5)/4=12.25\) score points. The mean of the four predicted scores is \(12\); the difference arises from the particular residual draws.
The assumed residual distribution is part of this example, not a universal default. A real implementation should use the residual structure supported by the fitted model. The covariate must also be coded and interpreted as it was in that model.
Why Patient-Level Simulation Matters
For a trial-level quantity such as the mean outcome, patient-level predictions must be aggregated over the simulated patients. If \(m_i=m(C_i,X_i;\hat{\theta})\), then the average predicted outcome is \(\sum_{i=1}^{n}m_i/n\). If the exposure-response relationship is nonlinear, this is generally not equal to evaluating the response function at the average exposure and covariate values. The individual exposure and covariate distribution therefore matters even when the target is an average.
A short derivation shows how residual variation enters a simulated group mean under a simple model. Suppose \(Y_i=m_i+\varepsilon_i\), with residuals having mean zero and variance \(\sigma^2\), and suppose they are independent across patients conditional on the supplied exposures and covariates. Then:
The equality follows because \(E(\varepsilon_i\mid C_i,X_i)=0\). Under the stated independence and common-variance assumptions, the conditional variance of the group mean is:
This result is conditional on the simulated exposures and covariates and on the stated residual assumptions. It does not account for uncertainty in the estimated exposure-response parameters or for other sources of variability that have not been included in the simulation.
Worked Example: Averaging a Nonlinear Exposure-Response Curve
Consider a hypothetical continuous-outcome model \(m(C)=5+10C/(5+C)\), with exposure \(C\) in mg·h/L. Four patients have predicted exposures of 1, 2, 4, and 8 mg·h/L. The model-predicted outcomes are:
At \(C=1\), \(m(1)=5+10(1)/(5+1)=6.667\). At \(C=2\), \(m(2)=5+20/7=7.857\). At \(C=4\), \(m(4)=5+40/9=9.444\). At \(C=8\), \(m(8)=5+80/13=11.154\).
The average of the four patient-level predictions is \((6.667+7.857+9.444+11.154)/4=8.781\) outcome units. The average exposure is \((1+2+4+8)/4=3.75\) mg·h/L. Evaluating the curve at that average exposure gives \(m(3.75)=5+37.5/8.75=9.286\) outcome units, which is not the average patient-level prediction.
If the target is the average predicted response in this simulated population, 8.781 is the relevant calculation. The value 9.286 answers a different question: the model’s prediction for a hypothetical patient with exposure equal to the group’s average. If a realized group mean is required, residual draws must also be generated under the fitted outcome model.
Binary Outcomes and Trial Simulation
For a binary outcome, calculate a probability for each patient before drawing the outcome. Suppose \(\eta_i\) is the fitted linear predictor. The corresponding probability is \(p_i=1/(1+\exp(-\eta_i))\). A simulated event indicator can be generated as \(Y_i=1\) when a uniform random draw \(U_i\) on \([0,1]\) is less than \(p_i\), and \(Y_i=0\) otherwise. The expected event proportion is the average of the individual probabilities; the realized event proportion is based on the generated indicators.
Worked Example: Simulating a Binary Endpoint
Suppose a hypothetical logistic exposure-response model is \(\operatorname{logit}(p_i)=-2+0.35C_i+0.8S_i\), where \(C_i\) is exposure in mg·h/L and \(S_i=1\) denotes smoking status (otherwise \(S_i=0\)). Four patients have \((C_i,S_i)=(2,0),(2,1),(4,0),(4,1)\).
Their linear predictors are \(-1.3,-0.5,-0.6,\) and \(0.2\), respectively. Converting each with \(p_i=1/(1+\exp(-\eta_i))\) gives probabilities of approximately \(0.214,0.378,0.354,\) and \(0.550\). The mean predicted event probability is \((0.214+0.378+0.354+0.550)/4=0.374\), or 37.4%.
For illustration, suppose the corresponding uniform draws are \(0.18,0.62,0.30,\) and \(0.80\). Comparing each draw with its probability gives outcomes \(1,0,1,0\). The simulated event proportion is \(2/4=0.500\), or 50.0%. This single simulated proportion differs from 37.4% because it is one random realization; the average over many simulations is expected to approach the mean predicted probability under the model.
Do not interpret the simulated event proportion from one run as a more accurate estimate of the model’s expected event rate. The probability average and the realized proportion are different quantities.
Implementation Checks and Common Failure Modes
Before relying on trial-simulation output, check the path from regimen to exposure to outcome. Each link should be consistent with the model used to estimate the exposure-response relationship and with the intended trial population and endpoint.
Specify the candidate regimen, simulated patient characteristics, outcome time point, and the exposure metric required by the fitted model.
Use the exposure predictions intended for those patients and that regimen. Check units, time interval, and any transformations used by the exposure-response model.
Apply the estimated function, including its covariate terms, at each patient’s exposure and covariate values.
Use the fitted outcome distribution, link, and residual assumptions. Retain predictions alone when the target is a conditional mean rather than a realized patient outcome.
Calculate the trial-level quantity of interest and inspect intermediate exposures, predictions, probabilities, and simulated outcomes for implausible values or coding errors.
Common warning signs include exposures outside the range supporting the fitted relationship, predictions outside a plausible outcome range, probabilities below 0 or above 1, and sharp changes caused by a covariate coding error. A simulation that gives identical outcomes to all patients may have omitted residual variability or incorrectly applied a group-level prediction. Conversely, adding residual noise when the target is only the model-predicted mean can obscure the quantity being reported.
A further pitfall is using the wrong scale for residual variation. In a normal model, \(\hat{\sigma}\) may be expressed in outcome units; in a logistic model, the link function defines how probabilities are obtained, and outcomes are generated as binary draws. Applying a normal error directly to a probability can produce impossible values and does not implement the stated logistic model. The simulator must follow the fitted model’s outcome distribution rather than impose a convenient but incompatible error rule.
Choosing the Simulation Target and Recognizing Limitations
A deterministic calculation of \(m(C_i,X_i;\hat{\theta})\) is appropriate when the target is a predicted conditional mean or probability. Stochastic outcome generation is needed when the target is a distribution of patient outcomes or a realized trial statistic. These approaches answer different questions; a stochastic simulation does not make the underlying mean prediction more valid, and a deterministic prediction does not describe the spread of individual outcomes.
A parametric residual model generates outcomes from the distribution specified by the fitted model. An alternative is to resample residuals, but that approach requires residuals that are suitable for resampling and does not automatically preserve a model’s covariate-dependent variance or outcome type. Neither approach repairs a misspecified exposure-response function or makes predictions reliable beyond the evidence supporting the model.
A plug-in simulation uses estimated parameters as fixed values. It can describe outcomes conditional on those estimates, but it does not represent uncertainty in them. It also does not establish that the regimen will cause the predicted response: that interpretation depends on the validity of the linked models and assumptions, as well as the clinical setting. Report the target, assumptions, exposure range, and whether results are conditional predictions or simulated realized outcomes.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions.
- A fitted normal exposure-response model predicts a mean score of 18 points for a patient and has residual standard deviation 3 points. What does the prediction mean, and what additional step is needed to simulate a realized score?
- Four patients have predicted binary-outcome probabilities of 0.10, 0.20, 0.60, and 0.70. What is the mean predicted event probability? Why need it not equal the event proportion in one simulated trial?
- A nonlinear model is evaluated at the average exposure rather than at each patient’s exposure. What target does that calculation describe, and why may it differ from the average patient-level prediction?
- Name two checks that can reveal a faulty handoff from an exposure-response model into a trial simulator.
Solutions. (1) Eighteen points is the model-predicted conditional mean, not a specific realized patient score. Generate a residual from the model’s specified distribution and add it to 18; under the stated normal model that is a draw from \(N(0,3^2)\). (2) The mean probability is \((0.10+0.20+0.60+0.70)/4=0.40\), or 40%. One realized proportion is based on random binary draws and can differ from 40%. (3) It describes the prediction for a hypothetical patient at the average exposure. Nonlinearity means the average of individual predictions need not equal the prediction at average exposure. (4) Examples include checking exposure units and metric against the fitted model, verifying that inputs lie in a supported range, inspecting predicted values for plausibility, and confirming that binary probabilities remain between 0 and 1.