Tutorials › Nonlinear Mixed-Effects Models (NLME) › Efficacy-Safety Dose Windows

Dose Selection by Simulation · Tutorial 723 of 797

Efficacy-Safety Dose Windows

Learn to estimate the probability that the same simulated individual meets both efficacy and safety criteria, then identify doses whose joint attainment probability meets a prespecified decision threshold.

Advanced 11 min read

What You'll Learn

  • Define joint efficacy–safety success as a single event for each simulated individual at a specified dose.
  • Calculate the population probability of joint success from paired simulation outcomes.
  • Explain why separate efficacy and safety probabilities do not determine the joint probability.
  • Construct a dose window from a prespecified minimum acceptable joint probability.
  • Assess Monte Carlo error and diagnose problems in the simulation or dose grid.
  • Distinguish population variability from uncertainty in model parameters.

Why a Dose Must Meet Both Criteria

A dose can produce strong efficacy for many individuals and still be unacceptable if it also produces toxicity too often. Conversely, a dose with little toxicity may fail to provide adequate efficacy. An efficacy–safety dose window makes these requirements explicit: at a candidate dose, an individual is counted as a success only when the efficacy criterion and the safety criterion are both met.

The key is to evaluate both outcomes for the same simulated individual. The population probability of meeting both criteria depends on how efficacy and toxicity co-occur, not just on their separate rates. The earlier material on joint efficacy targets and dependence establishes why this pairing matters; here the joint event is used to define an acceptable dose and a dose window.

Definition: At dose \(d\), let \(E_i(d)\) be the simulated efficacy outcome and \(T_i(d)\) the simulated toxicity outcome for individual \(i\). Let \(E^*\) be the efficacy target and \(T^*\) the toxicity limit. Under the strict criteria used here, individual \(i\) has joint success if \(E_i(d)>E^*\) and \(T_i(d)<T^*\). The population joint attainment probability is $$ p_{\mathrm{joint}}(d)=P\{E_i(d)>E^*,\ T_i(d)<T^*\}. $$ It is the probability, under the specified target-population and model assumptions, that one individual at dose \(d\) meets both criteria.

The endpoints must be defined before calculating this probability. For example, efficacy might be an exposure-response index evaluated over a dosing interval, while toxicity might be a peak concentration or a binary adverse-event outcome over a stated period. The efficacy target, toxicity limit, dose regimen, evaluation time, and target population are part of the estimand. Changing any of them can change the probability and therefore the resulting window.

The probability describes population variability under the model: individuals differ through the random effects and any within-individual variability included in the endpoint simulation. Unless parameter uncertainty is deliberately included, it is conditional on the fitted model parameters. Do not interpret ordinary simulated individuals as parameter draws; adding parameter uncertainty is a separate modeling choice.

Estimating the Joint Probability by Simulation

Suppose \(M\) simulated individuals represent draws from the target population. For each individual, simulate both endpoints at dose \(d\), retaining their pairing. Define an indicator \(I_i(d)\) equal to 1 when both criteria are met and 0 otherwise. The Monte Carlo estimate is the proportion of simulated individuals with joint success:

$$ \widehat{p}_{\mathrm{joint}}(d) = \frac{1}{M}\sum_{i=1}^{M} I_i(d), \qquad I_i(d) = \mathbf{1}\{E_i(d)>E^*,\ T_i(d)<T^*\}. $$

If the \(M\) simulated individuals are independent draws from the intended population distribution, the indicators are Bernoulli draws with success probability \(p_{\mathrm{joint}}(d)\). Thus the estimate is unbiased conditional on the model and simulation setup, and its Monte Carlo standard error is estimated by

$$ SE\{\widehat{p}_{\mathrm{joint}}(d)\} \approx \sqrt{\frac{\widehat{p}_{\mathrm{joint}}(d) [1-\widehat{p}_{\mathrm{joint}}(d)]}{M}}. $$

This standard error measures finite-simulation error, not uncertainty about whether the model is correct or whether its parameters are known. A small Monte Carlo standard error does not repair a misspecified model, an unrepresentative target population, or an incorrectly defined endpoint.

From Joint Probability to a Dose Window

A dose window requires a decision rule in addition to the joint probability. Let \(q\) be the prespecified minimum probability required for a dose to be acceptable. For a set of candidate doses \(\mathcal{D}\), the estimated acceptable set is

$$ \widehat{\mathcal{W}} = \{d\in\mathcal{D}:\widehat{p}_{\mathrm{joint}}(d)\ge q\}. $$

The value of \(q\) is a decision threshold, not a confidence level. It should be set according to the dose-selection context rather than chosen after inspecting which doses pass. If candidate doses are evaluated only on a grid, the result identifies acceptable grid points; it does not prove that every dose between two passing points is acceptable. Nor is a dose window necessarily a single continuous interval: the joint probability need not change monotonically with dose.

Worked Example: Counting Joint Successes

Consider 10 hypothetical simulated individuals at a candidate dose. Suppose the efficacy target is \(E^*=5\) units and the toxicity limit is \(T^*=8\) units. The simulated paired outcomes are:

IndividualEfficacy \(E_i(d)\)Toxicity \(T_i(d)\)Both criteria met?
164Yes
279No
353No
487Yes
542No
698No
766Yes
875Yes
939No
10107Yes

Because the criteria are strict, an efficacy value of exactly 5 does not exceed the target, and toxicity of exactly 8 is not below the limit. Individuals 1, 4, 7, 8, and 10 meet both criteria. Therefore,

$$ \widehat{p}_{\mathrm{joint}}(d) = \frac{5}{10} = 0.500. $$

The estimated joint success probability is 50.0% in this small hypothetical simulation. This calculation is an estimate for the specified population and model, not a statement that the dose will succeed for exactly half of any future group of 10.

Worked Example: Why the Joint Probability Is Not the Product of Marginal Rates

In a larger hypothetical simulation of 1,000 individuals at one dose, 900 meet the efficacy target, 850 meet the safety limit, and 810 meet both. The marginal estimates are \(900/1000=0.900\) for efficacy and \(850/1000=0.850\) for safety. The observed joint estimate is

$$ \widehat{p}_{\mathrm{joint}}(d)=\frac{810}{1000}=0.810. $$

Multiplying the two marginal probabilities would give

$$ 0.900\times0.850=0.765, $$

which is not the simulated joint probability. The product would represent the joint probability only under independence of the two success indicators. In this hypothetical set, 810 of 900 efficacy successes also meet the safety criterion, so the conditional safety success rate among efficacy successes is \(810/900=0.900\). The paired outcomes, rather than the product of the marginals, give the required estimate.

If the decision threshold is \(q=0.800\), this dose passes because \(0.810\ge0.800\). That conclusion is based on the estimated joint probability; it does not establish that the dose is acceptable under every plausible parameter value or every target population.

Short Justification of the Simulation Estimate

The indicator \(I_i(d)\) equals 1 with probability \(p_{\mathrm{joint}}(d)\) and 0 otherwise. Its expectation is therefore \(E[I_i(d)]=p_{\mathrm{joint}}(d)\). Taking expectations of the sample average gives

$$ E\left[\widehat{p}_{\mathrm{joint}}(d)\right] = E\left[\frac{1}{M}\sum_{i=1}^{M}I_i(d)\right] = \frac{1}{M}\sum_{i=1}^{M}E[I_i(d)] = p_{\mathrm{joint}}(d). $$

For independent individuals, the variance of each indicator is \(p_{\mathrm{joint}}(d)[1-p_{\mathrm{joint}}(d)]\). The variance of their average is consequently \(p_{\mathrm{joint}}(d)[1-p_{\mathrm{joint}}(d)]/M\), which yields the plug-in standard-error formula above. This justification depends on independent, identically distributed draws from the defined population simulation. Correlated simulation replicates or unequal sampling weights require an appropriate variance calculation rather than this simple formula.

Worked Example: Identifying an Acceptable Dose Window

A hypothetical simulation evaluates four candidate doses. At each dose, 10,000 paired individuals are simulated using the same efficacy and safety definitions. Suppose the prespecified decision threshold is \(q=0.800\).

Dose (mg)Joint successesEstimated joint probabilityPasses \(q=0.800\)?
506,2000.620No
1008,4000.840Yes
1508,8000.880Yes
2007,3000.730No

For example, at 100 mg the estimate is \(8,400/10,000=0.840\), which exceeds the threshold. At 200 mg it is \(7,300/10,000=0.730\), which does not. The estimated acceptable set on this candidate grid is therefore \(\{100,150\}\) mg. It is reasonable to describe these as the passing candidate doses, but the grid alone does not establish a continuous acceptable interval from 100 to 150 mg.

At 100 mg, the estimated Monte Carlo standard error is

$$ \sqrt{\frac{0.840(1-0.840)}{10,000}} = \sqrt{0.00001344} \approx 0.00367. $$

The simulation estimate is thus subject to about 0.00367 of Monte Carlo standard error, or 0.367 percentage points. This quantifies simulation precision under the assumed model; it is not a confidence assessment of the model assumptions themselves.

Diagnostics, Alternatives, and Limitations

Before interpreting a dose window, check that the simulation implements the intended question. The same simulated individual must contribute both outcomes at each dose, with any dependence induced by shared random effects or residual structure retained. Verify that the endpoint definitions, units, strict or inclusive boundary rules, regimen, and evaluation period match the decision specification. Check marginal efficacy and safety rates as well as the joint count: unexpected marginal rates can reveal a coding or model-input error even when the joint estimate appears plausible.

  • Too few simulations near the decision threshold. If an estimate is close to \(q\), Monte Carlo error may affect whether it passes. Increase the number of independent simulated individuals and reassess the estimate and its simulation error.
  • Unpaired outcomes. Simulating efficacy and toxicity in separate populations and combining them discards their dependence. Simulate both outcomes for each individual, then count joint successes.
  • Boundary mistakes. Applying \(\ge\) where the specified rule is \(>\), or \(>\) where it is \(\ge\), can change the count, especially for discrete endpoints or rounded values. Implement the stated decision rule exactly.
  • Over-interpreting a dose grid. Passing doses do not guarantee that untested doses between them pass. Evaluate additional doses if the shape or location of the window matters.
  • Confusing variability with parameter uncertainty. A large number of simulated individuals can estimate the population probability precisely conditional on fixed parameters, while uncertainty about those parameters remains. More individuals do not resolve that distinct source of uncertainty.

The paired simulation estimate is generally preferable to multiplying separate efficacy and safety probabilities because it directly estimates the event of interest without assuming independence. If a valid joint probability model is available, analytic calculation may be more efficient, but it still must represent the same dependence and endpoint definitions. In nonlinear mixed-effects applications with complex exposure-response relationships, simulation is often a practical way to preserve those features. The estimate remains only as credible as the model, target population, and endpoint assumptions; simulation does not validate them.

Key takeaway: Define success at the individual level, simulate efficacy and toxicity together, and estimate the dose-specific joint probability by the proportion meeting both criteria. A dose belongs to the estimated window only if that probability meets the prespecified decision threshold.

Check Your Understanding

Answer each question, then compare your reasoning with the concise solutions below.

  1. In 2,000 paired simulations, 1,500 individuals meet the efficacy target, 1,600 meet the safety limit, and 1,300 meet both. What is the estimated joint probability?
  2. Why is the product of the marginal success estimates not automatically the joint success estimate?
  3. A dose has estimated joint probability 0.79 when the prespecified threshold is 0.80. Does it pass the stated rule?
  4. What does the Monte Carlo standard error describe, and what important source of uncertainty does it not automatically describe?
  5. Only doses of 80 mg and 120 mg were simulated, and both pass. What can be concluded about doses between them?

Solutions. (1) The estimate is \(1,300/2,000=0.650\), or 65.0%. (2) The product equals the joint probability only under independence of the two success indicators; paired simulation directly estimates their joint event. (3) No. Since \(0.79<0.80\), the dose does not meet the specified threshold. (4) It describes finite-simulation variability conditional on the simulation setup and model; it does not by itself account for model misspecification or parameter uncertainty. (5) The two tested doses pass on the simulated grid. No conclusion follows for untested doses between them without additional evaluation or justified assumptions about the dose-response pattern.