Tutorials › Adaptive Clinical Trial Design › Joint Safety Stopping Rules

Phase 1/2 Designs With Efficacy and Toxicity · Tutorial 635 of 799

Joint Safety Stopping Rules

Build and evaluate Bayesian safety stopping rules that use posterior toxicity probabilities while keeping efficacy and toxicity interpretations distinct.

Advanced 11 min read

What You'll Learn

  • Define a dose-specific posterior probability of exceeding the maximum acceptable toxicity rate.
  • Distinguish a boundary for stopping at a dose from a rule for terminating the entire trial.
  • Derive the beta-binomial posterior tail calculation used in a basic safety rule.
  • Apply a rule to hypothetical dose-level toxicity data and interpret the decision.
  • Explain how association between efficacy and toxicity affects joint interpretation but does not relax a safety limit.
  • Identify assumptions, monitoring diagnostics, and limitations of posterior stopping rules.

Why Separate Dose Safety From Trial Stopping?

A dose-finding trial needs an explicit response to accumulating safety evidence. Without a prespecified rule, the same toxicity data may prompt different decisions at different times, especially when efficacy results are encouraging. A posterior safety rule makes the evidence threshold transparent: it specifies how much posterior evidence that a dose exceeds an acceptable toxicity rate is enough to trigger a safety action.

A dose-level action and a trial-level action are not the same. A protocol might stop assigning patients to one dose while continuing at lower doses. It might terminate the whole trial only when every available dose is judged too toxic, or when a separate protocol-defined sentinel event occurs. The trial-level rule must state which action follows from each possible pattern of dose-level results.

Definition: Let \(p_{T,j}\) denote the probability of toxicity by a prespecified assessment time at dose \(j\), and let \(p_T^*\) be the maximum acceptable toxicity probability. A posterior safety boundary at dose \(j\) is a rule to take a specified action when \(P(p_{T,j}>p_T^*\mid\text{data})\) exceeds a prespecified cutoff \(c\). The cutoff \(c\) is a design choice, not a universal constant.

For example, a protocol could suspend dose \(j\) when \(P(p_{T,j}>p_T^*\mid\text{data})>c\), and terminate the trial if all doses still available for enrollment meet that suspension criterion. Other protocols may impose a more conservative rule, such as stopping if even the lowest dose crosses its boundary. The operational rule must say exactly what happens to dose availability, enrollment, and the trial; a probability cutoff alone is not a complete stopping rule.

Model and Posterior Safety Probability

For a basic calculation, suppose toxicity is a binary outcome assessed within the same fixed window for every participant. At a given dose, assume outcomes from different participants are conditionally independent with a common toxicity probability \(p_T\). Use a beta prior \(p_T\sim\operatorname{Beta}(a,b)\), where \(a,b>0\). If \(x\) of \(n\) participants have toxicity, the likelihood is proportional to \(p_T^x(1-p_T)^{n-x}\), so the posterior is \(\operatorname{Beta}(a+x,b+n-x)\). This conjugate calculation assumes the endpoint and assessment window are consistently defined, and that the included participants have sufficiently complete toxicity follow-up for their outcomes to be classified.

$$ p_T\mid\text{data}\sim\operatorname{Beta}(a+x,b+n-x), \qquad P(p_T>p_T^*\mid\text{data}) =1-F_{\operatorname{Beta}(a+x,b+n-x)}(p_T^*). $$

Here \(F_{\operatorname{Beta}(r,s)}\) is the cumulative distribution function of a beta distribution with shape parameters \(r\) and \(s\). The posterior probability is a statement about uncertainty in \(p_T\), conditional on the model, prior, and observed data. It is not the probability that an individual patient will experience toxicity; that probability is \(p_T\), which remains uncertain.

When the posterior shape parameters are positive integers, a useful calculation identity is \(P(p_T>q)=P(Y\le r-1)\), where \(Y\sim\operatorname{Binomial}(r+s-1,q)\) and \(p_T\sim\operatorname{Beta}(r,s)\). This identity follows from the beta-binomial relationship between the beta cumulative distribution function and a binomial tail. It can be used to check software output or to calculate a tail probability by summing binomial probabilities.

$$ P(p_T>q) =\sum_{k=0}^{r-1}{r+s-1\choose k}q^k(1-q)^{r+s-1-k}. $$

The rule depends on more than the observed toxicity fraction. The prior, acceptable toxicity limit \(p_T^*\), cutoff \(c\), and timing of interim reviews all affect the action. These choices should be justified and assessed before the trial begins. In particular, \(c=0.90\) is not inherently correct: it is one possible operating threshold whose consequences need to be examined for the design and clinical setting.

Worked Example: Calculating a Posterior Safety Probability

Suppose 8 of 20 hypothetical participants treated at a dose experience the protocol-defined toxicity. Use a uniform prior, \(p_T\sim\operatorname{Beta}(1,1)\), and set the maximum acceptable toxicity probability to \(p_T^*=0.30\). Calculate the posterior probability that the dose exceeds this limit.

The model treats each participant’s toxicity outcome as a binary observation from the same assessment window, and assumes conditional independence at this dose. The posterior is \(\operatorname{Beta}(1+8,1+20-8)=\operatorname{Beta}(9,13)\). Therefore,

$$ P(p_T>0.30\mid\text{data}) =1-F_{\operatorname{Beta}(9,13)}(0.30) =P(Y\le 8),\quad Y\sim\operatorname{Binomial}(21,0.30) \approx 0.852. $$

The binomial sum is approximately \(0.8523495\), which rounds to \(0.852\) to three decimal places. If the prespecified cutoff were \(c=0.90\), this posterior probability would not cross the boundary, so this rule would not stop assignment at this dose on these data alone. That does not establish that the dose is safe; it means only that the specified posterior stopping criterion has not been met.

From Dose-Level Boundaries to a Trial-Level Rule

A trial-level safety rule combines dose-specific probabilities with the design’s dose-availability policy. One clear construction is: mark dose \(j\) as unsafe for further enrollment if its posterior probability exceeds \(c\); remove marked doses from the set of available doses; and terminate the trial if that set is empty. The protocol can also specify a different stopping condition for a serious event or an independent clinical safety review. Such conditions should be explicit rather than improvised after seeing the data.

1
Define the safety target.
Specify the toxicity endpoint, assessment window, and maximum acceptable probability \(p_T^*\) before examining interim data.
2
Update each dose’s posterior.
Use the prespecified dose model and the available, appropriately followed toxicity outcomes to calculate \(P(p_{T,j}>p_T^*\mid\text{data})\).
3
Apply the dose boundary.
Compare each posterior probability with the prespecified cutoff \(c\), and mark doses that cross it as unavailable if that is the protocol action.
4
Apply the trial boundary.
Stop the trial if the protocol-defined trial-level condition is met, such as no available dose remaining. Otherwise continue only according to the permitted dose-allocation rules.

This rule is interpretable only if the dose model supplies meaningful posterior probabilities at all doses considered. In a model that borrows information across doses, the dose-specific posterior is conditional on that model’s assumptions about the dose-toxicity relationship. The dose-level boundary can still be applied, but the resulting probabilities are not independent evidence from each dose; they may change when data at neighboring doses change.

Worked Example: Stopping One Dose Without Terminating the Trial

Consider a hypothetical trial with two doses and a uniform \(\operatorname{Beta}(1,1)\) prior at each dose. For illustration, suppose the dose-specific toxicity probabilities are modeled separately. The acceptable limit is \(p_T^*=0.30\), and the prespecified dose cutoff is \(c=0.90\). Dose 1 has 0 toxicities among 8 participants; dose 2 has 4 among 4.

At dose 1, the posterior is \(\operatorname{Beta}(1,9)\). Since the beta density has this simple tail probability,

$$ P(p_{T,1}>0.30\mid\text{data}) =(1-0.30)^9 =0.7^9 \approx 0.04035. $$

At dose 2, the posterior is \(\operatorname{Beta}(5,1)\), giving

$$ P(p_{T,2}>0.30\mid\text{data}) =1-(0.30)^5 =0.99757. $$

Dose 2 crosses the \(0.90\) cutoff, whereas dose 1 does not. Under the stated policy, dose 2 is removed from enrollment and dose 1 remains available. The trial does not terminate because at least one dose remains available. This conclusion is conditional on the illustrative independent dose models and the specified policy; a model that borrows across doses could yield different posterior probabilities.

Correlated Efficacy and Toxicity: Interpret, Do Not Trade Away Safety

Efficacy and toxicity can be associated within patients. For example, participants with greater drug exposure might be more likely both to respond and to experience toxicity. A joint outcome model represents this dependence and can distinguish the marginal response and toxicity probabilities from the probability of particular paired outcomes. Association changes the interpretation of the joint pattern: high response among participants with toxicity is not the same pattern as high response among participants without toxicity.

A safety limit remains a constraint on toxicity. If the protocol defines \(p_T^*\) as an unacceptable marginal toxicity probability, favorable efficacy should not be inserted as a credit that permits a dose above that limit. A utility-based dose choice and a safety stopping boundary answer different questions. A dose may have attractive estimated benefit while still crossing the prespecified safety boundary. Conversely, association in the observed data does not by itself prove that efficacy causes toxicity, or that toxicity causes efficacy.

When a joint model links efficacy and toxicity parameters, efficacy observations may affect the posterior for toxicity through the model’s dependence structure or shared parameters. That is a feature of the specified likelihood and prior, not a reason to discard the safety criterion. The relevant comparison remains the posterior probability that the defined toxicity parameter exceeds its limit, using the full prespecified model. Analysts should report the dependence assumptions and check whether the safety conclusion is sensitive to them.

Worked Example: Same Marginal Toxicity, Different Association

Suppose two hypothetical groups each contain 20 participants, with 10 efficacy responses and 10 toxicities in each group. In Group A, the paired counts are: 8 with both response and toxicity, 2 with response only, 2 with toxicity only, and 8 with neither. In Group B, each of the four paired categories contains 5 participants.

In both groups, the marginal toxicity rate is \(10/20=0.50\), and the marginal efficacy rate is also \(10/20=0.50\). For Group A, the joint probability estimated by the sample proportion for both outcomes is \(8/20=0.40\). The empirical covariance of the two binary indicators is \(0.40-(0.50)(0.50)=0.15\); each marginal variance is \(0.50(1-0.50)=0.25\), so the empirical correlation is \(0.15/\sqrt{0.25(0.25)}=0.60\). For Group B, the joint proportion is \(5/20=0.25\), giving covariance \(0.25-0.25=0\) and empirical correlation zero.

The paired patterns therefore differ, but the toxicity counts are the same. Under the separate uniform-prior beta-binomial safety calculation, each group gives a toxicity posterior \(\operatorname{Beta}(11,11)\) and the same posterior safety probability \(1-F_{\operatorname{Beta}(11,11)}(0.30)\). The efficacy-toxicity association informs interpretation of joint outcomes, but it does not alter this marginal calculation under the stated separate model or justify changing its safety boundary. A joint model could produce a different posterior update if it explicitly links parameters; in that case, the dependence model must be stated and the resulting safety probability still compared with the fixed safety criterion.

Assumptions, Diagnostics, and Alternatives

Before applying a posterior stopping rule, verify that the endpoint definition, dose labels, assessment window, and outcome coding are consistent. The beta-binomial calculation assumes a common toxicity probability for the participants represented at a dose. Strong patient heterogeneity, changing supportive care, dose modifications, or substantial dependence among outcomes can make that simple model inadequate. A dose-response model adds structural assumptions, such as smoothness or monotonicity, which should be examined rather than treated as facts.

Interim monitoring also requires careful handling of follow-up. A participant who has not completed the toxicity window cannot automatically be counted as having no toxicity. The rule must specify which outcomes are mature enough to use, or use a model designed for time-to-event or delayed outcomes. Otherwise, a dose may appear safer simply because its participants have had less time to experience the event.

Useful checks include reviewing dose-specific event counts and follow-up completeness, comparing posterior predictions with observed toxicity patterns, and examining whether reasonable prior choices or model assumptions change the stopping decision. A posterior probability close to \(c\) signals a decision sensitive to small changes in assumptions or data; it should not be presented as a categorical clinical truth. The trial’s operating behavior should also be assessed under plausible toxicity scenarios, including scenarios near \(p_T^*\), before the rule is used.

ApproachWhat it usesKey distinction
Posterior probability rulePosterior probability that toxicity exceeds \(p_T^*\)Expresses uncertainty conditional on prior and model; supports an explicit dose or trial action.
Observed-rate boundaryObserved toxicity proportion compared with a fixed thresholdSimpler, but does not directly quantify uncertainty and can behave erratically with small samples.
Frequentist sequential boundaryA prespecified sequential test or error-controlled boundaryControls specified long-run error properties under its assumptions; it is not a posterior probability statement.
Joint benefit-risk utilityBenefit and toxicity combined in a preference-weighted quantityCan guide dose preference, but should not silently replace a binding safety stopping constraint.

A posterior rule’s limitations follow from its inputs: it depends on prior specification, model fit, endpoint ascertainment, and the selected \(p_T^*\), \(c\), and review schedule. It does not guarantee that every dose retained is safe, nor that a dose removed would necessarily have exceeded the limit. A stopping action is a decision under uncertainty, not proof about the true toxicity probability.

Common Mistakes

  • Treating an unmet boundary as evidence of safety. If the posterior probability does not exceed \(c\), the rule has not triggered; this is not the same as establishing \(p_T\leq p_T^*\).
  • Stopping the whole trial whenever one dose crosses its boundary. That follows only if the protocol says so. A dose-specific suspension may leave lower doses available.
  • Letting efficacy compensate for an unacceptable safety probability. If the safety limit is binding, favorable efficacy does not erase a safety-boundary crossing.
  • Ignoring joint-model assumptions. Correlation can affect the posterior when the model links outcomes or parameters. State that model and assess sensitivity rather than assuming the marginal safety estimate is unaffected.
  • Counting incomplete follow-up as no toxicity. Apply the protocol’s maturity rule or an appropriate delayed-outcome model; do not treat pending outcomes as observed negatives.
Key takeaway: A joint safety stopping rule combines a defined toxicity limit, a posterior exceedance probability, a prespecified cutoff, and an explicit dose- and trial-level action. Efficacy-toxicity association can change how joint outcomes are understood, but it does not authorize overriding a binding safety limit.

Check Your Understanding

Answer each question, then compare your reasoning with the concise solutions below.

  1. With a uniform beta prior, 2 toxicities among 10 participants give what posterior distribution for \(p_T\)?
  2. If one dose crosses its safety cutoff but a lower dose does not, must the entire trial stop?
  3. Why can a high response rate among participants with toxicity not, by itself, justify ignoring a binding toxicity limit?
  4. What is one reason incomplete follow-up can make an interim safety estimate misleading?

Solutions. (1) The posterior is \(\operatorname{Beta}(1+2,1+10-2)=\operatorname{Beta}(3,9)\). (2) No. Trial termination depends on the protocol’s trial-level rule; a dose can be suspended while a lower dose remains available. (3) The safety boundary constrains toxicity probability. Efficacy-toxicity association describes the joint pattern but does not cancel the specified safety criterion. (4) Participants still within the assessment window may not yet have had the opportunity for toxicity to be observed, so counting them as toxicity-free can understate risk.

Clinical Biostats