Tutorials › Adaptive Clinical Trial Design › Overdose Control With Efficacy Requirements

Phase 1/2 Designs With Efficacy and Toxicity · Tutorial 627 of 799

Overdose Control With Efficacy Requirements

You will learn to apply separate posterior safety and efficacy thresholds to determine which doses may be considered for escalation or selection.

Advanced 11 min read

What You'll Learn

  • Define posterior overdose-control and minimum-efficacy criteria for each dose.
  • Derive a beta-binomial calculation for checking a posterior efficacy requirement.
  • Determine when both criteria permit escalation or final consideration of a dose.
  • Distinguish separate marginal criteria from a joint posterior probability requirement.
  • Recognize how uncertainty, delayed data, and poorly chosen thresholds can undermine these rules.

Two Requirements, One Admissible-Dose Set

Dose finding must address two different questions: is the probability of unacceptable toxicity sufficiently low, and is the probability of efficacy high enough to make the dose worth considering? A dose can satisfy one condition and fail the other. An efficacy signal does not cancel an excessive toxicity risk, and apparent safety alone does not make an ineffective dose a useful choice.

The introductory material on posterior probabilities of acceptable doses treats posterior evidence about dose acceptability. Here the focus is the explicit combination of an overdose-control limit with a minimum-efficacy requirement, and how their intersection can constrain both escalation and final consideration. The numerical thresholds are design choices that must be specified before using the rule.

Definition: At dose \(d\), let \(p_T(d)\) denote the probability of a dose-limiting toxicity and \(p_E(d)\) the probability of the prespecified efficacy outcome, each for a participant treated at that dose under the trial’s outcome definitions. Let \(\phi_T\) be the maximum acceptable toxicity probability and \(\phi_E\) the minimum efficacy probability of interest. Given accumulated data \(D\), a dose passes the posterior overdose-control condition if \(P\{p_T(d)>\phi_T\mid D\}\leq\xi\), where \(\xi\) is the design’s maximum tolerated posterior probability of overdose. It passes the posterior efficacy condition if \(P\{p_E(d)\geq\phi_E\mid D\}\geq\eta\), where \(\eta\) is the required posterior probability of adequate efficacy. A dose is admissible under both conditions only if it passes both.

The strict inequality in the overdose event and the weak inequality in the efficacy event follow the definitions above; a protocol should use its chosen boundary conventions consistently. The thresholds \(\phi_T,\phi_E,\xi,\eta\) are not universal constants. They encode a clinical standard and a decision tolerance for uncertainty. For example, \(\phi_T=0.30\) means toxicity probabilities above 30% are considered excessive, while \(\xi=0.25\) allows at most 25% posterior probability that a dose exceeds that limit.

The two posterior checks are usually marginal: one concerns \(p_T(d)\), the other \(p_E(d)\). Passing both does not, by itself, imply that the posterior probability of a joint event involving both outcomes exceeds a specified value. If the design instead requires \(P\{p_T(d)\leq\phi_T,\ p_E(d)\geq\phi_E\mid D\}\) to exceed a threshold, that is a different rule and requires a joint posterior distribution. The dependence between efficacy and toxicity can matter for such a joint probability.

Posterior Checks Under a Beta-Binomial Model

For a transparent calculation, suppose that at each dose the toxicity outcomes are binary and conditionally independent across participants, with probability \(p_T(d)\). Assign \(p_T(d)\) a beta prior, and update it using the observed toxicity count. Use the analogous model for binary efficacy outcomes. With a \(\operatorname{Beta}(a,b)\) prior and \(x\) events among \(n\) participants, the posterior is \(\operatorname{Beta}(a+x,b+n-x)\). A uniform \(\operatorname{Beta}(1,1)\) prior therefore gives posterior \(\operatorname{Beta}(x+1,n-x+1)\).

These simple marginal models assume a consistent binary outcome definition, complete outcome ascertainment for the participants included, and the stated binomial sampling model at each dose. They do not require efficacy and toxicity outcomes to be independent within a participant for their marginal probabilities to be assessed separately. But a joint posterior probability cannot be calculated by multiplying marginal probabilities unless the posterior quantities are independent under an appropriate joint model.

When the posterior is beta with integer parameters, a beta-binomial identity can turn the efficacy probability into a finite binomial sum. If \(p\mid D\sim\operatorname{Beta}(a,b)\), \(a,b\) are positive integers, and \(X\sim\operatorname{Binomial}(a+b-1,q)\), then

$$ P(p\geq q\mid D)=P(X\leq a-1). $$

This identity follows by differentiating the binomial sum on the right with respect to \(q\): its derivative is \(-q^{a-1}(1-q)^{b-1}/B(a,b)\), the negative beta density. Both sides equal 1 at \(q=0\), so integrating the matching derivatives establishes equality. It provides a direct way to evaluate the posterior efficacy condition using a binomial cumulative probability.

Worked Example: Checking Both Conditions Across Doses

Suppose a hypothetical trial uses \(\phi_T=0.30\), \(\xi=0.25\), \(\phi_E=0.40\), and \(\eta=0.80\). Independent uniform priors are used for the marginal toxicity and efficacy probabilities at each dose. The accumulated data give the following posteriors:

DoseToxicity posteriorEfficacy posterior
\(d_1\)\(\operatorname{Beta}(2,8)\)\(\operatorname{Beta}(7,5)\)
\(d_2\)\(\operatorname{Beta}(2,5)\)\(\operatorname{Beta}(8,4)\)

For a \(\operatorname{Beta}(2,b)\) toxicity posterior, the probability above a threshold \(t\) is \((1-t)^b(1+bt)\). Thus, at \(d_1\),

$$ P\{p_T(d_1)>0.30\mid D\} =(1-0.30)^8\{1+8(0.30)\} =0.7^8(3.4) =0.196003234 \approx 0.1960. $$

This is below \(\xi=0.25\), so \(d_1\) passes overdose control. At \(d_2\),

$$ P\{p_T(d_2)>0.30\mid D\} =0.7^5\{1+5(0.30)\} =0.16807(2.5) =0.420175 \approx 0.4202. $$

This exceeds 0.25, so \(d_2\) fails overdose control.

For efficacy, the beta-binomial identity gives \(P\{p_E(d_1)\geq0.40\mid D\}=P\{\operatorname{Binomial}(11,0.40)\leq6\}\). The probability of 7 through 11 successes is 0.099352576, so this probability is \(1-0.099352576=0.900647424\), or approximately 0.9006. It exceeds \(\eta=0.80\), and \(d_1\) passes the efficacy condition.

At \(d_2\), the identity gives \(P\{p_E(d_2)\geq0.40\mid D\}=1-P\{\operatorname{Binomial}(11,0.40)\geq8\}\). The upper tail is \(0.0233570304+0.0051904512+0.00069206016+0.00004194304=0.0292814848\). Therefore,

$$ P\{p_E(d_2)\geq0.40\mid D\} =1-0.0292814848 =0.9707185152 \approx0.9707. $$

Thus \(d_2\) passes the efficacy condition but fails overdose control. Under the rule requiring both conditions, only \(d_1\) is admissible. The stronger efficacy evidence at \(d_2\) does not compensate for its excessive posterior probability of crossing the toxicity limit.

Using the Intersection to Constrain Decisions

The set of admissible doses is the intersection of the safety-passing set and the efficacy-passing set. This simple set operation has an important practical implication: a dose becomes eligible only when the evidence supports both conditions. If escalation is permitted only to an admissible dose, then the next dose must satisfy the overdose-control condition and the minimum-efficacy condition under the prespecified rule. This is a design choice, not a universal feature of escalation procedures; some protocols use efficacy chiefly to restrict final selection rather than to control every escalation.

1
Set the clinical boundaries.
Specify the toxicity boundary \(\phi_T\), efficacy minimum \(\phi_E\), and posterior tolerances \(\xi\) and \(\eta\) before the trial uses these criteria.
2
Evaluate posterior evidence at each relevant dose.
Using the prespecified model and currently available outcomes, calculate the posterior probability of exceeding \(\phi_T\) and the posterior probability of reaching \(\phi_E\).
3
Apply both gates.
Keep a dose admissible only if its overdose probability is no greater than \(\xi\) and its efficacy probability is at least \(\eta\). Apply the protocol’s additional dose-order and escalation restrictions separately.
4
Restrict final consideration.
Consider final dose selection only among admissible doses, or stop if the protocol specifies that no admissible dose means no dose can be selected.

A dose can fail either gate in either direction. High toxicity evidence can eliminate a dose even when efficacy evidence is compelling. Conversely, a dose with low posterior overdose probability can be excluded if evidence does not support the minimum efficacy requirement. If no dose passes both conditions, the rule does not identify an admissible dose; it does not justify relaxing a threshold after seeing the results.

Worked Example: Escalation Candidate Fails the Safety Gate

Consider a hypothetical escalation decision with the same thresholds as the previous example. The next candidate dose has posterior \(p_T(d)\sim\operatorname{Beta}(2,5)\) and \(p_E(d)\sim\operatorname{Beta}(8,4)\). Its posterior overdose probability is \(0.420175\), as calculated from \(0.7^5(2.5)\), which is greater than \(\xi=0.25\). Its posterior efficacy probability is \(0.9707185\), which is greater than \(\eta=0.80\).

The candidate passes efficacy but fails overdose control. Under a policy that allows escalation only to doses passing both gates, escalation to this candidate is not permitted. This conclusion is not a claim that the dose is certainly unsafe: the posterior probability of exceeding the toxicity boundary is 42.02%, not 100%. It is the consequence of a prespecified tolerance that allows no more than 25% posterior probability of overdose.

Worked Example: A Safe-Looking Dose Fails the Efficacy Requirement

Suppose another hypothetical dose has toxicity posterior \(\operatorname{Beta}(2,8)\) and efficacy posterior \(\operatorname{Beta}(2,8)\), with \(\phi_T=0.30\), \(\xi=0.25\), \(\phi_E=0.40\), and \(\eta=0.80\). The toxicity calculation is

$$ P\{p_T(d)>0.30\mid D\} =0.7^8(1+8(0.30)) =0.196003234 \approx0.1960. $$

The dose passes overdose control. For efficacy, the beta-binomial identity gives \(P\{p_E(d)\geq0.40\mid D\}=P\{\operatorname{Binomial}(9,0.40)\leq1\}\), so

$$ P\{\operatorname{Binomial}(9,0.40)\leq1\} =0.6^9+9(0.40)(0.6^8) =0.010077696+0.060466176 =0.070543872 \approx0.07054. $$

This is below \(\eta=0.80\). The dose therefore fails the efficacy gate despite passing overdose control, and it is not admissible under the combined rule. This result expresses insufficient posterior support for adequate efficacy; it does not prove that the dose’s efficacy probability is below 0.40.

Diagnostics, Alternatives, and Limitations

Before applying the gates, check that the outcome definitions, analysis populations, and assessment windows match those used to set the clinical boundaries. Delayed toxicity or efficacy outcomes can make a posterior calculation look more reassuring than the available evidence warrants if participants without mature outcomes are treated as though their outcomes were known. Likewise, small samples can leave broad posterior distributions; a point estimate below \(\phi_T\) is not a substitute for checking the posterior probability above \(\phi_T\).

A useful diagnostic is to examine the posterior probabilities across all doses, not just the dose currently under consideration. Unexpected reversals across ordered doses may reflect sampling variability, data problems, or a model that does not capture the dose-response pattern. Do not silently force monotonicity or smooth the estimates after observing results. If a model imposes a dose-response structure, assess whether its assumptions are plausible and report how that structure affects the gates. Also inspect sensitivity to reasonable prior choices, especially when data are sparse and the decision is close to a threshold.

Compared with a rule based only on toxicity, the combined rule prevents a dose from being considered merely because it appears tolerable when efficacy is unlikely to reach a meaningful minimum. Compared with a rule based only on efficacy, it prevents a promising efficacy estimate from overriding an unacceptable posterior overdose probability. A single utility score is another possible decision framework, but it allows different benefit-risk tradeoffs and is not equivalent to requiring both separate gates. The thresholds make the present rule interpretable, while also making clear which doses are excluded and why.

Common pitfall: “The dose has excellent efficacy evidence, so it should be acceptable even though its overdose probability exceeds the limit.” This reasoning lets one endpoint compensate for violating the other endpoint’s constraint. Under a rule requiring both gates, a dose that fails either condition is inadmissible. Also avoid calling a dose “safe” just because it passes: passing means its posterior overdose probability is within the chosen tolerance, not that toxicity is impossible.

These rules depend on the clinical relevance of the cutoffs, the adequacy of the outcome models, and the timing and completeness of observed data. Separate marginal gates also do not summarize the probability that both true dose-level conditions hold simultaneously. If a design needs that joint statement, it must specify and fit a suitable joint model rather than infer it from two marginal checks.

Check Your Understanding

Answer each question using the definitions and thresholds in the question.

  1. A dose has posterior overdose probability 0.18 with \(\xi=0.20\), but posterior efficacy probability 0.72 with \(\eta=0.80\). Is it admissible?
  2. For \(p\mid D\sim\operatorname{Beta}(2,5)\), calculate \(P(p>0.30\mid D)\). Does it pass an overdose limit \(\xi=0.25\)?
  3. Why does passing separate marginal efficacy and toxicity gates not necessarily establish a specified posterior probability that both conditions hold jointly?
  4. A dose passes overdose control but has posterior efficacy probability below \(\eta\). What does the combined rule conclude, and what does it not prove?

Solutions. (1) No. It passes safety because \(0.18\leq0.20\), but fails efficacy because \(0.72<0.80\). (2) \(P(p>0.30\mid D)=0.7^5\{1+5(0.30)\}=0.16807(2.5)=0.420175\approx0.4202\); this exceeds 0.25, so the dose fails. (3) The two probabilities are marginal. Their joint probability depends on posterior dependence and cannot generally be obtained from the marginals alone. (4) The dose is inadmissible under the two-gate rule. This does not prove its efficacy probability is below the minimum; it means the required posterior support for adequate efficacy was not reached.

Clinical Biostats