Tutorials › Bayesian Clinical Trials › Overdose Control in a First-in-Human Escalation

Case Studies · Tutorial 678 of 696

Overdose Control in a First-in-Human Escalation

You will calculate dose-specific posterior overdose probabilities and apply a prespecified rule to determine which doses remain eligible for assignment.

Advanced 10 min read

What You'll Learn

  • Define the overdose target and posterior probability used by an overdose-control rule
  • Update dose-specific toxicity probabilities with a beta-binomial model
  • Calculate posterior overdose probabilities from the resulting beta distributions
  • Apply a prespecified cutoff to exclude doses from assignment
  • Distinguish a dose’s posterior risk from the operational rule applied to higher doses
  • Recognize data and model conditions that can make an overdose decision unreliable

Why Overdose Control Matters in Escalation

In a first-in-human escalation, each dose assignment is a safety decision made with limited information. A dose that has not produced many observed toxicities may still have a substantial probability of exceeding the trial’s acceptable toxicity target. An overdose-control rule makes this uncertainty explicit: it calculates a posterior probability of excessive toxicity and compares that probability with a cutoff specified in the protocol.

The calculation does not establish that a dose is safe, nor does it identify a dose that should be selected for later expansion. It addresses a narrower operational question: does the evidence meet the prespecified criterion for excluding this dose from further assignment? A rule can also require that all higher doses be excluded once a dose crosses the criterion. That higher-dose exclusion is a protocol safeguard; it is not, by itself, a separate posterior finding about every higher dose.

Definition: Let \(p_d\) be the probability of a dose-limiting toxicity (DLT) at dose \(d\), and let \(\phi\) be the prespecified maximum acceptable toxicity probability. The posterior overdose probability at dose \(d\) is \(P(p_d>\phi\mid\text{observed data})\). An overdose-control rule excludes dose \(d\) from assignment when this probability exceeds a prespecified cutoff \(\gamma\). A protocol may additionally exclude all doses above \(d\).

A Dose-Specific Beta-Binomial Calculation

For a transparent dose-level calculation, suppose each treated patient has a binary outcome: a DLT during a specified assessment window, or no DLT during that window. At dose \(d\), assume the outcomes are conditionally independent with a common DLT probability \(p_d\). If \(x_d\) DLTs are observed among \(n_d\) patients, then \(x_d\mid p_d\) has a binomial distribution.

For this tutorial’s calculations, use independent dose-specific priors \(p_d\sim\operatorname{Beta}(1,2)\). This is a deliberately specified illustrative prior, not a universal first-in-human prior. Its density is proportional to \(p_d^{1-1}(1-p_d)^{2-1}\). Under the binomial likelihood, the posterior is beta with parameters equal to the prior parameters updated by the observed DLT and non-DLT counts:

$$ p_d\mid x_d,n_d\sim\operatorname{Beta}(1+x_d,\;2+n_d-x_d). $$

This model treats each dose separately: the prior distributions are independent, and the likelihood at one dose does not borrow information from another. It does not impose a monotone dose-toxicity curve. The earlier material on Bayesian Dose Selection With a Logistic Toxicity Model considers a model-based dose-toxicity relationship; the calculation here instead applies a prespecified overdose rule to dose-specific posterior probabilities.

The rule requires two protocol choices. First, \(\phi\) defines what toxicity probability counts as excessive. Second, \(\gamma\) defines how much posterior probability of exceeding \(\phi\) is sufficient for exclusion. Neither number is supplied by the data alone. They should be justified and fixed in advance, rather than chosen after inspecting the observed toxicity counts.

Computing the Posterior Overdose Probability

For a posterior distribution \(p_d\mid\text{data}\sim\operatorname{Beta}(a,b)\), the quantity needed is the upper-tail probability beyond \(\phi\). It can be written as one minus the beta cumulative distribution function evaluated at \(\phi\). For positive integer \(a\) and \(b\), an equivalent expression uses a binomial probability:

$$ P(p_d>\phi\mid\text{data}) =1-F_{\operatorname{Beta}(a,b)}(\phi) =\sum_{k=0}^{a-1}\binom{a+b-1}{k}\phi^k(1-\phi)^{a+b-1-k}. $$

The identity follows from the relationship between the beta distribution and binomial tails: the beta cumulative probability \(F_{\operatorname{Beta}(a,b)}(\phi)\) equals the probability that a \(\operatorname{Binomial}(a+b-1,\phi)\) random variable is at least \(a\). Taking the complement gives the sum from zero through \(a-1\). In practice, software can evaluate the beta tail directly; the finite sum is useful for checking calculations when the parameters are integers.

Worked Example: Applying the Rule to Four Escalation Doses

Hypothetical data. A first-in-human protocol assesses DLTs over the same complete window for every patient. Six patients have completed assessment at each of four ordered doses. The observed DLT counts are 0, 1, 2, and 3, respectively. The protocol sets \(\phi=0.30\), \(\gamma=0.80\), and states that if a dose meets the exclusion criterion, that dose and all higher doses are excluded from assignment. Apply the rule using the \(\operatorname{Beta}(1,2)\) prior.

At the first dose, \(x=0\) of \(n=6\), so the posterior is \(\operatorname{Beta}(1+0,2+6-0)=\operatorname{Beta}(1,8)\). Its overdose probability is \(P(p_d>0.30\mid\text{data})=0.70^8=0.05765\).

At the second dose, \(x=1\) of \(n=6\), giving \(\operatorname{Beta}(2,7)\). With \(a+b-1=8\), the binomial-tail expression gives \(0.70^8+8(0.30)(0.70^7)=0.057648+0.197650=0.2553\).

At the third dose, \(x=2\) of \(n=6\), giving \(\operatorname{Beta}(3,6)\). The posterior overdose probability is \(0.70^8+8(0.30)(0.70^7)+28(0.30^2)(0.70^6)=0.5518\).

At the fourth dose, \(x=3\) of \(n=6\), giving \(\operatorname{Beta}(4,5)\). Adding the \(k=3\) term gives \(0.5517738+56(0.30^3)(0.70^5)=0.8059\).

Only the fourth dose has posterior overdose probability greater than \(0.80\). It therefore meets the specified exclusion criterion. Under this protocol’s additional higher-dose rule, the fourth dose and every dose above it are excluded from assignment. The first three doses do not meet the posterior cutoff in this calculation. This conclusion is conditional on the stated model, prior, completed outcomes, and rule; it is not a guarantee that the remaining doses are safe.

What the Rule Does—and Does Not—Infer

The comparison is strict as defined here: exclude when the posterior probability is greater than \(\gamma\). If it equals \(\gamma\), the rule does not exclude unless the protocol explicitly specifies a different convention. A protocol should also define what happens when an estimate is unavailable, when a cohort has unresolved DLT assessment, or when no dose remains eligible.

The posterior probability and the operational exclusion set are related but not identical. The posterior calculation is specific to a dose. The protocol’s monotone exclusion safeguard may then remove higher doses from assignment even if their own posterior probabilities have not crossed the cutoff. In the first worked example, the rule excludes the dose that crossed the cutoff and doses above it; it does not assert that every excluded higher dose independently crossed the threshold.

This approach is useful because it places uncertainty and the safety threshold on a common probability scale. It is also limited. Independent dose-specific analyses do not share information across doses, so estimates can be unstable when cohorts are small. They do not enforce the clinically plausible expectation that toxicity risk tends to rise with dose. A model-based alternative, such as a logistic toxicity model, can represent a dose-toxicity relationship and borrow information across levels, but depends on the chosen model and its assumptions. The dose-specific rule is simpler to audit, but simplicity does not remove the need to justify the prior, target, and cutoff.

Worked Example: A Posterior Probability Just Above a Stricter Cutoff

Hypothetical data. At a dose, four patients complete the DLT window and three experience a DLT. Use the same \(\operatorname{Beta}(1,2)\) prior, but suppose the protocol specifies \(\phi=0.25\) and \(\gamma=0.90\). Determine whether this dose meets the exclusion criterion.

The posterior is \(\operatorname{Beta}(1+3,2+4-3)=\operatorname{Beta}(4,3)\). For this distribution, the beta cumulative distribution function at \(0.25\) is \(15(0.25)^4-24(0.25)^5+10(0.25)^6=0.03760\). Therefore, \(P(p_d>0.25\mid\text{data})=1-0.03760=0.9624\).

Because \(0.9624>0.90\), the dose meets this protocol’s exclusion criterion. If the protocol also excludes all higher doses, those higher levels are removed from assignment as an operational consequence. This conclusion uses the stated target and cutoff; changing either would change the decision.

Assumptions, Diagnostics, and Failure Modes

Before applying the rule, check that its data and model conditions are credible. The binomial likelihood assumes a well-defined binary DLT outcome and a common underlying probability for patients treated at the same dose under the relevant trial conditions. It also assumes conditional independence of patient outcomes. The assessment window and DLT definition must be consistent, and the outcomes used for a decision should be sufficiently complete for the protocol’s timing rule.

A missing or immature safety outcome is not equivalent to a non-DLT. Treating an unresolved patient as toxicity-free can lower the posterior overdose probability and make a dose appear more acceptable than the evidence supports. The protocol should specify how delayed outcomes, withdrawals, and missing assessments are handled before the calculation is used. If dose assignment or supportive care changes the meaning or observation of DLTs across cohorts, the assumption of comparable outcomes deserves scrutiny.

Check the arithmetic as well as the assumptions: the posterior shape parameters must add the DLT count to the first prior parameter and the non-DLT count to the second. Confirm that the computed tail is \(P(p_d>\phi\mid\text{data})\), not the probability below \(\phi\), and compare it with the protocol’s actual cutoff. A tail probability unexpectedly close to zero after many observed DLTs, or close to one after none, is a prompt to check the target, parameter order, and calculation.

The posterior probability is not a frequentist error rate and is not the probability that a null hypothesis is true. It expresses uncertainty about \(p_d\), conditional on the specified prior and data. The cutoff \(\gamma\) is a decision threshold, not a guarantee of a particular rate of severe toxicity across trials. Operating characteristics of a proposed rule may need separate evaluation under plausible scenarios; this tutorial’s calculations do not establish those operating characteristics.

Worked Example: A Near-Cutoff Result and Its Interpretation

Hypothetical data. At a dose, two of three patients complete the assessment window with DLT. With the \(\operatorname{Beta}(1,2)\) prior, the posterior is \(\operatorname{Beta}(3,3)\). For \(\phi=0.25\), its cumulative probability below the target is \(10(0.25)^3-15(0.25)^4+6(0.25)^5=0.1035\), so the posterior overdose probability is \(1-0.1035=0.8965\).

If the protocol cutoff is \(\gamma=0.90\), this result does not meet the strict exclusion criterion because \(0.8965<0.90\). It is close to the cutoff, however, and should not be reported as strong evidence of safety. The rule gives a prespecified assignment decision; the posterior still indicates substantial uncertainty and a high probability of exceeding the target. If the cutoff were \(0.89\), the same posterior would meet the exclusion criterion. This illustrates why the threshold must be prespecified.

Common Mistake and Practical Comparison

  • Wrong reasoning: “The overdose probability is 0.8059, so there is an 80.59% chance that the dose is unsafe in every meaningful sense.” Correction: It is the posterior probability that the dose-specific DLT probability exceeds the particular target \(\phi\), conditional on the model, prior, and observed data. “Unsafe” may involve additional clinical considerations not represented by that target.
  • Wrong reasoning: “A dose below the cutoff has been shown safe.” Correction: It has not met this rule’s exclusion condition. The calculation does not prove safety or rule out clinically important toxicity.
  • Wrong reasoning: “If one dose crosses the cutoff, the posterior calculations prove that every higher dose is also excessive.” Correction: The rule may exclude higher doses by protocol, but the dose-specific posterior calculation only quantifies the risk at the dose whose data were used.

Compared with a deterministic rule based only on the observed toxicity proportion, the posterior rule accounts for uncertainty and makes the prior contribution explicit. Compared with a model-based dose-toxicity analysis, the independent beta-binomial approach requires fewer structural assumptions but does not pool information or enforce an ordered toxicity curve. No method removes the need to define the DLT outcome, target, decision threshold, and assignment safeguards in advance.

Key takeaway: Calculate the posterior distribution at each dose, evaluate \(P(p_d>\phi\mid\text{data})\), and apply the prespecified cutoff \(\gamma\). Keep the posterior finding separate from any protocol rule that automatically excludes higher doses, and never interpret a dose that remains eligible as proven safe.

Check Your Understanding

Answer each question using the definitions and decision convention in this tutorial. Brief solutions follow the questions.

  1. With a \(\operatorname{Beta}(1,2)\) prior, what is the posterior after one DLT among five patients at a dose?
  2. For a posterior \(\operatorname{Beta}(1,5)\) and target \(\phi=0.25\), calculate the posterior overdose probability.
  3. If the posterior overdose probability is exactly \(0.90\) and the rule excludes only when it is greater than \(0.90\), is the dose excluded by that criterion?
  4. Why is an incomplete DLT assessment window not automatically counted as a non-DLT?

Solutions. (1) There are four non-DLT outcomes, so the posterior is \(\operatorname{Beta}(1+1,2+5-1)=\operatorname{Beta}(2,6)\). (2) For \(\operatorname{Beta}(1,5)\), the upper tail is \((1-\phi)^5=0.75^5=0.2373\). (3) No. Equality does not satisfy a strict greater-than rule, unless the protocol defines another convention. (4) The patient may experience a DLT later in the specified window; counting an unresolved outcome as a non-DLT can understate the posterior overdose probability.

Clinical Biostats