Tutorials › Bayesian Clinical Trials › Temporary Suspension Versus Permanent Dropping

Adaptive and Platform Designs · Tutorial 562 of 696

Temporary Suspension Versus Permanent Dropping

Distinguish a reversible pause from permanent arm removal and evaluate the clinical evidence and operational conditions that should govern each action.

Advanced 12 min read

What You'll Learn

  • Define temporary suspension and permanent arm removal in a platform trial.
  • Separate posterior evidence about benefit or harm from operational reasons to pause enrollment.
  • Calculate a posterior safety probability with a beta-binomial model.
  • Apply a prespecified futility threshold to a hypothetical treatment arm.
  • Specify practical conditions for suspending, reviewing, and potentially reopening an arm.
  • Identify diagnostics and decision errors that can lead to premature or inconsistent removal.

Why the Distinction Matters

An arm that stops enrolling patients has not necessarily been removed permanently. A temporary suspension is a reversible operational state: new participants are not assigned to that arm while a defined concern is assessed or corrected. Permanent dropping, also called arm removal, ends enrollment to that intervention under the current trial design. The distinction matters because a pause preserves the option to restart, whereas removal changes which comparisons the platform can make and generally requires a formal design or protocol amendment to reverse.

Either action may follow concerning clinical evidence, such as a high posterior probability of unacceptable toxicity or a low probability of clinically worthwhile benefit. A suspension may also be appropriate for a nonclinical reason, such as a drug-supply interruption or a data-integrity problem. These reasons should not be conflated: operational problems do not establish that a treatment is ineffective, and posterior evidence of harm is not merely an administrative inconvenience.

Definition: A temporary suspension stops new enrollment to an arm for a defined period or pending a specified review, while preserving the possibility of reopening it under stated conditions. Permanent dropping stops new enrollment to that arm for the remainder of the current design. In either case, participants already assigned to the arm remain in follow-up and receive appropriate care and safety monitoring; stopping enrollment alone does not determine their treatment.

Evidence and Operational Conditions

An evidence-based action should use a prespecified rule, not an improvised cutoff chosen after seeing the interim results. For example, let \(p_a\) denote the probability of a clinically important adverse event under arm \(a\), and let \(p_{\max}\) be a clinically justified unacceptable rate. A safety rule might suspend enrollment when \(P(p_a>p_{\max}\mid D)\) exceeds a prespecified threshold, where \(D\) is the available trial data. A futility rule might drop an arm when its posterior probability of meeting a defined clinical target falls below a prespecified threshold. The posterior probability describes uncertainty about the parameter given the model, prior, and data; it is not the probability that a hypothesis is true in a frequentist test.

The threshold alone does not settle the decision. Before acting, the team should check that the endpoint, analysis population, data cut, prior, and clinical margin match the protocol. It should also assess whether the available observations are sufficiently reliable for the rule to be informative. A posterior probability based on a small or poorly verified data set can be numerically precise-looking without being decision-ready. The earlier material on posterior superiority rules, posterior futility rules, and clinical margins provides the decision-rule framework; here the focus is what follows from a signal and whether the response should be reversible.

Operational conditions can independently justify suspension. Examples include an unavailable investigational product, a site unable to follow the dosing procedure, a laboratory assay failing quality control, or a suspected data-processing error. A sound plan states what triggers a pause, who reviews the issue, what evidence is required to resolve it, and who authorizes reopening. If the problem cannot be corrected, or if the arm has no defensible role in the trial after review, permanent removal may be appropriate. If new enrollment can safely resume after a bounded correction, suspension better preserves the design’s options.

Worked Example: Safety Signal and a Temporary Suspension

Suppose a hypothetical arm has 8 clinically important adverse events among 20 participants. For illustration, use a \(\mathrm{Beta}(1,1)\) prior for the adverse-event probability \(p_a\), and let the prespecified unacceptable rate be \(p_{\max}=0.20\). The protocol says to suspend new enrollment for review if \(P(p_a>0.20\mid D)>0.95\). Assume the 20 observations are correctly classified and the model’s independent Bernoulli sampling assumption is appropriate for this simplified calculation.

With \(x=8\) events among \(n=20\), beta-binomial conjugacy gives the posterior:

$$ p_a\mid D \sim \mathrm{Beta}(1+x,1+n-x) =\mathrm{Beta}(9,13). $$

For integer beta parameters, if \(Z\sim\mathrm{Beta}(a,b)\) and \(Y\sim\mathrm{Binomial}(a+b-1,c)\), then \(P(Z>c)=P(Y\leq a-1)\). Here \(a=9\), \(b=13\), and \(c=0.20\), so:

$$ \begin{aligned} P(p_a>0.20\mid D) &=P\{\mathrm{Binomial}(21,0.20)\leq 8\}\\ &=\sum_{k=0}^{8}{21\choose k}(0.20)^k(0.80)^{21-k}\\ &\approx 0.9856. \end{aligned} $$

Because \(0.9856>0.95\), the prespecified rule is met. New enrollment to this arm should be temporarily suspended and the signal reviewed. This calculation supports a safety action; it does not by itself establish that the treatment caused the events or require permanent removal. Review should verify event classification and data quality, consider the clinical seriousness of the events, and follow the trial’s safety-governance procedures. If the evidence remains concerning, the responsible committee may recommend permanent removal under the protocol; if the signal is explained or the risk can be managed, reopening may be considered.

Justifying the Posterior Tail Calculation

The identity used above is a convenient way to evaluate a beta posterior tail when both beta parameters are positive integers. For \(Z\sim\mathrm{Beta}(a,b)\), its density is \(f(z)=z^{a-1}(1-z)^{b-1}/B(a,b)\), where \(B(a,b)=(a-1)!(b-1)!/(a+b-1)!\). Let \(m=a+b-1\). The binomial probability \(P(Y\leq a-1)\), for \(Y\sim\mathrm{Binomial}(m,c)\), is a polynomial in \(c\). Differentiating that sum and cancelling adjacent terms gives

$$ \frac{d}{dc}P(Y\leq a-1) =-\frac{m!}{(a-1)!(b-1)!}c^{a-1}(1-c)^{b-1} =-f(c). $$

The posterior tail \(P(Z>c)\) also has derivative \(-f(c)\). Both quantities equal 1 at \(c=0\); therefore they are equal for \(0\leq c\leq1\). This verifies the identity rather than treating the binomial calculation as a separate approximation.

When Permanent Dropping Is Better Supported

Permanent removal is more consequential than a short pause because the trial gives up the option to collect further randomized evidence on that intervention under the current design. It is therefore most defensible when a prespecified clinical decision rule is met, the data and analysis have been checked, and there is no realistic corrective action that would make continued enrollment appropriate. Relevant considerations include the magnitude of possible benefit or harm, remaining uncertainty, the arm’s scientific and clinical purpose, participant safety, and the operational feasibility of continuation.

A posterior futility probability must be tied to an explicit clinical target. For example, in a single-arm illustration, let \(p_a\) be the response probability and let \(p_*=0.40\) be the minimum rate judged worth pursuing. A futility rule could require dropping the arm if \(P(p_a>p_*\mid D)<0.05\). This rule concerns the chance of exceeding the stated benchmark under the model; it is not a general-purpose declaration that the treatment has no effect. In a comparative trial, the clinical target would generally be expressed through a contrast with control and an appropriate clinical margin.

Worked Example: Applying a Prespecified Futility Rule

Consider a hypothetical single-arm study with 1 response among 10 participants. Use a \(\mathrm{Beta}(1,1)\) prior for the response probability \(p_a\), assume independent binary responses with a common probability, and define \(p_*=0.40\) as the minimum response rate of interest. Suppose the prespecified rule is to drop the arm if \(P(p_a>0.40\mid D)<0.05\).

The posterior is \(\mathrm{Beta}(2,10)\). Using the beta-binomial identity with \(a=2\), \(b=10\), and \(c=0.40\):

$$ \begin{aligned} P(p_a>0.40\mid D) &=P\{\mathrm{Binomial}(11,0.40)\leq 1\}\\ &=(0.60)^{11}+{11\choose1}(0.40)(0.60)^{10}\\ &=0.003628+0.02660\\ &\approx 0.03023. \end{aligned} $$

Since \(0.03023<0.05\), the specified futility criterion is met. Under the assumed model and rule, permanent removal is supported, subject to checking the data, endpoint definition, prior, and protocol. The conclusion is that the posterior probability of exceeding the chosen 40% benchmark is about 3.0%, not that the response probability is exactly zero or that every patient would fail to respond. The 40% benchmark is illustrative and must be clinically justified in an actual trial.

Operational Suspension and Reopening

An operational pause should have an equally explicit trigger and resolution path, even when no posterior probability is involved. Suppose, hypothetically, that the protocol requires suspension of an arm if more than 10% of its required laboratory samples fail a specified assay-quality check in a rolling set of 20 samples. If 3 of 20 fail, the observed failure fraction is

$$ \frac{3}{20}=0.15=15\%>10\%. $$

The operational threshold is met, so new enrollment to the affected arm is paused while the assay problem is investigated. This proportion is a process-monitoring statistic, not a posterior probability that the treatment is ineffective or unsafe. A reopening plan might require correction of the assay issue, documented staff retraining where needed, and successful completion of the protocol’s specified quality checks. The plan should also state who confirms that those conditions have been met and how participants already enrolled will be followed.

The distinction between the two actions can be summarized as follows:

Decision featureTemporary suspensionPermanent dropping
New enrollmentPaused pending a defined review or correctionEnds for the arm under the current design
ReversibilityReopening is possible if stated conditions are satisfiedNot reopened without a formal change to the design or protocol
Typical basisUnresolved safety signal, operational failure, or a reviewable concernPrespecified evidence of futility or unacceptable risk, or an unresolvable operational problem
Follow-up of enrolled participantsContinues as requiredContinues as required

Diagnostics, Alternatives, and Limitations

Before treating a rule as decisive, check the inputs and the decision’s scope. Confirm that the interim data are complete enough for the intended endpoint, event definitions are applied consistently, and the analysis population matches the protocol. Examine whether the conclusion is sensitive to reasonable prior choices or to small changes in the clinical margin. A result that changes from “pause” to “continue” under modest, plausible changes should prompt careful review rather than false certainty. Also check whether operational explanations, such as a site-specific measurement problem, could account for an apparent arm-level pattern.

A temporary suspension is often preferable when a concern is serious enough to stop new exposure but plausibly resolvable, when the evidence warrants independent review, or when an operational defect could be corrected. Permanent dropping is more appropriate when the trial’s prespecified evidence rule is met and the decision remains justified after verification, or when continuation is no longer safe or feasible. Continuing enrollment without a pause is another option when the evidence and operations remain acceptable, but it should not be chosen merely to avoid making a difficult decision.

Neither action is a substitute for a well-designed rule. A suspension can disrupt recruitment and comparisons, and an unclear pause may persist indefinitely or be lifted inconsistently. Permanent removal can reduce the information available about an arm and may alter the trial’s scientific objectives. Posterior thresholds also depend on the model, prior, endpoint, and clinical margin; they do not automatically account for every clinical or operational consequence. The decision record should document the data cut, rule applied, rationale, participants’ follow-up plan, and any conditions for reopening or removal.

Common Mistake

A frequent error is to treat “the posterior crossed a threshold” as synonymous with “the arm must be dropped permanently.” That reasoning ignores the distinction between a decision signal and the operational action it supports. A safety threshold may call for an immediate temporary suspension and independent review, while the final evidence and review determine whether the arm can reopen or should be removed. Conversely, a supply or assay problem may justify suspension without providing any evidence about treatment efficacy. Match the action to both the type of concern and the prespecified response plan.

Key takeaway: A suspension preserves the possibility of restarting an arm; permanent dropping ends enrollment under the current design. Use prespecified clinical evidence rules for efficacy or safety decisions, explicit operational triggers for process failures, and clear review and reopening conditions for any temporary pause.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. What is the defining difference between temporarily suspending an arm and permanently dropping it?
  2. A prespecified safety rule is crossed, but the event data may contain classification errors. What action is generally more appropriate while the data are verified, and why?
  3. In the futility example, what does the posterior probability of about 0.030 describe? What does it not establish?
  4. An assay failure rate exceeds a protocol’s operational trigger. Does that alone show that the arm is clinically ineffective? Explain.
  5. Name two conditions that a protocol should specify before a suspended arm can reopen.

Solutions. (1) Suspension pauses new enrollment while leaving reopening possible under stated conditions; permanent dropping ends enrollment under the current design. (2) A temporary suspension pending verification is generally appropriate because it limits new exposure while preserving the option to resume if the signal resulted from data error. (3) It is the posterior probability that the response rate exceeds the illustrative 40% benchmark, given the model, prior, and observed data; it does not prove the response rate is zero or determine every patient’s outcome. (4) No. It supports an operational pause and investigation, not a conclusion about clinical efficacy. (5) For example, the protocol could require documented correction of the assay problem and successful completion of specified quality checks, with reopening authorized by a named review body.

Clinical Biostats