Tutorials › Bayesian Clinical Trials › Control-Arm Retention Constraints

Adaptive and Platform Designs · Tutorial 560 of 696

Control-Arm Retention Constraints

Learn how to encode a control-retention constraint so an experimental arm cannot continue without its control, and how a control concern changes the platform’s stopping decision.

Advanced 10 min read

What You'll Learn

  • Define a control-retention invariant for a platform trial.
  • Distinguish a control-arm signal from an experimental-arm futility decision.
  • Apply a prespecified rule that stops the platform when control acceptability is in doubt.
  • Calculate posterior trigger probabilities under a beta-binomial model.
  • Check whether an interim decision leaves an experimental arm active without its control.
  • Identify operational and modeling conditions that can undermine the safeguard.

Why Control Retention Is a Design Constraint

In a platform trial, experimental arms may be removed as evidence accumulates. A separate question is whether the control arm may also be removed while an experimental arm continues. If an experimental treatment is still enrolling but its concurrent control has been removed, later comparisons may no longer have the planned randomized reference. A control-retention constraint prevents that state by making control status depend on which experimental arms remain active.

The constraint is an operational rule, not a posterior probability result. Posterior evidence can trigger an arm decision, but the protocol must specify which combinations of arm statuses are permitted and what happens if evidence raises concern about the control itself. The policy below uses a conservative choice: if a prespecified control-unacceptability rule fires, enrollment stops across the platform rather than dropping control and continuing experimental enrollment.

Definition: Let \(C\) denote the control arm and let \(S_t\) be the set of experimental arms active immediately before interim \(t\). Let \(S_t^+\) be the set of experimental arms remaining after the interim decisions. A control-retention constraint requires that, whenever the platform continues enrolling at least one experimental arm after the interim, control remains active. In symbols, a post-interim continuing state must satisfy \(S_t^+\ne\varnothing \Rightarrow C\text{ is active}\). If no experimental arm remains, the platform closes rather than continuing control alone.

This tutorial uses a binary desirable outcome, such as clinical response, with response probability \(\theta_k\) in arm \(k\). For illustration, assume independent beta priors \(\theta_k\sim\operatorname{Beta}(a_k,b_k)\) and binomial outcomes within each arm. If arm \(k\) has \(x_k\) responses among \(n_k\) participants with outcomes available, its posterior is \(\operatorname{Beta}(a_k+x_k,b_k+n_k-x_k)\). These calculations assume the endpoint direction, analysis population, and outcome assessment are consistent across the arms being compared. Real protocols must also account for safety rules and other stopping criteria.

Specify the Gate Before Applying Arm Rules

A complete protocol separates three decisions. First, it defines a control-unacceptability signal. For a desirable binary response, one possible signal is \(B_t=1\{P(\theta_C<\lambda_C\mid D_t)\ge q_C\}\), where \(\lambda_C\) is a prespecified minimum acceptable control response rate, \(q_C\) is a prespecified posterior probability threshold, and \(D_t\) is the data available at interim \(t\). The direction would be reversed or otherwise changed for an endpoint where smaller values are desirable.

Second, the protocol applies its prespecified experimental-arm rules. For example, an arm-specific futility rule might remove arm \(j\) when \(P(\theta_j>\lambda_E\mid D_t)<\gamma_E\), for a prespecified activity threshold \(\lambda_E\) and futility cutoff \(\gamma_E\). Other posterior superiority, clinical-margin, or predictive-probability rules can be used instead; the retention constraint does not replace them.

Third, the protocol applies the control gate to the resulting platform state. The policy used in the examples is:

1
Check control acceptability.
If \(B_t=1\), stop enrollment to control and all experimental arms. Do not remove control alone and leave an experimental arm enrolling.
2
Apply experimental-arm rules if the control gate does not fire.
Remove any experimental arms that meet their prespecified removal criteria.
3
Check what remains.
If at least one experimental arm remains, keep control active. If none remains, close the platform; do not continue enrolling to control alone.

Other policies are possible. For instance, a protocol might retain control despite a control signal while suspending experimental enrollment pending review. What is essential is that the response be specified in advance and never permit experimental enrollment to continue without the intended control. The examples use the all-arm stopping policy so the consequences are unambiguous.

Worked Examples Under a Beta-Binomial Model

Worked Example: A Control Signal Stops the Whole Platform

Suppose the control response rate has a \(\operatorname{Beta}(1,1)\) prior. At an interim, 0 of 10 control participants have responded. Set \(\lambda_C=0.20\) and \(q_C=0.90\). An experimental arm has 10 responses among 10 participants. Its activity rule is \(P(\theta_E>0.20\mid D_t)\ge0.90\). Determine the arm decisions under the all-arm stopping policy.

The control posterior is \(\operatorname{Beta}(1,11)\). For a \(\operatorname{Beta}(1,b)\) variable, \(P(\theta<x)=1-(1-x)^b\), so

$$ P(\theta_C<0.20\mid D_t) =1-(1-0.20)^{11} =1-0.8^{11} =1-0.0858993 =0.914101. $$

Since \(0.914101\ge0.90\), the control-unacceptability signal fires. The experimental posterior is \(\operatorname{Beta}(11,1)\), and

$$ P(\theta_E>0.20\mid D_t) =1-0.20^{11} =1-0.00000002048 =0.99999997952. $$

The experimental arm satisfies its activity criterion, but that does not override the control gate. Under the stated policy, enrollment stops to both arms. Dropping control while continuing the apparently promising experimental arm would violate the safeguard and leave that arm without its planned concurrent reference.

Worked Example: Remove One Experimental Arm but Retain Control

Now suppose control has 10 responses among 10 participants under the same \(\operatorname{Beta}(1,1)\) prior. Two experimental arms are active. Arm \(E_1\) has 0 responses among 11 participants; arm \(E_2\) has 9 responses among 10. Use \(\lambda_C=\lambda_E=0.20\), \(q_C=0.90\), and remove an experimental arm for futility if \(P(\theta_j>0.20\mid D_t)<\gamma_E=0.10\).

For control, the posterior is \(\operatorname{Beta}(11,1)\), giving

$$ P(\theta_C<0.20\mid D_t)=0.20^{11}=0.00000002048<0.90. $$

The control signal does not fire. For \(E_1\), the posterior is \(\operatorname{Beta}(1,12)\), so

$$ P(\theta_{E_1}>0.20\mid D_t)=0.8^{12}=0.0687195<0.10. $$

Thus \(E_1\) meets the stated futility rule and is removed. For \(E_2\), the posterior is \(\operatorname{Beta}(10,2)\). Its cumulative distribution function at \(x\) is \(F(x)=x^{10}(11-10x)\), so

$$ P(\theta_{E_2}>0.20\mid D_t) =1-0.20^{10}(11-10(0.20)) =1-0.0000009216 =0.9999991. $$

Arm \(E_2\) remains active. Since an experimental arm remains, control must remain active as well. The allowed continuing platform therefore contains \(C\) and \(E_2\), not \(E_2\) alone.

Worked Example: Closing Control After the Last Experimental Arm Is Removed

Suppose control again has 10 responses among 10 participants, while the only experimental arm has 0 responses among 20. Use the same priors and thresholds as in the previous example. Apply the decision rule.

The control posterior is \(\operatorname{Beta}(11,1)\), and its probability of falling below \(0.20\) is \(0.20^{11}=0.00000002048\), so the control gate does not fire. The experimental posterior is \(\operatorname{Beta}(1,21)\). Its probability of exceeding the activity threshold is

$$ P(\theta_E>0.20\mid D_t) =0.8^{21} =0.00922337<0.10. $$

The sole experimental arm meets the futility rule and is removed. Now no experimental arm remains. Control is therefore closed as part of platform termination; it is not left enrolling alone. This is different from removing control while an experimental arm continues, which the constraint forbids.

Why the Constraint Works

The logic can be checked directly by considering the possible outcomes of the control gate and experimental-arm decisions. Let \(S_t^+\) be the set of experimental arms remaining after applying the arm-specific rules. Under the specified policy:

$$ \begin{array}{ll} B_t=1: & \text{all arms stop},\\ B_t=0,\ S_t^+\ne\varnothing: & C\text{ remains active},\\ B_t=0,\ S_t^+=\varnothing: & \text{the platform closes}. \end{array} $$

In the first case, no experimental arm continues enrolling. In the second, every continuing experimental arm has an active control. In the third, there is no experimental arm for which control retention is needed, and the policy prevents control-only enrollment. These cases exhaust the possible decisions, so the rule cannot produce a continuing state with an experimental arm active and control inactive.

This is a logical guarantee about the decision algorithm, conditional on correct implementation. It is not a guarantee that control is clinically acceptable, that every comparison is unbiased, or that the posterior model is correct. Those questions require separate design and monitoring work.

Implementation Checks, Alternatives, and Limitations

At each interim, the decision record should make the gate auditable. Record the control data and its maturity, the posterior probability used for the control trigger, the threshold and cutoff, each experimental-arm decision, the active-arm set before and after the interim, and the final enrollment action. A useful automated check is to flag any proposed continuing state for which at least one experimental arm is active but control is not.

The control data must represent the control population relevant to the active comparisons. If eligibility criteria, background care, endpoint measurement, or calendar-time conditions change materially, a nominally active control may no longer be an appropriate reference. Likewise, incomplete or delayed outcome ascertainment can make an interim posterior differ from the posterior implied by a fully observed cohort. The protocol should specify which available outcomes enter the calculation and how interim timing is handled.

ApproachDecision logicMain implication
Independent arm removal without a retention gateApply removal criteria to control and experimental arms separately.Can leave an experimental arm enrolling without its planned concurrent control.
Retention gate with platform-wide stop on a control signalStop all arms if the control trigger fires; otherwise retain control whenever any experimental arm remains.Prevents unsupported continuation but may stop promising arms early.
Alternative comparator or replacement controlContinue comparisons only under a separately specified control strategy.Requires additional design, estimand, and analysis provisions; retaining the same arm label alone is not enough.

The all-arm stop is conservative: a false control-unacceptability signal can end enrollment even when an experimental arm appears promising. Conversely, a threshold that is too permissive can allow continuation when the reference arm is clinically inadequate. The control trigger should therefore be justified clinically and assessed under plausible response rates, accrual patterns, and outcome delays before use. A retention constraint also does not protect against operational errors such as randomizing participants to an arm after it has been closed.

Common Pitfall

Incorrect reasoning: “The control posterior says control is unacceptable, so we should drop control and keep the experimental arm because its posterior looks favorable.” This treats each arm’s posterior decision as independent of the platform’s comparison structure. It can create exactly the state the safeguard is meant to prevent.

Correction: Apply the control gate before permitting continued experimental enrollment. Under the policy taught here, a control signal stops enrollment across the platform. If the control gate does not fire and an experimental arm remains after its own rule is applied, keep control active. If no experimental arm remains, close the platform rather than enrolling control alone.

Key takeaway: Define control retention as an explicit invariant of the platform’s stopping logic. An experimental arm may continue only while its intended control remains active; a control concern requires a prespecified platform response, not an unplanned control-only removal.

Check Your Understanding

For each question, decide what the safeguard requires. Solutions follow the questions.

  1. With a \(\operatorname{Beta}(1,1)\) prior, control has 0 responses among 8 participants. If \(\lambda_C=0.20\) and \(q_C=0.90\), does the control signal fire?
  2. The control signal does not fire. One of two experimental arms meets its futility rule, while the other remains active. What happens to control?
  3. The control signal fires while an experimental arm meets its activity criterion. Under the policy in this tutorial, which arms continue enrolling?
  4. All experimental arms have been removed and the control signal has not fired. Should control continue enrolling by itself?

Solutions. (1) The control posterior is \(\operatorname{Beta}(1,9)\), so \(P(\theta_C<0.20\mid D_t)=1-0.8^9=1-0.134218=0.865782\). This is below \(0.90\), so the signal does not fire. (2) Control remains active because one experimental arm remains; removing control would violate the retention constraint. (3) No arms continue enrolling under the stated policy: the control signal stops the platform even if the experimental arm appears active or promising. (4) No. With no experimental arm remaining, close the platform rather than continue control-only enrollment.

Clinical Biostats