Tutorials › Adaptive Clinical Trial Design › Treatment Selection With A Shared Control

Treatment Selection and Arm Dropping · Tutorial 367 of 799

Treatment Selection With A Shared Control

Learn how a common control group links interim treatment-effect estimates and how that dependence affects rankings and selection decisions.

Advanced 9 min read

What You'll Learn

  • Define and estimate each treatment’s contrast with one shared control.
  • Derive the variance and covariance of shared-control contrast estimates.
  • Distinguish raw-effect rankings from rankings based on standardized evidence.
  • Assess how the shared control mean can affect benefit thresholds and retention.
  • Identify allocation and analysis choices that can distort interim selection.

Why a Shared Control Changes the Selection Problem

In a multi-arm trial, several candidate treatments may each be compared with the same control group. Reusing the control observations can make the design more efficient than assigning a separate control group to every comparison. But it also means the estimated treatment effects are statistically linked: an unusually high or low control mean shifts every estimated contrast in the same direction.

That link matters at an interim analysis. It affects the uncertainty of each treatment-versus-control estimate and the chance that an estimated benefit crosses a selection threshold. It does not necessarily change every ranking: if candidates are ranked by their unstandardized estimated benefits, subtracting the same control mean from each treatment mean leaves their ordering unchanged. The distinction between ranking and threshold-based selection is central.

Contrasts and Their Sampling Dependence

Definition: Let arm \(0\) be the shared control and arms \(1,\ldots,K\) be candidate treatments. Let \(\mu_j\) be the mean outcome in arm \(j\), with higher outcomes defined as better. The treatment-versus-control contrast for candidate \(j\) is \(\Delta_j=\mu_j-\mu_0\). At an interim analysis, its estimate is \(\hat{\Delta}_j=\bar{Y}_j-\bar{Y}_0\), where \(\bar{Y}_j\) is the observed mean in arm \(j\). A positive contrast therefore favours treatment \(j\).

For the basic calculations below, assume that each participant contributes one outcome, participants are independently randomized to one arm, and the arm samples are independent. Assume also that outcomes in all arms have a common variance \(\sigma^2\), and that the interim sample sizes \(n_0,n_1,\ldots,n_K\) are fixed for the calculation. Under normal outcomes, the sample means and their linear contrasts have a joint normal distribution; with sufficiently large samples, the same formulas can be used as normal approximations. These assumptions are for describing the sampling behavior of the interim estimates, not a claim that a selection rule itself is a confirmatory test.

Because \(\bar{Y}_j\) and \(\bar{Y}_0\) come from independent arms, the variance of one estimated contrast is the sum of the two sample-mean variances:

$$ \operatorname{Var}(\hat{\Delta}_j) =\sigma^2\left(\frac{1}{n_j}+\frac{1}{n_0}\right), \qquad SE(\hat{\Delta}_j) =\sigma\sqrt{\frac{1}{n_j}+\frac{1}{n_0}}. $$

For two distinct candidates \(i\) and \(j\), their treatment-arm means are independent, but both contrasts include the same control mean with a minus sign. The shared term produces positive covariance:

$$ \operatorname{Cov}(\hat{\Delta}_i,\hat{\Delta}_j) =\operatorname{Cov}(\bar{Y}_i-\bar{Y}_0,\bar{Y}_j-\bar{Y}_0) =\operatorname{Var}(\bar{Y}_0) =\frac{\sigma^2}{n_0}. $$

The correlation is therefore \(\left(1/n_0\right)\big/\sqrt{(1/n_i+1/n_0)(1/n_j+1/n_0)}\). The covariance is not an extra contribution to either contrast’s individual variance; it describes how the two estimates move together across repeated trials.

What the Shared Control Does to Rankings

If candidates are ranked by \(\hat{\Delta}_j\), the control mean is a common subtraction. For any two candidates, \(\hat{\Delta}_i-\hat{\Delta}_j=(\bar{Y}_i-\bar{Y}_0)-(\bar{Y}_j-\bar{Y}_0)=\bar{Y}_i-\bar{Y}_j\). Thus the shared control observations do not alter their raw-effect ordering. They do affect the estimated size of each candidate’s benefit relative to control, and so can change whether any candidate meets a minimum-benefit requirement.

This invariance applies only to ranking by raw estimated effects. If the rule ranks standardized quantities such as \(U_j=\hat{\Delta}_j/SE(\hat{\Delta}_j)\), different standard errors can change the ordering. A standardized score asks how large the estimated contrast is relative to its uncertainty; it is not simply a ranking of estimated clinical benefit. The choice between these criteria should follow the prespecified selection objective, as in the earlier material on selection rules and unequal arm sizes.

Worked Example: Shared-Control Covariance With Equal Treatment Sizes

Suppose a hypothetical interim analysis has a shared-control mean of 10.0 outcome units and means of 12.4 and 11.7 units in treatments A and B. There are 30 control participants and 20 in each treatment arm. Assume independent participants and a common outcome standard deviation of 4 units. Higher outcomes are better.

The estimated contrasts are \(\hat{\Delta}_A=12.4-10.0=2.4\) units and \(\hat{\Delta}_B=11.7-10.0=1.7\) units. Their standard errors are equal:

$$ SE(\hat{\Delta}_A)=SE(\hat{\Delta}_B) =4\sqrt{\frac{1}{20}+\frac{1}{30}} =4\sqrt{0.08333} =1.155\text{ units}. $$

The covariance is \(4^2/30=0.5333\) square units. Since both contrast variances are \(1.333\) square units, their correlation is \(0.5333/1.333=0.400\). The estimates are positively correlated because an upward fluctuation in the shared control mean lowers both estimated benefits.

The raw-effect difference is \(2.4-1.7=0.7\) units. It is also the difference between the treatment means, \(12.4-11.7=0.7\). Under the stated independence and common-variance assumptions, its standard error is \(4\sqrt{1/20+1/20}=1.265\) units. The shared control mean cancels from this comparison; it is not counted twice as if two separate control samples had been observed.

Thresholds and Selection Decisions

A rule may retain a candidate only if its estimated contrast exceeds a prespecified minimum benefit \(c\), or may use a combination of a minimum benefit and a ranking rule. Since each contrast includes \(-\bar{Y}_0\), a change in the observed control mean shifts every estimated benefit. The candidates’ ordering by raw effects remains the same when the treatment means are fixed, but the set crossing the threshold can change.

A threshold is a design decision, not a universal statistical constant. It should be stated in the endpoint’s units and applied to the contrast the design actually targets. For outcomes where lower values are better, define the contrast with the direction reversed (for example, \(\mu_0-\mu_j\)) before applying a positive-benefit threshold. Otherwise signs can silently reverse the meaning of “retain.”

Worked Example: A Minimum-Benefit Retention Rule

In a hypothetical trial, higher outcome values are better. At an interim analysis, the shared-control mean is 8.6 units, while treatment means are 10.2 units for A and 9.8 units for B. The prespecified rule retains an arm only when its estimated benefit is at least 1.4 units.

The estimated benefits are \(10.2-8.6=1.6\) units for A and \(9.8-8.6=1.2\) units for B. Therefore A meets the threshold and B does not. A also ranks above B by raw estimated benefit.

Now consider a different hypothetical set of control observations with a mean of 9.0 units, holding the two treatment means fixed. The estimates become \(10.2-9.0=1.2\) and \(9.8-9.0=0.8\) units. Neither meets the 1.4-unit threshold, although A still ranks above B. This shows how a shared control mean can change retention without changing the raw-effect ranking.

Unequal Allocation and the Selection Objective

When arm sizes differ, the estimated benefits still subtract the same control mean, but their standard errors differ. A ranking by estimated benefit can therefore disagree with a ranking by standardized evidence. The shared control also induces covariance when allocation is unequal; its magnitude remains \(\sigma^2/n_0\) under the common-variance model.

Worked Example: Raw-Benefit and Standardized Rankings Differ

Suppose a hypothetical interim analysis has 40 control participants, 10 participants in treatment A, and 30 in treatment B. The observed means are 50.0, 56.0, and 55.5 units, respectively. Assume independent participants, a common standard deviation of 6 units, and higher outcomes as better.

The estimated benefits are \(56.0-50.0=6.0\) units for A and \(55.5-50.0=5.5\) units for B, so A ranks first by estimated benefit. The standard errors are \(6\sqrt{1/10+1/40}=2.121\) units for A and \(6\sqrt{1/30+1/40}=1.449\) units for B. The corresponding standardized estimates are \(6.0/2.121=2.828\) and \(5.5/1.449=3.796\). B ranks first by this standardized criterion because its estimate is more precise.

The estimated-contrast covariance is \(6^2/40=0.900\) square units, and the correlation is \(0.900/(2.121\times1.449)=0.293\). The two rankings answer different questions: which arm has the larger estimated benefit, and which has the larger estimate relative to its standard error. The trial’s prespecified objective must determine which is relevant for selection.

Derivation and Practical Checks

The cancellation property and the uncertainty of a raw-effect comparison follow directly from the contrast definitions. For independent treatment-arm means, the difference in estimated contrasts is \(\hat{\Delta}_i-\hat{\Delta}_j=\bar{Y}_i-\bar{Y}_j\). Its expectation is \(\mu_i-\mu_j\), and its variance is the sum of the independent sample-mean variances:

$$ \operatorname{Var}(\hat{\Delta}_i-\hat{\Delta}_j) =\operatorname{Var}(\bar{Y}_i)+\operatorname{Var}(\bar{Y}_j) =\sigma^2\left(\frac{1}{n_i}+\frac{1}{n_j}\right). $$

This derivation explains both the shared-control cancellation and why the precision of a treatment-to-treatment ranking depends on the treatment-arm sample sizes, not on \(n_0\), when the same control mean is subtracted from both. It does not imply that the control group is irrelevant: the control remains essential to each treatment-versus-control benefit estimate and to threshold decisions.

Before applying a selection rule, check that the interim estimates use the same defined control population and endpoint, that the control data are included once rather than duplicated, and that the direction and units of benefit are consistent. Also check arm-specific sample sizes and standard errors. If outcome variances differ, replace the common-variance formulas with \(\operatorname{Var}(\hat{\Delta}_j)=\sigma_j^2/n_j+\sigma_0^2/n_0\) and \(\operatorname{Cov}(\hat{\Delta}_i,\hat{\Delta}_j)=\sigma_0^2/n_0\), under independent arms. Missing data, unequal variances, or departures from the assumed sampling model can make a common-\(\sigma\) calculation unreliable; the analysis must reflect the actual estimand and variance structure.

Common Pitfalls and Alternatives

  • Counting shared controls as independent controls. Treating each contrast as though it used a separate control sample discards their positive covariance and misrepresents joint uncertainty. Use the covariance implied by the shared observations.
  • Claiming the control cannot affect ranking. It cancels from a raw contrast difference, but it shifts each contrast and can change threshold-based retention. Standardized rankings can also differ from raw-benefit rankings.
  • Changing the criterion after seeing interim data. Switching from clinical benefit to a standardized score because it favours a particular arm changes the selection objective. Prespecify the criterion, contrast direction, and threshold.
  • Using separate controls without accounting for the trade-off. Separate control groups remove this particular covariance between comparisons, but require more control observations and can reduce efficiency. A shared control is often more economical, provided the analysis recognizes dependence.

The choice of selection approach depends on the question. Raw contrasts are direct measures of estimated benefit versus the common control. Standardized estimates incorporate precision and may prioritize a smaller but more precisely estimated effect. A threshold rule expresses a minimum benefit in clinical units. These are not interchangeable summaries, and none by itself establishes confirmatory evidence for a selected treatment.

Key takeaway: A shared control creates positively correlated treatment-versus-control estimates. Its observed mean shifts every estimated benefit, so it can change threshold decisions; it cancels from pairwise differences, so it does not change rankings by raw estimated benefit. Unequal precision can make standardized rankings differ.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. With a shared control sample of size 25 and common standard deviation 5 units, what is the covariance between two distinct treatment-versus-control estimates?
  2. Two treatments have observed means of 14 and 13 units, and the shared-control mean is 10 units. If the control mean alone changes to 11 while treatment means stay fixed, what happens to their raw-benefit ranking and to their estimated benefits?
  3. With a common standard deviation of 3 units, \(n_0=20\), and \(n_A=n_B=10\), calculate the standard error of each contrast and their correlation.
  4. Why might a rule based on standardized estimates select a different arm from a rule based on estimated benefit?

Solutions. (1) The covariance is \(\sigma^2/n_0=25/25=1\) square unit. (2) Initially the benefits are 4 and 3 units; after the control mean rises, they are 3 and 2 units. The raw ranking remains unchanged, with the first treatment above the second, while both estimated benefits decrease by 1 unit. (3) Each standard error is \(3\sqrt{1/10+1/20}=3\sqrt{0.15}=1.162\) units. The covariance is \(9/20=0.45\) square units, so the correlation is \(0.45/(1.162^2)=0.333\). (4) Standardized estimates divide estimated benefit by its standard error. An arm with a smaller estimated benefit can rank higher if its estimate is sufficiently more precise; the two rules target different selection criteria.

Clinical Biostats