Tutorials › Multi-Arm Multi-Stage (MAMS) Designs › Shared-Control Dependence in Intermediate Outcomes

Time-to-Event MAMS With Intermediate Outcomes · Tutorial 302 of 499

Shared-Control Dependence in Intermediate Outcomes

Learn to calculate shared-control covariance and correlation, and understand which arm-selection conclusions depend on accounting for it.

Advanced 10 min read

What You'll Learn

  • Derive covariance between contrasts that use the same control participants.
  • Calculate the correlation for unequal arm sizes and outcome variances.
  • Interpret how shared-control dependence affects interim selection probabilities.
  • Distinguish arm ranking from crossing a selection threshold.
  • Identify assumptions and diagnostics for a joint-normal approximation.

Why a Common Control Creates Dependence

In a multi-arm, multi-stage trial, several experimental arms may be compared with the same control group at an interim look. Even if participants in different randomized arms are independent, the estimated treatment–control contrasts are not: each contrast contains the same estimated control mean. A chance fluctuation in that mean moves all contrasts in the same direction.

This matters when intermediate outcomes guide which arms continue. Selection rules act on several contrasts at once, so their joint distribution—not just each contrast’s standard error—determines the chance that one or more arms cross a boundary or that multiple arms appear promising. The focus here is the dependence caused by the shared control estimate, not the relationship between an intermediate outcome and a later endpoint.

Definition: Suppose \(K\) experimental arms and one control arm are observed at an interim look. Let \(\bar{X}_i\) be the mean intermediate outcome in experimental arm \(i\), and let \(\bar{X}_0\) be the mean in the common control group. Orient the outcome so that larger values are more favorable, and define the arm-specific contrast as \(D_i=\bar{X}_i-\bar{X}_0\). The shared-control dependence is the covariance between two different contrasts \(D_i\) and \(D_j\), induced by their common \(\bar{X}_0\).

Model and Covariance Derivation

For the basic derivation, assume participants are independently randomized to one of the arms, observations are independent between participants, and each arm’s sample mean has finite variance. Write the sample sizes as \(n_i\), and the outcome variances as \(\sigma_i^2\), for \(i=0,1,\ldots,K\). Thus \(\operatorname{Var}(\bar{X}_i)=\sigma_i^2/n_i\). The key assumption is independence of the arm-specific sample means across distinct randomized groups. The derivation does not require equal sample sizes or equal outcome variances.

For distinct experimental arms \(i\) and \(j\), expand the covariance of the two contrasts. The treatment-arm means are independent of each other and of the control mean, so the only nonzero term is the variance of the shared control mean:

$$ \begin{aligned} \operatorname{Cov}(D_i,D_j) &=\operatorname{Cov}(\bar{X}_i-\bar{X}_0,\bar{X}_j-\bar{X}_0)\\ &=\operatorname{Cov}(\bar{X}_i,\bar{X}_j) -\operatorname{Cov}(\bar{X}_i,\bar{X}_0) -\operatorname{Cov}(\bar{X}_0,\bar{X}_j) +\operatorname{Var}(\bar{X}_0)\\ &=\frac{\sigma_0^2}{n_0}. \end{aligned} $$

Each contrast has variance equal to the sum of the variances of its treatment and control means. Dividing the covariance by the product of the contrast standard deviations gives their correlation:

$$ \begin{aligned} \operatorname{Var}(D_i)&=\frac{\sigma_i^2}{n_i}+\frac{\sigma_0^2}{n_0},\\ \operatorname{Corr}(D_i,D_j) &= \frac{\sigma_0^2/n_0} {\sqrt{\left(\sigma_i^2/n_i+\sigma_0^2/n_0\right) \left(\sigma_j^2/n_j+\sigma_0^2/n_0\right)}}. \end{aligned} $$

When the variances are known, or treated as fixed for planning, the same correlation applies to the standardized contrasts \(Z_i=D_i/SE_i\), where \(SE_i=\sqrt{\sigma_i^2/n_i+\sigma_0^2/n_0}\). With estimated variances, the formula is a plug-in approximation; it does not account for additional randomness or dependence introduced by a particular variance-estimation procedure.

The covariance is positive whenever the control variance is positive. If a control mean happens to be lower than its expected value, every treatment-minus-control contrast tends to be larger. The degree of dependence is not determined by the control alone: it also depends on how much treatment-arm variability contributes to each contrast. As \(n_0\) grows, the control-mean variance shrinks and the induced correlation generally decreases. For equal arm sizes and equal variances, the correlation between any two contrasts is \(1/2\): the shared control contributes half of each contrast’s variance.

Worked Example: Correlation With Unequal Arm Sizes

Suppose a hypothetical trial measures a continuous intermediate outcome with a known standard deviation of 10 units in every arm. There are 80 control participants, 40 participants in experimental arm 1, and 60 in experimental arm 2. Calculate the standard errors and the correlation between the two contrasts.

The outcome variance in each arm is \(10^2=100\) square units. The control-mean variance is \(100/80=1.25\) square units. Therefore,

$$ SE_1=\sqrt{\frac{100}{40}+\frac{100}{80}} =\sqrt{3.75}=1.936\text{ units}, \qquad SE_2=\sqrt{\frac{100}{60}+\frac{100}{80}} =\sqrt{2.9167}=1.708\text{ units}. $$

The covariance is the shared control-mean variance, 1.25 square units. Hence,

$$ \operatorname{Corr}(D_1,D_2) =\frac{1.25}{(1.936)(1.708)} \approx 0.378. $$

The two contrasts are positively correlated, but not perfectly correlated: each includes its own experimental-arm mean as well as the common control mean. The smaller experimental arm has the larger standard error because its treatment mean is less precise.

How Dependence Changes Selection

A selection rule might retain an arm when its intermediate-outcome statistic exceeds a prespecified threshold, or retain the arm with the largest statistic. In either case, dependence affects the joint chance of the possible selection outcomes. For example, it affects the probability that at least one arm crosses a boundary and the probability that two arms cross it together. Calculating each arm’s marginal crossing probability does not, by itself, give these joint probabilities.

If the vector of standardized contrasts is jointly normal, its covariance matrix has ones on the diagonal and the shared-control correlations off the diagonal. Under that model, the conditional distribution of one standardized contrast given another is also normal. For two standardized contrasts with correlation \(\rho\), unit variances, and means \(\mu_1,\mu_2\), the conditional mean and variance are:

$$ E(Z_2\mid Z_1=z_1) =\mu_2+\rho(z_1-\mu_1), \qquad \operatorname{Var}(Z_2\mid Z_1=z_1)=1-\rho^2. $$

Thus, observing an unusually high value in one arm tends to make a high value in another arm more plausible when \(\rho>0\). This is a statement about the joint sampling distribution, not evidence that one treatment causes the other arm’s result.

Worked Example: Conditional Chance of Crossing a Threshold

Continue with the hypothetical design above, and suppose the observed means are 55 units in arm 1, 53 units in arm 2, and 50 units in control. The estimated contrasts are \(D_1=5\) and \(D_2=3\) units. Using the standard errors from the previous calculation, the standardized statistics are:

$$ z_1=\frac{55-50}{1.936}=2.582, \qquad z_2=\frac{53-50}{1.708}=1.757. $$

For illustration, suppose the joint-normal model is used under the global null, so both standardized statistics have mean zero, unit variance, and correlation \(\rho=0.378\). Conditional on \(Z_1=2.582\), the mean and standard deviation of \(Z_2\) are:

$$ E(Z_2\mid Z_1=2.582)=0.378(2.582)=0.976, \qquad SD(Z_2\mid Z_1)=\sqrt{1-0.378^2}=0.926. $$

If the illustrative selection threshold is \(1.645\), the conditional probability that arm 2 exceeds it, given \(Z_1=2.582\), is approximately:

$$ P(Z_2>1.645\mid Z_1=2.582) =1-\Phi\left(\frac{1.645-0.976}{0.926}\right) \approx 1-\Phi(0.723) \approx 0.235. $$

This is a conditional probability under the stated joint-null model and threshold; it is not the probability that the null hypothesis is true. The positive correlation makes arm 2’s conditional mean higher than its unconditional null mean of zero. Treating the two statistics as independent would miss that shift.

Arm Ranking and Threshold Decisions Are Different

A shared control affects both contrasts, but it affects their difference in a special way. Subtracting one contrast from another cancels the common control mean:

$$ D_i-D_j=(\bar{X}_i-\bar{X}_0)-(\bar{X}_j-\bar{X}_0) =\bar{X}_i-\bar{X}_j. $$

Consequently, the ordering of the raw contrasts is exactly the ordering of the experimental-arm means. Under independent arm samples, the variance of their difference is \(\sigma_i^2/n_i+\sigma_j^2/n_j\), with no control-mean variance component. This cancellation does not mean that the shared control can be ignored for all selection decisions. A rule that compares each contrast with a threshold still depends on the control estimate, and a rule that uses standardized rather than raw contrasts need not rank arms in the same way as their raw means when standard errors differ.

Worked Example: Correct Uncertainty for a Contrast Difference

Use the same hypothetical means and design, with known variance 100 square units in each arm. The observed difference between the two treatment–control contrasts is \(5-3=2\) units. From the covariance calculation, the variance of that difference is:

$$ \operatorname{Var}(D_1-D_2) =3.75+2.9167-2(1.25) =4.1667\text{ square units}. $$

This also equals the variance calculated directly from the two experimental-arm means:

$$ \frac{100}{40}+\frac{100}{60} =2.5+1.6667 =4.1667\text{ square units}. $$

The standard error is \(\sqrt{4.1667}=2.041\) units, giving a standardized difference of \(2/2.041=0.980\). If the two treatment–control contrasts were incorrectly treated as independent, the variance would instead be \(3.75+2.9167=6.6667\), because the covariance cancellation would be omitted. The correct calculation recognizes that the common control contributes equally to both contrasts and cancels in their difference.

Practical Calculation, Alternatives, and Failure Modes

For planning or analysis, construct the joint covariance matrix rather than supplying only separate standard errors. Its diagonal entries are the variances of the contrasts, and its off-diagonal entries are \(\sigma_0^2/n_0\) under the independent-arm model. A joint-normal approximation can then be used to evaluate selection probabilities, with the approximation checked against the design and outcome distribution where appropriate.

The standard formula assumes independent randomized groups and correctly specified variances. If observations within an arm are clustered, repeated, or otherwise dependent, \(\sigma_i^2/n_i\) may not be the correct variance for that arm’s mean. Use the variance of the actual arm-specific estimator and account for any cross-arm dependence in the design or analysis; the shared-control formula alone is not a substitute for that covariance structure. Missing outcomes, unequal follow-up, or model-based adjusted means can likewise change the relevant variances and covariances.

A practical alternative is to estimate the full covariance matrix from a model or by simulation that reproduces the randomization, outcome model, and interim analysis. This can be preferable when the simple independent-means model is implausible. By contrast, treating each comparison as if it had its own independent control is appropriate only when the design truly supplies independent control groups. It is not a harmless computational shortcut for a shared-control design.

Common diagnostics include checking that the covariance matrix is symmetric and positive semidefinite, that its diagonal agrees with the reported contrast variances, and that its off-diagonal entries reflect the shared control. A simulation under the assumed model can compare empirical correlations and selection frequencies with the analytic calculations. Large discrepancies suggest a coding error or that the model assumptions do not represent the implemented design.

Common pitfall: “The experimental arms are randomized independently, so their treatment–control contrasts are independent.” This reasoning overlooks the shared control estimate. The treatment-arm means may be independent, but the contrasts share \(-\bar{X}_0\), giving covariance \(\operatorname{Var}(\bar{X}_0)\). Model that dependence when evaluating joint selection events. For the difference between two raw contrasts, however, the control component cancels; do not add its variance twice to that comparison.

The central limitation is that this derivation addresses dependence arising from a common control mean under a specified mean-variance model. It does not establish that an intermediate outcome predicts the final endpoint, nor does a high correlation between selection statistics establish that the outcome is a valid surrogate. Those are separate scientific and statistical questions.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. Two contrasts use independent treatment arms and the same control mean. What is their covariance under the independent-arm model?
  2. Suppose the control-mean variance is 2, and two contrast variances are 5 and 8. Calculate their correlation.
  3. Why does the shared-control component cancel when comparing two raw treatment–control contrasts?
  4. What is one reason the simple covariance formula might not be sufficient for a real interim analysis?

Solutions. (1) The covariance is the variance of the shared control mean. (2) The correlation is \(2/\sqrt{5\times 8}=2/\sqrt{40}\approx0.316\). (3) Subtracting the contrasts gives \((\bar{X}_i-\bar{X}_0)-(\bar{X}_j-\bar{X}_0)=\bar{X}_i-\bar{X}_j\), so the control mean cancels. (4) For example, clustering or repeated observations may mean that the variance of an arm mean is not \(\sigma_i^2/n_i\); a suitable joint covariance model is then needed.

Clinical Biostats