Tutorials › Multi-Arm Multi-Stage (MAMS) Designs › STAMPEDE’s Control Arm Across Calendar Time

Case Studies · Tutorial 469 of 499

STAMPEDE's Control Arm Across Calendar Time

You will learn to trace changes in STAMPEDE’s control strategy and eligibility, and to distinguish valid concurrent randomized comparisons from misleading comparisons across calendar periods.

Advanced 12 min read

What You'll Learn

  • Describe the ADT backbone and how the meaning of standard care could change over time.
  • Distinguish platform-level history from eligibility criteria for a particular comparison.
  • Explain why a concurrent randomized control is central to interpreting an arm’s result.
  • Identify how recruitment period and changing patient mix can distort nonconcurrent comparisons.
  • Use stratification and standardization to summarize treatment effects across periods.
  • Recognize limitations when applying one comparison’s result to a different care setting.

Why the Control Arm Has a Calendar-Time History

In a long-running platform trial, “standard care” is a clinical strategy defined by the protocol and the care available when patients enter. It need not be the same package of treatment throughout the trial. STAMPEDE began in an era when long-term androgen-deprivation therapy (ADT) was the central systemic treatment for advanced prostate cancer. As evidence and practice changed, the platform added comparisons, and the appropriate background care could differ by disease setting, protocol version, and recruitment period.

This matters because an arm’s result is a comparison with the control patients who were eligible and randomized alongside it—not with an abstract, timeless control group. STAMPEDE’s control history therefore has two linked parts: what standard care meant at a particular time, and which patients were eligible for each comparison at that time.

Definition: A concurrent control consists of control participants randomized during the same recruitment period and under the same comparison’s eligibility rules as the experimental-arm participants. The control strategy is the protocol-defined care received by those participants. Both the strategy and the population to which a comparison applies can vary across protocol versions.

The ADT backbone is an important point of continuity, but it does not make every control group identical. Local treatment, such as radiotherapy, could be part of care according to disease setting and protocol requirements. Later, as docetaxel became an established option for some men with metastatic hormone-sensitive disease, protocol versions and comparisons could differ in whether it was available or included in background care. It would be incorrect to assume that every STAMPEDE control participant received the same combination—or that a treatment tested in one comparison automatically became part of every other comparison’s control.

Eligibility Changed Alongside the Platform

STAMPEDE was designed to evaluate multiple treatment comparisons in men with prostate cancer at substantial risk of progression. The original platform included patients with advanced disease, but there was not one permanently fixed eligibility definition that applied identically to every arm. New comparisons could focus on particular disease states or risk groups, and eligibility could be specified or amended for the question being tested.

For example, a comparison in metastatic disease and a comparison restricted to nonmetastatic disease do not answer the same clinical question, even if both use ADT as a backbone. Within nonmetastatic disease, whether a patient had nodal involvement and what local treatment was planned could also matter to the treatment strategy. The STAMPEDE comparisons of prostate radiotherapy in low-burden metastatic disease and metformin in nonmetastatic disease illustrate why the setting named in a comparison is part of its interpretation, not a descriptive footnote.

A useful record for interpreting any reported arm result therefore includes the comparison’s recruitment dates, eligibility rules, control treatment, and relevant background care. These details help establish which patients and care context the result actually represents. They also prevent a common error: treating “the STAMPEDE control” as one homogeneous group assembled across the entire life of the platform.

What Randomization Does—and Does Not—Protect

Within an eligible comparison and recruitment period, randomization assigns participants to treatment groups by chance. Under the trial’s allocation and follow-up procedures, this supports a causal comparison of the assigned strategies for that eligible population. It does not make the control strategy identical across periods, nor does it guarantee that patients eligible for one comparison represent patients eligible for another.

Key distinction: A randomized treatment effect is a contrast between assigned strategies in a defined eligible population and care context. Comparing an experimental group from one period with controls recruited in another period is not automatically randomized: calendar time may also represent changes in prognosis, background care, eligibility, or outcome ascertainment.

A compact way to state the target is to let \(Y(1)\) and \(Y(0)\) denote the outcome that a participant would have under the experimental and control strategies, respectively. For the eligible population in a particular comparison and period, a risk-difference estimand is \(E\{Y(1)-Y(0)\}\). Changing the eligibility rules changes the population over which that expectation is taken; changing the control strategy changes what \(Y(0)\) means.

This is why a result from an earlier comparison cannot simply be carried over as the control experience for a later one. Even if the endpoint name is the same, the patient mix, treatment options, follow-up practices, or standard-care components may differ. Conversely, if an experimental arm and control arm were randomized concurrently under the same rules, their contrast remains the primary comparison for that trial question.

Worked Examples: Period, Eligibility, and Interpretation

Worked Example: Why a Cross-Period Contrast Can Mislead

Hypothetical illustration. Suppose an early period includes a higher-risk eligible group, with 12-month event risks of 40% under control and 30% under an experimental strategy. A later period includes a lower-risk group, with risks of 20% under control and 10% under the experimental strategy. The experimental strategy reduces risk by 10 percentage points in each period. Now suppose a nonconcurrent pooled comparison contains 20% early-period and 80% later-period experimental participants, but 80% early-period and 20% later-period controls. What does the crude contrast show?

The pooled experimental-arm risk is \(0.20(0.30)+0.80(0.10)=0.06+0.08=0.14\), or 14%.

The pooled control risk is \(0.80(0.40)+0.20(0.20)=0.32+0.04=0.36\), or 36%. The crude risk difference is \(0.14-0.36=-0.22\), a 22-percentage-point lower risk in the experimental group.

That contrast exaggerates the within-period effect of 10 percentage points. The groups have different period compositions, and period is associated with baseline risk in this illustration. The pooled difference combines treatment contrast with calendar-period and eligibility composition differences. It should not be interpreted as the randomized treatment effect.

Worked Example: A Concurrent Randomized Contrast

Hypothetical illustration. In one recruitment period, 200 eligible participants are randomized to each of two strategies. By 12 months, 30 experimental-arm participants and 40 control-arm participants have had the event. Assume complete outcome ascertainment, the same event definition and follow-up, and randomization within this eligible comparison. Estimate the risk difference and a simple approximate 95% confidence interval.

The observed risks are \(\hat{p}_1=30/200=0.15\) and \(\hat{p}_0=40/200=0.20\). Defining the risk difference as experimental minus control gives \(\hat{p}_1-\hat{p}_0=0.15-0.20=-0.05\). In this hypothetical comparison, the estimated 12-month event risk is 5 percentage points lower under the experimental strategy.

Using the usual independent-binomial standard error for two randomized groups, \(SE=\sqrt{\hat{p}_1(1-\hat{p}_1)/n_1+\hat{p}_0(1-\hat{p}_0)/n_0}\). Substitution gives \(SE=\sqrt{0.15(0.85)/200+0.20(0.80)/200}=\sqrt{0.0014375}=0.03791\).

The approximate interval is \(-0.05\pm1.96(0.03791)=[-0.1243,\ 0.0243]\). Thus, the data are compatible with effects from about a 12.4-percentage-point reduction to a 2.43-percentage-point increase in 12-month risk. This interval is illustrative, not a STAMPEDE result. Its interpretation applies to the hypothetical eligible population, endpoint, period, and strategies specified above.

Worked Example: Standardizing Across Two Periods

Hypothetical illustration. Suppose a valid randomized comparison reports these 12-month event risks: in an early period, 30% for the experimental strategy and 40% for control; in a later period, 10% and 20%, respectively. To summarize both periods for a target population that weights them equally, calculate the standardized risks and their difference.

The standardized experimental risk is \(0.50(0.30)+0.50(0.10)=0.20\), or 20%. The standardized control risk is \(0.50(0.40)+0.50(0.20)=0.30\), or 30%. Their difference is \(0.20-0.30=-0.10\), a 10-percentage-point lower standardized risk under the experimental strategy.

The equal weights define the target mix of periods; they are not automatically the correct weights for every clinical question. Here the period-specific differences are both \(-0.10\), so the standardized difference is also \(-0.10\). If period-specific effects differed, the summary would depend on the chosen weights. Standardization can make the target population explicit, but it cannot repair a comparison that was not randomized or remove unmeasured differences between nonconcurrent groups.

Justification: Why Period Must Be Considered

The problem in the first example can be seen directly by writing each pooled risk as a weighted average of period-specific risks. Let \(w_{g,t}\) be the proportion from period \(t\) in group \(g\), and let \(r_{g,t}\) be that group’s event risk in that period. Then the pooled risk is \(\sum_t w_{g,t}r_{g,t}\). The difference between pooled groups is \(\sum_t w_{1,t}r_{1,t}-\sum_t w_{0,t}r_{0,t}\).

If the weights differ by group, this is generally not a weighted average of the within-period treatment differences \(r_{1,t}-r_{0,t}\). Only when the groups have the same period weights, or when special conditions make the composition irrelevant, does the crude pooled contrast directly reflect a common weighted within-period contrast. In the first example the early and later weights differed, so the period mix contributed to the apparent 22-point difference despite a 10-point difference within each period.

This is a justification for examining recruitment period and eligibility, not a claim that statistical adjustment alone creates comparability. The most secure basis for an arm comparison remains concurrent randomization. If a summary across periods is needed, report the period-specific estimates and state the target weights; consider whether treatment effects differ by period rather than assuming they are constant.

Reading a Control History Carefully

1
Identify the comparison.
Name the experimental strategy and the particular control strategy, rather than referring only to “the STAMPEDE control.”
2
Locate the recruitment period.
Check when participants entered and whether relevant standard-care components or protocol rules changed during that time.
3
Check eligibility and disease setting.
Determine which patients the comparison included, including the disease state and any risk-group restrictions relevant to the question.
4
Interpret the randomized contrast first.
Use the concurrent control as the reference for the comparison, and describe the population, endpoint, and treatment context to which the result applies.
5
Qualify cross-period summaries.
If combining periods or comparing nonconcurrent groups, show period-specific information and explain the weights and assumptions behind any summary.

Diagnostics include checking whether the arms being compared overlap in recruitment dates, whether their eligibility criteria match, and whether the background control strategy is documented. Large shifts in patient characteristics across periods, a change in local treatment, or different follow-up and outcome definitions are warnings against an unqualified pooled comparison. A regression model with a period indicator may describe measured differences, but it cannot guarantee that all time-related differences have been controlled.

Alternatives and Limitations

The main alternative to a concurrent randomized comparison is a historical or nonconcurrent control comparison. It may be useful descriptively when no concurrent control is available, but it is vulnerable to calendar-time confounding and changes in eligible patients. A second approach is to present period-stratified randomized effects and, if a combined summary is useful, standardize them to a stated target period mix. This preserves visibility of heterogeneity better than a single unqualified pooled estimate, but it requires adequate data in each period and does not remove bias from changes that were not measured or randomized.

A further limitation is that “standard care” can vary among patients even within a protocol period because clinical decisions and local practice differ. A protocol definition tells the reader what was intended or permitted; it does not by itself prove that every participant received identical background treatment. Interpretation should therefore distinguish assigned strategy from actual care received.

The key practical lesson is not that results from different periods cannot be compared. It is that a comparison must say what is being held constant and what is allowed to change. A valid concurrent result can be strong evidence for its defined population and care context without being a universal estimate for every later standard-care setting.

Common pitfall: “Both arms were called standard care, so their outcomes can be pooled as one control group.” This overlooks changes in eligibility, treatment components, and calendar-time prognosis. Instead, identify the comparison-specific concurrent control first; combine across periods only with an explicit target population, appropriate assumptions, and transparent period-specific results.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. Why is ADT’s role as a recurring treatment backbone insufficient to show that all STAMPEDE control groups were identical?
  2. In a comparison restricted to a particular disease setting, what does the randomized treatment effect directly apply to?
  3. Suppose an experimental arm and a control arm have different proportions of participants recruited before and after a change in standard care. What is the main concern with their crude pooled contrast?
  4. What must be specified when reporting a standardized effect across recruitment periods?

Solutions. (1) Other components of background care, protocol rules, recruitment periods, and eligibility could differ; a shared backbone does not define an identical complete strategy. (2) It applies to the eligible population randomized in that comparison, under its specified treatment strategies, endpoint, and care context. (3) The pooled contrast may combine treatment differences with changes in period composition, prognosis, or care; it is not automatically a randomized treatment effect. (4) Report the period-specific estimates and the weights used, which define the target period mix, and state assumptions about combining effects across periods.

Clinical Biostats