Why Metastatic Burden Changes the Question
STAMPEDE’s prostate-radiotherapy comparison asks whether treating the primary prostate tumour improves outcomes for men with newly diagnosed metastatic prostate cancer. Its overall-survival result and its low-metastatic-burden result answer related but distinct questions. The overall estimate summarizes the randomized comparison across all eligible metastatic participants; the subgroup estimate asks whether the effect differs among men classified as having low metastatic burden.
The distinction matters because the overall result did not show a statistically significant survival benefit, while the low-burden subgroup showed evidence of longer survival with radiotherapy. Neither finding should be substituted for the other. The all-participant estimate does not establish that every subgroup has the same effect, and a favorable subgroup estimate does not mean the overall trial was positive.
Participants were randomly assigned to standard care with or without prostate radiotherapy. The principal survival outcome discussed here is overall survival (OS), the time from randomization until death from any cause. A hazard ratio (HR) compares the instantaneous event rates between groups over follow-up, among participants still at risk. An HR below 1 favors radiotherapy for mortality, under the stated comparison, but is not itself a ratio of survival probabilities.
The Overall Result and the Low-Burden Result
In STAMPEDE, the overall OS estimate for prostate radiotherapy was HR 0.92, with a 95% confidence interval (CI) of 0.80 to 1.06 and \(p=0.266\). The point estimate corresponds to an estimated 8% lower mortality hazard in the radiotherapy group. However, the interval includes 1, so the data are compatible with effects ranging from a 20% lower hazard to a 6% higher hazard. The result does not provide statistically significant evidence of an OS benefit across all participants at a conventional 0.05 significance level.
Among participants with low metastatic burden, the reported OS HR was 0.68 (95% CI 0.52 to 0.90; \(p=0.007\)). This estimate corresponds to a 32% lower mortality hazard with radiotherapy. The confidence interval is compatible with a hazard reduction between 10% and 48%. The study also reported estimated 3-year survival of about 81% with radiotherapy and 73% without it in this subgroup, an absolute difference of approximately 8 percentage points. These survival percentages and the HR summarize different aspects of the data: the former compare estimated survival at a particular time, while the latter compares hazards over follow-up.
Worked Example: Interpreting the Overall Survival Estimate
Suppose a reader is given STAMPEDE’s overall OS estimate, HR 0.92 (95% CI 0.80 to 1.06; \(p=0.266\)), and asked whether radiotherapy improved survival across the full metastatic cohort.
The point estimate is \(1-0.92=0.08\), or an estimated 8% lower mortality hazard with radiotherapy. The interval’s lower endpoint, 0.80, corresponds to a 20% lower hazard; its upper endpoint, 1.06, corresponds to a 6% higher hazard. Because the interval includes the null HR of 1 and \(p=0.266>0.05\), the result is not statistically significant at the 5% level.
The appropriate conclusion is that STAMPEDE did not demonstrate an OS benefit for the unselected metastatic cohort. It is not correct to conclude that radiotherapy has exactly no effect: the interval still includes potentially meaningful benefit and modest harm.
Interpreting the Subgroup Evidence
The low-burden estimate is clinically important, but subgroup interpretation requires more than noticing that one subgroup’s \(p\)-value is below 0.05. A subgroup result estimates the treatment effect within that subgroup. A treatment-by-subgroup interaction asks a different question: is the treatment effect itself different between burden groups? In STAMPEDE, the reported evidence that the OS treatment effect differed by metastatic burden had an interaction \(p\)-value of 0.0098.
A significant result in one subgroup and a non-significant result in another does not, by itself, establish an interaction. The difference between “statistically significant” and “not statistically significant” is not automatically statistically significant. The formal interaction test evaluates the contrast between subgroup-specific treatment effects.
One way to express the interaction is to compare log hazard ratios. If \(\beta_L=\log(HR_L)\) is the low-burden treatment effect and \(\beta_H=\log(HR_H)\) is the high-burden treatment effect, then the interaction contrast is \(\Delta=\beta_L-\beta_H\). Under independent subgroup estimates, its standard error is \(SE(\Delta)=\sqrt{SE(\beta_L)^2+SE(\beta_H)^2}\). A test of \(H_0:\Delta=0\) assesses whether the log HRs differ. In a trial analysis, the interaction is typically estimated within a survival model; the reported test, rather than an informal comparison of subgroup \(p\)-values, is the relevant evidence.
Worked Example: Translating the Low-Burden Estimate
For the low-burden subgroup, take the reported OS HR of 0.68 (95% CI 0.52 to 0.90; \(p=0.007\)). The estimated relative hazard reduction is calculated as:
Thus, the point estimate is a 32% lower mortality hazard with prostate radiotherapy than with standard care alone in this subgroup. Applying the same conversion to the confidence limits gives \(1-0.90=0.10\) and \(1-0.52=0.48\), corresponding to a range from a 10% to a 48% lower hazard.
The 3-year survival estimates, about 81% versus 73%, give a separate absolute comparison: \(81\%-73\%=8\) percentage points higher estimated survival at 3 years with radiotherapy. This is not an 8% relative increase, nor does it imply that every individual gains 8 percentage points of survival probability. It is a difference between group-level survival estimates at that time point.
A Wald Calculation and What It Does—and Does Not—Show
For a log hazard ratio estimate \(\hat\beta=\log(\widehat{HR})\) with estimated standard error \(SE(\hat\beta)\), a Wald statistic for \(H_0:\beta=0\) is \(z=\hat\beta/SE(\hat\beta)\). Under the null and the large-sample approximation, this statistic is approximately standard normal. A two-sided \(p\)-value is \(2P(Z\geq |z|)\), where \(Z\sim N(0,1)\). The corresponding approximate 95% CI on the log scale is \(\hat\beta\pm1.96SE(\hat\beta)\); exponentiating both endpoints returns an interval for the HR.
Worked Example: Checking a Hypothetical Log-HR Calculation
Consider a separate, explicitly hypothetical survival analysis with estimated log HR \(\hat\beta=-0.376478\) and \(SE(\hat\beta)=0.1661\). These values are used only to demonstrate the calculation; they are not the reported STAMPEDE subgroup result.
The Wald statistic is:
The two-sided \(p\)-value is \(2P(Z\geq 2.2666)\approx0.02343\). The estimated HR is \(\exp(-0.376478)\approx0.6863\). The approximate 95% log-scale interval is \(-0.376478\pm1.96(0.1661)\), or approximately \((-0.7020,-0.05092)\). Exponentiating gives an HR interval of approximately \((0.4956,0.9504)\).
For this hypothetical analysis, the interval excludes 1 and the two-sided \(p\)-value is below 0.05. That would be evidence against a zero log treatment effect under the model and assumptions used. It should not be confused with the actual STAMPEDE low-burden estimate, whose reported HR, interval, and \(p\)-value are 0.68, 0.52 to 0.90, and 0.007, respectively.
The Wald calculation relies on a suitable large-sample approximation and an estimated standard error appropriate to the survival model. The interpretation of an HR as a reasonably stable relative hazard over follow-up also relies on the proportional-hazards assumption. If treatment effects vary substantially over time, one HR may conceal that pattern; survival curves and time-specific estimates then provide useful context. Censoring must also be handled appropriately: the survival analysis assumes that censoring is non-informative, at least conditional on the variables included in the model.
What the Result Supports, and Its Limits
Randomization supports a causal comparison of assigned treatment strategies within the trial population, subject to issues such as adherence, outcome ascertainment, and missing follow-up. It does not make every subgroup comparison equally precise. Subgroups contain fewer participants and events than the full trial, so their estimates are generally less precise. The low-burden finding is strengthened by the reported interaction evidence, but it remains evidence from a subgroup analysis in a defined clinical setting.
The burden classification depends on imaging and the trial’s stated criteria. A different imaging method or a population with different patterns of disease could classify participants differently. The findings concern men with newly diagnosed metastatic disease in the trial’s treatment context; they should not automatically be extended to all men with metastatic prostate cancer, including those whose disease became metastatic later. The absolute survival difference is also tied to the follow-up period and background care in the trial. If systemic treatment and prognosis change, the absolute benefit may change even if a relative treatment effect were similar.
Worked Example: Avoiding a Subgroup-Comparison Error
Suppose a report gives a low-burden \(p\)-value of 0.007 and a high-burden \(p\)-value above 0.05. A reader concludes, “Radiotherapy works in low-burden disease but definitely does not work in high-burden disease.”
That conclusion overstates what separate significance tests establish. The low-burden result is evidence of a treatment effect in that subgroup; the high-burden result’s failure to reach significance does not prove a zero effect there. To assess whether effects differ, use the treatment-by-burden interaction test. STAMPEDE reported an interaction \(p\)-value of 0.0098, which supports a difference in treatment effects by burden in this analysis, while still leaving uncertainty about the exact effects in each group.
A common mistake is to describe HR 0.68 as “32% more men survived” or as an individual patient’s probability of benefit. The correction is that it is an estimated 32% lower instantaneous mortality hazard in the low-burden group, subject to the survival model and its assumptions. A second mistake is to call the overall trial positive because the subgroup \(p\)-value is significant. The correction is to report both the overall result and the subgroup evidence, specifying the population and outcome each describes.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions.
- What does the overall STAMPEDE OS HR of 0.92 estimate, and why does it not establish an OS benefit across all participants?
- In the low-burden subgroup, what does HR 0.68 mean? State the interpretation in terms of mortality hazard.
- Why is “significant in low burden but not significant in high burden” not, by itself, proof of a treatment-by-burden interaction?
- What is the approximate absolute difference between the reported 3-year survival estimates of 81% and 73%, and what does that difference describe?
- For the hypothetical log HR \(-0.376478\) and standard error 0.1661, calculate the Wald statistic and two-sided \(p\)-value to four significant figures.
Solutions: (1) It estimates the relative instantaneous mortality hazard for radiotherapy versus standard care in the full randomized metastatic cohort. Its 95% CI, 0.80 to 1.06, includes 1, and \(p=0.266\), so the trial did not demonstrate an overall OS benefit at the 0.05 level. (2) It estimates a 32% lower mortality hazard with radiotherapy in the low-burden subgroup; it is not a 32-percentage-point increase in survival probability. (3) The difference between two significance decisions is not itself a test of the difference between effects; the interaction test directly addresses whether subgroup effects differ. (4) \(81\%-73\%=8\) percentage points, a difference in group-level estimated survival at 3 years. (5) \(z=-0.376478/0.1661\approx-2.2666\), giving a two-sided \(p\)-value of approximately 0.02343.