Why this I-SPY 2 result needs careful reading
A promising result for a combination is not automatically evidence that each drug in it contributes benefit. That distinction matters in the I-SPY 2 evaluation of veliparib plus carboplatin for triple-negative breast cancer (TNBC). The combination’s pathologic complete response (pCR) estimate was substantially higher than the concurrent control estimate, which made the regimen a candidate for further testing. But because veliparib and carboplatin were given together, that comparison alone could not tell whether the signal came from veliparib, carboplatin, their joint use, or some combination of these explanations.
I-SPY 2 is an adaptive neoadjuvant platform: experimental regimens are assessed against a shared standard-treatment control, and assignment can adapt as evidence accumulates. In the regimen considered here, veliparib and carboplatin were added during the paclitaxel portion of neoadjuvant treatment; patients then received doxorubicin and cyclophosphamide. The comparison is therefore about the added regimen on this treatment backbone, not about either drug in isolation.
What the I-SPY 2 evidence showed
In the published I-SPY 2 evaluation, the model-based estimated pCR rate for patients with TNBC was about 51% with veliparib plus carboplatin and about 26% with the concurrent control regimen. The estimated difference was therefore about 25 percentage points. These were Bayesian model-based estimates, not simply two raw percentages calculated from fixed, equal-sized groups. The model used the trial’s adaptive platform and subtype information; its uncertainty was reported using Bayesian probability intervals. Such an interval summarizes uncertainty about the model-based rate under the specified model and prior, and should not be mislabeled as a frequentist confidence interval.
The result was encouraging evidence for the combination in the TNBC subgroup. It did not establish that the combination improved every clinically important outcome, nor did it isolate veliparib’s contribution. I-SPY 2’s role was to provide a basis for deciding whether a candidate regimen merited larger testing. That evidence should be read in the context of the design and endpoint: a pCR signal is evidence about response at surgery, not a direct measurement of long-term survival.
The elementary risk-difference calculation below is useful for understanding what a comparison of pCR proportions means. It is not a reconstruction of I-SPY 2’s adaptive Bayesian analysis. The distinction between a transparent descriptive contrast and the platform’s model-based inference is essential.
A simple comparison and its assumptions
Suppose two independently randomized groups have pCR probabilities \(p_1\) and \(p_0\), and observed pCR proportions \(\hat p_1\) and \(\hat p_0\), based on \(n_1\) and \(n_0\) patients. The estimated risk difference is \(\hat\Delta=\hat p_1-\hat p_0\). Under independent Bernoulli outcomes within groups, an approximate standard error is
An approximate 95% Wald interval is \(\hat\Delta\pm1.96SE(\hat\Delta)\). This approximation is most defensible when each group has enough pCR and non-pCR outcomes; with sparse outcomes, a score-based or exact method is generally preferable. The calculation also presumes independent patient outcomes and a clearly defined outcome measured comparably across groups. In an adaptive platform, this simple formula is an illustration, not a replacement for the analysis that accounts for the trial’s design and model.
Worked Example: Estimating a Hypothetical pCR Rate
Hypothetical data only. Suppose 36 of 80 patients in a single treatment group have pCR. The estimated rate is \(\hat p=36/80=0.45\), or 45%.
Using the normal approximation, the standard error is \(SE=\sqrt{0.45(1-0.45)/80}=\sqrt{0.00309375}\approx0.0556\). An approximate 95% Wald interval is \(0.45\pm1.96(0.0556)=0.45\pm0.1090\), or approximately \((0.341,0.559)\).
Thus, under the assumptions behind this interval procedure, the data are compatible with a pCR rate of roughly 34.1% to 55.9%. This is an approximate frequentist interval, not a statement that there is a 95% probability the fixed rate lies in this particular interval. The 36 pCR and 44 non-pCR outcomes make a normal approximation plausible for this illustration, though other intervals can have better coverage properties.
Worked Example: A Hypothetical Difference That Includes Zero
Hypothetical data only. Suppose an experimental group has 53 pCRs among 100 patients and a control group has 58 among 100. The estimated risk difference, experimental minus control, is \(0.53-0.58=-0.05\), or −5 percentage points.
The approximate standard error is \(SE=\sqrt{0.53(0.47)/100+0.58(0.42)/100}\). The terms are \(0.002491\) and \(0.002436\), so \(SE=\sqrt{0.004927}\approx0.0702\).
The approximate 95% interval is \(-0.05\pm1.96\sqrt{0.004927}\approx(-0.188,0.088)\). In percentage points, this is about −18.8 to 8.8. The data do not rule out either a lower pCR rate or a modestly higher one for the experimental group under this simple analysis. The point estimate alone does not establish a treatment effect, and the interval is not an I-SPY 2 result.
Why a later trial needed a carboplatin-only comparison
A combination-versus-control contrast answers whether the tested combination performs differently from the control under the study’s conditions. It cannot, by itself, determine which component accounts for the difference. A later randomized test, BrighTNess, addressed this attribution question by including three groups: paclitaxel with carboplatin and veliparib, paclitaxel with carboplatin and placebo, and a paclitaxel-based control without either added drug. All groups subsequently received doxorubicin and cyclophosphamide.
BrighTNess reported pCR rates of approximately 53% for the veliparib-plus-carboplatin group, 58% for the carboplatin-without-veliparib group, and 31% for the control group. The direct comparison of the two carboplatin groups is the relevant randomized contrast for assessing the incremental contribution of adding veliparib to carboplatin. The trial did not demonstrate a significant pCR improvement from adding veliparib. The carboplatin-containing groups had higher pCR rates than the control group, supporting a role for carboplatin in that regimen setting. These findings do not prove that veliparib can never help any subgroup or under any regimen; they show why the combination signal in I-SPY 2 was not enough to establish veliparib’s added contribution.
Worked Example: Separating the Components in a Hypothetical Three-Arm Trial
Hypothetical data only. Imagine three randomized groups of 200 patients each: combination treatment has 106 pCRs (53%), carboplatin without veliparib has 116 (58%), and control has 62 (31%). These numbers are invented for illustrating the comparisons, not BrighTNess data.
For combination versus carboplatin alone, the risk difference is \(0.53-0.58=-0.05\). Its approximate standard error is \(\sqrt{0.53(0.47)/200+0.58(0.42)/200} =\sqrt{0.0012455+0.001218} =\sqrt{0.0024635}\approx0.0496\). The approximate 95% interval is \(-0.05\pm1.96(0.0496)\), or about \((-0.147,0.047)\). This comparison does not suggest an evident pCR advantage from adding veliparib in these hypothetical data.
For carboplatin alone versus control, the difference is \(0.58-0.31=0.27\). The standard error is \(\sqrt{0.58(0.42)/200+0.31(0.69)/200} =\sqrt{0.001218+0.0010695} =\sqrt{0.0022875}\approx0.0478\). The approximate 95% interval is \(0.27\pm1.96(0.0478)\), or about \((0.176,0.364)\). This illustrates a substantially higher pCR rate in the carboplatin group than in control. A real trial’s formal conclusions would use its prespecified analysis, not these illustrative Wald calculations.
Diagnostics, limitations, and common misreadings
When evaluating a pCR comparison, first check that the endpoint definition, eligible population, treatment backbone, and timing of assessment are aligned across the groups. Then examine the uncertainty as well as the point estimate. In an adaptive design, also ask whether the reported quantity is a raw proportion, a model-based estimate, or a predictive probability; they answer different questions. Do not use an elementary independent-binomial standard error as though it reproduced an adaptive trial’s full analysis.
Failure modes include incomplete ascertainment of surgical pathology, missing outcomes, changes in the control regimen over calendar time, and imbalances in prognostic features within a small biomarker-defined subgroup. Adaptive allocation can also produce unequal group sizes, so a simple comparison that ignores the allocation and modeling strategy may be misleading. These considerations do not make the pCR evidence unusable; they determine what inference it can support and how much uncertainty should remain.
pCR is clinically informative in neoadjuvant breast cancer, but it is not interchangeable with event-free or overall survival. A treatment can change the probability of pCR without producing the same-sized change in later outcomes, and toxicity and treatment burden matter when judging net benefit. Finally, the I-SPY 2 result concerned TNBC within a specific platform, regimen, and treatment context. It should not be generalized automatically to other breast-cancer subtypes or to a different drug combination.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions below.
- In the I-SPY 2 case, what does pCR mean, and why is it not a direct measure of survival?
- An experimental regimen has an estimated pCR rate 25 percentage points above control. What can this contrast establish, and what can it not establish about a two-drug combination?
- Why is a comparison between carboplatin plus veliparib and carboplatin without veliparib informative about veliparib’s added contribution?
- In a hypothetical study, 40 of 100 patients in one group and 30 of 100 in another achieve pCR. Calculate the risk difference, experimental minus comparison, and state its units.
Solutions. (1) pCR means no residual invasive cancer in the breast or regional nodes at surgery after neoadjuvant treatment, with in-situ disease permitted in the breast. It is a response endpoint at surgery, not a measurement of how long patients live or remain free of recurrence. (2) The contrast describes the combination-versus-control difference in pCR in the studied population and setting. It cannot identify which component caused the difference or establish that both components contributed. (3) Random assignment between those two groups holds the carboplatin regimen broadly in common, so their contrast estimates the incremental effect of adding veliparib under the trial conditions. (4) The risk difference is \(40/100-30/100=0.10\), or 10 percentage points higher in the experimental group.