Tutorials › Multi-Arm Multi-Stage (MAMS) Designs › Pembrolizumab’s I-SPY 2 Evaluation

Case Studies · Tutorial 479 of 499

Pembrolizumab's I-SPY 2 Evaluation

Learn how to interpret pembrolizumab’s I-SPY 2 pCR findings across hormone-receptor-defined signatures without confusing promising phase II evidence with definitive clinical benefit.

Advanced 10 min read

What You'll Learn

  • Describe the pembrolizumab regimen and the high-risk HER2-negative population evaluated in I-SPY 2.
  • Interpret model-estimated pathologic complete response rates in the HER2-negative, HR-positive, and HR-negative signatures.
  • Calculate absolute differences and explain why they are not automatically individual treatment benefits.
  • Distinguish subgroup-specific evidence from proof that a biomarker predicts differential treatment response.
  • Identify limitations of pCR, adaptive phase II comparisons, and cross-trial comparisons.

Why Pembrolizumab Was Evaluated Before Surgery

For high-risk early breast cancer, treatment before surgery can shrink disease and provides a direct way to observe whether invasive cancer remains in the breast and regional lymph nodes. Pembrolizumab, an immune checkpoint inhibitor, was therefore evaluated in I-SPY 2 as part of a neoadjuvant regimen for high-risk HER2-negative disease. The question was not whether pembrolizumab alone could produce a response, but whether adding it to chemotherapy improved the chance of pathologic complete response (pCR).

In the pembrolizumab arm, patients received pembrolizumab with weekly paclitaxel, followed by doxorubicin and cyclophosphamide. The comparison was the corresponding chemotherapy regimen without pembrolizumab. Thus, an arm-level difference concerns the addition of pembrolizumab to that treatment sequence; it does not isolate an effect of pembrolizumab as a standalone therapy.

I-SPY 2 enrolled patients with high-risk, early-stage breast cancer and used an adaptive randomized phase II platform. The earlier material on pathologic complete response defines the endpoint; here, the key point is that pCR is assessed at surgery. In this setting, pCR means no residual invasive cancer in the breast or sampled regional lymph nodes; residual in-situ disease may remain. The pembrolizumab evaluation focused on HER2-negative disease, with results considered in hormone receptor (HR)-positive and HR-negative signatures.

Definition: A biomarker signature is a predefined patient subgroup identified by one or more biological characteristics. In this evaluation, HR status within HER2-negative disease distinguished the HR-positive/HER2-negative and HR-negative/HER2-negative signatures. A treatment result within a signature describes an effect estimate for that subgroup; it does not, by itself, establish that the signature predicts who benefits more.

What the pCR Findings Showed

The reported results were Bayesian model estimates, not simple proportions from two equally sized, fixed parallel groups. The estimated pCR rates for the pembrolizumab-containing regimen versus control were approximately 44% versus 17% in HER2-negative disease overall, 30% versus 13% in the HR-positive/HER2-negative signature, and 60% versus 22% in the HR-negative/HER2-negative signature. These figures indicate higher estimated pCR rates in the pembrolizumab arm in each of these signatures.

Those estimates are clinically striking, particularly in HR-negative/HER2-negative disease, but their meaning is specific. They are estimates from a phase II adaptive platform and its statistical model. They are not the probability that a particular patient will achieve pCR, nor proof that the same difference would be observed in every clinical setting. The study supported further evaluation of the regimen; it was not a definitive test of long-term survival benefit.

Worked Example: Reading a Subgroup Difference

Use the reported approximate model estimates for the HR-positive/HER2-negative signature: pCR of 30% with pembrolizumab plus chemotherapy and 13% with chemotherapy alone. Calculate the absolute difference and the ratio of the estimated rates.

Absolute difference. Subtract the control estimate from the pembrolizumab estimate:

$$ 0.30-0.13=0.17 $$

The estimated difference is 17 percentage points. In this model-based comparison, the pembrolizumab-containing regimen had an estimated pCR rate 17 percentage points higher in this signature.

Rate ratio. Divide the two estimated rates:

$$ \frac{0.30}{0.13}\approx 2.31 $$

The estimated pCR rate was about 2.31 times the control estimate. This ratio is a comparison of group-level estimates, not a statement that an individual patient is 2.31 times as likely to benefit. Neither calculation supplies the uncertainty interval or replaces the platform’s Bayesian analysis.

Why Subgroup Estimates Need Careful Interpretation

A difference between treatment estimates in two signatures can suggest that treatment effects vary, but it is not by itself a formal test of treatment-by-biomarker interaction. For example, the estimated absolute differences were about 17 percentage points in HR-positive/HER2-negative disease and 38 percentage points in HR-negative/HER2-negative disease. Subtracting these gives a 21-percentage-point contrast between the two estimated differences. That arithmetic alone does not establish a real biological interaction: uncertainty in both subgroup estimates, the model structure, and the prespecified analysis all matter.

It is also important to distinguish a prognostic marker from a predictive marker. A prognostic marker is associated with outcome regardless of treatment. A predictive marker identifies variation in the relative treatment effect. To support a predictive interpretation, investigators need evidence about how treatment effect differs by marker status, not merely a high pCR rate in one subgroup or a favorable result in each subgroup considered separately.

Worked Example: Why the Overall Rate Depends on Subgroup Mix

Suppose, purely for illustration, a hypothetical HER2-negative population is 60% HR-negative and 40% HR-positive. Apply the approximate signature-specific rates above to this mix. This calculation is illustrative; it is not a reconstruction of I-SPY 2’s observed sample or model.

For the pembrolizumab regimen, the weighted pCR estimate is:

$$ (0.60)(0.60)+(0.40)(0.30)=0.36+0.12=0.48 $$

The corresponding control estimate is:

$$ (0.60)(0.22)+(0.40)(0.13)=0.132+0.052=0.184 $$

For this hypothetical mix, the overall estimates are 48.0% and 18.4%, a difference of 29.6 percentage points. If the population had a different HR-signature mix, the weighted overall rates would also differ, even if the signature-specific rates stayed the same. This is one reason that an overall rate from one trial population should not be transferred uncritically to another.

Checking the Arithmetic Behind a Simple Comparison

A basic independent-binomial calculation can help explain why raw proportions alone are not enough. It is not a replacement for I-SPY 2’s adaptive Bayesian analysis. Suppose a separate, hypothetical fixed randomized comparison had 24 pCRs among 50 patients assigned to the pembrolizumab regimen and 10 among 50 controls. Assume each patient contributes one binary outcome, treatment assignment makes the groups comparable, and outcomes are independent within and between groups for this illustrative calculation.

Worked Example: A Hypothetical Fixed-Group Comparison

The sample pCR proportions are \(24/50=0.48\) and \(10/50=0.20\). The estimated absolute difference is:

$$ \hat{p}_1-\hat{p}_0=0.48-0.20=0.28 $$

So the observed difference is 28 percentage points. Under independent binomial sampling, the estimated standard error of this difference is:

$$ SE=\sqrt{\frac{0.48(1-0.48)}{50}+\frac{0.20(1-0.20)}{50}} =\sqrt{0.004992+0.003200} =\sqrt{0.008192} \approx 0.0905 $$

A simple large-sample 95% interval is \(0.28\pm1.96(0.0905)\), or approximately 0.103 to 0.457. Under the assumptions of this hypothetical fixed-group calculation, the interval estimates the range of plausible values for the population difference in pCR rates, from about 10.3 to 45.7 percentage points. It is not an interval for the chance that any one patient will benefit. The calculation also illustrates why the observed difference must be considered alongside uncertainty, rather than reported alone.

The calculation above relies on a simple fixed-group approximation. In an adaptive platform, allocation probabilities and the use of shared concurrent controls can change as evidence accumulates. The analysis must account for the design and model; a naive calculation that treats every arm as an independent, fixed-size conventional trial may not reproduce the intended inferential procedure.

Clinical Meaning, Diagnostics, and Limitations

pCR is an important neoadjuvant endpoint, but it is not identical to cure or survival. Patients who achieve pCR often have favorable outcomes, yet a treatment-induced increase in pCR does not automatically establish an improvement in event-free or overall survival. Long-term follow-up and evidence designed to evaluate those outcomes are needed for those claims. Moreover, this arm evaluated a regimen in a selected high-risk population; its estimates should not be assumed to apply to lower-risk disease, metastatic disease, or a different chemotherapy schedule.

A useful interpretation check is to ask whether the evidence is being used for the claim it can support. The findings support a promising pCR signal for adding pembrolizumab in the evaluated neoadjuvant setting and across the reported HER2-negative signatures. They do not establish that HR status alone selects patients who should receive pembrolizumab. Nor should later clinical practice be attributed to this phase II result alone: definitive treatment decisions rely on the wider body of evidence, including separate randomized studies.

When reviewing results from an adaptive platform, check that the comparator is appropriate for the arm and calendar period, that the endpoint is consistently defined, and that the subgroup was specified and analyzed as intended. Be cautious if a report presents a subgroup percentage without its uncertainty, compares an experimental group with a nonconcurrent historical rate, or treats a model-estimated rate as if it were an unadjusted raw proportion. Changes in patient mix or control outcomes over time can make an unadjusted comparison misleading.

1
Identify the treatment contrast.
Ask whether the estimate compares the pembrolizumab-containing chemotherapy regimen with the same chemotherapy without pembrolizumab.
2
Identify the endpoint and signature.
Confirm that the result concerns pCR at surgery and name the population, such as HR-positive/HER2-negative disease.
3
Read the estimate with its uncertainty and design.
Distinguish a Bayesian model estimate in an adaptive phase II platform from a raw proportion in a conventional fixed-size trial.
4
Limit the conclusion to the evidence.
Describe a pCR signal in the evaluated setting; do not claim a proven survival benefit or a validated treatment-selection biomarker without supporting evidence.

Common Mistake and Main Alternatives

Common mistake: “The pCR estimate was higher in both HR signatures, so HR status is proven to predict pembrolizumab benefit.” The reasoning confuses favorable treatment estimates within subgroups with evidence that treatment effects differ between subgroups. The correction is to examine the formal treatment-by-signature evidence and its uncertainty. A difference between subgroup point estimates can be suggestive, but it is not sufficient on its own.

A fixed, conventional randomized phase III trial is an important alternative when the goal is definitive confirmation of efficacy and clinically consequential outcomes. It typically provides a prespecified comparison and greater information for its primary endpoint, but is larger and slower than an adaptive phase II screen. A historical-control comparison may be faster, but is more vulnerable to differences in patient selection, care, and outcome assessment. I-SPY 2’s randomized, concurrent-control platform offers an efficient way to evaluate promising regimens and estimate pCR patterns; its limitations include model dependence, evolving allocation, and the need for confirmatory evidence.

Key takeaway: I-SPY 2 estimated higher pCR rates with pembrolizumab plus chemotherapy than with chemotherapy alone in HER2-negative disease, including both HR-defined signatures. Interpret these as model-based phase II findings for a specific regimen and population—not as standalone proof of survival benefit or proof that HR status predicts differential benefit.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. What treatment contrast did the pembrolizumab arm evaluate, and why is it inaccurate to describe the result as the effect of pembrolizumab alone?
  2. Using the approximate HR-negative/HER2-negative estimates of 60% versus 22%, calculate the absolute difference in pCR rates.
  3. Why does a larger estimated difference in one HR signature than another not, by itself, prove that HR status predicts treatment benefit?
  4. Name one reason that a higher pCR rate should not automatically be interpreted as proof of improved overall survival.

Solutions. (1) It compared pembrolizumab added to the specified neoadjuvant chemotherapy sequence with that chemotherapy sequence without pembrolizumab; the contrast is for the combined regimen. (2) \(0.60-0.22=0.38\), or 38 percentage points. (3) The two estimates have uncertainty, and the difference between their point estimates is not itself a formal interaction analysis. (4) pCR is an intermediate surgical endpoint; a treatment-induced change in pCR does not necessarily establish a change in long-term survival, which requires appropriate follow-up and evidence.

Clinical Biostats