Tutorials › Adaptive Clinical Trial Design › I-SPY 2.2 And Response-Based Treatment Paths

Case Studies · Tutorial 770 of 799

I-SPY 2.2 And Response-Based Treatment Paths

Learn how response-guided treatment paths work in I-SPY 2.2, what early MRI measures can and cannot show, and how to avoid biased comparisons of the paths patients follow.

Advanced 11 min read

What You'll Learn

  • Describe the roles of sequential treatment blocks and early MRI response assessment in I-SPY 2.2.
  • Calculate a percentage change in functional tumor volume and interpret it as an early response measure.
  • Distinguish a response-guided treatment policy from a single drug or treatment block.
  • Explain why comparing patients who followed different observed paths can produce biased conclusions.
  • Identify the assumptions needed to estimate outcomes for a prespecified treatment policy.
  • Interpret uncertainty in a hypothetical comparison of treatment policies.

Why Treatment Paths Matter

In neoadjuvant breast cancer treatment, therapy is given before surgery, allowing clinicians to observe tumor response while treatment is under way. I-SPY 2.2 uses that opportunity to organize care in sequential treatment blocks: patients begin with a treatment, undergo early response assessment, and may then proceed to surgery or receive further treatment. The first block can include an investigational regimen; later blocks include additional therapy according to the protocol.

The clinical and statistical question is therefore not only whether a drug has activity. It is also whether a response-guided treatment path—a rule connecting initial treatment and early response to subsequent care—produces useful outcomes. A patient who responds early may receive fewer treatment blocks than a patient whose tumor does not respond sufficiently. Those paths differ in treatment exposure as well as in the patients who follow them.

Definition: A treatment path is the sequence of treatments and decisions a patient experiences over time. A response-guided treatment policy specifies the initial treatment and the rule for choosing subsequent care using response information available at each decision point. The policy is distinct from the observed path of any one patient.

I-SPY 2.2 uses serial breast MRI, including functional tumor volume (FTV), as an early measure of tumor response. The protocol’s response algorithm uses such information to guide decisions about subsequent blocks. The precise decision rules and treatment details are protocol-specific; an early MRI result is not itself the final clinical outcome. Pathologic complete response (pCR), assessed at surgery under the trial’s definition, is an important outcome for evaluating whether a treatment strategy is promising.

From an Early Measure to a Treatment Decision

An early response measure is useful because it can inform treatment before the full course is complete. For example, a change in FTV can summarize how the MRI-measured functional tumor volume has changed from baseline. If \(FTV_0\) is the baseline measurement and \(FTV_1\) is a later measurement, the percentage reduction is

$$ 100\frac{FTV_0-FTV_1}{FTV_0}\%. $$

A positive value indicates a reduction; zero indicates no measured change; and a negative value indicates an increase. This calculation describes a change in the imaging measure, not a percentage probability of pCR. In I-SPY 2.2, the treatment decision uses a prespecified response algorithm rather than an informal judgment based on one number. The algorithm relates early response information to the possibility of later outcomes and determines whether further treatment is indicated.

Worked Example: Calculating an Early FTV Reduction

Suppose, for illustration only, a patient has a baseline FTV of \(40\text{ cm}^3\) and an FTV of \(22\text{ cm}^3\) at an early assessment. The percentage reduction is

$$ 100\frac{40-22}{40}\% =100\frac{18}{40}\% =45\%. $$

The measured FTV has decreased by \(18\text{ cm}^3\), or 45% of its baseline value. This calculation alone does not establish that the patient meets an I-SPY 2.2 decision criterion, nor does it predict pCR with certainty. The protocol’s response model, assessment timing, and decision rule determine how the measurement is used.

A useful early measure must be collected at the right time, measured consistently, and interpreted in the context of the treatment rule. If MRI scans are delayed or unavailable, the decision may be made with incomplete information. Measurement variation can also make an apparent change differ from the underlying tumor change. In addition, patients assessed at different times may not have directly comparable FTV changes. These are reasons to document assessment timing and data completeness and to apply the protocol’s rules consistently.

Why the Path Is the Unit of Interpretation

Suppose a patient receives an investigational regimen in an initial block and then receives more treatment because the early response is insufficient. The final outcome reflects the initial regimen, the additional treatment, the timing and quality of response measurement, and the patient’s characteristics. It cannot generally be attributed to the initial drug alone. Conversely, a patient who proceeds to surgery after an early response has had a different treatment exposure. Comparing these patients as though they had received interchangeable versions of one therapy would obscure the decision rule that created the difference.

Key distinction: The assigned policy is defined before the response is observed. The observed path is the sequence actually followed after response and other protocol-defined information are known. Outcomes by assigned policy address the consequences of using the rule; outcomes grouped by observed path are descriptive unless additional assumptions justify a causal comparison.

This distinction matters because response is measured after treatment begins. Patients who proceed to a later block or to surgery are selected partly by their early response. Early response is also related to prognosis. Thus, a simple comparison of patients who did and did not receive a later block mixes treatment effects with differences in the patients selected for that path.

Worked Example: Why Observed Paths Do Not Form a Fair Comparison

Consider a hypothetical group of 100 patients. After an initial block and MRI assessment, 40 have an early response sufficient under the illustrative rule to proceed to surgery, while 60 receive a further block. Suppose pCR is observed in 28 of the 40 patients proceeding to surgery and 24 of the 60 receiving further treatment.

The observed pCR proportions are

$$ \frac{28}{40}=0.70 \qquad\text{and}\qquad \frac{24}{60}=0.40. $$

It would be incorrect to conclude from this 30-percentage-point difference that avoiding the further block caused better outcomes. The groups were formed using an early response measured after treatment started, not randomized to the two paths. Patients proceeding to surgery were selected for having responded sufficiently; the other group was selected for not doing so. The calculation is a valid description of these hypothetical observed groups, but it does not isolate the causal effect of receiving versus not receiving the further block.

Defining an Estimand for a Response-Guided Policy

A causal question needs a clearly stated comparison. Let \(g\) denote a fully specified policy, including the initial treatment and the rules for subsequent treatment. Let \(Y^g\) denote the outcome a patient would have under policy \(g\), such as an indicator equal to 1 for pCR and 0 otherwise. The policy-level pCR probability is \(P(Y^g=1)\). Comparing policies \(g_1\) and \(g_0\) can be expressed as a difference in pCR probabilities:

$$ P(Y^{g_1}=1)-P(Y^{g_0}=1). $$

This contrast concerns the policies as complete strategies. If the policies differ in their initial treatments, their response rules, or both, the contrast includes those differences. It is not automatically an estimate of the effect of a single drug independent of subsequent care.

A simple justification shows why baseline randomization is valuable. If patients are randomly assigned to one of two prespecified policies, assignment is independent of their potential outcomes. With consistent implementation and complete outcome ascertainment, the observed pCR proportion in each assigned group estimates the pCR probability under that group’s policy. The difference between those observed proportions then estimates the policy contrast, subject to sampling uncertainty. By contrast, grouping patients by the path they actually followed does not preserve that randomization: the observed path is determined in part by post-assignment response.

Assumptions for a policy comparison: The policies and outcome must be defined clearly; assignment to the policies must support a valid comparison (for example, random assignment at baseline); the observed treatment and outcome data must correspond to the specified policy and endpoint; and missing outcomes or departures from the policy must be handled without introducing unaddressed bias. Estimating effects of specific later decisions from nonrandomized observed paths requires additional assumptions about measured and unmeasured factors affecting both the decision and outcome.

Worked Example: A Hypothetical Policy-Level Comparison

Suppose, purely for illustration, 60 patients are randomly assigned to each of two prespecified policies. Both policies use the same response-guided rule after the initial block, but they begin with different initial regimens. Suppose 30 of 60 patients assigned to policy A achieve pCR and 24 of 60 assigned to policy B achieve pCR.

The estimated pCR proportions are \(30/60=0.50\) for policy A and \(24/60=0.40\) for policy B. The estimated difference, A minus B, is

$$ \hat{p}_A-\hat{p}_B =0.50-0.40 =0.10. $$

The estimated difference is 10 percentage points in favor of policy A. An approximate standard error for the difference in two independent proportions is

$$ SE =\sqrt{\frac{0.50(1-0.50)}{60} +\frac{0.40(1-0.40)}{60}} =\sqrt{0.004167+0.004000} =0.09037. $$

Using 1.96 standard errors for an approximate 95% interval gives

$$ 0.10\pm1.96(0.09037) =0.10\pm0.1771 =(-0.0771,\ 0.2771). $$

The interval is approximately from 7.7 percentage points lower to 27.7 percentage points higher for policy A. It is wide and includes zero, so these hypothetical data do not establish a difference between the policies. The estimate concerns the two complete assigned policies, not the isolated effect of either initial regimen. This calculation also assumes independent randomized groups and complete, consistently assessed pCR outcomes.

Interpreting the Design and Its Limits

The response-guided structure can make treatment more adaptive: early information can direct patients toward different subsequent care rather than requiring every patient to receive an identical sequence. It also changes what a trial result means. Evidence that a treatment path has promising outcomes does not, by itself, prove that every component is beneficial, that a different response rule would work as well, or that the strategy improves long-term outcomes. pCR is an important neoadjuvant endpoint, but it does not answer every question about recurrence, survival, toxicity, or quality of life.

A sound analysis should therefore make the target explicit: Is the question about a complete response-guided policy, an initial regimen under a common policy, or the effect of a particular later treatment decision? The answer determines which comparison is appropriate. Results should also be interpreted in light of the population and biomarker-defined groups for which the response model and treatment rules were developed. A rule that performs well in one population need not transfer unchanged to another.

A common mistake is to compare outcomes among patients who reached different blocks and call the difference a treatment effect. The reasoning is tempting: one group received more treatment, so a difference seems to measure the effect of that treatment. The correction is that early response helps determine who receives the next block and also predicts outcome. The groups are therefore not exchangeable by design. Report those comparisons as descriptions of observed paths, or use a causal method only when its assumptions and the required data are justified.

1
Specify the policy.
State the initial treatment, assessment schedule, response rule, subsequent options, and outcome being evaluated.
2
Track response and treatment.
Record the timing and completeness of early MRI measures, the decision made under the rule, and the treatment actually received.
3
Analyze the intended comparison.
Use assigned policies for policy-level inference; do not treat post-treatment observed paths as randomized groups.
4
State what the result supports.
Separate evidence about the complete strategy from claims about an individual drug, a later treatment decision, or outcomes not measured.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A patient’s FTV changes from \(50\text{ cm}^3\) at baseline to \(35\text{ cm}^3\) at reassessment. What is the percentage reduction?
  2. Why is a comparison of pCR rates among patients who did and did not receive a later block not automatically a causal comparison?
  3. In a randomized policy comparison, 36 of 80 patients in policy A and 28 of 80 in policy B achieve pCR. What is the estimated difference in pCR proportions, A minus B?
  4. Does an early FTV reduction establish that a patient will achieve pCR? Explain.

Solutions. (1) The reduction is \(100(50-35)/50=30\%\). (2) Receipt of the later block depends partly on early response, which is measured after treatment begins and is related to prognosis; the observed groups are not randomized. (3) The proportions are \(36/80=0.45\) and \(28/80=0.35\), so the estimated difference is \(0.45-0.35=0.10\), or 10 percentage points in favor of policy A. (4) No. FTV change is an early imaging measure used within a protocol’s response algorithm; it is not a guarantee of pCR, which is assessed at surgery.

Clinical Biostats