Tutorials › Pattern-Mixture and Selection Models › Worked Estimand Analysis for a Rescue-Therapy Trial

The Estimand Framework and Intercurrent Events · Tutorial 409 of 499

Worked Estimand Analysis for a Rescue-Therapy Trial

Learn to specify and compare three estimands for a trial in which participants may use rescue therapy, and interpret the distinct clinical questions each answers.

Intermediate 12 min read

What You'll Learn

  • Define rescue therapy as an intercurrent event and specify the target population, outcome, treatment conditions, and summary measure.
  • Calculate a treatment-policy contrast from outcomes that include rescue use as it occurs.
  • Describe the counterfactual outcome required by a hypothetical no-rescue estimand.
  • Construct a composite responder outcome that counts rescue use as failure.
  • Compare the clinical interpretations, identification assumptions, and limitations of the three estimands.

Why Rescue Therapy Changes the Question

In a randomized trial, some participants may need rescue therapy because their symptoms remain uncontrolled or worsen. The outcome measured after rescue is still clinically relevant, but it does not describe what would have happened had rescue been unavailable. A trial analysis must therefore make explicit how rescue use is handled. Different choices define different estimands, and consequently answer different clinical questions.

Consider a hypothetical 12-week trial comparing an investigational treatment with control for a condition measured on a 0-to-10 symptom scale, where lower scores indicate fewer symptoms. Participants may use a specified rescue medication before week 12. The examples below use symptom score at week 12 as the outcome unless a composite responder outcome is explicitly defined. All numerical values are hypothetical.

Definition: An intercurrent event is an event after treatment initiation that affects either the interpretation or existence of the outcome relevant to the clinical question. Rescue-therapy use is an intercurrent event. An estimand specifies the target population, treatment conditions, outcome variable, strategy for handling intercurrent events, and population-level summary used to express the treatment effect.

Let \(A=1\) denote assignment to the investigational treatment and \(A=0\) assignment to control. Let \(R=1\) indicate rescue-therapy use before week 12 and \(R=0\) indicate no use. Write \(Y\) for the week-12 symptom score. A treatment contrast on the mean-difference scale will be written as treatment minus control; a negative value favors the investigational treatment because lower scores are better.

Three Ways to Define the Rescue Strategy

The same trial can support several clinically coherent questions. The key is not to treat these questions as interchangeable. For each estimand, the treatment conditions and outcome scale should stay clear while the handling of rescue changes.

Definition: In a treatment-policy estimand, outcomes are used regardless of whether rescue therapy occurs. The question is about the effect of assignment to each randomized treatment condition in a setting where rescue is available and used as it occurs.

For the mean symptom score, the treatment-policy contrast is \(E(Y\mid A=1)-E(Y\mid A=0)\), for the randomized target population. In a randomized trial, assignment supports comparison of these marginal outcomes, provided outcome data are adequately observed or appropriately handled. Rescue users remain part of their assigned groups. Their measured week-12 outcomes, including any benefit from rescue, contribute to the result.

Definition: In a hypothetical estimand, the outcome is defined under a specified scenario in which rescue therapy does not occur. Let \(Y^{a,0}\) denote the week-12 outcome that would arise under assignment \(a\) in the hypothetical scenario where rescue is prevented. The mean contrast is \(E(Y^{1,0})-E(Y^{0,0})\).

This estimand asks what the treatment contrast would be if participants did not use rescue therapy. It is not the same as comparing observed participants who happened not to use rescue: that subset may differ systematically between arms and from participants who required rescue. Outcomes \(Y^{a,0}\) are not observed for participants who actually used rescue, so the hypothetical contrast requires assumptions and an appropriate estimation approach.

Definition: In a composite strategy, the intercurrent event is incorporated into the outcome itself. For example, define success as both achieving at least a 30% reduction in symptoms from baseline and not using rescue therapy. A participant who uses rescue is classified as a failure on this composite outcome, whatever their symptom score.

The composite estimand could be the difference between treatment and control in the probability of composite success. Its meaning is not simply “the effect on symptoms.” It concerns a combined outcome: symptom response without rescue. The threshold and the rule for rescue use must be stated in advance and justified clinically.

Worked Example: Specify the Three Clinical Questions

Worked Example: Specify the Three Clinical Questions

Suppose the trial enrolls adults with moderate symptoms, randomizes them to the investigational treatment or control, and measures a 0-to-10 symptom score at week 12. Rescue therapy is permitted. State three distinct estimands that could be used to compare the randomized groups.

Treatment policy. The population is all randomized adults meeting the trial eligibility criteria. The treatment conditions are assignment to investigational treatment or control, with rescue available. The variable is week-12 symptom score, including the outcomes observed after rescue. The summary is the difference in population mean scores, treatment minus control. This asks about the effect of assignment in a care setting that allows rescue.

Hypothetical no rescue. The population and assigned treatment conditions are the same, but the variable is the week-12 score in the scenario where rescue is prevented. The summary is \(E(Y^{1,0})-E(Y^{0,0})\). This asks about the contrast under a specified no-rescue scenario, rather than the effect of assignment with usual rescue use.

Composite success. Define success as at least a 30% symptom reduction from baseline and no rescue use by week 12. The summary is the difference in success probabilities. This asks whether assignment changes the chance of achieving symptom response without needing rescue.

All three use the same target population and randomized treatment conditions, but their outcomes or intercurrent-event strategies differ. Thus they need not produce the same numerical contrast, and no one contrast is a substitute for the others without a clinical argument.

Treatment-Policy Analysis: Include Rescue Outcomes

For a treatment-policy estimand, rescue use is not a reason to remove a participant or disregard their outcome. The marginal mean in each randomized arm can be expressed as a weighted average of the means among rescue users and nonusers. This identity helps show why an analysis limited to participants who avoided rescue changes the question.

$$ E(Y\mid A=a) = P(R=0\mid A=a)E(Y\mid A=a,R=0) + P(R=1\mid A=a)E(Y\mid A=a,R=1). $$

Worked Example: Calculate a Treatment-Policy Contrast

In a hypothetical trial, 100 participants are randomized to each arm and all have week-12 outcomes recorded. In the treatment arm, 80 do not use rescue and have a mean score of 4.0; 20 use rescue and have a mean score of 5.0. In the control arm, 60 do not use rescue and have a mean score of 6.5; 40 use rescue and have a mean score of 6.0. Calculate the treatment-policy mean difference.

The treatment-arm marginal mean is the weighted mean across all 100 assigned participants:

$$ \bar{Y}_{1} = \frac{80}{100}(4.0)+\frac{20}{100}(5.0) =3.2+1.0 =4.20\text{ points}. $$

The control-arm marginal mean is:

$$ \bar{Y}_{0} = \frac{60}{100}(6.5)+\frac{40}{100}(6.0) =3.9+2.4 =6.30\text{ points}. $$

Therefore, the treatment-policy contrast is \(4.20-6.30=-2.10\) points. In this hypothetical sample, assignment to the investigational treatment is associated with a mean week-12 score 2.10 points lower than assignment to control, with rescue outcomes included. Since lower scores are better, the direction favors the investigational arm. This arithmetic assumes the stated outcomes are available for all participants; it does not by itself address uncertainty or missing outcome data.

The weighted-mean identity follows by partitioning each arm into the mutually exclusive groups \(R=0\) and \(R=1\). Each group's contribution to the arm mean equals its proportion in that arm multiplied by its group mean. Adding the two contributions recovers the mean for the full arm. Omitting rescue users, or averaging only the \(R=0\) group means, does not recover this treatment-policy mean.

Hypothetical Analysis: Estimate Outcomes Under No Rescue

A hypothetical estimand requires a model or other identification strategy for outcomes that would have been observed if rescue had not occurred. Randomization makes treatment assignment independent of baseline potential outcomes in expectation, but it does not randomize rescue use. Participants who need rescue may have worse symptoms, different prognostic characteristics, or different clinical histories. Therefore, the observed non-rescue group is generally not a valid stand-in for the full population under a no-rescue scenario.

A typical identification argument requires a clearly defined no-rescue intervention, consistency between observed outcomes and the relevant potential outcomes when rescue is not used, adequate probability of remaining rescue-free across relevant histories, and sufficient control of predictors of both rescue and outcome. In longitudinal settings, the analysis must account for measured histories that affect later rescue and outcomes. The needed assumptions are substantive; a fitted model does not make them true.

Worked Example: Standardize Hypothetical No-Rescue Predictions

For illustration, suppose a fitted outcome model predicts week-12 symptom scores under no rescue in two baseline symptom-risk strata. Each stratum represents 50% of the target population. The predicted means are 3.5 and 4.5 points under treatment, and 5.5 and 6.5 points under control. These are model-based predictions under the no-rescue scenario, not simply the observed means among participants who avoided rescue. Calculate the standardized contrast.

Average the predicted treatment means using the target-population stratum proportions:

$$ \widehat{E}(Y^{1,0}) = 0.50(3.5)+0.50(4.5) =1.75+2.25 =4.00\text{ points}. $$

Likewise, the standardized control prediction is:

$$ \widehat{E}(Y^{0,0}) = 0.50(5.5)+0.50(6.5) =2.75+3.25 =6.00\text{ points}. $$

The estimated hypothetical contrast is \(4.00-6.00=-2.00\) points. Under the model and its identifying assumptions, this estimates a 2.00-point lower mean score under treatment than control in the no-rescue scenario. It is not a direct randomized comparison among participants who happened to avoid rescue. Its interpretation depends on the model's ability to estimate no-rescue outcomes for people who actually used rescue and on the assumptions that support that extrapolation.

Composite Analysis: Make Rescue Part of the Outcome

A composite outcome is useful when needing rescue is itself an important unfavorable event and the clinical question concerns achieving benefit without that event. For example, let \(B=1\) indicate at least a 30% reduction in symptom score from baseline, and define \(C=1\) only if \(B=1\) and \(R=0\). Equivalently, \(C=0\) if rescue is used or if the response threshold is not met. The treatment effect can then be summarized as a risk difference, \(P(C=1\mid A=1)-P(C=1\mid A=0)\).

Worked Example: Compare Composite Success Rates

In a hypothetical trial with 100 participants per arm, 58 treatment-assigned participants achieve at least a 30% symptom reduction without rescue. In the control arm, 35 achieve that same outcome. All participants who use rescue are classified as composite failures, and the counts already apply this rule. Calculate the risk difference.

The treatment success proportion is \(58/100=0.58\), or 58%. The control success proportion is \(35/100=0.35\), or 35%. Thus:

$$ \widehat{p}_{1}-\widehat{p}_{0} = \frac{58}{100}-\frac{35}{100} =0.58-0.35 =0.23. $$

The estimated difference is 0.23, or 23 percentage points. In this hypothetical sample, 23 more participants per 100 assigned to treatment achieved symptom response without rescue than per 100 assigned to control. This is an estimate of the composite outcome difference, not a 23-point difference in symptom scores or a treatment effect among people who would never use rescue.

Compare Interpretations and Check the Analysis

StrategyHow rescue is handledClinical interpretationImportant limitation
Treatment policyUse outcomes regardless of rescue use.Effect of assignment when rescue is available and used as it occurs.Does not isolate the effect in a no-rescue scenario.
HypotheticalDefine outcomes under a scenario where rescue is prevented.Effect under the specified no-rescue scenario.Requires assumptions to identify outcomes unobserved after actual rescue.
CompositeMake rescue part of the outcome, such as classifying any rescue use as failure.Effect on achieving the defined response without rescue.Depends on a clinically defensible composite rule and threshold.

Several checks help reveal whether the estimand and its analysis are coherent:

  • Confirm the event definition. Specify what counts as rescue, the relevant time window, and how repeated or partial use is handled. Ambiguous event coding can make the estimand ambiguous.
  • Check outcome availability. Treatment policy still requires an outcome definition after rescue. If week-12 outcomes are missing, the missing-data approach must target the same estimand rather than silently excluding participants.
  • Inspect hypothetical-model support. If some clinically relevant histories almost always lead to rescue, there may be little information about their outcomes without rescue. Predictions in such regions rely heavily on extrapolation.
  • Check composite clinical meaning. A threshold and rescue rule should reflect the clinical decision of interest. If rescue is frequent but symptom response remains valuable, treating every rescue user as failure may obscure that distinction.
  • Keep the scale visible. A difference of symptom-score points and a difference of success probabilities have different units and interpretations; neither is automatically the preferred measure.

The main alternative is not a statistical trick but a different estimand. A treatment-policy analysis is often directly aligned with a pragmatic question about assignment under available care. A hypothetical analysis targets a no-rescue scenario that may be useful for understanding treatment effects absent rescue, but depends on untestable or partly testable assumptions. A composite analysis answers a combined benefit-and-rescue question and may be more directly relevant when avoiding rescue is part of treatment success. The choice should follow the clinical question, not which result appears most favorable.

Common Pitfall

Common mistake: “Rescue users should be removed, because they did not follow the treatment strategy; the remaining participants show the treatment effect without rescue.”

Correction: Removing rescue users changes the population being compared and conditions on a post-randomization event. The observed no-rescue groups may not be comparable, even though treatment was randomized. For a treatment-policy question, include rescue users' outcomes. For a hypothetical no-rescue question, estimate counterfactual outcomes under stated assumptions. For a composite question, apply the prespecified rescue rule to everyone.

The distinction matters because rescue therapy can be both a consequence of treatment and a marker of participants' evolving health. Treatment-policy, hypothetical, and composite estimands preserve different parts of that clinical story. Reporting the event strategy alongside the outcome and summary measure makes clear what the treatment contrast can—and cannot—support.

Check Your Understanding

Answer each question, then compare with the solutions below.

  1. In a trial where rescue therapy is available, what does a treatment-policy mean difference include?
  2. Why is the observed mean among participants who did not use rescue generally not the hypothetical no-rescue mean?
  3. A composite success rate is 0.62 under treatment and 0.47 under control. What is the risk difference, and how should it be interpreted?
  4. Name one assumption or diagnostic concern that is especially important for a hypothetical no-rescue estimand.

Solutions. (1) It includes outcomes from all participants in each assigned arm, including outcomes measured after rescue use, and compares the arm-level means. (2) Rescue use occurs after randomization and may depend on prognosis or evolving symptoms; the no-rescue subset can therefore differ from the target population, and it does not reveal rescue users' counterfactual outcomes without rescue. (3) The risk difference is \(0.62-0.47=0.15\), or 15 percentage points; the estimated treatment group has a 15-point higher probability of the defined composite success in this comparison. (4) One concern is whether there is adequate probability of remaining rescue-free across relevant clinical histories; sparse support makes modeled no-rescue predictions rely on extrapolation. Another is whether measured histories sufficiently address the factors related to rescue and subsequent outcome.

Clinical Biostats