Tutorials › Adaptive Clinical Trial Design › Choosing Strategies for Intercurrent Events

Estimand Preservation Under Adaptation · Tutorial 22 of 799

Choosing Strategies for Intercurrent Events

Learn to distinguish the treatment-policy, hypothetical, composite, while-on-treatment, and principal-stratum targets for the same clinical question.

Advanced 11 min read

What You'll Learn

  • Define each of the five intercurrent-event strategies for a treatment comparison.
  • Distinguish an event strategy from missing-outcome handling.
  • Calculate and interpret treatment-policy and composite contrasts.
  • Identify the assumptions needed to interpret hypothetical and principal-stratum targets.
  • Recognize how a while-on-treatment summary can depend on event timing.
  • Compare the strategies when deciding whether an adaptation preserves the intended estimand.

One Event, Several Different Questions

An intercurrent event occurs after treatment assignment and affects either the interpretation or existence of the outcome relevant to the clinical question. Treatment discontinuation because of toxicity is one example. Suppose a randomized trial compares a new therapy with control for a chronic condition, and the outcome is improvement in symptoms at week 24, measured in points, with larger values indicating greater improvement. Some participants discontinue assigned treatment before week 24. The clinical question might sound like “Does the new therapy improve symptoms?” But that question does not yet specify what to do with outcomes after discontinuation.

A strategy for handling the event is part of the estimand: it determines which outcome or population the treatment contrast concerns. The strategies below can use the same treatment comparison and clinical setting yet target different quantities. They are not alternative calculations of one fixed effect; choosing among them changes the question being answered.

Definition: Let \(A\) denote randomized assignment, with \(A=1\) for the new therapy and \(A=0\) for control. Let \(D(a)\) indicate whether a participant would discontinue assigned treatment before week 24 under assignment \(a\), and let \(Y(a)\) be week-24 symptom improvement under assignment \(a\), including whatever subsequent care occurs in the trial. An intercurrent-event strategy specifies how the event is handled in defining the outcome or treatment contrast.

Potential outcomes are indexed by the treatment assignment a participant would receive; \(Y(1)\) and \(Y(0)\) cannot both be observed for the same participant. The definitions also require treatment conditions, the event, outcome, population, and summary measure to be sufficiently precise. For example, “discontinuation” should specify which treatment is discontinued and when; “symptom improvement” should specify its scale and assessment time.

An event strategy is not a missing-data method. If a participant discontinues treatment but week-24 symptoms are still measured, the outcome is observed and the event strategy determines how it enters the estimand. If the week-24 measurement is unavailable, that is missing outcome data; additional assumptions and methods are needed to address it.

Five Strategies and Their Targets

For a treatment-policy strategy, the outcome is considered regardless of whether the intercurrent event occurs. The contrast includes the consequences of discontinuation and subsequent care as they arise under each assigned treatment. It asks about assignment to each treatment condition in the trial context, not about the isolated biological effect of remaining on treatment.

Definition: The treatment-policy contrast for the example is \(E[Y(1)]-E[Y(0)]\), where outcomes after discontinuation remain part of the week-24 outcome. Treatment discontinuation is not used to exclude participants or redefine their outcome.

A hypothetical strategy asks what the outcome would have been under a specified scenario in which the event did not occur. “No discontinuation” must describe a coherent hypothetical intervention: for example, remaining on assigned treatment while otherwise receiving the stated care. The resulting contrast concerns those hypothetical outcomes, not the outcomes actually observed after discontinuation.

Definition: A hypothetical contrast compares \(E[Y(1;\,D=0)]\) with \(E[Y(0;\,D=0)]\), where \(Y(a;\,D=0)\) denotes the outcome under assignment \(a\) in a clearly specified scenario preventing discontinuation. It is meaningful only if that scenario and its outcome are well defined.

A composite strategy incorporates the event into the outcome itself. For example, define success as achieving a prespecified symptom response and not discontinuing assigned treatment by week 24. The target is then a contrast in the probability of this joint success, not a contrast in mean symptom improvement alone.

Definition: Under a composite strategy, the outcome is redefined to include the event. In this example, \(S(a)=1\) only when a participant meets the specified symptom-response criterion and does not discontinue assigned treatment; otherwise \(S(a)=0\). A natural summary is \(P(S(1)=1)-P(S(0)=1)\).

A while-on-treatment strategy uses outcome information while participants are receiving assigned treatment and defines the target in relation to that period. To make the summary explicit, one could average improvement over each participant’s time on assigned treatment, ending at discontinuation or week 24. This is not the same as a week-24 outcome: participants may contribute over different durations, and an outcome summary must specify how those durations are handled.

A principal-stratum strategy targets a subgroup defined by potential event status under both assignments. In this example, the “always non-discontinuers” are participants who would not discontinue under either treatment. Membership depends on the pair \((D(1),D(0))\), although only one of those event statuses is observed per randomized participant.

Definition: The principal-stratum contrast among always non-discontinuers is \(E[Y(1)-Y(0)\mid D(1)=0,\ D(0)=0]\). It compares treatment outcomes in a subgroup defined by potential event status under both assignments, rather than simply selecting participants who happened not to discontinue.

Worked Examples

Worked Example: Treatment-Policy Contrast

In a hypothetical randomized trial, 100 participants are assigned to each treatment. The mean observed week-24 improvement, including measurements after discontinuation, is 5.2 points in the new-therapy group and 3.7 points in the control group. Assume the endpoint is measured for all participants and the randomized groups represent the intended target population.

The treatment-policy estimate is the difference in the two group means:

$$ \widehat{\Delta}_{\text{TP}}=\bar{Y}_{1}-\bar{Y}_{0} =5.2-3.7=1.5\text{ points}. $$

In this hypothetical trial, assignment to the new-therapy treatment condition is associated with 1.5 points greater mean week-24 improvement than assignment to control, including the consequences of discontinuation and subsequent care. This estimate does not isolate the effect of taking treatment continuously. Randomization supports a treatment-policy comparison when treatment conditions are implemented as defined and outcomes are ascertained; it does not make missing week-24 outcomes observed.

Worked Example: Hypothetical Contrast

Suppose, for illustration, that a clearly specified hypothetical scenario preventing discontinuation would yield mean week-24 improvements of 6.4 points under the new therapy and 4.1 points under control. These are stipulated hypothetical means, not quantities calculated from the observed post-discontinuation outcomes.

The hypothetical contrast is:

$$ \widehat{\Delta}_{\text{hyp}}=6.4-4.1=2.3\text{ points}. $$

The 2.3-point contrast describes the specified no-discontinuation scenario. It need not equal the 1.5-point treatment-policy contrast because preventing discontinuation changes the target outcomes. In an actual trial, these means are not directly observed for participants who discontinue. Estimating them requires assumptions and data that support the hypothetical scenario; randomization by itself does not identify the outcomes that would have occurred had discontinuation been prevented.

Worked Example: Composite Success

In a hypothetical trial with 100 participants per group, 58 participants assigned to the new therapy both achieve the prespecified symptom response and avoid discontinuation. The corresponding number under control is 43. The composite success proportions are \(58/100=0.58\) and \(43/100=0.43\).

The risk difference is:

$$ \widehat{\Delta}_{\text{comp}}=0.58-0.43=0.15. $$

The new-therapy group has a 15-percentage-point higher observed proportion meeting the joint success definition in this hypothetical trial. This does not mean symptom improvement alone is 15 percentage points better: the endpoint requires both response and no discontinuation. The response threshold and event rule must be clinically justified because they determine which participants count as successes.

Worked Example: A While-on-Treatment Summary

Consider a hypothetical participant whose symptom improvement is 2, 4, and 6 points at weeks 4, 8, and 12, respectively, before discontinuing. Using the mean of these three scheduled on-treatment measurements as a simple illustration, the participant’s summary is:

$$ \frac{2+4+6}{3}=4.0\text{ points}. $$

A participant remaining on treatment through week 24 could contribute a different number of measurements and a different time interval. Suppose a hypothetical analysis averages each participant’s on-treatment summary within assignment group and obtains 4.2 points for the new therapy and 3.6 points for control. The contrast is \(4.2-3.6=0.6\) points for the specified summary. It is not a week-24 mean treatment effect: it summarizes outcomes during potentially different periods, and its interpretation depends on the precise measurement and averaging rule.

Why Conditioning on the Event Changes the Question

The treatment-policy mean can be decomposed by event status within each treatment condition. For assignment \(a\), the law of total expectation gives:

$$ E[Y(a)] =P(D(a)=0)E[Y(a)\mid D(a)=0] +P(D(a)=1)E[Y(a)\mid D(a)=1]. $$

The treatment-policy target includes both event groups, weighted by their proportions under that assignment. By contrast, comparing only participants who did not discontinue in each randomized group compares \(E[Y(1)\mid D(1)=0]\) with \(E[Y(0)\mid D(0)=0]\). These are different groups: discontinuation may be affected by treatment and by prognosis. Conditioning on the post-randomization event can therefore break the balance created by randomization. It does not, by itself, estimate either the treatment-policy effect or the principal-stratum effect.

The principal stratum avoids defining its target by observed event status in one arm, but it creates a different challenge: both potential event statuses are needed to determine membership, and each participant reveals only one. The hypothetical strategy also refers to unobserved outcomes under a scenario that did not occur. Neither strategy becomes identified merely by naming it.

Assumptions, Diagnostics, and Choice

A clear estimand begins with well-defined treatment conditions, population, outcome, event, and summary. Consistency requires that the outcomes represented by each treatment condition match the treatment actually assigned and received as specified. For a randomized treatment-policy comparison with complete outcome ascertainment, randomization supports comparison of the assignment groups in the target population. If outcomes are missing, assumptions about their distribution and missingness are also needed.

Additional assumptions depend on the strategy. A hypothetical estimand requires a clinically coherent no-event scenario and assumptions adequate to learn its outcomes from observed data. A composite estimand requires a prespecified rule for combining the event and clinical outcome. A while-on-treatment estimand requires a defined treatment exposure period and outcome summary; event-related truncation can make the available outcomes differ systematically across participants. A principal-stratum estimand requires a scientifically useful stratum and assumptions or design information sufficient for identification; the stratum is not directly observed.

Diagnostics should first check whether the event and outcome are defined and recorded as intended: inspect event frequencies by randomized group, event timing, post-event outcome availability, and reasons for discontinuation. Large differences in event rates can make the choice of strategy especially consequential. For hypothetical and principal-stratum analyses, also examine whether conclusions depend strongly on assumptions that cannot be checked from observed data alone. A precise numerical result does not resolve a poorly defined or weakly supported target.

StrategyTarget in this exampleKey interpretive caution
Treatment-policyMean week-24 improvement regardless of discontinuationIncludes consequences of discontinuation and subsequent care
HypotheticalMean improvement if discontinuation were prevented under a specified scenarioScenario and unobserved outcomes require justification and assumptions
CompositeProbability of response without discontinuationBoth the response threshold and event rule define success
While-on-treatmentSpecified symptom summary during assigned treatmentExposure periods may differ; state the time and averaging rule
Principal-stratumTreatment contrast among those who would not discontinue under either assignmentStratum membership depends on two potential event statuses

In an adaptive trial, changing allocation or making another planned adaptation does not automatically change the estimand. But the target is preserved only if the treatment conditions, population, outcome, event strategy, and summary continue to mean what the estimand specifies. A change that alters who is studied, what treatment is assigned, or what is counted after an event may change the question unless the estimand is explicitly maintained.

Common Mistake

Wrong reasoning: “The participants who did not discontinue are the ones who stayed on treatment, so comparing them gives the randomized treatment effect among people who can tolerate treatment.” The observed event-free groups need not be comparable: treatment assignment can affect discontinuation, and underlying prognosis can affect both discontinuation and outcome. The comparison conditions on a post-randomization variable.

Correction: State the intended target first. Use all randomized participants and outcomes regardless of event for a treatment-policy question; define a no-event scenario for a hypothetical question; incorporate the event explicitly in a composite; specify the time-dependent outcome for a while-on-treatment question; or define the principal stratum using potential event status under both assignments. Do not treat these targets as interchangeable.

Key takeaway: The event strategy determines what treatment effect is being targeted. Choose and define it from the clinical question before interpreting an estimate; randomization alone does not make the five strategies answer the same question.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A trial measures week-24 outcome after treatment discontinuation and includes it in the randomized-group comparison. Which strategy is being used?
  2. Why does comparing only observed non-discontinuers generally not estimate the treatment-policy effect?
  3. A composite endpoint defines success as symptom response without discontinuation. What does a risk difference in this endpoint measure?
  4. What additional conceptual information is required to define a hypothetical estimand for “no discontinuation”?
  5. Why is the principal stratum of participants who would not discontinue under either treatment not directly observed?

Solutions: (1) Treatment-policy, because outcomes are considered regardless of discontinuation. (2) Discontinuation occurs after randomization and may depend on assigned treatment and prognosis, so the two observed event-free groups may differ. (3) It measures the difference in probabilities of meeting the joint response-and-no-discontinuation definition, not a mean symptom improvement difference. (4) A coherent, sufficiently precise scenario specifying how discontinuation is prevented and what care continues. (5) Each participant reveals event status under only the assigned treatment, not under both potential assignments.

Clinical Biostats