Tutorials › Biostatistics › The ICH E9(R1) Estimand Framework Explained

Estimands & Missing Data

The ICH E9(R1) Estimand Framework Explained

A practical guide to the ICH E9(R1) estimand framework, including the five attributes of an estimand, intercurrent events, treatment strategies, estimands versus estimators, worked clinical trial examples, and how the framework changes statistical analysis planning.

Advanced 18 min read

What You'll Learn

  • What an estimand is and why ICH E9(R1) introduced a formal framework
  • The five attributes that define a clinical trial estimand
  • How intercurrent events differ from ordinary missing data
  • How treatment-policy, hypothetical, composite, while-on-treatment, and principal-stratum strategies work
  • Why an estimand is different from an estimator and an estimate
  • How to translate an estimand into a statistical analysis plan

Introduction

Clinical trials are often described as estimating a treatment effect, but the phrase "treatment effect" is much less precise than it sounds.

Consider a randomized trial comparing an experimental treatment with placebo. Suppose some participants discontinue treatment, some receive rescue medication, some die before the scheduled endpoint, and some remain on treatment through the final visit.

What exactly should the treatment effect represent?

Should it describe what would happen if everyone remained on their assigned treatment? Should patients who discontinue treatment still contribute their later outcomes? Should rescue medication be ignored? Should patients who discontinue because of lack of efficacy be considered treatment failures? Should the analysis estimate the effect of assignment to treatment or the effect of actually receiving treatment?

These are not merely statistical programming questions. They define the scientific question that the trial is intended to answer.

The ICH E9(R1) addendum introduced a structured framework for answering this problem through the concept of the estimand.

Key idea: An estimand is a precise description of the treatment effect that a clinical trial seeks to estimate. It specifies the population, treatment conditions, outcome variable, how intercurrent events are handled, and the population-level summary used to describe the treatment effect.

Why Was ICH E9(R1) Needed?

The original ICH E9 guideline established widely used principles for statistical analysis of clinical trials.

However, clinical trials became increasingly complex.

Patients may:

  • Discontinue study treatment.
  • Receive rescue medication.
  • Switch treatment.
  • Receive prohibited or additional therapy.
  • Die before the planned assessment.
  • Experience disease progression before the endpoint.
  • Become otherwise unable to provide the planned measurement.

These events can occur after randomization and before the outcome of interest is observed.

Historically, statistical analysis plans often described these situations as "missing data" and then specified an imputation or modeling method.

ICH E9(R1) encourages a different way of thinking: first define what treatment effect is scientifically relevant, including how important post-randomization events should affect that treatment effect; then select an appropriate estimator and analysis method.

The Core Problem: What Treatment Effect Do We Want?

Suppose a trial compares treatment \(A\) with treatment \(B\), and the outcome is a change from baseline at Week 24.

A simplistic statement might be:

$$ \text{Treatment effect} = E(Y_A)-E(Y_B) $$

But this expression leaves several important questions unanswered.

What population is being considered? What exactly is treatment \(A\)? What happens if a participant discontinues treatment? What happens if rescue medication is administered? What outcome is being measured? What summary of the outcome is being compared?

The estimand framework forces these questions to be answered explicitly.

What Is an Estimand?

An estimand is the target of estimation.

It is not the statistical model. It is not the p-value. It is not the treatment difference observed in the dataset. It is not the estimator.

Instead, the estimand describes the precise treatment effect that the study intends to quantify.

Think of the hierarchy this way: The estimand defines what question you want answered. The estimator is the statistical procedure used to estimate that quantity. The estimate is the numerical result obtained from the observed data.

The Five Attributes of an Estimand

ICH E9(R1) describes an estimand using five attributes:

Attribute Question It Answers
Treatment What treatment conditions are being compared?
Population In which patients is the treatment effect being evaluated?
Variable What outcome is being measured?
Intercurrent events How are events occurring after treatment initiation handled?
Population-level summary How is the treatment effect summarized across the population?

These five attributes work together.

Changing any one of them can change the estimand.

Important: Two analyses can use the same dataset, the same endpoint, and even the same statistical model while targeting different estimands if they make different assumptions about intercurrent events or define the treatment conditions differently.

Attribute 1: Treatment

The first attribute specifies the treatment conditions to be compared.

In a randomized parallel-group trial this might be:

$$ A=\text{experimental treatment} $$

versus:

$$ B=\text{placebo} $$

But the treatment attribute can be more specific.

For example, it may specify:

  • Assigned treatment
  • A particular dose
  • A dosing regimen
  • A treatment strategy involving permitted concomitant therapy
  • Treatment assignment regardless of adherence

The important point is that "treatment" in an estimand is a well-defined treatment condition rather than merely the name of a treatment arm.

Attribute 2: Population

The second attribute identifies the population for which the treatment effect is relevant.

For example:

  • All randomized patients
  • All randomized patients satisfying eligibility criteria
  • Patients with a specific disease severity
  • Patients with a particular biomarker status
  • A prespecified subgroup

In a randomized trial, the target population should be distinguished from a particular analysis population used for computational convenience.

Do not confuse the estimand population with an analysis-set label. "Full analysis set," "intent-to-treat population," and "per-protocol population" are analysis concepts. The estimand should describe the scientific population of interest, while the analysis strategy should explain how that population is represented in the data.

Attribute 3: Variable

The third attribute identifies the outcome variable.

Examples include:

  • Change from baseline in systolic blood pressure at Week 12
  • HbA1c at Week 24
  • Time to cardiovascular death
  • Overall survival
  • Objective response by Week 24
  • Number of exacerbations during follow-up
  • Patient-reported quality-of-life score

The variable should be defined precisely enough that the target outcome is unambiguous.

For example, "clinical response" may be too vague. A stronger definition might specify the response criteria, assessment window, and relevant assessment rules.

Attribute 4: Intercurrent Events

This is one of the most important concepts in ICH E9(R1).

An intercurrent event is an event occurring after treatment initiation that affects either the interpretation or the existence of the measurement associated with the clinical question of interest.

Examples include:

  • Permanent discontinuation of study treatment
  • Initiation of rescue medication
  • Treatment switching
  • Use of prohibited medication
  • Dose modification
  • Death before the planned outcome assessment
  • Other events that prevent or modify the planned outcome

The critical question is not simply: "How do we impute the missing value?"

The first question is: "What treatment effect should this event contribute to?"

Intercurrent Event vs. Missing Data

These concepts are related but are not interchangeable.

Suppose a participant stops treatment at Week 12 and therefore has no Week 24 measurement.

The treatment discontinuation is an intercurrent event. The absence of the Week 24 measurement is a missing-data issue.

The estimand framework asks how the treatment discontinuation should affect the scientific treatment effect. Only after that question has been addressed does the statistical analysis need to deal with any resulting missing observations.

Key distinction: An intercurrent event is a clinical event or post-randomization occurrence. Missing data are an information problem. An intercurrent event may cause missing data, but the two concepts should not be treated as synonyms.

Attribute 5: Population-Level Summary

The fifth attribute describes how the treatment effect is summarized at the population level.

Examples include:

  • Difference in means
  • Ratio of means
  • Risk difference
  • Risk ratio
  • Odds ratio
  • Hazard ratio
  • Difference in survival probabilities at a fixed time
  • Difference in median time to event

For a continuous endpoint, an estimand might use:

$$ \Delta = E(Y_A)-E(Y_B) $$

For a binary endpoint, it might use a risk difference:

$$ \Delta = P(Y_A=1)-P(Y_B=1) $$

The population-level summary completes the definition of the treatment effect.

The Five Attributes Together

A complete estimand can therefore be thought of as a structured statement:

1
Treatment: Which treatment conditions are being compared?
2
Population: In which patients is the effect defined?
3
Variable: What outcome is of interest?
4
Intercurrent events: What treatment-related or post-randomization events occur, and how should they affect the treatment effect?
5
Population-level summary: How should the treatment effect be summarized?

The Five Intercurrent-Event Strategies

ICH E9(R1) describes several strategies for handling intercurrent events.

The principal strategies are:

Strategy Basic Question
Treatment policy What is the effect regardless of whether the intercurrent event occurs?
Hypothetical What would the outcome have been under a specified hypothetical condition?
Composite Is the intercurrent event incorporated into the definition of the outcome?
While on treatment What is the treatment effect while patients remain on treatment?
Principal stratum What is the treatment effect within a subgroup defined by potential response to the intercurrent event?

Strategy 1: Treatment Policy

Under a treatment-policy strategy, the occurrence of the intercurrent event does not change the treatment effect being targeted.

The question is essentially: What is the effect of being assigned to the treatment strategy, regardless of whether the intercurrent event occurs?

For example, suppose patients may discontinue study treatment. A treatment-policy estimand may ask:

Example: What is the difference in mean Week 24 HbA1c between patients randomized to drug A and placebo, regardless of treatment discontinuation or use of rescue medication?

Patients who discontinue treatment remain relevant to the treatment-assignment effect.

This strategy is closely aligned with an intention-to-treat interpretation of treatment assignment, although an estimand should not simply be labeled "ITT" without specifying its attributes.

Strategy 2: Hypothetical

A hypothetical strategy asks what would happen under a specified hypothetical scenario.

For example:

Example: What would the difference in Week 24 outcome be between treatment A and placebo if no patient had discontinued treatment before Week 24?

This is a different scientific question from treatment policy.

The treatment-policy question includes treatment discontinuation in the treatment effect. The hypothetical question imagines a world in which the specified intercurrent event does not occur.

Strategy 3: Composite

Under a composite strategy, the intercurrent event becomes part of the endpoint itself.

Suppose the primary endpoint is clinical success at Week 24, but death before Week 24 is clinically important. A composite endpoint might define:

$$ \text{Success} = \begin{cases} 1, & \text{clinical success without death before Week 24}\\ 0, & \text{otherwise} \end{cases} $$

Death is therefore not treated merely as missing data. It is incorporated directly into the outcome definition.

Why this matters: A composite strategy can prevent an important intercurrent event from disappearing from the analysis simply because the planned measurement was no longer obtained.

Strategy 4: While on Treatment

The while-on-treatment strategy focuses on outcomes observed while patients remain on the assigned treatment.

For example:

Example: What is the treatment difference in mean symptom score at Week 24 while patients remain on their assigned treatment and before initiation of rescue therapy?

This can be scientifically appropriate when the question is specifically about the pharmacologic or treatment effect during exposure.

However, it answers a narrower question than a treatment-policy estimand.

Strategy 5: Principal Stratum

The principal-stratum strategy defines the target population according to potential outcomes associated with the intercurrent event.

This is conceptually more difficult because the relevant subgroup may depend on potential outcomes that are not simultaneously observable.

For example, an investigator might want to compare treatment effects among patients who would remain free of rescue medication under either treatment condition.

That subgroup is defined using potential behavior under both treatment conditions.

Advanced concept: Principal-stratum estimands can be scientifically compelling but may require strong assumptions and specialized statistical methods because membership in the principal stratum is generally not directly observable for every patient.

Comparing the Intercurrent-Event Strategies

Strategy Interpretation Typical Question
Treatment policy Ignore the event as a modifier of the treatment-assignment question What is the effect regardless of discontinuation?
Hypothetical Imagine the event did not occur What would happen if rescue therapy were never used?
Composite Build the event into the endpoint What is the effect when death or another event counts as failure?
While on treatment Focus on outcomes during treatment exposure What is the effect while patients remain on therapy?
Principal stratum Restrict to a subgroup defined by potential event behavior What is the effect among patients who would avoid rescue under either treatment?

A Worked Example: HbA1c Trial

Consider a randomized Phase III diabetes trial comparing a new drug with placebo.

The primary endpoint is change from baseline in HbA1c at Week 24.

During the study:

  • Some patients discontinue assigned treatment.
  • Some patients receive rescue medication.
  • Some patients remain on assigned treatment throughout.
  • Some Week 24 measurements are unavailable.

A traditional SAP might simply state: "The primary analysis will use an MMRM under a missing-at-random assumption."

That describes an estimator and an assumption, but it does not fully describe the scientific question.

An estimand-first approach starts with the question.

Example A: Treatment-Policy Estimand

Suppose the scientific question is:

Question: Among all randomized eligible patients, what is the difference in mean change from baseline in HbA1c at Week 24 between drug A and placebo, regardless of treatment discontinuation or rescue medication use?

The five attributes can be described as:

Attribute Specification
Treatment Drug A vs placebo as randomized
Population All randomized eligible patients
Variable Change from baseline in HbA1c at Week 24
Intercurrent events Treatment policy for discontinuation and rescue medication
Population-level summary Difference in mean change

The resulting estimand can be represented as:

$$ \theta_{\mathrm{TP}} = E(Y_{24,A})-E(Y_{24,B}) $$

where the potential outcomes are interpreted according to the treatment-policy strategy.

Example B: Hypothetical Estimand

Now suppose the scientific question is:

Question: Among all randomized eligible patients, what would the Week 24 HbA1c treatment difference have been if patients had remained on assigned treatment and had not received rescue medication?

The treatment and population may remain unchanged. But the intercurrent-event strategy is different.

Attribute Treatment-Policy Version Hypothetical Version
Treatment Drug A vs placebo Drug A vs placebo
Population All randomized eligible patients All randomized eligible patients
Variable Week 24 HbA1c change Week 24 HbA1c change
Intercurrent event Included regardless of event Imagine no discontinuation/rescue
Summary Difference in means Difference in means

The two estimands therefore answer different scientific questions even though the endpoint and treatment comparison appear identical.

Example C: Composite Strategy

Suppose instead that receiving rescue medication is clinically considered treatment failure.

The endpoint could be redefined so that a patient who requires rescue therapy is classified as unsuccessful.

For example:

$$ Y= \begin{cases} 1, & \text{clinical success without rescue}\\ 0, & \text{rescue or clinical failure} \end{cases} $$

Now rescue medication is not something that must be removed through an imputation rule. It is part of the endpoint definition.

The Same Intercurrent Event Can Have Different Strategies

Consider treatment discontinuation.

The same event can be handled in several scientifically legitimate ways.

Strategy Interpretation of Discontinuation
Treatment policy Outcome after discontinuation remains relevant to the treatment-assignment effect
Hypothetical Estimate what would have happened had discontinuation not occurred
Composite Discontinuation may be incorporated into the endpoint if scientifically justified
While on treatment Focus on the outcome while treatment is maintained
Principal stratum Target patients according to potential discontinuation behavior

This is why saying simply "we handle discontinuations using MMRM" is not enough to define an estimand.

Estimand vs. Estimator vs. Estimate

These three terms are frequently confused.

Concept Meaning
Estimand The treatment effect being targeted
Estimator The statistical procedure used to estimate the estimand
Estimate The numerical result produced from the observed data

For example, suppose the estimand is the difference in mean Week 24 change under a treatment-policy strategy.

An estimator might be an MMRM-based model-adjusted difference in means.

The resulting estimate might be:

$$ \widehat{\theta}=-0.72 $$

The estimand is the target. The estimator is the method. The estimate is the number.

Critical distinction: Changing the statistical model does not necessarily change the estimand. Conversely, changing the estimand can require a fundamentally different estimation strategy.

The Estimand Is Not the Same as the Analysis Method

This distinction is one of the most important lessons of ICH E9(R1).

Consider two analyses:

  • MMRM
  • Multiple imputation followed by ANCOVA

These are statistical methods.

They do not by themselves define the scientific treatment effect.

For example, two multiple-imputation analyses can target different estimands depending on how post-discontinuation outcomes are conceptualized and modeled.

Therefore:

$$ \boxed{ \text{Estimand} \neq \text{Estimator} } $$

Why "Missing at Random" Is Not an Estimand

Missing at random, or MAR, is a statistical assumption about the missing-data mechanism.

It does not specify:

  • The treatment effect of interest
  • The population
  • The endpoint
  • The intercurrent-event strategy
  • The population-level summary

Therefore, MAR belongs to the estimation framework rather than serving as a replacement for an estimand.

Good SAP language: First specify the estimand and intercurrent-event strategy. Then state the estimator, missing-data assumptions, sensitivity analyses, and implementation details used to estimate that estimand.

Estimand and the Treatment-Policy Strategy

The treatment-policy strategy is especially important in randomized trials because it preserves the interpretation of treatment assignment.

Suppose:

  • 100 patients are randomized to drug A.
  • 100 patients are randomized to placebo.
  • 20 patients in the drug A group discontinue treatment.
  • 15 patients in the placebo group discontinue treatment.

A treatment-policy estimand does not redefine the treatment effect to apply only to patients who remain on treatment.

Instead, it asks about the effect of assignment to the treatment condition, with post-randomization events handled according to the specified strategy.

Estimand and Hypothetical Strategy

A hypothetical estimand is fundamentally counterfactual.

Suppose a patient receives rescue medication.

The hypothetical question may be:

$$ Y_A^{(\text{no rescue})} $$

What would the patient's outcome have been under treatment A in a world in which rescue medication did not occur?

This is not directly observed.

Consequently, hypothetical estimands often require stronger modeling assumptions than treatment-policy estimands.

Estimand and Composite Endpoints

Composite strategies can sometimes simplify the interpretation of clinically important events.

Suppose a cardiovascular trial measures time to cardiovascular death, but hospitalization is also clinically important.

A composite endpoint might define the outcome as time to:

  • Cardiovascular death, or
  • First cardiovascular hospitalization.

The hospitalization is then part of the endpoint rather than an event that must be handled separately after it occurs.

Estimand and While-on-Treatment Effects

A while-on-treatment estimand can be useful when the scientific question is specifically about the effect of treatment exposure.

For example:

Question: What is the treatment effect on symptom severity while patients remain on the assigned treatment and before treatment discontinuation?

This can be scientifically meaningful.

However, it should not be presented as though it were automatically the same as the treatment-policy effect.

Estimand and Principal Strata

Principal-stratum estimands are among the most conceptually challenging parts of the framework.

Suppose rescue medication is an intercurrent event. An investigator may want the treatment effect among patients who would not require rescue under either treatment.

Define the principal stratum:

$$ S= \left\{ Y_A^{R}=0,\, Y_B^{R}=0 \right\} $$

where \(Y_A^{R}\) and \(Y_B^{R}\) indicate potential rescue behavior under the two treatment conditions.

The target treatment effect might then be:

$$ E(Y_A-Y_B\mid S) $$

The difficulty is obvious: for an individual patient, we generally observe only one treatment condition, so both potential rescue outcomes cannot be directly observed.

Consequently, identification and estimation may require strong assumptions.

Intercurrent Events Are Not All the Same

A common mistake is to create one blanket rule for all post-randomization events.

Instead, different intercurrent events may require different strategies.

Intercurrent Event Possible Strategy
Permanent treatment discontinuation Treatment policy or hypothetical
Rescue medication Treatment policy, hypothetical, or composite
Death Composite, treatment policy, or another scientifically justified strategy
Treatment switching Treatment policy or hypothetical
Dose reduction Treatment policy or while-on-treatment

The correct choice depends on the clinical question.

There is no universally correct intercurrent-event strategy. The appropriate strategy is the one that best represents the treatment effect the trial is intended to answer.

A Complete Estimand Specification

Consider a Phase III trial evaluating an investigational treatment for rheumatoid arthritis.

The primary endpoint is change from baseline in a disease activity score at Week 24.

Suppose the treatment-policy estimand is:

Treatment: Investigational treatment versus placebo.

Population: All randomized patients meeting eligibility criteria.

Variable: Change from baseline in disease activity score at Week 24.

Intercurrent events: Treatment policy for treatment discontinuation and rescue medication; patients remain part of the treatment-assignment comparison.

Population-level summary: Difference in mean Week 24 change between treatment groups.

This is a substantially more informative specification than:

"The primary analysis will use MMRM."

From Estimand to Estimator

Once the estimand is defined, the statistical team selects an estimator.

For a continuous longitudinal endpoint, the estimator might use:

  • MMRM
  • ANCOVA
  • Multiple imputation followed by an analysis model
  • Other model-based approaches

The selected method must be appropriate for the estimand and the available data.

For example, an MMRM may estimate adjusted treatment differences at Week 24 using repeated observations over time.

PROC MIXED DATA=analysis;
  CLASS treatment visit subject;

  MODEL change =
    baseline
    treatment
    visit
    treatment*visit
    / DDFM=KR;

  REPEATED visit /
    SUBJECT=subject
    TYPE=UN;

  LSMEANS treatment*visit /
    DIFF CL;
RUN;

The model itself is not the estimand. It is an estimator used to obtain an estimate of the prespecified treatment effect.

Why the Same MMRM Can Support Different Questions

An MMRM can be used in analyses addressing different scientific questions, depending on how the data, intercurrent events, and assumptions are defined.

For example, one analysis may target a treatment-policy estimand. Another may be designed around a hypothetical estimand.

The difference lies in the scientific interpretation and assumptions, not simply in the name of the procedure.

Estimand and Missing Data

The estimand framework changes how missing data should be discussed.

Instead of starting with:

"We have 12% missing data. Which imputation method should we use?"

the analysis should start with:

"What treatment effect do we want to estimate when those post-randomization events occur?"

Then ask:

  • What outcomes are observed?
  • What outcomes are missing?
  • What assumptions are needed?
  • What estimator is appropriate?
  • How sensitive are conclusions to those assumptions?

Estimand and Multiple Imputation

Multiple imputation is an estimation tool. It is not itself an estimand strategy.

For example, multiple imputation may be used to estimate a treatment-policy estimand if the imputation model is constructed to represent the intended post-intercurrent-event outcome distribution.

Likewise, reference-based multiple imputation can be used to construct certain hypothetical or other sensitivity scenarios.

The important question is not: "Are we using multiple imputation?"

The important question is: "What treatment effect does the imputation procedure attempt to estimate?"

Estimand and Sensitivity Analysis

ICH E9(R1) strongly reinforces the importance of examining the robustness of the primary conclusion.

A useful sensitivity-analysis program may consider:

  • Alternative assumptions about missing outcomes
  • Alternative handling of intercurrent events
  • Alternative estimators
  • Alternative covariance structures
  • Reference-based assumptions
  • Pattern-mixture models
  • Selection models
  • Tipping-point analyses

These analyses should be connected to clinically meaningful departures from the primary assumptions.

Estimand vs. Sensitivity Estimand

Not every sensitivity analysis needs to target exactly the same estimand.

An analysis can instead address a related but scientifically informative question.

For example:

Analysis Potential Target
Primary analysis Treatment-policy estimand
Hypothetical sensitivity analysis Effect if rescue therapy had not occurred
While-on-treatment analysis Effect during treatment exposure
Composite analysis Effect when rescue is classified as failure

This makes the sensitivity program much more interpretable than simply listing a collection of alternative statistical methods.

Estimand vs. Intercurrent Event Strategy

The intercurrent-event strategy is not a fifth statistical model. It is one of the five attributes defining the estimand.

This means that changing the strategy can change the target parameter.

For example:

$$ \theta_{\mathrm{TP}} \neq \theta_{\mathrm{Hyp}} $$

where:

  • \(\theta_{\mathrm{TP}}\) is a treatment-policy estimand.
  • \(\theta_{\mathrm{Hyp}}\) is a hypothetical estimand.

They can use the same randomized treatment groups and the same nominal endpoint while answering different questions.

Worked Example: Rescue Medication

Suppose a Phase III trial evaluates pain reduction. The primary outcome is change in pain score at Week 12.

Patients may receive rescue analgesic medication.

There are at least three scientifically different questions.

Question 1: Treatment Policy

What is the treatment difference in Week 12 pain score regardless of whether patients use rescue medication?

This estimates the effect of treatment assignment in the presence of rescue therapy as it occurs in the trial.

Question 2: Hypothetical

What would the treatment difference have been if rescue medication had never been used?

This asks a counterfactual question.

Question 3: Composite

What is the treatment effect when patients requiring rescue medication are classified as treatment failures?

This changes the outcome definition.

All three questions can be scientifically legitimate. They are simply different estimands.

The Estimand Framework and Randomization

Randomization is fundamental to causal interpretation.

However, randomization does not automatically answer every post-randomization question.

Randomization provides a strong basis for comparing treatment groups under the randomized treatment conditions.

But once the question involves hypothetical post-randomization scenarios or principal strata, additional assumptions may be required.

Important: Randomization protects the treatment comparison, but it does not make every possible counterfactual estimand automatically identifiable.

Estimand and the Primary Objective

A well-written clinical trial objective should correspond closely to the primary estimand.

For example:

Weak objective: "To compare the efficacy of treatment A and placebo at Week 24."

This does not specify how treatment discontinuation or rescue medication affects the treatment effect.

Stronger objective: "To estimate the difference between treatment A and placebo in mean change from baseline in HbA1c at Week 24 among all randomized eligible patients, regardless of treatment discontinuation or rescue medication use."

The second statement is much closer to an estimand specification.

Estimands in the Protocol

The protocol should identify the treatment effect of interest before the statistical analysis is finalized.

A useful protocol section should describe:

  • Primary estimand
  • Key secondary estimands
  • Treatment conditions
  • Target population
  • Primary outcome variable
  • Important intercurrent events
  • Strategy for each important intercurrent event
  • Population-level summary

The statistical analysis plan can then describe how the estimand will be estimated.

Estimands in the Statistical Analysis Plan

A practical SAP structure is:

1
Define the scientific objective.
2
Specify the five attributes of the estimand.
3
Identify important intercurrent events.
4
Specify the strategy for each intercurrent event.
5
Select an appropriate estimator.
6
State assumptions required for estimation.
7
Specify sensitivity analyses.
8
Document how the estimate and uncertainty will be reported.

A Practical Estimand Table

A table like the following can make the estimand framework much easier to implement operationally.

Attribute Primary Estimand
Treatment Investigational treatment vs placebo
Population All randomized eligible patients
Variable Change from baseline in primary endpoint at Week 24
Discontinuation Treatment policy
Rescue medication Treatment policy
Death before assessment Prespecified composite strategy
Population-level summary Difference in means

One Trial Can Have Multiple Estimands

A modern clinical trial does not need to have only one estimand.

For example, a trial might define:

  • One primary estimand
  • Several key secondary estimands
  • Additional estimands for clinically important treatment questions

For example:

Estimand Clinical Question
Primary Effect regardless of treatment discontinuation
Secondary 1 Effect if no rescue medication were used
Secondary 2 Effect while remaining on treatment
Secondary 3 Effect using a composite success/failure endpoint

This can provide a much richer description of treatment benefit than a single analysis.

Estimand vs. Per-Protocol Analysis

The estimand framework should not be reduced to a debate between "intention-to-treat" and "per-protocol."

Those terms describe analysis populations and strategies, whereas the estimand framework asks a more fundamental question: What causal treatment effect do we want?

A hypothetical or while-on-treatment estimand may resemble the scientific motivation behind a per-protocol analysis, but the concepts are not identical.

The estimand should be explicitly defined rather than inferred from an analysis-set label.

Estimand vs. As-Treated Analysis

Similarly, an as-treated analysis is not automatically an estimand.

An as-treated analysis changes how treatment exposure is represented in the analysis.

But that does not by itself specify:

  • The target population
  • The outcome
  • The handling of intercurrent events
  • The summary measure

The estimand framework therefore provides a more precise language.

Estimands and Time-to-Event Endpoints

The estimand framework applies to survival and time-to-event endpoints as well as continuous and binary endpoints.

Suppose the endpoint is overall survival.

The variable might be:

$$ T=\text{time from randomization to death} $$

The population-level summary could be:

  • Hazard ratio
  • Difference in survival probability at Month 12
  • Restricted mean survival time difference

These are different population-level summaries and therefore can correspond to different estimands.

Hazard Ratio Is Not the Only Possible Summary

Suppose:

$$ S_A(t) $$ and:

$$ S_B(t) $$

are the survival functions under treatments A and B.

A fixed-time survival difference might be:

$$ \Delta(t) = S_A(t)-S_B(t) $$

Alternatively, a restricted mean survival time difference over \([0,\tau]\) could be:

$$ \Delta_{\mathrm{RMST}} = \int_0^\tau \left[ S_A(t)-S_B(t) \right]dt $$

These summaries answer different questions.

Estimand lesson: Even when treatment, population, endpoint, and intercurrent-event handling are unchanged, changing the population-level summary can change the estimand.

Estimands for Binary Endpoints

Suppose the endpoint is response by Week 24. Let:

$$ p_A=P(Y_A=1) $$ and:

$$ p_B=P(Y_B=1) $$

Possible population-level summaries include:

$$ RD=p_A-p_B $$

or:

$$ RR=\frac{p_A}{p_B} $$

or:

$$ OR= \frac{p_A/(1-p_A)} {p_B/(1-p_B)} $$

These are not interchangeable descriptions of the same estimand.

Estimands for Continuous Endpoints

For a continuous endpoint:

$$ Y_A \qquad\text{and}\qquad Y_B $$

the treatment effect might be:

$$ \Delta=E(Y_A)-E(Y_B) $$

Alternatively, it could be expressed as a ratio:

$$ R=\frac{E(Y_A)}{E(Y_B)} $$

Again, the population-level summary must be specified explicitly.

Estimands and Treatment Switching

Treatment switching is a particularly important intercurrent event in oncology and other therapeutic areas.

Suppose patients randomized to placebo may later switch to active treatment.

A treatment-policy estimand might ask:

What is the effect of initial randomization regardless of subsequent switching?

A hypothetical estimand might instead ask:

What would the treatment difference have been if treatment switching had not occurred?

These are different causal questions.

Therefore, treatment-switching methodology should be selected only after the target estimand has been established.

Estimands and Death

Death is a particularly important intercurrent event because it can make some outcomes undefined.

For example, suppose the endpoint is physical-function score at Week 24. A patient who dies at Week 16 cannot have a Week 24 physical-function score in the ordinary sense.

Possible strategies include:

  • Composite strategy, treating death as an outcome event.
  • Hypothetical strategy, asking what the score would have been had death not occurred.
  • Other clinically justified strategies.

The choice should be driven by the scientific question rather than by which method is easiest to program.

Important: When an intercurrent event makes the endpoint conceptually undefined, simple missing-data terminology may obscure the actual scientific problem.

Estimands and COVID-Era Treatment Disruptions

The estimand framework became particularly relevant when external events affected clinical trial conduct.

For example:

  • Site closures
  • Interrupted treatment administration
  • Delayed assessments
  • Changes in standard of care
  • Temporary treatment interruptions

The key question remains: Does the event change the treatment effect being targeted, or does it primarily create missing or delayed observations?

The answer determines the appropriate estimand and analysis strategy.

Estimand-First Statistical Planning

A useful workflow is to reverse the traditional order of statistical planning.

Instead of:

1
Choose a statistical model.
2
Determine how to handle missing data.
3
Write the treatment-effect interpretation.

Use an estimand-first workflow:

1
Define the clinical question.
2
Define the estimand.
3
Identify intercurrent events.
4
Select an intercurrent-event strategy for each relevant event.
5
Choose an estimator consistent with the estimand.
6
Specify assumptions.
7
Develop sensitivity analyses.

Sample Size and the Estimand

The estimand can also influence sample-size planning.

Sample-size calculations depend on the parameter being tested and the assumed data-generating process.

If the primary estimand changes from a treatment-policy effect to a hypothetical effect, the assumptions needed for estimation may change.

This can affect:

  • Variance assumptions
  • Event rates
  • Missing-data assumptions
  • Expected treatment differences
  • Power
  • Simulation requirements

Therefore, the estimand should be established before finalizing the statistical design assumptions.

Estimand and Multiplicity

If multiple estimands are treated as formal confirmatory objectives, the multiplicity strategy may need to be considered.

For example, a trial may have:

  • A primary treatment-policy estimand
  • A key secondary hypothetical estimand
  • A key secondary composite estimand

Whether these are part of the formal confirmatory testing hierarchy depends on the trial's objectives and regulatory strategy.

The key point is that multiple estimands should be clearly distinguished from multiple statistical methods applied to the same estimand.

Common Estimand Mistakes

  1. Defining the estimator before defining the estimand. Writing "MMRM will be the primary analysis" without first describing the treatment effect leaves the scientific question underspecified.
  2. Calling every post-baseline event missing data. Treatment discontinuation, rescue therapy, and death may be intercurrent events requiring explicit scientific strategies.
  3. Using "ITT" as a complete estimand definition. ITT does not specify all five estimand attributes.
  4. Assuming treatment policy is always the correct strategy. Different clinical questions may require hypothetical, composite, while-on-treatment, or principal-stratum approaches.
  5. Treating MAR as an estimand. MAR is an assumption about the missing-data mechanism, not a treatment effect.
  6. Assuming multiple imputation defines the estimand. Multiple imputation is an estimation technique.
  7. Ignoring the population-level summary. A risk difference, risk ratio, odds ratio, and hazard ratio are different summaries.
  8. Failing to distinguish treatment assignment from treatment exposure. A treatment-policy estimand can target the effect of assignment even when patients discontinue treatment.
  9. Using principal-stratum language without considering identifiability. Principal strata often involve unobservable joint potential outcomes.
  10. Changing the estimand after seeing the results. The target treatment effect should be prespecified rather than selected based on which analysis produces the most favorable result.

Estimand vs. Traditional SAP Language

Traditional Wording Estimand-Oriented Wording
"Primary analysis will use MMRM." First define the treatment effect, then specify MMRM as the estimator.
"Patients who discontinue will be considered missing." Specify the intercurrent-event strategy for treatment discontinuation.
"LOCF will handle missing data." Define the estimand and justify an estimation strategy consistent with it.
"ITT population." Explicitly define the target population attribute.
"Treatment effect." Specify treatment, population, variable, intercurrent-event strategy, and summary measure.

Estimand and the Role of the Statistician

The estimand framework does not make the statistician solely responsible for choosing the treatment effect.

Estimand development is inherently multidisciplinary.

It may involve:

  • Clinicians
  • Statisticians
  • Regulatory experts
  • Clinical pharmacologists
  • Patient representatives
  • Medical writers
  • Data scientists
  • Other subject-matter experts

The statistician's role is to translate the clinical question into a well-defined statistical target and ensure that the estimator and analysis strategy appropriately address it.

Estimand and the Clinical Question

A useful practical test is to ask:

"If I had a perfect oracle that could tell me the true treatment effect, what exactly would I ask it to tell me?"

The answer should describe:

  • Who is being studied
  • What treatments are being compared
  • What outcome is being considered
  • What happens under important post-randomization events
  • How the effect is summarized

That is essentially the estimand.

A Compact Estimand Template

A practical template for a protocol or SAP is:

Treatment:
    [Treatment A] versus [Treatment B]

Population:
    [Target population]

Variable:
    [Primary outcome and assessment time]

Intercurrent events:
    [Event 1] → [strategy]
    [Event 2] → [strategy]
    [Event 3] → [strategy]

Population-level summary:
    [Difference / ratio / hazard ratio / other summary]

This simple structure can make an otherwise ambiguous treatment-effect definition much more precise.

Worked Estimand Specification: Oncology

Consider a randomized oncology trial comparing an investigational therapy with standard treatment.

The primary endpoint is overall survival.

The estimand might be:

Treatment: Investigational therapy versus standard treatment.

Population: All randomized patients meeting eligibility criteria.

Variable: Time from randomization to death from any cause.

Intercurrent events: Subsequent anticancer therapy handled according to a treatment-policy strategy.

Population-level summary: Difference in survival probability at 12 months.

Notice that this is not simply: "overall survival analyzed using a Cox model."

The Cox model would be the estimator. The estimand is the scientific target.

Estimand and the Cox Model

Suppose the analysis uses:

PROC PHREG DATA=analysis;
  CLASS treatment;
  MODEL time*status(0) = treatment;
RUN;

The resulting hazard ratio is an estimate from a particular statistical model.

It does not automatically define the complete estimand.

The estimand must still specify:

  • Population
  • Treatment conditions
  • Survival endpoint
  • Intercurrent-event strategy
  • Population-level summary

Estimand and Data Collection

The estimand can influence what data should be collected.

If a treatment-policy estimand is important after treatment discontinuation, post-discontinuation outcome information may be valuable.

If a hypothetical estimand is primary, information about reasons for discontinuation and relevant covariates may become especially important for modeling the counterfactual outcome.

Thus:

$$ \text{Estimand} \rightarrow \text{Data requirements} \rightarrow \text{Estimator} \rightarrow \text{Sensitivity analyses} $$

Estimand planning should therefore occur early, not immediately before database lock.

Estimand and Trial Design

The estimand framework can influence trial design itself.

For example, if post-treatment outcomes are essential to a treatment-policy estimand, the protocol may need procedures for continued follow-up after treatment discontinuation.

This leads to an important principle: follow-up should not necessarily stop when treatment stops.

Whether continued follow-up is required depends on the estimand.

Estimand and Discontinuation

Suppose 15% of patients discontinue treatment before the primary assessment.

If the primary estimand is treatment policy, continued outcome collection may be essential to preserve information about the effect of randomized treatment assignment.

If the primary estimand is while-on-treatment, the same post-discontinuation measurements may be outside the primary target.

Thus, the same operational event can have very different consequences depending on the estimand.

Estimand and Trial Conduct

The estimand is not merely a statistical-analysis concept.

It can influence:

  • Protocol design
  • Patient follow-up
  • Rescue-treatment rules
  • Endpoint definitions
  • Data collection
  • Statistical analysis
  • Sensitivity analyses
  • Interpretation of results

This is why ICH E9(R1) represents a conceptual shift in clinical-trial planning rather than simply another missing-data methodology.

How to Read an Estimand Statement

When reviewing a clinical trial protocol, ask five questions:

1
Who? What population is the treatment effect about?
2
What treatment? What treatment conditions are being compared?
3
What outcome? What variable and assessment are being targeted?
4
What happens after treatment starts? How are intercurrent events handled?
5
How is the effect summarized? Difference, ratio, hazard ratio, RMST difference, or another measure?

A Five-Question Estimand Checklist

Question Estimand Attribute
Who are we studying? Population
What are we comparing? Treatment
What are we measuring? Variable
What happens if something occurs after treatment begins? Intercurrent-event strategy
How do we summarize the treatment effect? Population-level summary

Practical Workflow for Clinical Biostatisticians

1
Start with the clinical objective, not the statistical procedure.
2
List every clinically important intercurrent event.
3
Decide what each event means for the treatment question.
4
Construct the five attributes of the estimand.
5
Write the estimand in plain clinical language.
6
Translate the estimand into a mathematical target where appropriate.
7
Choose an estimator that can estimate the target under stated assumptions.
8
Develop sensitivity analyses that challenge important assumptions.
9
Ensure the protocol, SAP, TLFs, and clinical interpretation remain aligned.

Estimand-to-SAP Translation

Estimand Question SAP Component
What population? Analysis population and eligibility definition
What treatment? Treatment comparison and assignment definition
What variable? Endpoint derivation and assessment window
How are intercurrent events handled? Intercurrent-event and missing-data strategy
How is the effect summarized? Statistical model and treatment contrast
What assumptions are needed? Model assumptions and sensitivity analyses

The Most Important Concept

The central lesson of ICH E9(R1) is simple: a clinical trial cannot be interpreted correctly until the treatment effect being sought has been clearly defined.

The estimand framework makes that definition explicit.

A complete estimand identifies:

  • The treatment conditions being compared.
  • The population of interest.
  • The outcome variable.
  • How important intercurrent events are handled.
  • The population-level summary of the treatment effect.

Only after these elements are established should the statistician determine how to estimate the treatment effect.

Bottom line: ICH E9(R1) moves clinical-trial analysis from "Which statistical method should we use?" toward the more fundamental question: "What treatment effect do we actually want to know?" An estimand defines that target. Intercurrent-event strategies determine what the treatment effect means when important post-randomization events occur. The estimator is then chosen to estimate the prespecified target under stated assumptions. This distinction makes protocols, SAPs, sensitivity analyses, and clinical interpretation substantially more coherent.

References

International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use (ICH). (2019). ICH E9(R1): Addendum on Estimands and Sensitivity Analysis in Clinical Trials.
International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use (ICH). (1998). ICH E9: Statistical Principles for Clinical Trials.
ICH E9(R1) Expert Working Group. Addendum on Estimands and Sensitivity Analysis in Clinical Trials: Questions and Answers.
ICH E9(R1) Implementation Working Group. Estimands and Sensitivity Analysis in Clinical Trials: Supplemental Materials.
Akacha, M., Bretz, F., Ohlssen, D., Rosenkranz, G. & Schmidli, H. (2017). Estimands and their role in clinical trials. Pharmaceutical Statistics.
Mallinckrodt, C.H., Molenberghs, G., Lipkovich, I. & Ratitch, B. (2017). Estimands, estimators and estimates. Pharmaceutical Statistics.