Tutorials › Pattern-Mixture and Selection Models › Identification of Hypothetical Estimands

The Estimand Framework and Intercurrent Events · Tutorial 398 of 499

Identification of Hypothetical Estimands

You will learn to express a hypothetical treatment contrast with counterfactual outcomes and determine when observed event-free data identify it.

Intermediate 12 min read

What You'll Learn

  • Define the counterfactual outcome for treatment assignment under an intervention that prevents an intercurrent event.
  • Distinguish a hypothetical estimand from an observed event-free comparison and a treatment-policy estimand.
  • State the assumptions needed to identify each treatment-specific mean.
  • Derive the standardization and inverse-probability representations of the hypothetical mean.
  • Diagnose failures of positivity and understand what observed data cannot identify.

What a Hypothetical Estimand Asks

Suppose a trial compares two treatments, but some participants discontinue assigned treatment, take rescue medication, or switch to another therapy. A hypothetical estimand asks about outcomes under a specified scenario in which an intercurrent event is prevented. It is not simply a comparison among participants who happened not to experience the event. The target includes the defined population, with each treatment considered under the same hypothetical event-prevention strategy.

Let \(A\) denote assigned treatment, with values \(0\) and \(1\). Let \(L\) denote measured baseline covariates, \(E\) indicate whether the intercurrent event occurs during the relevant period, and \(Y\) denote the outcome at the target time. Write \(Y^{a,g_0}\) for the outcome that would be observed if treatment were set to \(a\) and the event-prevention intervention \(g_0\) were applied. The intervention must be specified in words: for example, “rescue medication is not initiated through week 12.” The notation does not, by itself, say how such prevention would be achieved.

Definition: For a specified target population, a hypothetical treatment contrast on the mean-difference scale is \(\psi_1-\psi_0\), where \(\psi_a=E[Y^{a,g_0}]\). Each \(\psi_a\) is the population mean outcome under treatment \(a\) and the stated event-prevention intervention. The contrast is meaningful only when the outcome and intervention are sufficiently well-defined for the population.

This definition separates the estimand—the counterfactual quantity of interest—from an estimator calculated using observed data. It also clarifies that “prevent the event” is part of the question, not a statistical trick. If preventing the event would change other care or behavior, the hypothetical intervention needs enough detail to make its consequences interpretable.

Assumptions That Connect the Target to Observed Data

The observed data contain outcomes under the treatment and event histories that actually occurred, not every participant’s \(Y^{a,g_0}\). A standard identification argument uses baseline covariates \(L\) to connect the hypothetical means to observed outcomes among participants with \(E=0\). The assumptions below are substantive; randomization alone does not establish all of them.

  • Well-defined interventions and consistency. Treatment levels and \(g_0\) must describe sufficiently clear interventions. For a participant with \(A=a\) and \(E=0\), the observed outcome equals the counterfactual outcome under the corresponding treatment and event-prevention strategy: \(Y=Y^{a,g_0}\). This consistency statement assumes that the observed event-free history represents the relevant intervention history; it is not a claim that every way of preventing the event has identical effects.
  • Treatment exchangeability. Conditional on \(L\), treatment assignment carries no additional information about \(Y^{a,g_0}\): \(Y^{a,g_0}\mathrel{\perp\!\!\!\perp} A\mid L\). In a randomized trial this can follow from the randomization scheme, with appropriate attention to the variables used in randomization. In an observational study it is a no-unmeasured-confounding assumption.
  • Event exchangeability. Among people with treatment \(a\) and covariates \(L\), event occurrence carries no additional information about the outcome under \(g_0\): \(Y^{a,g_0}\mathrel{\perp\!\!\!\perp} E\mid A=a,L\). This assumption rules out residual differences in the hypothetical outcome between observed event-free and event-experiencing participants after conditioning on \(L\). It is often strong and cannot be verified from the observed data alone.
  • Positivity. Each treatment must be possible at covariate values represented in the target population, and the event-free state must have positive probability in each treatment-covariate group used for identification: \(P(A=a\mid L=l)>0\) and \(P(E=0\mid A=a,L=l)>0\) for relevant \(l\).

The event-exchangeability condition is specific to the hypothetical question. If event occurrence is associated with prognosis even after conditioning on \(L\), then observed event-free outcomes may not represent what event-experiencing participants would have experienced had the event been prevented. Randomization of \(A\) does not randomize \(E\).

Identification by Standardization

Under these assumptions, the treatment-specific mean can be identified by averaging the observed conditional mean among event-free participants over the baseline covariate distribution of the target population:

$$ \psi_a = E[Y^{a,g_0}] = \int E[Y\mid A=a,E=0,L=l]\,dF_L(l). $$

Here \(F_L\) is the distribution of \(L\) in the target population. The formula says to estimate the mean outcome for treatment \(a\) among event-free participants within each covariate pattern, then average those means using the target population’s covariate distribution. It does not average using the covariate distribution among observed event-free participants, which may differ across treatment groups.

A short derivation makes the role of the assumptions explicit. First, average the counterfactual mean over \(L\). Treatment exchangeability lets us replace the treatment counterfactual mean at \(L=l\) with the corresponding mean among those assigned \(a\). Event exchangeability then lets us restrict that conditional mean to \(E=0\); consistency equates that observed event-free outcome with \(Y^{a,g_0}\):

$$ \begin{aligned} E[Y^{a,g_0}] &= \int E[Y^{a,g_0}\mid L=l]\,dF_L(l)\\ &= \int E[Y^{a,g_0}\mid A=a,L=l]\,dF_L(l)\\ &= \int E[Y^{a,g_0}\mid A=a,E=0,L=l]\,dF_L(l)\\ &= \int E[Y\mid A=a,E=0,L=l]\,dF_L(l). \end{aligned} $$

The equalities require the stated exchangeability and consistency conditions, as well as positivity so the observed conditional means exist for the relevant covariate values. In practice, standardization may be implemented by estimating the conditional mean model and predicting under \(A=a,E=0\) for each target-population participant, then averaging those predictions.

Worked Example: Standardizing Across Baseline Risk Groups

Consider a hypothetical trial with two baseline groups, lower risk and higher risk. In the target population, 60% are lower risk and 40% higher risk. Suppose the observed event-free mean outcome, in points, is 8 for treatment 1 in the lower-risk group and 6 in the higher-risk group; for treatment 0 the corresponding means are 5 and 4. Assume both treatments and event-free outcomes have positive probability in both groups. Also assume the interventions are well-defined, consistency holds, and treatment and event exchangeability hold conditional on risk group.

The standardized mean under treatment 1 is

$$ \psi_1=(0.60)(8)+(0.40)(6)=4.80+2.40=7.20\text{ points}. $$

The standardized mean under treatment 0 is

$$ \psi_0=(0.60)(5)+(0.40)(4)=3.00+1.60=4.60\text{ points}. $$

Thus the hypothetical mean difference is \(7.20-4.60=2.60\) points. Under the assumptions, this estimates the difference in target-population mean outcomes if everyone received treatment 1 rather than treatment 0 and the event were prevented for everyone. It is not the observed difference between the two event-free groups, which could use different risk-group compositions.

Inverse-Probability Representation and Treatment Assignment

The same target mean has a weighted representation. Define the treatment propensity \(P(A=a\mid L)\) and the conditional event-free probability \(P(E=0\mid A=a,L)\). Under the identification assumptions and positivity,

$$ \psi_a = E\left[ \frac{I(A=a)I(E=0)Y} {P(A=a\mid L)P(E=0\mid A=a,L)} \right]. $$

The weights reweight observed participants who received treatment \(a\) and remained event-free to represent the target population under that treatment and event-prevention scenario. The treatment probability must be conditional on \(L\) unless treatment assignment is known to have a constant probability independent of \(L\). Randomization does not generally imply a constant assignment probability: probabilities can vary across randomization strata.

Worked Example: Why the Treatment Propensity Must Be Conditional

In a hypothetical population, half the participants have low baseline risk and half have high baseline risk. Treatment 1 is assigned with probability 0.90 in the low-risk group and 0.10 in the high-risk group. Suppose the event never occurs, so \(E=0\) for everyone, and the outcomes under treatment 1 with the event-prevention intervention are 0 points in the low-risk group and 10 points in the high-risk group. Assume treatment assignment is randomized within risk group, the outcomes are consistent, and both treatment probabilities are positive.

The target mean is \(0.50(0)+0.50(10)=5\) points. In the inverse-probability expression, each treatment-1 observation is weighted by its own group-specific assignment probability. Its expectation is

$$ \begin{aligned} E\left[\frac{I(A=1)Y}{P(A=1\mid L)}\right] &=0.50\left(\frac{0.90(0)}{0.90}\right) +0.50\left(\frac{0.10(10)}{0.10}\right)\\ &=0+5=5\text{ points}. \end{aligned} $$

The marginal treatment probability is \(P(A=1)=0.50\). Using it as the denominator instead would give \(E[I(A=1)Y]/0.50=\{0.50(0.90)(0)+0.50(0.10)(10)\}/0.50=1\) point, not the target mean of 5. The marginal weight fails because treatment assignment varies with a prognostic covariate. Conditional propensities, or an explicitly justified constant-probability design, are needed.

When the Observed Data Do Not Identify the Target

Positivity is not a technical detail that can be repaired by choosing a more elaborate estimator. If no one in a target-population subgroup is observed event-free under treatment \(a\), that subgroup’s mean under the hypothetical intervention is not learned from event-free outcomes. A model can extrapolate into the unsupported subgroup, but the resulting answer depends on untestable modeling assumptions.

Worked Example: A Missing Event-Free Group

Suppose a hypothetical target population has equal numbers in low- and high-risk groups. For treatment 1, the event-free mean is 7 points in the low-risk group, but every high-risk participant experiences the event. For treatment 0, the event-free means are 4 points in the low-risk group and 2 points in the high-risk group. Assume the treatment assignment probabilities are positive in every group, and assume the other identification conditions would hold if event-free observations existed.

The treatment-0 mean is identified as \(0.50(4)+0.50(2)=3\) points. For treatment 1, the observed data identify the low-risk contribution \(0.50(7)=3.5\), but not the high-risk contribution, because \(P(E=0\mid A=1,L=\text{high})=0\). If an analyst assumes the missing hypothetical high-risk mean is 6 points, the resulting treatment-1 mean is \(0.50(7)+0.50(6)=6.5\), giving a contrast of \(6.5-3=3.5\) points. If that unobserved mean is instead assumed to be 10 points, the treatment-1 mean is \(0.50(7)+0.50(10)=8.5\), giving a contrast of \(8.5-3=5.5\) points.

Neither contrast is identified by these observed data alone. The two calculations show how assumptions about an unsupported subgroup change the answer; they are not evidence that either assumed mean is correct.

Diagnostics, Alternatives, and Limits

Diagnostics cannot prove exchangeability, but they can reveal when an analysis is relying on fragile support or modeling choices. Before interpreting a hypothetical estimate, examine:

  • Event-free support: tabulate event-free counts across treatment and important baseline covariates. Empty or very small cells warn of positivity problems.
  • Estimated probabilities and weights: inspect treatment and event-free probabilities, the range of combined weights, and whether a few observations dominate. Extreme weights often signal limited overlap or unstable estimates.
  • Model dependence: compare reasonable conditional-mean specifications and check whether predictions for sparse covariate groups drive the result. Large changes indicate substantial extrapolation.
  • Assumption plausibility: consider whether measured \(L\) captures common causes of event occurrence and the hypothetical outcome. This is a scientific assessment, not a test settled by a good model fit.

The main alternatives answer different questions. A treatment-policy estimand includes outcomes regardless of the intercurrent event and therefore does not ask what would happen if the event were prevented. A comparison restricted to observed event-free participants conditions on a post-treatment event and generally compares selected groups; it is not automatically the hypothetical contrast. Standardization and inverse-probability weighting are alternative identification-based approaches to the same hypothetical target when their assumptions hold. Their finite-sample behavior and sensitivity to model specification can differ, but neither method removes the need for exchangeability and positivity.

The hypothetical estimand also has limits of interpretation. It does not describe the effect among only those people who would remain event-free under either treatment. Its target is the population outcome under the specified prevention intervention. If that intervention is implausible, poorly specified, or changes the clinical context in ways not captured by the question, the resulting contrast may have limited practical relevance. When the event is frequent or near-deterministic in important groups, identification may be weak even when the target is clearly stated.

  • Common mistake: “Treatment was randomized, so the event-free participants in each arm identify the hypothetical means.”
  • Correction: Randomization supports treatment exchangeability, but event occurrence is generally not randomized. Identification also requires event exchangeability conditional on measured covariates and positive event-free probability in relevant groups. A crude event-free comparison can additionally have different covariate distributions across arms.
Key takeaway: State the hypothetical intervention and counterfactual outcome first. Then identify the assumptions linking those outcomes to observed event-free data, use the target population’s covariate distribution, and check that every relevant treatment-covariate group has event-free support.

Check Your Understanding

Try each question, then compare your reasoning with the solutions below.

  1. In one sentence, distinguish a hypothetical estimand from a comparison restricted to observed event-free participants.
  2. Suppose the target population is 70% group A and 30% group B. For a treatment, the event-free means are 6 and 2 points. Calculate its standardized mean.
  3. Why is randomization of treatment insufficient to justify identifying a hypothetical mean from event-free outcomes?
  4. In a subgroup with positive treatment probability, no one is event-free under treatment 1. Can the treatment-1 hypothetical mean be identified from event-free observed outcomes in that subgroup? Explain.

Solutions. (1) A hypothetical estimand averages outcomes under a specified intervention that prevents the event across the target population; an observed event-free comparison averages outcomes among the selected participants who actually had no event. (2) The standardized mean is \(0.70(6)+0.30(2)=4.20+0.60=4.80\) points. (3) Treatment randomization addresses treatment assignment, not whether event-free participants represent the outcomes that would occur under event prevention; conditional event exchangeability and positivity are also needed. (4) No. The event-free probability is zero, so the relevant observed conditional mean is unavailable; a value requires additional extrapolation assumptions and is not identified by those data.

Clinical Biostats