Tutorials › Marginal Structural Models › Deriving Identification at a Single Decision Time

Sequential Exchangeability, Consistency and Positivity · Tutorial 43 of 501

Deriving Identification at a Single Decision Time

Learn how consistency and conditional exchangeability turn a counterfactual mean into an observed-data average over pre-treatment covariates.

Intermediate 9 min read

What You'll Learn

  • State the assumptions needed to identify a regime-specific mean at one treatment decision.
  • Derive the conditional observed-data mean from exchangeability and consistency.
  • Standardize conditional means over the population covariate distribution.
  • Calculate regime-specific means and contrasts from discrete and continuous examples.
  • Recognize how a missing treatment option within a covariate stratum prevents identification.

From Assumptions to an Observed-Data Mean

At a single decision time, the target is often the mean outcome that would occur if everyone received a specified treatment \(a\), written \(E[Y^a]\). The challenge is that each person receives only one treatment, so the counterfactual outcome \(Y^a\) is not generally observed for everyone. Identification means expressing this target using the distribution of variables that are observed.

Let \(L\) denote covariates measured before treatment \(A\), and let \(Y\) be the observed outcome. The covariates may be categorical, continuous, or mixed. For the derivation below, assume the treatment and outcome are well-defined, the counterfactual outcome is integrable, and the following conditions hold.

Assumptions: Consistency: if a person receives treatment \(A=a\), then \(Y=Y^a\). Conditional exchangeability: \(Y^a\) is independent of \(A\) given \(L\), written \(Y^a \perp A \mid L\). Support: for almost every covariate value \(l\) in the population, treatment \(a\) has positive probability given \(L=l\). The support condition ensures the observed data include information about treatment \(a\) at the covariate values over which the target population is averaged.

These assumptions serve different purposes. Exchangeability lets us use people who received \(a\) to learn about the counterfactual outcome under \(a\), within covariate levels. Consistency connects that counterfactual outcome to the outcome actually recorded. Support prevents the calculation from requiring an unobserved treatment-specific outcome in a covariate stratum where nobody received that treatment.

Deriving the Identification Formula

Theorem: Under consistency, conditional exchangeability, support for treatment \(a\), and \(E[|Y^a|]<\infty\), the regime-specific mean is identified by
$$ E[Y^a] = E_L\!\left[E[Y\mid A=a,L]\right]. $$
For discrete \(L\), this is \(\sum_l E[Y\mid A=a,L=l]P(L=l)\). For continuous \(L\), it is the integral of \(E[Y\mid A=a,L=l]\) with respect to the population distribution of \(L\).

The formula averages the treatment-specific conditional outcome mean over the covariate distribution in the target population. It does not average over the distribution of \(L\) among people who happened to receive treatment \(a\).

To prove the result, first condition the target mean on \(L\) and use the law of iterated expectation. For almost every \(l\), exchangeability gives the first equality below. Since support makes conditioning on \(A=a,L=l\) available, consistency gives the second.

$$ \begin{aligned} E[Y^a] &= E_L\!\left[E[Y^a\mid L]\right]\\ &= E_L\!\left[E[Y^a\mid A=a,L]\right]\\ &= E_L\!\left[E[Y\mid A=a,L]\right]. \end{aligned} $$

The middle equality follows from \(Y^a \perp A\mid L\): within each covariate level, learning that \(A=a\) does not change the conditional distribution, and hence does not change the conditional mean, of \(Y^a\). The last equality follows because \(Y=Y^a\) for people with \(A=a\). Integrability ensures these expectations exist. Thus the counterfactual mean is a functional of the observed-data distribution. \(\square\)

Worked Example: Standardizing Across Two Covariate Strata

Suppose \(L\) has two levels, with \(P(L=0)=0.6\) and \(P(L=1)=0.4\). The observed conditional outcome means are:

Covariate levelPopulation proportion\(E[Y\mid A=1,L]\)\(E[Y\mid A=0,L]\)
\(L=0\)0.6108
\(L=1\)0.464

Assuming the identification conditions hold, the mean under treatment \(1\) is the conditional mean in each stratum weighted by that stratum’s population proportion:

$$ E[Y^1] =0.6(10)+0.4(6) =6+2.4 =8.4. $$

For treatment \(0\), the corresponding calculation is

$$ E[Y^0] =0.6(8)+0.4(4) =4.8+1.6 =6.4. $$

The identified mean contrast is \(8.4-6.4=2.0\). Each standardized mean uses the same population weights, \(0.6\) and \(0.4\). Using treatment-specific weights instead would answer a different question because it would average over the covariate distribution of the group that received that treatment.

Why the Covariate Distribution Matters

The formula is a standardization: it computes a conditional mean for each covariate value under the treatment of interest, then averages those means over the target population’s covariate distribution. This distinction matters when treatment groups differ in their covariate composition. A comparison of the two observed treatment-group means can reflect both treatment and those compositional differences.

Worked Example: Crude and Standardized Comparisons Can Differ

Use the conditional means and population proportions in the preceding example. Suppose \(P(A=1\mid L=0)=0.2\) and \(P(A=1\mid L=1)=0.8\). The overall probability of treatment is

$$ P(A=1)=0.6(0.2)+0.4(0.8)=0.12+0.32=0.44. $$

Among treated people, the joint probabilities of \((A=1,L=0)\) and \((A=1,L=1)\) are \(0.12\) and \(0.32\). Therefore their covariate proportions are \(0.12/0.44=3/11\) and \(0.32/0.44=8/11\). The crude treated mean is

$$ E[Y\mid A=1] =\frac{3}{11}(10)+\frac{8}{11}(6) =\frac{78}{11} \approx 7.09. $$

For untreated people, the joint probabilities in the two strata are \(0.6(0.8)=0.48\) and \(0.4(0.2)=0.08\), so \(P(A=0)=0.56\). Their covariate proportions are \(0.48/0.56=6/7\) and \(0.08/0.56=1/7\), giving

$$ E[Y\mid A=0] =\frac{6}{7}(8)+\frac{1}{7}(4) =\frac{52}{7} \approx 7.43. $$

The crude difference is approximately \(7.09-7.43=-0.34\), whereas the standardized contrast is \(2.0\). The crude comparison weights the strata differently in the two groups; standardization instead compares treatment-specific means over one common population distribution. This calculation illustrates why the crude difference need not equal the regime-specific mean contrast.

A Continuous Covariate and a Weighted Representation

The same argument applies when \(L\) is continuous. The expectation over \(L\) is then an integral, not a sum. For example, a fitted conditional mean must be averaged over the target population’s covariate distribution; evaluating it only at the mean covariate value is not generally equivalent.

Worked Example: Integrating Over a Normal Covariate

Suppose \(L\sim N(0,1)\), treatment support holds throughout the covariate distribution, and the observed conditional means are \(E[Y\mid A=a,L=l]=2+3a+2l\) for \(a\in\{0,1\}\). Under the identification assumptions, the mean under treatment \(a\) is

$$ E[Y^a] =\int (2+3a+2l)\,dF_L(l) =2+3a+2E[L]. $$

Since \(E[L]=0\), this gives \(E[Y^0]=2\) and \(E[Y^1]=5\), so the mean contrast is \(5-2=3\). The integral averages over the full distribution of \(L\). Here the conditional mean is linear, so evaluating at \(L=E[L]=0\) happens to give the same answer; for a nonlinear conditional mean, that shortcut need not work.

There is also an equivalent inverse-probability-weighted representation. Define \(e_a(L)=P(A=a\mid L)\). Under the same assumptions and suitable integrability of the weighted expression,

$$ E\!\left[\frac{\mathbb{1}(A=a)Y}{e_a(L)}\right] = E_L\!\left[ \frac{E[\mathbb{1}(A=a)Y\mid L]}{e_a(L)} \right] = E_L\!\left[E[Y\mid A=a,L]\right] = E[Y^a]. $$

For the middle equality, conditional on \(L\), the numerator is \(e_a(L)E[Y\mid A=a,L]\); support allows division by \(e_a(L)\). This identity is a second derivation of the same target, not a different causal assumption. Standardization works directly with conditional outcome means, whereas the weighted expression reweights observed outcomes. Each representation can be difficult to estimate when treatment support is weak.

When Identification Fails

Worked Example: A Treatment Option Is Missing in One Stratum

Let \(P(L=0)=P(L=1)=0.5\), and suppose treatment is deterministic: \(A=L\). The observed outcome is \(Y=0\) when \(L=0\) and \(Y=1\) when \(L=1\). Consider two possible counterfactual systems. In both, \(Y^0=0\) for everyone and \(Y^1=1\) when \(L=1\). When \(L=0\), let \(Y^1=0\) in the first system and \(Y^1=10\) in the second.

Both systems produce exactly the same observed data: people with \(L=0\) receive treatment \(0\) and have outcome \(0\); people with \(L=1\) receive treatment \(1\) and have outcome \(1\). Both also satisfy consistency. Yet the mean under treatment \(1\) is \(0.5(0)+0.5(1)=0.5\) in the first system and \(0.5(10)+0.5(1)=5.5\) in the second. Since the observed distribution cannot distinguish these values, \(E[Y^1]\) is not identified from it. In particular, \(E[Y\mid A=1,L=0]\) is unavailable, so the standardization formula cannot be evaluated over the whole population.

This example shows why support is a necessary condition, not merely a technical convenience. In data, warning signs include covariate strata with no treated or no untreated observations, very small treatment probabilities, and estimates that depend heavily on extrapolating a fitted outcome model beyond the observed treatment groups. A model can produce a numerical prediction in an empty stratum, but that prediction does not create information in the data.

Identification also depends on measuring an adequate set of pre-treatment covariates. If an unmeasured common cause of treatment and outcome remains after conditioning on \(L\), conditional exchangeability may fail. Likewise, the derivation requires covariates to precede the decision and the treatment to have a sufficiently well-defined meaning for consistency to apply. These assumptions are substantive; the observed data alone cannot verify them.

Outcome regression and weighting are computational approaches to the same identified quantity when their assumptions and target population agree. The crude comparison \(E[Y\mid A=1]-E[Y\mid A=0]\) does not generally implement the required standardization. Nor does simply adjusting a conditional regression coefficient necessarily report the marginal contrast \(E[Y^1]-E[Y^0]\); the conditional parameter and the population-average target are different quantities.

Check Your Understanding

For each question, give the answer before reading the solution immediately below it.

  1. State the identification formula for \(E[Y^a]\) when \(L\) is discrete.
  2. Why does the formula average over the population distribution of \(L\), rather than the distribution of \(L\) among people with \(A=a\)?
  3. Suppose \(P(L=0)=0.25\), \(P(L=1)=0.75\), and the conditional means under treatment \(1\) are 4 and 8 in the two strata. What is the identified mean under treatment \(1\)?
  4. What part of the derivation uses consistency, and what part uses conditional exchangeability?
  5. If nobody with \(L=1\) receives treatment \(a\), can the formula identify \(E[Y^a]\) for a population that includes \(L=1\)? Explain.

Solutions. (1) \(E[Y^a]=\sum_l E[Y\mid A=a,L=l]P(L=l)\). (2) The target is the mean if everyone in the population received \(a\), so the covariate distribution must be the population distribution; treatment-group weights describe a different population and generally differ across treatment groups. (3) \(0.25(4)+0.75(8)=1+6=7\). (4) Exchangeability replaces \(E[Y^a\mid L]\) by \(E[Y^a\mid A=a,L]\); consistency then replaces \(Y^a\) by observed \(Y\) among those with \(A=a\). (5) No: the needed conditional outcome mean at \(L=1\) is unobserved, so the population average requires unsupported information.

Clinical Biostats