From Assumptions to an Observed-Data Mean
At a single decision time, the target is often the mean outcome that would occur if everyone received a specified treatment \(a\), written \(E[Y^a]\). The challenge is that each person receives only one treatment, so the counterfactual outcome \(Y^a\) is not generally observed for everyone. Identification means expressing this target using the distribution of variables that are observed.
Let \(L\) denote covariates measured before treatment \(A\), and let \(Y\) be the observed outcome. The covariates may be categorical, continuous, or mixed. For the derivation below, assume the treatment and outcome are well-defined, the counterfactual outcome is integrable, and the following conditions hold.
These assumptions serve different purposes. Exchangeability lets us use people who received \(a\) to learn about the counterfactual outcome under \(a\), within covariate levels. Consistency connects that counterfactual outcome to the outcome actually recorded. Support prevents the calculation from requiring an unobserved treatment-specific outcome in a covariate stratum where nobody received that treatment.
Deriving the Identification Formula
The formula averages the treatment-specific conditional outcome mean over the covariate distribution in the target population. It does not average over the distribution of \(L\) among people who happened to receive treatment \(a\).
To prove the result, first condition the target mean on \(L\) and use the law of iterated expectation. For almost every \(l\), exchangeability gives the first equality below. Since support makes conditioning on \(A=a,L=l\) available, consistency gives the second.
The middle equality follows from \(Y^a \perp A\mid L\): within each covariate level, learning that \(A=a\) does not change the conditional distribution, and hence does not change the conditional mean, of \(Y^a\). The last equality follows because \(Y=Y^a\) for people with \(A=a\). Integrability ensures these expectations exist. Thus the counterfactual mean is a functional of the observed-data distribution. \(\square\)
Worked Example: Standardizing Across Two Covariate Strata
Suppose \(L\) has two levels, with \(P(L=0)=0.6\) and \(P(L=1)=0.4\). The observed conditional outcome means are:
| Covariate level | Population proportion | \(E[Y\mid A=1,L]\) | \(E[Y\mid A=0,L]\) |
|---|---|---|---|
| \(L=0\) | 0.6 | 10 | 8 |
| \(L=1\) | 0.4 | 6 | 4 |
Assuming the identification conditions hold, the mean under treatment \(1\) is the conditional mean in each stratum weighted by that stratum’s population proportion:
For treatment \(0\), the corresponding calculation is
The identified mean contrast is \(8.4-6.4=2.0\). Each standardized mean uses the same population weights, \(0.6\) and \(0.4\). Using treatment-specific weights instead would answer a different question because it would average over the covariate distribution of the group that received that treatment.
Why the Covariate Distribution Matters
The formula is a standardization: it computes a conditional mean for each covariate value under the treatment of interest, then averages those means over the target population’s covariate distribution. This distinction matters when treatment groups differ in their covariate composition. A comparison of the two observed treatment-group means can reflect both treatment and those compositional differences.
Worked Example: Crude and Standardized Comparisons Can Differ
Use the conditional means and population proportions in the preceding example. Suppose \(P(A=1\mid L=0)=0.2\) and \(P(A=1\mid L=1)=0.8\). The overall probability of treatment is
Among treated people, the joint probabilities of \((A=1,L=0)\) and \((A=1,L=1)\) are \(0.12\) and \(0.32\). Therefore their covariate proportions are \(0.12/0.44=3/11\) and \(0.32/0.44=8/11\). The crude treated mean is
For untreated people, the joint probabilities in the two strata are \(0.6(0.8)=0.48\) and \(0.4(0.2)=0.08\), so \(P(A=0)=0.56\). Their covariate proportions are \(0.48/0.56=6/7\) and \(0.08/0.56=1/7\), giving
The crude difference is approximately \(7.09-7.43=-0.34\), whereas the standardized contrast is \(2.0\). The crude comparison weights the strata differently in the two groups; standardization instead compares treatment-specific means over one common population distribution. This calculation illustrates why the crude difference need not equal the regime-specific mean contrast.
A Continuous Covariate and a Weighted Representation
The same argument applies when \(L\) is continuous. The expectation over \(L\) is then an integral, not a sum. For example, a fitted conditional mean must be averaged over the target population’s covariate distribution; evaluating it only at the mean covariate value is not generally equivalent.
Worked Example: Integrating Over a Normal Covariate
Suppose \(L\sim N(0,1)\), treatment support holds throughout the covariate distribution, and the observed conditional means are \(E[Y\mid A=a,L=l]=2+3a+2l\) for \(a\in\{0,1\}\). Under the identification assumptions, the mean under treatment \(a\) is
Since \(E[L]=0\), this gives \(E[Y^0]=2\) and \(E[Y^1]=5\), so the mean contrast is \(5-2=3\). The integral averages over the full distribution of \(L\). Here the conditional mean is linear, so evaluating at \(L=E[L]=0\) happens to give the same answer; for a nonlinear conditional mean, that shortcut need not work.
There is also an equivalent inverse-probability-weighted representation. Define \(e_a(L)=P(A=a\mid L)\). Under the same assumptions and suitable integrability of the weighted expression,
For the middle equality, conditional on \(L\), the numerator is \(e_a(L)E[Y\mid A=a,L]\); support allows division by \(e_a(L)\). This identity is a second derivation of the same target, not a different causal assumption. Standardization works directly with conditional outcome means, whereas the weighted expression reweights observed outcomes. Each representation can be difficult to estimate when treatment support is weak.
When Identification Fails
Worked Example: A Treatment Option Is Missing in One Stratum
Let \(P(L=0)=P(L=1)=0.5\), and suppose treatment is deterministic: \(A=L\). The observed outcome is \(Y=0\) when \(L=0\) and \(Y=1\) when \(L=1\). Consider two possible counterfactual systems. In both, \(Y^0=0\) for everyone and \(Y^1=1\) when \(L=1\). When \(L=0\), let \(Y^1=0\) in the first system and \(Y^1=10\) in the second.
Both systems produce exactly the same observed data: people with \(L=0\) receive treatment \(0\) and have outcome \(0\); people with \(L=1\) receive treatment \(1\) and have outcome \(1\). Both also satisfy consistency. Yet the mean under treatment \(1\) is \(0.5(0)+0.5(1)=0.5\) in the first system and \(0.5(10)+0.5(1)=5.5\) in the second. Since the observed distribution cannot distinguish these values, \(E[Y^1]\) is not identified from it. In particular, \(E[Y\mid A=1,L=0]\) is unavailable, so the standardization formula cannot be evaluated over the whole population.
This example shows why support is a necessary condition, not merely a technical convenience. In data, warning signs include covariate strata with no treated or no untreated observations, very small treatment probabilities, and estimates that depend heavily on extrapolating a fitted outcome model beyond the observed treatment groups. A model can produce a numerical prediction in an empty stratum, but that prediction does not create information in the data.
Identification also depends on measuring an adequate set of pre-treatment covariates. If an unmeasured common cause of treatment and outcome remains after conditioning on \(L\), conditional exchangeability may fail. Likewise, the derivation requires covariates to precede the decision and the treatment to have a sufficiently well-defined meaning for consistency to apply. These assumptions are substantive; the observed data alone cannot verify them.
Outcome regression and weighting are computational approaches to the same identified quantity when their assumptions and target population agree. The crude comparison \(E[Y\mid A=1]-E[Y\mid A=0]\) does not generally implement the required standardization. Nor does simply adjusting a conditional regression coefficient necessarily report the marginal contrast \(E[Y^1]-E[Y^0]\); the conditional parameter and the population-average target are different quantities.
Check Your Understanding
For each question, give the answer before reading the solution immediately below it.
- State the identification formula for \(E[Y^a]\) when \(L\) is discrete.
- Why does the formula average over the population distribution of \(L\), rather than the distribution of \(L\) among people with \(A=a\)?
- Suppose \(P(L=0)=0.25\), \(P(L=1)=0.75\), and the conditional means under treatment \(1\) are 4 and 8 in the two strata. What is the identified mean under treatment \(1\)?
- What part of the derivation uses consistency, and what part uses conditional exchangeability?
- If nobody with \(L=1\) receives treatment \(a\), can the formula identify \(E[Y^a]\) for a population that includes \(L=1\)? Explain.
Solutions. (1) \(E[Y^a]=\sum_l E[Y\mid A=a,L=l]P(L=l)\). (2) The target is the mean if everyone in the population received \(a\), so the covariate distribution must be the population distribution; treatment-group weights describe a different population and generally differ across treatment groups. (3) \(0.25(4)+0.75(8)=1+6=7\). (4) Exchangeability replaces \(E[Y^a\mid L]\) by \(E[Y^a\mid A=a,L]\); consistency then replaces \(Y^a\) by observed \(Y\) among those with \(A=a\). (5) No: the needed conditional outcome mean at \(L=1\) is unobserved, so the population average requires unsupported information.