Tutorials › Propensity Score Matching and Instrumental Variables › Average Causal Effects as Potential-Outcome Contrasts

Causal Effects, Ignorability and Positivity · Tutorial 5 of 699

Average Causal Effects as Potential-Outcome Contrasts

Learn to define and calculate the average causal effect for a specified population, and distinguish that estimand from an observed difference between treatment groups.

Beginner 10 min read

What You'll Learn

  • Define the population average treatment effect using treatment and control potential outcomes.
  • Express the average effect as either a mean of individual effects or a difference of population means.
  • Distinguish a causal estimand from a descriptive difference in observed group means.
  • Calculate an average effect for a specified target population and weighting scheme.
  • Identify conditions needed to define the estimand and common errors in interpreting it.

From Individual Effects to a Population Average

An individual causal effect compares what would happen to one unit under treatment with what would happen to that same unit under control. A population-level question asks for a summary across a defined set of units: what is the average of those individual contrasts? The answer depends on which population is being averaged over and on the outcome scale.

Let \(Y(1)\) denote a unit’s potential outcome under treatment and \(Y(0)\) its potential outcome under control. These are defined for each unit in the target population. The individual effect is \(Y(1)-Y(0)\). Averaging that contrast over the target population gives the population average treatment effect, usually abbreviated ATE.

Definition: For a specified target population, the average treatment effect (ATE) is the population mean of the individual treatment effects: $$ \operatorname{ATE}=E\!\left[Y(1)-Y(0)\right]. $$ When the two potential outcomes have finite means, linearity of expectation gives the equivalent expression $$ \operatorname{ATE}=E[Y(1)]-E[Y(0)]. $$

The first expression emphasizes that the ATE averages individual effects. The second expresses it as a difference between the population mean potential outcome under treatment and the population mean potential outcome under control. Both refer to the same target population and the same outcome definition. The ATE is an average contrast, not a claim that every individual has that effect.

The target population is part of the definition, not a detail to add afterward. For example, an average effect among all eligible patients need not equal the average effect among patients who actually received treatment. Changing who is included changes the distribution over which the potential-outcome contrast is averaged.

Defining the Estimand Carefully

Before calculating an ATE, specify the population and treatment contrast. The treatment states must be clear enough to define \(Y(1)\) and \(Y(0)\); the outcome must use the same measurement scale and time point under both states; and the expectations in the definition must exist. These are requirements for the estimand to be meaningful and mathematically defined. They do not, by themselves, ensure that observed data identify or estimate it.

For a finite population of \(N\) units, the corresponding average is an arithmetic mean:

$$ \operatorname{ATE}_{N} =\frac{1}{N}\sum_{i=1}^{N}\left\{Y_i(1)-Y_i(0)\right\} =\frac{1}{N}\sum_{i=1}^{N}Y_i(1) -\frac{1}{N}\sum_{i=1}^{N}Y_i(0). $$

Here \(i\) indexes units in the target population. This finite-population expression makes the weighting explicit: each unit contributes equally. In a population formulation, \(E[\cdot]\) denotes the average under the distribution of units in the target population. Other weighting choices are possible, but they define a different target average and must be stated.

Worked Example: Averaging Individual Effects

Suppose a hypothetical target population contains four patients, and the outcome is a symptom score measured in points after a fixed follow-up period. Their potential outcomes are:

Patient\(Y_i(1)\), treatment\(Y_i(0)\), controlIndividual effect \(Y_i(1)-Y_i(0)\)
A853
B651
C1073
D431

The average of the individual effects is $$ \operatorname{ATE}_{N} =\frac{3+1+3+1}{4} =\frac{8}{4} =2\text{ points}. $$

The two mean potential outcomes give the same answer: $$ \frac{8+6+10+4}{4}-\frac{5+5+7+3}{4} =7-5 =2\text{ points}. $$

Thus the treatment-versus-control average contrast for this hypothetical population is 2 symptom-score points. The individual effects are not all 2 points: they are 3, 1, 3, and 1. The ATE summarizes their mean; it does not describe each patient’s effect.

The Population Average Is Sensitive to Its Weights

An overall average combines subgroup effects according to how much of the target population each subgroup contributes. It is generally not the simple average of subgroup averages unless the subgroup sizes or the chosen weights make it so. This matters when results are summarized across populations with different compositions.

Worked Example: Applying Target-Population Weights

Consider a hypothetical population of four people divided into two groups. Group A has three people, with individual effects of 1, 2, and 3 outcome points. Group B has one person, with an effect of 8 points.

The target-population ATE gives each of the four people equal weight: $$ \operatorname{ATE}_{N} =\frac{1+2+3+8}{4} =\frac{14}{4} =3.5\text{ points}. $$

The group means are 2 points for Group A and 8 points for Group B. Simply averaging those two group means would give $$ \frac{2+8}{2}=5\text{ points}, $$ but that assigns half the weight to each group, despite Group A containing three quarters of the population. Using the population shares instead gives $$ \frac{3}{4}(2)+\frac{1}{4}(8) =1.5+2 =3.5\text{ points}. $$

The correct weighting depends on the target. The value 3.5 points is the average for the four-person population described. An average that deliberately gives the two groups equal weight answers a different question.

Why an Observed Group Difference Is Not the ATE

An observed treated-versus-control difference compares outcomes recorded for two groups. If \(T\) indicates treatment status and \(Y\) is the recorded outcome, the population version of that descriptive contrast is

$$ E[Y\mid T=1]-E[Y\mid T=0]. $$

This quantity compares the mean recorded outcome among units with \(T=1\) to the mean among units with \(T=0\). By contrast, the ATE compares the two potential-outcome means for the same specified target population. The definitions are different: the observed contrast averages over treatment groups, while the ATE averages two potential outcomes over the target population.

The distinction is not merely that one quantity is called “observed” and the other “causal.” An observed group difference can reflect both treatment-related outcome differences and differences in which units are represented in the groups. The group contrast alone does not establish that it equals the target-population ATE. Whether and how observed data can support an estimate of the ATE depends on additional conditions and a suitable design or analysis.

Worked Example: Calculating an Observed Group Difference

In a hypothetical service evaluation, the recorded outcome is a satisfaction score in points. The treated group has scores 8, 9, and 10; the control group has scores 6, 7, and 8. Calculate and interpret the observed group difference.

The treated-group mean is $$ \bar{Y}_{T=1}=\frac{8+9+10}{3}=\frac{27}{3}=9\text{ points}, $$ and the control-group mean is $$ \bar{Y}_{T=0}=\frac{6+7+8}{3}=\frac{21}{3}=7\text{ points}. $$ The observed difference is therefore $$ \bar{Y}_{T=1}-\bar{Y}_{T=0}=9-7=2\text{ points}. $$

The accurate descriptive conclusion is that the treated group’s mean recorded score is 2 points higher than the control group’s mean recorded score. This calculation alone does not establish that treatment increases the target population’s mean score by 2 points. It is a difference between observed groups, not automatically the ATE.

A useful way to keep the quantities separate is to write down what each averages before interpreting a number:

QuantityWhat is averaged or compared?Meaning
Individual effect\(Y_i(1)-Y_i(0)\) for one unitThat unit’s treatment-versus-control contrast
ATEIndividual effects across a specified target populationThe population’s average causal contrast
Observed group differenceRecorded outcomes among \(T=1\) versus \(T=0\)A descriptive comparison of the observed groups

Derivation and Interpretation

The equivalence of the two ATE expressions follows directly from linearity of expectation. Provided \(Y(1)\) and \(Y(0)\) have finite means,

$$ \begin{aligned} E[Y(1)-Y(0)] &=E[Y(1)]+E[-Y(0)]\\ &=E[Y(1)]-E[Y(0)]. \end{aligned} $$

The same calculation applies to the finite-population mean because sums distribute over subtraction: $$ \frac{1}{N}\sum_{i=1}^{N}\{Y_i(1)-Y_i(0)\} =\frac{1}{N}\sum_{i=1}^{N}Y_i(1) -\frac{1}{N}\sum_{i=1}^{N}Y_i(0). $$ This equality is an algebraic property of the estimand. It does not say that both potential outcomes are observed for each unit, nor that a particular observed statistic equals the ATE.

The ATE uses the outcome’s units. If \(Y\) is measured in points, the ATE is measured in points; if \(Y\) is measured in days, it is measured in days. Its sign also follows the order of subtraction: a positive ATE means the mean potential outcome under treatment is higher than under control, while a negative ATE means it is lower. Whether a higher value is desirable depends on what the outcome measures.

Common Pitfalls and Limits

  • Treating a group difference as a causal effect. A difference between observed means is descriptive by definition. Do not label it the ATE unless the required link between the observed data and the target potential-outcome means has been justified.
  • Leaving the target population implicit. An ATE is always an average for some population. State who is included and what weights define that average.
  • Assuming the mean describes everyone. An ATE of 2 points does not imply that each individual effect is 2 points. Effects may vary around the average.
  • Changing the outcome or treatment definition. Potential outcomes must refer to the same outcome scale and clearly specified treatment states. Changing the follow-up time, outcome measure, or target population changes the estimand.
  • Overstating what the definition provides. Defining an ATE specifies a causal quantity of interest; it does not show that available data identify it or estimate it precisely.

The ATE is often a useful summary, but it can conceal important variation. It also may not be the most relevant average for every decision: a question focused on a particular subgroup or on people who received treatment has a different target. The first task is to define the contrast and population that match the question; estimation comes afterward.

Key takeaway: The ATE is \(E[Y(1)-Y(0)]\), equivalently \(E[Y(1)]-E[Y(0)]\), for a specified population. An observed treated-versus-control mean difference is a different quantity and is not automatically a causal effect.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. In one sentence, define the ATE and name the population over which it is averaged.
  2. A finite population has individual effects of \(-2\), 1, and 4 outcome points. Calculate its ATE.
  3. Explain why the difference between observed treated- and control-group means is not automatically the ATE.
  4. A target population has two equally sized groups with average effects of 2 and 6 days. What is the overall ATE?

Solutions. (1) The ATE is the mean of \(Y(1)-Y(0)\) over a specified target population. (2) \(\{(-2)+1+4\}/3=3/3=1\) point. (3) The observed contrast compares recorded outcomes in two groups, whereas the ATE compares potential-outcome means for the same target population; the observed contrast alone does not establish equality between them. (4) Equal group sizes give equal weights, so the ATE is \((2+6)/2=4\) days.

Clinical Biostats