Tutorials › Propensity Score Matching and Instrumental Variables › Conditional Effects as Weighted Population Effects

Estimands: ATE, ATT, ATO and Estimand Shifts After Matching · Tutorial 51 of 699

Conditional Effects as Weighted Population Effects

Learn to express the ATE, ATT, ATC, and ATO as weighted averages of conditional treatment effects, and interpret what each weighting scheme targets.

Intermediate 10 min read

What You'll Learn

  • Define a conditional treatment effect and express population estimands as weighted averages of it.
  • Derive the propensity-score weights that yield the ATT and ATC.
  • Show how overlap weights yield the ATO and describe its target population.
  • Calculate several estimands from a hypothetical stratified population.
  • Relate differences between the ATE and ATT to treatment-effect heterogeneity.
  • Check integrability, treatment prevalence, and overlap conditions before interpreting a weighted effect.

Why Population Weights Matter

A conditional treatment effect describes the average causal effect for units with a particular value of the pretreatment covariates. A population effect averages those conditional effects across some target population. The target is important: averaging over everyone, over those treated, over those untreated, or over an overlap-weighted population can produce different answers when treatment effects vary with covariates.

This tutorial derives those differences through population weights. The formulas are useful even when conditional effects are not directly observed: they state exactly which people contribute to each estimand and how heavily. They do not, by themselves, establish that an effect can be identified from observed data.

Definition: Let \(A\in\{0,1\}\) denote treatment, \(X\) the pretreatment covariates, and \(Y(1)\) and \(Y(0)\) the potential outcomes under treatment and control. The conditional average treatment effect is $$ \tau(x)=E[Y(1)-Y(0)\mid X=x]. $$ The propensity score is \(e(x)=P(A=1\mid X=x)\). A weighted population effect with nonnegative weight function \(h(X)\) is $$ \psi_h=\frac{E[h(X)\tau(X)]}{E[h(X)]}, $$ provided \(0<E[h(X)]<\infty\) and \(E[|h(X)\tau(X)|]<\infty\). These conditions ensure that the denominator is positive and finite and that the numerator exists as a finite expectation.

Multiplying \(h\) by any positive finite constant leaves \(\psi_h\) unchanged. Thus, weights specify relative emphasis across covariate values, not an absolute scale. The weighted target population has covariate distribution proportional to \(h(x)\) times the original population distribution of \(X\).

Deriving the Four Population Effects

The average treatment effect (ATE) averages the conditional effect over the full population, so its weight is \(h(x)=1\). The ATT averages over the covariate distribution among treated units; the ATC does the same among controls. To express those distributions in the full population, use \(P(A=1\mid X)=e(X)\) and \(P(A=0\mid X)=1-e(X)\).

$$ \begin{aligned} \mathrm{ATE} &= E[\tau(X)],\\ \mathrm{ATT} &= E[\tau(X)\mid A=1] =\frac{E[e(X)\tau(X)]}{E[e(X)]},\\ \mathrm{ATC} &= E[\tau(X)\mid A=0] =\frac{E[(1-e(X))\tau(X)]}{E[1-e(X)]},\\ \mathrm{ATO} &= \frac{E[e(X)(1-e(X))\tau(X)]} {E[e(X)(1-e(X))]}. \end{aligned} $$

For example, the ATT identity follows by averaging \(\tau(X)\) over the covariate distribution of treated units. For any integrable function \(g\), \(E[g(X)\mid A=1]=E[g(X)I(A=1)]/P(A=1)\). Taking the expectation conditional on \(X\) in the numerator gives \(E[g(X)e(X)]\); also \(P(A=1)=E[e(X)]\). Set \(g(X)=\tau(X)\) to obtain the ATT formula. Replacing treated with control gives the ATC formula.

The ATO uses the overlap weight \(e(X)(1-e(X))\). It gives greatest relative weight to covariate profiles with substantial probability of receiving either treatment, and zero weight where the propensity is exactly zero or one. Its target covariate distribution is the original distribution reweighted by \(e(X)(1-e(X))\).

Conditions and interpretation: For the ATT, require \(P(A=1)=E[e(X)]>0\); for the ATC, require \(P(A=0)=E[1-e(X)]>0\). For the ATO, require \(E[e(X)(1-e(X))]>0\). The relevant effect expectations must also exist. Since \(e(X)\) and \(1-e(X)\) are bounded between zero and one, \(E[|\tau(X)|]<\infty\) is sufficient for all four effects to be finite. These are conditions for defining the estimands, not sufficient conditions for identifying them from observed outcomes.

If causal effects are to be identified from observed data, additional assumptions are needed. A common set is consistency (the observed outcome equals the potential outcome under the treatment actually received), conditional exchangeability \(\{Y(1),Y(0)\}\perp A\mid X\), and positivity in the target population. For the ATE, positivity ordinarily requires \(0<e(X)<1\) throughout the population of interest. For ATT identification, treated covariate profiles must have a positive chance of control; for ATC identification, control profiles must have a positive chance of treatment. The ATO targets covariate profiles with \(0<e(X)<1\), so it does not require positivity at profiles it assigns zero weight. These identification conditions do not change the definitions of the estimands above.

Worked Example: Four Effects in a Three-Stratum Population

Consider a hypothetical population in which \(X\) has three strata. The table gives each stratum's population proportion, propensity score, and conditional average treatment effect. Effects are measured in days of improved recovery time; positive values indicate benefit.

StratumPopulation proportion\(e(x)\)\(\tau(x)\), days
Lower-risk0.400.202
Middle-risk0.350.505
Higher-risk0.250.809

ATE. Average the effects using the population proportions: $$ \mathrm{ATE}=0.40(2)+0.35(5)+0.25(9) =0.80+1.75+2.25=4.80\text{ days}. $$

ATT. The unnormalized weights are population proportion times propensity: \(0.40(0.20)=0.080\), \(0.35(0.50)=0.175\), and \(0.25(0.80)=0.200\). Their sum is \(P(A=1)=0.455\). Thus $$ \mathrm{ATT}=\frac{0.080(2)+0.175(5)+0.200(9)}{0.455} =\frac{2.835}{0.455}=6.231\text{ days}. $$

ATC. The unnormalized weights are population proportion times \(1-e(x)\): \(0.320\), \(0.175\), and \(0.050\), summing to \(P(A=0)=0.545\). Therefore $$ \mathrm{ATC}=\frac{0.320(2)+0.175(5)+0.050(9)}{0.545} =\frac{1.965}{0.545}=3.606\text{ days}. $$

ATO. The unnormalized overlap weights, including population proportions, are \(0.40(0.20)(0.80)=0.064\), \(0.35(0.50)(0.50)=0.0875\), and \(0.25(0.80)(0.20)=0.040\). They sum to \(0.1915\). Hence $$ \mathrm{ATO}=\frac{0.064(2)+0.0875(5)+0.040(9)}{0.1915} =\frac{0.9255}{0.1915}=4.833\text{ days}. $$

These are different averages of the same conditional effects. Treated units are concentrated in the higher-risk stratum, where the effect is largest, so the ATT exceeds the ATE. The ATO emphasizes the middle stratum, where treatment assignment is most balanced.

A General Weighted Effect and Its Calculation

The same reasoning applies to any nonnegative weight function \(h(X)\) that meets the integrability conditions. Such a function defines a target population whose covariate profiles are more or less represented according to \(h\). This perspective makes explicit that a weighted effect is not an “adjusted effect” with no target: it is an average for a particular reweighted population.

Worked Example: Checking and Calculating a Custom Weighted Effect

In a hypothetical population, three covariate strata have proportions \(0.50\), \(0.30\), and \(0.20\), with conditional effects \(-1\), \(3\), and \(8\) outcome units. Suppose a target is defined by weights \(h(x)=1,2,0.5\) in the three strata, respectively.

All three weights are nonnegative. The denominator is $$ E[h(X)]=0.50(1)+0.30(2)+0.20(0.5)=0.50+0.60+0.10=1.20, $$ which is positive and finite. The absolute numerator expectation is finite because the population has only three strata and all weights and effects are finite. Its signed numerator is $$ E[h(X)\tau(X)]=0.50(1)(-1)+0.30(2)(3)+0.20(0.5)(8) =-0.50+1.80+0.80=2.10. $$ Thus \(\psi_h=2.10/1.20=1.75\) outcome units. The negative effect in the first stratum is included, but the second stratum receives twice its original relative weight and the third half its original relative weight.

The calculation also shows why a positive finite denominator alone is not enough to define \(\psi_h\): the numerator must exist. In this finite example it does; in a population with unbounded effects, finiteness must be checked rather than assumed.

Why the ATE and ATT Can Differ

The ATT and ATE coincide when the propensity score is unrelated to the conditional treatment effect in the population, but treatment-effect homogeneity is not required for coincidence. A useful identity makes the role of their association precise. Provided the expectations exist and \(P(A=1)>0\),

$$ \mathrm{ATT} =\frac{E[e(X)\tau(X)]}{E[e(X)]} =\mathrm{ATE}+ \frac{\operatorname{Cov}(e(X),\tau(X))}{P(A=1)}. $$

To verify it, expand the covariance: \(\operatorname{Cov}(e(X),\tau(X))=E[e(X)\tau(X)]-E[e(X)]E[\tau(X)]\). Divide by \(E[e(X)]\), then add \(E[\tau(X)]\); the result is \(E[e(X)\tau(X)]/E[e(X)]\), the ATT. Positive association between propensity and effect therefore makes ATT exceed ATE; negative association makes it smaller. This is a statement about how effects and treatment prevalence vary across \(X\), not a claim that the propensity score causes the effect.

Worked Example: Decomposing the ATT–ATE Difference

Suppose a hypothetical population has a higher-effect stratum with probability \(0.40\), propensity \(0.80\), and effect \(6\) outcome units, and a lower-effect stratum with probability \(0.60\), propensity \(0.20\), and effect \(2\) units.

The ATE is \(0.40(6)+0.60(2)=3.60\) units. Treatment prevalence is \(P(A=1)=0.40(0.80)+0.60(0.20)=0.44\). The ATT numerator is \(0.40(0.80)(6)+0.60(0.20)(2)=1.92+0.24=2.16\), so \(\mathrm{ATT}=2.16/0.44=4.909\) units.

For the covariance identity, $$ \operatorname{Cov}(e(X),\tau(X))=2.16-(0.44)(3.60)=0.576. $$ Consequently, $$ \mathrm{ATE}+\frac{\operatorname{Cov}(e(X),\tau(X))}{P(A=1)} =3.60+\frac{0.576}{0.44}=4.909\text{ units}, $$ which agrees with the direct ATT calculation. The positive covariance reflects that the higher-effect stratum is more likely to be treated.

Choosing and Diagnosing the Target

The four effects differ in their target covariate distributions, not merely in the algebra used to estimate them. The table summarizes their population weights.

EstimandWeight on \(\tau(X)\)Target population
ATE1Full population
ATT\(e(X)\)Population represented among treated units
ATC\(1-e(X)\)Population represented among control units
ATO\(e(X)(1-e(X))\)Population emphasizing covariate profiles with treatment overlap

This is a population-level comparison. In an application, investigators may estimate effects through outcome models, propensity-based weighting, matching, or other procedures. Those approaches can target different populations, and their validity depends on design and modeling assumptions. The formulas here specify the estimands; choosing an estimation method does not automatically make its target equal to the ATE, ATT, ATC, or ATO.

Several checks help reveal a mismatch between the intended target and the effect being reported:

  • State the target population before interpreting the estimate. A result for treated units does not automatically describe everyone.
  • Check treatment prevalence and the denominator for the chosen estimand. A zero denominator means that target population is not represented.
  • For identification, examine whether both treatment groups occur in the covariate profiles relevant to the target. Sparse representation can make estimates unstable even when a formal positivity condition holds.
  • Check whether the conditional effect varies across important covariates. If it does, different population weights can yield substantively different averages.
  • Check that the effect has a finite expectation under the target weights. A finite normalizing denominator cannot repair an undefined or infinite numerator.

A common mistake is to say, “The ATT is the ATE among treated people,” and then calculate the unweighted average of conditional effects across the overall population. That uses weight 1 and gives the ATE. The correction is to average using the treated covariate distribution, equivalently weighting the full population by \(e(X)\) and dividing by \(E[e(X)]\). Another mistake is to assume that a well-defined weighted estimand is automatically identified from observed outcomes. The definition concerns potential outcomes and the target distribution; identification additionally requires assumptions such as consistency, conditional exchangeability, and suitable positivity.

Key takeaway: ATE, ATT, ATC, and ATO are averages of the same conditional treatment effect under different population weights. The weight determines whose effect is being averaged, and a valid definition requires both a positive finite normalizing expectation and a finite numerator expectation.

Check Your Understanding

Try each question, then compare your reasoning with the solutions.

  1. If \(P(A=1)=0.30\), \(E[e(X)\tau(X)]=1.20\) outcome units, and the expectations exist, what is the ATT?
  2. Which estimand uses the weight \(1-e(X)\), and what population does it target?
  3. Suppose \(\tau(X)\) is constant across all covariate profiles and the four estimands are defined. How do their values compare?
  4. Why does \(0<E[h(X)]<\infty\) not by itself guarantee that \(\psi_h\) is defined?
  5. If propensity and conditional effect have positive covariance, how does the ATT compare with the ATE?

Solutions. (1) \(\mathrm{ATT}=1.20/0.30=4.00\) outcome units. (2) The ATC uses \(1-e(X)\) and targets the covariate distribution represented among controls. (3) They are equal to the constant conditional effect because every normalized weighted average of a constant has that value. (4) The numerator \(E[h(X)\tau(X)]\) may fail to exist or be finite; a sufficient additional condition is \(E[|h(X)\tau(X)|]<\infty\). (5) The covariance identity gives \(\mathrm{ATT}=\mathrm{ATE}+\operatorname{Cov}(e(X),\tau(X))/P(A=1)\); with positive covariance and positive treatment prevalence, ATT exceeds ATE.

Clinical Biostats