Tutorials › Econometrics (Graduate) › Contamination in Staggered Event-Study Regressions

Difference-in-Differences and Events · Tutorial 668 of 952

Contamination in Staggered Event-Study Regressions

Learn why staggered-adoption event-study coefficients need not represent effects at their stated event times, and how post-adoption treatment-effect heterogeneity can appear as a pretrend.

Advanced 11 min read

What You'll Learn

  • Write the conventional two-way fixed-effects event-study regression and define its cohort-time treatment effects.
  • Use the Frisch–Waugh–Lovell representation to see how event-study coefficients combine effects across cohorts and dates.
  • Explain how heterogeneous post-adoption effects can contaminate lead coefficients despite no anticipation.
  • Distinguish a coefficient’s event-time label from the treatment effects that contribute to it.
  • Recognize why conventional event-study leads are not, by themselves, definitive pretrend tests.

Why Event-Time Labels Can Mislead

An event-study regression reports coefficients indexed by time relative to treatment adoption. It is tempting to read the coefficient at event time \(k\) as the average treatment effect \(k\) periods after adoption, and to read lead coefficients as evidence about whether treated units had different trends before adoption. Under staggered adoption, those interpretations can fail: the regression uses a common set of coefficients to fit observations from cohorts treated at different dates, and some treated cohorts can serve as comparisons for others.

The central problem is contamination. When treatment effects differ across cohorts or over time, a conventional two-way fixed-effects (TWFE) event-study coefficient can combine effects from multiple cohort-date cells. In particular, a coefficient labeled as a lead can receive contributions from effects after some cohorts have already adopted treatment. Thus a nonzero lead need not imply anticipation or a violation of parallel trends.

Definition: Let \(G_i=g\) denote that unit \(i\) first receives treatment in period \(g\), and let \(G_i=\infty\) denote a never-treated unit. Event time is \(k=t-G_i\). The cohort-time average treatment effect on the treated is \(\operatorname{ATT}(g,t)=E[Y_{it}(1)-Y_{it}(0)\mid G_i=g]\), for \(t\geq g\). Here \(Y_{it}(1)\) and \(Y_{it}(0)\) are the outcomes with and without treatment.

A conventional event-study specification includes unit and calendar-time fixed effects and indicators for event times, omitting one event time as the reference period, often \(k=-1\). A generic version is

$$ Y_{it}=\alpha_i+\lambda_t+ \sum_{k\in\mathcal{K},\,k\ne -1}\beta_k\,1\{t-G_i=k\} +\varepsilon_{it}. $$

The set \(\mathcal{K}\) contains the event times included in the regression. Event-time indicators are zero for never-treated units. The coefficient \(\beta_k\) is a regression coefficient relative to the omitted event time, conditional on the included fixed effects and other event-time indicators. It is not defined simply as the average of \(\operatorname{ATT}(g,g+k)\) over cohorts.

How the Regression Mixes Treatment Effects

To isolate the issue, suppose treatment begins at \(G_i\), there is no anticipation (treatment does not affect outcomes before adoption), and untreated outcomes satisfy the restrictions needed for the fixed effects to absorb their systematic differences. Parallel trends is one familiar way to motivate such restrictions. These assumptions do not require treatment effects to be identical: \(\operatorname{ATT}(g,t)\) may vary both across adoption cohorts and across dates since adoption.

The source of contamination can be stated exactly using the Frisch–Waugh–Lovell theorem. Let \(D\) be the matrix of included event-time indicators, \(Z\) the matrix of unit and time indicators, and \(M_Z=I-P_Z\) the residual-maker that removes the projection on \(Z\). Define \(A\) to contain cohort-by-calendar-time indicators for treated observations, and let \(\theta\) collect their treatment effects. After removing the fixed effects, the event-study regression estimates

$$ \widehat{\boldsymbol{\beta}} =(D'M_ZD)^{-1}D'M_ZY. $$

Under the stated untreated-outcome restrictions, the systematic untreated-outcome component contributes zero to the population projection. Since the treatment-effect component is represented by \(A\theta\), the population coefficient vector has the form

$$ \boldsymbol{\beta} =(D'M_ZD)^{-1}D'M_ZA\boldsymbol{\theta}. $$

This is a linear combination of cohort-time effects. In other words, for each included event time \(k\), there are design-dependent weights \(w_{k,g,t}\) such that

$$ \beta_k=\sum_{g,t}w_{k,g,t}\operatorname{ATT}(g,t). $$

The weights depend on the adoption pattern, which event times are included, the omitted reference period, and the regression’s observation structure. They are not generally restricted to cells with \(t-g=k\); some can be negative, and they need not form a simple average. The event-time label describes the indicator being estimated, not necessarily every treatment effect contributing to its coefficient.

A Lead Coefficient Can Reflect Later Effects

No anticipation means \(\operatorname{ATT}(g,t)=0\) for \(t<g\). It does not force every estimated lead coefficient to be zero. In the linear-combination expression, a lead coefficient can place nonzero weight on cohort-time effects for which \(t\geq g\). Heterogeneous effects in those post-adoption cells can therefore make the lead coefficient nonzero, even if every cohort’s true pre-adoption effect is zero.

Worked Example: A Nonzero Lead With No Anticipation

Suppose a hypothetical event-study regression has the following design-specific projection weights for its coefficient at \(k=-2\):

$$ \beta_{-2} =0.75\operatorname{ATT}(g_E,g_E) -0.25\operatorname{ATT}(g_L,g_L+1), $$

where \(g_E\) and \(g_L\) are an early and a later adoption cohort. These weights are illustrative, not a general formula for all TWFE event studies. Suppose the early cohort’s effect at adoption is \(8\) dollars per month, and the later cohort’s effect one period after adoption is \(4\) dollars per month. Assume all pre-adoption effects are zero.

Substitution gives

$$ \beta_{-2}=0.75(8)-0.25(4)=6-1=5 \quad\text{dollars per month}. $$

The fitted lead coefficient is \(5\) dollars per month, although the true treatment effects before adoption are zero. The calculation is possible because the lead coefficient’s projection includes post-adoption effects. It does not show that this particular set of weights applies to every study; the weights must be determined by that study’s design and regression specification.

Contamination can also affect lag coefficients. A coefficient at \(k=1\), for example, need not be the average effect exactly one period after adoption. It can include effects from other event times and cohorts. Consequently, a conventional event-study plot may distort both the apparent timing of effects and the apparent presence of pretrends.

Reading the Projection Equations Carefully

The matrix expression also clarifies why coefficients must be solved jointly. After residualizing the event-time indicators on the fixed effects, their columns can still be correlated with one another. The normal equations therefore involve all included event-time coefficients at once. A coefficient cannot generally be read from one equation in isolation.

Worked Example: Solving the Event-Time Normal Equations

Consider a hypothetical regression with three included event-time coefficients, ordered as \((\beta_{-2},\beta_0,\beta_1)'\). Suppose the residualized normal equations are

$$ \begin{pmatrix} 4&-1&1\\ -1&3&-1\\ 1&-1&2 \end{pmatrix} \begin{pmatrix} \widehat{\beta}_{-2}\\ \widehat{\beta}_0\\ \widehat{\beta}_1 \end{pmatrix} = \begin{pmatrix} -10\\ 9\\ -3.5 \end{pmatrix}. $$

Solving the system jointly gives \(\widehat{\beta}_{-2}=-2\), \(\widehat{\beta}_0=2.5\), and \(\widehat{\beta}_1=0.5\). Check the first equation by substituting the entire solution:

$$ 4(-2)-2.5+0.5=-8-2.5+0.5=-10. $$

The other equations also hold:

$$ -(-2)+3(2.5)-0.5=2+7.5-0.5=9, $$
$$ (-2)-2.5+2(0.5)=-2-2.5+1=-3.5. $$

Thus the coefficient labeled \(-2\) is \(-2\) in this system; it is not obtained by isolating an entry from the first row while ignoring the other coefficients. The normal equations show how the event indicators interact after fixed effects are removed. The separate projection-weight representation is what identifies which cohort-time treatment effects contribute to each coefficient.

Heterogeneity Changes the Meaning of a Lag

A further consequence is that a lag coefficient may not equal a natural average of the effects at that lag. A natural target might average \(\operatorname{ATT}(g,g+k)\) over cohorts observed at event time \(k\), using explicit nonnegative weights that sum to one. The conventional coefficient instead follows from the regression projection. Its weights may reach other event times and may be negative, so it can differ from that target even when all relevant treatment effects are positive.

Worked Example: A Lag Coefficient Need Not Be the Lag-Specific Average

Suppose, for illustration, that the event-time \(k=0\) coefficient from a particular regression has the projection

$$ \beta_0=0.8\operatorname{ATT}(g_E,g_E)+0.2\operatorname{ATT}(g_L,g_L). $$

Assume the early cohort’s effect at adoption is \(2\) outcome units and the later cohort’s is \(10\) outcome units. Then

$$ \beta_0=0.8(2)+0.2(10)=1.6+2=3.6 \quad\text{outcome units}. $$

An equally weighted average of those two cohort effects would be \((2+10)/2=6\) outcome units, not \(3.6\). The difference arises because the regression’s projection weights are \(0.8\) and \(0.2\), rather than one half each. In other designs, a coefficient can also load on effects at other event times. Neither the event-time label nor the fact that the coefficient is estimated by least squares guarantees that it is the desired causal average.

What Lead Coefficients Can and Cannot Diagnose

A pretrend diagnostic asks whether outcomes appear to differ before treatment. In a conventional TWFE event study with staggered adoption, a nonzero lead can reflect genuine anticipation or a failure of the assumptions governing untreated outcomes. But it can also arise through contamination from heterogeneous post-adoption effects. Conversely, a lead near zero does not establish that parallel trends holds: the projection weights can combine contributions in ways that cancel, and diagnostics may have limited power.

Interpret leads in light of the estimator and design, not as automatic tests that identify the cause of a nonzero coefficient. The earlier material on pretrend diagnostics and the Goodman-Bacon decomposition addresses related issues; here the key point is specific to event-study regressions: heterogeneity can make the lead coefficients themselves mixtures of effects. The event-time coefficients remain regression summaries, but their causal interpretation requires more than reading off their labels.

1
Define the target.
Specify whether the goal is an effect for a particular cohort and event time or an average across cohorts.
2
Describe the adoption pattern.
Identify which cohorts are treated, when they adopt, and which cohort-time observations enter the regression.
3
Assess the projection.
Recognize that fixed effects and event-time indicators jointly determine how cohort-time effects contribute to each coefficient.
4
Qualify the interpretation.
Do not call a lead a direct estimate of a pre-treatment effect, or a lag a direct estimate of its same-numbered post-treatment effect, without establishing the needed mapping.

Common Mistake

Wrong reasoning: “The coefficient at \(k=-2\) is nonzero, so treated units must have had an effect two periods before adoption.” This treats the coefficient’s label as if it fixed the set of treatment-effect cells contributing to the estimate.

Correction: Under staggered adoption, the coefficient is a design-dependent linear combination of cohort-time effects. With heterogeneous post-adoption effects, some contributions to a lead can come from after adoption. A nonzero lead is therefore not, on its own, proof of anticipation or nonparallel untreated trends. Establishing its interpretation requires examining the regression’s comparison structure and the assumptions that identify its components.

Key takeaway: In a conventional staggered-adoption TWFE event study, event-time labels do not by themselves determine which treatment effects a coefficient summarizes. Heterogeneous effects after adoption can contaminate both lead and lag coefficients, including producing apparent pretrends when there is no anticipation.

Check Your Understanding

Answer each question by referring to the distinction between an event-time label and the regression’s projection weights.

  1. What does \(\operatorname{ATT}(g,t)\) represent, and how is event time \(k\) related to \(g\) and \(t\)?
  2. Why can a conventional lead coefficient be nonzero even when all true pre-adoption treatment effects are zero?
  3. In the worked projection for \(\beta_{-2}\), calculate the coefficient if the two post-adoption effects are \(6\) and \(8\) dollars per month.
  4. Why does a conventional lag coefficient not necessarily equal an equally weighted average of cohort-specific effects at that lag?
  5. Does a zero lead coefficient establish parallel trends? Give one reason it may not.
Clinical Biostats