Tutorials › Econometrics (Graduate) › Differencing Dynamic Panels And Deriving Moment Conditions

Dynamic Panel Models · Tutorial 300 of 952

Differencing Dynamic Panels And Deriving Moment Conditions

Learn how differencing removes individual effects and why outcome levels dated at least two periods earlier are orthogonal to the differenced error under appropriate initial-condition and error assumptions.

Advanced 9 min read

What You'll Learn

  • Difference a dynamic panel equation to eliminate its time-invariant individual effect.
  • State the timing and initial-condition assumptions needed for valid moments.
  • Derive orthogonality between lagged outcome levels and differenced errors.
  • Explain why the immediately preceding outcome level is not a valid instrument.
  • Distinguish population moment conditions from noisy sample moments.
  • Recognize the serial dependence that differencing induces in the errors.

Why Differencing Creates Dynamic-Panel Moments

A dynamic panel includes a lagged outcome among its regressors, so the outcome at one date carries information about outcomes at later dates. If the model also contains an unobserved individual effect, that effect is correlated with the lagged outcome. First-differencing removes the time-invariant effect, but it also transforms the error. The timing of the transformed error determines which earlier outcome levels can provide valid orthogonality conditions.

The objective here is to derive those conditions, not to construct an estimator. The central result is that, under suitable assumptions, an outcome level dated at least two periods before a differenced equation is orthogonal to that equation’s differenced error. The outcome level from just one period earlier generally is not.

Model: For individual \(i\) at time \(t\), consider the dynamic panel $$ y_{it}=\rho y_{i,t-1}+\eta_i+u_{it}, \qquad t=2,\ldots,T. $$ Here \(y_{it}\) is the outcome, \(\rho\) is a common autoregressive coefficient, \(\eta_i\) is an unobserved individual effect that does not vary over time, and \(u_{it}\) is an idiosyncratic error. The model is written without additional regressors to isolate the moments for the lagged outcome.

The assumptions concern both the errors and the initial conditions. A useful sufficient set is: \(u_{it}\) has mean zero; the idiosyncratic errors are serially uncorrelated, so \(E[u_{it}u_{is}]=0\) for \(t\ne s\); the errors are orthogonal to \(\eta_i\); and the initial outcome \(y_{i1}\) is orthogonal to the subsequent errors. A stronger, familiar way to express the timing restriction is that each \(u_{it}\) has conditional mean zero given \(\eta_i\), \(y_{i1}\), and the errors dated before \(t\). These assumptions rule out feedback from past outcomes or the individual effect into the current innovation.

Serial uncorrelatedness by itself is not a complete initial-condition assumption. If an initial outcome is correlated with later errors, an earlier outcome level can inherit that correlation, and the moment conditions below need not hold. The moment statements are population restrictions: they say that expected products are zero, not that every observed product must equal zero.

First-Differencing the Equation

Define the first difference of a variable as \(\Delta y_{it}=y_{it}-y_{i,t-1}\), and similarly \(\Delta u_{it}=u_{it}-u_{i,t-1}\). Subtract the model at \(t-1\) from the model at \(t\). The effect \(\eta_i\) appears in both equations and therefore cancels:

$$ \begin{aligned} y_{it}-y_{i,t-1} &=\rho(y_{i,t-1}-y_{i,t-2})+(u_{it}-u_{i,t-1}),\\ \Delta y_{it} &=\rho\Delta y_{i,t-1}+\Delta u_{it}, \qquad t=3,\ldots,T. \end{aligned} $$

The first-differenced equation has no individual effect. Its right-hand side still contains a lagged change in the outcome, and that regressor can be correlated with the differenced error. The key is to identify outcome levels with dates early enough to avoid both error terms in \(\Delta u_{it}=u_{it}-u_{i,t-1}\).

Worked Example: Removing an Individual Effect

Suppose a hypothetical individual follows \(y_{it}=0.5y_{i,t-1}+2+u_{it}\). The observed values are \(y_{i1}=10\), \(y_{i2}=9\), and \(y_{i3}=10.5\). Verify the differenced equation at \(t=3\).

The changes in the outcome are \(\Delta y_{i2}=9-10=-1\) and \(\Delta y_{i3}=10.5-9=1.5\). To check the error change from the level equation, calculate each error:

$$ u_{i2}=9-(0.5)(10)-2=2,\qquad u_{i3}=10.5-(0.5)(9)-2=4. $$

Thus \(\Delta u_{i3}=4-2=2\). Substitution into the differenced equation gives \(\rho\Delta y_{i2}+\Delta u_{i3}=(0.5)(-1)+2=1.5=\Delta y_{i3}\). The individual effect contributes \(2-2=0\) after subtraction, as required. This arithmetic illustrates the identity; it does not establish the stochastic assumptions needed for an instrument moment.

Deriving the Valid Lagged-Level Moments

At date \(t\), the differenced error contains \(u_{it}\) and \(u_{i,t-1}\). An outcome level dated \(t-2\) is determined by the individual effect, the initial outcome, and errors dated no later than \(t-2\). Under the stated timing and orthogonality assumptions, it is orthogonal to both errors in the difference. The same argument applies to any still earlier outcome level.

Moment conditions: Under the model and assumptions above, $$ E[y_{i,t-s}\Delta u_{it}]=0,\qquad s=2,\ldots,t-1,\quad t=3,\ldots,T. $$ Equivalently, every available outcome level dated \(t-2\) or earlier is orthogonal in expectation to the differenced error at \(t\). These are population orthogonality restrictions.

A short derivation makes the timing explicit. For \(s\ge2\), \(y_{i,t-s}\) is dated no later than \(t-2\). Since \(\Delta u_{it}=u_{it}-u_{i,t-1}\), linearity of expectation gives:

$$ \begin{aligned} E[y_{i,t-s}\Delta u_{it}] &=E[y_{i,t-s}u_{it}]-E[y_{i,t-s}u_{i,t-1}]\\ &=0-0=0. \end{aligned} $$

The two zero terms follow because the earlier outcome is orthogonal to both \(u_{it}\) and \(u_{i,t-1}\): neither error has entered that outcome, and the assumptions rule out correlation through the initial condition or individual effect. This argument relies on the model’s timing restrictions as well as serially uncorrelated errors.

Worked Example: Why the Second Lag Is Valid but the First Is Not

Consider \(t=4\), with serially uncorrelated errors of constant variance \(\sigma_u^2=4\), and suppose the initial-condition and timing assumptions hold. Assess \(y_{i2}\) and \(y_{i3}\) as potential instruments for the differenced equation at \(t=4\).

The differenced error is \(\Delta u_{i4}=u_{i4}-u_{i3}\). The level \(y_{i2}\) is dated before both errors. Therefore, $$ E[y_{i2}\Delta u_{i4}] =E[y_{i2}u_{i4}]-E[y_{i2}u_{i3}] =0-0=0. $$ So \(y_{i2}\) satisfies the moment condition.

By contrast, the level equation at \(t=3\) implies that \(y_{i3}\) contains \(u_{i3}\) with coefficient one. Under the assumptions, its covariance with \(u_{i4}\) is zero, while its covariance with \(u_{i3}\) is \(\operatorname{Var}(u_{i3})=4\). Hence $$ \operatorname{Cov}(y_{i3},\Delta u_{i4}) =\operatorname{Cov}(y_{i3},u_{i4})-\operatorname{Cov}(y_{i3},u_{i3}) =0-4=-4. $$ The immediately preceding level is not orthogonal to the differenced error. It is not made valid simply by differencing the equation.

Why the First Lag Fails

The failure of the immediately preceding level is a direct consequence of the error timing. The level \(y_{i,t-1}\) contains the innovation \(u_{i,t-1}\), and the differenced error subtracts that same innovation. Under the stated assumptions, the covariance is

$$ \operatorname{Cov}(y_{i,t-1},\Delta u_{it}) =\operatorname{Cov}(y_{i,t-1},u_{it}) -\operatorname{Cov}(y_{i,t-1},u_{i,t-1}) =-\operatorname{Var}(u_{i,t-1}), $$

which is nonzero when the idiosyncratic error has positive variance. The first lag is therefore generally invalid, while the second and deeper lags satisfy the derived moments under the assumptions. This distinction is about dates relative to the differenced error, not about whether a variable is called a “lag.”

Differencing also changes the serial dependence of the errors. Even if the level errors are serially uncorrelated and have common variance \(\sigma_u^2\), adjacent differenced errors share one level error with opposite signs:

$$ \operatorname{Cov}(\Delta u_{it},\Delta u_{i,t-1}) =\operatorname{Cov}(u_{it}-u_{i,t-1},u_{i,t-1}-u_{i,t-2}) =-\sigma_u^2. $$

Thus serially uncorrelated level errors do not imply serially uncorrelated differenced errors. This is another reason to derive instrument validity from the original error timing rather than assume that differencing leaves all error properties unchanged.

Worked Example: Reading the Moment Conditions Across Dates

For a hypothetical panel observed from \(t=1\) to \(t=5\), list the outcome levels that meet the timing rule for each differenced equation. The rule is \(s\ge2\), so an eligible level has date \(t-s\le t-2\).

At \(t=3\), the only available level dated at least two periods earlier is \(y_{i1}\). Its moment is \(E[y_{i1}\Delta u_{i3}]=0\).

At \(t=4\), the eligible levels are \(y_{i2}\) and \(y_{i1}\), giving \(E[y_{i2}\Delta u_{i4}]=0\) and \(E[y_{i1}\Delta u_{i4}]=0\).

At \(t=5\), the eligible levels are \(y_{i3}\), \(y_{i2}\), and \(y_{i1}\). The three restrictions are \(E[y_{i3}\Delta u_{i5}]=0\), \(E[y_{i2}\Delta u_{i5}]=0\), and \(E[y_{i1}\Delta u_{i5}]=0\). In contrast, \(y_{i4}\) is excluded because it is only one period earlier and contains \(u_{i4}\), which appears with a negative sign in \(\Delta u_{i5}\).

These restrictions apply to expectations over the population of individuals. In a finite sample, an average product such as \(n^{-1}\sum_i y_{i,t-2}\Delta u_{it}\) need not equal zero exactly. A nonzero sample value alone does not contradict a zero population moment; sampling variation can produce such a value.

Assumptions, Interpretation, and Common Pitfalls

The derived moments are useful only when their assumptions are credible. If the level errors have serial correlation, an earlier outcome may be correlated with \(u_{i,t-1}\), even when its date makes it appear safely remote. If the initial outcome is correlated with later innovations, the same problem can arise. In either case, the zero covariance step in the derivation is not justified and the stated moments may fail.

A frequent mistake is to say, “The individual effect has been differenced out, so every lagged outcome is a valid instrument.” Differencing removes \(\eta_i\), but does not remove the overlap between \(y_{i,t-1}\) and \(u_{i,t-1}\). The correction is to inspect the transformed error term and exclude the outcome dated \(t-1\); under the required timing assumptions, use levels dated \(t-2\) or earlier for the differenced equation.

A second pitfall is to treat the moment condition as a statement about each individual or each observed sample product. \(E[y_{i,t-s}\Delta u_{it}]=0\) is an expectation restriction. Individual products can be positive or negative, and their finite-sample average can differ from zero. The condition supplies a basis for later estimation procedures; it is not a claim that realized data satisfy an exact identity.

Key takeaway: First-differencing the dynamic panel eliminates the time-invariant individual effect and produces the error \(\Delta u_{it}=u_{it}-u_{i,t-1}\). With appropriate initial-condition and error-timing assumptions, \(y_{i,t-2}\) and deeper outcome levels are orthogonal to that error; \(y_{i,t-1}\) generally is not.

Check Your Understanding

Use the model and assumptions stated above to answer the following questions.

  1. Write the first-differenced equation and identify the term that disappears.
  2. For the equation at date \(t\), which outcome-level dates meet the timing rule for the lagged-level moments?
  3. Explain why \(y_{i,t-1}\) is generally correlated with \(\Delta u_{it}\), even though the level errors are serially uncorrelated.
  4. Why does serial uncorrelatedness alone not guarantee the moment conditions if the initial outcome is correlated with later errors?
  5. Does a nonzero sample average of \(y_{i,t-2}\Delta u_{it}\) prove that the population moment is nonzero? Explain.
Clinical Biostats