Tutorials › Econometrics (Graduate) › Long-Panel Asymptotics And Within Estimation

Dynamic Panel Models · Tutorial 318 of 952

Long-Panel Asymptotics And Within Estimation

Learn when longer panels make within estimation attractive, how its leading bias depends on the asymptotic regime, and why the number of units still matters for inference.

Advanced 12 min read

What You'll Learn

  • State the stationary dynamic-panel model and conditions used for the long-\(T\) bias result.
  • Derive the leading within-estimator bias when the large-\(N\) limit is taken before \(T\) grows.
  • Distinguish that sequential-limit result from fixed-\(N\) finite-sample bias.
  • Assess how increasing \(N\) and increasing \(T\) affect bias and sampling uncertainty differently.
  • Compare long-panel within estimation with dynamic-panel GMM in their usual panel-dimension settings.
  • Recognize why a long time dimension does not, by itself, settle inference or model validity.

Why the Time Dimension Matters

In a dynamic panel, the lagged outcome is correlated with the unit-specific effect. The within transformation removes that effect, but it also makes the transformed lagged outcome correlated with the transformed error. This is the source of the familiar finite-\(T\) bias in dynamic fixed-effects estimation. Unlike a bias that disappears merely by adding more units while holding \(T\) fixed, this bias can shrink as the time dimension grows.

The phrase “the bias shrinks with \(T\)” needs qualification. A leading bias formula depends on the asymptotic regime and on the assumptions about the panel. In particular, the standard leading formula below is for a large-\(N\) limit at fixed \(T\), followed by an expansion as \(T\) increases. It is not a universal finite-sample formula for every \(N\).

Model and assumptions: Consider a balanced panel with \(N\) units observed for \(t=1,\ldots,T\): \(y_{it}=\alpha_i+\rho y_{i,t-1}+u_{it}\). Assume \(|\rho|<1\), a stationary initial condition, and errors \(u_{it}\) that are independent across units and over time, have mean zero and variance \(\sigma^2\), and are independent of the past. The unit effect \(\alpha_i\) is constant over time. For the leading bias result, also take the large-\(N\) limit at fixed \(T\) before letting \(T\) grow.

The stationarity and error assumptions make the calculations below transparent; they are not innocuous details. For example, persistent common shocks, serial correlation in \(u_{it}\), nonstationary initial conditions, or a different dynamic specification can change the bias and the appropriate inference. The tutorial focuses on the coefficient \(\rho\), not on adding regressors or specifying a broader model.

Within Estimation and Its Large-\(N\) Limit

For each unit, let \(\bar{y}_i=T^{-1}\sum_{t=1}^{T}y_{it}\), \(\bar{y}_{i,-1}=T^{-1}\sum_{t=1}^{T}y_{i,t-1}\), and \(\bar{u}_i=T^{-1}\sum_{t=1}^{T}u_{it}\). The within estimator applies unit demeaning and regresses demeaned \(y_{it}\) on demeaned \(y_{i,t-1}\):

$$ \hat{\rho}_{W} = \frac{\displaystyle\sum_{i=1}^{N}\sum_{t=1}^{T} (y_{i,t-1}-\bar{y}_{i,-1})(y_{it}-\bar{y}_i)} {\displaystyle\sum_{i=1}^{N}\sum_{t=1}^{T} (y_{i,t-1}-\bar{y}_{i,-1})^2}. $$

Because \(y_{it}=\alpha_i+\rho y_{i,t-1}+u_{it}\), subtracting unit means removes \(\alpha_i\). The resulting transformed error is \(u_{it}-\bar{u}_i\), which is generally correlated with \(y_{i,t-1}-\bar{y}_{i,-1}\). Thus removing the fixed effect does not make the within regression an ordinary regression with an exogenous regressor.

When \(N\) grows with \(T\) fixed, independent units allow the numerator and denominator, each divided by \(N\), to converge to their unit-level expectations. The ratio of those limits is a probability limit, not generally the expectation of the finite-\(N\) ratio. Expanding that probability limit for large \(T\) gives the standard leading result:

Result (sequential large-\(N\), then large-\(T\) limit): Under the stated stationary AR(1) assumptions, the probability limit of the within estimator has leading bias \(\operatorname{plim}_{N\to\infty}\hat{\rho}_W-\rho=-(1+\rho)/T+O(T^{-2})\) as \(T\) grows. Equivalently, the leading term may be written \(-(1+\rho)/(T-1)\), since the two expressions differ only by terms of order \(T^{-2}\). This is a large-\(N\) limit result, not a general fixed-\(N\) formula.

Why the Leading Bias Is of Order \(1/T\)

A short derivation shows both the direction and the scale of the effect. Write \(x_{it}=y_{i,t-1}\). In the within regression, the numerator of \(\hat{\rho}_W-\rho\) is the sum of demeaned \(x_{it}\) times demeaned \(u_{it}\). For one unit, its expectation is \(\operatorname{E}[\sum_t(x_{it}-\bar{x}_i)(u_{it}-\bar{u}_i)]\). The untransformed terms have zero expectation because \(x_{it}\) is dated before \(u_{it}\). The remaining contribution is \(-T\operatorname{E}[\bar{x}_i\bar{u}_i]\), or equivalently \(-T^{-1}\operatorname{Cov}(\sum_t x_{it},\sum_t u_{it})\).

Under the stationary AR(1) model, \(x_{it}\) contains past errors with geometrically declining weights. Summing the covariances across dates therefore gives \(\operatorname{Cov}(\sum_t x_{it},\sum_t u_{it})=T\sigma^2/(1-\rho)+O(1)\). Consequently, the expected demeaned numerator for one unit is \(-\sigma^2/(1-\rho)+O(T^{-1})\): it is of constant order in \(T\), not of order \(T\).

The denominator for one unit is the sum of squared demeaned lagged outcomes. Stationarity implies that its leading term is \(T\operatorname{Var}(y_{i,t-1})\). Since \(\operatorname{Var}(y_{i,t-1})=\sigma^2/(1-\rho^2)\), that denominator is \(T\sigma^2/(1-\rho^2)+O(1)\). Dividing the two leading terms yields

$$ \frac{-\sigma^2/(1-\rho)} {T\sigma^2/(1-\rho^2)} = -\frac{1+\rho}{T}. $$

The bias is negative for \(-1<\rho<1\). For positive persistence, it pulls the within estimate downward. The calculation also explains the order \(1/T\): the demeaning-induced numerator is of constant order, while the regressor’s sum of squares grows in proportion to \(T\). The ratio-of-expectations reasoning here applies to the large-\(N\) probability limit; it does not justify replacing the expectation of a finite-sample random ratio by a ratio of expectations.

Worked Example: Interpreting the Leading Bias at \(T=40\)

Suppose the true persistence parameter is \(\rho=0.60\), with stationary AR(1) errors as specified above. Consider the sequential regime: first \(N\) grows at fixed \(T\), then \(T=40\) is treated as large enough for the leading expansion to be informative.

Leading bias. Substitute the values into the expansion:

$$ -\frac{1+\rho}{T} = -\frac{1+0.60}{40} = -\frac{1.60}{40} = -0.0400. $$

Thus the large-\(N\) probability limit is approximately \(\rho-0.0400=0.560\), up to terms of order \(T^{-2}\). This is a bias approximation under the stated model and sequential limit, not a prediction that every realized estimate will equal \(0.560\). Sampling variation remains, and the omitted higher-order terms need not be negligible in every application.

Worked Example: Comparing Two Time Dimensions

Keep \(\rho=0.60\) and the same assumptions, and compare panels with \(T=20\) and \(T=80\). Use the same sequential large-\(N\) interpretation for both.

At \(T=20\), the leading bias is \(-1.60/20=-0.0800\), so the leading approximation to the probability limit is \(0.60-0.0800=0.520\).

At \(T=80\), the leading bias is \(-1.60/80=-0.0200\), so the corresponding approximation is \(0.60-0.0200=0.580\).

The time dimension is four times as large in the second panel, and the leading bias magnitude is one quarter as large. This comparison concerns the bias term only. It does not say that the estimate from \(T=80\) must be closer to \(0.60\) in a particular data set, because realized estimation error also depends on sampling variation and model validity.

What Changes When \(N\) Is Fixed?

The preceding result is deliberately stated with its asymptotic order made explicit. With fixed \(N\), the within estimator is still consistent as \(T\) grows under suitable stationarity, ergodicity, and nondegeneracy conditions. But its finite-\(T\) expected bias is not generally given by the large-\(N\) leading formula. At fixed \(N\), the estimator is a random ratio, and the numerator and denominator are dependent. Taking the expectation of that ratio introduces a correction that is not captured by the ratio of their expectations.

For example, in a one-unit stationary Gaussian AR(1) calculation, the leading finite-\(T\) bias can be \(-(1+3\rho)/T\), rather than the large-\(N\) expression \(-(1+\rho)/T\). The point is not to substitute that one-unit expression into other settings; it is to recognize that the regime matters. A finite-\(N\) panel, a large-\(N\) probability limit, and a joint growth of \(N\) and \(T\) are distinct asymptotic questions.

Worked Example: Why More Units Do Not Remove Fixed-\(T\) Bias

Consider \(\rho=0.60\) and hold \(T=20\) fixed. Under the large-\(N\) sequential calculation, the within estimator’s probability limit is approximately \(0.520\), because its leading bias is \(-0.0800\).

Increasing \(N\) from 50 to 500 supplies more independent units under the assumed cross-unit independence. It can reduce sampling variation around the fixed-\(T\) probability limit, but it does not change that limit from approximately \(0.520\) to \(0.600\). To reduce this leading dynamic fixed-effects bias, \(T\) must also grow, or an appropriate bias correction or alternative estimator must be used.

This calculation does not give the standard error for either panel. That requires an inference procedure suited to the estimator and the dependence structure. It only distinguishes a bias that persists in the fixed-\(T\), large-\(N\) limit from sampling variation that can decrease as the number of independent units increases.

Long-Panel Within Estimation and Dynamic-Panel GMM

Dynamic-panel GMM is commonly motivated by panels with many units and a relatively short time dimension. Difference-GMM uses moment conditions based on lagged levels, while system GMM adds level-equation moments under additional assumptions. Those methods can address the short-\(T\) dynamic fixed-effects problem, but their performance depends on the validity and strength of the moments and on instrument choices. Earlier material on instrument proliferation and finite-sample GMM inference is relevant when applying them; a large instrument set is not automatically an advantage.

When \(T\) is sufficiently long, within estimation becomes more attractive because its leading dynamic bias shrinks with \(T\), and it avoids constructing a large lag-instrument set. This is a comparison of approaches, not a rule that within estimation is always preferable for a long panel. The result above depends on a correctly specified, stationary dynamic model and suitable error assumptions. If these fail, increasing \(T\) does not repair misspecification or invalid assumptions.

Panel featureImplication for within estimationImplication for dynamic-panel GMM
Many units, short \(T\)The large-\(N\) limit can retain dynamic fixed-effects bias.Often the motivating setting, subject to valid moments and careful instrument choice.
Longer \(T\)The leading bias is of order \(1/T\) under the stated model.The instrument set can grow with the time dimension, so instrument management remains important.
Few unitsMore time observations may help consistency under time-series conditions, but inference still needs justification.Large-\(N\) approximations may be unreliable when the number of units is limited.

The dimensions also matter for inference. If units are independent, adding units supplies more independent cross-sectional information. Adding time observations supplies additional within-unit information, but observations from the same unit are linked by the dynamic process. Therefore, “more observations” is not by itself a complete description of precision: one must state which dimension grows and what dependence assumptions justify the standard errors. The later subject of panel inference treats dependence structures and covariance estimation in detail.

Common Mistakes and Practical Checks

  • Using the large-\(N\) bias formula at fixed \(N\) without qualification. The leading formula \(-(1+\rho)/T\) is for a specified sequential limit. A finite-\(N\) expectation involves the dependence between a random numerator and denominator.
  • Assuming that adding units removes the dynamic fixed-effects bias. At fixed \(T\), the large-\(N\) probability limit can remain biased. More units mainly sharpen estimation around that limit under cross-unit independence.
  • Treating the leading expansion as an exact correction. The omitted \(O(T^{-2})\) terms matter more when \(T\) is modest. Do not mechanically add \((1+\hat{\rho})/T\) to an estimate and call the result unbiased.
  • Concluding that a long panel guarantees valid inference. Long \(T\) can reduce this particular bias under the model; it does not establish stationarity, rule out serial or cross-sectional dependence, or validate the chosen standard errors.
  • Choosing between within and GMM from dimensions alone. The time and unit dimensions guide the asymptotic approximation, but moment validity, instrument strength, model specification, and the intended inference also matter.
Key takeaway: In a stationary dynamic AR(1) panel, the within estimator’s leading bias is approximately \(-(1+\rho)/T\) in the large-\(N\)-first regime. The bias shrinks as \(T\) grows, but the formula is not a universal fixed-\(N\) expectation, and increasing \(N\) alone does not remove fixed-\(T\) bias.

Check Your Understanding

Use the assumptions and asymptotic qualifications stated above.

  1. For \(\rho=0.40\) and \(T=50\), calculate the leading large-\(N\) bias and the corresponding approximation to the within estimator’s probability limit.
  2. Why can increasing \(N\) at fixed \(T\) reduce sampling variation without removing the dynamic fixed-effects bias?
  3. What is the distinction between taking \(N\) large at fixed \(T\) and analyzing a fixed-\(N\) panel as \(T\) grows?
  4. Explain why the within estimator’s leading bias is of order \(1/T\) in the stated derivation.
  5. Name one reason dynamic-panel GMM may be useful in a short panel and one concern that remains when \(T\) becomes long.
Clinical Biostats