Tutorials › Econometrics (Graduate) › Common Correlated Effects Estimation

Panel Dependence and Inference · Tutorial 333 of 952

Common Correlated Effects Estimation

Learn how cross-sectional averages can proxy for unobserved common factors in panel regressions, and how CCE estimation uses those proxies to estimate heterogeneous or common slopes.

Advanced 12 min read

What You'll Learn

  • Construct the cross-sectional averages used as common-factor proxies.
  • Understand why averages can span the space of pervasive unobserved factors.
  • Specify unit-specific CCE regressions and the CCE mean-group estimator.
  • Distinguish heterogeneous-slope and common-slope CCE targets.
  • Identify rank, dependence, and asymptotic conditions supporting consistency.
  • Recognize when CCE augmentation may fail or leave coefficients unidentified.

Why Augment a Panel Regression?

A panel regression can be misleading when an unobserved shock affects many units at once. For example, a change in financing conditions may influence each unit’s outcome and its regressors, but with a different strength for each unit. If that common influence is omitted, a regressor’s coefficient can partly reflect the shock rather than its own relationship with the outcome.

Common correlated effects (CCE) estimation addresses this problem without requiring the researcher to estimate each common factor directly. It augments the regression with cross-sectional averages of the outcome and regressors. Under suitable conditions, these averages provide proxies for the factor space. The method is useful when units may respond heterogeneously to common shocks and regressors may be correlated with those shocks.

Definition: Let \(y_{it}\) be a scalar outcome and \(x_{it}\) a \(k\)-vector of regressors for unit \(i\) at time \(t\). The cross-sectional averages are \(\bar y_t=N^{-1}\sum_{i=1}^{N}y_{it}\) and \(\bar x_t=N^{-1}\sum_{i=1}^{N}x_{it}\). The CCE augmentation uses these averages, collected as \(\bar z_t=(\bar y_t,\bar x_t')'\), as additional regressors in the unit-level equation.

A common-factor representation helps explain the method. One useful specification is

$$ y_{it}=\alpha_i'd_t+\beta_i'x_{it}+\lambda_i'f_t+\varepsilon_{it}, \qquad x_{it}=\Gamma_i'd_t+\Lambda_i'f_t+v_{it}. $$

Here \(f_t\) is an \(r\)-vector of unobserved common factors; \(\lambda_i\) and \(\Lambda_i\) are unit-specific factor loadings; \(d_t\) contains observed common controls, such as deterministic terms; and \(\varepsilon_{it}\) and \(v_{it}\) are idiosyncratic components. The loadings allow the same factor to affect different units with different magnitudes and signs. The central difficulty is that \(f_t\) can be correlated with \(x_{it}\), so treating it as part of an ordinary regression error can invalidate the slope estimate.

Why Cross-Sectional Averages Proxy for Factors

Average the unit-level equations across \(i\). If the common factors affect a non-negligible share of units, the averages inherit their time variation. In a simplified factor-driven regressor equation, for example, \(\bar x_t\) contains the term \(\left(N^{-1}\sum_i\Lambda_i\right)f_t\). The average of the idiosyncratic components may become small as \(N\) grows when those components are sufficiently weakly dependent across units. The outcome average also carries common-factor variation through its loadings and through the factor-driven regressors.

The key requirement is not that an average equal a factor. Rather, the matrix of factor loadings in the averages must contain enough independent information to span the relevant factor space. If \(r\) factors matter, the population loading matrix linking \(\bar z_t\) to \(f_t\) must have rank \(r\). Then the averages can represent the factors up to a nonsingular linear transformation, with remaining terms that become negligible under the asymptotic conditions.

Worked Example: Computing Cross-Sectional Proxies

Consider hypothetical observations for four units at two dates. Suppose the values are as follows:

DateUnit 1 \(x_{it}\)Unit 2 \(x_{it}\)Unit 3 \(x_{it}\)Unit 4 \(x_{it}\)Unit 1 \(y_{it}\)Unit 2 \(y_{it}\)Unit 3 \(y_{it}\)Unit 4 \(y_{it}\)
112344567
22345681012

At date 1, the averages are

$$ \bar x_1=\frac{1+2+3+4}{4}=2.5, \qquad \bar y_1=\frac{4+5+6+7}{4}=5.5. $$

At date 2, they are

$$ \bar x_2=\frac{2+3+4+5}{4}=3.5, \qquad \bar y_2=\frac{6+8+10+12}{4}=9. $$

Both averages change across dates, so they can carry information about common time variation. This calculation alone does not establish that they span any particular factor space: that depends on the loading rank and the behavior of idiosyncratic components as the number of units grows. In an applied CCE regression, the averages are constructed for each date and included as regressors for the units.

CCE Regressions and Their Targets

For each unit, the CCE regression includes the observed regressors, any observed common controls, and the cross-sectional averages. A standard unit-specific form is

$$ y_{it}=\alpha_i'd_t+\beta_i'x_{it}+\delta_i'\bar z_t+u_{it}^{*}. $$

The coefficient \(\delta_i\) is a nuisance coefficient: its purpose is to absorb the common variation represented by the averages, not to give a structural interpretation to each average. The slope of substantive interest is \(\beta_i\). Estimating a separate regression for each unit yields \(\hat\beta_i\); the CCE mean-group estimator is the unweighted average of those estimates:

$$ \hat\beta_{\mathrm{CCE\text{-}MG}}=\frac{1}{N}\sum_{i=1}^{N}\hat\beta_i. $$

This estimator allows the slopes to differ across units. Its target is the cross-unit average slope, provided the units and asymptotic framework support that interpretation. A pooled CCE specification instead imposes a common slope \(\beta_i=\beta\) and estimates a shared slope while allowing the common-factor controls—and, in appropriate specifications, unit intercepts or other nuisance terms—to absorb unit-specific features. The choice between these approaches is substantive: pooling is not merely a computational shortcut if slope heterogeneity is present.

Worked Example: A CCE Slope After Partialling Out Averages

Suppose a hypothetical six-period regression for one unit includes an intercept and the cross-sectional averages \(\bar y_t\) and \(\bar x_t\) as controls. Let \(W\) denote those three control columns. After projecting \(x_{it}\) and \(y_{it}\) on \(W\), suppose the residualized values are:

PeriodResidualized \(x_{it}\)Residualized \(y_{it}\)
1-2-3
2-1-4
310
425
501
601

By the partial-regression formula, the OLS coefficient on \(x_{it}\) in the augmented regression is the inner product of the residualized regressor and outcome divided by the residualized regressor’s sum of squares:

$$ \hat\beta_i= \frac{\sum_t\tilde x_{it}\tilde y_{it}}{\sum_t\tilde x_{it}^{\,2}} = \frac{(-2)(-3)+(-1)(-4)+(1)(0)+(2)(5)+(0)(1)+(0)(1)} {(-2)^2+(-1)^2+1^2+2^2+0^2+0^2} = \frac{20}{10}=2. $$

Thus the fitted CCE slope for this unit is 2 outcome units per unit of \(x\), conditional on the included averages and intercept. This calculation illustrates the role of the augmentation: the slope is estimated from the part of \(x_{it}\) and \(y_{it}\) left after their linear association with the controls has been removed. The example does not establish that the factor proxies are adequate; that conclusion requires the model and rank conditions discussed below.

Key result: If the cross-sectional averages span the relevant common-factor space asymptotically, and the regressors retain sufficient variation after controlling for the averages and observed controls, the augmented regression can remove the omitted common-factor component that would otherwise confound slope estimation.

Factor-Proxy Argument: A Short Justification

The logic can be stated as a linear-algebra argument. Suppose the vector of cross-sectional averages has the representation \(\bar z_t=A f_t+r_t\), where \(A\) is a loading matrix and \(r_t\) is a remainder that becomes negligible as \(N\) grows. If \(A\) has full column rank \(r\), there is a left inverse \(L\) such that \(LA=I_r\). Consequently,

$$ L\bar z_t=L(Af_t+r_t)=f_t+Lr_t. $$

As the remainder becomes small, linear combinations of the averages approximate the factors. Since the CCE regression includes the averages themselves, it also includes their linear combinations. The component \(\lambda_i'f_t\) can therefore be represented, up to a small remainder, by a linear combination of the included averages. This explains why the augmentation can control for common factors without estimating \(f_t\) or the factor loadings directly.

This argument depends on both parts of the condition. If \(A\) lacks full column rank, no left inverse can recover all \(r\) factor directions. If the remainder does not become negligible, averages may retain substantial idiosyncratic noise rather than acting as reliable proxies. And even with adequate proxies, the slope is not identified if \(x_{it}\) has no variation left after the controls are partialled out.

Conditions for Credible CCE Estimation

CCE consistency is an asymptotic result, not a guarantee from adding averages mechanically. The precise assumptions depend on the specification and whether the target is a unit-specific slope, a mean-group slope, or a pooled common slope. The main conditions have a common interpretation:

  • Relevant factors are represented. The factors driving the outcome and the regressors must be captured by the factor space spanned by the averages. The average-loading matrix must have sufficient rank.
  • Cross-sectional averages are informative. The factors must affect enough units, and idiosyncratic components must be sufficiently weakly dependent across units for their averages to become negligible or otherwise well behaved.
  • There is usable time-series variation. After controlling for the averages and any included common terms, the regressors must retain enough variation to identify the slopes. Exact or asymptotic collinearity prevents identification.
  • The asymptotic regime supports the approximation. Many CCE arguments rely on a large cross-section \(N\) so the averages proxy for factors, and a sufficiently informative time dimension \(T\) for the unit regressions. The required joint growth conditions depend on the result being used.
  • The slope restriction matches the target. CCE mean group allows heterogeneous slopes; pooled CCE imposes a common slope. Consistency for one target does not imply consistency for the other when the restriction is wrong.

The augmentation handles dependence generated by the represented common factors; it does not automatically correct every form of dependence or endogeneity. Strong spatial structure not captured by the averages, missing common drivers, measurement problems, or feedback that violates the regression’s identifying assumptions may still cause difficulty. CCE is a factor-robust estimation strategy under stated conditions, not a substitute for specifying a credible model.

Worked Example: Forming a Mean-Group Estimate

Suppose four hypothetical units have CCE slope estimates of 1.2, 0.8, 1.5, and 1.1. The mean-group estimate is

$$ \hat\beta_{\mathrm{CCE\text{-}MG}} =\frac{1.2+0.8+1.5+1.1}{4} =\frac{4.6}{4} =1.15. $$

If \(y\) is measured in dollars and \(x\) in hours, the estimate is 1.15 dollars per hour: the unweighted average of the four unit-specific CCE slopes. It is not the slope from pooling all unit-period observations, and it does not assert that every unit has a slope of 1.15. Its interpretation as an average for a broader population also depends on how the units were selected and on the relevant sampling assumptions.

Common Mistakes and Practical Checks

A frequent mistake is to treat \(\bar y_t\) and \(\bar x_t\) as observed factors and interpret their regression coefficients as factor loadings. They are proxies built from observed panel variables; their coefficients are nuisance controls, and generally do not identify the underlying factors or loadings. A second mistake is to assume that including averages guarantees consistency. If their loading matrix does not span all relevant factors, or if the regressor is collinear with the augmentation, the intended slope may not be identified consistently.

Before interpreting a CCE estimate, check which slope target is being estimated, how the averages are constructed, whether the factor-proxy rank condition is plausible, and whether enough within-unit time variation remains after augmentation. Also distinguish the CCE estimator from subsequent inference: estimating factors or accounting for uncertainty in factor estimation can require additional procedures.

1
Specify the target and panel equation.
Decide whether slopes may vary by unit or are restricted to be common, and identify the potential common-factor component.
2
Construct date-specific averages.
Compute \(\bar y_t\) and each component of \(\bar x_t\) across the units observed at date \(t\).
3
Augment and estimate.
Include the averages with the observed regressors and controls; estimate unit-specific slopes for mean group, or impose the common-slope restriction for pooled CCE.
4
Assess whether the proxy argument is credible.
Consider factor-loading rank, cross-sectional behavior of idiosyncratic components, remaining regressor variation, and the asymptotic regime.

Check Your Understanding

Answer each question by referring to the factor-proxy logic and the estimator’s target.

  1. Why can the cross-sectional average of a regressor contain information about an unobserved common factor?
  2. What rank condition is needed for the averages to span a space generated by \(r\) relevant factors?
  3. In a CCE mean-group regression, what does the reported slope estimate average across units?
  4. Why does including \(\bar y_t\) and \(\bar x_t\) not guarantee that every omitted common factor has been controlled for?
  5. What happens to slope identification if \(x_{it}\) has no variation after it is projected on the intercept and cross-sectional averages?
Clinical Biostats