Tutorials › Econometrics (Graduate) › Testing Slope Homogeneity Across Units

Panel Designs and Unbalanced Data · Tutorial 290 of 952

Testing Slope Homogeneity Across Units

Formulate and interpret panel slope-homogeneity tests, then assess whether unequal time coverage changes the evidence or its practical meaning.

Intermediate 11 min read

What You'll Learn

  • State the null hypothesis that all units share the same slope vector.
  • Construct restrictions and a Wald statistic for testing slope equality.
  • Identify the covariance and asymptotic assumptions needed for the test.
  • Distinguish a statistically detectable difference from practically important heterogeneity.
  • Examine how unequal time coverage can change slope estimates and test precision.
  • Use common-support checks to assess sensitivity to unequal coverage.

Why Test Whether Panel Slopes Are Common?

A pooled panel regression imposes a common relationship between the regressors and outcome across units. That restriction can be useful, but it may conceal meaningful differences: a one-unit increase in a regressor might have a different association with the outcome in different firms, regions, or people. A slope-homogeneity test asks whether the observed unit-specific slopes are sufficiently inconsistent with a common slope vector to reject that restriction.

The question is not whether the units have the same outcomes or intercepts. In the model below, intercepts may differ freely. The test concerns only the coefficients on the regressors. It also does not establish that a regressor causes an outcome; interpretation remains conditional on the model and its identifying assumptions.

Definition: In a panel regression with \(N\) units and \(p\) regressors, slope homogeneity means that each unit has the same \(p\)-dimensional slope vector. Slope heterogeneity means that at least one unit's slope vector differs from another's. Neither term requires the unit intercepts to be equal.

Model and Hypotheses

Let \(y_{it}\) be the outcome for unit \(i\) at time \(t\), and let \(x_{it}\) be a \(p\)-vector of regressors. Unit \(i\) is observed for the periods in its set \(T_i\), which may differ across units. Consider the unit-specific linear model

$$ y_{it}=a_i+x_{it}'\beta_i+u_{it}, \qquad t\in T_i,\quad i=1,\ldots,N. $$

Here \(a_i\) is a unit-specific intercept, \(\beta_i\) is the unit-specific slope vector, and \(u_{it}\) is the error. This specification is conditional on the chosen regressors and other stated modeling choices. It does not itself ensure that the regressors are exogenous or that the model is correctly specified.

The null hypothesis is that every unit's slope vector equals a common vector. A convenient set of restrictions compares each unit after the first with unit 1:

$$ H_0:\ \beta_2-\beta_1=0,\ \ldots,\ \beta_N-\beta_1=0 \qquad\text{against}\qquad H_a:\ \text{at least one of these differences is nonzero}. $$

There are \(q=(N-1)p\) restrictions when all \(p\) slopes are tested for all \(N\) units. The choice of unit 1 as the reference is only a way to write the restrictions; equality across all units does not depend on which unit is used as the reference. If only selected slopes are of interest, the test can instead impose equality on those slopes alone.

Worked Example: Writing the Restrictions

Suppose three hypothetical regions have two regressors, \(x_1\) and \(x_2\), and each region has its own slope vector. Write the joint null for common slopes and count the restrictions.

Let \(\beta_i=(\beta_{i1},\beta_{i2})'\) be the slope vector for region \(i\). Using region 1 as the reference, the restrictions are

$$ \beta_{21}-\beta_{11}=0,\quad \beta_{22}-\beta_{12}=0,\quad \beta_{31}-\beta_{11}=0,\quad \beta_{32}-\beta_{12}=0. $$

There are \(q=(3-1)2=4\) restrictions. The intercepts \(a_1,a_2,a_3\) are not constrained by this null. A rejection would say that the data provide evidence against at least one of the four slope equalities, not that all four equalities must be false.

The Wald Test for Slope Homogeneity

Stack the unit-specific slopes into a vector \(\beta=(\beta_1',\ldots,\beta_N')'\). Write the restrictions as \(R\beta=0\), where \(R\) is a matrix that forms the chosen slope differences. Estimate the unit-specific slopes, producing \(\widehat{\beta}\), and estimate their covariance matrix, \(\widehat{V}_{\beta}\). Then the estimated restriction vector and its covariance are

$$ \widehat{d}=R\widehat{\beta}, \qquad \widehat{V}_{d}=R\widehat{V}_{\beta}R'. $$

The Wald statistic measures the size of the estimated differences relative to their joint uncertainty. Provided \(\widehat{V}_d\) is nonsingular, it is

$$ W=\widehat{d}'\widehat{V}_{d}^{-1}\widehat{d}. $$

For a large-sample test, compare \(W\) with a chi-square distribution with \(q\) degrees of freedom under the null. The resulting p-value is the upper-tail probability \(P(\chi^2_q\geq W)\). This reference approximation requires the slope estimates to have an appropriate joint asymptotic distribution, a consistent covariance estimate, and identifiable restrictions. In panel applications, the covariance calculation must reflect the assumed error dependence and the sampling design; simply treating repeated observations as independent when they are not can give misleading standard errors and tests. If each unit has too few observed periods to estimate its slopes precisely, a large-sample approximation may be unreliable.

Test procedure: Estimate the unit-specific slopes under the stated model, form the slope-equality restrictions, and obtain their covariance using an estimator appropriate to the error dependence. Compute \(W\), use the chi-square reference distribution with \(q\) degrees of freedom when its asymptotic conditions are credible, and report the p-value alongside the estimated differences and their units.

Worked Example: A Joint Wald Test for Two Slopes

Consider two hypothetical units and two regressors. The estimated slope difference, unit 2 minus unit 1, is \(\widehat{d}=(0.35,-0.30)'\). Suppose its estimated covariance matrix is

$$ \widehat{V}_{d}= \begin{pmatrix} 0.040 & 0.010\\ 0.010 & 0.050 \end{pmatrix}. $$

The diagonal entries are the estimated variances of the two slope differences; the off-diagonal entry accounts for their covariance. The determinant is \(0.040(0.050)-(0.010)^2=0.0019\), so the inverse is

$$ \widehat{V}_{d}^{-1} =\frac{1}{0.0019} \begin{pmatrix} 0.050 & -0.010\\ -0.010 & 0.040 \end{pmatrix}. $$

There are two restrictions, so \(q=2\). Substituting the estimates into the quadratic form gives

$$ W =\frac{0.050(0.35)^2+2(-0.010)(0.35)(-0.30)+0.040(-0.30)^2}{0.0019} =\frac{0.006125+0.002100+0.003600}{0.0019} =\frac{0.011825}{0.0019} =6.224. $$

For a chi-square distribution with two degrees of freedom, the upper-tail probability is \(P(\chi^2_2\geq 6.224)=\exp(-6.224/2)\approx0.04452\). At the 5% level, this rejects the joint null under the stated large-sample reference approximation. The estimated differences suggest that unit 2's first slope is 0.35 units higher and its second slope 0.30 units lower than unit 1's. The test does not say which difference is responsible for the rejection, and a very small number of units would make reliance on a large-sample approximation especially cautious.

What a Rejection Does—and Does Not—Establish

A rejection is evidence against the exact equality restrictions, conditional on the specification, covariance estimator, and reference approximation. It does not show that every unit has a different slope. Nor does a small p-value measure the size or importance of the differences. With highly precise estimates, even modest differences can be statistically detectable; with imprecise estimates, substantial differences can remain uncertain.

For interpretation, report the unit-specific slope estimates or contrasts as well as the joint test. A coefficient difference should be described in the outcome units associated with a one-unit change in its regressor, holding the model's other regressors fixed. Whether that difference matters substantively depends on the scale of the outcome and regressor, the application, and the consequences of using a common-slope approximation.

Worked Example: Statistical Evidence and Practical Size

Suppose a hypothetical model relates weekly sales, measured in thousands of dollars, to advertising expenditure, measured in thousands of dollars. Two units have estimated slopes of 0.42 and 0.71, with a standard error of 0.08 for their estimated difference. Interpret the difference and its test statistic.

The estimated difference, unit 2 minus unit 1, is \(0.71-0.42=0.29\). In the model's units, an additional thousand dollars of advertising is associated with an estimated increase in weekly sales of 0.29 thousand dollars more in unit 2 than in unit 1. This is a slope contrast, not a causal effect unless the model's causal assumptions are justified.

For the single equality restriction, the Wald statistic is

$$ W=\frac{(0.29)^2}{(0.08)^2} =\frac{0.0841}{0.0064} =13.14. $$

Using a chi-square reference distribution with one degree of freedom gives a p-value of approximately 0.00029. This is strong statistical evidence against equal slopes under the stated approximation. Whether a 0.29-thousand-dollar difference per thousand dollars of advertising is practically important is a separate judgment; it cannot be decided from the p-value alone.

Unequal Time Coverage and Sensitivity

In an unbalanced panel, units can have different observed periods and different numbers of observations. Unequal coverage can affect the precision of each unit's slope estimate, because a shorter series may contain less information. It can also affect the estimated slope itself: units may be observed in different calendar periods, or their available observations may differ systematically from their missing observations. A test's covariance estimate should reflect the actual estimation and error structure, but a correct standard error does not by itself remove bias from selective observation or model misspecification.

A useful sensitivity check is to re-estimate the unit-specific slopes using a common time window or common observed periods where feasible, then compare the estimated contrasts and test results with those from the available observations. This changes the data contributing to the estimates, so it is a diagnostic rather than a universally superior estimator. Large shifts suggest that conclusions depend on coverage. Similar estimates do not prove that missingness is harmless, but they provide some reassurance about this particular sensitivity.

Worked Example: Comparing Full-Coverage and Common-Window Results

Suppose two hypothetical units have different time coverage. Based on all available observations, the estimated slopes are 0.40 and 0.90, with standard errors 0.08 and 0.30. Assume for this calculation that the two slope estimates are independent. Test equality using their difference and a large-sample normal approximation.

The estimated difference is \(0.90-0.40=0.50\). Under independence, its estimated standard error is

$$ SE(\widehat{\beta}_2-\widehat{\beta}_1) =\sqrt{0.08^2+0.30^2} =\sqrt{0.0064+0.0900} =\sqrt{0.0964} =0.3105. $$

The squared standardized difference is \(W=(0.50/0.3105)^2\approx2.593\). Against a chi-square distribution with one degree of freedom, the p-value is approximately 0.107. Thus this test does not reject equality at the 5% level. It does not establish equal slopes: the estimated difference is 0.50, but its uncertainty is substantial.

Now suppose fitting both units on a common time window produces slopes of 0.55 and 0.90, with standard errors 0.15 and 0.30. Under the same independence assumption, the difference is \(0.35\), and

$$ SE=\sqrt{0.15^2+0.30^2} =\sqrt{0.1125} =0.3354,\qquad W=(0.35/0.3354)^2=1.089. $$

The one-degree-of-freedom p-value is approximately 0.297, also not significant at 5%. The point estimate changed from 0.50 to 0.35, while the common-window estimate is less precise. This comparison shows why both the estimated difference and its uncertainty matter. It does not identify why the estimates changed, nor does it correct possible selection bias in the available observations.

Common Pitfalls

  • Constraining intercepts unintentionally. Equal slopes do not imply equal intercepts. Keep unit intercepts unrestricted unless their equality is a separate research question.
  • Reading non-rejection as proof of equality. A non-significant test may reflect imprecision, especially for units with short coverage. Report uncertainty rather than accepting the null as established.
  • Equating statistical significance with practical importance. The p-value addresses compatibility with the exact null under a reference model; it does not quantify the substantive size of heterogeneity.
  • Ignoring the covariance among contrasts. A joint Wald statistic uses the full covariance matrix. Summing separate squared statistics or dropping off-diagonal terms is generally incorrect.
  • Treating unequal coverage as only a standard-error issue. Different observed periods can change the estimated slopes as well as their precision. Compare estimates across defensible coverage choices and consider the observation process.
Key takeaway: A slope-homogeneity test is a joint test of equality restrictions on unit-specific slope vectors. Interpret its result together with the estimated contrasts, their uncertainty, the test's assumptions, and the sensitivity of estimates to unequal time coverage.

Check Your Understanding

Answer these questions using the definitions and procedures developed above.

  1. With four units and three regressors, how many restrictions are tested by a joint test that all slopes are common?
  2. Why can a slope-homogeneity test allow unit-specific intercepts?
  3. What does rejecting the joint null establish, and what does it not establish about the individual slope differences?
  4. Why must the covariance between estimated slope contrasts be included in a joint Wald statistic?
  5. How could unequal time coverage affect both the estimated slope differences and the precision of the test?
Clinical Biostats