Tutorials › Multivariate Statistics (Graduate) › Huynh-Feldt Correction

Contrasts and Repeated Measures · Tutorial 375 of 975

Huynh-Feldt Correction

Learn how the Huynh–Feldt estimate adjusts Greenhouse–Geisser epsilon and how both corrections change the reference degrees of freedom without changing the observed F statistic.

Advanced 10 min read

What You'll Learn

  • Define population and estimated Greenhouse–Geisser epsilon from contrast-coordinate covariances.
  • Calculate the Huynh–Feldt estimate and apply its upper bound of one.
  • Understand when the raw Huynh–Feldt estimate is at least the Greenhouse–Geisser estimate.
  • Adjust numerator and denominator degrees of freedom for a repeated-measures F test.
  • Distinguish a degrees-of-freedom correction from changing the observed F statistic.

Why Use the Huynh–Feldt Correction?

A univariate repeated-measures F test uses a reference F distribution whose degrees of freedom depend on the number of within-subject contrasts. When sphericity does not hold, those nominal degrees of freedom can make the test too liberal. The Greenhouse–Geisser correction addresses this by multiplying both degrees of freedom by an estimated epsilon. The Huynh–Feldt correction uses a finite-sample adjustment to that estimate, often producing a less conservative adjustment.

The key distinction is operational: both corrections leave the observed F statistic unchanged and alter its reference degrees of freedom. The Huynh–Feldt estimate is not automatically preferable; its value, its upper bound, and the resulting degrees of freedom should be understood before using it.

Greenhouse–Geisser Epsilon and Its Estimate

Suppose each of \(n\) independent subjects is measured at \(k\) occasions, and the within-subject effect is represented by \(p=k-1\) linearly independent, orthonormal contrast coordinates. Let \(\Sigma_C\) be the population covariance matrix of those \(p\) coordinates. The population Greenhouse–Geisser epsilon summarizes how evenly variation is distributed across them.

Definition: For a nonzero positive semidefinite \(p\times p\) covariance matrix \(\Sigma_C\), the population Greenhouse–Geisser epsilon is \(\epsilon_{GG}=(\operatorname{tr}\Sigma_C)^2/[p\,\operatorname{tr}(\Sigma_C^2)]\). Given the sample covariance matrix \(S_C\) of the contrast coordinates, its sample estimate is \(\hat{\epsilon}_{GG}=(\operatorname{tr}S_C)^2/[p\,\operatorname{tr}(S_C^2)]\), provided \(S_C\ne0\).

Here \(\operatorname{tr}\) denotes the trace, and \(\operatorname{tr}(S_C^2)\) means the trace of the matrix product \(S_CS_C\). Epsilon equals one when the covariance is proportional to the identity matrix, and is smaller when variation is less evenly spread across contrast directions. The earlier material on sphericity in contrast coordinates gives the relevant covariance setting; the trace expression provides a scalar summary for the degrees-of-freedom adjustment.

For a nonzero positive semidefinite matrix, the estimate lies between \(1/p\) and \(1\). The lower endpoint corresponds to variation concentrated in one direction; the upper endpoint corresponds to equal eigenvalues. The following derivation establishes these bounds.

Result: If \(S_C\) is nonzero and positive semidefinite with eigenvalues \(\lambda_1,\ldots,\lambda_p\), then \(1/p\leq\hat{\epsilon}_{GG}\leq1\).

Proof. The eigenvalues are nonnegative and not all zero. Since trace is invariant under orthogonal diagonalization, \(\operatorname{tr}S_C=\sum_i\lambda_i\) and \(\operatorname{tr}(S_C^2)=\sum_i\lambda_i^2\). Cauchy–Schwarz gives \((\sum_i\lambda_i)^2\leq p\sum_i\lambda_i^2\), so \(\hat{\epsilon}_{GG}\leq1\). Also, nonnegativity gives \(\sum_i\lambda_i^2\leq(\sum_i\lambda_i)^2\), so \(\hat{\epsilon}_{GG}\geq1/p\). \(\square\)

The Huynh–Feldt Estimate

The Huynh–Feldt (HF) estimate adjusts the Greenhouse–Geisser estimate using the number of subjects and contrast dimensions. In the complete, one-group repeated-measures setting, let \(n\) be the number of subjects and \(p=k-1\) the within-subject numerator degrees of freedom before correction. The formula below is used when \(n>p+1\), ensuring a positive denominator.

Definition: The raw Huynh–Feldt estimate is \(\hat{\epsilon}_{HF}^{\,raw}=\dfrac{np\hat{\epsilon}_{GG}-2}{p\{n-1-p\hat{\epsilon}_{GG}\}}\). The operational estimate used for the degrees-of-freedom correction is \(\hat{\epsilon}_{HF}=\min(1,\hat{\epsilon}_{HF}^{\,raw})\).

The upper cap matters because a correction factor above one would increase the nominal degrees of freedom. The raw HF estimate can exceed one, so report and use the capped value for the correction. Under the stated sample-size condition, its denominator is positive: since \(\hat{\epsilon}_{GG}\leq1\), \(n-1-p\hat{\epsilon}_{GG}\geq n-1-p>0\).

Result: If \(n>p+1\) and \(S_C\ne0\), then the raw Huynh–Feldt estimate is at least the Greenhouse–Geisser estimate.

Proof. Write \(g=\hat{\epsilon}_{GG}\). The difference between the raw HF estimate and \(g\), on the positive common denominator \(p(n-1-pg)\), has numerator \[ np g-2-pg(n-1-pg)=p^2g^2+pg-2. \] Set \(x=pg\). The Greenhouse–Geisser bound \(g\geq1/p\) implies \(x\geq1\). Thus \(p^2g^2+pg-2=x^2+x-2=(x-1)(x+2)\geq0\). Dividing by the positive denominator proves \(\hat{\epsilon}_{HF}^{\,raw}\geq g\). Capping at one does not make the operational HF estimate less than \(g\), because \(g\leq1\). \(\square\)

This comparison explains the usual description of HF as less conservative: before the cap, it is no smaller than GG under these conditions, so it retains at least as much of the nominal degrees of freedom. It does not guarantee that the two estimates differ substantially, nor that HF is a better choice in every application.

Adjusting the Repeated-Measures Test

For a one-group repeated-measures effect with \(p\) uncorrected numerator degrees of freedom and \(p(n-1)\) uncorrected denominator degrees of freedom, an epsilon correction multiplies both by the same estimate. The observed univariate F statistic is computed as usual. Its p-value is then evaluated against an F distribution with the corrected degrees of freedom, which need not be integers.

Degrees-of-freedom rule: For a chosen correction factor \(\hat{\epsilon}\), use numerator degrees of freedom \(\hat{\epsilon}p\) and denominator degrees of freedom \(\hat{\epsilon}p(n-1)\). Use \(\hat{\epsilon}_{GG}\) for the Greenhouse–Geisser correction or the capped \(\hat{\epsilon}_{HF}\) for the Huynh–Feldt correction.

The two corrected degrees of freedom are related to the uncorrected ones by the same multiplier. Therefore their ratio is unchanged: \(\{\hat{\epsilon}p(n-1)\}/(\hat{\epsilon}p)=n-1\), for positive \(\hat{\epsilon}\) and \(p\). The F statistic itself is not multiplied by epsilon. The correction changes the reference distribution used to assess that statistic.

Worked Example: Computing Both Estimates From a Contrast Covariance

Suppose \(n=12\) subjects have \(p=2\) within-subject contrast coordinates, and the sample covariance matrix is \(S_C=\begin{pmatrix}4&0\\0&1\end{pmatrix}\). Calculate both estimates and the corrected degrees of freedom.

The trace is \(4+1=5\). The square is \(\begin{pmatrix}16&0\\0&1\end{pmatrix}\), with trace \(17\). Therefore \[ \hat{\epsilon}_{GG}=\frac{5^2}{2(17)}=\frac{25}{34}\approx0.7353. \]

For HF, the numerator of the raw estimate is \(np\hat{\epsilon}_{GG}-2=12(2)(25/34)-2=600/34-68/34=532/34=266/17\). The denominator is \(p\{n-1-p\hat{\epsilon}_{GG}\}=2\{11-2(25/34)\}=2(11-25/17)=2(162/17)=324/17\). Thus \[ \hat{\epsilon}_{HF}^{\,raw}=\frac{266/17}{324/17}=\frac{133}{162}\approx0.8210, \] which is below one, so no cap is needed.

The uncorrected degrees of freedom are \(2\) and \(2(12-1)=22\). Greenhouse–Geisser gives \(2(25/34)=25/17\approx1.4706\) and \(22(25/34)=275/17\approx16.1765\). Huynh–Feldt gives \(2(133/162)=133/81\approx1.6420\) and \(22(133/162)=1463/81\approx18.0617\). In either case, compare the same observed F statistic with the F distribution having the corresponding corrected degrees of freedom.

Worked Example: Raw Huynh–Feldt Estimate Above One

Let \(n=20\), \(p=3\), and \(\hat{\epsilon}_{GG}=6/7\). The raw HF estimate is \[ \hat{\epsilon}_{HF}^{\,raw} =\frac{20(3)(6/7)-2}{3\{19-3(6/7)\}} =\frac{360/7-14/7}{3(115/7)} =\frac{346/7}{345/7} =\frac{346}{345} \approx1.0029. \]

Since this exceeds one, the operational HF estimate is \(\hat{\epsilon}_{HF}=1\). The uncorrected degrees of freedom are \(3\) and \(3(20-1)=57\). The GG correction gives \(3(6/7)=18/7\approx2.5714\) and \(57(6/7)=342/7\approx48.8571\). The capped HF correction leaves the degrees of freedom at \(3\) and \(57\). This example shows why the cap is part of applying the HF correction, not an optional alteration to the arithmetic.

Worked Example: An Estimate at the Lower Bound

Suppose \(p=2\), \(n=8\), and the contrast covariance estimate is \(S_C=\begin{pmatrix}1&0\\0&0\end{pmatrix}\). Its trace is \(1\), and the trace of its square is also \(1\). Hence \[ \hat{\epsilon}_{GG}=\frac{1^2}{2(1)}=\frac12, \] which is the lower bound \(1/p\).

The raw HF estimate is \[ \hat{\epsilon}_{HF}^{\,raw} =\frac{8(2)(1/2)-2}{2\{7-2(1/2)\}} =\frac{8-2}{2(6)} =\frac{6}{12} =\frac12. \] The estimate is already below one. The uncorrected degrees of freedom \(2\) and \(2(7)=14\) become \(1\) and \(7\) under either correction. This confirms that the two estimates can coincide, including at the lower endpoint.

Interpretation and a Common Mistake

An epsilon correction is useful because it provides a scalar adjustment to the univariate repeated-measures reference degrees of freedom when the covariance structure does not support the uncorrected test calibration. GG and HF make the adjustment comparable: both rescale numerator and denominator degrees of freedom, and the observed F ratio remains unchanged. The main practical difference is the estimate used as the multiplier.

A common mistake is to calculate an HF estimate greater than one and use it directly, or to multiply the observed F statistic by epsilon. The first would increase the degrees of freedom beyond their nominal values; the second changes the statistic rather than its reference distribution. The correction is to cap the estimate at one and apply it to both degrees of freedom only. Another error is to confuse the raw and operational HF estimates: show the raw calculation, then state whether the cap applies.

Key takeaway: Calculate \(\hat{\epsilon}_{GG}\) from the contrast covariance, use it in the HF formula when appropriate, cap the HF estimate at one, and multiply both uncorrected degrees of freedom by the selected epsilon. Do not alter the observed F statistic.

Check Your Understanding

Answer these questions using the definitions and calculations above.

  1. What covariance-matrix quantities determine the Greenhouse–Geisser estimate?
  2. Why must the denominator of the stated HF formula be positive, and what condition on \(n\) and \(p\) ensures this?
  3. If the uncorrected degrees of freedom are \(p\) and \(p(n-1)\), what are the corrected degrees of freedom for a chosen epsilon?
  4. For \(p=2\), \(n=10\), and \(\hat{\epsilon}_{GG}=1\), calculate the raw HF estimate and state the capped value.
  5. Does applying either correction multiply the observed F statistic? Explain what changes instead.
Clinical Biostats