Tutorials › VEE Mathematical Statistics › Degrees of Freedom and Chi-Square Shape

VEE Mathematical Statistics · Chi-Square and Student t Distributions · Tutorial 391 of 880

Degrees of Freedom and Chi-Square Shape

Learn to read and compare chi-square density shapes by relating degrees of freedom to the support, mode, and skewness.

Intermediate 10 min read

What You'll Learn

  • State the support and density of a chi-square variable with a given number of degrees of freedom
  • Determine whether the density is unbounded, finite, or zero at the left boundary
  • Find the mode from the density and explain its dependence on degrees of freedom
  • Compare chi-square densities at specified values without confusing density with probability
  • Use skewness to describe how shape changes as degrees of freedom increase

Why Degrees of Freedom Change the Shape

A chi-square distribution is not a single curve: its shape depends on its degrees of freedom. As those degrees of freedom increase, the curve’s peak moves to the right and its right skew decreases. The support, however, always begins at zero. Recognizing these features helps you interpret density formulas and avoid treating chi-square curves as interchangeable.

The earlier material on the chi-square distribution defines a chi-square variable with \(\nu\) degrees of freedom as the sum of squares of \(\nu\) independent standard normal variables. Here, \(\nu\) is a positive integer. We focus on what changing \(\nu\) does to the density’s support, boundary behavior, mode, and skewness. The results describe the curve; calculating quantiles and tail areas is a separate task.

Definition: If \(Z_1,\ldots,Z_\nu\) are independent standard normal variables, then \(Q=\sum_{j=1}^{\nu} Z_j^2\) has a chi-square distribution with \(\nu\) degrees of freedom, written \(Q\sim\chi^2_\nu\). Its support is \(q\geq 0\), and its density for \(q>0\) is $$ f_{Q}(q)=\frac{1}{2^{\nu/2}\Gamma(\nu/2)}q^{\nu/2-1}e^{-q/2}. $$ For \(q<0\), the density is zero. Here \(\Gamma\) is the gamma function, with \(\Gamma(r)=(r-1)!\) for positive integers \(r\).

The density is specified on \(q>0\); its behavior as \(q\) approaches zero depends on the power \(q^{\nu/2-1}\). This is why the same general formula produces visibly different left boundaries for small and large degrees of freedom.

Support and Behavior at Zero

A squared value cannot be negative, so a chi-square variable has no probability density to the left of zero. The density at the boundary itself requires care: for some degrees of freedom the density approaches infinity as \(q\) decreases toward zero, even though the variable still has a valid probability distribution. A high density at a point does not mean a positive probability of taking exactly that value.

The boundary behavior follows directly from the exponent \(\nu/2-1\). If \(\nu=1\), that exponent is \(-1/2\), so the density diverges as \(q\) approaches zero from above. If \(\nu=2\), the exponent is zero and the density approaches \(1/2\). If \(\nu>2\), the exponent is positive, so the density approaches zero.

Degrees of freedomExponent of \(q\)Density behavior as \(q\) approaches zero
\(\nu=1\)\(-1/2\)Unbounded; tends to infinity
\(\nu=2\)\(0\)Approaches \(1/2\)
\(\nu>2\)PositiveApproaches zero

Worked Example: Classifying the Left Boundary

Method: Inspect the exponent in the density. A hypothetical quality-control statistic has a chi-square distribution, and an analyst is comparing cases with \(\nu=1\), \(\nu=2\), and \(\nu=5\). For each case, state the support and the density’s limiting behavior near zero. Identify the shape error this comparison guards against.

For all three cases, the statistic can take only nonnegative values, so the support is \(q\geq 0\), and the density is zero for \(q<0\).

For \(\nu=1\), the exponent is \(1/2-1=-1/2\). Thus the density contains a factor \(q^{-1/2}\) and becomes unbounded as \(q\) approaches zero from above.

For \(\nu=2\), the exponent is \(2/2-1=0\), and the density simplifies to \(f_Q(q)=\frac12e^{-q/2}\). Its limit at zero is \(\frac12e^0=0.5\).

For \(\nu=5\), the exponent is \(5/2-1=3/2\). The factor \(q^{3/2}\) tends to zero, so the density tends to zero at the boundary.

Check: The three boundary behaviors are respectively unbounded, finite and positive, and zero. The common mistake is to assume that every chi-square density starts at zero. That is true for \(\nu>2\), but not for \(\nu=1\) or \(\nu=2\).

Mode: Where the Density Peaks

The mode is the value at which a density reaches its maximum. For a chi-square density, it is determined by differentiating the log density. Taking the logarithm simplifies the calculation because products become sums, and the logarithm preserves the location of a positive density’s maximum.

1
Take the log density.
Ignoring terms that do not depend on \(q\), write \(\log f_Q(q)=(\nu/2-1)\log q-q/2+C\), where \(C\) is constant in \(q\).
2
Differentiate for \(q>0\).
The derivative is \((\nu/2-1)/q-1/2\). Setting it equal to zero gives \(q=\nu-2\).
3
Check the boundary.
If \(\nu>2\), the critical point \(q=\nu-2\) is positive and is the mode. If \(\nu\leq2\), there is no positive critical point; the density decreases from its boundary behavior, so the mode is at zero.
Result: The mode of a chi-square distribution with \(\nu\) degrees of freedom is \(\max(\nu-2,0)\). When \(\nu=1\), the density is unbounded at zero; when \(\nu=2\), its finite maximum is at zero. For \(\nu>2\), the mode is the positive value \(\nu-2\).

Worked Example: Comparing Modes and Skewness

Method: Apply the mode formula and the chi-square skewness formula to compare \(\nu=2\), \(\nu=6\), and \(\nu=10\). A hypothetical researcher uses these distributions to describe statistics based on different numbers of squared standard normal observations. State each mode and skewness, then identify the trend. This comparison avoids confusing the mode with the mean.

For \(\nu=2\), the mode is \(\max(2-2,0)=0\). The skewness is \(\sqrt{8/2}=\sqrt{4}=2\).

For \(\nu=6\), the mode is \(\max(6-2,0)=4\). The skewness is \(\sqrt{8/6}=\sqrt{4/3}\approx1.1547\).

For \(\nu=10\), the mode is \(\max(10-2,0)=8\). The skewness is \(\sqrt{8/10}=\sqrt{0.8}\approx0.8944\).

The mode moves from zero to four to eight, while skewness falls from \(2\) to approximately \(1.1547\) to \(0.8944\). The mean is \(\nu\), so in these three cases the means are \(2\), \(6\), and \(10\), respectively; they are not the modes.

Check: Each positive mode is two less than its degrees of freedom. The common mistake is to report \(\nu\), the mean, as the mode. The calculation shows that the distribution’s peak and average are distinct.

Skewness and the Overall Shape

A chi-square density is right-skewed: its tail extends toward larger values. As \(\nu\) increases, this skewness decreases, the mode shifts right, and the curve becomes less asymmetric. These statements concern the distribution’s overall shape. They do not say that the density at every fixed value increases or decreases as \(\nu\) changes.

For a chi-square variable, the mean is \(\nu\), the variance is \(2\nu\), and the skewness is \(\sqrt{8/\nu}\). In terms of the moment-generating function, the cumulants are \(\kappa_r=2^{r-1}(r-1)!\nu\). In particular, \(\kappa_2=2\nu\) and \(\kappa_3=8\nu\). Since skewness is the third cumulant divided by the variance to the power \(3/2\),

$$ \frac{\kappa_3}{\kappa_2^{3/2}} =\frac{8\nu}{(2\nu)^{3/2}} =\sqrt{\frac{8}{\nu}}. $$

This derivation explains why the skewness falls as degrees of freedom increase: the numerator grows in proportion to \(\nu\), while the denominator grows in proportion to \(\nu^{3/2}\). The standardized distribution also has a lower endpoint at \(-\nu/\sqrt{2\nu}=-\sqrt{\nu/2}\), which moves farther left as \(\nu\) increases. In combination, decreasing skewness and a progressively more distant standardized boundary are consistent with a shape that becomes more nearly symmetric.

The density formula gives a complementary view. Its power of \(q\) changes with \(\nu\), moving the interior peak away from zero once \(\nu>2\). The exponential factor \(e^{-q/2}\) continues to suppress the density at large \(q\), producing the right tail. A larger \(\nu\) changes the balance between these factors; it does not remove the nonnegative support.

Worked Example: Tracking Standardized Skewness as Degrees of Freedom Grow

Method: Compare the mean, standard deviation, mode, and skewness for \(\nu=4\), \(16\), and \(64\). These are hypothetical chi-square statistics formed from different numbers of independent standard normal squares. The calculation illustrates how location and asymmetry change together, without treating density as probability.

For \(\nu=4\), the mean is \(4\), the variance is \(2(4)=8\), and the standard deviation is \(\sqrt{8}\approx2.8284\). The mode is \(4-2=2\). The skewness is \(\sqrt{8/4}=\sqrt{2}\approx1.4142\).

For \(\nu=16\), the mean is \(16\), the variance is \(2(16)=32\), and the standard deviation is \(\sqrt{32}\approx5.6569\). The mode is \(16-2=14\). The skewness is \(\sqrt{8/16}=\sqrt{0.5}\approx0.7071\).

For \(\nu=64\), the mean is \(64\), the variance is \(2(64)=128\), and the standard deviation is \(\sqrt{128}\approx11.3137\). The mode is \(64-2=62\). The skewness is \(\sqrt{8/64}=\sqrt{0.125}\approx0.3536\).

The mean, standard deviation, and mode all increase, while the skewness decreases. The mode remains two units below the mean in each case, but the skewness values show that the right asymmetry is less pronounced at larger degrees of freedom.

Check: The standard deviation is the square root of the variance, not the variance itself. The common mistake is to interpret a larger standard deviation in the original scale as greater skewness. Here, the standard deviation increases, but the dimensionless skewness decreases.

Comparing Densities at a Fixed Value

A density is not a probability at a point. Comparing density heights at a fixed \(q\) can show where two curves cross or which curve is higher there, but it does not by itself compare probabilities over an interval. The following calculation uses the density formula directly, with each normalization constant included.

Worked Example: Finding Where Two Densities Cross

Method: Write the densities for \(\nu=2\) and \(\nu=4\), then compare them at selected positive values. A hypothetical analyst is checking whether the four-degree curve is always higher than the two-degree curve. This comparison avoids inferring an ordering of whole distributions from a single peak.

For \(\nu=2\), \(\Gamma(1)=1\), so \(f_2(q)=\frac{1}{2}e^{-q/2}\). For \(\nu=4\), \(\Gamma(2)=1\), so \(f_4(q)=\frac{q}{4}e^{-q/2}\).

At \(q=1\), \(f_2(1)=\frac12e^{-1/2}\approx0.3033\), while \(f_4(1)=\frac14e^{-1/2}\approx0.1516\). Thus the two-degree density is higher at \(q=1\).

At \(q=2\), \(f_2(2)=\frac12e^{-1}\approx0.1839\), and \(f_4(2)=\frac{2}{4}e^{-1}=\frac12e^{-1}\approx0.1839\). The densities are equal.

At \(q=4\), \(f_2(4)=\frac12e^{-2}\approx0.0677\), while \(f_4(4)=\frac{4}{4}e^{-2}\approx0.1353\). The four-degree density is higher at \(q=4\).

The crossing follows algebraically: for \(q>0\), the ratio is \(f_4(q)/f_2(q)=q/2\), so the densities are equal when \(q/2=1\), or \(q=2\). Below that value the ratio is less than one; above it, the ratio is greater than one.

Check: The higher density switches from \(\nu=2\) to \(\nu=4\) at \(q=2\). The common mistake is to assume one density must be higher everywhere because its distribution has more degrees of freedom. Density curves can cross; density height at a point is not a probability.

Reading Shape Comparisons Reliably

When comparing chi-square distributions, separate four features that are easy to conflate:

  • Support: every chi-square distribution is supported on nonnegative values.
  • Boundary behavior: the density is unbounded at zero for \(\nu=1\), finite and positive there for \(\nu=2\), and tends to zero there for \(\nu>2\).
  • Mode: it is zero for \(\nu\leq2\), and \(\nu-2\) for \(\nu>2\).
  • Skewness: it is \(\sqrt{8/\nu}\), so it decreases as \(\nu\) increases.

A related exam trap is to treat density height as probability. For a continuous variable, the probability of taking exactly one specified value is zero; probabilities are areas under the density over intervals. Another trap is to compare unstandardized spreads only. The standard deviation \(\sqrt{2\nu}\) grows with \(\nu\), but that fact alone does not measure asymmetry; skewness is the relevant standardized measure of right-skew.

Key takeaway: Increasing the degrees of freedom shifts the chi-square mode to the right and reduces right-skewness, while the support remains nonnegative. Check the density’s power near zero, use \(\max(\nu-2,0)\) for the mode, and use \(\sqrt{8/\nu}\) for skewness.

Check Your Understanding

For each problem, use the density shape results to make the comparison. Each answer is included for checking.

  1. For \(\nu=3\), state the support, the density’s limiting behavior at zero, the mode, and the skewness. (Answer: support \(q\geq0\); density tends to zero at zero; mode \(1\); skewness \(\sqrt{8/3}\approx1.6330\))
  2. A chi-square density has \(\nu=8\). Find its mode and skewness to four decimal places. (Answer: mode \(6\); skewness \(\sqrt{1}=1.0000\))
  3. Compare the densities for \(\nu=2\) and \(\nu=4\) at \(q=6\). Which is higher, and what are their values to four decimals? (Answer: \(\nu=4\) is higher; \(f_2(6)=\frac12e^{-3}\approx0.0249\), \(f_4(6)=\frac{6}{4}e^{-3}\approx0.0747\))
  4. For \(\nu=18\), calculate the mean, variance, mode, and skewness to four decimal places where needed. (Answer: mean \(18\); variance \(36\); mode \(16\); skewness \(\sqrt{8/18}=\sqrt{4/9}\approx0.6667\))
  5. A colleague says that a chi-square density with more degrees of freedom must be higher at every positive value because its mode is farther right. Give a specific counterexample by comparing \(\nu=2\) and \(\nu=4\) at \(q=1\), and state where those two densities cross. (Answer: at \(q=1\), \(f_2(1)\approx0.3033\) exceeds \(f_4(1)\approx0.1516\); they cross at \(q=2\))
Clinical Biostats