Tutorials › Multivariate Statistics (Graduate) › The Central MANOVA Root Density

MANOVA Criteria and Distributions · Tutorial 341 of 975

The Central MANOVA Root Density

Learn how independent central Wishart matrices determine the joint density and support of the MANOVA roots, including cases where the hypothesis matrix is singular.

Advanced 12 min read

What You'll Learn

  • State the degrees-of-freedom conditions for a central MANOVA root density.
  • Distinguish positive generalized roots from structural zero roots.
  • Derive the joint density on the positive-root support and identify its normalizing constant.
  • Transform between generalized roots and roots bounded between zero and one.
  • Check the density and its normalization in concrete MANOVA dimensions.

Why the Joint Root Density Matters

Under a central MANOVA null hypothesis, the hypothesis and error sums-of-squares-and-cross-products matrices fluctuate even when there is no population effect. Their generalized eigenvalues therefore have a nontrivial joint distribution. That distribution describes the roots together, rather than treating them as unrelated statistics, and is the starting point for exact null calculations.

The degrees of freedom determine both the shape of the density and how many roots are positive. In particular, a hypothesis matrix with fewer degrees of freedom than response dimensions is singular: it produces some roots that are exactly zero, as well as a smaller set of random positive roots.

Central Wishart Setup and Root Support

Definition: Let \(p\) be the response dimension, \(m\) the hypothesis degrees of freedom, and \(\nu\) the error degrees of freedom. Under the central null model, suppose \(H\sim W_p(m,I_p)\) and \(E\sim W_p(\nu,I_p)\) independently. The MANOVA roots are the generalized eigenvalues \(\lambda\) satisfying \(Hv=\lambda Ev\) for some nonzero vector \(v\). Set \(q=\min(p,m)\). There are \(q\) positive roots almost surely; if \(m<p\), the remaining \(p-m\) roots are zero.

For the usual integer degrees of freedom, assume \(m\geq 1\) and \(\nu\geq p\). The latter condition makes \(E\) positive definite almost surely, so the generalized eigenvalue problem is well-defined. The hypothesis matrix has rank \(\min(p,m)\) almost surely. We study only its \(q\) positive roots below. Unless roots are explicitly ordered, their density is for an unordered vector: it is symmetric in the \(q\) coordinates and integrates to one over the full positive orthant.

It is useful to map a positive root to \(x=\lambda/(1+\lambda)\). These transformed roots lie between zero and one. They are the eigenvalues associated with \(H\) relative to \(H+E\); this bounded support makes the joint density especially simple. The transformation does not change the number of positive roots.

The Joint Density

Theorem: Under the conditions above, the \(q\) positive central MANOVA roots have joint density
$$ f(\lambda_1,\ldots,\lambda_q) = \frac{1}{S_q(\alpha,\beta,1/2)} \prod_{i=1}^{q}\lambda_i^{(|p-m|-1)/2} (1+\lambda_i)^{-(m+\nu)/2} \prod_{i<j}|\lambda_i-\lambda_j|, \qquad \lambda_i>0, $$
where
$$ \alpha=\frac{|p-m|+1}{2},\qquad \beta=\frac{\nu-p+1}{2}, $$
and the normalizing constant is
$$ S_q(\alpha,\beta,\gamma) = \prod_{j=0}^{q-1} \frac{ \Gamma(\alpha+j\gamma)\, \Gamma(\beta+j\gamma)\, \Gamma(1+(j+1)\gamma)} {\Gamma(\alpha+\beta+(q+j-1)\gamma)\,\Gamma(1+\gamma)}. $$
Here \(\Gamma\) is the gamma function. The positive roots lie in \((0,\infty)\); they are distinct almost surely. If \(m<p\), there are also \(p-m\) structural zero roots, which are not coordinates in this density.

The absolute-difference product is essential: roots repel in the joint density, and the density is not a product of \(q\) independent one-dimensional densities. The exponent at zero depends on the difference between response dimension and hypothesis degrees of freedom. The common power of \(1+\lambda_i\) depends on the combined hypothesis and error degrees of freedom.

Derivation from Wishart Matrices

First consider the transformed roots \(x_i=\lambda_i/(1+\lambda_i)\). Write \(a=|p-m|\) and \(b=\nu-p\). Their joint density on \((0,1)^q\) is

$$ g(x_1,\ldots,x_q) = \frac{1}{S_q(\alpha,\beta,1/2)} \prod_{i=1}^{q}x_i^{(a-1)/2}(1-x_i)^{(b-1)/2} \prod_{i<j}|x_i-x_j|. $$

Here is the Wishart argument for this Jacobi-form density. Let \(X\) be an \(m\times p\) matrix and \(Y\) a \(\nu\times p\) matrix, all of whose entries are independent standard normal variables, with the two matrices independent. Then \(H=X^\mathsf{T}X\) and \(E=Y^\mathsf{T}Y\) have the required independent central Wishart distributions. If \(Z\) is the matrix formed by stacking \(X\) above \(Y\), then

$$ U=Z(Z^\mathsf{T}Z)^{-1/2} $$

has orthonormal columns and is uniformly distributed over such \(p\)-frames in \(\mathbb{R}^{m+\nu}\). Let \(P\) be the projection onto the first \(m\) coordinates. The eigenvalues of \(U^\mathsf{T}PU\) are precisely the roots of \(H\) relative to \(H+E\), including any zero roots.

The block-coordinate change for a uniform orthonormal frame gives the following density for its nonzero eigenvalues. When \(m\geq p\), the \(p\times p\) matrix \(U^\mathsf{T}PU\) has density proportional to \(|C|^{(m-p-1)/2}|I_p-C|^{(\nu-p-1)/2}\) on \(0<C<I_p\). When \(m<p\), use the \(m\times m\) matrix \(U_1U_1^\mathsf{T}\), where \(U_1\) comprises the first \(m\) rows of \(U\); it has the same nonzero eigenvalues and density proportional to \(|C|^{(p-m-1)/2}|I_m-C|^{(\nu-p-1)/2}\). These powers are the determinant powers in the frame-coordinate Jacobian. In both cases, diagonalizing the symmetric matrix contributes the eigenvalue Jacobian \(\prod_{i<j}|x_i-x_j|\). Thus the powers in the displayed density are \((|p-m|-1)/2\) at zero and \((\nu-p-1)/2\) at one.

The integral that normalizes this density is the Selberg integral on \((0,1)^q\). In its real case, with the Vandermonde power equal to one, it is exactly \(S_q(\alpha,\beta,1/2)\) given in the theorem. This establishes both the density and its normalization for the transformed roots.

It remains to change variables back to \(\lambda_i\). Since \(x_i=\lambda_i/(1+\lambda_i)\),

$$ dx_i=(1+\lambda_i)^{-2}d\lambda_i,\qquad |x_i-x_j|=\frac{|\lambda_i-\lambda_j|}{(1+\lambda_i)(1+\lambda_j)}. $$

Also, \(x_i^{(a-1)/2}=\lambda_i^{(a-1)/2}(1+\lambda_i)^{-(a-1)/2}\) and \((1-x_i)^{(b-1)/2}=(1+\lambda_i)^{-(b-1)/2}\). For each \(\lambda_i\), the Vandermonde contributes a further power \(-(q-1)\) of \(1+\lambda_i\). The total exponent in the denominator is therefore

$$ \frac{a-1}{2}+\frac{b-1}{2}+2+(q-1) = \frac{a+b}{2}+q = \frac{m+\nu}{2}, $$

because \(a+2q=p+m\) and \(b=\nu-p\). The change of variables proves the stated root density, including its support and constant. \(\square\)

Worked Examples

Worked Example: Four Hypothesis Degrees of Freedom and Two Responses

Suppose \(p=2\), \(m=4\), and \(\nu=7\). Then \(q=2\), both roots are positive, and \(\alpha=(|2-4|+1)/2=3/2\), \(\beta=(7-2+1)/2=3\). The density’s root-specific powers are \((|2-4|-1)/2=1/2\) at zero and \(-(4+7)/2=-11/2\) on \(1+\lambda_i\).

To calculate the constant, use the Selberg product with \(q=2\) and \(\gamma=1/2\). Its \(j=0\) factor is \(\Gamma(3/2)\Gamma(3)/\Gamma(5)=\sqrt{\pi}/24\). Its \(j=1\) factor is \(\Gamma(2)\Gamma(7/2)\Gamma(2)/[\Gamma(11/2)\Gamma(3/2)]=8/(63\sqrt{\pi})\). Thus \(S_2=1/189\), so the density is

$$ 189\,\lambda_1^{1/2}\lambda_2^{1/2} (1+\lambda_1)^{-11/2}(1+\lambda_2)^{-11/2} |\lambda_1-\lambda_2|,\qquad \lambda_1,\lambda_2>0. $$

It is symmetric in the two roots and is normalized over the full positive quadrant by the Selberg calculation.

Worked Example: A Singular Hypothesis Matrix

Let \(p=3\), \(m=2\), and \(\nu=6\). The hypothesis matrix has rank two almost surely, so there are two positive roots and one root that is exactly zero. For the positive roots, \(q=2\), \(\alpha=(|3-2|+1)/2=1\), and \(\beta=(6-3+1)/2=2\). The root power at zero is zero, and the denominator power is \(-(2+6)/2=-4\).

The Selberg factors are \(1/\Gamma(7/2)=8/(15\sqrt{\pi})\) for \(j=0\), and \(\Gamma(5/2)/\Gamma(4)=\sqrt{\pi}/8\) for \(j=1\). Their product is \(S_2=1/15\). Hence the joint density of the two positive roots is

$$ 15\,|\lambda_1-\lambda_2| (1+\lambda_1)^{-4}(1+\lambda_2)^{-4}, \qquad \lambda_1,\lambda_2>0. $$

This density integrates to one for the two random positive roots. It does not describe the structural zero root; that root is fixed by the rank condition.

Worked Example: One Response Dimension

For \(p=1\), \(m=3\), and \(\nu=5\), there is one positive root. The parameters are \(q=1\), \(\alpha=3/2\), and \(\beta=5/2\); there is no Vandermonde factor. The normalization integral is \(S_1=B(3/2,5/2)=\Gamma(3/2)\Gamma(5/2)/\Gamma(4)=\pi/16\).

Therefore the root density is

$$ \frac{16}{\pi}\lambda^{1/2}(1+\lambda)^{-4}, \qquad \lambda>0. $$

As a check, setting \(x=\lambda/(1+\lambda)\) gives the beta density \(x^{1/2}(1-x)^{3/2}/B(3/2,5/2)\) on \((0,1)\). Its integral is one, confirming the constant and the support transformation.

Common Pitfall and Use of the Density

  • Confusing the two supports. The transformed roots \(x_i\) lie in \((0,1)\), but the generalized roots \(\lambda_i=x_i/(1-x_i)\) range over all positive values. Applying the bounded support to \(\lambda_i\) is incorrect.
  • Counting zero roots as random positive roots. When \(m<p\), the density has \(q=m\) coordinates. The other \(p-m\) roots are identically zero, not additional draws from this density.
  • Assuming roots are independent. The factor \(\prod_{i<j}|\lambda_i-\lambda_j|\) couples the roots. Separate marginal densities cannot be multiplied to obtain their joint law.
  • Dropping the normalization convention. The constant above is for unordered roots over the entire positive orthant. If roots are instead restricted to an ordering, the density and its normalizing constant must be adjusted for that restricted domain.

The density matters because exact null calculations depend on the joint root law, including the dependence induced by the Vandermonde factor. Its degrees-of-freedom conditions also clarify when an analysis has a full set of positive roots and when rank forces zero roots. The Selberg form provides a direct normalization check before using the roots in a MANOVA criterion.

Check Your Understanding

Use the density and its conditions to answer these questions.

  1. For \(p=4\), \(m=2\), and \(\nu=8\), how many positive roots are there, and how many roots are identically zero?
  2. What is the support of the transformed roots \(x_i\), and how does it differ from the support of the generalized roots \(\lambda_i\)?
  3. For \(p=3\), \(m=5\), and \(\nu=6\), calculate the exponent of \(\lambda_i\) at zero and the exponent of \(1+\lambda_i\).
  4. Why does the absolute-difference factor rule out treating the positive roots as independent?
  5. Why is the condition \(\nu\geq p\) useful in defining the generalized roots through \(Hv=\lambda Ev\)?
Clinical Biostats