Tutorials › Multivariate Statistics (Graduate) › Wilks Lambda as a Product of Independent Beta Variables

MANOVA Criteria and Distributions · Tutorial 342 of 975

Wilks Lambda as a Product of Independent Beta Variables

Learn how the dimensions of a central MANOVA problem determine the independent beta variables whose product has Wilks’ lambda’s exact null distribution.

Advanced 11 min read

What You'll Learn

  • Identify the response dimension, hypothesis rank, and residual degrees of freedom used in the distribution.
  • State the conditions for the exact central-null product law.
  • Use Bartlett decomposition to obtain the independent beta factors.
  • Verify the product law through its moments and the multivariate gamma function.
  • Recognize why a rank-deficient hypothesis does not prevent the determinant ratio from having this law.
  • Calculate moments and interpret the factors in concrete MANOVA designs.

Why Wilks’ Lambda Has an Exact Product Law

Wilks’ lambda summarizes a MANOVA test by comparing the error sum-of-products matrix with the total sum of-products matrix. Its determinant ratio is compact, but its null distribution is not generally a single familiar univariate distribution. Under the central null, Bartlett decomposition gives a more revealing description: Wilks’ lambda has the distribution of a product of independent beta variables.

The dimensions matter. The number of response variables determines how many beta factors appear; the rank of the tested hypothesis determines one beta parameter; and the residual degrees of freedom determine the other. Keeping these quantities distinct prevents a common error: substituting the number of hypothesis restrictions or the sample size where the error degrees of freedom belong.

Definition: Let \(p\) be the number of response variables, \(q\) the rank of the hypothesis being tested, and \(\nu\) the residual degrees of freedom. In the central null model, write the error and hypothesis sum-of-products matrices as \(E\) and \(H\), respectively. Assume \(E\sim W_p(\nu,\Sigma)\) and \(H\sim W_p(q,\Sigma)\) are independent, where \(\Sigma\) is positive definite and \(\nu\ge p\). Wilks’ lambda is \(\Lambda=|E|/|E+H|\).

Here \(W_p(m,\Sigma)\) denotes a \(p\)-dimensional Wishart distribution with \(m\) degrees of freedom and scale matrix \(\Sigma\). The condition \(\nu\ge p\) ensures that \(E\) is positive definite with probability one, so both determinants in the ratio are well-defined and the denominator is positive. The matrix \(H\) may be singular when \(q<p\); that does not make \(E+H\) singular. We consider \(q\ge1\). If \(q=0\), there is no tested effect and \(\Lambda=1\).

Theorem: Under the central-null model above, \(\Lambda\) has the same distribution as \(\prod_{j=1}^{p} B_j\), where the \(B_j\) are mutually independent and \(B_j\sim\operatorname{Beta}\bigl((\nu-j+1)/2,\ q/2\bigr)\), for \(j=1,\ldots,p\).

The beta distribution is parameterized by shape parameters \(a,b>0\), with density proportional to \(x^{a-1}(1-x)^{b-1}\) on \(0<x<1\). The theorem’s shapes are positive: \(\nu\ge p\) implies \(\nu-j+1\ge1\) for every factor, and \(q\ge1\). The product representation is an equality in distribution; it does not say that the beta variables are observed separately from the MANOVA data.

Deriving the Product Representation

First, a common nonsingular change of response coordinates does not alter \(\Lambda\). If \(E\) and \(H\) are replaced by \(C'EC\) and \(C'HC\), for nonsingular \(C\), each determinant is multiplied by \(|C|^2\), so the ratio is unchanged. We can therefore reduce the derivation to \(\Sigma=I_p\).

The central-null matrices can be represented as Gram matrices of independent standard normal observations: \(E=X'X\) for a \(\nu\times p\) standard normal matrix \(X\), and \(H=Z'Z\) for an independent \(q\times p\) standard normal matrix \(Z\). Equivalently, stack the rows to form \(G=\begin{pmatrix}X\\Z\end{pmatrix}\), an \((\nu+q)\times p\) standard normal matrix. Then \(E+H=G'G\).

Bartlett decomposition, applied to this Gaussian Gram-matrix construction, gives the determinant-ratio moment identity \[ E[\Lambda^t] = \frac{\Gamma_p(\nu/2+t)\,\Gamma_p((\nu+q)/2)} {\Gamma_p(\nu/2)\,\Gamma_p((\nu+q)/2+t)},\qquad t\ge0, \] where \(\Gamma_p(a)=\pi^{p(p-1)/4}\prod_{j=1}^{p}\Gamma\bigl(a-(j-1)/2\bigr)\) is the multivariate gamma function. For \(q\ge p\), the identity also follows by transforming the two Wishart matrices to their sum and their matrix-beta ratio: the ratio has matrix-beta normalizing constant \(\Gamma_p(\nu/2)\Gamma_p(q/2)/\Gamma_p((\nu+q)/2)\), and multiplying its density by \(|U|^t\) replaces \(\nu/2\) by \(\nu/2+t\). When \(q<p\), \(H\) is singular and that full-dimensional density argument does not apply; the Gaussian Gram-matrix Bartlett decomposition gives the same moment identity in this case as well.

Proof of the product law: For a beta variable \(B\sim\operatorname{Beta}(a,b)\), direct integration of its density gives \(E[B^t]=\Gamma(a+t)\Gamma(a+b)/\{\Gamma(a)\Gamma(a+b+t)\}\) for \(t\ge0\). Consequently, for independent \(B_j\sim\operatorname{Beta}((\nu-j+1)/2,q/2)\), \[ E\!\left[\left(\prod_{j=1}^{p}B_j\right)^t\right] = \prod_{j=1}^{p} \frac{\Gamma((\nu-j+1)/2+t)\, \Gamma((\nu+q-j+1)/2)} {\Gamma((\nu-j+1)/2)\, \Gamma((\nu+q-j+1)/2+t)}. \] Expanding both multivariate gamma functions in the Bartlett moment identity gives exactly this product. In particular, the moments agree for every nonnegative integer \(t\). Both \(\Lambda\) and \(\prod_jB_j\) lie in \([0,1]\), and probability distributions on this compact interval are uniquely determined by their moments (the Hausdorff moment theorem). Therefore they have the same distribution. \(\square\)

This derivation also explains the indexing. Expanding \(\Gamma_p(\nu/2+t)\) gives scalar gamma factors with arguments \((\nu-j+1)/2+t\), one for each response dimension \(j\). The second beta shape is \(q/2\) for every factor. It is the rank of the tested hypothesis, not the number of beta factors, that supplies this shape.

Worked Examples

Worked Example: Three Responses and a Rank-Two Hypothesis

Suppose a central MANOVA test has \(p=3\) responses, hypothesis rank \(q=2\), and residual degrees of freedom \(\nu=12\). Write the exact product representation and calculate its mean.

There are \(p=3\) beta factors. Their first shapes are \((12-j+1)/2\) for \(j=1,2,3\), giving \(6\), \(11/2\), and \(5\). Their second shape is \(q/2=1\) in every case. Thus \(\Lambda\overset{d}{=}B_1B_2B_3\), with independent \(B_1\sim\operatorname{Beta}(6,1)\), \(B_2\sim\operatorname{Beta}(11/2,1)\), and \(B_3\sim\operatorname{Beta}(5,1)\).

For \(B\sim\operatorname{Beta}(a,b)\), \(E[B]=a/(a+b)\). Independence therefore gives \(E[\Lambda]=(6/7)(11/13)(5/6)=55/91\), approximately \(0.6044\). The factors are three-dimensional because there are three responses, even though the tested hypothesis has rank two.

Worked Example: A Hypothesis Rank Smaller Than the Response Dimension

Take \(p=4\), \(q=2\), and \(\nu=9\). The hypothesis matrix has rank at most two, so \(H\) is singular as a \(4\times4\) matrix. Determine the exact law’s beta shapes and its mean.

The error matrix is nonsingular with probability one because \(\nu=9\ge4=p\). The product still has four factors, with first shapes \((9-j+1)/2\): \(9/2\), \(4\), \(7/2\), and \(3\). The second shape for each factor is \(q/2=1\). Hence \(\Lambda\overset{d}{=}B_1B_2B_3B_4\), where the independent factors have distributions \(\operatorname{Beta}(9/2,1)\), \(\operatorname{Beta}(4,1)\), \(\operatorname{Beta}(7/2,1)\), and \(\operatorname{Beta}(3,1)\).

Their means are \(9/11\), \(4/5\), \(7/9\), and \(3/4\). Thus \(E[\Lambda]=(9/11)(4/5)(7/9)(3/4)=21/55\). Singularity of \(H\) does not invalidate the determinant ratio: adding the positive-semidefinite matrix \(H\) to positive-definite \(E\) leaves \(E+H\) positive definite.

Worked Example: Checking the Scalar-Response Boundary Case

For one response, let \(p=1\), with \(q=3\) and \(\nu=8\). What does the product law become, and what is the expected value of Wilks’ lambda?

There is only one factor, and its shapes are \((8-1+1)/2=4\) and \(3/2\). Therefore \(\Lambda\sim\operatorname{Beta}(4,3/2)\). Its mean is \(4/(4+3/2)=4/(11/2)=8/11\).

The example checks the role of \(p\): with a single response, the product contains one beta variable. It also confirms that \(q\) remains the hypothesis rank and \(\nu\) remains the error degrees of freedom. This is a check of the beta product law, not a reduction to a separate univariate test statistic.

What the Dimensions Tell You

The product representation is useful for more than naming an exact distribution. It makes the model’s dimensional structure visible. Increasing \(p\) adds beta factors; changing \(q\) changes the common second shape; changing \(\nu\) changes the first shape of each factor. For example, the mean follows immediately from independence: \[ E[\Lambda]=\prod_{j=1}^{p} \frac{\nu-j+1}{\nu+q-j+1}. \] Each denominator exceeds its numerator when \(q>0\), so this null mean is strictly between zero and one.

The beta factors are a distributional device. They need not be independent components of the observed error and hypothesis matrices, and the product representation does not imply that each factor corresponds to an individual response. Its purpose is to specify the exact null law, with the dimensions and degrees of freedom made explicit.

Common mistake: Using \(q\) as the number of beta factors because \(q\) is the rank of the hypothesis. The number of factors is \(p\), the number of responses. The correct factors are \(B_j\sim\operatorname{Beta}((\nu-j+1)/2,q/2)\), \(j=1,\ldots,p\). A related mistake is to insert total sample size in place of \(\nu\); the first beta shape uses residual degrees of freedom.

Before applying the result, check the assumptions and the bookkeeping: the null is central, the hypothesis and error matrices are independent Wishart matrices with a common scale, \(q\) is the hypothesis rank, and \(\nu\ge p\) ensures a nonsingular error matrix. If these conditions fail, the stated exact law need not apply. In particular, noncentral alternatives do not have this central-null distribution.

Check Your Understanding

Use the product law and the dimension definitions to answer these questions.

  1. A test has \(p=5\), \(q=3\), and \(\nu=14\). How many independent beta factors appear, and what are the two shapes of the last factor?
  2. Why can the exact law apply when \(q<p\), even though \(H\) is then singular?
  3. For \(p=2\), \(q=4\), and \(\nu=10\), write the beta distributions of both factors.
  4. Which dimension determines the number of factors, and which dimension determines their common second shape?
  5. State the condition on \(\nu\) that ensures \(E\) is positive definite with probability one.
Clinical Biostats