Tutorials › Statistical Genetics › The Mixture Chi-Square Null Distribution of SKAT

Kernel Tests and SKAT Methods · Tutorial 441 of 989

The Mixture Chi-Square Null Distribution of SKAT

Learn how eigenvalues turn the SKAT score quadratic form into a weighted sum of independent one-degree-of-freedom chi-square variables.

Advanced 10 min read

What You'll Learn

  • State the score-normal approximation and other conditions underlying the SKAT null distribution.
  • Express the SKAT quadratic form using the covariance matrix of the weighted score.
  • Derive the mixture chi-square law by diagonalizing that covariance matrix.
  • Interpret positive and zero eigenvalues in terms of the mixture components.
  • Distinguish a chi-square mixture from a chi-square distribution with fixed degrees of freedom.
  • Check the null-law calculations in concrete hypothetical examples.

Why the Null Distribution Is a Mixture

The SKAT statistic is a quadratic form in variant-level score information. Even when each score is approximately normal under the null hypothesis, the quadratic form does not generally have the same null distribution as a single chi-square statistic. Its distribution depends on how variability is spread across directions in the weighted score vector. The eigenvalues of that vector’s covariance matrix describe this spread and determine the null law.

The distinction matters for inference: a chi-square distribution with a fixed number of degrees of freedom is not generally a valid substitute for the SKAT null distribution. This tutorial derives the mixture form and explains what its eigenvalues do. It does not address numerical methods for evaluating tail probabilities.

Score Quadratic Form and Assumptions

Let \(U\) be the \(m\)-component vector of variant-level scores under the null hypothesis \(H_0\), and let \(V\) be its covariance matrix under \(H_0\). Let \(W\) be the symmetric positive-semidefinite matrix that defines the SKAT quadratic form. In the usual diagonal-weight case, \(W\) is diagonal and its entries are the nonnegative quadratic-form weights. Define

$$ Q=U^{\mathsf T}WU. $$

The distributional argument below uses the standard score-normal approximation: under \(H_0\), \(U\) is approximately multivariate normal with mean zero and covariance \(V\). Equivalently, the weighted score vector \(W^{1/2}U\) is approximately multivariate normal with mean zero and covariance \(W^{1/2}VW^{1/2}\). This approximation is exact if the score vector is exactly multivariate normal; in applications it is typically an asymptotic approximation under the null model and its regularity conditions. The weights are treated as fixed for this derivation, and the covariance matrix is assumed to describe the null variability adequately.

Definition: The mixture chi-square null distribution of the SKAT statistic is a distribution of the form \(\sum_{j=1}^{r}\lambda_j X_j\), where \(X_j\) are independent chi-square random variables with one degree of freedom and \(\lambda_j\) are the positive eigenvalues of \(W^{1/2}VW^{1/2}\). The weights \(\lambda_j\) are determined by the null covariance and the SKAT quadratic-form weights; they are not generally all equal.

The matrix \(W^{1/2}VW^{1/2}\) is positive semidefinite: \(V\) is a covariance matrix and hence positive semidefinite, and \(W\) is also positive semidefinite. Thus its eigenvalues are nonnegative. If some eigenvalues are zero, their directions contribute nothing to \(Q\) and are omitted from the sum. The number \(r\) of positive eigenvalues is the rank of this matrix.

Deriving the Mixture Form

Set \(Z=W^{1/2}U\) and \(A=W^{1/2}VW^{1/2}\). Then \(Q=Z^{\mathsf T}Z\), and under the stated score-normal approximation \(Z\) is approximately \(N(0,A)\). Since \(A\) is symmetric and positive semidefinite, it has an orthogonal eigendecomposition \(A=P\Lambda P^{\mathsf T}\), where \(P^{\mathsf T}P=I\) and \(\Lambda\) is diagonal with the eigenvalues of \(A\). Rotating the vector by \(P^{\mathsf T}\) preserves its squared length. Its coordinates in the eigenvector directions have variances given by the eigenvalues.

$$ Y=P^{\mathsf T}Z,\qquad \operatorname{Cov}(Y)=P^{\mathsf T}AP=\Lambda,\qquad Q=Z^{\mathsf T}Z=Y^{\mathsf T}Y. $$

A multivariate normal vector with diagonal covariance has independent coordinates. For each positive eigenvalue \(\lambda_j\), the corresponding coordinate \(Y_j\) is therefore distributed as \(\sqrt{\lambda_j}\,N_j\), where the \(N_j\) are independent standard normal random variables. Squaring and summing gives the result:

$$ Q=\sum_{j=1}^{r}Y_j^2 \ \overset{d}{=}\ \sum_{j=1}^{r}\lambda_j N_j^2 =\sum_{j=1}^{r}\lambda_j X_j, \qquad X_j=N_j^2\sim\chi^2_1. $$

Here \(\overset{d}{=}\) denotes equality in distribution under the normal model, or the corresponding approximate equality under the score-normal approximation. A zero eigenvalue gives a coordinate with zero variance, so that coordinate is zero with probability one and adds no term. This completes the derivation: each independent squared standard-normal coordinate contributes a \(\chi^2_1\) variable, scaled by its eigenvalue.

1
Form the weighted score covariance.
Use \(A=W^{1/2}VW^{1/2}\), which describes the covariance of \(W^{1/2}U\) under \(H_0\).
2
Diagonalize it.
Find the eigenvalues of \(A\). They are nonnegative because \(A\) is positive semidefinite.
3
Write the null law.
Each positive eigenvalue multiplies one independent \(\chi^2_1\) component; zero eigenvalues contribute nothing.

Worked Examples

Worked Example: A Two-Variant Weighted Score

Suppose, hypothetically, that the covariance matrix of the weighted score vector is

$$ A= \begin{pmatrix} 4 & 1.2\\ 1.2 & 1 \end{pmatrix}. $$

This matrix is positive definite: its leading diagonal entry is positive and its determinant is \(4(1)-1.2^2=2.56>0\). Its eigenvalues solve \(\det(A-\lambda I)=0\). The trace is \(5\), the determinant is \(2.56\), and therefore

$$ \lambda^2-5\lambda+2.56=0,\qquad \lambda=\frac{5\pm\sqrt{25-4(2.56)}}{2} =\frac{5\pm\sqrt{14.76}}{2}. $$

Since \(\sqrt{14.76}\approx3.842\), the eigenvalues are approximately \(4.421\) and \(0.5791\). Thus, under the score-normal null model,

$$ Q\ \overset{d}{\approx}\ 4.421X_1+0.5791X_2, \qquad X_1,X_2\ \text{independent and }X_j\sim\chi^2_1. $$

There are two positive eigenvalues, so there are two mixture components. But the components have markedly different scales. The law is not a \(\chi^2_2\) distribution: that distribution would assign a weight of \(1\) to each of its two independent \(\chi^2_1\) components.

Worked Example: A Zero Eigenvalue Removes a Component

Suppose a hypothetical three-variant analysis has weighted score covariance

$$ A= \begin{pmatrix} 2&0&0\\ 0&0.5&0\\ 0&0&0 \end{pmatrix}. $$

Because this matrix is diagonal, its eigenvalues are its diagonal entries: \(2\), \(0.5\), and \(0\). The first two directions have positive null variance; the third has none. Consequently,

$$ Q\ \overset{d}{\approx}\ 2X_1+0.5X_2, \qquad X_1,X_2\ \text{independent and }X_j\sim\chi^2_1. $$

Although the score vector has three entries, the mixture has only two nonzero components because the covariance matrix has rank \(2\). A zero eigenvalue does not create a \(\chi^2_1\) term with a small but positive contribution; it contributes exactly zero under this model. The example separates the number of variants, \(m=3\), from the number of positive eigenvalues, \(r=2\).

Worked Example: Equal Versus Unequal Eigenvalues

Consider first a hypothetical weighted score covariance with eigenvalues \(2,2,2\). Its null law is

$$ Q\ \overset{d}{\approx}\ 2X_1+2X_2+2X_3 =2\left(X_1+X_2+X_3\right) \ \overset{d}{=}\ 2\chi^2_3. $$

The equality follows because a sum of three independent \(\chi^2_1\) variables has a \(\chi^2_3\) distribution. Even here, the result is a scaled chi-square, not the standard \(\chi^2_3\) distribution.

Now suppose instead that the eigenvalues are \(3,1,0.5\). The null law becomes \(3X_1+X_2+0.5X_3\), a mixture with unequal weights. Its mean is \(3+1+0.5=4.5\), and its variance is \(2(3^2+1^2+0.5^2)=20.5\). The variance calculation uses \(E(X_j)=1\), \(\operatorname{Var}(X_j)=2\), and independence. A single ordinary chi-square distribution with degrees of freedom \(4.5\) would have mean \(4.5\) but variance \(9\), not \(20.5\). Matching the mean alone therefore cannot justify replacing this mixture with an ordinary chi-square distribution.

Why the Degrees of Freedom Are Not Generally Fixed

For a standard \(\chi^2_k\) distribution, the statistic is a sum of \(k\) independent squared standard normals, each with coefficient \(1\). SKAT instead produces the weighted sum \(\sum_{j=1}^{r}\lambda_jX_j\). Its number of nonzero terms is the rank \(r\), but the coefficients can differ across terms and can depend on the covariance structure as well as on the chosen kernel weights. Thus “degrees of freedom equal the number of variants” is generally wrong, and “degrees of freedom equal the rank” does not by itself specify the mixture law.

If all \(r\) positive eigenvalues are equal to a common value \(c\), the distribution simplifies to \(c\chi^2_r\). If \(c=1\), this is an ordinary \(\chi^2_r\); if \(c\ne1\), it is scaled. When the eigenvalues are unequal, the law generally remains a weighted sum rather than a single chi-square distribution. The eigenvalues are consequently part of the null-distribution specification, not merely a way to count its terms.

Two useful checks follow directly from the mixture representation. Its mean and variance are

$$ E(Q)=\sum_{j=1}^{r}\lambda_j,\qquad \operatorname{Var}(Q)=2\sum_{j=1}^{r}\lambda_j^2. $$

These formulas can verify calculations and show why a simple degree-of-freedom count loses information: the mean depends on the sum of the eigenvalues, while the variance also depends on their squared sizes. They do not, on their own, turn the mixture into an ordinary chi-square distribution.

Common Mistake and Practical Meaning

Incorrect reasoning: “There are \(m\) variants, so the SKAT statistic has a \(\chi^2_m\) null distribution.” This treats every score direction as if it contributed an independent squared standard normal with coefficient \(1\). But the correct null form has coefficients equal to the eigenvalues of \(W^{1/2}VW^{1/2}\); some can be zero, and the positive ones need not equal one.

Correction: First establish the null score covariance and the quadratic-form weights, then use the eigenvalues of the resulting weighted covariance matrix to characterize the mixture. The number of variants alone does not determine either the number of nonzero components or their weights. In particular, correlated score directions can change the eigenvalues, even when the variant count is unchanged.

The mixture representation provides the bridge between the SKAT score statistic and its null calibration. It explains why two analyses with the same number of variants need not have the same null distribution, and why the covariance structure matters. A computed SKAT statistic is interpreted relative to this distribution under the null model; the mixture form does not imply that any one variant is individually associated or establish a causal effect.

Check Your Understanding

Use the mixture derivation and the role of the eigenvalues to answer these questions.

  1. What assumptions about the null score vector are used to derive the SKAT mixture chi-square law?
  2. If the weighted score covariance has eigenvalues \(2,0.5,0\), how many nonzero mixture components are present, and what is the null form?
  3. Why does a score vector with \(m\) entries not necessarily lead to a \(\chi^2_m\) null distribution?
  4. When do equal positive eigenvalues yield a scaled chi-square distribution? When is it an ordinary chi-square distribution?
  5. For a mixture with positive eigenvalues \(\lambda_1,\ldots,\lambda_r\), state its mean and variance under the score-normal model.
Clinical Biostats