Tutorials › High-Dimensional Genomic Data Analysis › Mixture Chi-Square Null Distribution for SKAT

Rare-Variant Burden and Variance-Component Tests · Tutorial 334 of 795

Mixture Chi-Square Null Distribution for SKAT

Learn why the SKAT statistic has a weighted chi-square null distribution, how to obtain its weights from a kernel spectrum, and what can undermine that calibration.

Advanced 12 min read

What You'll Learn

  • State the assumptions that make the SKAT score approximately multivariate normal under the null.
  • Derive the weighted chi-square mixture from the score covariance and weight matrix.
  • Relate the mixture weights to eigenvalues of the score-space or observation-space kernel.
  • Calculate mixture moments and work through null-tail calculations.
  • Recognize zero eigenvalues, poor asymptotic calibration, and incorrect degrees-of-freedom shortcuts.
  • Compare mixture calibration with single chi-square approximations and burden-score tests.

Why the SKAT Null Is a Mixture

The SKAT statistic is quadratic in a vector of variant-level scores. Even when each score is approximately normal under the null hypothesis, the quadratic form is not generally a single chi-square variable. Its null distribution depends on how variable the scores are, how they covary, and how the variants are weighted. The eigenvalues of the resulting quadratic form summarize those features: each positive eigenvalue becomes a weight on an independent one-degree-of-freedom chi-square variable.

The derivation starts with the quadratic score statistic from the earlier material on deriving the SKAT quadratic score statistic. This tutorial focuses on its null distribution and on using that distribution to calibrate a test. The result is exact when the score vector is normal with known covariance; in many association models, normality is an asymptotic approximation.

Definition: Let \(U\) be the \(m\)-dimensional score vector for \(m\) variants, let \(W\) be a symmetric positive semidefinite weight matrix, and let \(\Sigma_U=\operatorname{Cov}(U\mid H_0)\). The SKAT quadratic statistic is \(Q=U^\mathsf{T}WU\). Define \(A=W^{1/2}\Sigma_UW^{1/2}\), where \(W^{1/2}\) is the symmetric positive semidefinite square root of \(W\). If the eigenvalues of \(A\) are \(\lambda_1,\ldots,\lambda_m\), including any zeros, then under a multivariate normal null score, \(Q\) has the distribution of \(\sum_{j=1}^{m}\lambda_j\chi^2_{1,j}\), where the \(\chi^2_{1,j}\) are independent chi-square random variables with one degree of freedom. This is a weighted mixture of chi-square variables.

Assumptions and the Eigenvalue Derivation

For the result, the null score must have mean zero and covariance \(\Sigma_U\), and \(W\) must be symmetric positive semidefinite. If \(U\sim N(0,\Sigma_U)\), these conditions give the distribution exactly, even if \(\Sigma_U\) is singular. If the score is not exactly normal, the same result is an asymptotic null approximation when a multivariate central limit theorem applies and the null covariance is consistently estimated. In association analyses, nuisance covariates must be accounted for in the score and its covariance; otherwise the stated null distribution may not apply.

To see the result, write \(U=\Sigma_U^{1/2}Z\), where \(Z\sim N(0,I)\). Substitution into the statistic gives \(Q=Z^\mathsf{T}\Sigma_U^{1/2}W\Sigma_U^{1/2}Z\). The matrix in this expression is symmetric and positive semidefinite. Orthogonally diagonalizing it rotates \(Z\) without changing its standard multivariate normal distribution. Its rotated coordinates remain independent standard normal variables, and their squares are independent \(\chi^2_1\) variables.

$$ Q =Z^\mathsf{T}\Sigma_U^{1/2}W\Sigma_U^{1/2}Z \ \overset{d}{=}\ \sum_{j=1}^{m}\lambda_j Z_j^2 =\sum_{j=1}^{m}\lambda_j\chi^2_{1,j}. $$

The eigenvalues in the definition use \(A=W^{1/2}\Sigma_UW^{1/2}\). This has the same nonzero eigenvalues as \(\Sigma_U^{1/2}W\Sigma_U^{1/2}\), so either matrix gives the mixture weights. In the common linear-model formulation, if \(G\) is the \(n\times m\) genotype matrix and \(R\) is a residual vector with covariance \(\sigma^2 M\), then \(U=G^\mathsf{T}R\) has covariance \(\sigma^2G^\mathsf{T}MG\). The score-space matrix is therefore \(W^{1/2}(\sigma^2G^\mathsf{T}MG)W^{1/2}\). Equivalently, the nonzero weights can be obtained from the observation-space matrix \(\sigma^2M^{1/2}GWG^\mathsf{T}M^{1/2}\). This explains the reference to kernel eigenvalues: they are the eigenvalues of the relevant weighted score or observation-space quadratic form, not necessarily the eigenvalues of an unweighted genotype matrix.

Zero eigenvalues contribute nothing to \(Q\); they do not add degrees of freedom. A positive eigenvalue \(\lambda_j\) scales one \(\chi^2_1\) component. Thus, the mixture is not generally determined just by the number of variants or by a nominal degrees-of-freedom count.

Worked Mixture Calculations

Worked Example: A Two-Component Mixture and Its Tail Probability

Suppose a hypothetical null score has covariance \(\Sigma_U=\begin{pmatrix}4&0\\0&1\end{pmatrix}\), and \(W=I\). The observed score is \(U=(2,1)^\mathsf{T}\). Calculate \(Q\), identify its null distribution, and assess the upper-tail probability.

The observed statistic is \(Q=U^\mathsf{T}U=2^2+1^2=5\). Since \(A=W^{1/2}\Sigma_UW^{1/2}=\operatorname{diag}(4,1)\), its eigenvalues are 4 and 1. Under the normal null, \(Q\) has the distribution \(4\chi^2_{1,1}+\chi^2_{1,2}\), not \(5\chi^2_2\).

For this two-component case, write independent standard normal variables in polar form. Conditional on angle \(\theta\), the quadratic form is \(r^2(4\cos^2\theta+\sin^2\theta)\); for two independent standard normals, \(P(r^2\geq c)=\exp(-c/2)\). Therefore the upper-tail probability at the observed value is \(P(Q\geq5)=\frac{2}{\pi}\int_0^{\pi/2}\exp\{-5/[2(4\cos^2\theta+\sin^2\theta)]\}\,d\theta\). Numerical quadrature gives approximately 0.337. Under these hypothetical model assumptions, the observed statistic is not unusually large relative to this null distribution at a 0.05 significance level.

Worked Example: Computing Eigenvalues After Variant Weighting

Consider a hypothetical two-variant score with covariance \(\Sigma_U=\begin{pmatrix}1&0.5\\0.5&1\end{pmatrix}\), weight matrix \(W=\operatorname{diag}(4,1)\), and observed score \(U=(1,2)^\mathsf{T}\). Find the statistic and the mixture weights.

The statistic is \(Q=U^\mathsf{T}WU=4(1)^2+(2)^2=8\). Since \(W^{1/2}=\operatorname{diag}(2,1)\), the matrix that determines the mixture is \(A=W^{1/2}\Sigma_UW^{1/2}=\begin{pmatrix}4&1\\1&1\end{pmatrix}\). Its trace is 5 and determinant is 3, so its eigenvalues solve \(\lambda^2-5\lambda+3=0\). Thus \(\lambda_1=(5+\sqrt{13})/2\approx4.303\) and \(\lambda_2=(5-\sqrt{13})/2\approx0.6972\).

The null distribution is consequently approximately \(4.303\chi^2_{1,1}+0.6972\chi^2_{1,2}\). Both the score covariance and the unequal variant weights affect the mixture; using the eigenvalues of \(\Sigma_U\) alone would ignore the weighting and give the wrong calibration. The observed value \(Q=8\) can be compared with this mixture using a numerical tail-probability method.

Worked Example: Repeated Eigenvalues Reduce to a Single Chi-Square

Suppose, hypothetically, all three eigenvalues of \(A\) equal 2, and the observed statistic is \(Q=12\). Then \(Q=2(\chi^2_{1,1}+\chi^2_{1,2}+\chi^2_{1,3})\). The sum in parentheses has a \(\chi^2_3\) distribution, so \(Q/2\sim\chi^2_3\).

The upper-tail probability is \(P(Q\geq12)=P(\chi^2_3\geq6)\approx0.1116\). The equality of the three positive eigenvalues permits this simplification. If the eigenvalues were unequal, their weighted sum would not in general be a scaled chi-square distribution with three degrees of freedom.

Moments, Calibration, and Numerical Evaluation

The mixture representation gives useful checks on a calculation. Because a \(\chi^2_1\) variable has mean 1 and variance 2, independence implies that the null mean and variance of \(Q\) are

$$ E(Q\mid H_0)=\sum_j\lambda_j,\qquad \operatorname{Var}(Q\mid H_0)=2\sum_j\lambda_j^2. $$

For the first worked example, these are \(4+1=5\) and \(2(4^2+1^2)=34\). These moments can detect some mistakes—for example, an incorrect eigenvalue list may fail to reproduce the trace and sum of squared eigenvalues—but matching moments alone does not establish that a tail probability is correct.

For a general mixture, the upper-tail probability \(P(Q\geq q_{\mathrm{obs}}\mid H_0)\) is computed numerically. Methods such as the Davies and Imhof procedures evaluate the distribution of a weighted chi-square sum; they do not replace the mixture with an ordinary chi-square. Approximate moment-matching methods can be faster, but may be less accurate in extreme tails. For a genome-wide or other stringent threshold, tail accuracy matters: a small absolute error can be large relative to the true probability.

The weights must be nonnegative for this representation. A materially negative computed eigenvalue usually signals numerical error or an incorrectly constructed matrix, since the target matrix is positive semidefinite. Tiny negative values caused by floating-point rounding may be treated as zero only after checking the scale and numerical precision. If all eigenvalues are zero, then \(Q=0\) under the stated model and there is no nondegenerate test statistic to calibrate.

Diagnostics, Alternatives, and Limitations

A reliable calibration requires more than diagonalizing a matrix. Check that the score is centered under the null, that nuisance covariates were handled consistently in both the score and its covariance, that the same weights were used to form \(Q\) and \(A\), and that the eigenvalues are nonnegative up to numerical tolerance. Also compare the computed sum of eigenvalues with \(\operatorname{tr}(A)\), and compare the sum of their squares with \(\operatorname{tr}(A^2)\). Disagreement indicates an implementation or numerical problem.

The normal-score approximation can be weak when data are highly discrete, observations are influential, or the effective information is limited. In those settings, the mixture based on an asymptotic covariance may not give accurate tail probabilities. This is a limitation of the approximation, not a change in the eigenvalue derivation. Diagnostics should include null calibration in suitable simulations or other checks appropriate to the data and model.

A single scaled chi-square is justified when all positive eigenvalues are equal; otherwise it is only an approximation. A burden-score test instead tests a collapsed, directional score and has a different null statistic and alternative emphasis. It is not a substitute for evaluating the SKAT mixture when the SKAT statistic is the chosen test. Resampling or permutation can offer an alternative calibration when its exchangeability assumptions hold, but may be computationally demanding and must respect the study design and covariate structure.

A common mistake is to count variants and compare \(Q\) with a chi-square distribution having that many degrees of freedom. This reasoning assumes equal mixture weights, which need not hold even when all variants are included. The correction is to calculate the eigenvalues of \(W^{1/2}\Sigma_UW^{1/2}\) and evaluate the resulting weighted sum. Another mistake is to interpret a mixture p-value as evidence that a particular variant is associated: the statistic tests the set-level null, and its calibration does not identify which variant contributes.

Key takeaway: Under a centered normal null score, the SKAT quadratic statistic is a sum of independent one-degree-of-freedom chi-square variables weighted by the eigenvalues of \(W^{1/2}\Sigma_UW^{1/2}\). Correct tail calibration depends on the full spectrum, not just the number of variants.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. If the positive eigenvalues are 3 and 0.5, what is the null mixture distribution of \(Q\)?
  2. For eigenvalues 2, 2, and 0, simplify the distribution of \(Q\).
  3. Why is it generally wrong to use a chi-square distribution with degrees of freedom equal to the number of variants?
  4. What matrix should be diagonalized when \(Q=U^\mathsf{T}WU\) and \(\operatorname{Cov}(U\mid H_0)=\Sigma_U\)?
  5. Name two checks that can reveal an error in the calculated eigenvalues or calibration.

Solutions. (1) \(Q\) has distribution \(3\chi^2_{1,1}+0.5\chi^2_{1,2}\), with independent components. (2) The zero eigenvalue contributes nothing, so \(Q=2(\chi^2_{1,1}+\chi^2_{1,2})\), which has distribution \(2\chi^2_2\). (3) That shortcut assumes equal positive eigenvalues; unequal eigenvalues produce a weighted mixture, not the ordinary chi-square with that variant count as its degrees of freedom. (4) Diagonalize \(W^{1/2}\Sigma_UW^{1/2}\), whose eigenvalues are the mixture weights. (5) Check that the eigenvalues are nonnegative up to numerical tolerance, that their sum equals \(\operatorname{tr}(A)\), and that their squared sum equals \(\operatorname{tr}(A^2)\); null simulations can also assess calibration.

Clinical Biostats