Why Opposing Effects Matter
A burden test compresses information across variants into one score. That compression is useful when the variants in a set tend to affect the phenotype in the same direction: their contributions can reinforce one another. But if some variants increase the phenotype and others decrease it, the contributions can offset. The set may contain real effects while its combined burden score has little average association signal.
This is a power issue, not evidence that every variant is harmless. A burden test targets a particular kind of combined effect: the association between a specified weighted score and the phenotype. When the effects oppose one another, that target may be small even when individual effects are not.
For the derivation and examples below, assume independent individuals, mean-zero genotype dosages, and independent variants with genotype variances \(v_j=\operatorname{Var}(G_{ij})\). Assume the errors are independent of genotypes, have mean zero and variance \(\sigma^2\), and there is no confounding of genotype and phenotype. The effects and weights are treated as fixed. These assumptions simplify the calculation; linkage disequilibrium and other departures are discussed below. A burden score test uses a standardized association score, with its null distribution approximated by the standard normal distribution in the setting considered here.
Where Cancellation Enters the Score
Under the model, the phenotype’s genetic component is \(\sum_j\beta_jG_{ij}\). The covariance between that component and the burden score is \(\operatorname{Cov}(B_i,\sum_j\beta_jG_{ij})=\sum_jw_j\beta_jv_j\) when variants are independent. This covariance is the expected signal that the one-dimensional burden test can detect. The variance of the burden score is \(\sum_jw_j^2v_j\).
The approximate standardized mean displacement of the score statistic is therefore
The numerator is a signed sum. A variant with a positive effect contributes in one direction and a variant with a negative effect contributes in the other, assuming positive weights. If these terms nearly cancel, \(|\delta|\) is small. A small \(|\delta|\) means that the score statistic’s distribution under the alternative is not far from its null distribution, so the test often fails to reject even when some \(\beta_j\) are substantial.
For a two-sided test at significance level \(\alpha\), let \(c=z_{1-\alpha/2}\), the standard-normal critical value. Under a local-alternative approximation (or if the standardized score variance is approximately 1 under the alternative), \(Z\) is approximately \(N(\delta,1)\), and the corresponding approximate power is. For the fixed effects in the examples below, the score’s alternative variance need not equal its null variance; it depends on the genotype distribution, including higher moments. The supplied inputs do not determine fixed-effect power, so the numerical power values below are mean-shift calculations under the unit-variance approximation, not fixed-effect power estimates.
where \(\Phi\) is the standard normal cumulative distribution function. Under this unit-variance normal approximation, power depends on \(|\delta|\) for a two-sided test: a negative displacement reverses the direction of the association but does not, by itself, lower two-sided power compared with the same positive displacement.
Worked Example: Opposing Effects Leave a Modest Net Signal
Suppose a hypothetical study has \(n=10{,}000\) independent participants and two independent variants. Each genotype has variance \(v_1=v_2=0.02\), both burden weights are 1, the residual standard deviation is \(\sigma=1\) phenotype unit, and the effects are \(\beta_1=0.300\) and \(\beta_2=-0.141886\) phenotype units per allele. These assumptions are stipulated for the calculation; the values are not from a real study.
The burden variance is \(0.02+0.02=0.04\), so its standard deviation is \(\sqrt{0.04}=0.2\). The covariance signal is \(0.02(0.300)+0.02(-0.141886)=0.00316228\). Thus \(\delta=\sqrt{10{,}000}(0.00316228)/(1\times0.2)=1.58114\), approximately \(\sqrt{2.50}\).
For a two-sided test with \(\alpha=0.05\), take \(c=1.96\). The approximate power is \(\Phi(-1.96-1.58114)+1-\Phi(1.96-1.58114)\) \(=\Phi(-3.54114)+1-\Phi(0.37886)\) \(\approx0.0002+0.3525=0.3527\), or about 35.3%. The contributions oppose one another, so power is far below what would be expected if both effects had the same direction and similar magnitudes. It is still above the 5% null rejection rate because cancellation is incomplete.
Worked Cases: Exact and Near Cancellation
Worked Example: Nonzero Effects With Exact Cancellation
Consider a second hypothetical setting with \(n=5{,}000\), independent variants, weights \(w_1=w_2=1\), variances \(v_1=0.01\) and \(v_2=0.04\), residual standard deviation \(\sigma=1\) phenotype unit, and effects \(\beta_1=0.40\) and \(\beta_2=-0.10\) phenotype units per allele.
The first variant contributes \(w_1\beta_1v_1=1(0.40)(0.01)=0.004\) to the covariance signal. The second contributes \(w_2\beta_2v_2=1(-0.10)(0.04)=-0.004\). Their sum is zero, whereas the burden variance is \(0.01+0.04=0.05\). Consequently, \(\delta=\sqrt{5{,}000}(0)/(1\sqrt{0.05})=0\).
Under the local-alternative approximation, the statistic has no mean displacement from its null distribution, so the approximate rejection probability is the nominal 5%. For the stated fixed effects, however, zero mean displacement alone does not imply a 5% rejection probability: the score’s alternative variance may differ from its null variance, and the genotype variances given here do not determine that alternative variance. This does not say that the two effects are zero: both specified effects are nonzero. It says that this particular burden score has no first-order mean signal for them. The test can therefore have little power against this mixed-direction pattern.
Worked Example: A Small Net Signal Despite a Large Individual Effect
Suppose a hypothetical study has \(n=10{,}000\), \(\sigma=1\) phenotype unit, and two independent variants with \(v_1=0.01\), \(v_2=0.04\), weights both 1, and effects \(\beta_1=0.30\) and \(\beta_2=-0.10\) phenotype units per allele.
The covariance contributions are \(0.01(0.30)=0.003\) and \(0.04(-0.10)=-0.004\), giving a net signal of \(-0.001\). The burden variance is \(0.01+0.04=0.05\). Therefore \(\delta=100(-0.001)/\sqrt{0.05}=-0.4472\).
For \(\alpha=0.05\), approximate two-sided power is \(\Phi(-1.96-(-0.4472))+1-\Phi(1.96-(-0.4472))\) \(=\Phi(-1.5128)+1-\Phi(2.4072)\) \(\approx0.0652+0.0080=0.0732\), or about 7.32%. The negative sign indicates the net burden association is in the negative direction under the chosen coding; it does not make the two-sided power calculation negative. Here the larger variance of the second genotype makes its negative contribution outweigh the first variant’s positive contribution.
Justification and Interpretation
The score’s mean displacement follows directly from its covariance with the phenotype. In the simplified model, the burden component of an individual’s phenotype is \(\sum_j\beta_jG_{ij}\). Since each centered genotype has mean zero and the variants are independent, cross-variant covariances vanish. Hence \(\operatorname{Cov}(B_i,Y_i)=\sum_jw_j\beta_jv_j\). Under the null, the score has variance approximately \(n\sigma^2\operatorname{Var}(B_i)\). Dividing its alternative mean, approximately \(n\operatorname{Cov}(B_i,Y_i)\), by the null standard deviation, \(\sqrt{n\sigma^2\operatorname{Var}(B_i)}\), gives the stated \(\delta\). This derivation identifies the cancellation mechanism: it is the signed covariance contributions, not simply the count of positive and negative effects, that determine the mean signal.
With correlated variants, let \(\Sigma\) be the genotype covariance matrix, \(w\) the vector of weights, and \(\beta\) the vector of effects. The corresponding quantities are \(\operatorname{Var}(B_i)=w^\mathsf{T}\Sigma w\) and \(\operatorname{Cov}(B_i,\sum_j\beta_jG_{ij})=w^\mathsf{T}\Sigma\beta\). Thus the displacement becomes \(\delta=\sqrt{n}\,w^\mathsf{T}\Sigma\beta/(\sigma\sqrt{w^\mathsf{T}\Sigma w})\). Linkage disequilibrium changes the contributions through the covariance matrix; the independent-variant sum is not generally valid when variants are correlated.
The calculation is an approximation under the stated model and normal score calibration. It is most useful for understanding how the specified effects, weights, genotype variation, and sample size combine. In applications, the effects are unknown, and their estimates can be noisy—particularly for rare variants. A power calculation based on assumed effects is conditional on those assumptions; it is not a guaranteed power level for a real study.
Diagnostics, Alternatives, and Limitations
To diagnose potential cancellation, examine the expected or estimated contributions \(w_j\beta_jv_j\), not just the signs of the effects or the number of variants in each direction. Opposite signs are a warning, but cancellation depends on magnitudes, weights, genotype variances, and, with linkage disequilibrium, covariance. In real data, estimated effects may be unstable, so direction patterns should be interpreted cautiously. Choosing weights or a variant subset after inspecting the same outcome data can also inflate the false-positive rate unless that selection is accounted for.
A very small burden statistic alone cannot diagnose cancellation. It can also result from small effects, low genotype variation, a small sample, measurement error, or a mismatch between the chosen weights and the true effects. Check the genotype coding and allele harmonization, verify the intended weights, and examine whether the model assumptions are plausible. If variants are correlated, use the covariance-aware calculation rather than treating their contributions as independent.
The main strength of a burden test is its efficiency when effects align with the score’s direction: aggregating can yield a strong signal with fewer degrees of freedom than testing variants separately. Its central limitation is the same aggregation: one signed score cannot represent every mixed-direction pattern well. Variant-by-variant tests retain direction-specific information but may have low power for rare variants and require attention to multiple testing. Methods designed to detect variation in effects across a set provide another option when directions may differ; they target a different pattern of association and require their own calibration. Neither alternative makes assumptions or limitations disappear, and a significant set-level result does not identify which variants are responsible.
The practical lesson is to treat the burden test as a targeted summary, not a universal test for any genetic effect in a region. Its power is highest when the specified score aligns with the pattern of effects. When protective and risk-increasing effects coexist, a weak burden result does not rule out meaningful variant-level associations; it may show that a single-direction summary is poorly matched to them.
Check Your Understanding
Use the formulas and assumptions in this tutorial to answer the questions. Solutions follow each problem.
- With positive weights and independent variants, what quantity determines whether variant contributions cancel in the mean burden signal?
- Suppose two variants have \(w_1=w_2=1\), \(v_1=0.02\), \(v_2=0.03\), and effects \(\beta_1=0.30\), \(\beta_2=-0.20\). Calculate their total covariance signal.
- If a two-sided burden statistic has displacement \(\delta=-1.2\), does the negative sign alone imply lower power than \(\delta=1.2\)? Explain.
- Why is it incorrect to conclude from a nonsignificant burden test that all variants in the set have zero effects?
Solutions. (1) The relevant sum is \(\sum_jw_j\beta_jv_j\); its signed terms can reinforce or offset one another. (2) The contributions are \(1(0.30)(0.02)=0.006\) and \(1(-0.20)(0.03)=-0.006\), so the total covariance signal is zero. (3) No. For a symmetric two-sided test with standard-normal variance, the power formula is unchanged when \(\delta\) is replaced by \(-\delta\); the sign identifies direction, not lower power by itself. (4) Nonzero variant effects can cancel in the burden score, and the test evaluates that combined score rather than each variant separately. Low power or other model limitations can also produce a nonsignificant result.