Why Opposing Effects Matter
A burden test compresses several variants into one score for each person. This can be powerful when included variants tend to shift the trait in the same direction: their contributions reinforce one another. But if some variants increase the trait and others decrease it, the signed contributions may offset. A small burden-test signal can then occur even when individual variants have meaningful effects.
The direction of an effect depends on how the outcome is coded. For a quantitative trait, a positive effect means that carrying an additional effect allele is associated with a higher value of the trait, conditional on the model. A negative effect means a lower value. In a case-control analysis, the direction instead depends on which outcome is coded as the event. Neither direction by itself establishes causation.
How Cancellation Enters the Burden Score
Consider \(m\) variants and let \(G_{ij}\) denote the dosage or carrier indicator for variant \(j\) in person \(i\), according to the chosen burden definition. With prespecified nonnegative weights \(w_j\), the burden is \(B_i=\sum_{j=1}^{m}w_jG_{ij}\). A standard linear-model description of a quantitative trait is
where \(\beta_j\) is the conditional change in the trait per unit of \(G_{ij}\), and \(\varepsilon_i\) is an error term with mean zero given the genotypes. For the simple calculations below, assume the genotypes are independent across variants and the errors are independent of the genotypes, with constant variance. These assumptions make the source of cancellation transparent; real analyses may use covariate-adjusted models and correlated variants.
If the burden is fitted as the single genetic predictor, its population slope is the covariance of \(B_i\) with \(Y_i\), divided by the variance of \(B_i\). Under the stated independence assumptions, this gives
For a carrier indicator with carrier probability \(p_j\), \(\operatorname{Var}(G_{ij})=p_j(1-p_j)\). The numerator is a signed sum: a positive \(\beta_j\) contributes in one direction and a negative \(\beta_j\) in the other. The denominator is nonnegative, so it does not undo the numerator’s cancellation. This formula also shows why the burden result is not a simple unweighted average of variant effects: variants with different weights and genotype variation contribute differently.
A Derivation of the Cancellation Formula
The key calculation follows from covariance linearity. Write the burden and genetic component of the trait as \(B_i=\sum_jw_jG_{ij}\) and \(Y_i-\mu=\sum_k\beta_kG_{ik}+\varepsilon_i\). Then
Because the errors have mean zero given the genotypes, \(\operatorname{Cov}(B_i,\varepsilon_i)=0\). If variants are independent, \(\operatorname{Cov}(G_{ij},G_{ik})=0\) whenever \(j\ne k\). Only terms with \(j=k\) remain, so
Similarly, independence gives \(\operatorname{Var}(B_i)=\sum_jw_j^2\operatorname{Var}(G_{ij})\). Dividing the covariance by this variance yields the stated burden slope. If variants are correlated, the double sum contains cross-variant covariance terms too; cancellation can then depend on linkage disequilibrium as well as on the signs of the \(\beta_j\).
Worked Example: Nearly Opposing Contributions
Suppose a hypothetical quantitative-trait study uses two independent carrier indicators, equal weights of 1, and a trait measured in millimetres. The carrier probabilities are \(p_1=0.01\) and \(p_2=0.02\). Under the assumed model, variant 1 has effect \(\beta_1=2\) mm per carrier and variant 2 has effect \(\beta_2=-1\) mm per carrier. Calculate the burden slope.
For a Bernoulli carrier indicator, the genotype variance is \(p_j(1-p_j)\). Thus the two variances are \(0.01(0.99)=0.0099\) and \(0.02(0.98)=0.0196\). The signed numerator is
The denominator is
Therefore,
The fitted burden direction is slightly positive, but the expected slope is close to zero because the positive contribution from variant 1 is almost balanced by the negative contribution from variant 2. This is not the same as either variant having no effect.
Cancellation in a Score Test
The same idea appears in a burden score test. For a simple linear model with an intercept, independent variants, and centered genotype contributions, the expected score contribution from variant \(j\) under the alternative is proportional to \(n\,w_j\beta_j\operatorname{Var}(G_{ij})\), where \(n\) is the sample size. A burden score adds those contributions. Its null standard error reflects the total genotype information and the residual variation; the opposing signs affect the score numerator, not merely its standard error.
This distinction matters: a weak result can reflect low information because few people carry the included variants, cancellation because their effects point in opposing directions, or both. A burden p-value alone does not tell which explanation applies. The score calculation below is an illustration under a simple model, not a substitute for the appropriate covariate-adjusted test or its calibration.
Worked Example: Expected Score Contributions
In a hypothetical study of \(n=5{,}000\) people, suppose two independent rare-variant carrier indicators have probabilities \(0.005\) and \(0.01\), with weights of 1. Assume a quantitative-trait model with residual standard deviation \(1\), and true effects of \(1.5\) and \(-0.75\) trait units per carrier. Under the simple score approximation, each variant’s information is \(I_j=np_j(1-p_j)\).
For variant 1, \(I_1=5{,}000(0.005)(0.995)=24.875\), so its expected score contribution is \(w_1I_1\beta_1=(1)(24.875)(1.5)=37.3125\). For variant 2, \(I_2=5{,}000(0.01)(0.99)=49.5\), so its expected contribution is \(w_2I_2\beta_2=(1)(49.5)(-0.75)=-37.125\). The combined expected numerator is \(37.3125-37.125=0.1875\).
With residual variance 1, the corresponding null standard deviation in this simplified calculation is \(\sqrt{I_1+I_2}=\sqrt{74.375}=8.624\). The standardized expected score is therefore \(0.1875/8.624=0.0217\), close to zero. This is a noncentrality calculation under the assumed model, not an observed test statistic or p-value. It shows how substantial opposing contributions can nearly cancel even when neither assumed effect is zero.
Diagnosing Opposing Effects
Variant-level effect estimates can help identify possible cancellation, but they must be read with their uncertainty. Rare alleles often have few carriers, so separate estimates can be unstable and their confidence intervals wide. A positive estimate for one variant and a negative estimate for another is therefore a clue to investigate, not by itself proof that their true effects differ in direction.
A useful diagnostic asks whether the pattern is coherent with the burden construction and the study design. Check the outcome coding, effect-allele coding, dosage definition, and weight signs first; inconsistent coding can create an apparent direction conflict. Then inspect variant-level estimates with standard errors or confidence intervals, and consider whether the pattern follows a prespecified functional distinction, such as two annotation classes.
Worked Example: Comparing Prespecified Masks
Suppose a hypothetical pilot study, independent of the association analysis, estimates effects in trait units for two variants: variant A has \(\hat{\beta}_A=1.8\) with \(SE=0.9\), and variant B has \(\hat{\beta}_B=-1.2\) with \(SE=0.7\). Before examining the association results, investigators define one mask for a functional class containing A and another for a distinct class containing B. For illustration, assume the two variants have independent carrier indicators, equal weights, and \(n=4{,}000\) participants in the planned analysis, with carrier probabilities \(0.005\) and \(0.01\).
The approximate 95% intervals from the pilot estimates are \(\hat{\beta}_A\pm1.96SE_A=1.8\pm1.764\), or \([0.036,3.564]\), and \(\hat{\beta}_B\pm1.96SE_B=-1.2\pm1.372\), or \([-2.572,0.172]\) trait units per carrier. The first estimate is positive; the second is negative, but its interval includes zero. These intervals describe uncertainty in the pilot estimates under their model; they do not establish that the true effects have opposite signs.
The planned analysis has \(I_A=4{,}000(0.005)(0.995)=19.9\) and \(I_B=4{,}000(0.01)(0.99)=39.6\). Plugging the pilot estimates into the approximate score contributions gives \(19.9(1.8)=35.82\) for A and \(39.6(-1.2)=-47.52\) for B, for a combined contribution of \(-11.70\). The negative combined direction does not erase the fact that the two estimated contributions oppose one another. The separate, prespecified masks can help reveal that pattern, but their association results still require appropriate uncertainty estimates and interpretation.
Why Prespecification Matters
A mask is a rule for deciding which variants contribute to a burden. If biology or annotation motivates distinct groups before the association results are examined, testing those masks can provide a useful way to investigate whether a broad mask combines variants with different likely roles. For example, separate masks might be defined by functional consequence or another established annotation rule. Each mask answers a different, explicitly defined question.
By contrast, repeatedly changing masks after seeing which variants have positive or negative estimates can make a seemingly compelling result partly a product of selection. The chosen mask may be unusually favorable in the same data, and the reported p-value may not account for that search. A mask motivated by observed directions should therefore be described as exploratory, not as independent confirmation. Prespecification does not guarantee a valid biological grouping, but it makes the analysis question clear and limits data-driven selection.
Verify that genotype counts, effect alleles, trait direction, and mask weights use consistent conventions.
Look for differing directions, but account for wide uncertainty when carrier counts are small.
Use groups defined by defensible, preferably prespecified criteria, and distinguish planned analyses from exploratory ones.
A weak burden signal is compatible with cancellation, low information, or both; it does not show that every included variant is null.
Common Mistake
Wrong reasoning: “The burden test was not significant, so none of the variants affects the trait.” This conclusion does not follow. A burden test tests an aggregate direction under its chosen mask and weights. Opposite contributions can make that aggregate small, and rare carriers can also make estimates imprecise.
Correction: Treat the burden result as evidence about the specified aggregate, not as a separate verdict on every variant. Examine variant-level estimates and uncertainty to assess whether opposing effects are plausible, check whether the burden assumptions are appropriate, and use alternative masks only when their definitions are justified. A nonsignificant result is not proof of no variant effects.
Check Your Understanding
Answer each question using the definitions and assumptions in this tutorial.
- Under independent genotypes, what determines the signed contribution of variant \(j\) to the numerator of the burden slope?
- Why can a near-zero burden result occur even when some variant effects are nonzero?
- In the score example, why is the combined expected numerator close to zero despite two substantial individual contributions?
- What information should accompany variant-level effect estimates when using them to diagnose possible cancellation?
- Why is a mask chosen after inspecting effect directions not automatically an independent confirmation?