Tutorials › High-Dimensional Genomic Data Analysis › Sum of Single Effects Models

Statistical Fine-Mapping and Credible Sets · Tutorial 710 of 795

Sum of Single Effects Models

Learn how a genetic effect can be represented as a sum of components that each select one variant, and why this representation supports fine-mapping when multiple signals are present.

Advanced 12 min read

What You'll Learn

  • Define a single-effect component and combine components into a multiple-signal regression model.
  • Distinguish a component’s selected variant from the total effect assigned to that variant.
  • Understand the role of effect-size and variant-selection priors.
  • Derive why correlated variants couple the component likelihoods.
  • Calculate approximate variant inclusion probabilities from component probabilities.
  • Recognize limitations caused by linkage disequilibrium and model misspecification.

From One Signal to a Sum of Signals

A single-causal-variant model represents an association as one variant carrying an effect. That representation can be too restrictive when a region contains more than one signal: a variant associated with the outcome may partly reflect another signal correlated with it through linkage disequilibrium (LD). A multiple-signal model needs to represent several effects while still allowing uncertainty about which variants carry them.

A sum of single effects (SuSiE) does this by writing the total genetic effect as a sum of component effects. Each component has its own variant choice and effect size. The components are not the same thing as a list of variants that have already been identified: their selections and effect sizes are uncertain, and the observed data inform them jointly.

Definition: Let \(X\) be an \(n \times p\) genotype matrix and let \(y\) be a vector of \(n\) quantitative outcomes. A single-effect component \(l\) has an effect vector \(b_l\) with at most one nonzero entry. The total effect vector is \(b=\sum_{l=1}^{L}b_l\), and the regression model is \(y=Xb+\varepsilon\). The integer \(L\) is the number of modeled components; in applications it is usually an upper bound on the number of signals to represent.

For clarity, suppose the outcome has been centered and the genotype columns are centered and scaled to have squared length \(n\). The model assumes independent Gaussian errors, \(\varepsilon\sim N(0,\sigma^2 I_n)\), conditional on the genotype matrix and the modeled effects. If covariates such as ancestry principal components are required, they must be included or appropriately accounted for; otherwise their effects can be mistaken for genetic associations. The Gaussian model is a working assumption, not a guarantee that every phenotype has Gaussian residuals.

Component Choices, Effect Sizes, and the Total Effect

One way to express component \(l\) is with a one-hot indicator vector \(\gamma_l\): its \(j\)th entry is 1 if that component selects variant \(j\), and all other entries are 0. If \(\theta_l\) is its effect size, then \(b_l=\gamma_l\theta_l\). A common prior assigns variant-selection probabilities \(\pi_j\), where \(\pi_j\geq 0\) and \(\sum_{j=1}^{p}\pi_j=1\), and gives the effect size a mean-zero normal prior, \(\theta_l\sim N(0,\tau^2)\). The prior choices are made before examining the association evidence; the likelihood then updates uncertainty about the component selections and effects.

In this basic formulation, each component selects one variant. Some implementations also allow an explicit null choice, so a component may contribute no effect. A component with an effect close to zero can also contribute little to the total even if it selects a variant. These details matter when interpreting \(L\): it is not automatically a statement that exactly \(L\) distinct variants are causal.

The distinction between component effects and total effects is important. If two components select the same variant, their effect sizes add in \(b\). The model therefore allows multiple components to select the same variant unless an additional constraint rules that out. In practical fine-mapping, component labels are also not inherently meaningful: relabeling components does not change the sum \(b\).

Worked Example: Adding Two Component Effects

Consider three variants and two components. Suppose component 1 selects variant 1 with effect \(0.30\), while component 2 selects variant 3 with effect \(-0.20\). Effects are measured in outcome units per one scaled genotype unit.

The component vectors are \(b_1=(0.30,0,0)\) and \(b_2=(0,0,-0.20)\). Their sum is \[ b=b_1+b_2=(0.30,0,-0.20). \]

For an individual whose scaled genotype values are \((1,-0.5,2)\), the genetic part of the predicted outcome is \[ X_i b=1(0.30)+(-0.5)(0)+2(-0.20)=0.30-0.40=-0.10. \]

Thus, the prediction from the two modeled genetic effects is \(-0.10\) outcome units for this individual. It is the sum of component contributions, not a choice between the two components.

Why the Components Are Coupled by the Data

Although the model is written as a sum of component effects, the components are generally not statistically independent after observing the data. The reason is that the same outcome is explained by their combined prediction. Expanding the Gaussian likelihood makes this explicit.

$$ \begin{aligned} p(y\mid X,b) &\propto \exp\left\{-\frac{1}{2\sigma^2}(y-Xb)^\mathsf{T}(y-Xb)\right\}\\ &\propto \exp\left\{-\frac{1}{2\sigma^2} \left(y^\mathsf{T}y-2y^\mathsf{T}Xb+b^\mathsf{T}X^\mathsf{T}Xb\right)\right\}\\ b^\mathsf{T}X^\mathsf{T}Xb &=\sum_{l=1}^{L}\sum_{m=1}^{L}b_l^\mathsf{T}X^\mathsf{T}Xb_m . \end{aligned} $$

The final expression contains cross-products between components. When two selected genotype columns are correlated, the corresponding cross-product need not be zero. Consequently, evidence for one component can depend on the choices and effects of the others. In the special case of orthogonal genotype columns, those cross-products between distinct variants vanish; real genomic data commonly have LD, so that simplifying case should not be assumed.

This likelihood also explains why “fit each variant separately, then add the strongest results” is not equivalent to fitting a multiple-signal model. Separate marginal associations do not account for how variants jointly explain the same outcome. A configuration model can represent combinations directly, but the number of possible configurations grows rapidly with the number of variants and signals. The sum-of-single-effects representation organizes a multiple-signal model as a collection of simple components; it does not make the likelihood independent across those components.

Justification: With Gaussian errors, the log likelihood is, up to a constant, \(-\|y-Xb\|^2/(2\sigma^2)\). Substituting \(b=\sum_l b_l\) and expanding the squared norm gives a term for every pair \(l,m\). If \(b_l\) and \(b_m\) select different correlated variants, \(b_l^\mathsf{T}X^\mathsf{T}Xb_m\) generally differs from zero. The data therefore connect the component choices even though the prior may assign them independently.

From Component Uncertainty to Variant Inclusion

A component’s selection probability describes the probability that it assigns its effect to a particular variant. A variant-level inclusion probability instead asks whether that variant is selected by at least one component. These are different summaries: a variant may have modest probability in several components, or substantial probability in just one.

For example, if a posterior approximation treats the component selections as independent and gives component \(l\) probability \(\alpha_{lj}\) of selecting variant \(j\), then the probability that no component selects \(j\) is \(\prod_l(1-\alpha_{lj})\). The resulting approximate inclusion probability is one minus this quantity. This product formula requires independence under the posterior being used; it is not a general identity for a dependent joint posterior.

Worked Example: Combining Component Selection Probabilities

Suppose a fitted approximation has two components and three variants. Its component selection probabilities are \((0.70,0.20,0.10)\) for component 1 and \((0.10,0.60,0.30)\) for component 2. Assume the approximate posterior treats the two component selections as independent.

For variant 1, the approximate probability that neither component selects it is \((1-0.70)(1-0.10)=0.30(0.90)=0.27\). Its approximate inclusion probability is therefore \(1-0.27=0.73\).

For variant 2, the probability that neither selects it is \((1-0.20)(1-0.60)=0.80(0.40)=0.32\), giving an inclusion probability of \(1-0.32=0.68\). For variant 3, it is \(1-(0.90)(0.70)=0.37\).

These values are approximate probabilities that each variant appears in at least one component under the stated posterior approximation. They do not establish that a variant is causal with probability 0.73, independently of model assumptions, prior choices, and data quality.

Component-specific effect-size uncertainty is also needed to describe the total effect. If \(\alpha_{lj}\) is a component’s selection probability and \(m_{lj}\) is its posterior mean effect conditional on selecting variant \(j\), then under that component’s posterior representation its expected contribution to variant \(j\) is \(\alpha_{lj}m_{lj}\). Summing across components gives the expected total coefficient, provided the component effects are defined on the same scale. This mean is not a substitute for the full posterior distribution: components may have uncertainty and dependence that affect the total-effect interval.

Worked Example: Expected Total Coefficients

Use the selection probabilities from the preceding example. Suppose the conditional posterior mean effects, in outcome units per scaled genotype unit, are \((0.40,0.10,0)\) for component 1 and \((0,-0.30,0.20)\) for component 2.

For variant 1, the expected contribution is \(0.70(0.40)+0.10(0)=0.28\). For variant 2, it is \(0.20(0.10)+0.60(-0.30)=0.02-0.18=-0.16\). For variant 3, it is \(0.10(0)+0.30(0.20)=0.06\).

Thus, the vector of expected total coefficients is \((0.28,-0.16,0.06)\) in the stated units. This calculation averages over which variant each component selects as well as its conditional mean effect. It does not say that every posterior draw has these three coefficients.

LD, Diagnostics, and Limits of Interpretation

LD creates a central difficulty for multiple-signal fine-mapping. If two variants have highly correlated genotype columns, the data may have difficulty distinguishing which one a component selects. The component representation can describe this uncertainty, but it cannot create information that is absent from the observed genotypes. A sharp-looking component assignment should therefore be considered alongside the LD structure and the assumptions behind the model.

Worked Example: Similar Predictions Under High LD

Suppose two centered genotype columns each have squared length \(n=1000\), and their correlation is \(r=0.95\). Compare two single-effect predictions: effect \(0.40\) on variant 1 versus effect \(0.40\) on variant 2. The difference between their fitted genetic predictors is \(0.40(x_1-x_2)\).

Since \(x_1^\mathsf{T}x_1=x_2^\mathsf{T}x_2=1000\) and \(x_1^\mathsf{T}x_2=0.95(1000)=950\), \[ \|0.40(x_1-x_2)\|^2 =0.16(1000+1000-2(950)) =0.16(100) =16. \]

With Gaussian residual variance \(\sigma^2=1\), the difference in log likelihoods has an expected contribution of \(16/(2\sigma^2)=8\) in favor of the correctly specified mean, if one of these means generated the data. This is not a posterior probability: actual evidence also depends on noise, other modeled effects, and priors. The calculation shows why high correlation can leave the identity of the selected variant uncertain even when the models make similar predictions.

Useful warning signs include components repeatedly assigning substantial probability to the same group of highly correlated variants, unstable selections under modest changes in prior settings, and poor agreement between the genotype information used for fitting and the information used to describe LD. These signs call for investigation, not automatic rejection: correlated alternatives can be a genuine feature of the data. Conversely, a model with too few components can force several signals into one component, while too many components can yield weak or redundant allocations. A model’s component count and prior assumptions should be reported rather than treated as invisible defaults.

A sum of single effects is a modeling representation, not a guarantee of causal discovery. A causal interpretation depends on the study design and assumptions connecting genotype to outcome, including control of population structure and other sources of bias. The method also relies on an adequate variant set, an appropriate likelihood, and suitable priors. If important variants are missing, the fitted effects may absorb their associations; if phenotype or genotype data are misspecified, posterior probabilities can be misleading.

Common Mistake and Practical Comparison

  • Mistake: “There are \(L\) components, so the model has identified \(L\) distinct causal variants.” Correction: \(L\) is the number of modeled components, not necessarily the number of distinct, well-supported causal variants. Components can be uncertain, weak, redundant, or—in some implementations—null.
  • Mistake: Treating a component’s selection probability as the variant’s overall inclusion probability. Correction: Inclusion concerns selection by any component; combining component probabilities requires accounting for their joint posterior distribution.
  • Mistake: Reading a high inclusion probability as proof of causality. Correction: It is conditional on the data, model, and priors, and does not remove bias or identify a causal variant when LD prevents distinction.

Compared with enumerating multi-variant configurations, the component representation expresses effects in a structured way that is useful when many variants are under consideration. Direct configuration models make joint variant combinations explicit but can become computationally burdensome as the number of possible combinations grows. Compared with one-at-a-time marginal association, a multiple-component model aims to represent several signals together rather than confusing correlated evidence with independent effects. The trade-off is that inference still requires handling dependence among components; the representation alone is not a fitting algorithm or a diagnostic guarantee.

Key takeaway: A sum-of-single-effects model writes the total genetic coefficient vector as \(b=\sum_l b_l\), with each component selecting at most one variant. This makes multiple signals representable while preserving uncertainty about variant assignment and effect size. LD, model assumptions, and posterior dependence remain central to interpretation.

Check Your Understanding

Answer each question, then compare with the brief solutions.

  1. If two components select the same variant with effects \(0.25\) and \(-0.10\), what is that variant’s total coefficient?
  2. Under an independent component-selection approximation, two components select a particular variant with probabilities \(0.40\) and \(0.50\). What is its approximate inclusion probability?
  3. Why can correlated genotype columns make component assignments uncertain even when the model allows multiple components?
  4. Does specifying \(L=3\) establish that exactly three distinct variants are causal? Explain.

Solutions. (1) The total coefficient is \(0.25+(-0.10)=0.15\), in the same effect units. (2) The probability neither selects the variant is \((1-0.40)(1-0.50)=0.30\), so the approximate inclusion probability is \(1-0.30=0.70\). (3) Correlated columns can make different variant assignments produce similar fitted predictors, so the data may not distinguish them well. (4) No. \(L\) is the number of modeled components; components may be uncertain or redundant, and a component need not correspond to a distinct, established causal variant.

Clinical Biostats