Tutorials › Statistical Genetics › Posterior Inference Over Multiple-Causal Configurations

Bayesian Statistical Fine-Mapping · Tutorial 626 of 989

Posterior Inference Over Multiple-Causal Configurations

See how a joint summary-statistic likelihood and explicit priors yield posterior probabilities for configurations containing one or several causal variants.

Advanced 12 min read

What You'll Learn

  • Define a causal configuration as a specific set of variants assigned nonzero effects.
  • Connect LD to the covariance of joint effect estimates.
  • Calculate configuration Bayes factors by integrating over effect sizes.
  • Combine Bayes factors with configuration priors to obtain posterior probabilities.
  • Interpret posterior probabilities and variant inclusion probabilities without making causal claims beyond the model.
  • Diagnose how configuration priors and LD affect conclusions when marginal signals overlap.

Why Compare Configurations?

When variants are correlated through linkage disequilibrium (LD), several can show association with the same underlying signal. If more than one variant may contribute, the inferential target is not just a ranking of variants: it is the probability assigned to each possible set of causal variants under a specified model. A configuration might contain one variant, two variants, or none. Comparing configurations requires accounting for both the observed joint effects and the fact that correlated estimates do not provide independent evidence.

The calculations below use joint effect estimates and their sampling covariance. This is important when marginal signals overlap: an association estimate for one variant can reflect effects at correlated variants, whereas a joint model represents effects conditional on the other variants included in the analysis. The posterior is conditional on the likelihood, effect-size prior, and configuration prior that have been specified. It is not a data-only probability that a variant is causal.

Definition: A configuration \(C\) is a particular subset of the variants under consideration assigned potentially nonzero effects. Under configuration \(C\), variants outside \(C\) have effect zero, and variants in \(C\) have effects drawn from the specified effect-size prior. The empty configuration, written \(\varnothing\), assigns zero effects to every variant.

Joint Estimates, LD, and Configuration Likelihoods

Let \(\hat{\boldsymbol{\beta}}\) be the vector of joint effect estimates for \(m\) variants. In the normal summary-statistic model used here, conditional on the true joint effects \(\boldsymbol{\beta}\),

$$ \hat{\boldsymbol{\beta}}\mid\boldsymbol{\beta} \sim N(\boldsymbol{\beta},V). $$

The sampling covariance matrix \(V\) has sampling variances on its diagonal and covariances between estimates off the diagonal; standard errors are the square roots of the diagonal entries. LD affects these covariances. Thus, even if two estimates have similar standard errors, they need not represent independent evidence. This normal likelihood is an assumption of the analysis; its adequacy depends on the summary estimates and covariance being appropriate for the variants and sample under study.

For a configuration \(C\), let \(S_C\) be the \(m\)-by-\(|C|\) matrix that places the effects for variants in \(C\) into the full vector of effects. For example, with three variants, \(C=\{1,3\}\) gives \(\boldsymbol{\beta}=S_C\boldsymbol{\theta}_C=(\theta_1,0,\theta_3)^\mathsf{T}\). Use a zero-centered multivariate normal effect prior,

$$ \boldsymbol{\theta}_C\sim N(\boldsymbol{0},W_C). $$

A common specification takes \(W_C=\tau^2 I\), giving independent effects with prior variance \(\tau^2\) for the variants in the configuration. The prior describes plausible effect sizes before observing the estimates; it is not the configuration prior. The latter, denoted \(\pi(C)=P(C)\), assigns prior probability to each set of variants. These are distinct modeling choices.

Integrating the effect sizes out gives a marginal likelihood for each configuration. Since a linear transformation of a normal vector is normal, and independent normal vectors add to a normal vector, the likelihood after integration is

$$ \hat{\boldsymbol{\beta}}\mid C \sim N\!\left(\boldsymbol{0},\;V+S_CW_CS_C^\mathsf{T}\right). $$

The null configuration has covariance \(V\). The configuration Bayes factor \(BF_C\) compares the marginal likelihood under \(C\) with that under the null:

$$ BF_C = \frac{|V|^{1/2}} {|V+S_CW_CS_C^\mathsf{T}|^{1/2}} \exp\!\left[ -\frac{1}{2}\hat{\boldsymbol{\beta}}^\mathsf{T} \left\{ (V+S_CW_CS_C^\mathsf{T})^{-1}-V^{-1} \right\} \hat{\boldsymbol{\beta}} \right], \qquad BF_{\varnothing}=1. $$

The determinant term and the quadratic-form term both matter. The determinant accounts for how much probability the model spreads over possible estimates; the quadratic form reflects how well the observed joint estimates fit that model. A larger estimated effect can improve fit, but a configuration is not automatically favored simply because it contains more variants: its fit is judged alongside the prior effect scale and the uncertainty represented by \(V\).

From Bayes Factors to Posterior Probabilities

Given a set of mutually exclusive configurations covering the possibilities being considered, Bayes’ rule gives

$$ P(C\mid\hat{\boldsymbol{\beta}}) = \frac{\pi(C)BF_C} {\displaystyle\sum_{C'}\pi(C')BF_{C'}}. $$

The sum in the denominator is over the configurations in the model. It normalizes their prior-weighted evidence so the posterior probabilities sum to one. A configuration posterior therefore depends on its Bayes factor and its prior probability. If configurations are restricted, for example to a fixed causal count, the posterior is conditional on that restriction.

A variant-level posterior inclusion probability (PIP) can be calculated from the configuration probabilities by summing the probabilities of all configurations that contain the variant:

$$ P(j\in C\mid\hat{\boldsymbol{\beta}}) = \sum_{C:\,j\in C}P(C\mid\hat{\boldsymbol{\beta}}). $$

This sum is useful for describing marginal support for including a variant across the configurations in the model. It does not say which other variants accompany it, so it cannot replace the configuration posterior when the combinations themselves matter.

Worked Example: Two Overlapping Signals and Four Configurations

Hypothetical data. Suppose two variants have joint effect estimates \(\hat{\boldsymbol{\beta}}=(0.24,0.20)^\mathsf{T}\), in outcome units per effect allele. Their sampling covariance is \(V=0.04\begin{pmatrix}1&0.5\\0.5&1\end{pmatrix}\), so each standard error is \(\sqrt{0.04}=0.20\), and the estimate covariance is \(0.02\). This positive covariance is consistent with correlated estimates under LD. Assume the normal joint-estimate likelihood is appropriate, use independent \(N(0,0.09)\) effect priors for included variants, and assign configuration prior probabilities \(0.60\) to \(\varnothing\), \(0.15\) to each singleton, and \(0.10\) to \(\{1,2\}\).

For \(C=\{1\}\), the integrated covariance is \(\Sigma_1=V+\operatorname{diag}(0.09,0)=\begin{pmatrix}0.13&0.02\\0.02&0.04\end{pmatrix}\). The determinant of \(V\) is \(0.04(0.04)-0.02^2=0.0012\), and \(|\Sigma_1|=0.13(0.04)-0.02^2=0.0048\). The null quadratic form is \(\hat{\boldsymbol{\beta}}^\mathsf{T}V^{-1}\hat{\boldsymbol{\beta}}=1.6533\), while the quadratic form using \(\Sigma_1^{-1}\) is \(1.1633\). Therefore

$$ BF_{\{1\}}= \sqrt{\frac{0.0012}{0.0048}} \exp\!\left[-\frac{1}{2}(1.1633-1.6533)\right] =0.5\exp(0.2450) \approx 0.6388. $$

By symmetry of the sampling covariance, but not of the observed estimates, the corresponding calculation for \(C=\{2\}\) gives \(BF_{\{2\}}\approx0.5416\). For \(C=\{1,2\}\), the integrated covariance is \(\Sigma_{12}=\begin{pmatrix}0.13&0.02\\0.02&0.13\end{pmatrix}\), with determinant \(0.13(0.13)-0.02^2=0.0165\). Its quadratic form is approximately \(0.6526\), giving

$$ BF_{\{1,2\}}= \sqrt{\frac{0.0012}{0.0165}} \exp\!\left[-\frac{1}{2}(0.6526-1.6533)\right] \approx 0.4448. $$

The prior-weighted values for \(\varnothing,\{1\},\{2\},\{1,2\}\) are respectively \(0.6000\), \(0.15(0.6388)=0.09582\), \(0.15(0.5416)=0.08124\), and \(0.10(0.4448)=0.04448\). Their sum is \(0.82154\). Thus, for example,

$$ P(\{1,2\}\mid\hat{\boldsymbol{\beta}}) =\frac{0.04448}{0.82154}\approx0.0541. $$

The four posterior probabilities are approximately \(0.7303\), \(0.1166\), \(0.0989\), and \(0.0541\), respectively. In this hypothetical analysis, the data and priors do not strongly favor either variant-containing configuration over the null. The two positive estimates do not, by themselves, establish two causal variants; their covariance and the prior model affect how their joint pattern is evaluated.

A Short Derivation of the Integrated Likelihood

The configuration Bayes factor follows directly by integrating the likelihood with respect to the effect prior. Under configuration \(C\), write \(\hat{\boldsymbol{\beta}}=S_C\boldsymbol{\theta}_C+\boldsymbol{\varepsilon}\), where \(\boldsymbol{\varepsilon}\sim N(\boldsymbol{0},V)\) is independent of \(\boldsymbol{\theta}_C\sim N(\boldsymbol{0},W_C)\). It follows that \(S_C\boldsymbol{\theta}_C\) has covariance \(S_CW_CS_C^\mathsf{T}\). Adding the independent error gives

$$ \operatorname{Cov}(\hat{\boldsymbol{\beta}}\mid C) = S_CW_CS_C^\mathsf{T}+V, \qquad E(\hat{\boldsymbol{\beta}}\mid C)=\boldsymbol{0}. $$

Consequently, the marginal density under \(C\), evaluated at the observed estimate vector, is the multivariate normal density with that covariance. Dividing it by the null density, which has covariance \(V\), cancels the common factor \((2\pi)^{-m/2}\) and yields the determinant ratio and difference of quadratic forms shown above. This argument also clarifies why the diagonal of \(V\) must contain variances: the normal density and its quadratic form use a covariance matrix, not a matrix of standard errors.

Worked Example: Comparing Pair Configurations When Exactly Two Variants Are Causal

Hypothetical data. Consider three variants with joint estimates \(0.30\), \(0.25\), and \(0.05\) outcome units per effect allele. Suppose their estimates have independent sampling errors, each with standard error \(0.10\); hence \(V=0.01I\). This independence assumption means this example has no off-diagonal LD covariance. Use independent \(N(0,0.04)\) effect priors and restrict the model to exactly two causal variants. The only configurations are \(\{1,2\}\), \(\{1,3\}\), and \(\{2,3\}\), with equal prior probability \(1/3\) each.

Because \(V\) and the effect prior are diagonal here, the Bayes factor for a configuration is the product of the single-variant factors for its included variants. For an estimate \(y_j\), the factor is \(\sqrt{0.01/0.05}\exp[-\tfrac12(y_j^2/0.05-y_j^2/0.01)]\). For variant 1, this is \(\sqrt{0.2}\exp[0.5(0.30^2)(80)]=0.4472\exp(3.6)\approx16.3672\). For variant 2, it is \(0.4472\exp[0.5(0.25^2)(80)]=0.4472\exp(2.5)\approx5.4482\). For variant 3, it is \(0.4472\exp[0.5(0.05^2)(80)]=0.4472\exp(0.1)\approx0.4942\).

The three pair Bayes factors are therefore \(16.3672(5.4482)\approx89.17\), \(16.3672(0.494247)\approx8.089\), and \(5.4482(0.494247)\approx2.693\). Equal prior probabilities cancel in normalization. The posterior for the first pair is

$$ P(\{1,2\}\mid\hat{\boldsymbol{\beta}},K=2) =\frac{89.17}{89.17+8.089+2.693} \approx0.8921. $$

The other pair posteriors are approximately \(0.0809\) and \(0.0269\). These probabilities are conditional on the assumption that exactly two of the three variants are causal. They do not compare the two-variant model with a one-variant or null model, because those configurations were excluded by the stated prior restriction.

Configuration Priors and Interpretation

Configuration priors can encode beliefs about how many variants are causal as well as how probability is distributed among variants at a given count. For example, a prior on causal count can assign probability to \(K=|C|\), then distribute that probability across configurations of that size. If all configurations with a given count are treated equally, then each receives the count prior divided by the number of such configurations. The resulting posterior can differ from one based on equal prior probability for every configuration, because the latter generally gives different total prior mass to different causal counts.

The same distinction matters in interpreting a PIP. In the first example, the PIP for variant 1 is the posterior probability of \(\{1\}\) plus that of \(\{1,2\}\), approximately \(0.1166+0.0541=0.1707\). This summarizes the model’s posterior support for configurations containing variant 1. It is not the posterior probability that variant 1 is biologically causal without qualification: it depends on the candidate variants, likelihood, effect prior, and configuration prior.

Common Mistakes and a Practical Check

  • Using standard errors as covariance-matrix entries. A standard error is the square root of a sampling variance. Put variances on the diagonal of \(V\), and covariances—not correlations alone—off the diagonal.
  • Ignoring LD in the joint likelihood. Treating correlated joint estimates as independent can misstate the evidence for a set of variants. Use a covariance matrix appropriate to the joint estimates and the analysis sample.
  • Equating a Bayes factor with a posterior probability. A Bayes factor compares marginal likelihoods; posterior probabilities also depend on the prior probabilities of the configurations and normalization across the modeled set.
  • Interpreting an excluded configuration as having no posterior support in reality. If a model restricts the causal count, its posterior is conditional on that restriction. It cannot assess configurations the model left out.
  • Reading a high configuration posterior as proof of biological causation. The posterior describes support under a specified statistical model and candidate-variant set. It does not establish a mechanism or rule out model misspecification.

A useful check is to verify that the configuration priors sum to one, that all covariance matrices used in the normal likelihood are valid, and that the normalized configuration posteriors sum to one. Also confirm whether the posterior is conditional on a fixed causal count or compares counts. These checks make the assumptions behind a multi-variant conclusion explicit.

Check Your Understanding

Use the definitions and calculations above to answer the following.

  1. In a joint estimate covariance matrix, what belongs on the diagonal, and how is a standard error obtained from it?
  2. Why can two positive, correlated joint estimates not be treated as two independent pieces of evidence?
  3. What two ingredients, in addition to the likelihood, determine the posterior probability of a configuration?
  4. If a model includes only configurations with exactly two causal variants, what does its configuration posterior condition on?
  5. How is the posterior inclusion probability for a variant calculated from configuration posterior probabilities?
Clinical Biostats