Tutorials › High-Dimensional Genomic Data Analysis › Common Credible-Set Interpretation Errors

Statistical Fine-Mapping and Credible Sets · Tutorial 735 of 795

Common Credible-Set Interpretation Errors

Learn to separate a credible set’s posterior support, its member variants’ probabilities, its LD purity, and the number of causal variants it represents.

Advanced 11 min read

What You'll Learn

  • Distinguish inclusion in a credible set from a high individual posterior inclusion probability.
  • Interpret a set’s cumulative posterior mass under the model used to construct it.
  • Explain why summed PIPs represent an expected causal-variant count, not always the probability of any causal variant.
  • Define LD purity and identify what it cannot establish about causality.
  • Recognize when single-signal and multiple-signal credible-set interpretations differ.
  • Diagnose common overstatements and replace them with appropriately qualified conclusions.

What a Credible Set Does—and Does Not—Say

Fine-mapping results are often summarized as a short list of variants. That list can look deceptively simple: a reader may assume every member is equally plausible, that the reported posterior mass is the probability of a particular variant, or that a highly correlated set proves one of its members is causal. None of those conclusions follows from set membership alone.

The interpretation depends on the quantity being summarized and on the model used to obtain it. In the earlier material on interpreting high posterior inclusion probabilities, each variant’s posterior inclusion probability (PIP) summarizes its marginal posterior probability of being causal. A credible set instead groups variants according to a cumulative posterior-mass rule, often for a particular signal. LD purity describes correlations among the variants in the set, not their posterior probabilities.

Definition: Let \(D\) denote the observed genetic and association data, and let \(C_j=1\) indicate that variant \(j\) is causal under the fine-mapping model. Its posterior inclusion probability is \(\mathrm{PIP}_j=P(C_j=1\mid D)\). A credible set \(S\) is a collection of variants selected so that a stated posterior-mass criterion is met. For a single-causal-variant model, one common rule is to order variants by posterior probability and take the smallest set whose probabilities sum to at least a target \(\gamma\), such as \(0.95\).

The phrase “95% credible set” refers to that set-level posterior criterion, under the specified model and assumptions. It does not mean that each included variant has a 95% probability of being causal. Nor does it mean that 95% of the variants in the set are causal. If there is exactly one causal variant in the modeled signal, the posterior probability that the causal variant is in the set is the sum of the member probabilities. With multiple causal variants, the interpretation requires more care, as shown below.

Set Membership Is Not Equal Probability

A cumulative rule adds posterior probabilities until the target is reached. The final variant may take the cumulative total from below the target to above it, so the total can exceed \(\gamma\). The variants included can have very different posterior probabilities. Being included means that a variant contributes to meeting the set’s construction rule; it does not mean that it is as plausible as every other member.

Worked Example: A 95% Set With Unequal Member Probabilities

Suppose a hypothetical single-signal analysis gives four variants posterior probabilities \(0.60\), \(0.25\), \(0.10\), and \(0.05\), respectively, and the target is \(\gamma=0.95\). Assume the model assigns exactly one causal variant to this signal, so the probabilities across these four candidates sum to one.

Order the variants from largest to smallest posterior probability. The first three have cumulative mass \(0.60+0.25+0.10=0.95\), so the resulting set is \(S=\{1,2,3\}\).

Under this model, the posterior probability that the causal variant lies in \(S\) is \(0.95\). But the individual probabilities are \(0.60\), \(0.25\), and \(0.10\), not \(0.95\) each and not equal to one another. Variant 1 is the most probable single causal variant, yet there remains posterior probability \(0.40\) that it is not causal.

The set-level statement concerns the event that the causal variant is among the members. It does not identify which member is causal, and it does not make all members equally likely.

A further distinction is between posterior credibility and frequentist coverage. A 95% posterior-mass set has at least 95% posterior probability under the fitted model and its priors, conditional on the observed data. It does not automatically guarantee that sets produced in repeated studies contain the true causal variant 95% of the time. Empirical coverage requires assessment across repeated simulations or suitable data, and can be affected by model misspecification.

Posterior Mass and Causal-Variant Count

For a single causal variant, the events \(C_j=1\) are mutually exclusive: at most one candidate is causal. Thus, for any set \(S\), the probability that at least one member is causal is the sum of the member probabilities. The same shortcut does not generally apply when multiple variants may be causal.

$$ P\!\left(\bigcup_{j\in S}\{C_j=1\}\mid D\right) = \sum_{j\in S}P(C_j=1\mid D) \quad\text{if at most one variant can be causal.} $$

With multiple causal variants, the sum of PIPs is the posterior expected number of causal variants in the set. To see this, define \(N_S=\sum_{j\in S}C_j\), the number of causal variants in \(S\). Linearity of expectation gives the following result without requiring the causal indicators to be independent.

$$ E(N_S\mid D) = E\!\left(\sum_{j\in S}C_j\mid D\right) = \sum_{j\in S}E(C_j\mid D) = \sum_{j\in S}\mathrm{PIP}_j. $$

But the probability \(P(N_S\geq 1\mid D)\) is a different quantity. It is a union probability, and overlapping events must not be counted twice. In particular, when multiple variants can be causal, summing PIPs can exceed one and cannot then be the probability that at least one member is causal.

Worked Example: The Sum of PIPs Is Not the Probability of Any Cause

Consider a hypothetical posterior over two variants, \(A\) and \(B\), with these configuration probabilities: neither is causal, \(0.20\); only \(A\) is causal, \(0.30\); only \(B\) is causal, \(0.10\); both are causal, \(0.40\). The four probabilities sum to \(1.00\).

The PIP for \(A\) is the probability of the configurations containing \(A\): \(0.30+0.40=0.70\). The PIP for \(B\) is \(0.10+0.40=0.50\). Therefore the summed PIP is \(0.70+0.50=1.20\).

The expected number of causal variants among the two is \(1.20\), as the expectation identity predicts. In contrast, the probability that at least one is causal is the sum of the three configurations containing \(A\), \(B\), or both: \(0.30+0.10+0.40=0.80\). The \(0.40\) probability of both being causal contributes to each PIP but only once to the “at least one” event.

Thus, “the PIPs sum to 1.20” means that the posterior expected causal count is 1.20; it does not mean there is a 120% probability of a causal variant in the pair. A set’s stated mass must be interpreted according to how the analysis constructed it. In a multiple-signal analysis, a signal-specific posterior distribution may support a signal-specific credible set, but it should not be conflated with a simple sum of marginal PIPs across variants.

A useful justification for the single-signal rule is that mutually exclusive events are additive. If exactly one variant \(J\) is causal, then the event \(J\in S\) is the disjoint union of the events \(J=j\), for \(j\in S\). Therefore \(P(J\in S\mid D)=\sum_{j\in S}P(J=j\mid D)\). When more than one variant can be causal, those events need not be disjoint: configurations with two or more causal members belong to several events at once. Adding the marginal probabilities then counts such configurations more than once. This is why the model’s causal-count assumptions matter to the meaning of “credible mass.”

Purity Measures LD, Not Causality

Credible-set purity is a separate diagnostic commonly used to summarize how strongly correlated the variants in a set are. A typical measure is the minimum pairwise \(r^2\) among the variants, calculated from their genotypes in an appropriate reference or study sample. For a set with at least two variants, it is the smallest pairwise \(r^2\); for a singleton, there is no pair to compare, so minimum pairwise purity is undefined or reported by a stated convention.

Definition: For a set \(S\) containing at least two variants, its minimum-\(r^2\) purity is \(\min_{j\neq \ell,\;j,\ell\in S} r_{j\ell}^{\,2}\), where \(r_{j\ell}\) is the correlation between the genotypes of variants \(j\) and \(\ell\). High purity means every pair is highly correlated by this measure. It does not mean that every member has a high PIP or that any member is causal.

Worked Example: High Purity Does Not Choose the Causal Variant

Suppose a hypothetical single-signal credible set contains variants \(U\) and \(V\). Their posterior probabilities are \(0.52\) and \(0.43\), so the set has mass \(0.52+0.43=0.95\). Suppose their genotype correlation is \(r_{UV}=0.98\). Then \(r^2_{UV}=(0.98)^2=0.9604\), so the minimum pairwise \(r^2\) is \(0.9604\).

The set has high LD purity and meets the 95% posterior-mass rule under the stated single-causal model. However, neither variant has posterior probability \(0.95\): their probabilities are \(0.52\) and \(0.43\). The result does not distinguish decisively between them. High correlation is consistent with difficulty resolving which correlated variant is causal; it is not independent evidence that both are causal or that the top-PIP variant has been identified with certainty.

Conversely, a set can meet its posterior-mass rule but have low minimum pairwise \(r^2\). That indicates that at least one pair is weakly correlated by the chosen measure; it does not, by itself, erase the posterior calculation. The analyst should check the set definition, the LD data and allele alignment, and whether the fitted causal model is appropriate before drawing conclusions.

Common Interpretation Errors and Checks

  • Wrong: “Every variant in the 95% set has a 95% chance of being causal.” Correction: The mass applies to the set-level event under its construction and model. Report individual PIPs separately.
  • Wrong: “The set contains five variants, so each has probability 20%.” Correction: Set membership does not imply equal probabilities. Use the variant-specific posterior values.
  • Wrong: “The PIPs sum to 1.2, so there is a 120% chance that something is causal.” Correction: With multiple causal variants, that sum is the expected causal count, not a probability. Calculate or report the union probability only if it is available and relevant.
  • Wrong: “High purity proves that one of these variants is the cause.” Correction: Purity summarizes pairwise LD. Causality and posterior support come from the association data and the fitted model; purity alone establishes neither.
  • Wrong: “A 95% set has 95% repeated-sampling coverage by definition.” Correction: Posterior credibility is conditional on the model and observed data. Repeated-sampling coverage is a separate property that requires evaluation.

When reading a result, check whether the set is signal-specific or region-wide, whether the model permits one or multiple causal variants, how the reported mass was calculated, and how purity was defined. If those details are missing, a precise interpretation may not be possible. These checks do not replace sensitivity or calibration analyses; they prevent the summary statistics from being given meanings they do not support.

Key takeaway: Keep four statements separate: which variants are included in the set, how much posterior mass the set represents under a specified model, how many causal variants are expected or possible, and how strongly the members are correlated. No one of these statements automatically supplies the others.

Check Your Understanding

Answer each question, then compare with the solutions.

  1. A single-causal-variant model assigns three ordered variants posterior probabilities \(0.55\), \(0.30\), and \(0.10\). What is the smallest set reaching 95% mass, and what does its mass mean?
  2. Two variants have PIPs \(0.65\) and \(0.45\) under a model allowing multiple causal variants. What is the posterior expected causal count among them? Can their summed PIP be reported as the probability at least one is causal?
  3. A two-variant set has \(r=0.40\). Compute its minimum pairwise \(r^2\), and state what this value does and does not tell you.
  4. Why can a 95% posterior-mass set contain a variant with a PIP far below 95%?

Solutions. (1) The first two probabilities sum to \(0.55+0.30=0.85\), below 0.95; including the third gives \(0.85+0.10=0.95\). Under the stated single-causal model, there is 0.95 posterior probability that the causal variant is in this three-variant set. (2) The expected causal count is \(0.65+0.45=1.10\). No: with multiple causal variants, the PIPs can count configurations containing both variants twice, so the sum is not generally the probability that at least one is causal. (3) \(r^2=(0.40)^2=0.16\). For a two-variant set this is its minimum pairwise \(r^2\); it indicates modest genotype correlation, not either variant’s probability of causality. (4) The target is the cumulative probability across included variants. The mass is distributed among members, so an individual member’s PIP can be much smaller than the target.

Clinical Biostats