Tutorials › High-Dimensional Genomic Data Analysis › Posterior Inclusion Probabilities Versus Credible Sets

Statistical Fine-Mapping and Credible Sets · Tutorial 718 of 795

Posterior Inclusion Probabilities Versus Credible Sets

Learn what a variant-level inclusion probability measures, what event a credible set summarizes, and why a variant can have moderate posterior support while belonging to a high-mass set.

Advanced 12 min read

What You'll Learn

  • Define a variant’s posterior inclusion probability from posterior probabilities over causal configurations.
  • Interpret a credible set’s posterior mass without treating it as the probability that any member is causal.
  • Relate credible-set mass to summed inclusion probabilities in a single-causal-variant model.
  • Distinguish the probability of at least one causal variant in a region from the expected number of causal variants there.
  • Read variant-level and set-level summaries together, including when several causal variants are allowed.
  • Recognize how model assumptions and credible-set construction affect interpretation.

Two summaries, two different questions

Fine-mapping reports often place a variant’s posterior inclusion probability beside a credible set containing that variant. The numbers answer different questions. A posterior inclusion probability (PIP) describes one variant: how much posterior probability is assigned to configurations that include it as causal. A credible set describes a collection of variants: how much posterior probability is assigned to a specified event represented by that collection, under the model and construction used.

This distinction matters when no single variant dominates the evidence. A variant can have a moderate PIP and still belong to a set with high posterior mass, because the set’s mass is distributed across its members. Conversely, a large set-level probability does not imply that every member is individually likely to be causal.

Definition: Let \(C\) denote the set of causal variants in a region, and let \(D\) denote the observed data. The posterior inclusion probability of variant \(j\) is \(P(j\in C\mid D)\). For a specified variant set \(S\), its at-least-one-causal posterior probability is \(P(C\cap S\ne\varnothing\mid D)\). A credible set is a set constructed so that a stated posterior probability target is reached under a stated model and construction. These probabilities are conditional on the data and model.

A common construction ranks variants by posterior probability for a single causal signal and adds them until the cumulative posterior probability reaches a target such as 0.95. The resulting set is not a list in which each member has 95% probability of being causal. Rather, under the construction’s assumptions, the posterior probability that the causal variant is among the selected members is at least the target. Ties or discrete posterior masses can make the achieved probability exceed the target.

The exact event behind a credible set depends on the model. With exactly one causal variant and no separate null state, a set’s posterior mass is the sum of the PIPs of its members. With multiple causal variants, the event “at least one member of this set is causal” is generally not given by adding PIPs. Some methods instead construct a credible set for each modeled signal; that set’s target concerns that signal’s posterior distribution, not automatically the probability that the whole region contains a causal variant.

When set mass equals a sum of PIPs

Suppose the model specifies exactly one causal variant among \(m\) candidates. The events “variant 1 is causal,” “variant 2 is causal,” and so on are mutually exclusive and exhaustive. If \(S\) is any subset of candidates, the event that the causal variant lies in \(S\) is the disjoint union of the events that each particular member is causal. Therefore, its posterior probability is the sum of their PIPs.

$$ P(C\cap S\ne\varnothing\mid D) =\sum_{j\in S}P(j\in C\mid D) $$

This identity depends on the exactly-one-causal assumption. It is not a general rule for multi-causal models, because two or more members can be causal at the same time. In that setting, summing PIPs gives the posterior expected number of causal variants in \(S\), not the probability that \(S\) contains at least one.

Worked Example: A Moderate PIP in a 90% Credible Set

Consider a hypothetical region with exactly one causal variant among five candidates. Suppose the posterior probabilities are \(0.30, 0.25, 0.20, 0.15,\) and \(0.10\), in that order. They sum to 1, as required under this model. Construct a 90% credible set by ranking candidates and accumulating their posterior probabilities.

After the first candidate, the cumulative mass is \(0.30\). After the second, it is \(0.30+0.25=0.55\). After the third, it is \(0.55+0.20=0.75\). After the fourth, it is \(0.75+0.15=0.90\). Thus, the first four variants form a 90% credible set.

The third variant has a PIP of \(0.20\), but it belongs to a set with posterior mass \(0.90\). The 0.90 applies to the event that the causal variant is among those four candidates, not to the third variant individually. The individual posterior probability that the third variant is causal remains \(0.20\).

Why PIPs do not add to a region probability with multiple causes

For a set \(S\), define \(I_j=1\) if variant \(j\) is causal and \(I_j=0\) otherwise. The number of causal variants in \(S\) is \(\sum_{j\in S}I_j\). Taking its posterior expectation gives the sum of the PIPs. But the event of interest for an at-least-one-causal probability is different: it occurs if this count is 1 or more. A count can exceed 1, so its expectation is not generally its probability of being positive.

For two variants \(A\) and \(B\), the distinction follows from inclusion-exclusion:

$$ P(A\text{ or }B\text{ is causal}\mid D) =P(A\text{ causal}\mid D)+P(B\text{ causal}\mid D) -P(A\text{ and }B\text{ causal}\mid D) $$

The joint probability is subtracted because outcomes in which both are causal are counted twice in the sum of the individual PIPs. With more variants, the same issue involves further overlaps. This is why the joint posterior over causal configurations matters when interpreting a region-level event.

Worked Example: A Region With Two Possible Causal Variants

Suppose a hypothetical model assigns posterior probabilities \(0.10, 0.20, 0.15, 0.30,\) and \(0.25\) to configurations \(\varnothing,\{A\},\{B\},\{A,B\},\{C\}\), respectively. The probabilities sum to 1. Let the region of interest be \(S=\{A,B\}\).

Variant \(A\) occurs in configurations \(\{A\}\) and \(\{A,B\}\), so its PIP is \(0.20+0.30=0.50\). Variant \(B\) occurs in \(\{B\}\) and \(\{A,B\}\), so its PIP is \(0.15+0.30=0.45\). Their PIPs sum to \(0.95\).

The event that at least one of \(A\) and \(B\) is causal occurs in configurations \(\{A\},\{B\},\{A,B\}\). Its posterior probability is \(0.20+0.15+0.30=0.65\). Equivalently, inclusion-exclusion gives \(0.50+0.45-0.30=0.65\). The joint configuration \(\{A,B\}\) accounts for the difference: it is included in both PIPs but only once in the at-least-one event.

The sum \(0.95\) is the posterior expected number of causal variants in \(S\): \(0.50\) expected from \(A\) plus \(0.45\) from \(B\). It is not a 95% probability that the region contains a causal variant. The at-least-one probability is \(0.65\).

Reading variant and set summaries together

A PIP is useful for comparing individual candidates: it records how posterior support is allocated to each variant. A credible set is useful for representing uncertainty about a signal when the data and model do not resolve one candidate. In a single-causal model, a high-mass set can contain several variants with modest PIPs because their probabilities accumulate. Reporting both summaries makes the distribution of support more visible than either alone.

In multi-signal analyses, check what the set was constructed to cover. A per-signal credible set may be formed from the posterior probabilities for one modeled effect. The overall PIP for a variant instead refers to whether it is included anywhere in the causal configuration. These quantities need not coincide: a variant can receive support across signals, and signal-specific summaries are not automatically interchangeable with overall inclusion probabilities.

Worked Example: Conditional Signal Summary Versus Overall Inclusion

Suppose a hypothetical two-signal analysis reports a 90% credible set for signal 1 containing variants \(V_1\) and \(V_2\). Under the signal-specific posterior used to construct that set, \(V_1\) has probability \(0.52\) and \(V_2\) has probability \(0.39\) of representing signal 1. Their cumulative probability is \(0.52+0.39=0.91\), so the set reaches the 90% target. The overall PIP for \(V_2\), computed as the probability that it is causal in any signal, is reported as \(0.43\).

These values refer to different events. The \(0.39\) is the signal-1-specific probability used in the set construction; the \(0.43\) is the overall probability of inclusion. The set’s 0.91 mass means that, under the stated signal-specific construction, signal 1 is represented by \(V_1\) or \(V_2\) with posterior probability 0.91. It does not mean that either variant has a PIP of 0.91, nor that the overall probability that at least one of them is causal must equal 0.91. That latter event must be evaluated from the joint posterior over configurations.

Assumptions, diagnostics, and limitations

All of these interpretations are conditional on the model, including its candidate variants, causal-configuration assumptions, priors, and representation of the data. A posterior credible-set target is not by itself a guarantee of empirical coverage across repeated studies, nor does it establish that the model is correctly specified. The introductory material on credible-set probability and calibration distinguishes posterior mass conditional on a model from performance assessed across repeated data sets.

Before interpreting a reported set, identify its probability target and construction. Check whether it concerns one causal variant, one modeled signal, or the event that at least one member of a region is causal. Also check whether a no-causal-variant state is possible. If it is, posterior probabilities over candidate variants may sum to less than 1; a set can reach a target only under the method’s stated convention, such as conditioning on a signal being present. Do not silently treat the remaining probability as assigned to one of the listed variants.

A useful diagnostic is to compare the set’s reported cumulative mass with the probabilities actually used to construct it. In a single-causal model, these are the member PIPs. If the model permits multiple causal variants, do not expect the sum of overall PIPs to equal the at-least-one probability; calculate the latter from posterior configurations or a valid equivalent summary. A mismatch between a reported set interpretation and its construction is a warning about interpretation, even when the arithmetic is correct.

Credible sets also have limitations as summaries. The target alone does not show whether posterior mass is concentrated on a few members or spread across many, and the same target can produce sets of very different sizes. PIPs add useful variant-level detail, but neither a PIP nor set membership proves causality. Both are model-based measures of posterior uncertainty, not statements that an association is causal in the biological or experimental sense.

Key takeaway: A PIP is a posterior probability for one variant’s inclusion. A credible-set probability concerns a set-level event defined by a particular construction. Add PIPs to obtain set mass only when the relevant causal events are mutually exclusive, as in a model with exactly one causal variant.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. Under a model with exactly one causal variant, three variants have PIPs \(0.45, 0.30,\) and \(0.25\). What is the posterior probability that the causal variant is among the first two?
  2. In a multi-causal model, two variants have PIPs \(0.60\) and \(0.50\), and their joint posterior probability of both being causal is \(0.35\). What is the probability that at least one is causal?
  3. What does it mean if a variant with PIP \(0.18\) is included in a 90% credible set? State what it does not mean.
  4. In a multi-causal model, what quantity does the sum of PIPs over a set equal, and why is it not generally the probability that the set contains at least one causal variant?

Solutions. (1) The events are mutually exclusive under the one-causal model, so the probability is \(0.45+0.30=0.75\). (2) Inclusion-exclusion gives \(0.60+0.50-0.35=0.75\). (3) Under the set’s stated construction, the event represented by membership in the set has posterior mass at least 0.90. The individual variant’s PIP remains 0.18; it is not 90% likely to be causal. (4) The sum is the posterior expected number of causal variants in the set. It is not generally the at-least-one probability because configurations with multiple causal members contribute more than once to the sum.

Clinical Biostats