Tutorials › High-Dimensional Genomic Data Analysis › Overlapping Credible Sets Across Signals

Statistical Fine-Mapping and Credible Sets · Tutorial 723 of 795

Overlapping Credible Sets Across Signals

Interpret overlap between signal-specific credible sets without confusing shared candidates with duplicated causal effects, and use joint assignment probabilities to assess dependence.

Advanced 12 min read

What You'll Learn

  • Define signal-specific credible sets from posterior assignment probabilities.
  • Interpret shared variants without treating set overlap as proof of duplicate effects.
  • Compare set overlap using intersection and Jaccard similarity.
  • Distinguish marginal assignment probabilities from joint posterior probabilities.
  • Calculate assignment dependence from a joint probability table.
  • Diagnose unstable or misleading overlap patterns.

Why Overlap Needs Careful Interpretation

In multi-signal fine-mapping, each inferred signal has its own posterior distribution over candidate variants and its own credible set. Two such sets can overlap because the data do not clearly distinguish which nearby variant belongs to which signal. That overlap is useful information about uncertainty, but it is not, by itself, evidence that the signals are the same effect—or that they are independent effects.

The distinction matters because a credible set is a summary of marginal posterior uncertainty for one signal. Whether assignments across signals are dependent is a joint-probability question. A shared variant may be a candidate for either signal, while the posterior may make the two assignments strongly dependent, nearly independent, or subject to model constraints. Those possibilities cannot generally be distinguished by looking at the sets alone.

Definition: Let \(C_k\) denote the variant assigned to signal \(k\), and let \(D\) denote the observed data. For candidate variant \(j\), define its signal-specific posterior assignment probability as \(\alpha_{kj}=P(C_k=j\mid D)\). A credible set for signal \(k\), at target level \(1-\gamma\), is a set of variants whose \(\alpha_{kj}\) values sum to at least \(1-\gamma\), usually by taking variants in descending order of \(\alpha_{kj}\) until that threshold is reached.

This definition presumes a specified multi-signal model, a common set of candidate variants, and a posterior assignment distribution for each signal. The target level describes posterior mass under that model and its assumptions; it is not a guarantee that every set will contain a causal variant in repeated studies. If posterior probabilities are obtained from an approximation, the credible-set interpretation inherits that approximation.

Write \(S_k\) for the credible set of signal \(k\). The sets overlap when \(S_k\cap S_\ell\) is nonempty. Their intersection identifies variants included as candidates for both signals. It does not tell us how probable it is that both signals are assigned to the same variant: that requires the joint distribution \(P(C_k,C_\ell\mid D)\).

Reading the Overlap

A variant in an intersection has posterior support in the marginal assignment distribution for each of the relevant signals. It is therefore a shared candidate, not automatically a shared causal effect. Conversely, two sets with no shared variants do not establish that the signals are statistically independent: their assignments could still be dependent through the joint posterior.

A simple measure of set overlap is the Jaccard similarity:

$$ J(S_k,S_\ell)=\frac{|S_k\cap S_\ell|}{|S_k\cup S_\ell|}. $$

This describes the proportion of the combined set members that appear in both sets. It is a descriptive comparison, not a probability of shared causality or a measure of posterior dependence. In particular, it treats a variant barely included at the credible-set threshold the same as one with a large assignment probability.

Worked Example: Two Sets Share Candidate Variants

Suppose a hypothetical analysis has four candidate variants, \(v_1,\ldots,v_4\), and a target credible-set level of 95%. The signal-specific assignment probabilities are:

$$ \begin{aligned} (\alpha_{1,1},\alpha_{1,2},\alpha_{1,3},\alpha_{1,4})&=(0.55,0.35,0.10,0),\\ (\alpha_{2,1},\alpha_{2,2},\alpha_{2,3},\alpha_{2,4})&=(0,0.50,0.30,0.20). \end{aligned} $$

For signal 1, the probabilities in descending order are \(0.55, 0.35, 0.10\). The first two sum to \(0.55+0.35=0.90\), which is below 0.95; including \(v_3\) gives \(0.90+0.10=1.00\). Thus \(S_1=\{v_1,v_2,v_3\}\).

For signal 2, the first two probabilities sum to \(0.50+0.30=0.80\). Including \(v_4\) gives \(0.80+0.20=1.00\), so \(S_2=\{v_2,v_3,v_4\}\). The intersection is \(\{v_2,v_3\}\), the union contains four variants, and \(J=2/4=0.50\).

The warranted conclusion is that \(v_2\) and \(v_3\) are candidates in both signal-specific sets. These marginal probabilities do not establish that either variant is assigned to both signals, nor do they establish that both signals represent distinct biological effects. Those claims require interpreting the multi-signal model and its joint assignments.

Overlap can arise for several reasons. Nearby variants may be difficult to distinguish because their genotypes are correlated through linkage disequilibrium. A signal may be weak, leaving its assignment probabilities spread over many variants. Multiple signals may also compete to explain related evidence. These explanations are not interchangeable: a broad set can reflect limited resolution for one signal, while cross-signal dependence concerns how assignments vary together.

The earlier material on posterior uncertainty within a credible set and credible-set purity and LD helps distinguish uncertainty among variants in one set from the relationship between sets. A wide intersection can be a clue to shared ambiguity, but inspecting the variants’ assignment probabilities and the model’s joint behavior is necessary before drawing stronger conclusions.

Marginal Probabilities Do Not Determine Dependence

To assess dependence between two signal assignments, define the joint assignment probabilities \(q_{k\ell}(j,m)=P(C_k=j,C_\ell=m\mid D)\). They must agree with the marginal probabilities when summed over the other signal:

$$ \sum_m q_{k\ell}(j,m)=\alpha_{kj}, \qquad \sum_j q_{k\ell}(j,m)=\alpha_{\ell m}. $$

The marginals constrain the joint distribution but do not usually determine it. The following short derivation makes that limitation explicit. If the two assignments were independent, then \(q_{k\ell}(j,m)=\alpha_{kj}\alpha_{\ell m}\). But other joint tables can have the same row and column sums while assigning different probabilities to matching or differing variants. Therefore, neither marginal probabilities nor credible-set membership alone identify dependence.

Worked Example: Same Credible Sets, Different Dependence

Consider two hypothetical signals and two variants, \(A\) and \(B\). Suppose both signals have marginal assignment probabilities \(P(C_1=A\mid D)=P(C_1=B\mid D)=0.50\) and \(P(C_2=A\mid D)=P(C_2=B\mid D)=0.50\). Each 95% credible set is therefore \(\{A,B\}\).

Under independence, the joint table is:

\(C_2=A\)\(C_2=B\)
\(C_1=A\)0.250.25
\(C_1=B\)0.250.25

The probability of a matching assignment is \(P(C_1=C_2\mid D)=0.25+0.25=0.50\). Now consider a different joint table:

\(C_2=A\)\(C_2=B\)
\(C_1=A\)0.500
\(C_1=B\)00.50

This second table has the same marginals, since each row and column sums to 0.50, but \(P(C_1=C_2\mid D)=0.50+0.50=1.00\). The credible sets and marginal probabilities are identical in the two cases; the dependence is not. The tables are hypothetical illustrations of joint distributions, not empirical estimates from a study.

Key distinction: Credible-set overlap describes shared membership among marginal candidate sets. Dependence describes how signal assignments co-vary in the joint posterior. A set-intersection statistic cannot substitute for a joint assignment probability.

Assessing Dependence and Model Interpretation

When a joint posterior over assignments is available, one direct summary is the probability of matching assignments, \(\sum_j P(C_k=j,C_\ell=j\mid D)\). This is meaningful only when the signal definitions and variant universe make a match interpretable. It is not, on its own, proof that two modeled signals are biologically one effect: distinct effects can map to the same measured variant under some model formulations, and the model’s assumptions determine which configurations are permitted.

Another useful question is conditional: how does the assignment distribution for one signal change given the assignment of another? For example, compare \(P(C_\ell=m\mid C_k=j,D)\) with the marginal \(P(C_\ell=m\mid D)\). A difference indicates dependence for those assignments, provided the conditioning event has positive posterior probability. Such comparisons can reveal competition or coordination that a single overall matching probability might conceal.

In some computational approaches, a posterior approximation factorizes across signal components. Under that approximation, assignments may be treated as independent in the approximation even when the exact posterior would not factorize. Dependence conclusions should therefore be attributed to the joint distribution actually represented by the fitted method—not inferred from an algorithm’s separate marginal summaries. If only per-signal assignment probabilities are reported, the joint dependence is not identified from those summaries alone.

Worked Example: Quantifying Excess Matching Assignments

Suppose a hypothetical joint posterior for two signals and variants \(A,B\) is:

\(C_2=A\)\(C_2=B\)
\(C_1=A\)0.200.40
\(C_1=B\)0.400

The first signal has marginals \(P(C_1=A\mid D)=0.20+0.40=0.60\) and \(P(C_1=B\mid D)=0.40+0=0.40\). The second has marginals \(P(C_2=A\mid D)=0.20+0.40=0.60\) and \(P(C_2=B\mid D)=0.40+0=0.40\).

The observed posterior probability of matching assignments is \(0.20+0=0.20\). If the assignments were independent, the matching probability implied by the marginals would be \((0.60)(0.60)+(0.40)(0.40)=0.36+0.16=0.52\). Thus this joint distribution has fewer matching assignments than independence would imply. For instance, \(P(C_2=A\mid C_1=A,D)=0.20/0.60=0.3333\), compared with the marginal \(P(C_2=A\mid D)=0.60\). This quantifies dependence in the hypothetical joint posterior; it does not establish why the dependence occurs biologically.

Diagnostics, Alternatives, and Limitations

Before interpreting overlap, check the assignment probabilities and the model output that produced them. Confirm that probabilities for each signal are normalized over the stated candidate universe, that both sets use the same variants and target level, and that any ties or thresholding choices are handled consistently. If a signal has diffuse probabilities or is weak, small changes in its ranking can change set membership even when the underlying uncertainty has changed very little.

Also inspect whether the same variant appears in many signals, whether assignment probabilities are concentrated or diffuse, and whether the fitted model’s joint output permits assessment of dependence. A pattern of repeated or very similar signal sets can flag weak resolution or unstable component allocation; it is a diagnostic prompt, not a stand-alone proof that the model has duplicated a signal. In particular, labels for fitted components should not be treated as distinct biological entities solely because the computation reports separate components.

Several summaries answer different questions:

SummaryQuestion it addressesWhat it does not establish
Intersection or Jaccard similarityHow much do the reported sets share?Joint assignment dependence or duplicate causal effects
Signal-specific assignment probabilitiesWhich variants are candidates for each signal?How assignments vary jointly across signals
Joint assignment probabilitiesHow probable are pairs of assignments?Biological interpretation beyond the model’s assumptions
Variant-level posterior inclusion summariesHow strongly is a variant supported across the model?Which signal-specific assignment generated that support

A common mistake is to see one variant in two 95% credible sets and conclude that the model has found two independent causal effects at that variant. The reasoning is wrong because membership records that the variant contributes to each signal’s marginal credible set; it does not show that the two assignment events occur jointly, nor that they are independent. The correction is to report shared membership as shared candidacy, then use joint posterior output and the model’s assumptions to assess assignment dependence and interpret the signal structure.

The main limitation is that all these interpretations are conditional on the fitted model, candidate variants, data, and any approximation used to compute posterior probabilities. Overlap can describe unresolved localization without resolving the biological number of effects. A model-based joint probability adds information beyond marginal sets, but it does not remove uncertainty caused by limited data or model misspecification.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. Signal 1 has ordered assignment probabilities \(0.60,0.25,0.15\), and signal 2 has \(0.50,0.30,0.20\). At a 95% target, how many variants are needed in each credible set?
  2. Two signals have the same 95% credible set. Does that fact establish that their assignments are dependent? Explain.
  3. For two signals with marginal probabilities \(P(C_1=A\mid D)=0.70\) and \(P(C_2=A\mid D)=0.60\), what would \(P(C_1=A,C_2=A\mid D)\) be under independence?
  4. A variant appears in the credible sets for three signals. State one conclusion that is warranted and one that is not warranted from that fact alone.

Solutions. (1) Signal 1 needs all three variants: the first two sum to \(0.60+0.25=0.85\), and adding \(0.15\) gives 1.00. Signal 2 also needs all three: the first two sum to \(0.50+0.30=0.80\), and adding \(0.20\) gives 1.00. (2) No. Identical marginal sets do not determine the joint assignment distribution; the assignments could be independent or dependent. (3) Under independence, the joint probability is \((0.70)(0.60)=0.42\). (4) Warranted: the variant is included as a candidate in each of the three marginal sets. Not warranted: that the variant is jointly assigned to all three signals or represents three independent biological effects.

Clinical Biostats