Tutorials › Bayesian Clinical Trials › Spike-and-Slab Commensurability Priors

Robustness to Prior-Data Conflict · Tutorial 420 of 696

Spike-and-Slab Commensurability Priors

Learn to calculate posterior probabilities of exact and approximate borrowing under a spike-and-slab commensurability prior, and interpret those probabilities alongside the resulting treatment-effect estimates.

Advanced 12 min read

What You'll Learn

  • Define a spike for exact commensurability and a slab for finite commensurability precision.
  • Derive the marginal likelihood for the spike and slab components.
  • Calculate posterior probabilities of exact borrowing and threshold-defined approximate borrowing.
  • Interpret component-specific shrinkage in the context of a clinical treatment effect.
  • Recognize assumptions, diagnostics, and limitations of the prior specification.

Why Put a Spike on Commensurability?

A commensurate prior lets current-trial information borrow from a historical treatment effect, with the amount of borrowing controlled by a precision parameter. A finite precision allows the effects to differ: larger precision concentrates the current effect more tightly around the historical effect. But a prior that only assigns finite precision does not give positive probability to exact equality. A spike-and-slab prior addresses this by assigning one part of the prior to exact commensurability and the other to a distribution over finite precisions.

This distinction is clinically useful. The spike represents a model in which the underlying historical and current effects are equal. The slab represents models in which they may differ, with the precision determining how strongly the current effect is expected to remain close to the historical effect. Neither component says that a historical estimate is known without uncertainty.

Definition: Let \(\theta_H\) and \(\theta_C\) denote the historical and current treatment effects, and let \(\kappa\) be the commensurability precision. A spike-and-slab commensurability prior assigns probability \(w\) to exact commensurability, \(\theta_C=\theta_H\), and probability \(1-w\) to a slab in which \(\kappa\) is finite and drawn from a specified probability distribution \(G\). Under the slab, \(\theta_C\mid\theta_H,\kappa\sim N(\theta_H,1/\kappa)\). The precision \(\kappa\) is measured in inverse squared effect units.

For calculations, it is useful to represent the two components with an indicator \(Z\). Set \(Z=1\) for the spike and \(Z=0\) for the slab, with \(P(Z=1)=w\). When \(Z=1\), \(\theta_C=\theta_H\) exactly; when \(Z=0\), draw a finite \(\kappa\) from \(G\) and use the normal prior above. A continuous slab places probability zero on any one exact finite value of \(\kappa\), while the spike is an atom with positive prior probability.

Model and Posterior Component Probabilities

Suppose historical data \(D_H\) have been analyzed to give \(\theta_H\mid D_H\sim N(m_H,V_H)\). Let \(Y\) be a current-trial estimate of the treatment effect. Use the sampling model \(Y\mid\theta_C\sim N(\theta_C,s^2)\), where \(s\) is the known standard error (or a justified normal-approximation standard error). Assume the current and historical data are conditionally independent given their respective effects, and that the prior and sampling models are appropriate for the endpoint and trial design.

Under the spike, integrating over the historical uncertainty gives \(Y\mid Z=1,D_H\sim N(m_H,s^2+V_H)\). Under a slab value \(\kappa\), the prior distribution of \(\theta_C\) after integrating over \(\theta_H\mid D_H\) is \(N(m_H,V_H+1/\kappa)\). Thus \(Y\mid Z=0,\kappa,D_H\) is normal with mean \(m_H\) and variance \(s^2+V_H+1/\kappa\). These distributions provide the component marginal likelihoods: the probability densities assigned to the observed current estimate by each component.

$$ m_1(y)=\phi\!\left(y;m_H,s^2+V_H\right), \qquad m_0(y)=\int_0^\infty \phi\!\left(y;m_H,s^2+V_H+1/\kappa\right)\,dG(\kappa) $$

Here \(\phi(y;\mu,v)\) is the normal density at \(y\) with mean \(\mu\) and variance \(v\). The subscript 1 denotes the spike and 0 the slab; \(m_0(y)\) averages the slab likelihood over its prior distribution \(G\) on \(\kappa\). Bayes' rule gives the posterior probability of exact commensurability:

$$ P(Z=1\mid y,D_H)= \frac{w\,m_1(y)} {w\,m_1(y)+(1-w)m_0(y)}. $$

Conditional on being in the slab, the posterior distribution of \(\kappa\) is proportional to its prior distribution times its component likelihood. This also gives a precise way to report approximate borrowing. For a prespecified threshold \(\kappa_0\), the posterior probability of slab borrowing at least that precise is:

$$ P(Z=0,\kappa\geq\kappa_0\mid y,D_H)= \frac{(1-w)\int_{[\kappa_0,\infty)}\phi(y;m_H,s^2+V_H+1/\kappa)\,dG(\kappa)} {w\,m_1(y)+(1-w)m_0(y)}. $$

The threshold must be chosen and interpreted on the effect scale: large \(\kappa\) means small prior variance \(1/\kappa\), hence stronger approximate borrowing. A threshold probability is not the posterior probability of exact equality. The latter is the spike probability alone.

Worked Posterior Calculations

Worked Example: Posterior Probability of Exact Borrowing

Suppose a hypothetical trial estimates a treatment effect as \(y=0.30\) mmHg, with \(s=0.20\) mmHg. The historical posterior is \(N(m_H,V_H)\) with \(m_H=0.10\) mmHg and \(V_H=0.04\) mmHg\(^2\). Let \(w=0.25\), and let the slab put all its probability on \(\kappa=25\) mmHg\(^{-2}\). Calculate the posterior probability of the spike.

For the spike, the predictive variance of \(Y\) is \(s^2+V_H=0.04+0.04=0.08\) mmHg\(^2\). For the slab, \(1/\kappa=0.04\) mmHg\(^2\), so its predictive variance is \(0.04+0.04+0.04=0.12\) mmHg\(^2\). Both component means are \(0.10\) mmHg, so the observed difference from the mean is \(0.20\) mmHg. Their densities are:

$$ m_1(y)=\frac{1}{\sqrt{2\pi(0.08)}}\exp\!\left[-\frac{(0.30-0.10)^2}{2(0.08)}\right]\approx 1.099, \qquad m_0(y)=\frac{1}{\sqrt{2\pi(0.12)}}\exp\!\left[-\frac{(0.30-0.10)^2}{2(0.12)}\right]\approx 0.975. $$

The posterior spike probability is therefore \(0.25(1.099)/[0.25(1.099)+0.75(0.975)]\approx 0.273\). The current estimate is somewhat more compatible with the spike density than with the slab density, but the prior odds and both likelihoods matter. Under this specified model, the posterior probability of exact commensurability is about 27.3%; this is a model probability, not a probability that the observed estimate itself is exact.

Worked Example: Probability of Strong Approximate Borrowing

Consider another hypothetical analysis with \(y=0.50\) mmHg, \(s^2=0.04\) mmHg\(^2\), \(m_H=0.10\) mmHg, and \(V_H=0.01\) mmHg\(^2\). Set \(w=0.20\). Let the slab assign equal probability to \(\kappa=4\) and \(\kappa=25\) mmHg\(^{-2}\). Find the posterior spike probability and the posterior probability of being in the slab with \(\kappa\geq 10\) mmHg\(^{-2}\).

The observed difference from the predictive mean is \(0.40\) mmHg. The spike predictive variance is \(0.04+0.01=0.05\) mmHg\(^2\). Its density is \(m_1(y)=\exp[-0.40^2/(2(0.05))]/\sqrt{2\pi(0.05)}\approx 0.360\). For \(\kappa=4\), the slab predictive variance is \(0.04+0.01+0.25=0.30\), giving density approximately \(0.558\). For \(\kappa=25\), it is \(0.04+0.01+0.04=0.09\), giving density approximately \(0.547\). The slab marginal likelihood is their equal-weight average: \(m_0(y)=(0.558+0.547)/2\approx 0.5525\).

The normalizing density for the mixture is \(0.20(0.360)+0.80(0.5525)=0.5140\). Thus the posterior spike probability is \(0.20(0.360)/0.5140\approx 0.140\). The joint prior probability of the slab point \(\kappa=25\) is \(0.80(0.50)=0.40\), so its posterior probability is \(0.40(0.547)/0.5140\approx 0.426\). Since this point is the only slab value at least 10, the posterior probability of slab borrowing at least that precise is about 42.6%. The remaining slab probability, about 43.4%, is at \(\kappa=4\). These probabilities sum with the spike probability to approximately one.

Worked Example: What the Components Imply for the Treatment Effect

Return to the first hypothetical example, with \(y=0.30\) mmHg, \(m_H=0.10\) mmHg, \(s^2=0.04\) mmHg\(^2\), and \(V_H=0.04\) mmHg\(^2\). The slab has \(\kappa=25\), and the posterior spike probability was approximately \(0.273\). Find the posterior means and variances of \(\theta_C\) within each component, then combine the means.

For a component with marginal prior \(\theta_C\sim N(m_H,q)\), where \(q=V_H\) for the spike and \(q=V_H+1/\kappa\) for the slab, normal updating gives posterior mean \(m_H+[q/(q+s^2)](y-m_H)\) and variance \(qs^2/(q+s^2)\). The spike has \(q=0.04\), so its posterior mean is \(0.10+[0.04/(0.04+0.04)](0.20)=0.200\) mmHg and its variance is \(0.04(0.04)/0.08=0.0200\) mmHg\(^2\). The slab has \(q=0.08\), so its mean is \(0.10+[0.08/(0.08+0.04)](0.20)=0.233\) mmHg and its variance is \(0.08(0.04)/0.12=0.0267\) mmHg\(^2\).

The mixture posterior mean is the posterior-weighted component mean: \(0.273(0.200)+0.727(0.233)\approx 0.224\) mmHg. The spike component enforces equality of the underlying effects, not equality of the estimates: historical uncertainty remains, and the current data update the common effect. The slab permits a larger difference between the current and historical effects.

Justification and Practical Interpretation

The marginal distributions and component updates follow from the sum of independent normal variables. Under the slab, conditional on \(D_H\), write \(\theta_C=\theta_H+\epsilon\), where \(\theta_H\sim N(m_H,V_H)\) and \(\epsilon\sim N(0,1/\kappa)\) independently. Then \(\theta_C\sim N(m_H,V_H+1/\kappa)\). Adding the sampling error in \(Y=\theta_C+\eta\), with \(\eta\sim N(0,s^2)\) independent, gives \(Y\sim N(m_H,V_H+1/\kappa+s^2)\). Under the spike, \(\epsilon=0\), so the same argument gives variance \(V_H+s^2\). Applying Bayes' rule to the two component probabilities yields the posterior formula above; applying it to a slab interval yields the threshold-probability formula.

A posterior probability is conditional on the model, its prior mixture weight, and the observed data. A low spike probability can reflect conflict with the exact-equality model, but it does not by itself identify why the historical and current evidence differ. Trial populations, endpoint measurement, treatment delivery, and chance variation may all matter. Likewise, a high spike probability is not a guarantee that borrowing is scientifically appropriate under every unmodeled source of difference.

Diagnostics, Alternatives, and Limitations

Check that the normal approximation for the current estimate is credible, that the standard error is on the same treatment-effect scale as the historical posterior, and that historical data have not been counted twice. Inspect predictive distributions under each component: if the observed current estimate lies in a tail under both, the model may fit poorly even if one component receives most of the posterior probability. Recalculate posterior probabilities over plausible values of \(w\) and slab distributions \(G\); a conclusion that changes sharply under modest changes is prior-sensitive.

A fixed finite commensurability precision is simpler, but it cannot assign positive probability to exact equality or adapt across precision values. A spike-and-slab prior explicitly separates exact equality from finite differences, while a robust mixture that instead mixes prior distributions for the current effect represents a different modeling choice. The spike-and-slab approach has interpretable component probabilities, but those probabilities depend on the specified component distributions and prior weight. The threshold \(\kappa_0\) for approximate borrowing is also a reporting choice, not a universal scientific boundary.

A practical failure mode is to interpret \(\kappa\) as a direct measure of borrowing without accounting for uncertainty in the historical effect. The actual marginal prior variance around \(m_H\) under the slab is \(V_H+1/\kappa\), not merely \(1/\kappa\). Even as \(\kappa\) grows very large, uncertainty \(V_H\) remains unless historical information is effectively known without uncertainty. In addition, a posterior spike probability is not a posterior estimate of the treatment effect and should be reported alongside the component-conditional or mixture posterior for \(\theta_C\).

Key takeaway: The spike assigns prior and posterior probability to exact commensurability; the slab assigns probability across finite precisions and therefore approximate borrowing. Compute posterior probabilities by weighting each component's marginal likelihood by its prior probability, and interpret them as conditional on the full model specification.

Check Your Understanding

Try each question, then compare your reasoning with the solutions below.

  1. In a spike-and-slab commensurability prior, what does the spike represent, and what does a large finite \(\kappa\) represent?
  2. If \(s^2=0.09\), \(V_H=0.01\), and \(\kappa=4\), what is the slab predictive variance for the current estimate?
  3. Why is \(P(Z=1\mid y,D_H)\) not the posterior probability that the observed current estimate equals the historical estimate?
  4. What additional quantity is needed to report posterior probability of approximate borrowing at least as strong as a chosen level?

Solutions. (1) The spike represents exact equality of the underlying historical and current effects. A large finite precision gives a small prior variance \(1/\kappa\), favoring close but not necessarily equal effects. (2) The variance is \(s^2+V_H+1/\kappa=0.09+0.01+0.25=0.35\) in squared effect units. (3) The spike probability concerns the latent model component and equality of underlying effects; observed estimates include sampling variation and need not be equal even under exact commensurability. (4) Specify a threshold \(\kappa_0\) on the precision scale, then calculate the posterior probability of \(Z=0\) and \(\kappa\geq\kappa_0\).

Clinical Biostats