Tutorials › Bayesian Clinical Trials › Deriving Normal Commensurate Shrinkage

Robustness to Prior-Data Conflict · Tutorial 418 of 696

Deriving Normal Commensurate Shrinkage

Derive posterior means and variances for current and historical normal effects, and interpret how fixed commensurability precision controls borrowing between them.

Advanced 12 min read

What You'll Learn

  • State the normal likelihood and commensurate-prior assumptions for two effects.
  • Derive the posterior mean and variance for the current effect.
  • Derive how current data update the historical effect.
  • Interpret the shrinkage weights and their dependence on precision.
  • Check limiting cases for no borrowing and near-complete commensurability.
  • Recognize assumptions and diagnostics that can make fixed-precision borrowing misleading.

Why derive the shrinkage?

A commensurate prior links a current treatment effect to a historical treatment effect while allowing them to differ. With a fixed commensurability precision, the link has a transparent normal-model derivation: the current posterior mean is a weighted average of the current estimate and the historical posterior mean. The weights depend on sampling uncertainty, historical uncertainty, and the precision of the link.

The derivation also shows that borrowing is reciprocal. Current data can update the historical effect as well as the current effect. This is a consequence of treating both effects as uncertain, not of treating the historical estimate as a fixed target.

Model and assumptions

Let \(\theta_H\) be the historical treatment effect and \(\theta_C\) the current treatment effect, measured on the same scale and in the same direction. Suppose the historical data have already been summarized by a proper normal posterior distribution. Write its mean as \(m_H\) and its variance as \(V_H\). This summary may, for example, result from a normal prior for \(\theta_H\) and a normal likelihood for a historical estimate.

For the current data, suppose \(y_C\) is an unbiased normal estimate of \(\theta_C\), with known sampling variance \(V_C\). The commensurate prior states that, conditional on the historical effect, the current effect differs from it by a normal deviation with precision \(\tau\).

Definition: The fixed-precision normal commensurate model is \(\theta_H\mid D_H\sim N(m_H,V_H)\), \(\theta_C\mid\theta_H\sim N(\theta_H,\tau^{-1})\), and \(y_C\mid\theta_C\sim N(\theta_C,V_C)\), where \(\tau>0\) is fixed and \(D_H\) denotes the historical data. The current sampling error is independent of the effects and of the commensurate deviation. The variances \(V_H\) and \(V_C\) are treated as known.

Here \(\tau\) has units of inverse effect-squared, so \(\tau^{-1}\) is a variance on the effect scale. Larger \(\tau\) means the model expects the two effects to be closer; smaller \(\tau\) allows greater differences. The model also assumes that the two effects are comparable: the endpoint, treatment contrast, population context, and effect scale must support interpreting their difference as a commensurate deviation. The normal sampling model and known variances are working assumptions, not consequences of choosing a commensurate prior.

The historical posterior \(N(m_H,V_H)\) must represent historical information only. Incorporating current data into it first and then using it as the historical input would count the current data twice. The derivation below conditions on the historical data through that posterior and then adds the current likelihood once.

Posterior distributions and derivation

Set \(A=V_H+\tau^{-1}\). By adding independent normal variables, the prior distribution for the current effect after accounting for historical data is \(\theta_C\mid D_H\sim N(m_H,A)\). Updating this normal distribution with the current estimate gives the usual normal-normal posterior. To see the weighted-average form, multiply the prior density by the current likelihood and collect the terms involving \(\theta_C\).

$$ \begin{aligned} p(\theta_C\mid y_C,D_H) &\propto \exp\left\{-\frac{1}{2} \left[\frac{(\theta_C-m_H)^2}{A} +\frac{(y_C-\theta_C)^2}{V_C}\right]\right\},\\ \operatorname{Var}(\theta_C\mid y_C,D_H) &=\left(\frac{1}{A}+\frac{1}{V_C}\right)^{-1} =\frac{A V_C}{A+V_C},\\ E(\theta_C\mid y_C,D_H) &=\frac{m_H/A+y_C/V_C}{1/A+1/V_C} =\frac{V_C}{A+V_C}m_H+\frac{A}{A+V_C}y_C. \end{aligned} $$

The final line is a precision-weighted average: the current estimate receives more weight when the historical-based prior variance \(A\) is large relative to the current sampling variance \(V_C\). Equivalently, the posterior mean starts at \(m_H\) and moves toward \(y_C\) by a fraction of their difference.

Result: Under the stated model, the current-effect posterior is normal with \(\displaystyle E(\theta_C\mid y_C,D_H)=m_H+\frac{A}{A+V_C}(y_C-m_H)\) and \(\displaystyle \operatorname{Var}(\theta_C\mid y_C,D_H)=\frac{A V_C}{A+V_C}\), where \(A=V_H+\tau^{-1}\). The coefficient \(A/(A+V_C)\) is the fraction of the difference \(y_C-m_H\) reflected in the posterior mean.

The historical effect also updates. Marginally, the current estimate obeys \(y_C\mid\theta_H,D_H\sim N(\theta_H,W)\), where \(W=\tau^{-1}+V_C\): the estimate differs from \(\theta_H\) both through the commensurate deviation and through current sampling error. Updating \(\theta_H\mid D_H\sim N(m_H,V_H)\) with this likelihood gives

$$ \begin{aligned} E(\theta_H\mid y_C,D_H) &=m_H+\frac{V_H}{V_H+W}(y_C-m_H),\\ \operatorname{Var}(\theta_H\mid y_C,D_H) &=\frac{V_H W}{V_H+W}. \end{aligned} $$

These expressions can also be checked by completing the square in the normal likelihood for \(y_C\) given \(\theta_H\). They show that the historical effect moves toward the current estimate, but its movement is governed by \(V_H\) and the combined uncertainty \(W\). If desired, the posterior covariance of the two effects is \(V_H V_C/(A+V_C)\); their posterior dependence remains because the commensurate prior links them.

Worked Example: Updating Both Effects

Suppose the historical effect has prior \(\theta_H\sim N(0,1)\), and the historical estimate is \(y_H=2.0\) effect units with sampling variance \(0.25\). A normal-normal update gives \(V_H=(1+1/0.25)^{-1}=0.2000\) and \(m_H=V_H(2.0/0.25)=1.600\) effect units. Now suppose \(y_C=2.8\) effect units, \(V_C=0.36\), and the fixed commensurability precision is \(\tau=4\) inverse effect-units squared.

The commensurate variance is \(\tau^{-1}=0.25\) effect-units squared, so \(A=V_H+\tau^{-1}=0.2000+0.2500=0.4500\). The current-effect posterior mean and variance are

$$ \begin{aligned} E(\theta_C\mid y_C,D_H) &=\frac{0.36}{0.45+0.36}(1.600) +\frac{0.45}{0.45+0.36}(2.800)\\ &=0.4444(1.600)+0.5556(2.800) =2.267\text{ effect units},\\ \operatorname{Var}(\theta_C\mid y_C,D_H) &=\frac{0.45(0.36)}{0.81} =0.2000\text{ effect-units squared}. \end{aligned} $$

For the historical effect, \(W=\tau^{-1}+V_C=0.25+0.36=0.61\). Thus \(E(\theta_H\mid y_C,D_H)=1.600+\{0.2000/(0.2000+0.61)\}(2.8-1.6)=1.896\) effect units, and \(\operatorname{Var}(\theta_H\mid y_C,D_H)=0.2000(0.61)/0.81=0.1506\) effect-units squared. Both effects move toward the current estimate, but the current effect moves more because its prior variance \(A\) is larger than \(V_H\).

How fixed precision controls borrowing

The limiting cases clarify what the commensurability assumption does. As \(\tau\) approaches zero, \(\tau^{-1}\) becomes very large. Then \(A/(A+V_C)\) approaches one, and the current posterior mean approaches \(y_C\); the historical information has little influence. The historical update also vanishes because \(V_H/(V_H+W)\) approaches zero. This is the no-borrowing limit.

As \(\tau\) becomes very large, the commensurate variance approaches zero. The prior enforces \(\theta_C=\theta_H\) increasingly closely, so the current data can strongly update the historical effect and the current effect. In the limit, the two effects are a common effect, and their information is pooled through the historical posterior and current likelihood. A large but finite \(\tau\) does not make the effects exactly equal.

Worked Example: Comparing Two Fixed Precisions

Suppose \(m_H=1.0\) effect unit, \(V_H=0.09\) effect-units squared, \(y_C=3.0\) effect units, and \(V_C=0.25\) effect-units squared. First take \(\tau=1\), so \(A=0.09+1=1.09\). The current estimate's weight is \(A/(A+V_C)=1.09/1.34=0.8134\). Therefore \(E(\theta_C\mid y_C,D_H)=1.0+0.8134(3.0-1.0)=2.627\) effect units, and \(\operatorname{Var}(\theta_C\mid y_C,D_H)=1.09(0.25)/1.34=0.2034\) effect-units squared.

Now take a much larger precision, \(\tau=100\), so \(\tau^{-1}=0.01\) and \(A=0.10\). The current weight becomes \(0.10/(0.10+0.25)=0.2857\), giving a posterior mean of \(1.0+0.2857(2.0)=1.571\) effect units and variance \(0.10(0.25)/0.35=0.07143\) effect-units squared. Under this model, higher precision means stronger commensurability and more borrowing: the current posterior moves closer to the historical mean and becomes more precise. This numerical comparison describes the consequences of two assumed precisions; it does not determine which precision is appropriate.

Worked Example: Reading the Weights on an Effect Scale

Suppose a historical analysis gives \(m_H=-0.4\) points and \(V_H=0.16\) points squared. The current estimate is \(y_C=0.2\) points with \(V_C=0.09\) points squared, and \(\tau=2.5\) per point squared. Then \(\tau^{-1}=0.40\) points squared and \(A=0.16+0.40=0.56\) points squared. The current estimate's weight is \(0.56/(0.56+0.09)=0.8615\); the historical mean's weight is \(0.09/0.65=0.1385\). The weights sum to one.

The posterior mean is \(0.1385(-0.4)+0.8615(0.2)=0.1169\) points. The variance is \(0.56(0.09)/0.65=0.07754\) points squared, corresponding to a posterior standard deviation of \(\sqrt{0.07754}=0.2785\) points. The estimate is near the current estimate because the historical-based prior variance is much larger than the current sampling variance. The historical effect nevertheless updates: \(W=0.40+0.09=0.49\), so its posterior mean is \(-0.4+\{0.16/(0.16+0.49)\}(0.6)=-0.2523\) points.

Assumptions, diagnostics, and alternatives

The algebra is exact under the specified normal model, but the model can still be a poor description of a trial. Before using the result, check that the effects refer to compatible estimands and that their sampling variances are credible. A treatment effect on one scale cannot be directly linked to an effect on another without a justified transformation. Also check whether normal sampling summaries are adequate; skewed, sparse, or otherwise non-normal data may not be well represented by a normal estimate with a known variance.

A useful diagnostic is the discrepancy \(y_C-m_H\) in relation to its prior predictive standard deviation \(\sqrt{V_H+\tau^{-1}+V_C}\). A discrepancy large relative to this scale means the current estimate is surprising under the chosen link and uncertainty assumptions. That is a warning to investigate incompatibility and sensitivity, not a formal proof that the studies differ. A fixed \(\tau\) cannot adapt to conflict: it assigns the same linking strength regardless of the observed discrepancy.

The main alternatives answer different modeling questions. Setting borrowing to zero leaves the current analysis independent of the historical effect. A common-effect model assumes the effects are equal, rather than merely close with a finite commensurate variance. Robust mixture approaches can allow borrowing to change according to conflict through their component structure and posterior weights. The fixed-precision model is simpler and gives closed-form updates, but it does not represent uncertainty about \(\tau\) or automatically protect against prior-data conflict.

Common mistake

A frequent error is to interpret larger \(\tau\) as allowing more difference because it is called a precision. That reverses the parameter's role: the variance of the difference is \(\tau^{-1}\), so increasing \(\tau\) decreases the allowed difference and strengthens borrowing. Another error is to call \(A/(A+V_C)\) the historical weight. It is the weight on the current estimate \(y_C\); the historical mean's weight is \(V_C/(A+V_C)\). Keeping the variance and weight definitions beside the formula prevents both mistakes.

Key takeaway: With fixed \(\tau\), the current posterior is a normal precision-weighted update of \(y_C\) and \(m_H\), with prior variance \(V_H+\tau^{-1}\). Current data also update \(\theta_H\). The amount and direction of borrowing are mathematical consequences of the model assumptions; they are not evidence that historical and current effects are truly exchangeable.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. If \(\tau\) increases while all variances remain fixed, what happens to the commensurate variance and, generally, to the current estimate's posterior weight?
  2. Let \(m_H=0\), \(V_H=0.25\), \(y_C=1\), \(V_C=0.25\), and \(\tau^{-1}=0.25\). Find the current posterior mean and variance.
  3. In the same model, explain what happens to the historical posterior mean as \(\tau\) approaches zero.
  4. Why is it invalid to use a historical posterior that already includes the current data as the input \(N(m_H,V_H)\), then update it again with \(y_C\)?

Solutions. (1) The commensurate variance \(\tau^{-1}\) decreases. Since \(A=V_H+\tau^{-1}\) decreases, the current estimate's weight \(A/(A+V_C)\) generally decreases, while the historical mean's weight increases. (2) Here \(A=0.25+0.25=0.50\). The posterior mean is \(\{0.25(0)+0.50(1)\}/0.75=0.6667\), and the variance is \(0.50(0.25)/0.75=0.1667\). (3) As \(\tau\) approaches zero, \(W=\tau^{-1}+V_C\) grows without bound, so \(V_H/(V_H+W)\) approaches zero. The historical posterior mean therefore approaches its historical-only value \(m_H\). (4) The current data would be counted twice: once in the purported historical posterior and again in the current likelihood. The model requires the historical summary to condition on historical data only.

Clinical Biostats