Tutorials › Model-Informed Drug Development (MIDD) › Robust Borrowing With Commensurate Priors

Model-Based Bridging and Extrapolation · Tutorial 457 of 596

Robust Borrowing With Commensurate Priors

Use commensurate and robust mixture priors to quantify borrowing from a source population and reduce it when target data provide evidence of conflict.

Advanced 12 min read

What You'll Learn

  • Define commensurate priors and robust mixture priors for cross-population borrowing.
  • Derive posterior borrowing weights from the component predictive distributions.
  • Calculate component-specific and mixture posterior estimates in a normal example.
  • Examine how prior mixture weights and target observations affect borrowing.
  • Identify model checks, sensitivity analyses, and limitations of robust borrowing.

Why Borrowing Needs Protection

A source population may provide useful information about a target population, but the two populations need not share the same treatment effect. A model that borrows strongly when effects are similar can become misleading when they differ. Robust borrowing methods make this tension explicit: the prior can favor information from the source while allowing the target data to weaken that borrowing when they conflict.

The earlier material on hierarchical models for cross-population borrowing establishes the general idea of partial pooling. Here the focus is narrower: specifying a commensurate prior or a robust mixture prior, and interpreting how the target data change the posterior contribution of a source-informed component. Borrowing weights are model-based summaries, not objective measures of how much evidence is “really” shared.

Definition: Let \(\theta_S\) and \(\theta_T\) denote a parameter in a source population and the corresponding parameter in a target population. A commensurate prior specifies a distribution for \(\theta_T\) centered on \(\theta_S\), such as \(\theta_T\mid\theta_S,\tau^2\sim N(\theta_S,\tau^2)\). Small \(\tau^2\) expresses stronger prior belief that the populations are similar; large \(\tau^2\) permits greater difference. A robust mixture prior assigns prior probability to a source-informed component and to a less informative component, allowing the target data to update the probability of each.

Normal Commensurate and Mixture Models

For a normal summary-data example, suppose the target estimate \(Y_T\) has sampling model \(Y_T\mid\theta_T\sim N(\theta_T,s_T^2)\), with known standard error \(s_T\). Assume the source-informed prior for the target parameter is \(\theta_T\sim N(m_b,v_b)\), where \(m_b\) and \(v_b\) summarize source information. Under a single normal component, conjugacy gives a normal posterior with precision equal to the sum of the prior and sampling precisions.

$$ \theta_T\mid Y_T=y_T,\ B=b \sim N\left( \frac{m_b/v_b+y_T/s_T^2}{1/v_b+1/s_T^2}, \frac{1}{1/v_b+1/s_T^2} \right). $$

Here \(B=b\) labels the source-informed component. A robust alternative introduces a second component, indexed by \(B=r\), with prior \(\theta_T\mid B=r\sim N(m_r,v_r)\), usually broader or less tied to the source. Let \(P(B=b)=w\), so \(P(B=r)=1-w\). The component label is unknown, and its posterior probability is updated using the component predictive distributions.

$$ Y_T\mid B=j\sim N(m_j,v_j+s_T^2),\qquad P(B=b\mid y_T)= \frac{w\,f_b(y_T)} {w\,f_b(y_T)+(1-w)\,f_r(y_T)},\quad j\in\{b,r\}, $$

where \(f_j\) is the normal density with mean \(m_j\) and variance \(v_j+s_T^2\). The posterior probability \(P(B=b\mid y_T)\) is often called the posterior borrowing weight. It is the posterior probability of the source-informed component under this specified mixture, not a universal proportion of information transferred.

Why the Target Data Update Borrowing

The weight formula follows directly from Bayes’ rule. Conditional on component \(j\), integrating over the component prior gives the marginal density of the observed target estimate. In the normal model, the sum of the prior variance and sampling variance is the predictive variance. The target estimate is more supportive of a component when it has higher density under that component.

$$ f_j(y_T)=\int f(y_T\mid\theta_T)\,p(\theta_T\mid B=j)\,d\theta_T =\phi(y_T;m_j,v_j+s_T^2). $$

The posterior target distribution is itself a mixture: each component retains its own normal posterior, and the component posterior probabilities are the mixture weights. Consequently, its posterior mean is the weighted average of the component posterior means. This averaging does not imply that the posterior distribution is normal; when the component means differ, the mixture can be skewed or have more than one mode.

$$ E(\theta_T\mid y_T) =P(B=b\mid y_T)E(\theta_T\mid y_T,B=b) +P(B=r\mid y_T)E(\theta_T\mid y_T,B=r). $$

Worked Calculations

Worked Example: A Single Commensurate Component

Suppose a hypothetical source-informed prior for the target treatment effect is \(N(10,8)\), where effects are measured in percentage points. A hypothetical target estimate is \(y_T=4\) percentage points with known sampling variance \(s_T^2=4\) squared percentage points. Assume the normal sampling model and the stated prior are adequate for this summary-data calculation.

The posterior variance is the reciprocal of the summed precisions:

$$ v_{\text{post}}=\frac{1}{1/8+1/4}=\frac{1}{0.375}=2.667 \quad\text{(squared percentage points)}. $$

The posterior mean is

$$ m_{\text{post}}= \frac{10/8+4/4}{1/8+1/4} =\frac{1.25+1}{0.375} =6.000\quad\text{percentage points}. $$

Thus this component moves the estimate from 4 toward the source-informed prior mean of 10. This calculation describes the consequence of that component alone; it does not establish that the source and target are commensurate. If the prior variance were much larger, the same target likelihood would exert more influence.

Worked Example: Robust Borrowing Under Conflict

Now use a hypothetical mixture with source-informed prior \(\theta_T\mid B=b\sim N(10,8)\), robust component \(\theta_T\mid B=r\sim N(0,100)\), and prior component probabilities \(P(B=b)=0.8\) and \(P(B=r)=0.2\). The target estimate is \(y_T=-2\) percentage points, with sampling variance \(4\) squared percentage points. The normal sampling model and both prior components are assumed for this illustration.

The predictive distributions for the target estimate are \(N(10,12)\) under the source-informed component and \(N(0,104)\) under the robust component. Their densities at \(-2\) are approximately \(0.0002855\) and \(0.03838\), respectively. Bayes’ rule gives

$$ P(B=b\mid -2)= \frac{0.8(0.0002855)} {0.8(0.0002855)+0.2(0.03838)} \approx 0.0289. $$

The component-specific posterior means are

$$ m_b=\frac{10/8+(-2)/4}{1/8+1/4}=2.000,\qquad m_r=\frac{0/100+(-2)/4}{1/100+1/4}=-1.923 \quad\text{percentage points}. $$

The mixture posterior mean is therefore

$$ 0.0289(2.000)+0.9711(-1.923)=-1.810 \quad\text{percentage points (approximately)}. $$

The target estimate is far below the source-informed mean, so the robust component receives most of the posterior weight. The small remaining borrowing weight does not mean that the source data were discarded; it reflects the specified prior probabilities and predictive densities in this particular model.

Worked Example: Sensitivity of the Borrowing Weight

Retain the component distributions and sampling variance from the preceding example, but examine several hypothetical target estimates. For this model, the log posterior odds for the source-informed component are

$$ \log\frac{P(B=b\mid y_T)}{P(B=r\mid y_T)} =\log\frac{w}{1-w} +\frac{1}{2}\log\frac{104}{12} -\frac{(y_T-10)^2}{24} +\frac{y_T^2}{208}. $$

With \(w=0.8\), the prior log odds are \(\log(4)\). Substitution gives the following illustrative weights. Values are rounded; each is obtained by applying the logistic transformation \(1/(1+\exp(-\text{log odds}))\).

Target estimate \(y_T\) (percentage points)Log posterior odds, approximately\(P(B=b\mid y_T)\), approximately
-2-3.51470.0289
0-1.70060.1544
1-0.90420.2882
41.04300.7394
122.99170.9522

For example, at \(y_T=1\), the log odds are \(\log(4)+\tfrac12\log(104/12)-81/24+1/208\approx-0.9042\), giving a borrowing weight of \(0.2882\). At \(y_T=12\), the source-informed component predicts the estimate much better: the densities are approximately \(0.09748\) under \(N(10,12)\) and \(0.01958\) under \(N(0,104)\), giving a posterior weight of \(0.9522\).

Prior sensitivity also matters. At \(y_T=-2\), changing the prior source-component probability from \(0.8\) to \(0.5\) gives weight about \(0.0074\); increasing it to \(0.95\) gives weight about \(0.1239\). The target evidence favors the robust component, but the posterior weight still depends materially on the prior odds. These values are model-based sensitivity results, not a data-independent rule for choosing the mixture probability.

Simulation, Diagnostics, and Failure Modes

A simulation can reveal how the rule behaves across plausible target outcomes. For example, one could generate target estimates from \(N(0,4)\) when the source-informed component is centered at 10, calculate a posterior borrowing weight for each estimate, and summarize the distribution of weights. This deliberately conflicting scenario would show how often sampling variation nevertheless produces estimates that appear more compatible with the source component. A second scenario with target effects near 10 would show the behavior when populations are more similar. Simulations should repeat the full analysis procedure, including any estimation of source uncertainty, rather than treating fitted quantities as known when they would be estimated in practice.

Diagnostics should examine both the model and its consequences. Compare target estimates with component predictive distributions, inspect posterior weights across a reasonable range of prior mixture probabilities and robust-component scales, and report the resulting target posterior estimates and uncertainty. For multi-parameter models, a single scalar weight may not describe borrowing for every parameter; inspect the relevant parameters and predictions. Posterior predictive checks can assess whether the sampling model reproduces important features of the target data, but they do not prove that the source and target are exchangeable.

  • Robust component not sufficiently robust. If it is too narrow or centered in an implausible location, conflicting target data may not receive adequate protection. Vary its scale and center as scientifically justified.
  • Prior odds dominate. With little target information, posterior weights can remain close to prior weights. Report this dependence rather than presenting a weight as if the data determined it alone.
  • Overinterpreting a weight. A posterior weight of 0.8 is not a claim that 80% of the patients, studies, or information were borrowed. It is the posterior probability of a model component under the chosen specification.
  • Ignoring source uncertainty. Plugging in a source estimate as if it were known can make borrowing too strong. A joint model or an appropriately propagated source posterior is needed when source uncertainty is material.
  • Confusing conflict with model failure. A low source-component weight may reflect real population differences, misspecification of the likelihood, or an outlying target estimate. The weight alone cannot distinguish these explanations.

Choosing and Interpreting a Borrowing Strategy

A fixed commensurate normal prior is direct and interpretable when a scientifically defensible amount of between-population difference can be specified. Its limitation is that the degree of borrowing is controlled by the chosen variance: if that variance is too small, discordant target data may be over-shrunk. A robust mixture allows data-adaptive movement between a source-informed and a less informative component, but adds choices about prior mixture probability and the robust component’s distribution. Neither approach removes the need for scientific justification and sensitivity analysis.

These methods differ in emphasis from a conventional hierarchical model, which represents between-population variation through a shared distribution and its heterogeneity parameters. A robust mixture instead makes a specific alternative component available and updates its probability against a source-informed component. The methods can be related or combined, but they encode different assumptions. The choice should be made before interpreting the posterior as evidence for a target-population conclusion.

A defensible analysis states the target estimand, source and target data models, prior component distributions, and prior mixture probabilities. It then reports posterior estimates and uncertainty alongside posterior component weights and sensitivity results. In a drug-development setting, this makes clear both when cross-population evidence is supporting the target estimate and when target data are limiting that support.

Key takeaway: Robust borrowing is conditional on a model, not an automatic safeguard. A commensurate prior controls prior similarity; a robust mixture lets target data update support for source-informed versus less informative components. Interpret borrowing weights together with component assumptions, prior sensitivity, and model diagnostics.

Check Your Understanding

Answer each question using the stated model ideas. Brief solutions follow the questions.

  1. In a commensurate prior \(\theta_T\mid\theta_S,\tau^2\sim N(\theta_S,\tau^2)\), what does decreasing \(\tau^2\) express?
  2. Why does the posterior borrowing weight depend on the predictive densities of the target estimate under both mixture components?
  3. In the robust mixture example, why did \(y_T=-2\) produce a low source-informed posterior weight?
  4. Does a posterior borrowing weight of 0.8 mean that 80% of the target patients’ information came from the source? Explain.
  5. Name two sensitivity analyses that would help evaluate the robustness of a mixture-prior result.

Solutions. (1) It expresses stronger prior belief that the target parameter is close to the source parameter. (2) Bayes’ rule updates component probabilities in proportion to each component’s prior probability times its probability density for the observed target estimate. (3) The estimate was much more probable under the broad robust predictive distribution than under the source-informed predictive distribution. (4) No; it is the posterior probability of a specified model component, not a literal fraction of patients or information. (5) Vary the prior mixture probability and the robust component’s scale or center, then compare posterior estimates and uncertainty.

Clinical Biostats