Why Adjust for Covariates Before Borrowing?
Historical and current control groups can differ in their mix of prognostic characteristics. If those characteristics predict outcome, a difference between the groups’ crude averages may reflect that mix rather than a change in outcomes conditional on covariates. Borrowing historical outcomes without accounting for this distinction can pull an estimate toward an inappropriate benchmark. Covariate adjustment makes the intended comparison explicit: it models outcomes at the same covariate values, then discounts the historical likelihood.
The model does not make historical data exchangeable with current data by itself. It relies on a defensible conditional relationship between covariates and outcomes, and on adequate representation of the relevant covariate values in the historical data. A power-prior discount can reduce the influence of historical information; it cannot repair a poorly chosen covariate set or justify extrapolation.
Model and Assumptions
Let \(y_{Hi}\) and \(y_{Cj}\) denote outcomes for historical and current control participants, and let \(x_{Hi}\) and \(x_{Cj}\) be their covariate vectors. A standard starting point for a continuous outcome is
Here, \(x\) can include an intercept and prespecified prognostic covariates, and \(\beta\) is the common regression-coefficient vector. For the conjugate calculation below, \(\sigma^2\) is treated as known. In practice, covariates should be chosen using clinical knowledge and specified before examining outcome differences that might motivate borrowing. The model assumes independent observations conditional on the covariates and coefficients, a correctly specified conditional mean, and a common conditional outcome relationship across historical and current controls.
A common relationship is a substantive transportability assumption, not a consequence of fitting a regression. It may be implausible if treatment standards, eligibility criteria, measurement procedures, or unmeasured prognostic factors changed. The covariates also need sufficient overlap: the historical data should include participants whose covariate profiles cover those relevant to the current trial. If current participants occupy a region absent from the historical data, the model’s prediction there is extrapolation.
How the Discount Enters the Posterior
Write \(X_H\) and \(X_C\) for the design matrices and \(y_H\) and \(y_C\) for the outcome vectors. For fixed \(a\), the posterior density for \(\beta\) is proportional to its prior density times the current likelihood and the discounted historical likelihood:
This fixed-discount expression is the relevant power-prior update; the earlier material on power priors gives the broader framework. With normal outcomes and known \(\sigma^2\), the historical likelihood is proportional to \(\exp\{-\tfrac{1}{2\sigma^2}(y_H-X_H\beta)^{\mathsf T}(y_H-X_H\beta)\}\). Raising it to \(a\) multiplies its quadratic and linear contributions by \(a\). Thus, historical information is discounted in the regression likelihood, not by first treating a crude historical mean as if it were a current observation.
Suppose the prior is \(\beta\sim N(m_0,V_0)\), with proper covariance matrix \(V_0\). Completing the square gives a multivariate normal posterior with precision matrix \(\Lambda\) and mean \(m\):
To see why, expand each squared residual. The terms involving \(\beta\) in the log posterior are
Collecting quadratic and linear terms yields \(-\tfrac12\beta^{\mathsf T}\Lambda\beta+\beta^{\mathsf T}\Lambda m\), which is the kernel of \(N(m,\Lambda^{-1})\). The current data contribute at full weight; each historical contribution is multiplied by \(a\). At \(a=0\), historical observations contribute no likelihood information. At \(a=1\), they contribute at full likelihood weight under the shared model. These endpoints do not remove the need to assess model fit or compatibility.
Worked Example: A Crude Difference Disappears After Covariate Adjustment
Consider hypothetical control data with a binary prognostic covariate, labelled low-risk or high-risk. The mean score is 60 points in the low-risk group and 50 points in the high-risk group in each data source. Historical controls are 80% low-risk and 20% high-risk; current controls are 20% low-risk and 80% high-risk. Calculate the crude means, then compare the sources at the current trial’s covariate mix.
The historical crude mean is \(0.80(60)+0.20(50)=48+10=58\) points. The current crude mean is \(0.20(60)+0.80(50)=12+40=52\) points. The crude historical mean is therefore 6 points higher, even though the hypothetical conditional means are identical in the two sources at both covariate levels.
Standardizing the historical conditional means to the current mix gives \(0.20(60)+0.80(50)=52\) points. The adjusted historical mean at that mix equals the current mean of 52 points. In this example, the crude difference arises entirely from different covariate distributions. In an actual analysis, conditional means would be estimated with uncertainty; this arithmetic illustrates why regression adjustment must precede borrowing rather than treating the crude difference as a source effect.
Worked Posterior Update
The next hypothetical calculation uses a simplified normal regression with two covariate-basis coefficients, a known reference mean of 50 points, and known residual variance \(\sigma^2=4\) score-points squared. The coefficients describe deviations from that reference mean. The two design columns are orthogonal, so the information matrices are diagonal. A proper prior has mean \((0,0)^{\mathsf T}\) and precision matrix \(\operatorname{diag}(0.01,0.04)\). For this example, the historical cross-product matrix is \(\operatorname{diag}(3,3)\), the current cross-product matrix is \(\operatorname{diag}(2,2)\), and \(a=0.5\). Suppose the corresponding score vectors are \(X_H^{\mathsf T}(y_H-50)/\sigma^2=(1.2,-0.6)^{\mathsf T}\) and \(X_C^{\mathsf T}(y_C-50)/\sigma^2=(1.2,0.8)^{\mathsf T}\). These are hypothetical sufficient-statistic summaries for the regression update.
Worked Example: Discounted Regression Update
First calculate the posterior precision. The historical cross-product contribution is discounted and divided by the variance; the current contribution is divided by the variance without discounting:
The posterior linear term is the prior precision times its mean, plus the discounted historical score and the full current score. The prior term is zero:
Because the precision is diagonal, divide each component of \(h\) by its corresponding precision to obtain the posterior mean:
The posterior variances of the two coefficients are \(1/0.885=1.130\) and \(1/0.915=1.093\), respectively. The associated posterior standard deviations are approximately 1.063 and 1.045 coefficient units. These calculations show the separate roles of covariate adjustment and discounting: the model relates outcomes to covariates, while \(a=0.5\) halves the historical likelihood’s information and score contributions.
Worked Example: Predicting at a Current-Trial Covariate Profile
Use the posterior from the previous calculation to estimate the outcome for a hypothetical new control participant with basis vector \(z=(1,0)^{\mathsf T}\). The conditional mean is the reference mean plus the first coefficient:
The posterior variance for the unknown conditional mean at this profile is \(z^{\mathsf T}\Lambda^{-1}z=1/0.885=1.130\) score-points squared. Its 95% normal posterior credible interval is \(52.034\pm1.96\sqrt{1.130}\), or approximately \([49.95,54.12]\) score points. Conditional on the model and data, this interval has 95% posterior probability of containing the conditional mean at this profile.
For a future individual outcome, residual variation must also be included. Its posterior predictive variance is \(4+1.130=5.130\) score-points squared, so the predictive standard deviation is \(\sqrt{5.130}\approx2.265\) score points. A corresponding 95% normal posterior predictive interval is \(52.034\pm1.96(2.265)\), approximately \([47.59,56.47]\) score points. The predictive interval is wider because it includes both uncertainty about the conditional mean and individual residual variation.
Diagnostics, Alternatives, and Limitations
Before interpreting a borrowed estimate, inspect whether the shared regression is credible in both sources. Useful checks include plotting outcomes against continuous covariates by source, examining residual patterns, checking influential observations, and comparing covariate ranges and combinations across sources. For binary outcomes, the analogous conditional model may be logistic; its powered historical likelihood generally does not yield the normal-model conjugate update shown above. Whatever the outcome model, a poor fit in either source makes the shared conditional relationship questionable.
One direct diagnostic is to compare the estimated conditional relationships across sources before imposing a common coefficient. Large differences may indicate changes in care, outcome ascertainment, or effect modification. Such differences do not automatically identify their cause, but they are a warning against uncritical borrowing. Sensitivity analysis over plausible values of \(a\) is also informative: if conclusions change substantially over a modest range of discounts, the result depends materially on historical information. A discount cannot compensate for severe lack of covariate overlap, since the model may still rely on unsupported extrapolation.
The main alternative is unadjusted borrowing, which combines historical and current outcomes without conditioning on prognostic covariates. It is simpler but can confound source differences in covariate mix with outcome differences. Regression adjustment instead compares outcomes conditional on included covariates, but depends on the chosen functional form and common relationship assumptions. A stratified approach can address categorical covariates by separate groups, but may become unstable when many covariates or sparse groups are involved. Neither regression nor stratification guarantees comparability; each requires adequate data and careful specification.
A further limitation is that a model with a shared \(\beta\) rules out source-specific covariate effects unless those are explicitly added. Adding source interactions may reveal departures from the shared model, but increases model complexity and may be weakly identified when historical and current covariate ranges differ. Covariate adjustment also cannot control differences in unmeasured prognostic factors. The model is most defensible when covariates are measured consistently, are prognostic, are prespecified, and have substantial overlap between sources.
Choose clinically relevant covariates before examining outcome-driven source differences, and state the conditional model and variance assumptions.
Check covariate overlap, measurement consistency, residual fit, and whether a shared conditional relationship is plausible.
Use the current-control likelihood at full weight and multiply the historical log likelihood by the chosen \(a\).
Evaluate conclusions under alternative plausible discounts and distinguish inference about a conditional mean from prediction for an individual outcome.
Check Your Understanding
Answer each question, then compare with the solutions below.
- In the normal regression update, which likelihood contribution is multiplied by \(a\), and which is used at full weight?
- If the historical and current covariate distributions differ but conditional means are equal at every covariate value, what can happen to their crude means?
- In the worked update, recalculate the first posterior precision if the historical discount is changed from \(0.5\) to \(0\).
- Why does the predictive interval for a future individual outcome exceed the interval for the conditional mean?
- Name two problems that regression adjustment does not, by itself, solve.
Solutions. (1) The historical likelihood is raised to \(a\); the current-control likelihood remains at full weight. (2) Crude means can differ because they average the conditional means over different covariate distributions. (3) With \(a=0\), the first precision is \(0.01+2/4=0.510\). (4) Prediction includes residual individual-level variance in addition to posterior uncertainty about the conditional mean. (5) Examples include lack of covariate overlap, an incorrect regression form, unmeasured source differences, and inconsistent covariate measurement.