Why Information Borrowing Needs Interpretation
A joint model can use observations from one endpoint to improve estimation or prediction for another. This is especially attractive when one endpoint is measured often and another is sparse. But a narrower interval for the sparse endpoint does not, by itself, show that borrowing was appropriate. The gain depends on the model’s link between endpoints: a shared parameter, a shared latent effect, or another specified dependence structure.
The practical question is therefore not simply whether the endpoints are associated. It is which quantities are shared, how strongly they are linked, and what assumptions make information transfer valid. If the link is too restrictive, precision can increase while estimates become less representative of the sparse endpoint.
Where the Borrowing Comes From
With a shared parameter, the model constrains two endpoint processes to depend on a common quantity. Data from either endpoint can then inform that quantity, and consequently affect estimates for both endpoints. Exact sharing is a strong assumption: if an exposure-effect parameter is identical across endpoints, the model does not allow the endpoints to have different values of that effect.
With partial pooling, endpoint-specific parameters are allowed to differ, but their differences are modeled as coming from a shared distribution. One endpoint informs the distribution, and thereby the estimate for another, without forcing equality. The strength of borrowing depends on the modeled between-endpoint variation: less variation implies tighter linkage and generally more borrowing.
With a shared latent effect, observations from one endpoint can inform an individual’s latent state or random effect, which also enters the other endpoint’s model. This can improve estimates of that latent quantity and predictions for a sparsely observed endpoint. The earlier material on shared random effects, latent disease states, and joint likelihoods provides the relevant model structures; here the emphasis is on interpreting the resulting information transfer.
These mechanisms are not interchangeable. Shared parameters link population-level effects; shared random effects can link individual-level departures; residual dependence links outcomes after modeled effects are accounted for. A model may use more than one mechanism, but each link needs a substantive and statistical justification.
Quantifying Partial Pooling
Consider a simple normal approximation for two endpoint-specific treatment effects, \(\theta_A\) and \(\theta_B\). Suppose endpoint A has estimate \(\hat{\theta}_A\) with standard error \(s_A\), and endpoint B has estimate \(\hat{\theta}_B\) with standard error \(s_B\). Model the difference between the true endpoint effects as \(\theta_B\mid\theta_A\sim N(\theta_A,\tau^2)\). For this illustration, treat \(\tau^2\) as known. The predictive distribution for endpoint B, conditional on the data for A, has mean \(\hat{\theta}_A\) and variance \(V_A=s_A^2+\tau^2\): it includes uncertainty in A’s estimate as well as the allowed difference between endpoints. If the two endpoint likelihood approximations are independent conditional on their effects, then B’s own estimate contributes variance \(s_B^2\).
The posterior distribution for \(\theta_B\) is normal. Its precision is the sum of the predictive precision from A and the likelihood precision from B. Completing the square gives the posterior mean as a precision-weighted average:
Thus, A’s contribution grows when its predictive variance \(V_A\) is small, while B’s own estimate carries more weight when its standard error is small. As \(\tau^2\) increases, \(V_A\) increases and borrowing weakens. In the limit \(\tau^2\to\infty\), B’s estimate is effectively unpooled. In the limit \(\tau^2\to0\), the model approaches a common effect, though A’s estimate uncertainty still matters.
In this normal model, the posterior variance can be compared directly with \(s_B^2\), the variance from B’s own likelihood approximation. That comparison quantifies model-based precision gain. It should not be treated as a universal conversion to “effective sample size”: outside simple models, the relation between variance and sample size depends on the likelihood and parameterization.
Worked Example: A Sparse Endpoint Gains Precision
Suppose, hypothetically, endpoint A has an estimated treatment effect of 1.20 units with standard error 0.20 units. Endpoint B is sparse, with estimate 2.00 units and standard error 0.50 units. Assume the normal partial-pooling model above, with \(\tau=0.30\) units. The model’s between-endpoint variation is treated as known for this calculation.
The predictive variance for B based on A is \(V_A=s_A^2+\tau^2=(0.20)^2+(0.30)^2=0.04+0.09=0.13\) units squared. Its precision is \(1/0.13=7.6923\) per unit squared. B’s own variance is \(s_B^2=(0.50)^2=0.25\) units squared, giving precision \(1/0.25=4.0000\) per unit squared.
The borrowing weight on A’s predictive information is \(7.6923/(7.6923+4.0000)=7.6923/11.6923\approx0.6579\). The weight on B’s own estimate is the complement, approximately \(0.3421\). The posterior mean is therefore \((7.6923\times1.20+4.0000\times2.00)/11.6923 =(9.2308+8.0000)/11.6923\approx1.474\) units.
The posterior variance is \(1/11.6923\approx0.08553\) units squared, so the posterior standard deviation is \(\sqrt{0.08553}\approx0.2924\) units. Compared with B’s own variance of 0.25 units squared, this is a reduction of \(1-0.08553/0.25\approx0.6579\), or about 65.79%. This is a conditional, model-based precision gain, not proof that B’s true effect is close to A’s.
Borrowing Through a Shared Latent Effect
The same principle can operate at the individual level. For a transparent calculation, suppose an individual has latent effect \(U\sim N(0,1)\). Endpoint A measures \(U\) with error variance 0.25, and endpoint B measures \(U\) with error variance 1. The measurement errors are independent conditional on \(U\), and the measurement scales and loadings are assumed known. In a real application, those assumptions and the suitability of a normal latent-effect model need assessment.
Worked Example: An Endpoint A Observation Refines a Latent Effect
For a hypothetical individual, suppose the observed endpoint values are \(A=1.00\) and \(B=1.40\), with \(A\mid U\sim N(U,0.25)\) and \(B\mid U\sim N(U,1)\). The prior precision for \(U\) is \(1/1=1\). A’s measurement contributes precision \(1/0.25=4\), and B’s contributes precision \(1/1=1\).
Using normal-normal updating, the posterior precision after both observations is \(1+4+1=6\), so the posterior variance is \(1/6\approx0.1667\). The posterior mean is \((0\times1+1.00\times4+1.40\times1)/6=5.40/6=0.9000\).
If only B were observed, the posterior precision would be \(1+1=2\), the variance would be \(1/2=0.5000\), and the mean would be \((0\times1+1.40\times1)/2=0.7000\). In this model, A’s observation adds information about the latent effect that also enters B’s process. The posterior variance for \(U\) is smaller, but that gain is justified only if the shared-effect and conditional-independence assumptions are credible.
This example is deliberately simple. In a nonlinear binary or count endpoint model, integrating over a shared latent effect can make the likelihood and posterior non-normal. The direction and magnitude of information transfer then depend on the link function, the latent-effect distribution, the endpoint-specific loadings, and which observations are available. A shared effect does not mean that one endpoint’s observed value can be substituted directly for the other’s.
When Borrowing Misleads
Borrowing is useful when the endpoint link is scientifically defensible and the data support its strength. It can mislead when the model imposes an overly tight link, when the shared structure is wrong, or when the apparent precision gain hides endpoint-specific differences. Sparse data make this especially important: a small amount of endpoint-specific evidence may be overwhelmed by a strong borrowing assumption.
Worked Example: A Precise Estimate Can Be Pulled Too Far
Keep the hypothetical standard errors and \(\tau=0.30\) units from the previous partial-pooling example, but suppose B’s estimate is now 3.00 units rather than 2.00 units. A remains at 1.20 units. The two estimates differ by \(3.00-1.20=1.80\) units. Under the model, the standard deviation of their difference is \(\sqrt{0.13+0.25}=\sqrt{0.38}\approx0.6164\) units, so the discrepancy is about \(1.80/0.6164\approx2.920\) standard deviations.
The partial-pooling estimate for B is \((7.6923\times1.20+4.0000\times3.00)/11.6923 =(9.2308+12.0000)/11.6923\approx1.816\) units. The model has moved B substantially toward A, even though B’s estimate is appreciably different. Under complete pooling, the common-effect estimate would be \((1.20/0.04+3.00/0.25)/(1/0.04+1/0.25) =(30+12)/(25+4)=42/29\approx1.448\) units. With no borrowing, B remains at 3.00 units. These different answers reflect different assumptions, not competing calculations of the same model.
The discrepancy is a warning to investigate the endpoint relationship, not a formal test of dependence or independence. In particular, do not report the narrower posterior standard deviation as reassuring without checking whether the assumed \(\tau\), endpoint-specific effects, and likelihood approximations are plausible.
Diagnostics, Comparisons, and Limits
Interpret borrowing by examining both the estimate and its uncertainty under reasonable alternative assumptions. The following checks help distinguish a stable precision gain from one driven by a fragile link:
- Compare borrowed and unborrowed results. Report how the endpoint estimate changes when its own data are analyzed without cross-endpoint information, and how it changes under weaker and stronger pooling. A large shift signals sensitivity to the borrowing structure.
- Inspect endpoint discrepancies. Compare endpoint-specific estimates and their uncertainty on a common, interpretable scale. Large discrepancies may indicate genuine endpoint differences, an unsuitable shared structure, or simply imprecise estimates; sparse data alone cannot distinguish these explanations.
- Assess the link parameters. If between-endpoint variation or latent-effect loadings are estimated, determine whether the data identify them adequately. Treating a weakly informed variance as known can make the reported gain look more certain than warranted.
- Check model fit and predictions. Examine whether the joint model can reproduce relevant endpoint patterns and whether predictions for the sparse endpoint are plausible. A model that fits one endpoint but systematically misses the other has not earned its precision gain.
- Account for uncertainty in the borrowing structure. The numerical example treated \(\tau^2\) as known. In practice, uncertainty in variance components and other shared parameters must be represented; plugging in an estimated value can understate uncertainty, particularly with few endpoints or sparse data.
The main alternatives are no borrowing, which estimates each endpoint separately; complete pooling, which enforces equality of a parameter; and partial pooling, which allows differences governed by a shared distribution. A joint model with shared latent effects is another option when the scientific mechanism is individual-level dependence rather than equality or exchangeability of endpoint parameters. Separate fits avoid cross-endpoint assumptions but can be imprecise. Complete pooling can be efficient when equality is credible but biased for an endpoint that differs. Partial pooling is more flexible, but its flexibility does not remove the need to validate the assumed distribution of differences.
Even when a borrowing model is appropriate, the gain is specific to the modeled estimand and data structure. It does not establish that changing one endpoint will causally change another, and it does not guarantee improved prediction in a new population. Conclusions should state which endpoint supplied information, through what modeled link, and how sensitive the target estimate was to that link.
Check Your Understanding
Answer each question, then compare with the solutions below.
- In the normal partial-pooling model, what happens to borrowing from endpoint A as \(\tau^2\) becomes very large?
- Suppose endpoint B’s own estimate has variance 0.25 units squared and the predictive variance from endpoint A is 0.25 units squared. What weight does each source receive in the posterior mean?
- In the shared-latent-effect example, why does observing A change inference about B?
- Why is a smaller posterior standard deviation not sufficient evidence that cross-endpoint borrowing is appropriate?
Solutions. (1) The predictive variance \(V_A=s_A^2+\tau^2\) grows, so A’s precision \(1/V_A\) approaches zero and borrowing vanishes. (2) The precisions are equal, so each source receives weight \(1/(1+1)=0.5000\). (3) Both measurements depend on the same latent \(U\); under the assumed conditional-independence model, A informs \(U\), which is also in B’s model. (4) The smaller standard deviation is conditional on the modeled link. If that link is wrong or too restrictive, the estimate may be overly precise and misleading.