From Trial Summaries to an Endpoint Comparison
A continuous endpoint comparison should answer a clinically interpretable question: how far apart are the treatment and control arm means, in the units actually measured? A posterior distribution for each arm mean provides the pieces for that comparison. Under a specified normal conjugate model, the update can be calculated from each arm’s sample size and sample mean, then combined to obtain a posterior distribution for the raw mean difference.
This analysis concerns a two-arm, independent-groups trial and a continuous endpoint measured on the same scale in both arms. For the examples, the endpoint is systolic blood pressure at 12 weeks, measured in mmHg, and lower values are favorable. The data and prior information below are hypothetical. The model treats the within-arm variances as known; this is an assumption of the worked analysis, not a claim that a trial generally knows its population variance exactly.
The normal sampling assumption describes the individual outcomes within each arm; under it, the sample mean has distribution \(\bar{x}_j\mid\mu_j\sim N(\mu_j,\sigma_j^2/n_j)\). The analysis uses the sample size and sample mean as the arm’s data summary. In a randomized trial, random assignment supports a between-arm comparison, but it does not itself guarantee normal outcomes, independent observations, or correctly specified variances.
The Conjugate Update for Each Arm
The prior mean \(m_{0j}\) and variance \(v_{0j}\) describe uncertainty about the arm mean before observing this trial’s endpoint data. The sample mean contributes information with variance \(\sigma_j^2/n_j\). Multiplying the normal prior density by the normal sampling density gives a normal posterior. Its precision (the reciprocal of variance) is the sum of the prior precision and the data precision.
Here \(m_j\) and \(v_j\) are the posterior mean and variance, respectively. The posterior mean is a precision-weighted average of the prior mean and the observed sample mean. More participants, or a smaller known outcome variance, increases the data precision and gives the sample mean more weight. A more precise prior gives the prior mean more weight.
Expanding the two squared terms, the coefficient of \(\mu_j^2\) inside the brackets is \(1/v_{0j}+n_j/\sigma_j^2\), and the coefficient of the linear term is \(-2(m_{0j}/v_{0j}+n_j\bar{x}_j/\sigma_j^2)\). Completing the square therefore gives a normal kernel with variance equal to the reciprocal of the total precision and mean equal to that variance times the combined precision-weighted sum. This yields the update above.
Worked Example: Updating the Two Arm Means
Suppose a hypothetical trial has \(n_T=40\) participants in treatment with mean systolic blood pressure \(\bar{x}_T=131\) mmHg, and \(n_C=38\) in control with mean \(\bar{x}_C=134\) mmHg. For this worked model, assume both arms have known outcome variance \(\sigma_T^2=\sigma_C^2=144\ \text{mmHg}^2\), corresponding to a known standard deviation of 12 mmHg. Use independent priors \(\mu_T,\mu_C\sim N(135,400)\), with variances in \(\text{mmHg}^2\).
The specified variance, independent-arm sampling model, and independent normal priors meet the conditions for the conjugate updates. For treatment, the posterior variance and mean are
For control, the corresponding calculation is
Thus the posterior arm distributions are approximately \(N(131.0357,3.5679)\) for the treatment mean and \(N(134.0094,3.7539)\) for the control mean, with means in mmHg and variances in \(\text{mmHg}^2\). The posterior standard deviations are about 1.889 mmHg and 1.937 mmHg, respectively. These quantify uncertainty about the arm means, not variation among individual patients.
Posterior Difference and Uncertainty
Define the raw treatment effect as \(\delta=\mu_T-\mu_C\). Under the model, the two arm posteriors are independent normal distributions. A difference of independent normal random variables is normal: its mean is the difference of their means, and its variance is the sum of their variances. Consequently, the posterior distribution of \(\delta\) is
The posterior standard deviation of the difference, \(\sqrt{v_T+v_C}\), describes its posterior uncertainty in the endpoint’s original units. A central 95% equal-tail credible interval for a normal posterior is its mean plus or minus 1.96 posterior standard deviations. This interval contains 95% of the posterior probability for \(\delta\), conditional on the model, prior, and observed data.
Worked Example: Difference in Mean Blood Pressure
Use the two posterior distributions calculated above. The unrounded posterior means give a treatment-minus-control difference of approximately \(131.0357-134.0094=-2.9737\) mmHg. The posterior variance and standard deviation of the difference are
Therefore, the posterior distribution is approximately \(N(-2.9737,7.3218)\), where the first parameter is in mmHg and the second is in \(\text{mmHg}^2\). Its central 95% credible interval is
Conditional on the specified model and data, the posterior probability that the treatment mean is lower is \(P(\delta<0\mid\text{data})\). Standardizing the posterior difference gives
The analysis assigns about 86.4% posterior probability to a lower treatment-arm mean. The 95% credible interval includes zero, so the posterior also retains probability for a small mean difference in the opposite direction. Neither statement says that the probability of a null hypothesis is 86.4%, or that the interval has a 95% chance of containing a fixed parameter after the data are observed.
Worked Example: Probability of a Clinically Relevant Reduction
Suppose clinicians regard a reduction of at least 5 mmHg as a meaningful treatment benefit. Since lower blood pressure is favorable and \(\delta=\mu_T-\mu_C\), this event is \(\delta\leq-5\) mmHg. With the posterior distribution from the preceding calculation,
Thus, under the model and prior, the posterior probability that the treatment mean is at least 5 mmHg lower than the control mean is about 22.7%. This is a threshold probability in the original clinical units; it is distinct from the probability of any reduction, which was about 86.4%. A clinical threshold should be selected for substantive reasons rather than chosen after seeing which value gives the most favorable probability.
Assumptions, Diagnostics, and Alternatives
Before interpreting the results, check whether the model describes the design and endpoint adequately. The independent-arm calculation is inappropriate if the observations are paired or otherwise dependent in a way the model ignores. Repeated measurements from one participant, clustering by site, or shared family membership may require a model that represents the dependence. The normal likelihood and known variance also need to be defensible for the endpoint and sample sizes. With small samples, pronounced skewness or influential outliers can make the normal summary model a poor description.
The prior deserves a check as well. A prior mean of 135 mmHg with standard deviation 20 mmHg is broad relative to the assumed standard deviation of an individual outcome, but it may still affect the result. Compare its implications with plausible clinical ranges and consider whether reasonable changes to its mean or variance would materially change the posterior. If variance is not known, using a known-variance update without justification understates the uncertainty in the variance; a model that estimates variance, such as the shared-unknown-variance approach, is an alternative. A paired endpoint needs a model for within-person differences, not two independent arm updates.
The raw mean difference is often preferable when the endpoint scale is clinically meaningful: it directly states the estimated contrast in mmHg, points, or another recorded unit. A standardized mean difference expresses a contrast relative to a standard deviation and can help compare effects measured on different scales, but it no longer reports the change in the original clinical units. The present analysis deliberately reports the raw contrast and does not replace the endpoint with a standardized effect.
This conjugate analysis is compact and transparent, but its simplicity is also a limitation: it conditions on a chosen normal likelihood, known variances, a particular prior, and complete observed endpoint summaries. It does not by itself address missing outcomes, nonadherence, multiplicity, baseline adjustment, or treatment-policy choices about the estimand. Such features should be handled by a model and analysis plan that explicitly represent them, rather than assumed away by the algebra of the normal update.
Check Your Understanding
Use the model and hypothetical trial results in this tutorial. Solutions follow the questions.
- Under the model, what is the posterior variance of an arm mean when its prior variance is \(v_0\), its sample size is \(n\), and its known outcome variance is \(\sigma^2\)?
- What is the direction and unit of \(\delta\) in the blood-pressure example?
- Why are the posterior variances added to obtain the difference variance?
- Interpret the 22.7% threshold probability without making a frequentist or causal overstatement.
- Name one reason the independent known-variance normal model may be unsuitable for a real trial endpoint.
Solutions. (1) The posterior variance is \(v=(1/v_0+n/\sigma^2)^{-1}\), the reciprocal of prior precision plus data precision. (2) \(\delta=\mu_T-\mu_C\), in mmHg; a negative value means lower mean blood pressure in treatment. (3) The arm posterior means are independent under the specified model, so the variance of their difference is \(v_T+v_C\). (4) Conditional on the model, prior, and data, there is about 22.7% posterior probability that the treatment mean is at least 5 mmHg lower than the control mean. This is not a probability that the null hypothesis is true. (5) Examples include paired or clustered observations, strong skewness or outliers with small samples, or an unknown variance that should be estimated rather than treated as known.