Tutorials › Bayesian Clinical Trials › Continuous Endpoint Location And Scale Implications

Prior Predictive Checks · Tutorial 79 of 696

Continuous Endpoint Location And Scale Implications

Translate priors on a continuous endpoint’s mean and standard deviation into implied patient values, then assess whether their location, spread, units, and tails are clinically credible.

Intermediate 10 min read

What You'll Learn

  • Distinguish uncertainty about a population mean from patient-to-patient variation.
  • Translate priors on a mean and standard deviation into implications for individual endpoint values.
  • Calculate patient-level prior predictive probabilities when the mean has a normal prior and the standard deviation is fixed.
  • Check whether prior-implied values and scales agree with endpoint units and clinical ranges.
  • Identify problems caused by a normal model for a bounded endpoint or by implausible scale-prior tails.

From Prior Parameters to Patient-Level Values

A prior on a continuous endpoint is often specified through parameters such as a mean and a standard deviation. Those parameters are not themselves patient outcomes: the mean describes the location of the endpoint distribution, while the standard deviation describes variation among patients conditional on the parameters. A prior predictive check asks what values these choices imply before observing trial data. The practical question is whether those values, in the endpoint’s actual units, look clinically credible.

For example, a mean prior centered at a clinically reasonable change does not guarantee that individual values are plausible. A large outcome standard deviation can imply many extreme patient values even when the mean is sensible. Conversely, a very small standard deviation can imply an implausibly homogeneous group. Checking location and scale together is therefore essential.

Model and definitions: Let \(Y_i\) be a continuous endpoint for patient \(i\), measured in a specified unit. Under a normal endpoint model, \(Y_i\mid\mu,\sigma\sim N(\mu,\sigma^2)\), where \(\mu\) is the population mean in that unit and \(\sigma>0\) is the patient-level standard deviation in the same unit. A prior \(\pi(\mu,\sigma)\) expresses uncertainty about these parameters before the trial data are observed. A prior predictive patient value is generated by first drawing \((\mu,\sigma)\) from that prior and then drawing \(Y_i\) from the conditional outcome model.

The conditional model assumes that, given \(\mu\) and \(\sigma\), patients have the specified normal distribution. If the model treats patients as conditionally independent, each patient has that same conditional distribution; this assumption may need to be adjusted for clustering or repeated measurements. The normal model also assigns positive probability to every real value. That support is appropriate only if values outside the clinically possible range are impossible or sufficiently rare under the prior to be negligible for the intended use.

Separating Location, Scale, and Uncertainty

There are two kinds of variation to keep distinct. Conditional on a particular \((\mu,\sigma)\), \(\sigma\) describes patient-to-patient spread. Across prior draws, \(\mu\) and \(\sigma\) can also vary because they are uncertain. Consequently, a patient-level prior predictive distribution can be wider than the outcome distribution for any one fixed parameter draw.

A useful exact result is available when the prior for \(\mu\) is normal and \(\sigma\) is fixed. Write \(\mu\sim N(m_\mu,\tau_\mu^2)\), and suppose \(\epsilon_i\sim N(0,\sigma^2)\) independently of \(\mu\), with \(Y_i=\mu+\epsilon_i\). Then the marginal distribution of one patient’s value is normal:

$$ Y_i\sim N\left(m_\mu,\tau_\mu^2+\sigma^2\right). $$

The mean is \(E(Y_i)=E\{E(Y_i\mid\mu)\}=E(\mu)=m_\mu\). For the variance, the law of total variance gives

$$ \operatorname{Var}(Y_i) =E\{\operatorname{Var}(Y_i\mid\mu)\} +\operatorname{Var}\{E(Y_i\mid\mu)\} =\sigma^2+\tau_\mu^2. $$

This addition of variances is not a rule for adding standard deviations. It combines conditional patient variation with uncertainty in the mean. If \(\sigma\) is uncertain, the marginal distribution is generally a mixture of normal distributions, not necessarily normal. Its variance, when finite, is \(E(\sigma^2)+\operatorname{Var}(\mu)\). A prior with an infinite second moment for \(\sigma\) does not yield a finite patient-level predictive variance, even if its central values appear reasonable.

Worked Example: Checking the Location and Spread of Blood-Pressure Changes

Suppose \(Y_i\) is the reduction in systolic blood pressure from baseline to week 12, measured in mmHg, so a positive value is a reduction. For illustration, take \(\mu\sim N(5,2^2)\) mmHg and fix \(\sigma=10\) mmHg. Assume the normal conditional model and independence between the prior draw of \(\mu\) and the patient-level residual.

The patient-level prior predictive distribution has mean \(5\) mmHg and variance \(2^2+10^2=104\) mmHg\(^2\). Its standard deviation is \(\sqrt{104}=10.20\) mmHg. Thus, although the prior mean is concentrated around a reduction of 5 mmHg, an individual patient’s change is considerably more variable.

Suppose the clinical review team regards changes from \(-20\) to \(40\) mmHg as a plausible range for this check. The probability of an individual value below \(-20\) or above \(40\) under this model is

$$ P(Y_i<-20\ \text{or}\ Y_i>40) =\Phi\left(\frac{-20-5}{\sqrt{104}}\right) +1-\Phi\left(\frac{40-5}{\sqrt{104}}\right) \approx \Phi(-2.451)+1-\Phi(3.432) \approx 0.0071+0.0003=0.0074. $$

So about 0.74% of prior predictive individual values fall outside that stated range. This calculation does not say that the prior assigns a 0.74% probability to a particular parameter value. It describes the model’s implication for a patient outcome after parameter uncertainty is included. A clinical team should decide whether that tail probability is acceptable for the endpoint and purpose, rather than treating any single threshold as universally correct.

Check the Scale Against the Endpoint

A standard deviation is expressed in the same units as the endpoint, not in squared units. Its square is the variance. This makes unit checks an efficient way to catch specification errors: a mean of 18 metres and a standard deviation of 25 metres can be compared directly, while a variance of 625 metres squared cannot be read as a 625-metre patient spread.

For fixed \(\mu\) and \(\sigma\), the normal model places approximately 95% of individual values within \(\mu\pm1.96\sigma\). This is a model-based range for individual outcomes conditional on those parameter values. It is not a 95% interval for \(\mu\), and when parameters have priors it is not automatically a 95% interval for the prior predictive distribution. The distinction matters because uncertainty about the mean adds further spread.

When \(\sigma\) has a prior, examine its typical values and tails in endpoint units. A prior can have a reasonable median yet still put substantial mass on scales that produce extreme patient values. Looking at several prior draws, alongside clinical reference ranges, helps reveal whether the issue is an implausible mean, an implausible scale, or their combination. If \(\mu\) and \(\sigma\) are dependent under the prior, retain that dependence when generating draws; breaking it by sampling each parameter independently changes the implied outcomes.

Worked Example: Scale Implications for a Bounded Pain Score

Consider a pain score \(Y_i\) on a 0-to-10 scale. For illustration, suppose \(\mu=4\) and the prior for \(\sigma\) is lognormal with median 2 points and log-scale standard deviation 0.2. The median and the upper part of the scale prior can be translated into implications for patient values. This example uses a normal outcome model to expose a possible support problem; it does not assume that this is necessarily the best final model for a bounded score.

The central 95% range of \(\sigma\) under this lognormal prior is approximately

$$ \left[\exp\{\log(2)-1.96(0.2)\},\ \exp\{\log(2)+1.96(0.2)\}\right] =[1.35,\ 2.96]\ \text{points}. $$

At the median scale, the conditional probability of an out-of-range score is

$$ P(Y_i<0\ \text{or}\ Y_i>10\mid\mu=4,\sigma=2) =\Phi\left(\frac{0-4}{2}\right)+1-\Phi\left(\frac{10-4}{2}\right) =\Phi(-2)+1-\Phi(3) \approx 0.0241. $$

At the upper end of the central scale range, using \(\sigma=2.96\), the same calculation gives

$$ \Phi\left(\frac{-4}{2.96}\right)+1-\Phi\left(\frac{6}{2.96}\right) \approx \Phi(-1.351)+1-\Phi(2.027) \approx 0.0883+0.0213=0.1096. $$

Thus, at that scale, roughly 11.0% of conditional patient values are outside the possible score range. The prior on \(\mu\) is not the only quantity to inspect: the scale prior can materially affect the frequency of impossible values. Since a pain score cannot be below 0 or above 10, persistent prior predictive mass outside those limits is a diagnostic that the normal model may be unsuitable or needs a carefully justified alternative. Simply reporting a plausible mean would not resolve this problem.

From a Parameter Draw to a Trial Summary

A prior predictive check can also examine whether values generated under a parameter draw would lead to recognisable trial summaries. The goal here is not to calculate a sampling distribution for a trial mean. It is to inspect whether a plausible draw of location and scale produces patient values, and hence an observed group, whose scale and range make clinical sense.

Worked Example: Interpreting a Simulated Group in Metres

Suppose an endpoint is change in six-minute walk distance, measured in metres. For illustration, use \(\mu=18\) metres and \(\sigma=25\) metres for one prior draw, with conditionally normal patient outcomes. One simulated group of six patients is \(4, 25, -7, 39, 12,\) and \(31\) metres. These are hypothetical values, not observations from a real trial.

The group mean is

$$ \bar{x}=\frac{4+25-7+39+12+31}{6} =\frac{104}{6}=17.33\ \text{metres}. $$

The sum of squared deviations from this mean is \(1513.33\) metres squared. Therefore the sample standard deviation is

$$ s=\sqrt{\frac{1513.33}{6-1}} =\sqrt{302.67}=17.40\ \text{metres}. $$

The group mean is near the parameter draw of 18 metres, while its sample standard deviation is below the conditional population scale of 25 metres. With only six patients, that difference is unsurprising; one small simulated group does not need to reproduce \(\sigma\) exactly. The values also include a negative change, which means a decline in walking distance and is possible for a change endpoint. The important diagnostic is to compare the simulated values and summaries with clinically understood units and ranges, not to demand that every small group match the prior parameters.

Diagnostics, Alternatives, and Limitations

Useful checks include plotting prior draws of \(\mu\) and \(\sigma\) on their natural scales, generating patient values using the joint prior, and comparing those values with clinically meaningful limits or reference data. Review both central outcomes and tails. A check that reports only an average can miss an excessive spread; one that reports only a typical \(\sigma\) can miss a prior tail that generates implausible outcomes. When values are generated computationally, confirm that the recorded units and any transformations are reversed correctly before clinical review.

The main alternative to a prior predictive simulation is an analytic calculation. For a normal prior on \(\mu\) and fixed \(\sigma\), the marginal distribution derived above gives exact probabilities for ranges. This is transparent and easy to audit. Simulation is more flexible when \(\sigma\) is uncertain, priors are dependent, or the model is not normal. It can also expose combinations of parameters that deserve review. In either approach, results should be interpreted under the stated model and prior, not as evidence about what the trial will certainly observe.

A normal model may be a useful approximation for an unbounded measurement or a change score, but it can be a poor choice for a naturally bounded, discrete, or strongly skewed endpoint. Alternatives include models whose support matches the endpoint, or transformations that are scientifically justified and interpretable. Those alternatives still require their own prior predictive checks. A model with correct support can remain implausible in its location or spread.

A common mistake is to treat a credible-looking prior mean as sufficient evidence that the continuous endpoint prior is plausible. For example, a mean centered at 4 on a 0-to-10 scale may seem reasonable, but a large \(\sigma\) can still imply many impossible scores. The correction is to inspect the joint implications of location and scale at the patient level, keeping the endpoint’s units and support explicit. Another mistake is to compare a standard deviation directly with a variance or to carry a scale across endpoints with different units; state the unit every time.

Key takeaway: A continuous endpoint prior is credible only insofar as its joint implications for patient values are credible. Translate \(\mu\) and \(\sigma\) into endpoint units, inspect the implied spread and tails, and address support violations before relying on the model.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. If \(\mu\sim N(10,3^2)\) mm and \(\sigma=4\) mm, what is the marginal prior predictive mean and standard deviation for one patient value under the normal model?
  2. A 0-to-100 score is modeled as normal with \(\mu=50\) and \(\sigma=5\). What is the conditional probability that a patient score lies outside the possible range?
  3. Why does a standard deviation of 12 minutes have a different interpretation from a variance of 144 minutes squared?
  4. What changes about the patient-level predictive distribution if \(\sigma\) has a prior instead of being fixed?

Solutions. (1) The predictive mean is \(10\) mm. Its variance is \(3^2+4^2=25\) mm\(^2\), so its standard deviation is \(5\) mm. (2) The lower and upper standardized limits are \((0-50)/5=-10\) and \((100-50)/5=10\). The probability outside the range is \(\Phi(-10)+1-\Phi(10)\), which is approximately zero for practical reporting, though the normal model assigns a nonzero probability. (3) The standard deviation is a typical spread expressed in the original unit, minutes; the variance is the squared spread expressed in minutes squared. (4) The patient-level predictive distribution becomes a mixture over possible scale values and is generally not normal. Its tails and variance depend on the whole scale prior, not just a single typical value.

Clinical Biostats