Tutorials › Bayesian Clinical Trials › Priors for Baseline Event Probabilities

Choosing and Eliciting Priors · Tutorial 51 of 696

Priors for Baseline Event Probabilities

Learn to choose and check a beta prior for the control-arm event probability, and see how baseline-risk uncertainty differs from uncertainty about the treatment effect.

Intermediate 10 min read

What You'll Learn

  • Define the control-arm event probability for a specified endpoint and follow-up period.
  • Translate a plausible prior mean and standard deviation into beta parameters.
  • Check a prior through its support, spread, tails, and predictive implications.
  • Distinguish uncertainty about baseline risk from uncertainty about a treatment contrast.
  • Recognize when a beta prior or its underlying clinical assumptions may be unsuitable.

Baseline risk is a separate quantity to specify

In a trial with a binary endpoint, the control-arm event probability is the risk of that event under the control strategy over a stated follow-up period. It is not the treatment effect: it describes the reference arm, while a treatment effect compares outcomes between arms. Specifying baseline risk matters because it sets the expected number of control events and can affect the absolute size of a treatment benefit, even when the relative treatment effect is unchanged.

Here \(p_C\) denotes the control-arm event probability. The definition depends on the endpoint, the control strategy, the population, and the follow-up period. For example, a 30-day event probability and a one-year event probability are different quantities and should not be assigned the same prior without a substantive reason.

Definition: A beta prior for the control-arm event probability is \(p_C\sim\mathrm{Beta}(a_C,b_C)\), where \(a_C>0\), \(b_C>0\), and \(0<p_C<1\). Its density is proportional to \(p_C^{a_C-1}(1-p_C)^{b_C-1}\). The prior mean is \(a_C/(a_C+b_C)\), and the prior variance is \(a_Cb_C/[(a_C+b_C)^2(a_C+b_C+1)]\).

The beta distribution is useful because it has support on probabilities and is conjugate to the binomial likelihood. Its two parameters can describe many shapes: mass near low risks, near high risks, around an interior value, or spread broadly across the unit interval. A beta prior is not automatically suitable merely because the parameter is a probability. The chosen distribution must also represent plausible uncertainty for this particular control strategy and endpoint.

Choose the prior by its clinical implications

Start by making the target precise. Name the event, control arm, population, and time horizon. Then identify a plausible central risk and a defensible degree of uncertainty. A prior mean and standard deviation are one convenient way to express those judgments. If the intended prior mean is \(m\) and prior variance is \(v\), define \(k=a_C+b_C\). Since \(m=a_C/k\) and \(v=m(1-m)/(k+1)\), solving gives:

$$ k=\frac{m(1-m)}{v}-1,\qquad a_C=mk,\qquad b_C=(1-m)k. $$

This parameterization is possible for a nondegenerate beta distribution when \(0<m<1\) and \(0<v<m(1-m)\). The upper bound is the variance of a Bernoulli variable with mean \(m\); a beta distribution with positive parameters has variance strictly below it. If elicited summaries violate these conditions, they cannot be matched exactly by a beta prior.

The sum \(a_C+b_C\) controls concentration: for a fixed mean, a larger sum gives a tighter distribution. The parameters are sometimes informally described as prior event and non-event counts, but they need not represent actual observed patients. In particular, external data may differ in population, follow-up, or control care, so treating them as literal counts can overstate how directly they inform the trial.

Worked Example: Matching a Mean and Standard Deviation

Suppose a hypothetical trial concerns a specified event by 90 days in its control arm. The design team wants a prior mean risk of 0.20 and a prior standard deviation of 0.08. Find the beta parameters and check the resulting moments.

The variance is \(v=0.08^2=0.0064\), and \(m=0.20\). Thus,

$$ k=\frac{0.20(1-0.20)}{0.0064}-1 =\frac{0.16}{0.0064}-1 =25-1=24. $$

Therefore \(a_C=mk=0.20(24)=4.8\), and \(b_C=(1-m)k=0.80(24)=19.2\). The proposed prior is \(p_C\sim\mathrm{Beta}(4.8,19.2)\). Its mean is \(4.8/(4.8+19.2)=0.20\), and its variance is \(0.20(0.80)/(24+1)=0.0064\), giving standard deviation \(0.08\). The parameters encode the specified mean and spread; they do not assert that 4.8 events and 19.2 non-events were observed.

Moment matching is a starting point, not a complete validation. Inspect the implied distribution, especially where its tails lie relative to clinically plausible risks. If judgments are instead expressed as quantiles or ranges, a beta distribution can be calibrated numerically, but the resulting fit still needs to be checked against the intended beliefs. A convenient parameterization cannot rescue summaries that are internally inconsistent or a distribution shape that puts implausible probability on important regions.

Check implications through prediction

A useful diagnostic is the prior predictive distribution: what outcomes does the model imply before trial data are observed? For a control group of size \(n_C\), assume conditionally independent binary outcomes with a common probability \(p_C\):

$$ Y_C\mid p_C\sim\mathrm{Binomial}(n_C,p_C),\qquad p_C\sim\mathrm{Beta}(a_C,b_C). $$

Here \(Y_C\) is the number of control-arm events. Averaging over the prior gives a beta-binomial predictive distribution. For example, the probability of observing no events is the expectation of \((1-p_C)^{n_C}\) under the beta prior. Checking such probabilities can expose a prior that seems reasonable by its mean but assigns too much probability to outcomes that would be surprising clinically or operationally.

Worked Example: Predicting No Events in a Small Control Group

For a hypothetical endpoint, suppose the prior is \(p_C\sim\mathrm{Beta}(2,8)\), and consider a control group of five participants. Calculate the prior predictive probability of observing zero events.

Conditional on \(p_C\), the probability of zero events is \((1-p_C)^5\). Integrating over the prior gives:

$$ P(Y_C=0) =E[(1-p_C)^5] =\frac{B(2,8+5)}{B(2,8)} =\frac{8}{10}\frac{9}{11}\frac{10}{12}\frac{11}{13}\frac{12}{14} =\frac{72}{182} \approx 0.3956. $$

Thus the prior predictive probability of no events among five control participants is about 39.6%. The prior mean risk is \(2/(2+8)=0.20\), so the prior expected event count is \(5(0.20)=1\), but an expected count of one does not mean that exactly one event is likely to occur. This calculation checks a feature of the full prior predictive distribution, not just its mean.

The derivation also gives the general conjugate update. If \(y_C\) events are observed among \(n_C\) conditionally independent control participants, the likelihood is proportional to \(p_C^{y_C}(1-p_C)^{n_C-y_C}\). Multiplying by the beta prior kernel yields:

$$ p_C\mid Y_C=y_C \sim\mathrm{Beta}(a_C+y_C,\ b_C+n_C-y_C). $$

This result depends on the stated binomial model: the endpoint is binary, the number followed is defined, and participants have a common event probability conditional on \(p_C\), with outcomes conditionally independent. If risks vary systematically across participants, sites, or follow-up times, a single binomial probability may be an inadequate description. The prior-predictive check should therefore consider whether the model as well as the prior is plausible.

Baseline uncertainty is not treatment-effect uncertainty

A prior for \(p_C\) describes uncertainty about the control risk. A prior for a treatment contrast describes uncertainty about how the treatment changes risk relative to control. These are distinct quantities, even though they jointly determine the risks in a two-arm trial. A narrowly specified treatment effect does not imply a precisely known control risk; likewise, a well-known baseline risk does not settle the treatment effect.

Worked Example: The Same Relative Effect at Different Baseline Risks

For illustration, suppose a hypothetical treatment has a fixed risk ratio of 0.80, so that \(p_T=0.80p_C\), where \(p_T\) is the treatment-arm event probability. Compare control risks of 0.10 and 0.30. The risk ratio is held fixed to isolate the role of baseline risk.

At \(p_C=0.10\), the treatment risk is \(p_T=0.80(0.10)=0.08\). The absolute risk reduction is \(p_C-p_T=0.10-0.08=0.02\), or 2 percentage points. At \(p_C=0.30\), \(p_T=0.80(0.30)=0.24\), and the absolute risk reduction is \(0.30-0.24=0.06\), or 6 percentage points. Both scenarios have the same relative effect, but different absolute effects because the baseline risks differ.

Now suppose, purely for illustration, that \(p_C\sim\mathrm{Beta}(4.8,19.2)\), with mean 0.20 and standard deviation 0.08, while the risk ratio remains fixed at 0.80. Since \(p_T=0.80p_C\), the prior mean treatment risk is \(0.80(0.20)=0.16\); the expected absolute risk reduction is \(0.20-0.16=0.04\), or 4 percentage points. Its standard deviation is \(0.20(0.08)=0.016\), or 1.6 percentage points, because the reduction is \(0.20p_C\). In this example the uncertainty in the absolute reduction comes from baseline-risk uncertainty, not from uncertainty in the risk ratio. A real model would need to specify uncertainty in both quantities and check that their joint specification is coherent.

This distinction matters for design and interpretation. Baseline risk influences expected control events and, for a given relative effect, the absolute event difference. Treatment-effect uncertainty concerns the contrast itself. When both are uncertain, a trial analysis should not silently substitute one for the other or present a baseline prior as though it were a prior on efficacy.

Diagnostics, alternatives, and limitations

Before using a baseline beta prior, check the assumptions and implications systematically:

  • Confirm the estimand. The event definition, arm, population, and follow-up horizon must match the probability being assigned a prior.
  • Inspect support and tails. A beta prior assigns probability only between 0 and 1, but it may still assign too much probability near zero or one, or in clinically implausible regions.
  • Check predictive outcomes. Consider plausible control event counts at the planned sample size, including zero or unusually high counts when relevant.
  • Question transportability and homogeneity. Differences between the planned trial and the sources informing prior beliefs may make a single exchangeable control risk questionable.
  • Check the model-data fit. If control outcomes show substantial variation across sites or patient subgroups beyond what a common-risk binomial model can represent, changing the beta prior alone does not resolve the model mismatch.

A fixed baseline risk is a simpler alternative when the risk can reasonably be treated as known, but it ignores uncertainty and can make downstream quantities appear too precise. A beta prior allows uncertainty while preserving the probability bounds and yields a simple update under the binomial model. Other probability-scale priors are possible; earlier material on Jeffreys priors and parameterization explains why a uniform density is not a parameterization-free default. Choosing among these approaches should be guided by the intended prior beliefs and model, not by convenience alone.

A beta prior is limited by its shape and by the assumptions of a single probability. It does not by itself account for participant-level risk predictors, site variation, changing hazards, or unequal follow-up. Those features require an appropriate model, not merely a different choice of \(a_C\) and \(b_C\). Nor should a prior be made artificially precise simply to represent a large external data set: differences in setting can make those data less informative for the trial’s target risk.

Common pitfall: “The expected control event rate is 20%, so baseline risk is known to be 20%.” A prior mean is a center of uncertainty, not certainty about the parameter. For example, \(\mathrm{Beta}(4.8,19.2)\) has mean 0.20 and standard deviation 0.08. Use the distribution, including its spread and predictive implications, when describing uncertainty.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A hypothetical control-risk prior has mean \(m=0.10\) and standard deviation 0.03. What beta parameters match these moments?
  2. For \(p_C\sim\mathrm{Beta}(2,8)\), what is the prior mean? What does it say, and what does it not say?
  3. With a fixed risk ratio of 0.75, calculate the treatment risk and absolute risk reduction when the control risk is 0.20.
  4. Name two assumptions behind the beta-binomial prior predictive calculation and one way to diagnose a possible mismatch.

Solutions. (1) \(v=0.03^2=0.0009\), so \(k=0.10(0.90)/0.0009-1=100-1=99\). Thus \(a_C=0.10(99)=9.9\) and \(b_C=0.90(99)=89.1\). (2) The mean is \(2/(2+8)=0.20\). It is the prior expected control risk, not a claim that the risk is known exactly to be 0.20. (3) \(p_T=0.75(0.20)=0.15\), so the absolute risk reduction is \(0.20-0.15=0.05\), or 5 percentage points. (4) Assumptions include binary outcomes and conditionally independent observations sharing one control-arm probability. Inspecting prior predictive event counts can reveal implausible implications; systematic variation across sites may also indicate that a common-risk model is inadequate.

Clinical Biostats