Tutorials › Bayesian Clinical Trials › Baseline-Risk And Treatment-Effect Dependence

Prior Predictive Checks · Tutorial 86 of 696

Baseline-Risk And Treatment-Effect Dependence

Learn to specify and check a joint prior for baseline event risk and treatment effect, including its support, induced arm-level predictions, and clinical implications.

Intermediate 12 min read

What You'll Learn

  • Define baseline event risk and treatment effect on the risk-difference scale.
  • Check the joint support needed to keep both arm risks between zero and one.
  • Explain how dependence changes joint predictions even when marginal priors are unchanged.
  • Calculate prior predictive means, variances, and covariances for binary trial outcomes.
  • Recognize when an independent prior or a chosen dependence pattern implies implausible outcomes.
  • Compare risk-difference and log-odds-ratio parameterizations for prior checking.

Why Dependence Matters

A prior for a treatment effect is not always independent of the prior for baseline risk. For a binary clinical endpoint, the expected event rate in the treatment arm depends jointly on the control-arm event risk and the treatment effect. If a prior makes these quantities dependent, the resulting joint predictions can differ substantially from those under independent priors—even when the marginal prior distributions for each quantity are the same.

This matters because clinical judgments often concern combinations: for example, whether a large treatment benefit is plausible when untreated risk is high, or whether treatment is allowed to increase risk in patients with low baseline risk. Checking the two marginals separately cannot answer those questions. The joint prior and the trial outcomes it generates must be examined together.

Definition: Let \(p_C\) be the event probability in the control arm and \(p_T\) the event probability in the treatment arm. On the risk-difference scale, define the treatment effect as \(\Delta=p_T-p_C\). Thus \(\Delta<0\) indicates fewer events under treatment, and \(\Delta>0\) indicates more events under treatment. A joint prior for \((p_C,\Delta)\) induces a prior for \(p_T=p_C+\Delta\).

For this tutorial, consider a binary endpoint measured over a specified follow-up period. Conditional on the arm-specific event probabilities, the event counts in two randomized arms are modeled as independent binomial counts: \(Y_C\mid p_C\sim\operatorname{Binomial}(n_C,p_C)\) and \(Y_T\mid p_T\sim\operatorname{Binomial}(n_T,p_T)\). A prior predictive check draws the parameters from their joint prior and then generates outcomes from these sampling models. The arm outcomes are independent conditional on the parameters, but they need not be independent after averaging over prior uncertainty.

Support and Dependence on the Risk-Difference Scale

Because probabilities must lie between zero and one, a risk-difference model requires \(-p_C\leq\Delta\leq1-p_C\). This is a joint constraint: the allowable treatment effect depends on the baseline risk. A prior that gives plausible separate values to \(p_C\) and \(\Delta\) can still assign positive probability to impossible pairs.

$$ 0\leq p_C\leq1,\qquad -p_C\leq\Delta\leq1-p_C,\qquad p_T=p_C+\Delta\in[0,1]. $$

Dependence is a property of the joint distribution, not simply a verbal belief that the parameters are “related.” For example, the prior correlation between \(p_C\) and \(\Delta\) summarizes linear association on those scales, but it does not fully describe nonlinear dependence or determine whether the joint support is valid. Also, a correlation can change when the effect is expressed on another scale. Clinical interpretation should therefore accompany any correlation summary.

Worked Example: Dependence Changes the Distribution of Treatment Risk

Suppose a hypothetical joint prior assigns probability one half to each of two parameter pairs: \((p_C,\Delta)=(0.10,-0.02)\) and \((0.40,-0.08)\). Both pairs satisfy the support constraint. Calculate the prior means and variances of the arm risks, and describe the dependence.

The induced treatment risks are \(p_T=0.10-0.02=0.08\) and \(p_T=0.40-0.08=0.32\). Therefore,

$$ E(p_C)=\frac{0.10+0.40}{2}=0.25,\qquad E(\Delta)=\frac{-0.02-0.08}{2}=-0.05,\qquad E(p_T)=\frac{0.08+0.32}{2}=0.20. $$

The deviations from the means for \(p_C\) are \(-0.15\) and \(0.15\); those for \(\Delta\) are \(0.03\) and \(-0.03\). Hence

$$ \operatorname{Var}(p_C)=0.0225,\quad \operatorname{Var}(\Delta)=0.0009,\quad \operatorname{Cov}(p_C,\Delta) =\frac{(-0.15)(0.03)+(0.15)(-0.03)}{2}=-0.0045. $$

The correlation is \(-0.0045/\sqrt{0.0225(0.0009)}=-1\): in this deliberately simple two-point prior, higher baseline risk is paired with a more negative risk difference. The treatment risk has variance \(0.0144\), because its two possible values, 0.08 and 0.32, are each 0.12 from its mean. The negative covariance reduces its variation compared with an independent pairing of the same marginal values.

What the Dependence Does to Prior Predictive Outcomes

Dependence can affect the spread and pairing of potential arm outcomes without changing either arm’s prior mean. Since \(p_T=p_C+\Delta\), linearity of expectation gives \(E(p_T)=E(p_C)+E(\Delta)\) whenever the expectations exist. But the treatment-risk variance includes a covariance term:

$$ \operatorname{Var}(p_T) =\operatorname{Var}(p_C)+\operatorname{Var}(\Delta) +2\operatorname{Cov}(p_C,\Delta). $$

This identity follows by expanding the variance of a sum. It shows directly why the sign and size of the dependence matter. A negative covariance reduces variation in treatment risk; a positive covariance increases it. Neither direction is automatically clinically appropriate.

The same issue appears in paired arm predictions. By \(p_T=p_C+\Delta\),

$$ \operatorname{Cov}(p_C,p_T) =\operatorname{Var}(p_C)+\operatorname{Cov}(p_C,\Delta). $$

Consequently, a negative association between baseline risk and treatment effect does not necessarily imply a negative association between the two arm risks. In the example above, \(\operatorname{Cov}(p_C,p_T)=0.0225-0.0045=0.018\), which is positive. High-risk settings still tend to have higher treatment-arm risks, even though the risk difference becomes more negative as baseline risk rises.

Worked Example: A Marginally Plausible Prior Can Have Impossible Pairs

Consider hypothetical marginal priors that each put equal probability on \(p_C=0.05\) or \(0.50\), and on \(\Delta=0.02\) or \(-0.20\). A proposed dependent joint prior pairs \((0.05,0.02)\) with \((0.50,-0.20)\), each with probability one half. Check its induced treatment risks, then assess what happens if the same marginals are made independent.

Under the proposed dependent prior, the treatment risks are \(0.05+0.02=0.07\) and \(0.50-0.20=0.30\). Both are valid. The means are \(E(p_C)=0.275\), \(E(\Delta)=-0.09\), and \(E(p_T)=0.185\).

Under independence, all four cross-combinations have probability one quarter. Their treatment risks are \(0.05+0.02=0.07\), \(0.05-0.20=-0.15\), \(0.50+0.02=0.52\), and \(0.50-0.20=0.30\). The value \(-0.15\) is not a probability. Thus the independent joint prior assigns one quarter of its mass to an impossible treatment risk, even though each marginal prior is unchanged and the proposed dependent prior has valid pairs.

The problem is not repaired by noting that the marginal mean treatment risk is positive. The generated model must have valid arm probabilities for every pair to which it assigns prior probability. A joint prior must instead respect the support constraint, or use a parameterization that guarantees valid probabilities. Simply discarding invalid draws after simulation changes the prior and should not be treated as an innocuous computational step.

Checking a Joint Prior Through Trial Replicates

A prior predictive check translates a joint prior into quantities that can be discussed in trial terms: arm event rates, event counts, their difference, and the way those quantities co-occur. The following derivation shows how both parameter uncertainty and binomial sampling variability contribute to predictive count variation. For a control count \(Y_C\), the law of total variance gives

$$ \operatorname{Var}(Y_C) =E\{\operatorname{Var}(Y_C\mid p_C)\} +\operatorname{Var}\{E(Y_C\mid p_C)\} =n_C E\{p_C(1-p_C)\}+n_C^2\operatorname{Var}(p_C). $$

The first term is average binomial variation conditional on the event probability; the second is variation across prior values of that probability. If the two arm counts are conditionally independent given the parameters, the law of total covariance similarly yields \(\operatorname{Cov}(Y_C,Y_T)=n_Cn_T\operatorname{Cov}(p_C,p_T)\). Shared uncertainty about baseline risk can therefore make the predictive arm counts strongly associated.

Worked Example: Predictive Count Variation in a Hypothetical Trial

Use the two-point prior from the first example and suppose the hypothetical trial plans \(n_C=n_T=100\). Calculate the predictive means and variances of both event counts, and their covariance. Conditional on the probabilities, assume independent binomial outcomes in the two arms.

The means are \(E(Y_C)=100(0.25)=25\) and \(E(Y_T)=100(0.20)=20\). For the control arm, the average conditional binomial variance is \(100\{[0.10(0.90)+0.40(0.60)]/2\}=16.5\). The prior variance component is \(100^2(0.0225)=225\), so \(\operatorname{Var}(Y_C)=16.5+225=241.5\) events squared.

For treatment, the average conditional variance is \(100\{[0.08(0.92)+0.32(0.68)]/2\}=14.56\). The prior variance component is \(100^2(0.0144)=144\), giving \(\operatorname{Var}(Y_T)=158.56\) events squared.

The covariance between the arm risks is 0.018, as calculated above. Thus \(\operatorname{Cov}(Y_C,Y_T)=100(100)(0.018)=180\) events squared. The predictive count correlation is approximately \(180/\sqrt{241.5(158.56)}=0.920\). This high positive correlation reflects common prior uncertainty in whether the baseline setting is relatively low-risk or high-risk. It does not mean that one arm’s outcomes cause the other arm’s outcomes.

Choosing a Scale and Assessing Clinical Plausibility

Risk differences are often directly interpretable, but their support depends on baseline risk. A different option is to specify a treatment effect as a log odds ratio, \(\theta=\operatorname{logit}(p_T)-\operatorname{logit}(p_C)\), where \(\operatorname{logit}(p)=\log\{p/(1-p)\}\). Then \(p_T=\operatorname{logit}^{-1}\{\operatorname{logit}(p_C)+\theta\}\), which lies between zero and one for finite values. This avoids impossible probabilities from an unconstrained log-odds effect, but it does not remove the need to check dependence. It also does not make effects on the risk-difference scale constant across baseline risks.

For instance, if the odds ratio is 0.5, then \(p_T=p_C/(2-p_C)\). At baseline risk \(p_C=0.10\), this gives \(p_T=0.0526\), a risk difference of \(-0.0474\); at \(p_C=0.40\), it gives \(p_T=0.25\), a risk difference of \(-0.15\). These are both reductions in event risk, but the absolute reductions differ. A prior that is independent on the log-odds scale does not imply independence between baseline risk and risk difference.

When checking a candidate joint prior, examine simulated pairs \((p_C,\Delta)\) or \((p_C,\theta)\) as well as the induced arm outcomes. Ask whether the pairings reflect clinical knowledge, whether the signs and magnitudes of effects are plausible at different baseline risks, and whether trial-sized counts include credible ranges and combinations. For a risk-difference prior, verify that all support lies within the probability constraints. For either scale, a marginal summary or a single correlation coefficient is not a substitute for examining the joint pattern.

An independent-prior specification is a useful comparison when independence is clinically defensible and the joint support is valid. A dependent joint prior can instead encode a believed relationship, for example through a specified conditional distribution of treatment effect given baseline risk or a joint distribution with stated dependence structure. These are modeling choices, not diagnostics that prove a prior is correct. The relevant comparison is whether each choice yields credible joint prior predictions for the intended trial.

Common Pitfalls and Limitations

  • Checking only marginal priors. Plausible values for \(p_C\) and \(\Delta\) separately do not guarantee plausible or even valid combinations. Check their joint support and the induced \(p_T\).
  • Assuming independence is neutral. Independence is a substantive restriction, and on the risk-difference scale it may generate invalid combinations. Compare its joint predictions with clinically defensible alternatives.
  • Interpreting correlation as the whole relationship. Correlation summarizes linear association on a chosen scale. It does not determine tail behavior, nonlinear patterns, or clinical plausibility.
  • Confusing outcome association with treatment-effect dependence. The arm risks can be positively associated because baseline risk varies, even when baseline risk and the risk difference are negatively associated.
  • Assuming a valid parameterization ensures a credible prior. A log-odds model prevents probabilities outside zero and one, but its implied absolute effects and dependence patterns may still be clinically implausible.

Prior predictive checks can reveal consequences of assumptions; they cannot establish that a dependence structure is true. The result also depends on the chosen endpoint, follow-up period, treatment-effect scale, and trial design. Those features must match the clinical question for the resulting predictions to be useful.

Check Your Understanding

Answer each question, then compare your reasoning with the brief solutions below.

  1. If \(p_C=0.30\), what values of \(\Delta\) are allowed by the probability constraint?
  2. Can two priors with the same marginal distributions for \(p_C\) and \(\Delta\) produce different prior predictive distributions for \(p_T\)? Explain.
  3. In the first worked example, what is the sign of \(\operatorname{Cov}(p_C,\Delta)\), and how does it affect \(\operatorname{Var}(p_T)\)?
  4. Why can an independent prior on a log odds ratio still imply that absolute treatment effects vary with baseline risk?

Solutions. (1) The constraint is \(-p_C\leq\Delta\leq1-p_C\), so \(-0.30\leq\Delta\leq0.70\). (2) Yes. Different dependence structures pair baseline risks and effects differently, changing the distribution of their sum \(p_T=p_C+\Delta\) even if both marginals are fixed. (3) The covariance is negative, \(-0.0045\). Since it enters \(\operatorname{Var}(p_T)\) multiplied by two, it reduces treatment-risk variance relative to the sum of the two marginal variances. (4) A fixed odds ratio maps to different risk differences at different baseline risks; for example, odds ratio 0.5 yields risk differences \(-0.0474\) at baseline risk 0.10 and \(-0.15\) at baseline risk 0.40.

Clinical Biostats