Tutorials › Bayesian Clinical Trials › Posterior Survival Probabilities Under Heavy Censoring

Posterior Inference for Trial Endpoints · Tutorial 30 of 696

Posterior Survival Probabilities Under Heavy Censoring

Use a discrete-time Bayesian survival model to interpret fixed-time survival probabilities when few participants remain under observation.

Beginner 13 min read

What You'll Learn

  • Define interval hazards, interval survival probabilities, and survival through a fixed number of intervals.
  • Update independent beta priors using interval event and non-event counts.
  • Calculate a posterior mean and variance for survival through several intervals.
  • Explain why a small late risk set produces substantial uncertainty.
  • Distinguish a recorded event-free interval from an interval obscured by censoring.
  • Check sensitivity to prior assumptions and identify when a late hazard is not informed by data.

Why Heavy Censoring Matters for Survival Estimates

A survival estimate at an early follow-up time may be supported by many participants, while an estimate at a later time may depend on only a handful. This is common in clinical trials: participants enter at different times, follow-up ends, or observation is otherwise censored before the endpoint of interest. A late survival estimate can still be calculated under a specified model, but its uncertainty should reflect how little information remains.

Here the focus is survival at a fixed time represented by several discrete intervals. The model uses an event hazard for each interval and a beta prior for each hazard. Its main lesson is not that heavy censoring makes estimation impossible in every case, but that the posterior for late survival can be wide, sensitive to prior assumptions, or unsupported by any late risk-set observations at all.

Model and Assumptions

Definition: In interval \(j\), let \(h_j\) be the probability of an event during that interval, conditional on being alive and event-free at its start. The corresponding interval survival probability is \(q_j=1-h_j\). Survival through \(J\) intervals is \(S_J=\prod_{j=1}^{J}q_j\), conditional on the model.

Suppose \(r_j\) participants are observed to be at risk at the start of interval \(j\), \(d_j\) have an event during that interval, and \(r_j-d_j\) are known to complete it event-free. The likelihood contribution for the interval hazard is proportional to \(h_j^{d_j}(1-h_j)^{r_j-d_j}\). In this tutorial, censoring is assumed to occur at interval boundaries, so each person counted as event-free is known to have completed the interval without an event. If a participant is censored partway through an interval, that participant cannot automatically be counted as a non-event for the whole interval; the observation model must account for the partial follow-up.

Assume independent priors \(h_j\sim\operatorname{Beta}(a_j,b_j)\), where both shape parameters are positive. The interval outcomes are conditionally independent given their hazards, and censoring is non-informative for the event process under the model: censoring does not select participants according to an unaccounted-for risk of the event. These assumptions matter. A beta update does not repair informative dropout, an incorrect interval definition, or a hazard model that poorly represents the trial.

Updating the Hazards and Combining Survival

The beta distribution is conjugate to the binomial likelihood. Given \(d_j\) events and \(r_j-d_j\) observed event-free intervals, the posterior is

$$ h_j\mid\text{data}\sim\operatorname{Beta}(a_j+d_j,\ b_j+r_j-d_j). $$

Because \(q_j=1-h_j\), its posterior distribution is \(\operatorname{Beta}(b_j+r_j-d_j,\ a_j+d_j)\). If the prior distributions and likelihood factor across intervals, the posterior distributions of the hazards (and therefore the \(q_j\)) are independent across intervals. This independence makes the mean and second moment of \(S_J\) straightforward to calculate.

$$ E(S_J\mid\text{data})=\prod_{j=1}^{J}E(q_j\mid\text{data}),\qquad E(S_J^2\mid\text{data})=\prod_{j=1}^{J}E(q_j^2\mid\text{data}). $$

For \(q_j\sim\operatorname{Beta}(A_j,B_j)\), the beta moments are \(E(q_j)=A_j/(A_j+B_j)\) and \(E(q_j^2)=A_j(A_j+1)/[(A_j+B_j)(A_j+B_j+1)]\). Consequently,

$$ \operatorname{Var}(S_J\mid\text{data}) =E(S_J^2\mid\text{data})-\{E(S_J\mid\text{data})\}^2. $$

These are posterior summaries under the stated model. The posterior mean is not a guarantee that the true survival probability equals that value, and it does not describe the uncertainty by itself. A credible interval or a posterior probability such as \(P(S_J>c\mid\text{data})\) is also useful when the clinical decision depends on a threshold \(c\).

Worked Example: Three Intervals With a Small Late Risk Set

Consider hypothetical trial follow-up divided into three intervals. Forty participants start interval 1; 4 have events and 10 are censored at its end, leaving 26 to enter interval 2. In interval 2, 3 have events and 17 are censored at its end, leaving 6 to enter interval 3. In interval 3, 1 has an event and 5 are censored at its end. Use independent \(\operatorname{Beta}(1,1)\) priors for all three hazards. These counts assume that the censoring times are at interval boundaries, so the stated non-events completed their intervals event-free.

The posterior hazards are

$$ h_1\mid\text{data}\sim\operatorname{Beta}(5,37),\quad h_2\mid\text{data}\sim\operatorname{Beta}(4,24),\quad h_3\mid\text{data}\sim\operatorname{Beta}(2,6). $$

For example, interval 2 has 3 events and \(26-3=23\) observed event-free intervals. Its posterior is therefore \(\operatorname{Beta}(1+3,1+23)=\operatorname{Beta}(4,24)\). The corresponding survival probabilities have distributions \(\operatorname{Beta}(37,5)\), \(\operatorname{Beta}(24,4)\), and \(\operatorname{Beta}(6,2)\). Their posterior means are \(37/42\), \(24/28\), and \(6/8\), respectively. Thus the posterior mean survival through all three intervals is

$$ E(S_3\mid\text{data}) =\frac{37}{42}\frac{24}{28}\frac{6}{8} =\frac{111}{196}\approx0.5663. $$

The late interval’s estimated mean survival is \(6/8=0.75\), but only six participants entered that interval. Its uncertainty contributes to uncertainty in the product. The second moments of the three interval survival probabilities are \(37(38)/[42(43)]\), \(24(25)/[28(29)]\), and \(6(7)/[8(9)]\). Multiplication gives \(E(S_3^2\mid\text{data})\approx0.3356\). Therefore,

$$ \operatorname{Var}(S_3\mid\text{data}) \approx0.3356-(0.5663)^2 \approx0.0148,\qquad \operatorname{SD}(S_3\mid\text{data})\approx0.1218. $$

The mean is a survival probability, with no physical unit. The posterior standard deviation of about 0.122 is also on the probability scale. It is not a confidence interval, and it does not convey the full shape of the posterior distribution. The small late risk set is a reason to report an interval or relevant posterior tail probability as well as the mean.

Why a Small Risk Set Produces More Uncertainty

The late interval’s posterior is informed by its own events and event-free observations, not by the original enrollment count alone. With a uniform prior, the six interval-3 observations in the example produce \(h_3\mid\text{data}\sim\operatorname{Beta}(2,6)\). The posterior mean hazard is \(2/(2+6)=0.25\), and the posterior mean interval survival is 0.75. That point summary should not obscure that the data are sparse.

For comparison, suppose the same interval data—one event and five event-free observations—were analyzed using a \(\operatorname{Beta}(2,2)\) prior for the hazard. The posterior would be \(\operatorname{Beta}(3,7)\), giving mean hazard \(3/10=0.30\) and mean interval survival \(7/10=0.70\). The data are unchanged; the prior contributes relatively more when the risk set is small. This is a sensitivity check, not a reason to select a prior after seeing which answer is preferred.

The uncertainty can also be seen in the variance. Under the uniform prior, \(q_3\mid\text{data}\sim\operatorname{Beta}(6,2)\), so

$$ \operatorname{Var}(q_3\mid\text{data}) =\frac{6\cdot2}{(6+2)^2(6+2+1)} =\frac{12}{576}\approx0.02083. $$

A late risk set with more observations would generally give more likelihood information, although the exact posterior uncertainty also depends on the observed event pattern and prior. Heavy censoring therefore calls for a careful account of who remains observed and how much the posterior depends on assumptions.

Worked Example: Interpreting a Prior-Sensitivity Check

Return to the hypothetical third interval with one event among six participants and five completed event-free intervals. Under the uniform prior, the posterior survival probability is \(\operatorname{Beta}(6,2)\). Its mean is \(6/8=0.75\), and its variance is \(6(2)/[8^2(9)]=12/576\approx0.02083\).

Now use a \(\operatorname{Beta}(2,2)\) prior on the hazard. The posterior hazard is \(\operatorname{Beta}(2+1,2+5)=\operatorname{Beta}(3,7)\), so posterior survival is \(\operatorname{Beta}(7,3)\). Its mean is \(7/10=0.70\), and its variance is \(7(3)/[10^2(11)]=21/1100\approx0.01909\).

The posterior means differ by \(0.75-0.70=0.05\), or five percentage points. Both calculations use the same sparse observations, so the difference reflects the prior as well as the data. A complete report would state the prior and, when the conclusion matters clinically, show whether the decision is robust to reasonable prior alternatives.

When the Late Hazard Has No Data

The most severe case occurs when nobody enters a later interval. Then \(r_j=0\), and the likelihood contribution for that interval is constant with respect to \(h_j\): it contains no event or event-free observations. The posterior for that hazard is its prior. A numerical late survival estimate can still be produced by combining it with earlier intervals, but the data have not updated the late hazard.

Worked Example: No Participants Observed in a Later Interval

For illustration, suppose survival through an earlier time is treated as fixed at 0.80, and no participants are observed in the next interval. Assign a \(\operatorname{Beta}(1,1)\) prior to the unobserved interval hazard \(h\). Since \(r=0\), there are no events and no completed event-free intervals, so the posterior remains \(h\mid\text{data}\sim\operatorname{Beta}(1,1)\). The interval survival \(q=1-h\) is also uniform on \([0,1]\).

The mean survival through the later time is \(0.80E(q)=0.80(0.50)=0.40\). Because the earlier survival is fixed in this illustration, the variance is \(0.80^2\operatorname{Var}(q)=0.64(1/12)\approx0.05333\), giving posterior standard deviation \(\sqrt{0.05333}\approx0.2309\). The estimate is driven by the assumed prior for the unobserved interval; it is not a late survival estimate learned from trial follow-up.

Diagnostics, Alternatives, and Limitations

Before interpreting a posterior survival probability under heavy censoring, check the data summaries and the model specification. Useful checks include:

  • Report the number at risk at the start of each interval, alongside the events and completed event-free intervals. A large original sample does not imply a large late risk set.
  • Verify that each participant’s interval contribution is justified. In particular, do not count someone censored partway through an interval as known to have survived the entire interval.
  • Check whether censoring could depend on prognosis after accounting for the model. If participants at higher event risk are more likely to leave observation, a non-informative censoring assumption may fail.
  • Assess whether the interval definitions and a constant hazard within each interval are defensible for the question. Different interval choices can alter the model and the inferred survival.
  • Examine posterior uncertainty and sensitivity to plausible priors, especially in intervals with few observations or none.

A non-Bayesian Kaplan–Meier estimate is a standard alternative for right-censored survival data and summarizes the observed event-time pattern without specifying beta priors for discrete interval hazards. It has its own sampling uncertainty and can also become imprecise at late times when few participants remain at risk. A parametric continuous-time model, such as an exponential model, instead imposes a form on event times and can use the timing of events and censoring. These approaches answer related questions under different assumptions; they do not make sparse late follow-up informative by itself.

The discrete-time beta-hazard calculation is transparent and gives a direct posterior distribution under its assumptions. Its limitations include dependence on interval choices, the assumption of a common hazard within each interval, and possible sensitivity to priors when risk sets are small. In particular, the posterior mean product is not the same as multiplying posterior hazard means: survival uses \(1-h_j\), and uncertainty in the product matters. Likewise, multiplying the endpoints of separate interval credible intervals does not generally produce a credible interval for the product. To obtain a credible interval or \(P(S_J>c\mid\text{data})\), use the posterior distribution of the product, for example by drawing independent \(q_j\) values from their posterior distributions, multiplying them for each draw, and summarizing those product draws.

Key takeaway: Under a discrete-time beta-hazard model, posterior survival through a fixed set of intervals is a product of interval survival probabilities. When censoring leaves few or no participants in late risk sets, quantify the resulting uncertainty and distinguish information supplied by the likelihood from assumptions supplied by the prior.

Check Your Understanding

Answer each question, then compare with the brief solutions below.

  1. In an interval, 12 participants are at risk, 2 have events, and the other 10 complete the interval event-free. Under a \(\operatorname{Beta}(1,1)\) hazard prior, what is the posterior hazard distribution?
  2. For the posterior in question 1, what is the posterior mean interval survival probability?
  3. If the posterior interval survival probabilities for two intervals are independent and have means 0.9 and 0.8, what is the posterior mean survival through both?
  4. Why is a participant censored halfway through an interval not automatically a non-event for that full interval in this model?
  5. If nobody enters a late interval, what does the interval’s posterior hazard depend on, and what should be reported about that interval?

Solutions. 1. The posterior is \(\operatorname{Beta}(1+2,1+10)=\operatorname{Beta}(3,11)\). 2. Interval survival has distribution \(\operatorname{Beta}(11,3)\), with mean \(11/14\approx0.7857\). 3. Independence gives \(E(S_2)=0.9(0.8)=0.72\). 4. Halfway censoring does not establish that the participant remained event-free through the interval’s end; treating the participant as a full-interval non-event would misstate the observation. 5. With no participants at risk, the likelihood contributes no information about that hazard, so the posterior equals its prior. Report the absence of a late risk set and make clear that any late estimate depends on model and prior assumptions rather than late-interval observations.

Clinical Biostats