Tutorials › Competing Risks and Multi-State Models › Estimating Censoring Survival Probabilities

Practical Handling of Censoring · Tutorial 549 of 699

Estimating Censoring Survival Probabilities

Learn how to estimate marginal and covariate-conditional censoring survival probabilities, and how to interpret the estimates and assess their assumptions.

Advanced 10 min read

What You'll Learn

  • Define the censoring survival probability and distinguish it from clinical-event survival.
  • Construct reverse Kaplan–Meier estimates when clinical events end observation.
  • Handle censoring and clinical-event ties consistently with the strict survival target.
  • Estimate conditional censoring survival from a proportional hazards regression model.
  • Standardize conditional estimates to a stated covariate distribution.
  • Diagnose sparse follow-up and potential censoring-model misspecification.

Why Estimate Censoring Survival?

In an event-history study, a participant may stop being observed before the end of the study. The probability of remaining uncensored through time \(t\) describes how much follow-up is available at that time. It is not the probability of remaining free of a clinical event: a clinical event and censoring are different ways observation can end. Keeping those two processes separate is essential when summarizing follow-up or fitting models for censoring.

Let \(C\) denote the censoring time, measured from a clearly specified time origin. For example, \(C\) may be the time of loss to follow-up or the end of available study observation. The censoring survival function is \(G(t)=P(C>t)\). This strict “after \(t\)” definition means that a person censored exactly at \(t\) is not counted as remaining uncensored beyond \(t\). We will estimate \(G(t)\) from data in which the censoring time may itself be unobserved.

Definition: The censoring survival probability at time \(t\) is \(G(t)=P(C>t)\), the probability that the censoring time exceeds \(t\). A conditional version is \(G(t\mid X=x)=P(C>t\mid X=x)\), where \(X\) denotes measured covariates. These are probabilities about observation, not probabilities about the occurrence or prevention of a clinical event.

Reverse Kaplan–Meier Estimation

For the censoring-process analysis, define \(T^*\) as the time to the first clinical event of any type. This is the time at which a clinical event first ends the event-free follow-up relevant to the censoring analysis. It is distinct from a particular event-of-interest time used in a clinical analysis: if any competing clinical event occurs first, it also ends observation of the censoring process for this purpose. The observed follow-up time is \(Y=\min(T^*,C)\).

When \(C<T^*\), the censoring time is observed. When \(T^*<C\), the censoring time is not observed; \(T^*\) instead gives a right-censoring time for the censoring-time distribution. If \(C=T^*\) is known, count it as a censoring-time event at that time when estimating \(P(C>t)\). This tie convention matches the strict survival definition: a participant censored at \(u\) does not have \(C>u\). If recorded timestamps cannot establish whether the times are truly tied or which process occurred first, the study must specify a consistent operational rule and acknowledge the resulting ambiguity.

Assumptions: The marginal reverse Kaplan–Meier estimator requires censoring time \(C\) and first clinical-event time \(T^*\) to be independent in the population being analyzed, along with independent observations and adequate follow-up to estimate the times of interest. If independence holds only conditional on covariates \(X\), a conditional censoring model must account for those covariates; a pooled reverse Kaplan–Meier estimate need not then estimate the marginal censoring distribution correctly.

Let \(u_1<u_2<\cdots\) be the distinct observed times at which a censoring-time event occurs. Just before \(u_j\), let \(n_j\) be the number of participants still under observation for this censoring analysis, and let \(d_j\) be the number whose censoring time is observed at \(u_j\). A first clinical event before censoring removes a participant from later risk sets but is not counted in \(d_j\). A known tie \(C=T^*=u_j\) is counted in \(d_j\), as specified above. The reverse Kaplan–Meier estimate is

$$ \widehat{G}(t)=\prod_{u_j\leq t}\left(1-\frac{d_j}{n_j}\right). $$

The product includes censoring-time events at \(t\), so it estimates the strict probability \(P(C>t)\). Each factor estimates the probability of passing a censoring-time event time without having been censored, among those still at risk immediately before that time. Clinical events act as right-censoring observations in this reversed analysis: they contribute to the risk set up to their event time and are then removed.

Worked Example: A Reverse Kaplan–Meier Estimate

Worked Example: A Reverse Kaplan–Meier Estimate

Suppose eight hypothetical participants have the following observed follow-up times. “Censor” means censoring occurred first; “clinical” means the first clinical event occurred first. One participant has a known tie between censoring and a clinical event.

ParticipantObserved time \(Y\) (months)Process ending follow-up
A1Censoring
B2Clinical event
C2Censoring
D3Censoring
E4Clinical event
F4Known tie: censoring and clinical event
G5Clinical event
H6Censoring

At 1 month, all eight are at risk and one censoring event occurs, so the product factor is \(1-1/8=7/8\). At 2 months, seven remain at risk: one clinical event removes B from later risk sets, while C contributes one censoring event. The factor is \(1-1/7=6/7\). At 3 months, five remain at risk and one censoring event occurs, giving \(1-1/5=4/5\).

At 4 months, four remain at risk. E has a clinical event and F has a known censoring tie. The tie is counted as a censoring-time event, so the factor is \(1-1/4=3/4\). Therefore,

$$ \widehat{G}(4)=\frac{7}{8}\times\frac{6}{7}\times\frac{4}{5}\times\frac{3}{4} =0.450. $$

In this hypothetical sample, the estimated probability of remaining uncensored beyond 4 months is 0.450. It is not the estimated probability of remaining free of a clinical event. The estimate uses the censoring observations and accounts for clinical events by removing those participants from subsequent risk sets.

Justification and Uncertainty

The product-limit form follows by breaking survival past \(t\) into conditional probabilities of passing each censoring-event time. If the probability of remaining uncensored across time \(u_j\), conditional on having remained uncensored up to that point, is estimated by \(1-d_j/n_j\), multiplying those conditional probabilities gives the probability of remaining uncensored through all such times up to \(t\). Under independence of \(C\) and \(T^*\), the observed risk sets—whose members have not yet had either process end follow-up—allow the censoring-time distribution to be estimated despite censoring of \(C\) by clinical events. This is the Kaplan–Meier product-limit argument applied with censoring and clinical-event roles reversed.

A common large-sample variance estimate, when the estimate is positive and the relevant risk-set terms are defined, is Greenwood’s formula:

$$ \widehat{\operatorname{Var}}\{\widehat{G}(t)\} = \widehat{G}(t)^2 \sum_{u_j\leq t}\frac{d_j}{n_j(n_j-d_j)}. $$

For the example at 4 months, the sum is \(1/(8\cdot7)+1/(7\cdot6)+1/(5\cdot4)+1/(4\cdot3)=0.1750\). Thus the estimated variance is \(0.450^2(0.1750)=0.03544\), and the estimated standard error is \(\sqrt{0.03544}=0.1883\). This standard error reflects sampling uncertainty under the model assumptions; it does not measure bias from informative censoring or a misspecified model. Confidence intervals based on transformations of the survival estimate are often preferable to a simple Wald interval near 0 or 1.

Conditional Estimates From Regression Models

When censoring depends on measured covariates, estimate \(G(t\mid X=x)\) rather than assume one common censoring curve applies to everyone. A common choice is a Cox proportional hazards model for the censoring time:

$$ \lambda_C(t\mid X)=\lambda_{C0}(t)\exp(\beta^\mathsf{T}X), \qquad G(t\mid X=x)=\exp\left\{-\Lambda_{C0}(t)\exp(\beta^\mathsf{T}x)\right\}. $$

Here \(\lambda_C(t\mid X)\) is the instantaneous censoring hazard among participants not yet censored, \(\lambda_{C0}(t)\) is the baseline censoring hazard, \(\beta\) is a vector of regression coefficients, and \(\Lambda_{C0}(t)\) is the cumulative baseline censoring hazard. To fit this model, treat observed censoring times as events and first clinical events as right-censoring times for the censoring process. Known censoring ties are included as censoring events. The model requires conditional independence of \(C\) and \(T^*\) given \(X\), proportional censoring hazards as specified, and an adequate covariate form. Regression adjustment does not correct dependence on unmeasured predictors.

Worked Example: Conditional Censoring Probability From a Cox Model

Consider hypothetical data in which \(X=1\) denotes use of a remote follow-up system and \(X=0\) denotes standard follow-up. Suppose a fitted censoring Cox model gives \(\widehat{\beta}=\log(1.50)=0.4055\), and the estimated baseline cumulative censoring hazard at 12 months is \(\widehat{\Lambda}_{C0}(12)=0.200\) for \(X=0\).

For standard follow-up, the estimated censoring survival probability is \(\widehat{G}(12\mid X=0)=\exp[-0.200\exp(0)]=\exp(-0.200)=0.8187\).

For remote follow-up, the estimated censoring hazard ratio is \(\exp(0.4055)=1.50\). The conditional survival estimate is \(\widehat{G}(12\mid X=1)=\exp[-0.200\exp(0.4055)]=\exp(-0.300)=0.7408\).

Under this fitted model, the estimated probabilities of remaining uncensored beyond 12 months are 0.8187 for standard follow-up and 0.7408 for remote follow-up. Equivalently, the estimated probabilities of censoring by 12 months are \(1-0.8187=0.1813\) and \(1-0.7408=0.2592\). These are model-based descriptions of follow-up, not causal effects of the follow-up system.

The baseline cumulative hazard can be estimated from the censoring events, for example by the Breslow estimator, while the Cox coefficients describe relative censoring hazards. The proportional hazards assumption concerns those censoring hazards over time; it is not established merely because a fitted model returns coefficients. If hazards are not proportional, a stratified model, time-varying effects, or a more flexible model for the censoring distribution may be more appropriate. The chosen model must still handle the clinical-event terminations correctly.

Worked Example: Averaging Conditional Estimates

Suppose the target population has 60% of participants with \(X=0\) and 40% with \(X=1\), and the conditional 12-month estimates are those from the previous example. The marginal estimate standardized to this covariate distribution is the weighted average of the conditional survival probabilities:

$$ \widehat{G}_{\mathrm{marg}}(12) =0.60(0.8187)+0.40(0.7408) =0.4912+0.2963 =0.7875. $$

The estimated probability of remaining uncensored beyond 12 months in this target population is 0.7875. For continuous or multivariable \(X\), the same idea can be implemented by calculating a conditional prediction for each member of a stated target covariate distribution and averaging those predictions. The target distribution matters: a standardized estimate for one population need not equal that for a population with a different covariate mix.

Diagnostics, Alternatives, and Limitations

A censoring survival estimate is only informative where the data support it. Inspect the number at risk over time, the number of observed censoring events, and the number of clinical events that terminate the reverse analysis. A curve based on very few people late in follow-up is unstable, even if it appears smooth. If the estimated \(G(t)\) approaches zero, the data provide little evidence about remaining uncensored beyond that time.

For regression estimates, examine whether the modeled censoring hazard is compatible with the data: compare observed and model-predicted censoring patterns over time and across covariate groups, inspect functional forms for continuous covariates, and assess proportional hazards where a Cox model is used. Sparse censoring events in a subgroup, strong departures from proportional hazards, or systematic prediction errors suggest that a single fitted model may not be adequate. These checks assess model fit; they cannot verify independence from unmeasured factors.

Reverse Kaplan–Meier is a direct, nonparametric option when marginal independence is defensible and a marginal estimate is the target. Stratified reverse Kaplan–Meier curves allow separate estimates within prespecified groups, but may be imprecise with small groups and do not automatically adjust for many covariates. Regression models can provide conditional estimates and use covariates more efficiently, but depend on their functional-form and hazard assumptions. A parametric censoring-time model is another option; it can smooth estimates and extrapolate, but requires a suitable distributional form. In contrast, simply dividing the number censored by the number enrolled does not estimate \(G(t)\): participants with a clinical event may have had a later censoring time that was never observed.

The principal limitation is identifiability. If censoring and clinical-event times are dependent even after conditioning on measured covariates, the observed data alone generally do not identify the censoring distribution that would have been seen without clinical-event termination. A model can estimate conditional censoring probabilities only under its assumptions and observed-data support. It cannot turn an informative censoring mechanism into an independent one by fitting covariates alone.

Common Mistake

  • Wrong reasoning: “A competing clinical event happened, so it should be counted as a censoring event in the censoring survival curve.”
  • Correction: In the reverse Kaplan–Meier analysis, a first clinical event is a right-censoring observation for the censoring time \(C\), not an observed censoring-time event. It removes the participant from later risk sets. Only an observed censoring time contributes to \(d_j\), including a known tie when estimating the strict target \(P(C>t)\).
  • Another error: Interpreting \(\widehat{G}(t)\) as the probability of being event-free at \(t\). It is the probability of remaining uncensored beyond \(t\); clinical-event probabilities are different quantities.
Key takeaway: Define the censoring target and tie convention first. Reverse Kaplan–Meier estimates a marginal censoring survival curve under marginal independence; censoring regression estimates conditional probabilities under conditional independence and model assumptions. Interpret every estimate as a probability about observation through a stated time and in a stated population.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. At a time with 20 people in the risk set, two censoring-time events occur. What is the reverse Kaplan–Meier factor at that time, and what does it represent?
  2. A person has a known tie \(C=T^*=u\). Under the strict target \(P(C>t)\), how is this record handled at \(u\), and why?
  3. A censoring Cox model has baseline cumulative hazard 0.10 at 6 months and coefficient \(\log(2)\) for a binary covariate. Calculate the estimated \(G(6\mid X=1)\).
  4. Suppose conditional estimates at a fixed time are 0.90 for 70% of a target population and 0.60 for 30%. What is the standardized marginal estimate?
  5. Why can a pooled reverse Kaplan–Meier curve be unsuitable when censoring is independent of clinical events only after conditioning on covariates?

Solutions: (1) The factor is \(1-2/20=0.900\). It estimates the conditional probability of passing that censoring-event time without censoring, among those still at risk just before it. (2) Count the known tie as a censoring-time event at \(u\). Since \(C=u\) does not satisfy \(C>u\), it must contribute to the strict survival estimate at \(u\). (3) The estimate is \(\exp[-0.10\exp\{\log(2)\}]=\exp(-0.20)=0.8187\). (4) The standardized estimate is \(0.70(0.90)+0.30(0.60)=0.63+0.18=0.810\). (5) Covariates can associate with both censoring and clinical-event times. Even if the times are independent within covariate levels, pooling can create marginal dependence and selection in the risk sets; conditional estimates should instead be combined over a stated target covariate distribution when a marginal target is needed.

Clinical Biostats