Why Dropout Must Be Distinguished From an Event
In longitudinal survival data, an individual may experience the event of interest or may stop being observed before the event status is known. These are different outcomes. Coding a person who drops out as event-free through the end of follow-up changes the data; coding dropout as an event changes the scientific question. Censoring-adjusted estimation instead uses the observed history and assumptions about why follow-up ended to recover the survival quantity of interest.
We use discrete intervals \(t=1,\ldots,K\), with a fixed treatment regime understood throughout. The focus here is dropout, so treatment assignment is treated as already handled. Let \(T\) denote the event time, and define \(\Delta_t=I(T=t)\), the event indicator in interval \(t\), among people event-free at its start. Let \(S_t=I(T>t)\) denote survival beyond interval \(t\). Define \(R_t=1\) if the person is observed and event-free at the start of interval \(t\), with \(R_1=1\). After surviving interval \(t\), \(R_{t+1}=1\) means follow-up continues and the next history can be observed. Because dropout is monotone, once \(R_{t+1}=0\), later \(R_j=0\) for \(j>t+1\). A person who has the event is no longer at risk, which is not the same as being censored.
The timing convention matters: an event during interval \(t\) is recorded before the dropout decision for a person who survives that interval. Thus \(R_{t+1}\) is needed to observe subsequent follow-up, not to decide whether an event in interval \(t\) occurred. At the final horizon, dropout after the last event assessment does not affect whether \(S_K\) was observed.
Identification and the Sequential Survival Recursion
Let \(H_t\) contain the information available at the start of interval \(t\), including relevant past covariates. Under a fixed regime, define \(Q_{K+1}=1\), and, for a person alive and observed at the start of \(t\), define the full-data conditional survival function recursively by
When \(T=t\), the factor \(1-\Delta_t\) is zero, so later survival contributes nothing. If the person survives interval \(t\), that factor is one and the recursion averages future survival over the next history. Since \(Q_{K+1}=1\), \(Q_K\) is simply the conditional probability of surviving the last interval. The target marginal survival probability is \(E[Q_1(H_1)]\) under the target baseline population and regime.
Dropout makes some terms in this full-data recursion unobserved. Identification requires sequential conditional independent censoring: among people alive and observed at the start of an interval, conditional on the recorded history used in the analysis, continuing observation is independent of the subsequent full-data event and covariate outcomes relevant to the target. It also requires retention positivity: every history with positive probability in the target population has a positive probability of continued observation when that observation is needed. These conditions do not say that dropout is unrelated to prognosis unconditionally. They say that the recorded history is sufficient to account for the relationship.
Proof. Write \(Z_t=(1-\Delta_t)Q_{t+1}(H_{t+1})\). By the stated conditional independent-censoring assumption, \(Z_t\) and \(R_{t+1}\) are conditionally independent given \(H_t\), survival to the start of interval \(t\), and the regime. Positivity ensures that the conditional distribution among \(R_{t+1}=1\) is defined for the target histories. Therefore,
The left side is estimable from retained individuals; substituting this equality at each time in the backward recursion identifies \(Q_t\), and hence its target-population average. \(\square\)
Worked Estimates and Sequential Updates
Worked Example: Event Risk Sets With Dropout
Suppose 20 people are event-free and observed at the start of interval 1. Two experience the event during that interval. Of the 18 who survive, three drop out before interval 2. In interval 2, three events are observed among the 15 people who remain under observation and event-free.
The interval-1 event hazard is \(2/20=0.10\). The three dropouts are not interval-1 events: the event status for all 20 was observed through interval 1. The interval-2 hazard among those at risk and observed is \(3/15=0.20\). The product-limit survival estimate through two intervals is therefore
This calculation treats the three dropouts as censored after interval 1: they contribute to the first risk set but not to the second. It does not assert that they would have survived interval 2. Interpreting the estimate as survival for the target population still requires independent censoring, at least conditional on the information used to define the risk sets.
Worked Example: Inverse-Retention Weighting
Consider 100 people in two equally sized baseline groups. In group A, 80% remain observed through the outcome assessment; among those observed, 30 of 40 survive. In group B, 50% remain observed; among those observed, 15 of 25 survive. Suppose dropout is independent of the outcome within each group. The target group-specific survival estimates are \(30/40=0.75\) and \(15/25=0.60\), so the equally weighted target average is
The same result follows by weighting each observed person by the inverse of the retention probability in that person’s group. Group A contributes \(30(1/0.80)=37.5\) weighted survivors and \(40(1/0.80)=50\) weighted people. Group B contributes \(15(1/0.50)=30\) weighted survivors and \(25(1/0.50)=50\) weighted people. Thus the weighted survival proportion is
As a check on the retention arithmetic, the expected observed fraction in the equally weighted target population is \(\{0.80+0.50\}/2=0.65\): 40 of 50 in group A and 25 of 50 in group B, or 65 of 100 overall. This overall fraction is not the survival estimate; the group-specific weights correct the unequal retention.
In longitudinal targeted maximum likelihood estimation (TMLE), the backward regressions estimate the \(Q_t\) functions, and sequential targeting updates these estimates so the final plug-in survival estimate reflects the relevant censoring-adjusted score. At interval \(t\), the regression outcome is zero for an event in that interval and otherwise is the next-time survival prediction. It is observed for the histories needed in that update only when follow-up continues. A standard targeting score therefore uses an inverse cumulative-retention factor: a retained observation is weighted in proportion to \(1/G_t\), with the precise index determined by whether the update is made before or after the interval-\(t\) retention decision. Under a treatment regime with treatment adherence also to be accounted for, the corresponding treatment factors enter as well; they are not censoring probabilities.
Worked Example: Reading a Two-Interval Sequential Update
Suppose there are no covariates, the estimated probability of surviving interval 1 is \(0.90\), the estimated conditional probability of surviving interval 2 among interval-1 survivors is \(0.80\), and \(75\%\) of those survivors remain observed for the second interval. The sequential survival plug-in is
For an update that uses the interval-2 outcome, the inverse-retention factor for people observed into interval 2 is \(1/0.75=4/3\). For example, an observed contribution of \(0.80\) to an inverse-retention weighted score has weighted value \((4/3)(0.80)=1.0667\), approximately. The weighted score contribution may exceed one; it is not itself a predicted survival probability. The final TMLE remains a plug-in estimate based on updated conditional predictions, rather than the raw weighted contribution.
The retention probability does not multiply survival as though dropout were an event. In particular, \(0.90(0.75)(0.80)=0.54\) would describe the probability of both surviving and remaining observed under this simplified setup, not the target survival probability. The target survival recursion uses \(0.90(0.80)=0.72\); the retention factor corrects the estimation procedure for who supplies the later information.
Why the Assumptions Matter: Diagnostics and Alternatives
The identification result is conditional, not automatic. A model for retention can be estimated from observed histories and used to calculate \(G_t\), but a fitted model cannot verify that dropout is independent of future outcomes after conditioning on those histories. Investigators should assess whether measured predictors of both dropout and survival are included, compare retention across important histories, and report how small estimated retention probabilities become. When some \(G_t\) values are near zero, inverse weights become large and estimates can be unstable; when a target history has zero chance of continued observation, positivity fails and the data do not identify its later survival without additional assumptions.
The main approaches have different strengths. Risk-set or product-limit estimation is direct and efficient in simple settings with independent censoring, but does not by itself adjust for complex measured histories. Inverse-probability-of-censoring weighting makes the correction explicit and can handle measured predictors of dropout, but extreme weights can inflate variability. Sequential regression models future survival conditional on history and can use covariates to predict outcomes; longitudinal TMLE adds targeted updates to these regressions while incorporating the censoring mechanism. Complete-case analysis is generally not a substitute: it selects people who stayed observed and is justified only under stronger conditions that make this selection harmless for the target.
A common mistake is to use one indicator for both event occurrence and dropout. For instance, setting \(\Delta_t=1\) whenever \(R_{t+1}=0\) makes dropout look like an event and generally lowers estimated survival. The correction is to record the event indicator only when event status was observed, retain a separate observation indicator, and use the retention assumption and probability to address missing future outcomes. Another mistake is to multiply the target survival by the probability of remaining observed. That estimates the chance of being both alive and observed, not survival in the target population.
Check Your Understanding
Answer each question, then compare with the solutions below.
- At the end of interval 1, a person is known to have survived but drops out before interval 2. Which indicator records the dropout, and is the person an interval-1 event?
- There are two equally common groups with retention probabilities \(0.80\) and \(0.50\). What is the average retention probability in the target population?
- With conditional survival estimates \(0.90\) and \(0.80\) in two successive intervals, what is the two-interval survival estimate?
- State the key conditional assumption that allows retained individuals to identify the full-data conditional survival recursion.
Solutions. (1) \(R_2=0\) records that the person is not observed at the start of interval 2; the person is not an interval-1 event because survival through interval 1 is known, so \(\Delta_1=0\). (2) The average is \((0.80+0.50)/2=0.65\). (3) The recursion gives \(0.90(0.80)=0.72\). (4) Sequential conditional independent censoring: given the recorded history and survival to the interval, continued observation is independent of the subsequent full-data outcomes relevant to the target; retention positivity is also required for those histories.