Tutorials › Competing Risks and Multi-State Models › Why One Minus Kaplan-Meier Is Not a Cause-Specific Risk

Cumulative Incidence Functions · Tutorial 53 of 699

Why One Minus Kaplan-Meier Is Not a Cause-Specific Risk

Learn to distinguish a cause-specific Kaplan–Meier complement from a cumulative incidence estimate, and see why competing events make the former larger.

Intermediate 10 min read

What You'll Learn

  • Identify what \(1-\widehat S_{KM,1}(t)\) estimates when competing events are treated as censored.
  • Calculate a cause-specific cumulative incidence using the Aalen–Johansen estimator.
  • Derive why the Kaplan–Meier complement is at least as large as the cumulative incidence estimate.
  • Recognize when the two estimates agree and when their difference matters.
  • Check assumptions and diagnose misleading interpretations of cause-specific risk.

Why the distinction matters

Suppose a study follows patients for a particular event, such as hospital readmission, while some patients die first. The question “What proportion experience readmission by one year?” concerns the event probability in the world where death can also occur. A calculation that treats death as censoring answers a different question: it removes those deaths from the risk set as though they were losses to follow-up. The resulting Kaplan–Meier complement is not, in general, the observed-world probability of readmission.

The distinction is not merely technical. If competing events are common, a Kaplan–Meier complement can give a noticeably larger number than the cumulative incidence estimate. The Aalen–Johansen estimator accounts for the fact that people who have already experienced a competing event can no longer experience the event of interest.

Definition: For cause 1, the cumulative incidence function \(F_1(t)\) is the probability that the event of interest occurs by time \(t\) and before any competing event. Its estimator, the Aalen–Johansen cumulative incidence estimator, weights each observed cause-1 event increment by the estimated probability of remaining free of every event just before that time. By contrast, \(1-\widehat S_{KM,1}(t)\) is the complement of a Kaplan–Meier estimate calculated with competing events treated as censored.

The two calculations

Consider event times \(t_1,\ldots,t_m\) observed by a chosen horizon \(t\). Let \(Y_j\) be the number at risk immediately before \(t_j\), \(d_{1j}\) the number of cause-1 events at \(t_j\), and \(d_j\) the number of events of all causes at \(t_j\). Let \(\widehat S(t_j-)\) denote the estimated probability of remaining free of every event just before \(t_j\). The Aalen–Johansen estimate is

$$ \widehat F_1(t) = \sum_{t_j\le t}\widehat S(t_j-)\frac{d_{1j}}{Y_j}, \qquad \widehat S(t_j-) = \prod_{t_\ell<t_j}\left(1-\frac{d_\ell}{Y_\ell}\right). $$

Each term has a direct interpretation: among those still free of events just before \(t_j\), the observed fraction with a cause-1 event is \(d_{1j}/Y_j\). The term multiplies that fraction by the estimated fraction still event-free at that point. Summing the increments gives the estimated probability of cause 1 occurring by \(t\).

For the competing-cause Kaplan–Meier calculation, competing events are instead treated as censored at their event times. The risk set immediately before each event time is still \(Y_j\), but only cause-1 events reduce the Kaplan–Meier survival estimate:

$$ \widehat S_{KM,1}(t) = \prod_{t_j\le t}\left(1-\frac{d_{1j}}{Y_j}\right), \qquad 1-\widehat S_{KM,1}(t) = \sum_{t_j\le t}\widehat S_{KM,1}(t_j-)\frac{d_{1j}}{Y_j}. $$

The last equality follows by telescoping the successive decreases in the Kaplan–Meier product. It shows the key difference: the Kaplan–Meier complement weights cause-1 increments by \(\widehat S_{KM,1}(t_j-)\), which accounts for having avoided cause 1, but not for having avoided competing events. The Aalen–Johansen estimate uses \(\widehat S(t_j-)\), which accounts for avoiding every event.

Why the Kaplan–Meier complement is larger

Assume the same observed risk sets are used in both calculations, event counts are nonnegative, and there are no complications from tied event times in the calculation. The all-cause event-free estimate includes competing events in its product; the cause-1 Kaplan–Meier estimate does not. Since \(d_j\ge d_{1j}\), each all-cause survival factor is no larger than the corresponding cause-1 factor:

$$ 1-\frac{d_j}{Y_j} \le 1-\frac{d_{1j}}{Y_j}. $$

Products of these nonnegative factors preserve the ordering. Therefore, just before every event time, \(\widehat S(t_j-)\le\widehat S_{KM,1}(t_j-)\). The cause-1 event fraction \(d_{1j}/Y_j\) is nonnegative, so each Aalen–Johansen increment is no larger than the corresponding increment in the Kaplan–Meier complement. Summing gives

$$ \widehat F_1(t)\le 1-\widehat S_{KM,1}(t). $$

The inequality is strict when a competing event has reduced the event-free estimate before a later cause-1 increment that is positive. If there are no competing events before any cause-1 events contributing by \(t\), the estimates agree. This is a comparison of the two estimates on the same data, not a claim that the Kaplan–Meier complement is always wrong for every possible target. It is not the observed-world cause-1 probability when competing events are possible.

Worked Example: Two Competing Events Reduce the Estimated Cause-1 Risk

Consider hypothetical follow-up of 10 people through time \(t=4\). There is one cause-2 event at time 1, one cause-1 event at time 2, another cause-2 event at time 3, and another cause-1 event at time 4. No one is censored before the horizon. The distinct event times and risk sets are:

TimeAt risk \(Y_j\)Cause-1 events \(d_{1j}\)Cause-2 events
11001
2910
3801
4710

For the Aalen–Johansen estimate, the all-cause event-free probability just before time 2 is \(9/10\). The cause-1 increment at time 2 is therefore \((9/10)(1/9)=0.1\). Just before time 4, the all-cause event-free probability is \((9/10)(8/9)(7/8)=7/10\). The cause-1 increment at time 4 is \((7/10)(1/7)=0.1\). Thus

$$ \widehat F_1(4) = \frac{9}{10}\frac{1}{9} + \frac{7}{10}\frac{1}{7} = 0.1+0.1 = 0.2000. $$

For the cause-1 Kaplan–Meier estimate, the cause-2 events are treated as censored. The cause-1 survival factors are \(1-1/9=8/9\) at time 2 and \(1-1/7=6/7\) at time 4. Hence

$$ 1-\widehat S_{KM,1}(4) = 1-\left(\frac{8}{9}\right)\left(\frac{6}{7}\right) = 1-\frac{48}{63} = \frac{5}{21} \approx 0.2381. $$

The Kaplan–Meier complement is about 0.0381, or 3.81 percentage points, higher. The Aalen–Johansen estimate is the estimated probability of cause 1 by time 4 in the setting where cause 2 can occur. The Kaplan–Meier complement has not counted the competing events as failures, so its cause-1 increments are given relatively larger weights.

Worked examples: when the estimates differ or agree

Worked Example: A Competing Event Before the Event of Interest

In a hypothetical group of five people, one person experiences a competing event at time 1, and one experiences cause 1 at time 2. The other three remain event-free through time 2. There is no censoring before the horizon \(t=2\). At time 2, \(Y=4\), and the estimated event-free probability just before that time is \(4/5\).

The Aalen–Johansen estimate is the cause-1 increment weighted by the fraction who remained free of all events:

$$ \widehat F_1(2) = \frac{4}{5}\frac{1}{4} = 0.2000. $$

When the competing event is treated as censored, the cause-1 Kaplan–Meier estimate starts with four people at risk at time 2. Its complement is \(1-(1-1/4)=0.2500\). Thus, on these data, the two estimates are 20% and 25%, respectively. The competing event is a real outcome that prevents a later cause-1 event for that person; it is not simply missing follow-up for the observed-world probability.

Worked Example: No Competing Events Before the Horizon

Suppose eight people are followed in a hypothetical example. One has a cause-1 event at time 1, another has a cause-1 event at time 2, and the remaining six are administratively censored after time 2. There are no competing events before \(t=2\). The risk sets are \(Y_1=8\) and \(Y_2=7\).

The Aalen–Johansen estimate is

$$ \widehat F_1(2) = \frac{1}{8} + \left(\frac{7}{8}\right)\frac{1}{7} = 0.1250+0.1250 = 0.2500. $$

The cause-1 Kaplan–Meier complement is

$$ 1-\widehat S_{KM,1}(2) = 1-\left(\frac{7}{8}\right)\left(\frac{6}{7}\right) = 1-\frac{6}{8} = 0.2500. $$

The estimates agree because no competing event reduces the all-cause event-free estimate before a cause-1 increment. Agreement in this special case does not make the two methods interchangeable when competing events occur.

Assumptions, interpretation, and diagnostics

These calculations assume that event types and event times are recorded correctly and that the risk set at each time contains the people still under observation and free of every event immediately beforehand. For estimates intended to represent a population, right censoring must be independent of the event process under the analysis design, or independent conditional on variables appropriately accounted for. A competing event is not independent censoring for the observed-world cause-1 probability: it determines that cause 1 cannot subsequently occur. Treating it as censored changes the estimand.

The Kaplan–Meier complement can be described as a net risk associated with the cause-1 hazard: it reflects cause-1 failure while the competing causes are removed from the calculation. Interpreting that quantity as the risk under an intervention that eliminates competing events requires additional assumptions. It should not automatically be read as a causal effect or as the probability that a patient would experience cause 1 if other causes were prevented.

Before interpreting a reported number, check the event coding, the risk-set convention, and which causes were treated as censoring. A useful diagnostic is to compare the cause-1 Kaplan–Meier complement with the Aalen–Johansen estimate at the same horizon. A substantial gap is plausible when competing events occur often or early. If the Kaplan–Meier complement is below the Aalen–Johansen estimate using the same event data and risk sets, check for a coding, implementation, or comparison error: the product-and-increment argument above gives the expected ordering.

QuantityHow competing events are handledInterpretation
Aalen–Johansen \(\widehat F_1(t)\)Included in the all-cause event-free probability and prevent later cause-1 eventsEstimated observed-world probability of cause 1 by time \(t\)
\(1-\widehat S_{KM,1}(t)\)Treated as censored in the cause-1 Kaplan–Meier calculationNet risk associated with cause 1; not generally the observed-world cause-1 probability

Neither estimate repairs informative loss to follow-up, incorrect cause classification, or a poorly chosen horizon. The Aalen–Johansen estimator answers the observed-world probability question under its censoring and data-quality assumptions; it does not by itself explain why risks differ between groups or establish a causal effect.

Common mistake

Common mistake: “Deaths were censored in the Kaplan–Meier calculation, so the resulting \(1-\widehat S_{KM,1}(t)\) is the proportion who would be readmitted by time \(t\), with deaths handled appropriately.” This reasoning confuses censoring with a competing event. Censoring represents incomplete observation of what happens next; death prevents a later readmission in the observed world. For the observed-world readmission probability, use the cumulative incidence estimate, which weights readmission increments by the probability of remaining free of all events.
Key takeaway: The cause-specific Kaplan–Meier complement weights cause-1 increments by survival from cause 1 alone. The Aalen–Johansen estimator weights them by survival from every cause. Consequently, with the same data and risk sets, the Kaplan–Meier complement is at least as large and is generally not the observed-world cause-specific risk.

Check Your Understanding

Work through each question, then compare with the solutions.

  1. In one sentence, explain why a competing event is not ordinary censoring when the target is the observed-world probability of cause 1 by time \(t\).
  2. Suppose a competing event occurs before any cause-1 event, and a cause-1 event occurs later. Which estimate is larger on the same data: the Aalen–Johansen estimate or the cause-1 Kaplan–Meier complement? Why?
  3. For eight people, suppose there is one competing event at time 1 and one cause-1 event at time 2; the remaining six are event-free through time 2. Calculate both estimates at time 2.
  4. Give a condition under which the two estimates agree through the horizon.

Solutions. (1) A competing event is an observed outcome that prevents a later event of interest, whereas censoring means later outcomes are unobserved. (2) The Kaplan–Meier complement is larger: the competing event reduces the all-cause event-free weight used by Aalen–Johansen but is treated as censoring in the cause-1 Kaplan–Meier calculation. (3) At time 2, \(Y=7\), and the all-cause event-free probability is \(7/8\). Thus \(\widehat F_1(2)=(7/8)(1/7)=0.1250\), while \(1-\widehat S_{KM,1}(2)=1-(1-1/7)=1/7\approx0.1429\). (4) They agree if there are no competing events before any cause-1 increments contributing by the horizon; in particular, they agree when no competing event occurs by that horizon.

Clinical Biostats