Tutorials › Competing Risks and Multi-State Models › Independent Censoring In Aalen-Johansen Estimation

Transition Intensities and Probabilities · Tutorial 308 of 699

Independent Censoring In Aalen-Johansen Estimation

Learn the censoring conditions behind Aalen–Johansen estimates, how they connect to transition probabilities, and how to recognize and address violations.

Advanced 11 min read

What You'll Learn

  • State the independent-censoring condition relevant to risk-set transition estimates
  • Distinguish independent censoring from the Markov assumption needed for transition probabilities
  • Calculate a risk-set transition-hazard increment and its product-integral update
  • Explain how censoring related to future transitions can bias an estimate
  • Recognize when conditional adjustment or weighting may be needed

Why Censoring Conditions Matter

Aalen–Johansen estimation builds transition estimates from people who are still observed and at risk in each state. Its risk sets are useful only if the observed people provide appropriate information about the transitions that would occur in the target population. When censoring selectively removes people with different future transition patterns, the remaining risk sets can give a misleading picture, even if the product-integral calculations are performed correctly.

A second condition is easy to overlook. Independent censoring can justify estimating state-specific transition intensities from risk sets, but it does not by itself make those intensities sufficient to recover every target transition probability. For the usual pooled Aalen–Johansen transition-probability interpretation, the process must also be Markov, or a suitable alternative model must justify that interpretation.

Definition: Let \(X(t)\) denote the state occupied at time \(t\), and let \(C\) be the right-censoring time. A risk-set-based estimate has independent censoring when, conditional on the information used to define the risk set (at least the observed state and time, and any covariates or history needed for the analysis), censoring does not convey additional information about the future transitions of those still at risk. The condition must hold for the target population and time range being analyzed.

This is a conditional statement, not necessarily the claim that \(C\) is unrelated to everything about a participant. Censoring may depend on observed covariates or the current state. The issue is whether, among people comparable on the information used in the analysis, those censored would have had the same future transition distribution as those remaining under observation. If censoring depends on a recorded covariate associated with transitions, an unadjusted pooled risk set may not be representative even when censoring is independent conditional on that covariate.

What the Risk-Set Calculation Assumes

For states \(j\) and \(k\), let \(Y_j(t)\) be the number observed and at risk in state \(j\) immediately before time \(t\), and let \(dN_{jk}(t)\) be the number of observed transitions from \(j\) to \(k\) at that time. At a transition time with \(Y_j(t)>0\), the Aalen–Johansen estimate of the cause-specific transition-intensity increment is

$$ d\widehat A_{jk}(t)=\frac{dN_{jk}(t)}{Y_j(t)}, \qquad j\ne k. $$

The diagonal increment is \(d\widehat A_{jj}(t)=-\sum_{k\ne j}d\widehat A_{jk}(t)\). The product integral combines these increments in time order to form an estimated transition matrix. The required risk-set condition is that the people still observed in state \(j\) at time \(t\) provide valid information about the transition intensity of the target people in that state at that time. There must also be adequate observation and a positive chance of remaining uncensored over the time range needed; if everyone at risk is censored before a transition can be observed, that transition intensity is not identified from the data.

For a precise transition-probability interpretation, suppose \(X(t)\) is a time-inhomogeneous Markov process: given its current state and time, its future does not additionally depend on its earlier state history. Write its transition intensity as \(q_{jk}(t)\). For small \(h>0\), the Markov condition gives

$$ P\{X(t+h)=k\mid X(t)=j,\text{ history through }t\} =q_{jk}(t)h+o(h), \qquad j\ne k. $$

The intensity depends on \(j\) and \(t\), not on unmodeled features of the path that led to state \(j\). Under this condition, independent censoring for the relevant risk sets, consistent recording of transitions and censoring, and adequate follow-up, the pooled risk-set estimates can estimate the transition intensities used to construct the target transition-probability matrix. If transition intensities depend on earlier history, risk-set estimates can still be calculated, but pooling people in the same current state can combine different histories. The resulting product integral should not automatically be described as a consistent estimate of the target conditional transition-probability matrix.

Worked Example: A Risk-Set Increment

Worked Example: A Risk-Set Increment

Suppose a hypothetical cohort has 20 people observed in state 1 immediately before time \(t=4\) years. At that time, 3 transition from state 1 to state 2, and 1 transitions from state 1 to state 3. Assume no other transition out of state 1 occurs at that instant. The risk set already excludes people censored before \(t=4\).

The estimated increments are

$$ d\widehat A_{12}(4)=\frac{3}{20}=0.15,\qquad d\widehat A_{13}(4)=\frac{1}{20}=0.05. $$

Thus the diagonal increment for state 1 is \(d\widehat A_{11}(4)=-(0.15+0.05)=-0.20\). The one-step product-integral factor for these transitions has row 1 equal to \((0.80,\,0.15,\,0.05)\), with entries ordered as states 1, 2, and 3. This row sums to 1. The calculation is an estimate from the observed risk set; interpreting it as estimating the target transition behavior requires the censoring and model conditions described above.

Why the Markov Condition Matters

The product integral propagates state probabilities using transition intensities indexed by current state and time. The Markov condition makes this propagation appropriate: once the current state and time are known, the transition rate does not need to distinguish how an individual arrived there. Without that condition, people in the same state at the same time may have different transition rates because of their prior paths or unmeasured characteristics. The observed risk-set rate is then an average over the histories represented among those still at risk. That average may change as the composition of the risk set changes, and it need not serve as a common transition intensity for every origin-state cohort in the target matrix.

Key distinction: Independent censoring addresses whether censoring distorts the transition information in risk sets. The Markov assumption addresses whether current state and time are sufficient to describe transition behavior for the target transition-probability matrix. One condition does not replace the other.

A short justification clarifies the role of censoring. At a fixed time, a risk-set ratio compares observed transitions with observed person-time in the state. Under independent censoring, remaining observed does not select people with different future transition behavior after conditioning on the information defining that risk set. With sufficient data and positivity, the ratio can therefore estimate the relevant transition intensity. But this argument does not establish that a single intensity \(q_{jk}(t)\) applies across different histories in state \(j\). That further conclusion comes from the Markov assumption, or from a correctly specified alternative that accounts for the history differences.

Worked Example: Future-Related Censoring Can Bias an Estimate

Worked Example: Future-Related Censoring Can Bias an Estimate

Consider a hypothetical population of 100 people in state 1 at baseline. Half have an unobserved high-risk characteristic and half a low-risk characteristic. By one year, 80% of the high-risk group and 20% of the low-risk group would transition to an absorbing event state. The target population transition probability is therefore

$$ 0.50(0.80)+0.50(0.20)=0.50. $$

Now suppose all 50 high-risk people are censored at 0.25 years, before their transitions would occur, while the low-risk group remains observed through one year. This censoring is related to future transition risk through the unobserved characteristic. At the event time, the observed risk set contains only the low-risk people. Ten of those 50 transition, so the risk-set increment is

$$ \frac{10}{50}=0.20. $$

With no other observed transitions, the estimated one-year event probability is 0.20, while the target probability is 0.50. The calculation is arithmetically correct for the observed risk set but does not recover the target population behavior. The missing high-risk transitions cannot be inferred from those remaining under observation without additional information or assumptions.

Addressing Conditional Censoring and Checking Assumptions

When censoring depends on measured covariates, an analysis can sometimes condition on those covariates, stratify the transition estimates, or use inverse-probability-of-censoring weights. Such approaches require that censoring be independent of future transitions after conditioning on the modeled information, that the censoring model be adequately specified, and that there be a positive probability of remaining uncensored across relevant covariate patterns and times. A weighted or adjusted estimate is not automatically valid merely because a model was fitted.

Worked Example: A Simple Censoring-Weighted Risk-Set Rate

Suppose a hypothetical baseline cohort has 10 people in each of two measured covariate groups, \(Z=0\) and \(Z=1\), all initially in state 1. At a particular transition time, 5 people with \(Z=0\) and all 10 with \(Z=1\) remain at risk. There is 1 observed transition in the \(Z=0\) group and 4 in the \(Z=1\) group. Assume the estimated probabilities of remaining uncensored to this time are \(G_0=0.50\) and \(G_1=1.00\), and censoring is independent of future transitions conditional on \(Z\).

An inverse-probability weighted rate uses weight \(1/G_z\) for each observed person. The weighted numerator is \(1(1/0.50)+4(1/1.00)=6\), and the weighted denominator is \(5(1/0.50)+10(1/1.00)=20\). Thus the estimated increment is

$$ \frac{6}{20}=0.30. $$

The unweighted rate is \((1+4)/(5+10)=0.3333\). The weighted calculation corrects the different representation of the two measured groups under the stated assumptions; it does not fix dependence on unmeasured future risk, an incorrect censoring model, or a violation of positivity.

Useful diagnostics include comparing censoring patterns across observed states, times, and measured risk factors; checking whether few or no people remain at risk in important groups; and examining sensitivity to plausible censoring models. Such checks can reveal sparse support or measured patterns that merit adjustment. They cannot prove independence from unobserved future transitions. Administrative end of follow-up may be plausibly independent by design, but loss to follow-up related to worsening health, treatment changes, or impending transitions deserves particular scrutiny.

Common Mistake and Limitations

Wrong reasoning: “Censoring is independent, so the Aalen–Johansen estimator consistently estimates the transition-probability matrix.” Correction: Independent censoring supports valid risk-set information, conditional on the relevant risk-set information. The usual pooled transition-probability interpretation also needs the Markov condition, or another justified model that accounts for history dependence. State-specific risk-set rates alone do not establish that condition.

The method also cannot recover transition behavior beyond times with adequate observation without additional assumptions. Dependence on unmeasured prognostic factors is especially difficult: observed data may not distinguish informative censoring from a genuinely different transition pattern. Alternative analyses can include covariate-adjusted transition models, stratified estimates, or censoring-weighted procedures, but each targets a particular population and relies on its own modeling and positivity conditions. These methods do not remove uncertainty about unobserved causes of censoring.

Practical takeaway: Before interpreting an Aalen–Johansen product integral as a target transition-probability matrix, state the target population, justify independent censoring for its risk sets, check follow-up support, and justify the Markov assumption or a suitable alternative.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. In a risk set of 40 people in state \(j\), 6 transition to \(k\) at time \(t\). What is \(d\widehat A_{jk}(t)\), and what assumptions are needed to interpret it as an estimate of a target transition intensity?
  2. Why does independent censoring alone not guarantee that a pooled Aalen–Johansen estimate is the target conditional transition-probability matrix?
  3. If censoring depends on a measured covariate associated with transition risk, name one possible strategy and two assumptions it requires.
  4. Suppose the observed event fraction is smaller than the target event probability because high-risk people were censored before their events. Is the problem a product-integral arithmetic error? Explain.

Solutions. (1) \(d\widehat A_{jk}(t)=6/40=0.15\). The risk set must represent the relevant target transitions under the independent-censoring condition, with adequate follow-up and correctly recorded events. (2) Independent censoring concerns selection into observed risk sets; it does not ensure that people in a current state share transition behavior regardless of their earlier histories. The usual pooled matrix interpretation requires a Markov process or another justified model. (3) One option is inverse-probability-of-censoring weighting. It requires conditional independent censoring given modeled information, a sufficiently correct censoring model, and positive censoring survival probabilities in relevant groups and times. (4) No. The arithmetic can be correct for the observed risk set; selective removal of high-risk people makes that risk set unrepresentative of the target population, so the estimate can be biased.

Clinical Biostats