Tutorials › Competing Risks and Multi-State Models › Worked Illness-Death Regression Analysis

Regression for Multi-State Data · Tutorial 382 of 699

Worked Illness-Death Regression Analysis

Learn how to fit and interpret separate transition-specific Cox regressions for illness-death data, and how to check whether their assumptions are plausible.

Advanced 11 min read

What You'll Learn

  • Define the risk set separately for each illness-death transition.
  • Use the transition-specific partial likelihood and state its assumptions.
  • Interpret age and treatment hazard ratios for each transition.
  • Calculate Wald confidence intervals and tests from fitted coefficients.
  • Diagnose proportional-hazards problems and compare transition-specific models with alternatives.

Why Fit a Separate Regression for Each Transition?

In an illness-death model, a person may move from an unoccupied state to an ill state, move directly from unoccupied to death, or die after becoming ill. These are distinct processes: the people at risk of becoming ill are not the same as the people at risk of dying after illness. A worked regression analysis must therefore make the state-specific risk sets and interpretations explicit.

Here, state 0 means unoccupied, state 1 means ill, and state 2 means death; state 2 is absorbing. We fit a Cox proportional-hazards regression for each allowed transition: \(0\to1\), \(0\to2\), and \(1\to2\). Age is baseline age measured in decades, and treatment is an indicator coded 1 for treated and 0 for untreated. Thus an age coefficient compares people whose baseline ages differ by 10 years, and a treatment coefficient compares treated with untreated people.

Definition: For transition \(r\to s\), the transition-specific hazard is the instantaneous rate of moving from state \(r\) to state \(s\), conditional on being in state \(r\) immediately before time \(t\) and on the covariate and observed-history information specified by the model. A transition-specific Cox model writes this hazard as \(h_{rs}(t\mid x)=h_{0,rs}(t)\exp(\beta_{rs}^{\mathsf T}x)\). Each transition has its own unspecified baseline hazard \(h_{0,rs}(t)\) and its own coefficient vector \(\beta_{rs}\).

For this analysis, follow-up time \(t\) is measured from study entry for all three transitions. Baseline age and treatment are fixed covariates. For \(0\to1\) and \(0\to2\), a person is at risk while still in state 0. For \(1\to2\), a person is at risk only after entering state 1 and until death or censoring. A person who becomes ill leaves the state-0 risk sets and enters the state-1 risk set.

Model, Risk Sets, and Assumptions

Let \(Y_i^{rs}(t)=1\) if person \(i\) is under observation and in state \(r\) immediately before time \(t\), and 0 otherwise. Let \(N_i^{rs}(t)\) count that person's observed \(r\to s\) transitions by time \(t\). The model for an allowed transition is

$$ h_{i,rs}(t\mid x_i)=h_{0,rs}(t)\exp\{\beta_{rs,\text{age}}x_{i,\text{age}}+\beta_{rs,\text{trt}}x_{i,\text{trt}}\}, \qquad Y_i^{rs}(t)=1. $$

The Cox partial likelihood compares the covariates of the person who makes a transition with those of people in that transition's risk set at the same event time. It does not require a parametric form for \(h_{0,rs}(t)\). Its usual interpretation relies on a correctly specified proportional-hazards model for that transition, suitable covariate form, correctly recorded transition and censoring times, and censoring that is independent of the future transition process conditional on modeled covariates and relevant history. Repeated transitions from the same person are not treated as independent observations; the state history determines which transition risk sets that person enters.

A key assumption is that each transition-specific covariate effect is proportional over the chosen time scale. For example, the treatment hazard ratio for \(1\to2\) is assumed constant over follow-up among people currently in state 1. This does not require the baseline hazards to be the same across transitions. It also does not imply that the transition probabilities are proportional or that a hazard ratio is a risk ratio.

Why the Partial Likelihood Has This Form

Suppose, for one transition \(r\to s\), that event times are distinct. At an event time \(t_k\), condition on exactly one \(r\to s\) transition occurring among the people in the risk set \(R_{rs}(t_k)=\{i:Y_i^{rs}(t_k)=1\}\). Under the Cox model, the event rate for person \(i\) is proportional to \(h_{0,rs}(t_k)\exp(\beta_{rs}^{\mathsf T}x_i)\). The conditional probability that the event is person \(i_k\)'s is therefore

$$ \frac{h_{0,rs}(t_k)\exp(\beta_{rs}^{\mathsf T}x_{i_k})} {\sum_{j\in R_{rs}(t_k)}h_{0,rs}(t_k)\exp(\beta_{rs}^{\mathsf T}x_j)} = \frac{\exp(\beta_{rs}^{\mathsf T}x_{i_k})} {\sum_{j\in R_{rs}(t_k)}\exp(\beta_{rs}^{\mathsf T}x_j)}. $$

The common baseline hazard cancels. Multiplying these conditional contributions over event times for this transition gives its partial likelihood:

$$ L_{rs}(\beta_{rs})= \prod_{k:\,r\to s\text{ event}} \frac{\exp(\beta_{rs}^{\mathsf T}x_{i_k})} {\sum_{j\in R_{rs}(t_k)}\exp(\beta_{rs}^{\mathsf T}x_j)}. $$

The three models use different risk sets and estimate separate coefficient vectors. If event times are tied, the distinct-time expression is not directly applicable; a specified ties method, such as Efron's approximation or the Breslow approximation, is used. Results should report which method was used when ties are present.

Worked Example: One \(0\to1\) Partial-Likelihood Contribution

Consider hypothetical fitted coefficients for the \(0\to1\) model: \(\hat\beta_{\text{age}}=0.28\) per decade and \(\hat\beta_{\text{trt}}=-0.36\). At one event time, suppose A, B, and C are the only people in state 0 and under observation. A makes the \(0\to1\) transition. Their age covariates (in decades relative to the chosen reference) and treatment indicators are A: \((0,0)\), B: \((1,1)\), and C: \((2,0)\).

Their fitted linear predictors are \(0\), \(0.28-0.36=-0.08\), and \(2(0.28)=0.56\). The corresponding relative hazard weights are \(\exp(0)=1\), \(\exp(-0.08)=0.9231\), and \(\exp(0.56)=1.7507\). Since A is the event, this time's partial-likelihood contribution is

$$ \frac{1}{1+0.9231+1.7507} = \frac{1}{3.6738} = 0.2722. $$

Only people in state 0 just before this event belong in this \(0\to1\) risk set. Someone who had already become ill would not be included, even if that person remained under observation. The contribution illustrates how the model compares the event person's covariates with those of the people eligible for that particular transition.

Worked Illness-Death Regression Results

Suppose a hypothetical study fits the three Cox models separately, using the covariates and coding defined above. The table reports coefficient estimates and model-based standard errors. Hazard ratios are exponentiated coefficients. For illustration, the confidence intervals and p-values below use the large-sample Wald method; they are approximate.

TransitionCovariateEstimateSEHazard ratio95% Wald CI for hazard ratioWald p-value
\(0\to1\)Age, per decade0.280.101.3231.088 to 1.6100.0051
\(0\to1\)Treatment, 1 vs 0-0.360.240.6980.436 to 1.1170.134
\(0\to2\)Age, per decade0.450.151.5681.169 to 2.1040.0027
\(0\to2\)Treatment, 1 vs 0-0.100.300.9050.503 to 1.6290.739
\(1\to2\)Age, per decade0.200.181.2210.858 to 1.7380.267
\(1\to2\)Treatment, 1 vs 0-0.550.270.5770.340 to 0.9790.0416

Worked Example: Interpreting the \(0\to1\) Age Effect

For age in the \(0\to1\) model, the estimated coefficient is 0.28 with standard error 0.10. The hazard ratio for a 10-year increase in baseline age, holding treatment fixed, is

$$ \exp(0.28)=1.323. $$

Thus, among people still in state 0 and otherwise compared at the same treatment value, a 10-year increase in baseline age is associated with an estimated 1.323-fold instantaneous hazard of becoming ill, or about 32.3% higher transition hazard. This is an association in the \(0\to1\) hazard, not a claim about the probability of ever becoming ill.

The Wald statistic for \(H_0:\beta_{\text{age}}=0\) is \(z=0.28/0.10=2.80\), with a two-sided standard-normal p-value of about 0.0051. A 95% coefficient interval is \(0.28\pm1.96(0.10)=(0.084,0.476)\). Exponentiating both endpoints gives \((\exp(0.084),\exp(0.476))=(1.088,1.610)\). Under the model and its large-sample approximation, this procedure produces a 95% confidence interval for the \(0\to1\) hazard ratio of 1.088 to 1.610 per 10 years. It excludes 1, consistent with the Wald test at the 0.05 level.

Worked Example: Interpreting Treatment Effects Across Transitions

For the \(0\to1\) transition, the treatment estimate is \(-0.36\). Its hazard ratio is \(\exp(-0.36)=0.698\), rounded to three decimal places. The Wald statistic is \(-0.36/0.24=-1.50\), giving a two-sided p-value of about 0.134. The 95% coefficient interval is \(-0.36\pm1.96(0.24)=(-0.8304,0.1104)\); exponentiating gives a hazard-ratio interval of 0.436 to 1.117. These data do not provide strong evidence of a treatment association with the \(0\to1\) transition at the 0.05 level. The interval also allows values on either side of 1.

For \(1\to2\), treatment has estimate \(-0.55\) and standard error 0.27. The hazard ratio is \(\exp(-0.55)=0.577\), and the Wald statistic is \(-0.55/0.27=-2.04\), with two-sided p-value about 0.0416. The 95% coefficient interval is \(-0.55\pm1.96(0.27)=(-1.0792,-0.0208)\); exponentiating gives 0.340 to 0.979. Conditional on being ill and the modeled covariates, the estimated instantaneous death hazard for treated people is 0.577 times that for untreated people. The interval excludes 1, but it is a transition-hazard association, not an estimated treatment effect on overall survival or a causal conclusion. Causal interpretation would require additional design and confounding assumptions.

The treatment estimates differ by transition. For \(0\to1\), the estimate is \(-0.36\); for \(0\to2\), it is \(-0.10\); and for \(1\to2\), it is \(-0.55\). These are not interchangeable coefficients: each describes a distinct transition hazard and is estimated from its own risk set. A difference in point estimates alone does not establish that the effects differ statistically; a formal comparison must account for the covariance of the estimates.

Diagnostics, Alternatives, and Limitations

Diagnostics should be examined separately for each transition, because a satisfactory fit on one edge does not validate the others. Check that the recorded state histories produce the intended risk sets and that event counts are adequate for the number of fitted terms. Inspect whether age has a plausible functional form, assess proportional hazards over the specified time scale (for example, with transition-specific Schoenfeld residuals), and investigate influential observations. If treatment or age effects vary over time, a constant-coefficient Cox model can give a misleading average summary. Sparse events, especially for \(1\to2\), can lead to unstable estimates and wide intervals.

The standard Cox model here uses baseline age. If the scientific question requires attained age as a changing covariate, the analysis must specify its time-varying form and ensure that values are defined appropriately as people move between states. The time scale must also be chosen deliberately; changing from time since entry to time since illness onset changes the risk-set comparisons and the meaning of baseline hazards. These decisions should be made before interpreting coefficients.

A transition-specific Cox analysis is one option among several. A model with a shared coefficient across transitions imposes a common-effect constraint; a stratified Cox model with transition-specific covariate interactions can instead allow edge-specific effects. Parametric proportional-hazards models specify baseline-hazard forms, while piecewise-exponential regression represents hazards as constant within chosen time intervals. Additive-hazards regression models absolute hazard differences rather than multiplicative hazard ratios. These alternatives answer related but not identical questions; their assumptions and interpretive scales should guide selection.

Separate Cox regressions do not, by themselves, produce state-occupation probabilities or the probability of a particular path by a given time. Those quantities require combining transition information under an appropriate multi-state probability calculation. Nor do edge-specific associations automatically identify causal effects. Results can also be sensitive to model misspecification, informative censoring, measurement error, and sparse transition events.

Common pitfall: It is incorrect to place everyone who is still alive in the \(1\to2\) risk set, or to interpret the \(1\to2\) treatment hazard ratio as a treatment effect on death for the full enrolled cohort. The correction is to include a person in that risk set only while the person is observed in state 1, and to interpret the coefficient as a conditional association for the transition out of state 1.
1
Define transitions and time.
State which transitions are allowed, specify the time origin, and define covariate coding and units.
2
Construct each risk set.
For every transition event, include only people under observation and in the appropriate origin state immediately beforehand.
3
Fit and check each Cox model.
Estimate a separate coefficient vector for each transition, specify the handling of ties, and assess model assumptions edge by edge.
4
Report effects in context.
Exponentiate coefficients, state the hazard-ratio contrast and units, and distinguish transition-specific hazards from overall risks.

Check Your Understanding

Answer each question, then compare with the solutions below.

  1. A person moves from state 0 to state 1 and later dies. Which transition risk set contains that person immediately before death?
  2. For a \(0\to2\) age coefficient of 0.45 per decade, what hazard ratio does the model estimate for a 10-year increase?
  3. For a \(1\to2\) treatment estimate of \(-0.55\), what is the hazard ratio, and what does it compare?
  4. Why should a person who has already entered state 1 not remain in the \(0\to1\) risk set?

Solutions. (1) The person is in the \(1\to2\) risk set immediately before death, because the person is then observed in state 1. (2) \(\exp(0.45)=1.568\), so the estimated \(0\to2\) transition hazard is 1.568 times as high per 10-year increase in baseline age, holding the other modeled covariate fixed. (3) \(\exp(-0.55)=0.577\); it compares the instantaneous death hazard for treated versus untreated people who are in state 1, conditional on the model covariates. (4) The \(0\to1\) transition has already occurred for that person, so the person is no longer eligible to make that transition; they leave the state-0 risk set and enter the state-1 risk set.

Clinical Biostats