Tutorials › Competing Risks and Multi-State Models › Worked Chronic Disease Progression and Mortality Predictions

Landmarking and Dynamic Prediction · Tutorial 500 of 699

Worked Chronic Disease Progression and Mortality Predictions

Calculate and interpret landmark state-occupation probabilities for people currently healthy or progressed, then combine predictions correctly for a target population.

Advanced 12 min read

What You'll Learn

  • Define landmark state-occupation probabilities for a three-state chronic disease model.
  • Calculate future probabilities from the healthy and progressed states at specified horizons.
  • Derive the transition probabilities from constant transition rates.
  • Combine state-specific predictions using valid target-population weights.
  • Check probability sums and identify common errors in weighted predictions.
  • Recognize the assumptions and limitations of the model-based predictions.

Landmark Predictions in a Chronic Disease Model

At a landmark time, prediction starts from a person’s state at that time, not from their state at the beginning of follow-up. For a chronic disease, a useful simplified model distinguishes people who are healthy, people whose disease has progressed, and people who have died. A clinician may want to know the probabilities of occupying each state one or more years after a particular assessment, conditional on the person’s current state.

The key calculation is to follow each possible path through the states over the prediction horizon. A person currently healthy may remain healthy, progress and remain alive, or die before progression or after it. Someone already in the progressed state cannot return to the healthy state under this model. Predictions for a target group can then be formed by averaging the conditional predictions using the group’s actual distribution of landmark states.

Definition: Let the states be \(H\) (healthy), \(P\) (progressed disease), and \(D\) (dead). For a person in state \(i\) at a landmark, \(p_{ij}(u)\) is the probability of occupying state \(j\) after \(u\) units of time, conditional on being in state \(i\) at the landmark. The probabilities \(p_{iH}(u)\), \(p_{iP}(u)\), and \(p_{iD}(u)\) describe state occupation at that horizon, not merely the first event that occurs.

For the calculations below, assume a time-homogeneous continuous-time Markov model with transitions \(H\to P\), \(H\to D\), and \(P\to D\), and no other transitions. Let the corresponding constant transition rates be \(\alpha\), \(\beta\), and \(\gamma\), respectively. Conditional on the current state, the model assumes that future transitions depend on the present state and not on earlier history, and that these rates remain constant throughout the prediction period. State \(D\) is absorbing: a person who has died remains dead.

The total rate of leaving \(H\) is \(\lambda_H=\alpha+\beta\). The time to leave \(H\) is therefore exponentially distributed with rate \(\lambda_H\). In particular, a healthy person can still be healthy at horizon \(u\) only if no transition out of \(H\) has occurred.

Deriving the State-Occupation Probabilities

Starting in \(H\), the probability of remaining healthy through time \(u\) is \(e^{-\lambda_Hu}\). To occupy \(P\) at time \(u\), the person must progress from \(H\) at some time \(s\) between 0 and \(u\), and then remain in \(P\) until \(u\). The density of progression at time \(s\), with no earlier exit from \(H\), is \(\alpha e^{-\lambda_Hs}\). The probability of surviving in \(P\) from \(s\) to \(u\) is \(e^{-\gamma(u-s)}\). Multiplying and integrating over possible progression times gives the probability of occupying \(P\).

$$ p_{HP}(u) =\int_0^u \alpha e^{-\lambda_Hs}e^{-\gamma(u-s)}\,ds =\frac{\alpha}{\gamma-\lambda_H} \left(e^{-\lambda_Hu}-e^{-\gamma u}\right), \qquad \gamma\ne\lambda_H. $$

The last equality follows by factoring out \(e^{-\gamma u}\) and integrating \(e^{(\gamma-\lambda_H)s}\) from 0 to \(u\). If \(\gamma=\lambda_H\), the integral instead gives \(\alpha u e^{-\lambda_Hu}\), the continuous limiting case. Finally, because the three states are mutually exclusive and exhaustive at horizon \(u\), the probability of occupying \(D\) is the remainder.

$$ p_{HH}(u)=e^{-\lambda_Hu}, \qquad p_{HD}(u)=1-p_{HH}(u)-p_{HP}(u). $$

Starting in \(P\), the only possible transition is to death. Thus \(p_{PP}(u)=e^{-\gamma u}\) and \(p_{PD}(u)=1-e^{-\gamma u}\); both probabilities of occupying \(H\) are zero. Starting in \(D\), the probabilities are \(p_{DD}(u)=1\) and \(p_{DH}(u)=p_{DP}(u)=0\). Each starting state therefore has a complete row of state-occupation probabilities that sums to one.

Worked Example: Predicting From the Healthy State

Suppose, hypothetically, that the annual rate of progression from healthy to progressed disease is \(\alpha=0.24\), the annual rate of death directly from the healthy state is \(\beta=0.06\), and the annual rate of death from the progressed state is \(\gamma=0.40\). Calculate the probabilities one year after a landmark for a person who is healthy at that landmark.

The total rate out of \(H\) is \(\lambda_H=0.24+0.06=0.30\) per year. For \(u=1\) year, the healthy-state probability is \(p_{HH}(1)=e^{-0.30}=0.7408\).

The progressed-state probability is \(p_{HP}(1)=\frac{0.24}{0.40-0.30}(e^{-0.30}-e^{-0.40})=2.4(0.7408-0.6703)=0.1692\). The coefficient \(\alpha/(\gamma-\lambda_H)=2.4\) is dimensionless, and the difference of exponentials is dimensionless, so their product is a probability.

The remaining probability is \(p_{HD}(1)=1-0.7408-0.1692=0.0900\), allowing for rounding. Thus the one-year predictions are about 74.08% healthy, 16.92% progressed, and 9.00% dead, conditional on being healthy at the landmark. They sum to 100% up to rounding.

Predictions Depend on Both Current State and Horizon

A prediction is not specified by a transition model alone: it also requires a current state and a future horizon. In this model, the same rates produce different probabilities for a person currently healthy and a person currently progressed. Changing the horizon also changes every state-occupation probability, even when the rates stay fixed.

Worked Example: Comparing Current States and Horizons

Use the hypothetical rates from the preceding example. Calculate the one-year prediction for a person currently in \(P\), then the two-year prediction for a person currently in \(H\).

Currently progressed, one year ahead. Since the only transition from \(P\) is to \(D\), the probability of remaining progressed is \(e^{-0.40(1)}=0.6703\), and the probability of being dead is \(1-0.6703=0.3297\). The probability of being healthy is zero. Therefore, the prediction is 67.03% progressed and 32.97% dead at one year.

Currently healthy, two years ahead. The healthy-state probability is \(e^{-0.30(2)}=e^{-0.60}=0.5488\). The progressed-state probability is \(p_{HP}(2)=2.4(e^{-0.60}-e^{-0.80})=0.2388\). The dead-state probability is \(p_{HD}(2)=1-e^{-0.60}-2.4(e^{-0.60}-e^{-0.80})=0.2124\). Thus the two-year prediction is approximately 54.88% healthy, 23.88% progressed, and 21.24% dead.

These are probabilities of occupying each state at the stated horizon. For example, the two-year dead-state probability includes death after progression as well as death directly from the healthy state. It is not just the probability of a direct \(H\to D\) transition.

Combining Predictions for a Target Group

A group prediction must use the distribution of current states in the target population at the landmark. If a fraction \(w_H\) is healthy, \(w_P\) is progressed, and \(w_D\) is dead, with \(w_H+w_P+w_D=1\), then the group probability of occupying state \(j\) after \(u\) is \(w_Hp_{Hj}(u)+w_Pp_{Pj}(u)+w_Dp_{Dj}(u)\). For a prediction among people alive at the landmark, \(w_D=0\) and \(w_H+w_P=1\).

Worked Example: Averaging Over Landmark States

Suppose, hypothetically, that among people alive at a landmark, 70% are healthy and 30% have progressed disease. Use the rates above and predict occupation at one year. The correct weights are \(w_H=0.70\) and \(w_P=0.30\), which sum to one.

For the healthy state, only those currently healthy can occupy \(H\) later: \(0.70(0.7408)+0.30(0)=0.5186\). For the progressed state, both current-state groups can contribute: \(0.70(0.1692)+0.30(0.6703)=0.1184+0.2011=0.3195\). For death, both groups can also contribute: \(0.70(0.0900)+0.30(0.3297)=0.0630+0.0989=0.1619\).

The group prediction is therefore about 51.86% healthy, 31.95% progressed, and 16.19% dead. The probabilities sum to \(0.5186+0.3195+0.1619=1.0000\), subject to rounding. This is a valid average because each current-state prediction is weighted by that state’s actual share of the landmark population.

A useful arithmetic check is to evaluate alternative expressions carefully. For example, \(0.70\{2.4(e^{-0.30}-e^{-0.40})+0.30e^{-0.40}\}=0.2592\), or 25.92%, and \(0.70\{1-e^{-0.30}-2.4(e^{-0.30}-e^{-0.40})+0.30(1-e^{-0.40})\}=0.1322\), or 13.22%. These are the values of those expressions, but they are not the group’s progressed and dead probabilities: the group weights have been placed incorrectly. In particular, \(0.30\) is already the share of the progressed-at-landmark group and must not be multiplied by an additional \(0.70\). Use \(0.70p_{Hj}+0.30p_{Pj}\) for each destination \(j\), then check that the three resulting probabilities sum to one.

Assumptions, Diagnostics, and Alternatives

The calculations are exact for the stated constant-rate model, but that does not establish that the model describes a particular chronic disease well. Before interpreting predictions, check whether the model’s structure and assumptions are credible for the intended target population and landmark:

  • Allowed transitions. The model rules out recovery from \(P\) to \(H\) and any other unlisted transition. If such transitions are clinically possible and relevant, the three-state structure may be inadequate.
  • Constant rates. The rates are assumed not to vary over the prediction interval. If transition rates change with time since the landmark, age, treatment, or disease duration, constant-rate predictions may be systematically inaccurate.
  • Markov conditioning. The future is assumed to depend on the current state, not on how long the person has already been in it or on earlier history. The earlier material on semi-Markov prediction addresses duration-conditioned predictions when this assumption is unsuitable.
  • Target population and landmark information. The current-state weights and any covariates used for prediction must represent the target population at the landmark. Information arising after that landmark must not be used as if it were already available.

Diagnostics should include checking that all calculated probabilities lie between zero and one and that each starting-state row sums to one. For fitted rates, examine whether the model’s implied transition patterns are plausible across time and relevant subgroups, and compare predicted state proportions with observed follow-up patterns when suitable data are available. A probability sum that is materially different from one usually signals an arithmetic error, omitted state, or incorrect weighting; it is not evidence of an unusual disease process.

Transition-based prediction, as used here, builds state-occupation probabilities from transition-specific rates and the possible paths through the model. A direct landmark approach instead models the probability of the future state at a specified horizon without requiring the same transition decomposition. These approaches answer closely related prediction questions but rely on different modeling structures. The direct approach is not a substitute for checking the transition model’s assumptions, and a transition model’s path interpretation does not by itself guarantee better predictive performance.

The main limitation of the worked calculations is their simplicity: constant rates and three states may be too restrictive for real chronic disease. More flexible models can allow time-varying rates or additional predictors, but predictions still need a clearly defined landmark, target population, current state, and horizon. Uncertainty in estimated rates also means that model-based probabilities are estimates, not known individual outcomes.

Common Mistakes

  • Using the wrong starting state. A prediction conditional on being healthy at the landmark is not interchangeable with one conditional on progressed disease. Start with the state the person actually occupies at the landmark.
  • Confusing state occupation with a transition probability. The probability of being dead at \(u\) includes every allowed path ending in death by \(u\), not only direct death from the starting state.
  • Applying population weights twice. If 30% of the target group is currently progressed, the progressed-state prediction is weighted by 0.30—not by \(0.70\times0.30\).
  • Ignoring probability conservation. For each starting state, and for a valid weighted group prediction, probabilities across \(H\), \(P\), and \(D\) must sum to one.
  • Treating model output as a personal certainty. A predicted probability describes a model-based distribution for people with the specified landmark information; it does not determine an individual’s future state.
Key takeaway: State-occupation prediction requires a specified landmark state and horizon. Calculate the conditional probabilities under the transition model, average them using target-population weights that sum to one, and verify that the resulting state probabilities also sum to one.

Check Your Understanding

Answer each question using the model and rates in the worked examples. Solutions are included for checking.

  1. For a person currently healthy, what is the probability of remaining healthy for one year? Solution: \(e^{-0.30}=0.7408\), or 74.08%.
  2. For a person currently progressed, can the probability of being healthy one year later be positive in this model? Solution: No. The model contains no \(P\to H\) transition, so \(p_{PH}(1)=0\).
  3. Why does the one-year death probability for someone currently healthy include more than direct \(H\to D\) deaths? Solution: Someone can progress first and then die before the one-year horizon; both paths end in \(D\) at the horizon.
  4. If 60% of a target group is healthy and 40% progressed at the landmark, how should the group’s probability of being progressed at horizon \(u\) be calculated? Solution: Use \(0.60p_{HP}(u)+0.40p_{PP}(u)\). These are the target group’s state shares, so they are applied once and sum to one.
  5. What should be checked if a calculated set of group probabilities sums to 0.91? Solution: Check the state-specific calculations and the landmark weights. Since the states are exhaustive and the weights should sum to one, a total of 0.91 indicates a calculation or weighting error, or an explicitly omitted state.
Clinical Biostats