Tutorials › Competing Risks and Multi-State Models › Direct Multinomial Landmark Models for State Occupation

Landmarking and Dynamic Prediction · Tutorial 502 of 699

Direct Multinomial Landmark Models for State Occupation

Learn to fit and interpret a multinomial model that predicts the probability of occupying each state at a chosen horizon, conditional on a person's state and covariates at a landmark.

Advanced 10 min read

What You'll Learn

  • Define a fixed-horizon state-occupation outcome for each eligible landmark.
  • Specify a multinomial logistic model with landmark state and covariates.
  • Convert fitted category logits into probabilities that sum to one.
  • Interpret multinomial coefficients as changes in category odds relative to a reference state.
  • Identify the censoring, support, and repeated-landmark assumptions needed for inference.
  • Calculate predictions for hypothetical patients and distinguish them from transition-based predictions.

Why Model State Occupation Directly?

At a landmark time, a clinician may want to know the probability that a person will be in each possible state one year later, given the state the person occupies now and covariates measured at the landmark. A direct multinomial model treats the state at that fixed future horizon as a single categorical outcome. It therefore targets the desired horizon-specific probabilities without separately modeling the sequence or timing of transitions between the landmark and horizon.

The prediction is conditional: it applies to people eligible for prediction at the landmark, with the stated current state and covariate values. It is not a probability of a particular transition path. The earlier material on conditioning on the current state and using landmark covariates provides the prediction setting; here the focus is specifying and interpreting the direct regression model.

Definition: Let \(S_i(t)\) denote the state of person \(i\) at time \(t\). For a landmark at time \(t\) and a fixed horizon \(h>0\), the outcome is \(Y_i(t,h)=S_i(t+h)\), taking values in the finite state set \(\mathcal S=\{1,\ldots,K\}\). A direct landmark model estimates \(P\{Y_i(t,h)=k\mid S_i(t)=r,\ X_i(t)=x,\ i\text{ eligible at }t\}\) for each future state \(k\), where \(r\) is the landmark state and \(X_i(t)\) contains covariates available at that time.

The time origin and horizon must be specified. For example, “one year after the landmark” is different from “one year after diagnosis” unless the landmark is diagnosis. The target population is also defined by eligibility at the landmark; it is not automatically the original cohort.

Multinomial Logistic Specification

Choose one future state \(K\) as the reference category. Let \(z_i(t)\) be the model covariate vector, which can include indicators for the landmark state, measured covariates, and prespecified interactions. For each non-reference future state \(k\), multinomial logistic regression specifies the log odds of state \(k\) rather than the reference state as a linear function of those predictors:

$$ \log\left\{ \frac{P(Y_i(t,h)=k\mid z_i(t))} {P(Y_i(t,h)=K\mid z_i(t))} \right\} =\eta_{ik}(t) =\beta_{k0}+\beta_k^\mathsf{T}z_i(t), \qquad k=1,\ldots,K-1. $$

The landmark state can enter as a categorical predictor, typically through indicator variables. If the association between a covariate and future state is expected to differ by landmark state, an interaction can represent that difference. The specification should be chosen before interpreting a single fitted coefficient: omitting an important interaction imposes the same log-odds association across the affected landmark states.

The state probabilities follow from the logits by the softmax transformation:

$$ \widehat p_k(t,h\mid z) = \frac{\exp\{\widehat\eta_k(t)\}} {1+\sum_{\ell=1}^{K-1}\exp\{\widehat\eta_\ell(t)\}}, \quad k=1,\ldots,K-1, \qquad \widehat p_K(t,h\mid z) = \frac{1} {1+\sum_{\ell=1}^{K-1}\exp\{\widehat\eta_\ell(t)\}}. $$

These fitted probabilities are nonnegative and sum to one. A coefficient \(\beta_{kj}\) is a change in the log odds of future state \(k\) versus the reference state for a one-unit increase in predictor \(j\), holding the other modeled predictors fixed. Its exponential is a ratio of those category odds, not a risk ratio and not, by itself, a change in the probability of state \(k\).

Estimation and Conditions for Interpretation

With one fully observed horizon outcome per landmark row, maximum likelihood estimates the coefficients by maximizing the multinomial likelihood. If \(y_{ik}\) is 1 when row \(i\)'s outcome is state \(k\) and 0 otherwise, the likelihood contribution is the fitted probability for the observed state. The log likelihood is:

$$ \ell(\beta)=\sum_i\sum_{k=1}^{K} y_{ik}\log p_k(z_i;\beta). $$

This likelihood presumes the recorded horizon state is known. If a person is lost to follow-up or censored before \(t+h\), their state at the horizon is generally unknown; assigning their last observed state as the outcome is not justified. One valid simple setting is complete ascertainment of the horizon outcome for every included row. With incomplete follow-up, an analysis may instead use inverse-probability-of-censoring weights when censoring is conditionally independent of the unobserved horizon state given the variables in the censoring model and the probability of remaining observed is positive for relevant covariate patterns. The censoring model and weighting procedure must then be appropriate; the ordinary unweighted likelihood of observed outcomes alone does not automatically solve the problem.

Interpretation also depends on adequate support: the data need observations across the landmark-state and covariate combinations for which predictions are requested. The multinomial logit functional form must be adequate, and all predictors used for prediction must be measured by the landmark. In repeated landmark data, rows from the same person can be dependent. This dependence does not change the definition of the conditional prediction, but it must be addressed in uncertainty estimates, for example with subject-clustered inference or resampling people rather than treating their rows as independent.

Worked Example: Fitting an Intercept-Only Model Within a Landmark Group

Suppose a hypothetical sample contains 80 eligible people, all in the same landmark state and with no additional predictors in the model. At the one-year horizon, 36 are in state A, 24 are in state B, and 20 are in state D (death). Assume all 80 horizon states are observed. Fit the intercept-only multinomial model and predict the state probabilities for another person in this same group.

With an intercept only, every person has the same probability vector. Write it as \((p_A,p_B,p_D)\), where \(p_A+p_B+p_D=1\). The likelihood is proportional to \(p_A^{36}p_B^{24}p_D^{20}\). Maximizing it subject to the probabilities summing to one gives each fitted probability equal to its observed category proportion:

$$ \widehat p_A=\frac{36}{80}=0.450,\qquad \widehat p_B=\frac{24}{80}=0.300,\qquad \widehat p_D=\frac{20}{80}=0.250. $$

Thus the fitted one-year probabilities for a person in this modeled group are 45.0% for state A, 30.0% for state B, and 25.0% for death. They sum to \(0.450+0.300+0.250=1.000\). These estimates describe the hypothetical landmark group; they do not establish that the same probabilities apply to people in other landmark states or with different covariates.

Turning Fitted Coefficients Into Predictions

Coefficients are useful for describing relative category odds, but prediction requires calculating all category probabilities for the covariate profile of interest. Because the probabilities share a denominator, a change in one predictor can affect several state probabilities at once.

Worked Example: Predicting Three State Probabilities

Consider a hypothetical one-year model with three future states: Stable, Worsened, and Death. Stable is the reference category. For illustration, the fitted equations use \(x=1\) for a specified landmark state and \(x=0\) otherwise, and an age covariate measured in decades above age 60. The equations are \( \eta_{\text{Worsened}}=-0.40+0.80x+0.30a \) and \( \eta_{\text{Death}}=-1.20+0.50x+0.60a \). For a person in the specified landmark state (\(x=1\)) who is 70 years old (\(a=1\)), calculate the predicted probabilities.

First calculate both logits: \( \eta_{\text{Worsened}}=-0.40+0.80(1)+0.30(1)=0.70 \), and \( \eta_{\text{Death}}=-1.20+0.50(1)+0.60(1)=-0.10 \). The reference-state logit is zero. Exponentiating gives relative weights \(e^{0.70}=2.014\), \(e^{-0.10}=0.9048\), and \(1\) for Stable. Their sum is \(2.014+0.9048+1=3.919\).

$$ \widehat p_{\text{Worsened}}=\frac{2.014}{3.919}=0.514, \qquad \widehat p_{\text{Death}}=\frac{0.9048}{3.919}=0.231, \qquad \widehat p_{\text{Stable}}=\frac{1}{3.919}=0.255. $$

The predicted one-year probabilities are approximately 51.4% Worsened, 23.1% Death, and 25.5% Stable. Rounding aside, they sum to 100%. This is a conditional prediction for the stated landmark state and age profile under the fitted model, not a causal effect of age or landmark state.

Worked Example: Interpreting a Multinomial Coefficient

In a hypothetical model, Stable is again the reference state. The coefficient for a one-decade increase in age in the Worsened-versus-Stable logit is \(0.30\), holding the other predictors fixed. Interpret the coefficient and distinguish it from a probability difference.

The coefficient is on the log category-odds scale. Exponentiating it gives \(e^{0.30}=1.350\). Thus, for otherwise identical modeled profiles, a one-decade increase in age is associated with 1.350 times the odds of being Worsened rather than Stable at the horizon, a 35.0% increase in those relative category odds.

It is not correct to say that the probability of Worsened increases by 35 percentage points, or by 35%. The probability also depends on the Death-versus-Stable logit and all other predictors through the shared softmax denominator. To report a probability contrast, calculate and compare the complete probability vectors for the two age values, as in the preceding example.

Repeated Landmarks, Diagnostics, and Limitations

A person can contribute multiple landmark rows, each with a current state, covariates measured at that time, and a corresponding fixed-horizon outcome. The fitted model then represents the conditional prediction for a landmark row. If the intended target is a particular population of landmark occasions, ensure that the sampling and analysis weights do not unintentionally give people with more eligible landmarks disproportionate influence. For standard errors, account for within-person dependence; treating all landmark rows as independent generally understates uncertainty when rows are correlated.

Useful checks include verifying that the outcome categories and their coding are consistent, confirming that every prediction uses only information available at the landmark, and examining whether the data support the requested state-and-covariate profiles. Sparse categories, separation, or very large fitted coefficients can indicate unstable estimation. Compare predicted probabilities with observed horizon outcomes across meaningful groups and inspect whether discrepancies are systematic; formal calibration measures are a separate topic. Also check censoring patterns: a high rate of unknown horizon outcomes or differences in follow-up across covariate groups can make complete-case predictions misleading.

A direct multinomial model and a model built from transition processes answer related but distinct modeling questions. The direct model targets state occupation at the selected horizon, and need not impose a particular transition structure between now and then. It also does not, by itself, provide transition times, intermediate state probabilities, or a coherent prediction for every possible horizon. Those limitations matter when the scientific question concerns the path as well as the endpoint.

Common pitfall: A row censored before the horizon is not automatically a row whose horizon state equals its last observed state. That substitution can misclassify outcomes and bias the fitted probabilities. Use fully observed horizon outcomes only when the resulting target and assumptions are appropriate, or use a censoring-aware method with its assumptions stated and assessed.

Short Justification of the Probability Formula

The multinomial model specifies log odds relative to the reference category. Exponentiating each non-reference equation gives \(p_k/p_K=\exp(\eta_k)\). Hence \(p_k=p_K\exp(\eta_k)\) for each \(k<K\). Since all category probabilities sum to one, \(p_K+\sum_{k=1}^{K-1}p_K\exp(\eta_k)=1\). Solving gives \(p_K=1/\{1+\sum_{k=1}^{K-1}\exp(\eta_k)\}\), and substituting this expression into \(p_k=p_K\exp(\eta_k)\) gives the softmax formula. This derivation also shows why the fitted probabilities are positive and sum to one.

Check Your Understanding

Answer each question, then compare with the brief solutions.

  1. A fixed-horizon outcome has three possible states, and one is selected as the multinomial reference. What does a coefficient of \(0.50\) mean for a one-unit increase in a predictor?
  2. For logits \(\eta_1=\log(2)\) and \(\eta_2=0\), with category 3 as reference, calculate the three probabilities.
  3. Why is it generally invalid to assign a person's last observed state as their outcome when they are censored before the prediction horizon?
  4. A person contributes four eligible landmark rows. What dependence issue can arise, and what is one way to account for it in uncertainty estimates?

Solutions. (1) The odds of the modeled category versus the reference category are multiplied by \(e^{0.50}=1.649\), holding other predictors fixed; this is not a probability increase of 0.50. (2) The relative weights are \(2,1,1\), with sum \(4\), so the probabilities are \(0.500, 0.250,0.250\). (3) The state may change between the last observation and the horizon, so the horizon outcome is unknown rather than necessarily equal to the last observed state. (4) Rows from the same person may be correlated; use a subject-clustered variance estimate or resample people as clusters.

Clinical Biostats