Why Model State Occupation Directly?
At a landmark time, a clinician may want to know the probability that a person will be in each possible state one year later, given the state the person occupies now and covariates measured at the landmark. A direct multinomial model treats the state at that fixed future horizon as a single categorical outcome. It therefore targets the desired horizon-specific probabilities without separately modeling the sequence or timing of transitions between the landmark and horizon.
The prediction is conditional: it applies to people eligible for prediction at the landmark, with the stated current state and covariate values. It is not a probability of a particular transition path. The earlier material on conditioning on the current state and using landmark covariates provides the prediction setting; here the focus is specifying and interpreting the direct regression model.
The time origin and horizon must be specified. For example, “one year after the landmark” is different from “one year after diagnosis” unless the landmark is diagnosis. The target population is also defined by eligibility at the landmark; it is not automatically the original cohort.
Multinomial Logistic Specification
Choose one future state \(K\) as the reference category. Let \(z_i(t)\) be the model covariate vector, which can include indicators for the landmark state, measured covariates, and prespecified interactions. For each non-reference future state \(k\), multinomial logistic regression specifies the log odds of state \(k\) rather than the reference state as a linear function of those predictors:
The landmark state can enter as a categorical predictor, typically through indicator variables. If the association between a covariate and future state is expected to differ by landmark state, an interaction can represent that difference. The specification should be chosen before interpreting a single fitted coefficient: omitting an important interaction imposes the same log-odds association across the affected landmark states.
The state probabilities follow from the logits by the softmax transformation:
These fitted probabilities are nonnegative and sum to one. A coefficient \(\beta_{kj}\) is a change in the log odds of future state \(k\) versus the reference state for a one-unit increase in predictor \(j\), holding the other modeled predictors fixed. Its exponential is a ratio of those category odds, not a risk ratio and not, by itself, a change in the probability of state \(k\).
Estimation and Conditions for Interpretation
With one fully observed horizon outcome per landmark row, maximum likelihood estimates the coefficients by maximizing the multinomial likelihood. If \(y_{ik}\) is 1 when row \(i\)'s outcome is state \(k\) and 0 otherwise, the likelihood contribution is the fitted probability for the observed state. The log likelihood is:
This likelihood presumes the recorded horizon state is known. If a person is lost to follow-up or censored before \(t+h\), their state at the horizon is generally unknown; assigning their last observed state as the outcome is not justified. One valid simple setting is complete ascertainment of the horizon outcome for every included row. With incomplete follow-up, an analysis may instead use inverse-probability-of-censoring weights when censoring is conditionally independent of the unobserved horizon state given the variables in the censoring model and the probability of remaining observed is positive for relevant covariate patterns. The censoring model and weighting procedure must then be appropriate; the ordinary unweighted likelihood of observed outcomes alone does not automatically solve the problem.
Interpretation also depends on adequate support: the data need observations across the landmark-state and covariate combinations for which predictions are requested. The multinomial logit functional form must be adequate, and all predictors used for prediction must be measured by the landmark. In repeated landmark data, rows from the same person can be dependent. This dependence does not change the definition of the conditional prediction, but it must be addressed in uncertainty estimates, for example with subject-clustered inference or resampling people rather than treating their rows as independent.
Worked Example: Fitting an Intercept-Only Model Within a Landmark Group
Suppose a hypothetical sample contains 80 eligible people, all in the same landmark state and with no additional predictors in the model. At the one-year horizon, 36 are in state A, 24 are in state B, and 20 are in state D (death). Assume all 80 horizon states are observed. Fit the intercept-only multinomial model and predict the state probabilities for another person in this same group.
With an intercept only, every person has the same probability vector. Write it as \((p_A,p_B,p_D)\), where \(p_A+p_B+p_D=1\). The likelihood is proportional to \(p_A^{36}p_B^{24}p_D^{20}\). Maximizing it subject to the probabilities summing to one gives each fitted probability equal to its observed category proportion:
Thus the fitted one-year probabilities for a person in this modeled group are 45.0% for state A, 30.0% for state B, and 25.0% for death. They sum to \(0.450+0.300+0.250=1.000\). These estimates describe the hypothetical landmark group; they do not establish that the same probabilities apply to people in other landmark states or with different covariates.
Turning Fitted Coefficients Into Predictions
Coefficients are useful for describing relative category odds, but prediction requires calculating all category probabilities for the covariate profile of interest. Because the probabilities share a denominator, a change in one predictor can affect several state probabilities at once.
Worked Example: Predicting Three State Probabilities
Consider a hypothetical one-year model with three future states: Stable, Worsened, and Death. Stable is the reference category. For illustration, the fitted equations use \(x=1\) for a specified landmark state and \(x=0\) otherwise, and an age covariate measured in decades above age 60. The equations are \( \eta_{\text{Worsened}}=-0.40+0.80x+0.30a \) and \( \eta_{\text{Death}}=-1.20+0.50x+0.60a \). For a person in the specified landmark state (\(x=1\)) who is 70 years old (\(a=1\)), calculate the predicted probabilities.
First calculate both logits: \( \eta_{\text{Worsened}}=-0.40+0.80(1)+0.30(1)=0.70 \), and \( \eta_{\text{Death}}=-1.20+0.50(1)+0.60(1)=-0.10 \). The reference-state logit is zero. Exponentiating gives relative weights \(e^{0.70}=2.014\), \(e^{-0.10}=0.9048\), and \(1\) for Stable. Their sum is \(2.014+0.9048+1=3.919\).
The predicted one-year probabilities are approximately 51.4% Worsened, 23.1% Death, and 25.5% Stable. Rounding aside, they sum to 100%. This is a conditional prediction for the stated landmark state and age profile under the fitted model, not a causal effect of age or landmark state.
Worked Example: Interpreting a Multinomial Coefficient
In a hypothetical model, Stable is again the reference state. The coefficient for a one-decade increase in age in the Worsened-versus-Stable logit is \(0.30\), holding the other predictors fixed. Interpret the coefficient and distinguish it from a probability difference.
The coefficient is on the log category-odds scale. Exponentiating it gives \(e^{0.30}=1.350\). Thus, for otherwise identical modeled profiles, a one-decade increase in age is associated with 1.350 times the odds of being Worsened rather than Stable at the horizon, a 35.0% increase in those relative category odds.
It is not correct to say that the probability of Worsened increases by 35 percentage points, or by 35%. The probability also depends on the Death-versus-Stable logit and all other predictors through the shared softmax denominator. To report a probability contrast, calculate and compare the complete probability vectors for the two age values, as in the preceding example.
Repeated Landmarks, Diagnostics, and Limitations
A person can contribute multiple landmark rows, each with a current state, covariates measured at that time, and a corresponding fixed-horizon outcome. The fitted model then represents the conditional prediction for a landmark row. If the intended target is a particular population of landmark occasions, ensure that the sampling and analysis weights do not unintentionally give people with more eligible landmarks disproportionate influence. For standard errors, account for within-person dependence; treating all landmark rows as independent generally understates uncertainty when rows are correlated.
Useful checks include verifying that the outcome categories and their coding are consistent, confirming that every prediction uses only information available at the landmark, and examining whether the data support the requested state-and-covariate profiles. Sparse categories, separation, or very large fitted coefficients can indicate unstable estimation. Compare predicted probabilities with observed horizon outcomes across meaningful groups and inspect whether discrepancies are systematic; formal calibration measures are a separate topic. Also check censoring patterns: a high rate of unknown horizon outcomes or differences in follow-up across covariate groups can make complete-case predictions misleading.
A direct multinomial model and a model built from transition processes answer related but distinct modeling questions. The direct model targets state occupation at the selected horizon, and need not impose a particular transition structure between now and then. It also does not, by itself, provide transition times, intermediate state probabilities, or a coherent prediction for every possible horizon. Those limitations matter when the scientific question concerns the path as well as the endpoint.
Short Justification of the Probability Formula
The multinomial model specifies log odds relative to the reference category. Exponentiating each non-reference equation gives \(p_k/p_K=\exp(\eta_k)\). Hence \(p_k=p_K\exp(\eta_k)\) for each \(k<K\). Since all category probabilities sum to one, \(p_K+\sum_{k=1}^{K-1}p_K\exp(\eta_k)=1\). Solving gives \(p_K=1/\{1+\sum_{k=1}^{K-1}\exp(\eta_k)\}\), and substituting this expression into \(p_k=p_K\exp(\eta_k)\) gives the softmax formula. This derivation also shows why the fitted probabilities are positive and sum to one.
Check Your Understanding
Answer each question, then compare with the brief solutions.
- A fixed-horizon outcome has three possible states, and one is selected as the multinomial reference. What does a coefficient of \(0.50\) mean for a one-unit increase in a predictor?
- For logits \(\eta_1=\log(2)\) and \(\eta_2=0\), with category 3 as reference, calculate the three probabilities.
- Why is it generally invalid to assign a person's last observed state as their outcome when they are censored before the prediction horizon?
- A person contributes four eligible landmark rows. What dependence issue can arise, and what is one way to account for it in uncertainty estimates?
Solutions. (1) The odds of the modeled category versus the reference category are multiplied by \(e^{0.50}=1.649\), holding other predictors fixed; this is not a probability increase of 0.50. (2) The relative weights are \(2,1,1\), with sum \(4\), so the probabilities are \(0.500, 0.250,0.250\). (3) The state may change between the last observation and the horizon, so the horizon outcome is unknown rather than necessarily equal to the last observed state. (4) Rows from the same person may be correlated; use a subject-clustered variance estimate or resample people as clusters.