Tutorials › Competing Risks and Multi-State Models › Selecting Prediction Horizons for State Occupation

Landmarking and Dynamic Prediction · Tutorial 497 of 699

Selecting Prediction Horizons for State Occupation

Choose prediction horizons that match the decision of interest and the data’s follow-up, then interpret each state probability at that specific horizon.

Advanced 12 min read

What You'll Learn

  • Define a prediction horizon relative to a landmark time and current state.
  • Match the horizon to a clinical or scientific question.
  • Check whether follow-up and numbers at risk support the proposed horizon.
  • Distinguish state occupation at a horizon from experiencing an event by that time.
  • Compare single-horizon predictions with state-probability trajectories.
  • Interpret how changing the horizon changes the prediction target.

Why the Prediction Horizon Matters

A state-occupation prediction is not complete until its time point is specified. A prediction that a patient will be in a particular state “after treatment” could mean after three months, one year, or five years. Those are different questions, and the corresponding probabilities need not be similar. Selecting a horizon therefore determines both the clinical meaning of the prediction and whether the available follow-up can estimate it with useful precision.

Suppose prediction begins at landmark time \(s\), when the person is known to be in state \(j\). A horizon \(h>0\) asks about the state at the later time \(s+h\). The horizon is the elapsed time from the landmark, not the time since the original study began. For example, at a landmark of six months, a one-year horizon refers to state occupation at month 18.

Definition: For a multi-state process \(X(t)\), the state-occupation probability for state \(k\), landmark time \(s\), and horizon \(h\) is $$ \pi_k(s,h)=P\{X(s+h)=k\mid X(s)=j,\ \mathcal{H}_s\}, $$ where \(j\) is the current state and \(\mathcal{H}_s\) denotes the information used to define or condition the prediction at the landmark. The prediction horizon \(h\) is the time from \(s\) to the target state assessment.

The conditioning information must be stated clearly. It may consist of the current state alone or include recorded history and covariates, as specified by the prediction target and model. Whatever the conditioning set, \(\pi_k(s,h)\) describes the probability of being in state \(k\) at one particular future time. It is not automatically the probability of ever entering state \(k\) before that time.

Choose a Horizon That Answers the Question

Begin with the decision or scientific question, then translate it into a time from the landmark. A clinician deciding whether to schedule a review at six months may need a six-month prediction. A health system planning two-year service capacity may need a two-year prediction. The most convenient horizon for analysis is not necessarily the most relevant one for use.

A useful horizon should satisfy two criteria. First, it should have a clear interpretation for the intended decision. Second, the observed follow-up should provide adequate support for estimating state occupation at that time in the target population. A clinically important horizon outside the data’s support cannot be rescued by labeling it important; it requires more follow-up or a model-based extrapolation whose assumptions must be made explicit.

For ordinary Aalen-Johansen state-occupation estimation after a landmark, the analysis also relies on appropriate observation of transitions and independent censoring for the target population, along with sufficient follow-up at the requested horizon. In a model-based prediction, the assumptions of that model are also relevant. In particular, a prediction is only as credible as its treatment of the history and covariates that determine future state occupation. Earlier material on Choosing Landmark Times With Adequate Prediction Support addresses support at the landmark; horizon selection asks whether support remains adequate at the later target time.

The endpoint state probabilities for a complete set of mutually exclusive states sum to one:

$$ \sum_{k=1}^{K}\pi_k(s,h)=1. $$

This is a useful check on a reported prediction. It does not mean each probability is equally well estimated: one or more states may have sparse data or substantial censoring. Nor does the sum reveal whether a particular state was visited earlier and then left. That distinction matters for transient states.

Worked Example: Matching a Horizon to a Review Decision

Consider a hypothetical clinic that makes a treatment-review decision six months after an initial visit. At that landmark, patients are in state \(A\), and the clinic needs the probability of being in state \(B\) six months later. Suppose the estimated state probabilities at the six-month horizon are \(P(X(s+0.5)=A)=0.58\), \(P(X(s+0.5)=B)=0.32\), and \(P(X(s+0.5)=D)=0.10\), where time is measured in years and \(D\) is an absorbing competing-event state.

The horizon aligned to the decision is \(h=0.5\) years, so the target is state occupation at \(s+0.5\), not at the end of the study. The probabilities sum to \(0.58+0.32+0.10=1.00\). In context, the estimated probability of being in state \(B\) at the review time is 0.32, or 32%, among people meeting the landmark conditioning definition.

A two-year estimate might also be scientifically useful, but it would answer a different question. It should not replace the six-month estimate if the decision is specifically made at six months.

Follow-up Support at the Chosen Horizon

Follow-up limits the horizons that can be estimated directly. If few people remain under observation near \(s+h\), the estimated state probabilities may be unstable. If nobody is observed sufficiently late, the data do not identify state occupation there without extrapolating beyond observed support. Inverse censoring adjustments or a transition model do not create information where there is no support.

Assess support in the population relevant to the prediction, not only in the full study. At a landmark, the target group may be a subset defined by current state, covariates, or history. A horizon with substantial follow-up overall can still have very little follow-up in that subset. Check numbers at risk, censoring patterns, observed follow-up times, and uncertainty at the proposed horizon. There is no universal number at risk that guarantees reliability; the consequences depend on event rates, censoring, and the state-transition pattern.

Worked Example: Rejecting an Unsupported Late Horizon

In a hypothetical landmark cohort, 120 people are eligible at \(s\). At \(h=1\) year, 76 are still observed and 44 have been censored or otherwise no longer under observation. At \(h=3\) years, only 8 remain under observation, and the latest adequately observed time for most members of the target group is 2.4 years.

A three-year state-occupation estimate would rely on very sparse late follow-up. The fact that \(8\) people remain observed does not by itself establish that the estimate is precise, and the limited support makes a stable estimate doubtful. If no relevant follow-up extends to three years for a portion of the target group, estimating the three-year probability also requires assumptions beyond direct observation.

The one-year horizon has more observed support, but \(76\) still needs to be considered alongside the number of transitions, censoring, and the estimate’s uncertainty. A defensible conclusion is not that one year is automatically reliable; it is that the three-year horizon is poorly supported by these data, while the one-year horizon warrants further diagnostic review. The arithmetic \(120-44=76\) describes the one-year observed count; it is not itself an estimate of any state probability.

A practical diagnostic is to plot state-probability estimates over time together with uncertainty intervals and, where available, numbers at risk. Look for a sharp increase in uncertainty, unstable late changes, or horizons beyond the period of meaningful observation. A curve that appears smooth is not proof of adequate support, especially if it is based on very few people. For interval estimation, use an appropriate method and interpret the interval at the selected horizon; a narrow-looking point estimate alone does not establish precision.

How the Horizon Changes the Interpretation

Changing \(h\) changes the target quantity, even if the landmark population and model stay fixed. At \(h=0.5\), \(\pi_k(s,0.5)\) is the probability of occupying state \(k\) half a year after the landmark. At \(h=2\), \(\pi_k(s,2)\) is the probability of occupying that state two years after the landmark. One cannot describe either as the probability of the state “in general.”

For a transient state, a person may enter and later leave it. Thus, state occupation at \(s+h\) is different from the probability of having entered that state at any time in \((s,s+h]\). If the state is an absorbing competing-event state, occupation by \(s+h\) corresponds to having experienced that event by then. For non-absorbing states, the endpoint probability does not record all prior visits. The distinction between transient-state occupation and eventual absorption is important when wording a prediction.

Worked Example: Endpoint Occupation Versus Ever Entering a State

Suppose a hypothetical prediction for people in state \(A\) at the landmark gives these probabilities at one year: state \(A\), 0.50; transient state \(B\), 0.30; and absorbing state \(D\), 0.20. At two years, the corresponding probabilities are 0.35, 0.25, and 0.40. Each set sums to one: \(0.50+0.30+0.20=1.00\), and \(0.35+0.25+0.40=1.00\).

At one year, the estimate 0.30 means a 30% probability of occupying transient state \(B\) at that time. At two years, 0.25 means a 25% probability of occupying \(B\) at that later time. It would be incorrect to say that only 25% ever entered \(B\): some people could have entered \(B\) and then moved to another state before the two-year assessment.

For absorbing state \(D\), the two-year probability is 0.40. Under the stated absorbing-state definition, that is the probability of occupying \(D\) by two years. The state-specific interpretation depends on whether the state is transient or absorbing, not merely on the value of the horizon.

One Horizon, Several Horizons, or a Trajectory?

A single prespecified horizon is often easiest to communicate when it corresponds to a concrete decision. Reporting several horizons can show how predictions change over time, but each is a distinct estimand and requires adequate support. A trajectory displays the state probabilities across a range of horizons; it can reveal transitions that a single endpoint hides, while also making late follow-up limitations visible.

These approaches answer related but different communication needs. A single horizon emphasizes one decision point. Several fixed horizons permit direct comparisons at selected times. A trajectory shows the pattern over time. None is universally best, and a longer list of horizons is not automatically more informative. Select a small set that addresses the question and is supported by the data, and label every estimate with its elapsed time from the landmark.

Reporting choiceBest suited toMain caution
One fixed horizonA decision tied to a specific timeDoes not describe what happens before or after that time
Several fixed horizonsComparisons at a few meaningful time pointsEach point needs adequate follow-up and clear labeling
State-probability trajectoryUnderstanding the pattern of state occupation over timeLate portions may be weakly supported or imprecise

Common Pitfalls and Limitations

  • Choosing the longest possible horizon by default. A longer horizon may be clinically relevant, but if follow-up is sparse, the estimate can be unstable or require extrapolation. Match the horizon to the question and assess support.
  • Reporting a probability without its time point. “The probability of state \(B\) is 0.30” is incomplete. State the landmark, elapsed horizon, conditioning group, and units of time.
  • Confusing endpoint occupation with an event history. For a transient state, the probability of occupying it at \(s+h\) is not the probability of ever having entered it by then.
  • Treating a supported horizon as automatically precise. Follow-up at a time point is necessary but may not be sufficient. Numbers at risk, censoring, transitions, and uncertainty also matter.
  • Extrapolating without saying so. Predictions beyond observed follow-up depend on model assumptions rather than direct support. Report that limitation plainly.

Horizon selection cannot eliminate limitations in the landmark population, measurement, censoring, or model specification. Nor does an appropriate horizon turn a predictive association into a causal effect. The gain is more precise alignment between the probability being estimated, the time at which it applies, and the decision it is intended to inform.

Key takeaway: Define the target as state occupation at a specified elapsed time from the landmark. Choose that time to fit the prediction question, verify that the target group has meaningful follow-up there, and describe whether the state is transient or absorbing.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A prediction is made at a landmark 18 months after study entry, for a horizon of one year. At what time after study entry is the target state assessed?
  2. At a two-year horizon, the predicted probability of a transient state is 0.22. Does this mean 22% entered that state at any point during the two years? Explain.
  3. A requested four-year horizon has no observed follow-up in the target subgroup after three years. What is the central limitation of reporting a four-year estimate?
  4. Why should a report identify both the landmark and the horizon rather than state only a predicted probability?

Solutions. (1) The target assessment is at 30 months after study entry: \(18+12=30\) months. (2) No. The probability refers to occupying the transient state at the two-year assessment; people could have entered and left it earlier. (3) The four-year estimate is unsupported by direct follow-up in that subgroup and would require extrapolating or other additional assumptions. (4) The probability is conditional on the landmark information and refers to a particular time after that landmark; omitting either leaves the target population or time point ambiguous.

Clinical Biostats