Tutorials › Competing Risks and Multi-State Models › Conditional Transition Probabilities From Each Origin State

Transition Intensities and Probabilities · Tutorial 300 of 699

Conditional Transition Probabilities From Each Origin State

Read a transition-probability matrix conditionally, select the correct origin row, and calculate origin-to-destination probabilities over one or more intervals.

Advanced 10 min read

What You'll Learn

  • Define a transition probability using its origin state and time interval.
  • Interpret a matrix row as conditional on starting in that row’s state.
  • Extract and report a selected origin-to-destination probability in context.
  • Multiply interval-specific matrices to calculate a multi-interval probability.
  • Check row sums, time order, and conditioning when interpreting estimates.

Why the Origin State Matters

A transition-probability matrix contains probabilities for moving between every pair of states over a stated time interval. Its rows are not interchangeable: each row answers a question conditional on a different origin state. For example, the probability of being in state 2 at month 12 may be quite different for someone who began in state 0 than for someone who began in state 1.

The key to interpreting any entry is to read its row first. The row identifies the state at the start of the interval; the column identifies the state at the end. A probability without its origin state and time interval is incomplete.

Definition: Let \(X(t)\) denote the state occupied at time \(t\). The transition probability from origin state \(i\) at time \(s\) to destination state \(j\) at time \(t\), where \(s \leq t\), is $$ P_{ij}(s,t)=P\{X(t)=j\mid X(s)=i\}. $$ The transition-probability matrix \(P(s,t)\) has entry \(P_{ij}(s,t)\) in row \(i\), column \(j\). An estimated matrix, written \(\hat P(s,t)\), uses estimated transition probabilities in those entries.

This conditional probability describes a group defined by its state at time \(s\), not a probability conditional on having followed one particular path before \(s\). If the process is Markov, its future transition distribution, given its present state and time, does not additionally depend on its earlier path. That condition supports interpreting the matrix as a transition law that depends on the current state and time. Without it, \(P\{X(t)=j\mid X(s)=i\}\) remains a well-defined conditional probability, but it can average over different earlier histories among individuals in state \(i\).

For an estimated transition matrix to have the intended state-probability interpretation, the state definitions and time points must be clear, and the underlying estimation assumptions must be appropriate. In particular, a Markov interpretation requires the Markov condition just described. Earlier material on the Aalen–Johansen estimator gives the estimation framework; here the emphasis is on reading the resulting entries correctly.

Reading a Row and Selecting an Entry

Consider a hypothetical illness-death model with states 0 (alive without the illness), 1 (alive with the illness), and 2 (dead). Suppose the estimated transition-probability matrix from baseline to 12 months is

$$ \hat P(0,12)= \begin{pmatrix} 0.72 & 0.20 & 0.08\\ 0 & 0.65 & 0.35\\ 0 & 0 & 1 \end{pmatrix}. $$

The first row applies to people in state 0 at baseline. For example, the entry in row 0 and column 2 is 0.08, so the estimated probability of being dead at 12 months, conditional on being alive without the illness at baseline, is 0.08. The second row applies instead to people already in state 1 at baseline: its row-1, column-2 entry is 0.35.

The diagonal entries are probabilities of occupying the same state at the end of the interval as at its start. Thus, 0.72 is the estimated probability of being in state 0 at 12 months given state 0 at baseline. It does not say that 72% of everyone in the study is in state 0 at 12 months; it concerns only the specified origin group.

Worked Example: Probability of a Destination From a Specified Origin

In the hypothetical illness-death example above, find the estimated probability of being alive with the illness at 12 months for a person who was alive without the illness at baseline.

The origin is state 0, so use row 0. The destination is state 1, so select column 1:

$$ \hat P_{01}(0,12)=0.20. $$

In context, the estimated probability is 0.20, or 20%, of being alive with the illness at 12 months among people who were alive without the illness at baseline. It is not the probability for people who already had the illness at baseline; that probability is the row-1, column-1 entry, 0.65.

Each row is a probability distribution over the possible destination states. If the state set is \(\{0,1,\ldots,K\}\), then for every origin \(i\),

$$ \sum_{j=0}^{K} P_{ij}(s,t)=1, \qquad P_{ij}(s,t)\geq 0. $$

The row total is one because, conditional on being in state \(i\) at time \(s\), the process must occupy exactly one of the defined states at time \(t\). This property is also a useful check on an estimated matrix. Small departures from one may result from rounding the displayed entries; large departures suggest a calculation, transcription, or model-output problem.

Calculating Probabilities Across Successive Intervals

A requested interval may span multiple periods for which separate transition matrices are available. When the Markov condition holds, the probability of moving from \(i\) to \(j\) over the full interval can be calculated by considering each possible state \(k\) at the intermediate time. The process must be in some such state at that time, so the origin-to-destination probability is the sum of the probabilities for the possible intermediate routes.

$$ P_{ij}(s,u)=\sum_k P_{ik}(s,t)P_{kj}(t,u), \qquad s \leq t \leq u. $$

In matrix form, this is \(P(s,u)=P(s,t)P(t,u)\). The first matrix acts over the earlier interval and the second over the later interval. Keeping the order and the time labels straight is essential: an entry in the product still has a specific origin row and destination column.

Worked Example: Reaching a Destination Through Two Intervals

Suppose a hypothetical three-state process has states 0, 1, and 2. Estimated matrices for months 0 to 6 and months 6 to 12 are

$$ \hat P(0,6)= \begin{pmatrix} 0.70 & 0.20 & 0.10\\ 0 & 0.75 & 0.25\\ 0 & 0 & 1 \end{pmatrix}, \qquad \hat P(6,12)= \begin{pmatrix} 0.60 & 0.25 & 0.15\\ 0 & 0.80 & 0.20\\ 0 & 0 & 1 \end{pmatrix}. $$

Find the estimated probability of being in state 2 at month 12, conditional on being in state 0 at baseline. The intermediate state at month 6 can be 0, 1, or 2. Therefore,

$$ \begin{aligned} \hat P_{02}(0,12) &=\hat P_{00}(0,6)\hat P_{02}(6,12) +\hat P_{01}(0,6)\hat P_{12}(6,12) +\hat P_{02}(0,6)\hat P_{22}(6,12)\\ &=(0.70)(0.15)+(0.20)(0.20)+(0.10)(1.00)\\ &=0.105+0.040+0.100\\ &=0.245. \end{aligned} $$

The estimated probability is 0.245, or 24.5%, over the full 12 months for the group starting in state 0. The three terms account respectively for being in state 0, 1, or 2 at month 6 and then being in state 2 at month 12. The calculation uses the earlier-interval matrix first, followed by the later-interval matrix.

Justification: Conditional on starting in state \(i\) at time \(s\), partition the event \(X(u)=j\) according to the mutually exclusive intermediate states \(X(t)=k\). Under the Markov condition, the probability of the route through \(k\) factors into \(P_{ik}(s,t)P_{kj}(t,u)\). Summing over all possible \(k\) gives the displayed formula. In matrix multiplication, the sum over \(k\) is exactly the row-\(i\), column-\(j\) entry of the product.

Worked Example: Comparing the Same Destination From Two Origins

For the hypothetical illness-death matrix, compare the estimated probability of death by month 12 for people in state 0 versus people in state 1 at baseline.

For origin state 0, select row 0 and the death column 2: \(\hat P_{02}(0,12)=0.08\), or 8%. For origin state 1, select row 1 and the same destination column: \(\hat P_{12}(0,12)=0.35\), or 35%.

The estimated conditional probabilities differ by \(0.35-0.08=0.27\), or 27 percentage points, across these origin groups over the stated interval. This is a descriptive comparison of conditional probabilities. It does not by itself show that starting in state 1 causes the higher probability; the groups may differ in other ways, and the matrix does not establish a causal effect.

Checks, Alternatives, and Common Pitfalls

Before reporting a selected transition probability, verify the origin state, destination state, and interval. Then check that the selected entry is nonnegative and that the row is a probability distribution. For a multi-interval calculation, confirm that adjacent matrices refer to consecutive intervals and that their multiplication order matches the time order. If states are ordered differently in two matrices, a numerically valid product can still answer the wrong question.

The main alternative to reading a transition-probability matrix is to work directly with transition intensities or event-time updates. Intensities describe instantaneous transition rates; a transition matrix describes probabilities over an interval. The matrix is often easier for answering questions such as “what is the probability of state \(j\) at month 12, given state \(i\) at baseline?” Intensity-based calculations can be useful when the underlying rates are the quantities of interest or when constructing the transition matrix. They are not interchangeable: a rate is not itself an interval probability.

A further distinction is between a conditional row and an overall probability that combines people from different initial states. A row answers a question for one specified origin. If an overall probability for a population with several origin states is required, the origin groups must be combined using their relevant proportions. That population-level quantity is not any single row entry.

  • Wrong row: selecting a destination column correctly but using the wrong origin row changes the conditioning group. State the origin in words before looking up the entry.
  • Ignoring the interval: a probability from baseline to 12 months is not automatically the probability for months 6 to 18. Report both endpoints.
  • Treating an entry as an unconditional proportion: a row entry is conditional on its origin state. Do not describe it as a percentage of everyone in the study.
  • Adding probabilities from different routes without accounting for the intermediate state: each route must include both the probability of reaching its intermediate state and the probability of the subsequent transition.
  • Overinterpreting an estimate: a transition probability is not a causal effect, and a point estimate alone does not describe its uncertainty.

These interpretations rely on the state system being sufficiently well defined for the question, on using the correct time-specific matrix, and—when interpreting the matrix as a history-independent transition law—on the Markov condition. Sparse data in an origin state, model misspecification, or poorly defined states can make estimates unstable or their interpretation less useful. Rounding can also cause displayed row totals to differ slightly from one, so calculations should use unrounded estimates when available.

Key takeaway: Read a transition-probability entry as row first, column second: the row gives the origin condition, the column gives the destination, and the matrix time labels give the interval. For multiple intervals, combine the matrices in time order and retain the same origin-to-destination interpretation.

Check Your Understanding

Answer each question by identifying the origin, destination, and relevant calculation. Solutions follow the questions.

  1. In the illness-death matrix, what does the entry 0.65 represent?
  2. For a person in state 1 at baseline, what is the estimated probability of being in state 2 at month 12 in that matrix?
  3. In the two-interval example, calculate the probability of being in state 1 at month 12 given state 0 at baseline.
  4. Why is it incorrect to describe the row-0, column-2 entry as the percentage of the entire study population that is dead at month 12?
  5. What condition supports multiplying successive transition matrices to obtain a transition probability over the combined interval?

Solutions. (1) It is the estimated probability of being in state 1 at month 12, conditional on being in state 1 at baseline. (2) Use row 1, column 2: the probability is 0.35, or 35%. (3) Sum over intermediate states: \((0.70)(0.25)+(0.20)(0.80)+(0.10)(0)=0.175+0.160+0=0.335\). Thus the probability is 0.335, or 33.5%. (4) The entry is conditional on starting in state 0, not unconditional over all baseline states. (5) The Markov condition supports the factorization by intermediate state and hence the matrix product for the combined interval.

Clinical Biostats