Tutorials › Generalized Linear Models › When Sequential Logits Misrepresent the Process

Alternative Nominal Models · Tutorial 521 of 981

When Sequential Logits Misrepresent the Process

Distinguish a useful sequential mechanism from a convenient factorization, and identify when continuation-ratio logits impose an arbitrary interpretation.

Advanced 12 min read

What You'll Learn

  • Define forward continuation probabilities and their risk sets
  • Prove how continuation probabilities factor a multinomial distribution
  • Explain why factorization alone does not imply a sequential mechanism
  • Check whether category order and risk sets match the process under study
  • See how changing an arbitrary category order changes conditional interpretations
  • Identify when a continuation-ratio model is unsuitable for nominal outcomes

Algebraic Fit Is Not a Sequential Story

A continuation-ratio model can describe categorical probabilities through a sequence of conditional probabilities. That can be a natural representation when people really move through successive stages, or when each conditional comparison corresponds to a genuine risk set. But the same algebra can be applied to categories that are merely different labels. In that case, the model may fit or factor the probabilities without representing how outcomes were generated.

The distinction matters because a sequential interpretation invites substantive claims: who remains at risk at each step, what decision or event occurs there, and what a covariate effect means at that step. Those claims do not follow just from writing down conditional probabilities. The ordering and risk sets must be justified by the study design or scientific process.

Definition: Let \(Y\) take one of the ordered labels \(1,\ldots,K\), and let \(x\) denote covariates. The forward continuation probability at step \(j<K\) is \(q_j(x)=P(Y=j\mid Y\geq j,x)\), provided \(P(Y\geq j\mid x)>0\). Its risk set is the set of outcomes \(j,j+1,\ldots,K\). The forward continuation-ratio logit is \(\log\{q_j(x)/(1-q_j(x))\}\). The final category has \(q_K(x)=1\), so it is not a finite logit comparison.

This definition makes the ordering consequential: \(Y\geq j\) is defined by the labels. In an actual sequential process, the labels should correspond to successive stages and the risk set should identify those still eligible for the event at that stage. For nominal categories, the same conditioning event can be computed from a chosen ordering, but it may have no process-based interpretation.

A Factorization Does Not Establish a Mechanism

Write \(p_j(x)=P(Y=j\mid x)\), and let \(S_j(x)=\sum_{\ell=j}^{K}p_\ell(x)\) be the probability of being in the forward risk set at step \(j\). If \(S_j(x)>0\), then \(q_j(x)=p_j(x)/S_j(x)\). This gives a mathematical representation of the category probabilities. It does not say that an individual literally faced a decision at each step.

Theorem: For any categorical distribution with \(p_j>0\) for \(j=1,\ldots,K\), the forward continuation probabilities \(q_j=p_j/S_j\), for \(j<K\), recover the original probabilities through \(p_j=q_j\prod_{r=1}^{j-1}(1-q_r)\) for \(j<K\), and \(p_K=\prod_{r=1}^{K-1}(1-q_r)\). Conversely, any \(q_1,\ldots,q_{K-1}\) strictly between zero and one defines a positive categorical distribution by these formulas.

Proof. Since \(S_1=1\), and \(S_{j+1}=S_j-p_j=S_j(1-q_j)\), it follows successively that \(S_j=\prod_{r=1}^{j-1}(1-q_r)\). Therefore, for \(j<K\), \(p_j=q_jS_j=q_j\prod_{r=1}^{j-1}(1-q_r)\). For the last category, \(p_K=S_K=\prod_{r=1}^{K-1}(1-q_r)\). For the converse, define the probabilities by the displayed formulas. Their sum is one because \[ \sum_{j=1}^{K-1}q_j\prod_{r=1}^{j-1}(1-q_r) +\prod_{r=1}^{K-1}(1-q_r)=1. \] To verify the identity, set \(A_j=\prod_{r=1}^{j}(1-q_r)\), with \(A_0=1\). Each summand in the sum is \(A_{j-1}-A_j\), so the total is \(\sum_{j=1}^{K-1}(A_{j-1}-A_j)+A_{K-1}=A_0=1\). All probabilities are positive because every \(q_j\) and \(1-q_j\) is positive. The risk-set probabilities obtained from these probabilities are \(S_j=\prod_{r=1}^{j-1}(1-q_r)\), so the conditional probability at step \(j\) is indeed \(q_j\). \(\square\)

The theorem explains the central diagnostic caution: continuation probabilities can always be recovered from positive category probabilities for a chosen order. Thus, the existence of a continuation-ratio factorization is not evidence that the response arose through sequential decisions. A probabilistic representation is not, by itself, a causal or temporal account.

Worked Example: Reordering Nominal Preferences

Suppose a survey records one preferred transport option, with probabilities \(P(A)=0.50\), \(P(B)=0.30\), and \(P(C)=0.20\). These options have no natural progression. Calculate the forward continuation probabilities in two different category orders.

Order \(A,B,C\). At step 1, the risk set is all respondents, so \(q_1=P(A)=0.50\). At step 2, the risk set consists of respondents who chose \(B\) or \(C\), giving \(q_2=P(B\mid B\text{ or }C)=0.30/(0.30+0.20)=0.60\). The final category \(C\) is the remaining outcome.

Order \(C,B,A\). Now \(q_1=P(C)=0.20\). At step 2, the risk set consists of respondents who chose \(B\) or \(A\), so \(q_2=0.30/(0.30+0.50)=0.375\).

Both representations recover the same three probabilities. Yet “choose \(A\) first, then \(B\)” and “choose \(C\) first, then \(B\)” are different conditional comparisons. Unless the survey or a theory supplies a meaningful sequence, neither order describes a real decision process. The factorization is valid; the sequential story is unsupported.

When the Sequential Interpretation Is Defensible

A continuation-ratio interpretation is more plausible when the data-generating process identifies a sequence and the risk set at each step. For example, a clinical pathway might classify a patient by the first of several ordered escalation stages reached during follow-up. If patients first face a decision about an initial escalation, and only those not yet escalated remain at risk for a later stage, the successive conditional probabilities can match the pathway.

Even then, the analyst must check the details. The outcome categories must be mutually exclusive in the way the model assumes, the order must match the actual sequence, and the conditional denominator must represent the people eligible at that stage. A list of severity labels alone does not prove that patients passed through the associated risk sets. The process may include transitions, repeated events, or eligibility rules that a single categorical response does not capture.

Worked Example: A Pathway With Explicit Risk Sets

Suppose a care pathway classifies each patient by the first stage at which an intervention is initiated: stage 1, stage 2, or stage 3. All patients begin eligible for stage 1. Patients who do not receive the intervention at stage 1 remain eligible for stage 2; those who do not receive it at stage 2 remain eligible for stage 3. Assume the conditional probabilities are \(q_1=0.40\) and \(q_2=0.50\).

The probability of a stage 1 intervention is \(p_1=q_1=0.40\).

The probability of reaching the stage 2 risk set is \(1-q_1=0.60\), so the probability of a stage 2 intervention is \(p_2=(1-q_1)q_2=(0.60)(0.50)=0.30\).

The probability of reaching stage 3 is \((1-q_1)(1-q_2)=(0.60)(0.50)=0.30\), so \(p_3=0.30\). The probabilities sum to \(0.40+0.30+0.30=1.00\).

Here, the risk sets have a stated meaning: everyone begins in the first, while only those not yet receiving an intervention continue to the next. This supports describing \(q_1\) and \(q_2\) as stage-specific conditional probabilities. If stage 1, 2, and 3 were merely labels assigned after the fact, the same calculations would not establish that pathway.

Conditional odds must also use the correct risk-set denominator. For example, if a stage has event mass \(0.20\) and non-event mass \(0.30\), its conditional event probability is \(0.20/(0.20+0.30)=0.40\), and its conditional odds are \(0.20/0.30=2/3\). If another conditional comparison has probability \(0.40\), its odds are \(0.40/0.60=2/3\); the ratio of these odds is \((2/3)/(2/3)=1\), not 2. The event and non-event masses, rather than the total risk-set mass alone, determine the odds.

How Arbitrary Ordering Changes Regression Meaning

In a continuation-ratio regression, each logit describes the odds of category \(j\) rather than a later category, conditional on being in the risk set at \(j\). If the labels have no progression, changing their order changes both the conditioning sets and the comparisons. Consequently, regression coefficients can answer different conditional questions under different orders even when the underlying category probabilities are unchanged.

Worked Example: Covariate Effects Depend on the Chosen Order

Let \(x\) be a binary covariate. Suppose the category probabilities are \(P(Y=A\mid x=0)=0.40\), \(P(Y=B\mid x=0)=0.20\), and \(P(Y=C\mid x=0)=0.40\); for \(x=1\), they are \(0.60\), \(0.20\), and \(0.20\), respectively. Treat \(A,B,C\) as nominal labels and calculate the first two forward continuation logits under two orders.

Order \(A,B,C\). At the first step, \(q_1(0)=0.40\) and \(q_1(1)=0.60\). The odds are \(0.40/0.60=2/3\) and \(0.60/0.40=3/2\), respectively. The odds ratio for \(x=1\) versus \(x=0\) at this step is \((3/2)/(2/3)=9/4=2.25\). At the second step, \(q_2(0)=0.20/(0.20+0.40)=1/3\) and \(q_2(1)=0.20/(0.20+0.20)=1/2\). Their odds are \(1/2\) and \(1\), giving an odds ratio of \(1/(1/2)=2\).

Order \(C,B,A\). At the first step, \(q_1(0)=0.40\) and \(q_1(1)=0.20\). Their odds are \(2/3\) and \(1/4\), so the odds ratio is \((1/4)/(2/3)=3/8\). At the second step, \(q_2(0)=0.20/(0.20+0.40)=1/3\) and \(q_2(1)=0.20/(0.20+0.60)=1/4\). Their odds are \(1/2\) and \(1/3\), so the odds ratio is \((1/3)/(1/2)=2/3\).

The probabilities have not changed, but the conditional comparisons and covariate odds ratios have. Since these category labels have no process-based order, the different step-specific interpretations are consequences of coding, not evidence of distinct stages in the underlying phenomenon.

A Practical Diagnostic

Before interpreting a continuation-ratio model as sequential, ask what makes someone enter and leave each risk set. The question should have an answer in the study design or substantive mechanism, not merely in the way the categories were numbered. If the only reason category \(j\) is considered before category \(j+1\) is that it was listed first, the fitted conditional logits are order-dependent descriptions rather than natural stage-specific effects.

Key takeaway: A continuation-ratio factorization can represent any positive categorical distribution for a selected ordering. Use a sequential interpretation only when the category order, eligibility rules, and risk sets correspond to a defensible process. Otherwise, the conditional comparisons may be mathematically defined but scientifically arbitrary.

Common Mistakes

  • Taking a factorization as proof of a sequence. Every positive category distribution has continuation probabilities for a chosen order. Their existence does not show that individuals passed through sequential decisions.
  • Assuming an ordered label means an ordered process. Coding nominal options as 1, 2, and 3 creates a computational order, not necessarily a meaningful progression.
  • Using the wrong risk set. At step \(j\), the forward continuation probability conditions on \(Y\geq j\). Its odds compare category \(j\) with the remaining later categories within that set.
  • Interpreting a coefficient without naming the conditional comparison. State both the event category and the risk set; otherwise, the coefficient’s meaning may be unclear or mistaken.
  • Ignoring changes under reordering. If plausible reorderings change the scientific interpretation, that is a warning that the sequential story lacks a basis in the response process.

Check Your Understanding

Use the definitions and examples above to assess each situation.

  1. Why does the ability to calculate continuation probabilities for any positive multinomial distribution fail to establish a sequential mechanism?
  2. For forward continuation probabilities, what outcomes make up the risk set at step \(j\)?
  3. A survey records preferred music genre as one of four nominal categories. What information would be needed to justify interpreting a continuation-ratio model as a sequence of decisions?
  4. In the pathway example, explain why the probability of a stage 2 intervention is \((1-q_1)q_2\), rather than simply \(q_2\).
  5. What should an analyst investigate if reordering nominal labels substantially changes the interpretation of fitted continuation logits?
Clinical Biostats