Tutorials › Generalized Linear Models › Selecting a Logit Structure from the Response Mechanism

Alternative Nominal Models · Tutorial 526 of 981

Selecting a Logit Structure from the Response Mechanism

Choose a logit structure by matching its comparisons to the way the response categories are scientifically related or generated.

Advanced 10 min read

What You'll Learn

  • Distinguish reference-category, neighboring-category, and sequential-stage comparisons
  • Decide when category ordering supports a model and when it does not
  • Match scientific questions to the contrasts represented by each logit
  • Recognize when sequential continuation ratios are appropriate
  • Explain why a single category table cannot by itself select a logit structure
  • Identify common errors in choosing and interpreting these models

Start With the Response Mechanism

A multinomial response can be described through several sets of logits. The choice is not merely a matter of which formula is easiest to fit: each structure emphasizes a different comparison. A useful choice begins by asking what the categories mean, which comparisons answer the scientific question, and whether responses arise through a sequence of stages.

Let \(Y\) take one of \(K\) categories, with probabilities \(p_j=P(Y=j)\), where \(p_j>0\) and \(\sum_{j=1}^K p_j=1\). If the outcome is modeled conditional on covariates \(x\), these probabilities may depend on \(x\); the comparisons below then apply at a fixed value of \(x\). The three structures considered here are baseline-category logits, adjacent-category logits, and continuation-ratio logits.

Definition: A baseline-category logit compares each nonreference category with a chosen reference category, for example \(\log(p_j/p_K)\), \(j=1,\ldots,K-1\). An adjacent-category logit compares neighboring categories, for example \(\log(p_j/p_{j+1})\), \(j=1,\ldots,K-1\). A forward continuation-ratio logit compares category \(j\) with all categories beyond \(j\), among responses still at risk of being in \(j\): \(\log\{p_j/(\sum_{r=j+1}^K p_r)\}\), \(j=1,\ldots,K-1\).

These are different sets of contrasts. Baseline-category logits need a designated reference but do not require an order. Adjacent-category logits use the immediate neighbors in a specified ordering. Continuation-ratio logits use an ordering and treat each category as a possible stage at which the response process stops or proceeds.

What Scientific Question Does Each Structure Answer?

For a nominal outcome, categories are distinct labels without a scientifically meaningful order. If the question is how each outcome compares with a particular control, usual-care, or reference outcome, the baseline-category structure directly encodes that question. The reference is a choice of comparison, not a claim that the other categories form a sequence around it.

An ordering alone does not automatically identify the right model. If neighboring categories are meaningfully distinct and the question concerns the local change from one level to the next, adjacent-category logits may be appropriate. For example, a researcher might ask how the odds of moderate rather than mild disease differ from the odds of severe rather than moderate disease. These are separate local comparisons.

A continuation-ratio structure is appropriate when the ordering also reflects a sequential process. At each stage, some responses are in the current category and the others continue to a later category. The relevant comparison is therefore the probability of stopping at stage \(j\) against proceeding beyond it, conditional on having reached the decision at \(j\). This can describe educational progression, treatment escalation, or a sequence of eligibility decisions, provided that such a process is scientifically defensible.

In short, ask whether the outcome is unordered, ordered with important neighboring contrasts, or ordered because responses pass through sequential decision stages. These are different properties: an ordered scale does not by itself mean that a sequential process generated the responses.

1
Establish the category meaning.
Decide whether categories are nominal labels or have a scientifically meaningful order. Do not infer an order from the way labels happen to be coded.
2
Name the scientific contrast.
Ask whether the target is each category versus a reference, one category versus its neighbor, or stopping at a stage versus continuing beyond it.
3
Check the response mechanism.
Use continuation ratios when the stages and risk sets correspond to a plausible sequential process, not just because the categories can be ranked.
4
Match the model to the question.
Choose a structure whose logits answer the intended contrasts and whose restrictions make sense for the scientific problem.

Worked Examples: Matching Contrasts to Questions

Worked Example: A Nominal Treatment Outcome

A trial records one of three mutually exclusive outcomes: improvement, no change, or adverse event. Suppose the probabilities for a treatment group are \(0.50\), \(0.30\), and \(0.20\), respectively. The scientific question is how each outcome compares with improvement.

Take improvement as the reference category. The baseline-category logits are

$$ \log\left(\frac{P(\text{no change})}{P(\text{improvement})}\right) =\log\left(\frac{0.30}{0.50}\right) =\log(0.6)\approx -0.511, $$
$$ \log\left(\frac{P(\text{adverse event})}{P(\text{improvement})}\right) =\log\left(\frac{0.20}{0.50}\right) =\log(0.4)\approx -0.916. $$

These two comparisons answer the stated question. The outcome labels do not form a natural severity or progression order: “no change” is not necessarily an intermediate stage between improvement and an adverse event. Thus the baseline-category structure is justified by the contrast of interest, not by any implied ordering of these three probabilities.

Worked Example: Neighboring Disease Stages

Suppose disease severity is classified as mild, moderate, or severe, with probabilities \(0.20\), \(0.50\), and \(0.30\). A study asks how odds change between neighboring severity stages. The adjacent-category logits are

$$ \log\left(\frac{P(\text{mild})}{P(\text{moderate})}\right) =\log\left(\frac{0.20}{0.50}\right) =\log(0.4)\approx -0.916, $$
$$ \log\left(\frac{P(\text{moderate})}{P(\text{severe})}\right) =\log\left(\frac{0.50}{0.30}\right) =\log\left(\frac{5}{3}\right)\approx 0.511. $$

The first logit compares mild with moderate disease; the second compares moderate with severe disease. The signs differ because mild is less probable than moderate, while moderate is more probable than severe. This structure is a natural choice when local transitions between adjacent severity levels are the scientific focus. It does not assert that every patient literally progresses through those stages.

Worked Example: Sequential Eligibility Stages

Consider an assessment with three outcomes: fails at stage 1, passes stage 1 but fails at stage 2, or passes both stages. Suppose their probabilities are \(0.40\), \(0.15\), and \(0.45\). The process first determines whether a person passes stage 1; only those who pass face stage 2.

At stage 1, the probability of stopping in category 1 is \(0.40\), and the probability of continuing is \(0.15+0.45=0.60\). The first continuation logit is therefore

$$ \log\left(\frac{0.40}{0.15+0.45}\right) =\log\left(\frac{2}{3}\right)\approx -0.405. $$

Among those who continue to stage 2, the probability of stopping there is \(0.15/(0.15+0.45)=0.25\), while the probability of passing is \(0.45/(0.15+0.45)=0.75\). The second continuation logit is

$$ \log\left(\frac{0.15}{0.45}\right) =\log\left(\frac{1}{3}\right)\approx -1.099. $$

These are stage-specific comparisons: fail now versus continue, conditional on having reached the stage. They correspond to the described process. Treating the three labels only as an ordered scale would miss this feature of the response mechanism.

Why One Category Table Cannot Decide the Structure

A single vector of positive category probabilities can be expressed through all three sets of logits. For a fixed table, each structure is simply a different way of describing the same probabilities. A fitted table alone therefore cannot establish which response mechanism is scientifically appropriate. The distinction matters when a model relates logits to covariates, because the structures impose different patterns on those covariate effects and answer different questions.

Result: For any strictly positive probability vector \(p_1,\ldots,p_K\), the forward continuation probabilities \(h_j=p_j/(\sum_{r=j}^K p_r)\), \(j=1,\ldots,K-1\), lie strictly between zero and one and uniquely determine the original probabilities.

Proof. Because every \(p_j>0\), both \(p_j\) and \(\sum_{r=j+1}^K p_r\) are positive for \(j<K\). Thus \(0<h_j<1\). Write \(S_j=\sum_{r=j}^K p_r\). Then \(h_j=p_j/S_j\), so

$$ p_j=h_jS_j,\qquad S_{j+1}=S_j-p_j=(1-h_j)S_j. $$

Since \(S_1=1\), repeated substitution gives \(S_j=\prod_{m=1}^{j-1}(1-h_m)\), with an empty product equal to \(1\). Consequently,

$$ p_j=h_j\prod_{m=1}^{j-1}(1-h_m)\quad (j<K), \qquad p_K=\prod_{m=1}^{K-1}(1-h_m). $$

These equations reconstruct every category probability from the continuation probabilities, so the representation is unique. They also show why a positive category table can always be represented by forward continuation logits: that fact alone does not show that the data arose through sequential stages. \(\square\)

The Sequential Likelihood Makes the Risk Sets Explicit

The interpretation of continuation logits is especially clear for grouped counts. Let \(n_j\) be the number of responses in category \(j\), with \(N=\sum_{j=1}^K n_j\), and define the number at risk of being in category \(j\) or later by \(R_j=\sum_{r=j}^K n_r\). At stage \(j\), \(n_j\) stop and \(R_{j+1}\) continue. The stage-specific stopping probability is \(h_j\).

Result: For \(j=1,\ldots,K-1\), the multinomial likelihood can be written as a product of binomial likelihoods for the successive risk sets:
$$ \frac{N!}{\prod_{j=1}^K n_j!}\prod_{j=1}^K p_j^{n_j} = \left\{\prod_{j=1}^{K-1}\binom{R_j}{n_j} h_j^{n_j}(1-h_j)^{R_{j+1}}\right\}. $$

Proof. From the probability reconstruction above, \(p_j=h_j\prod_{m<j}(1-h_m)\) for \(j<K\), and \(p_K=\prod_{m<K}(1-h_m)\). In the product \(\prod_j p_j^{n_j}\), the factor \(h_j\) appears with exponent \(n_j\). For each \(j<K\), the factor \(1-h_j\) appears for categories \(j+1,\ldots,K\), so its total exponent is \(R_{j+1}\). Hence

$$ \prod_{j=1}^K p_j^{n_j} =\prod_{j=1}^{K-1}h_j^{n_j}(1-h_j)^{R_{j+1}}. $$

For the combinatorial factors, \(R_j=n_j+R_{j+1}\) and \(R_1=N\). Therefore

$$ \prod_{j=1}^{K-1}\binom{R_j}{n_j} =\prod_{j=1}^{K-1}\frac{R_j!}{n_j!R_{j+1}!} =\frac{N!}{\prod_{j=1}^{K}n_j!}, $$

where \(R_K=n_K\) cancels the final remaining factorial in the denominator. Combining the probability and combinatorial identities proves the factorization. It shows precisely which people are in each stage-specific risk set; using this interpretation requires that those risk sets make sense for the scientific process. \(\square\)

Practical Checks and a Common Mistake

Before fitting a structure, state in words what each logit compares. If that sentence does not match the scientific question, the model is not made appropriate by a good numerical fit. Also distinguish the outcome’s order from the mechanism generating it: a severity scale can be ordered without being sequential, while a sequence of eligibility decisions has a process structure beyond its ordered labels.

  • Choose baseline-category logits when the outcomes are nominal or when the central question is comparison with a chosen reference category.
  • Choose adjacent-category logits when neighboring categories have substantive meaning and local comparisons are the target.
  • Choose continuation-ratio logits when responses proceed through ordered stages and the question is whether a response stops at each stage or continues.

Common mistake: “The response has three ordered categories, so a continuation-ratio model must be the right choice.” The ordering makes such logits definable, but does not establish that responses pass through stage-specific risk sets. The correction is to check how the response is generated and what comparison is of interest. If the scientific question is about neighboring severity levels, adjacent-category logits may be more direct; if there is no meaningful order, a baseline-category comparison may be preferable.

Key takeaway: Select the logit structure from the response mechanism and scientific contrast, not from the category table alone. Reference comparisons, neighboring comparisons, and sequential stop-versus-continue comparisons answer different questions.

Check Your Understanding

For each question, identify the relevant feature of the response and the most defensible logit structure.

  1. A study records whether a patient improves, has no change, or has an adverse event. The primary question compares each outcome with improvement. What structure fits the question, and why?
  2. Why does an ordered set of categories not, by itself, justify a continuation-ratio model?
  3. A researcher wants to compare mild with moderate disease and moderate with severe disease separately. Which contrasts are represented directly?
  4. In a sequential screening process, what does the denominator of the forward continuation probability at stage \(j\) represent?
  5. Why can a single positive category-probability table fail to identify which response mechanism is scientifically appropriate?
Clinical Biostats