Tutorials › Generalized Linear Mixed Models (GLMM) › Proportional Odds As An Ordinal Response Assumption

Responses: Binary, Count, Ordinal, Overdispersed · Tutorial 93 of 698

Proportional Odds As An Ordinal Response Assumption

Learn how proportional odds links ordered response thresholds through common covariate effects, and what that assumption means conditionally in a GLMM.

Intermediate 10 min read

What You'll Learn

  • Write the cumulative-logit proportional-odds model with ordered thresholds.
  • Derive the common odds ratio that applies at every response threshold.
  • Convert cumulative probabilities into probabilities for individual ordinal categories.
  • Interpret proportional odds conditionally when a GLMM includes random effects.
  • Recognize diagnostics and limitations of the proportional-odds assumption.
  • Distinguish proportional odds from other ways to model ordinal responses.

Why a Shared Odds Relationship Matters

An ordinal response has categories with a meaningful order, such as low, moderate, high, and very high. A cumulative model asks, at each boundary between categories, how likely an observation is to fall at or below that boundary rather than above it. The proportional-odds assumption says that a covariate has the same odds effect at every such boundary. It is a useful simplification, but it is a substantive restriction on how covariates relate to the response.

This tutorial focuses on that shared-odds restriction. The cumulative-link likelihood for ordinal responses supplies the setting: the model represents cumulative probabilities using thresholds and a link function. Here the link is the logit, and the central question is whether the covariate effects can be held equal across all thresholds.

Model Definition and Assumptions

Definition: Let \(Y_{ig}\) be an ordinal response for observation \(i\) in group \(g\), with ordered categories \(1,\ldots,K\). A cumulative-logit proportional-odds mixed model is $$ \operatorname{logit}\{P(Y_{ig}\leq j\mid \mathbf{x}_{ig},\mathbf{b}_g)\} =\theta_j-\mathbf{x}_{ig}^{\mathsf T}\boldsymbol{\beta}-\mathbf{z}_{ig}^{\mathsf T}\mathbf{b}_g,\qquad j=1,\ldots,K-1. $$ Here \(\theta_1<\cdots<\theta_{K-1}\) are ordered thresholds; \(\mathbf{x}_{ig}\) is the vector of fixed-effect covariates; \(\boldsymbol{\beta}\) is one shared vector of covariate effects; and \(\mathbf{b}_g\) is a group-level random effect with design vector \(\mathbf{z}_{ig}\). The proportional-odds assumption is that \(\boldsymbol{\beta}\) does not depend on threshold \(j\).

The model is conditional on the random effects: it describes the response probabilities for observations with specified covariates and a specified value of \(\mathbf{b}_g\). A common GLMM specification assumes \(\mathbf{b}_g\sim N(\mathbf{0},\mathbf{G})\), with independent random effects across groups and independence of responses across observations conditional on the random effects and covariates. The exact random-effects structure must suit the sampling design. The ordinal categories must be correctly ordered, and the thresholds must remain ordered so that cumulative probabilities increase with \(j\).

The minus signs in the model fix the direction of interpretation. Holding other covariates and the random effects fixed, a positive coefficient increases the odds of being above any particular threshold. Equivalently, it decreases the odds of being at or below that threshold. A different sign convention is possible, but interpretations must then change accordingly.

Deriving the Common Odds Ratio

For threshold \(j\), the cumulative odds of being at or below category \(j\), rather than above it, are the cumulative probability divided by its complement. Applying the logit model and exponentiating gives

$$ \frac{P(Y_{ig}\leq j\mid \mathbf{x}_{ig},\mathbf{b}_g)} {P(Y_{ig}>j\mid \mathbf{x}_{ig},\mathbf{b}_g)} = \exp\left(\theta_j-\mathbf{x}_{ig}^{\mathsf T}\boldsymbol{\beta} -\mathbf{z}_{ig}^{\mathsf T}\mathbf{b}_g\right). $$

Now compare two covariate vectors that differ by \(\Delta\mathbf{x}\), while holding the random effect and other covariates fixed. The ratio of their cumulative odds at the same threshold is

$$ \frac{\operatorname{odds}(Y\leq j\mid \mathbf{x}+\Delta\mathbf{x},\mathbf{b})} {\operatorname{odds}(Y\leq j\mid \mathbf{x},\mathbf{b})} = \frac{\exp\{\theta_j-(\mathbf{x}+\Delta\mathbf{x})^{\mathsf T}\boldsymbol{\beta} -\mathbf{z}^{\mathsf T}\mathbf{b}\}} {\exp\{\theta_j-\mathbf{x}^{\mathsf T}\boldsymbol{\beta} -\mathbf{z}^{\mathsf T}\mathbf{b}\}} = \exp(-\Delta\mathbf{x}^{\mathsf T}\boldsymbol{\beta}). $$

The threshold and random-effect terms cancel. Thus this odds ratio is the same for every \(j\). If instead the odds are defined as \(P(Y>j)/P(Y\leq j)\), the common ratio is \(\exp(\Delta\mathbf{x}^{\mathsf T}\boldsymbol{\beta})\). This derivation is the defining consequence of proportional odds: a covariate shifts each cumulative logit by the same amount, though the baseline cumulative odds differ across thresholds.

Worked Example: One Odds Ratio Across Three Thresholds

Suppose a hypothetical four-category symptom rating is modeled using one continuous covariate \(x\), measured in tens of units. The fitted coefficient is \(\beta=0.70\), with cumulative logits \(\operatorname{logit}\{P(Y\leq j)\}=\theta_j-0.70x\). Consider a one-unit increase in \(x\), holding other predictors and the random effect fixed.

For the odds of being above a threshold, the multiplier is \(\exp(\beta)=\exp(0.70)=2.014\). Therefore, at each of the three boundaries, a one-unit increase in \(x\) multiplies the conditional odds of a rating above that boundary by about 2.01. In the reverse direction, the odds of being at or below each boundary are multiplied by \(\exp(-0.70)=0.4966\).

The relationship is common across thresholds, not the odds themselves. For example, if the odds of being above the first boundary at a particular covariate value are 1, they become 2.014 after the increase. If the odds above the second boundary are 0.5, they become \(0.5(2.014)=1.007\). Different starting odds are compatible with the same odds ratio.

From Cumulative Probabilities to Category Probabilities

The model specifies cumulative probabilities, but the observed response occupies one category. Write \(F_j=P(Y\leq j\mid\mathbf{x},\mathbf{b})\). Then the probability of category 1 is \(F_1\), the probability of an interior category \(k\) is \(F_k-F_{k-1}\), and the probability of category \(K\) is \(1-F_{K-1}\). Ordered thresholds ensure that these differences are nonnegative.

Worked Example: Calculating Four Category Probabilities

Consider a hypothetical four-category response with thresholds \(\theta_1=-1.0\), \(\theta_2=0.5\), and \(\theta_3=1.5\). At a particular covariate and random-effect value, let the combined linear predictor be \(\eta=\mathbf{x}^{\mathsf T}\boldsymbol{\beta}+\mathbf{z}^{\mathsf T}\mathbf{b}=0.40\). The cumulative-logit model gives \(F_j=\operatorname{logit}^{-1}(\theta_j-\eta)\), where \(\operatorname{logit}^{-1}(a)=1/(1+\exp(-a))\).

The cumulative probabilities are

$$ F_1=\frac{1}{1+\exp(1.40)}=0.1978,\quad F_2=\frac{1}{1+\exp(-0.10)}=0.5250,\quad F_3=\frac{1}{1+\exp(-1.10)}=0.7503. $$

Therefore, the four category probabilities are \(P(Y=1)=0.1978\), \(P(Y=2)=0.5250-0.1978=0.3272\), \(P(Y=3)=0.7503-0.5250=0.2253\), and \(P(Y=4)=1-0.7503=0.2497\). They sum to \(1.0000\), subject to rounding. The probabilities need not increase or decrease across the categories; only the cumulative probabilities must be nondecreasing.

Conditional Interpretation in a Mixed Model

When a GLMM has random effects, the proportional-odds statement is conditional on those effects. For a random-intercept model, \(\mathbf{z}_{ig}^{\mathsf T}\mathbf{b}_g=b_g\), so each group may have a different baseline tendency toward lower or higher categories. But if the model contains only a shared fixed slope, a one-unit increase in a predictor still has the same conditional odds ratio at every threshold within any given group.

Worked Example: A Conditional Group-Specific Calculation

Suppose a hypothetical model has three categories, threshold \(\theta_1=0.5\), predictor coefficient \(\beta=0.70\), and a group random intercept \(b_g=0.30\). For a subject with \(x=0\), the odds of a response above category 1 are

$$ \frac{P(Y>1\mid x=0,b_g=0.30)}{P(Y\leq1\mid x=0,b_g=0.30)} =\exp(x\beta+b_g-\theta_1) =\exp(0+0.30-0.50)=\exp(-0.20)=0.8187. $$

For the same group at \(x=1\), those odds are \(\exp(0.70+0.30-0.50)=\exp(0.50)=1.649\). Their ratio is \(1.649/0.8187=2.014\), which equals \(\exp(0.70)\). The calculation is conditional on \(b_g=0.30\); it does not say that every group has the same baseline odds.

A conditional odds ratio should not automatically be described as a population-average odds ratio. Integrating over random effects averages probabilities, and the logit of an average probability is generally not the average of the conditional logits. As a result, the marginal relationship after averaging over groups need not retain exactly the same odds ratio.

Checking the Assumption and Recognizing Its Limits

Proportional odds is a model assumption, not a consequence of the response being ordinal. Its plausibility can be examined by comparing observed cumulative patterns across covariate values, inspecting fitted-versus-observed cumulative probabilities, and assessing whether threshold-specific effects show systematic differences. In a mixed model, these checks should respect clustering; treating correlated observations as independent can make evidence against the assumption look more precise than it is.

For example, if estimates from separate threshold-specific comparisons are approximately \(0.60\), \(0.65\), and \(0.55\), they are at least descriptively close to a common coefficient. Their corresponding odds ratios for being above each threshold are \(\exp(0.60)=1.822\), \(\exp(0.65)=1.916\), and \(\exp(0.55)=1.733\). This proximity alone does not establish proportional odds: sampling uncertainty, the model structure, and whether differences are practically important also matter. Conversely, substantially different patterns across thresholds may signal that one common slope is too restrictive.

Other warning signs include poor fit concentrated in particular categories, predicted category probabilities that systematically miss observed frequencies, and implausible fitted probabilities for covariate combinations of interest. Sparse categories can make these assessments unstable. A poorly specified random-effects structure or an incorrect linear form for a continuous predictor can also produce apparent threshold differences, so a diagnostic signal is not proof that proportional odds alone is the problem.

ApproachWhat it allowsWhat to keep in mind
Proportional-odds cumulative logitOne shared covariate slope across cumulative thresholdsCompact interpretation, but the shared-slope restriction must be plausible
Threshold-specific cumulative effectsEffects may differ across cumulative thresholdsMore flexibility requires more parameters and can be difficult with sparse categories
Adjacent-category or continuation-ratio modelsModels odds between neighboring categories or sequential conditional probabilitiesThese represent different probability comparisons and may suit different response processes
Nominal multicategory modelDoes not use the category ordering in the same wayCan be useful when order is not substantively informative, but may use more parameters

The alternatives in the table answer different questions; they are not interchangeable versions of the same assumption. The proportional-odds model is attractive when a single shift in the cumulative distribution is meaningful and the shared effects are adequate. Its limitations include that restrictive shift structure, dependence of conditional interpretations on the random effects, and sensitivity to category coding and model specification.

Common Mistake

Common mistake: “Proportional odds means every response category has the same probability, or that the odds themselves are identical at all cutpoints.” Neither is correct. The assumption is that a specified covariate contrast has the same odds ratio for the cumulative event \(Y>j\) versus \(Y\leq j\) at every threshold \(j\). Baseline odds and category probabilities can differ across thresholds.

Another frequent error is interpreting \(\exp(\beta)\) as a probability multiplier. It multiplies conditional odds, not probabilities. For instance, multiplying odds of 0.5 by 2.014 gives odds of 1.007, corresponding to probability \(1.007/(1+1.007)=0.5017\), not twice the original probability \(0.3333\).

Key takeaway: In a cumulative-logit proportional-odds model, ordered thresholds set the different baseline cumulative probabilities, while one shared covariate coefficient determines the same conditional cumulative odds ratio at every threshold. The assumption must be evaluated in context and interpreted conditionally when random effects are present.

Check Your Understanding

Answer each question, then compare with the solutions.

  1. For a coefficient \(\beta=-0.40\), what is the conditional odds ratio for \(Y>j\) versus \(Y\leq j\) for a one-unit increase in the predictor?
  2. In a four-category response, how is \(P(Y=3)\) obtained from cumulative probabilities?
  3. Does proportional odds assert equal baseline odds at all thresholds? State what it asserts instead.
  4. Why is a conditional odds ratio in a mixed model not automatically the same as the marginal odds ratio across groups?

Solutions. (1) \(\exp(-0.40)=0.6703\) at every threshold, conditional on the random effects and other predictors; the odds of being above a threshold decrease by a factor of about 0.670 per one-unit increase. (2) \(P(Y=3)=P(Y\leq3)-P(Y\leq2)=F_3-F_2\). (3) No. Baseline odds depend on the threshold through \(\theta_j\); proportional odds asserts that the covariate odds ratio comparing two predictor values is the same across thresholds. (4) Marginal probabilities average conditional probabilities over the random-effects distribution, and taking a logit after averaging does not generally preserve the conditional log-odds slope or odds ratio.

Clinical Biostats