Tutorials › Generalized Linear Mixed Models (GLMM) › Unequal Category Spacing Does Not Make An Outcome Continuous

Responses: Binary, Count, Ordinal, Overdispersed · Tutorial 97 of 698

Unequal Category Spacing Does Not Make An Outcome Continuous

Learn how to preserve ordinal meaning when response categories are unevenly spaced, and why numerical labels alone do not justify continuous-outcome methods.

Intermediate 9 min read

What You'll Learn

  • Distinguish category order from distances between categories.
  • Explain why unequal or unknown label spacing does not make an ordinal response continuous.
  • Calculate ordinal category probabilities from cumulative probabilities without rounding intermediate values.
  • Identify how treating category codes as equally spaced can change conclusions.
  • Choose summaries and model interpretations that respect the response scale.
  • Recognize when genuinely quantitative measurements require a different model.

Order Is Not Distance

A response scale can have a clear order without telling us how far apart its categories are. For example, a person may choose among “not at all,” “a little,” “moderately,” “very,” and “extremely” in response to a question about pain. These answers have a natural order. But the labels do not specify that the distance from “not at all” to “a little” equals the distance from “very” to “extremely”—or even provide a unit in which either distance can be measured.

This distinction matters when choosing an outcome representation. Assigning the codes 1 through 5 makes categories easier to store and display, but those codes record order; they do not establish a quantitative scale. A mixed model for an ordinal response can represent ordered category probabilities while retaining the response process. Treating the codes as continuous instead imposes additional assumptions about numerical distances and the meaning of arithmetic on the codes.

Definition: An ordinal outcome has categories with a meaningful ordering, but the distances between successive categories are not known to be equal on a quantitative scale. Numerical codes for its categories may express their order; by themselves, they do not turn the outcome into a continuous measurement.

The question is not whether category labels look uneven, or whether someone can write a number beside each label. The question is what the measurement process tells us. An ordinal response identifies which ordered category contains a response. A continuous measurement, by contrast, has a quantitative scale on which differences have a defined interpretation in the measurement units.

Category Labels and Likert-Type Responses

A Likert-type item asks a respondent to select one ordered answer, such as a level of agreement or frequency. Its categories can be coded 1, 2, 3, 4, and 5 for data handling. The code 4 means that the fourth ordered category was selected; it does not establish that the category is twice as far from the first category as the category coded 2. Nor does it establish equal intervals between all five categories.

The same distinction applies if category labels themselves refer to amounts. “Never,” “rarely,” “sometimes,” “often,” and “always” are ordered frequency categories, but without defined time intervals or other quantitative boundaries, the words do not specify equal frequency differences. Conversely, if responses are recorded as actual minutes, counts, or another measured quantity, those recorded values may support quantitative modeling. The measurement process, not the choice of labels, determines which interpretation is warranted.

In an ordinal model, the order constrains the probabilities: categories higher in the order represent responses at least as high as categories below them. A model can estimate category probabilities or cumulative probabilities without asserting that the response is a point on an equally spaced numerical scale. The likelihood should be chosen in light of how the response categories are generated, as in the earlier material on choosing an ordinal likelihood from the response process.

Worked Example: Reading an Unevenly Spaced Response Scale

Suppose, hypothetically, that a survey asks how often a participant experienced a symptom during the past month. The five response labels are “never,” “once,” “a few times,” “many times,” and “almost every day,” coded 1 through 5. Classify the outcome and explain what the codes permit.

Classification. The categories are ordinal: “never” is below “once,” which is below “a few times,” and so on. The labels provide no exact number of occurrences for “a few times” or “many times,” and do not define equal jumps between categories.

Permitted interpretation. Code 5 indicates a higher response category than code 3. The codes also let us tabulate how many participants chose each category and calculate cumulative proportions, such as the proportion choosing category 3 or below.

Not established by coding. A difference of 2 code points does not have a known symptom-frequency meaning. In particular, the difference between codes 1 and 3 cannot be interpreted as the same quantity of change as the difference between codes 3 and 5. The response remains ordinal unless the underlying measurements provide a quantitative scale.

Why Arithmetic on Category Codes Can Mislead

A useful test for a summary of ordinal data is whether it depends on arbitrary choices of numerical labels. Any strictly increasing recoding preserves the category order. If a conclusion changes under such a recoding, it is relying on distances that the ordinal scale did not specify.

For instance, the labels 1, 2, 3, 4, 5 and the labels 1, 2, 4, 7, 11 describe the same five-category order. The second set spaces some category codes farther apart than others. Neither coding is more faithful to the measurement process unless external information gives those numbers a quantitative interpretation.

Worked Example: A Mean That Depends on the Coding

Consider hypothetical responses from two groups on a five-category ordered item. Group A selects categories 1, 1, and 3; Group B selects categories 2, 2, and 2. First code the categories 1, 2, 3, 4, 5.

The coded mean for Group A is \((1+1+3)/3=5/3=1.667\), and for Group B it is \((2+2+2)/3=2.000\). On this coding, Group B's mean is higher by \(2.000-1.667=0.333\) code points.

Now use the equally order-preserving labels 1, 2, 4, 7, 11. Category 3 is now coded 4, while categories 1 and 2 retain codes 1 and 2. Group A's mean becomes \((1+1+4)/3=2.000\), and Group B's remains \((2+2+2)/3=2.000\). The coded mean difference is now \(0.000\).

The responses and their ordering have not changed, but the apparent mean difference has. Therefore the mean difference is not determined by ordinal information alone. A report should instead use summaries that respect the categories, such as category counts, category proportions, or cumulative proportions, unless the category scores have a separately justified quantitative meaning.

Category Probabilities Without Equal Spacing

An ordinal probability model can work directly with ordered cutpoints on a model scale. The cutpoints are not measurements of distances between the observed category labels. For illustration, consider a cumulative-logit form with five categories and a fixed linear predictor value \(\eta=0\). Let \(\theta_1<\theta_2<\theta_3<\theta_4\) be ordered cutpoints, and let \(F(t)=1/(1+\exp(-t))\) be the logistic cumulative distribution function. The model specifies the probability of category \(k\) or below. In this example, the cutpoints are \(-1.2,-0.4,0.5,1.4\).

Model statement: For this illustrative cumulative-logit model, \(P(Y\leq k\mid\eta)=F(\theta_k-\eta)\), for \(k=1,\ldots,4\). The category probability is obtained by subtracting adjacent cumulative probabilities; the first and last categories use the lower and upper endpoints, respectively. The cutpoints must be ordered so these probabilities are nonnegative.

The model is conditional on the specified \(\eta\); in a mixed model, \(\eta\) can include covariates and a random effect. The example below sets \(\eta=0\) to keep the arithmetic clear. Its calculations use the logistic distribution as a model assumption, not because the observed category labels have equal intervals.

Worked Example: Calculating Five Ordinal Category Probabilities

Using the stated cutpoints and \(\eta=0\), first calculate the cumulative probabilities at the four cutpoints:

$$ \begin{aligned} F(-1.2)&=0.231475,\\ F(-0.4)&=0.401312,\\ F(0.5)&=0.622459,\\ F(1.4)&=0.802184. \end{aligned} $$

The first category has probability \(F(-1.2)=0.231475\). The second has probability \(F(-0.4)-F(-1.2)=0.401312-0.231475=0.169837\). The third has probability \(F(0.5)-F(-0.4)=0.622459-0.401312=0.221147\). The fourth has probability \(F(1.4)-F(0.5)=0.802184-0.622459=0.179725\). The fifth, above the last cutpoint, has probability \(1-F(1.4)=1-0.802184=0.197816\).

Rounded individually to four decimal places, the category probabilities are approximately 0.2315, 0.1698, 0.2211, 0.1797, and 0.1978. Their unrounded values sum to 1. The displayed rounded values sum to 0.9999, which is a rounding effect. In particular, calculating the third probability from the unrounded cumulative probabilities gives \(0.6224593312-0.4013123399=0.2211469913\), or 0.2211 to four decimal places—not 0.2212.

This calculation uses the ordering of categories and cutpoints. It does not assign a distance in the response scale between categories 1 and 2, or between any other adjacent pair. The cutpoints locate cumulative probabilities on the model scale; they are not evidence that the observed category labels form an equally spaced numerical outcome.

Justification: Why the Probabilities Sum to One

The subtraction rule follows directly from the fact that the cumulative events are nested. For categories \(1,\ldots,K\), define \(C_k=P(Y\leq k\mid\eta)\), set \(C_0=0\), and set \(C_K=1\). The event \(Y=k\) is the event \(Y\leq k\) with the event \(Y\leq k-1\) removed. Therefore its probability is the difference of those cumulative probabilities.

$$ P(Y=k\mid\eta)=C_k-C_{k-1}, \qquad \sum_{k=1}^{K}P(Y=k\mid\eta) =\sum_{k=1}^{K}(C_k-C_{k-1}) =C_K-C_0 =1. $$

For these differences to be nonnegative, cumulative probabilities must be nondecreasing: \(C_k\geq C_{k-1}\). In the illustrative cumulative-logit model, the logistic function is increasing, so ordered cutpoints \(\theta_1<\cdots<\theta_{K-1}\) give ordered cumulative probabilities at a fixed \(\eta\). This is a basic probability condition, not an assumption that the observed categories are equally distant.

Assumptions, Diagnostics, and Alternatives

The classification as ordinal depends on the response process: categories must have a meaningful order, while the data do not supply a justified quantitative distance scale. If the model uses cumulative probabilities, it must also respect their ordering and yield valid category probabilities. Additional model assumptions depend on the likelihood and link chosen. For the illustrative cumulative-logit calculation, the logistic cumulative distribution and ordered cutpoints were specified; other ordinal likelihoods represent different response processes and should not be substituted merely because labels look uneven.

Useful checks begin with the response instrument and data coding. Confirm that category labels are in the intended order, that numerical codes have not been mistaken for measured values, and that the fitted or reported category probabilities are nonnegative and sum to one before rounding. Compare category and cumulative proportions across relevant covariate or group values. A category probability outside the interval from 0 to 1, decreasing cumulative probabilities, or category probabilities that fail to sum to 1 indicates a coding, calculation, or model problem.

A practical alternative is to analyze the ordinal categories as categorical without using their order. That avoids imposing equal distances but also discards ordering information. Treating category codes as continuous uses their numerical spacing and can be concise, but it changes the interpretation and requires a defensible quantitative scale. An ordinal likelihood retains category order without claiming that code differences are measured intervals. In a GLMM, adding random effects can represent dependence or heterogeneity; it does not convert the response scale into a continuous one.

This distinction has limits. If the data actually record a quantitative variable, or categories correspond to known measurement intervals and the scientific question concerns the underlying quantity, a quantitative or interval-based model may be appropriate. That is a different measurement situation from a Likert-type response whose labels only establish order. The classification should follow the information in the measurement, not a preference for one model family.

Common Mistake

Common mistake: “The response has five categories coded 1 through 5, so it is continuous; a one-point increase is the same amount anywhere on the scale.” The correction is that numerical codes alone establish neither equal intervals nor a continuous measurement. Unless the measurement process justifies those distances, interpret the response as ordinal and use a method that respects its ordered categories.

A related mistake is to infer that unequal wording makes the response nominal. Unequal or unknown spacing does not remove the ordering. The categories remain ordinal when their order is meaningful; what remains unknown is the quantitative distance between them.

Key takeaway: An ordered response scale supplies an order, not necessarily a unit or equal intervals. Preserve that distinction in the likelihood, summaries, and interpretation; arithmetic on category codes is justified only when the measurement provides a quantitative scale.

Check Your Understanding

Answer each question using the distinction between order and quantitative distance.

  1. A five-category agreement item is coded 1 through 5. What does the coding establish, and what does it not establish?
  2. For cumulative probabilities \(C_1=0.20\), \(C_2=0.55\), and \(C_3=0.80\) in a four-category outcome, calculate all four category probabilities.
  3. Why can two strictly increasing sets of category codes produce different coded means for the same ordinal responses?
  4. A symptom scale records actual minutes of pain during a specified period rather than verbal categories. Is that automatically the same measurement situation as a Likert-type item? Explain.

Solutions. (1) The codes establish category order, but not equal distances or a quantitative unit. (2) The probabilities are \(0.20\), \(0.55-0.20=0.35\), \(0.80-0.55=0.25\), and \(1-0.80=0.20\); they are nonnegative and sum to 1. (3) A strictly increasing recoding preserves order but can change the numerical gaps, so arithmetic summaries such as means can change. (4) No. Actual minutes have a defined quantitative unit, unlike verbal categories that only rank responses; the measurement process and scientific question should guide the model choice.

Clinical Biostats