Why Interactions Need Conditional Interpretations
In a multinomial logit model, an interaction means that a predictor’s effect on a category logit depends on another predictor. The coefficient of the interaction is not, by itself, the effect for every category comparison or every covariate value. To interpret it, specify both which categories are being compared and the values of the predictors being held fixed.
This tutorial uses category 0 as the baseline and categories \(j=1,\ldots,J-1\) as the alternatives. Let \(x\) and \(z\) be predictors, and let \(\mathbf{w}\) denote any other covariates, held fixed when making a conditional comparison. Write the category-versus-baseline logit as
The interaction coefficient \(\delta_j\) belongs to category \(j\)'s logit versus category 0. It need not equal the interaction coefficient in another category's logit. For convenience, set the baseline category's coefficients to zero: \(\alpha_0=\beta_0=\gamma_0=\delta_0=0\) and \(\boldsymbol{\lambda}_0=\mathbf{0}\). This lets the same formulas cover comparisons involving the baseline.
Reading the Category-Specific Interaction
When \(x\) is continuous, differentiating the category-\(j\)-versus-baseline logit with respect to \(x\) gives
Thus \(\beta_j\) is the slope when \(z=0\), while \(\delta_j\) is the change in that slope for a one-unit increase in \(z\). If \(z\) is a binary indicator, \(\beta_j\) is the slope in the \(z=0\) group and \(\beta_j+\delta_j\) is the slope in the \(z=1\) group. For a one-unit increase in \(x\), exponentiating the slope gives the corresponding odds ratio against the baseline.
If \(x\) is binary, the same algebra describes the change from \(x=0\) to \(x=1\); the conditional log-odds change is \(\beta_j+\delta_jz\). The interpretation of an interaction therefore depends on predictor coding and reference values. If \(z=0\) is not a meaningful value for a continuous predictor, centering \(z\) at a meaningful value can make the main-effect coefficient easier to interpret, without changing the fitted model.
Worked Example: A Continuous Predictor and a Binary Modifier
Suppose outcomes are categories A, B, and 0, with 0 as baseline. Let \(z=0\) and \(z=1\) indicate two groups, and suppose the fitted logits are
For a one-unit increase in \(x\) in group \(z=0\), the log-odds slopes are \(0.7\) for A versus 0 and \(0.2\) for B versus 0. The corresponding odds ratios are \(\exp(0.7)\approx2.014\) and \(\exp(0.2)\approx1.221\).
In group \(z=1\), the slopes are \(0.7+0.5=1.2\) for A versus 0 and \(0.2-0.1=0.1\) for B versus 0. The odds ratios are \(\exp(1.2)\approx3.320\) and \(\exp(0.1)\approx1.105\). These are conditional odds ratios for the named category comparison, not changes in category probabilities.
For A versus B, subtract the two logits. The slope for \(x\) at \(z=0\) is \(0.7-0.2=0.5\), so the pairwise odds ratio per unit increase in \(x\) is \(\exp(0.5)\approx1.649\). At \(z=1\), the slope is \(1.2-0.1=1.1\), giving \(\exp(1.1)\approx3.004\). The answer changes because the interaction coefficient for A, \(0.5\), differs from that for B, \(-0.1\).
Deriving Conditional Pairwise Odds Ratios
The model directly gives logits against category 0, but many questions compare two nonbaseline categories. The relevant quantity is obtained by subtracting their logits. This subtraction removes the baseline probability from the odds ratio, leaving a contrast between the two categories’ coefficients.
To verify this, first note that the log of the category-\(j\)-versus-\(k\) odds at \(x\) is
The terms not involving \(x\) cancel when this expression at \(x_0\) is subtracted from the expression at \(x_1\). The remaining difference is \((x_1-x_0)\{(\beta_j-\beta_k)+(\delta_j-\delta_k)z\}\). Exponentiating that log-odds difference gives the displayed odds ratio. This argument also applies when \(j\) or \(k\) is the baseline, using its zero coefficients. \(\square\)
For a one-unit increase in \(x\), the pairwise log-odds slope is \((\beta_j-\beta_k)+(\delta_j-\delta_k)z\). In particular, the interaction relevant to the \(j\)-versus-\(k\) comparison is the difference \(\delta_j-\delta_k\), not just \(\delta_j\). A category-specific interaction coefficient answers a question against the baseline; a nonbaseline pairwise comparison requires a contrast of interaction coefficients.
Worked Example: A Binary-by-Binary Interaction
Let \(x\) indicate treatment (1 versus 0), \(z\) indicate a subgroup (1 versus 0), and category C be the baseline. Suppose
For A versus C, the treatment log-odds contrast is \(0.4\) in subgroup \(z=0\), giving an odds ratio of \(\exp(0.4)\approx1.492\). In subgroup \(z=1\), it is \(0.4+0.8=1.2\), giving \(\exp(1.2)\approx3.320\).
For B versus C, the treatment contrasts are \(-0.1\) and \(-0.1+0.3=0.2\). The corresponding odds ratios are \(\exp(-0.1)\approx0.905\) and \(\exp(0.2)\approx1.221\).
For A versus B, the treatment contrast in subgroup \(z=0\) is \(0.4-(-0.1)=0.5\), with odds ratio \(\exp(0.5)\approx1.649\). In subgroup \(z=1\), the contrast is \((0.4+0.8)-(-0.1+0.3)=1.0\), with odds ratio \(\exp(1)\approx2.718\). This comparison uses the interaction contrast \(0.8-0.3=0.5\).
Binary Interactions as Differences-in-Differences
When both predictors are binary, the interaction coefficient has a particularly direct contrast interpretation. For category \(j\) versus the baseline, compare the treatment log-odds change between the \(z=1\) and \(z=0\) groups. This is a difference between two differences.
The equality follows by substituting the model into each bracket: terms that do not change with \(x\) cancel within each bracket, and subtracting the \(z=0\) treatment contrast from the \(z=1\) treatment contrast leaves \(\delta_j\). On the odds-ratio scale, exponentiating gives
For categories \(j\) and \(k\), the corresponding difference-in-differences is \(\delta_j-\delta_k\), and its exponent is the ratio of their treatment odds ratios across the two groups. This is a contrast on the category-pair log-odds scale.
Worked Example: Matching a Pairwise Question to a Contrast
Suppose a model has categories A, B, and 0. Medication \(x\) is continuous, and \(z=1\) denotes an older group while \(z=0\) denotes a younger group. The coefficients on \(x\) are \(\beta_A=0.6\) and \(\beta_B=0.1\); the coefficients on \(xz\) are \(\delta_A=-0.2\) and \(\delta_B=0.4\). A researcher asks: “How does a one-unit increase in medication change the odds of A rather than B among older individuals?”
The question names the pair A versus B and fixes \(z=1\). The A-versus-B slope is
Therefore, the conditional odds ratio is \(\exp(-0.1)\approx0.905\). For comparison, among younger individuals it is \(\exp(\beta_A-\beta_B)=\exp(0.5)\approx1.649\). The ratio of the older-group odds ratio to the younger-group odds ratio is \(\exp(-0.1-0.5)=\exp(-0.6)\approx0.549\), which also equals \(\exp(\delta_A-\delta_B)\). These calculations answer three distinct questions: the older-group effect, the younger-group effect, and how the effects differ across groups.
Choosing the Contrast That Answers the Question
Before calculating an interaction interpretation, translate the research question into a comparison. Identify the outcome categories, the predictor change, and the values of the interacting covariate. Then form the corresponding coefficient contrast.
| Question being asked | Log-odds contrast |
|---|---|
| Effect of \(x\) on category \(j\) versus baseline at \(z\) | \(\beta_j+\delta_jz\) |
| Effect of \(x\) on category \(j\) versus \(k\) at \(z\) | \((\beta_j-\beta_k)+(\delta_j-\delta_k)z\) |
| Difference in the \(x\) effect across two values \(z_1,z_0\), for \(j\) versus \(k\) | \((\delta_j-\delta_k)(z_1-z_0)\) |
Multiply a slope by \(x_1-x_0\) when the question compares a change other than one unit, then exponentiate the log-odds contrast to obtain an odds ratio. For a categorical predictor with several levels, use the indicator and reference-level coding in the fitted model: a comparison between two nonreference levels generally requires subtracting their relevant coefficient combinations. The same principle applies to interactions involving multiple indicators.
Common Mistakes and Why the Interpretation Matters
- Reading \(\beta_j\) as the effect at every value of \(z\). With an interaction, it is the effect at \(z=0\); at another value, add \(\delta_jz\).
- Using only \(\delta_j\) for a comparison of two nonbaseline categories. For \(j\) versus \(k\), the interaction contrast is \(\delta_j-\delta_k\).
- Exponentiating before forming the coefficient contrast. First subtract the appropriate logit coefficients and evaluate the covariates; then exponentiate the resulting contrast.
- Leaving the category comparison implicit. “The treatment odds ratio” is incomplete in a multinomial model unless the two outcome categories and the conditioning values are specified.
These distinctions matter because the same fitted model can produce different conditional odds ratios for different category pairs and covariate values. Writing down the target comparison first prevents an interaction coefficient from being assigned a broader interpretation than it supports. It also makes results easier to communicate: report the category pair, predictor change, conditioning values, and odds-ratio scale together.
Check Your Understanding
For each question, identify the relevant coefficient contrast before interpreting it.
- In the stated model, what is the one-unit effect of \(x\) on category \(j\) versus baseline when \(z=2\)?
- How does the pairwise odds ratio for categories \(j\) versus \(k\) change when \(z\) increases by one unit?
- For binary \(x\) and \(z\), what does \(\exp(\delta_j)\) represent for category \(j\) versus baseline?
- Why is \(\delta_j\) alone generally insufficient to describe the interaction for a comparison of two nonbaseline categories?
- If the question asks for the effect of \(x\) on A versus B in the \(z=1\) group, which category-specific coefficients must be combined?