Why Logit Coefficients Need Translation
A logit model is often reported as a table of estimated coefficients, but a coefficient is not a direct change in outcome probability. Its scale is the conditional log-odds: a slope describes how the log-odds of the outcome change as a regressor changes, with the other included regressors held fixed. Exponentiating the slope puts the same comparison on the odds-ratio scale, which is often easier to communicate.
The phrase “conditional on the other regressors” is central. It specifies what is being kept equal in the comparison. It does not, by itself, make the comparison causal, and an odds ratio is not a probability ratio. To interpret a coefficient correctly, first identify the model, the outcome coded as one, and the units in which each regressor is measured.
The Logit Model and Conditional Log-Odds
Let \(Y_i\) be a binary outcome, coded \(1\) when the event of interest occurs and \(0\) otherwise. Let \(X_i=(X_{i1},\ldots,X_{ik})\) denote the \(k\) regressors for observation \(i\). A logit model specifies the conditional probability of the event as
Here \(p(x)\) is the probability of \(Y_i=1\) given the regressor values \(x\). The quantity \(p(x)/(1-p(x))\) is the conditional odds of the event rather than the non-event. The logarithm of those odds is the conditional log-odds, also called the logit. The coefficient \(\beta_j\) is a model parameter; in an estimated model, its reported counterpart is typically \(\hat{\beta}_j\).
This interpretation follows from the specified linear form of the conditional log-odds. It is not an assumption that probability changes linearly with a regressor. A one-unit change means one unit on the regressor’s recorded scale: for example, one year, one percentage point, or one dollar, depending on how the variable was defined.
Deriving the Conditional Odds Ratio
To compare two regressor settings, hold every regressor except \(X_j\) fixed. Let the first setting have \(X_j=x_j\), and let the second have \(X_j=x_j+\Delta\), where \(\Delta\) is the size of the change. Subtracting the two conditional log-odds gives the change in log-odds.
The intercept and all terms for the other regressors cancel because they are the same in both settings. Exponentiating the difference of log-odds gives the ratio of the odds:
Thus, a one-unit increase has conditional odds ratio \(\exp(\beta_j)\), and a \(\Delta\)-unit increase has conditional odds ratio \(\exp(\beta_j\Delta)\). In the additive model, this ratio does not depend on the fixed values of the other regressors. This constancy is a property of the model’s log-odds specification, not a claim that probability differences are constant.
Worked Example: A Continuous Regressor Measured in Years
Suppose a hypothetical model predicts whether a customer renews a service (\(Y=1\)) using customer age in years and several other measured characteristics. The estimated age coefficient is \(\hat{\beta}_{\text{age}}=-0.08\) per year. Interpret a five-year increase in age, comparing customers with the same values of the other regressors.
The estimated change in conditional log-odds for five additional years is \(\hat{\beta}_{\text{age}}\Delta=(-0.08)(5)=-0.40\). The corresponding conditional odds ratio is
At fixed values of the other regressors, the model therefore assigns the customer who is five years older about \(0.6703\) times the renewal odds of the younger customer, or about \(1-0.6703=0.3297\), a 33.0% lower odds. This is a comparison of odds, not a claim that the renewal probability falls by 33.0 percentage points or by 33.0%. The conclusion is conditional on the other included regressors being held equal.
Reading the Sign and Size of a Slope
A positive slope means that an increase in the regressor raises conditional log-odds and multiplies conditional odds by a number greater than one. A negative slope means that it lowers conditional log-odds and multiplies odds by a number between zero and one. A zero slope corresponds to an odds ratio of one, so the model specifies no change in conditional odds for that regressor change.
For a coefficient \(\beta_j\), the percentage change in odds for a one-unit increase is \(100[\exp(\beta_j)-1]\%\). This expression is signed: if \(\exp(\beta_j)<1\), the result is negative. For a change of \(\Delta\) units, use \(100[\exp(\beta_j\Delta)-1]\%\). Reporting the odds ratio alongside the units of the change prevents an ambiguous statement such as “the odds go up by \(\beta_j\).”
Changing the measurement scale changes the numerical coefficient but not the underlying comparison when the change is described consistently. If a variable is recorded in tens rather than single units, its coefficient is the log-odds change per ten original units. The coefficient must always be interpreted using the actual coding and scale in the fitted model.
Worked Example: Holding Other Regressors Fixed
Consider a hypothetical logit model for whether an applicant receives a loan offer (\(Y=1\)). The estimated model includes income measured in thousands of dollars and credit history measured in years:
Compare two otherwise equal applicants, one with annual income of \$60,000 and one with annual income of \$50,000, while holding credit-history years fixed. Income rises by 10 units on the model’s scale, since each unit represents \$1,000. The estimated difference in conditional log-odds is
The estimated conditional odds ratio is \(\exp(0.60)\approx 1.822\). Thus, at the same credit-history value, the model associates the \$60,000 income level with about 1.82 times the loan-offer odds of the \$50,000 level, or approximately 82.2% higher odds. The coefficient \(0.06\) is per \$1,000, so interpreting it as the comparison for a \$10,000 increase would understate the change. This model-based conditional association does not establish that raising a person’s income would cause a loan offer.
Indicator Regressors and Outcome Coding
For a binary regressor coded \(0\) and \(1\), its coefficient compares the two groups while the other regressors are fixed. The change in that regressor is one unit, so the conditional odds ratio for group \(1\) relative to group \(0\) is \(\exp(\beta_j)\). The order of the comparison matters: reversing the groups gives the reciprocal odds ratio, \(\exp(-\beta_j)=1/\exp(\beta_j)\).
The outcome coding matters as well. The interpretation above concerns the odds of \(Y=1\). If the event of interest is instead coded \(0\), then the odds being modeled are for the opposite outcome. Always state which event is coded as one before describing a positive or negative coefficient.
Worked Example: An Indicator Regressor and Odds
Suppose a hypothetical logit model for attending a scheduled appointment uses an indicator for receiving a reminder: \(R=1\) for a reminder and \(R=0\) otherwise. The estimated reminder coefficient is \(\hat{\beta}_R=\log(1.5)\approx0.4055\). For a person without a reminder who has a predicted attendance probability of \(0.20\) at specified values of the other regressors, calculate the corresponding odds and the model-implied odds and probability with a reminder, keeping those other regressors fixed.
Without a reminder, the conditional odds are \(\frac{0.20}{1-0.20}=0.25\). The conditional odds ratio for \(R=1\) versus \(R=0\) is
The model-implied odds with a reminder are therefore \(0.25(1.5)=0.375\). Converting those odds back to a probability gives \[ \frac{0.375}{1+0.375} =\frac{3}{11} \approx0.2727. \] At these fixed covariate values, the predicted probability is about \(0.2727\) with a reminder rather than \(0.20\) without one. The increase here is about 7.27 percentage points, not 50 percentage points. The odds rose by 50%; the probability change depends on the starting odds.
What the Interpretation Does—and Does Not—Say
The conditional odds ratio compares model-implied odds for two regressor settings with all the other included regressors fixed. It describes a feature of the specified conditional-mean model. Its interpretation relies on the model’s outcome coding, regressor units, and functional form. In particular, the constant odds-ratio comparison for a regressor follows from the additive logit specification; a different specification can imply a different comparison.
A conditional association is not automatically a causal effect. To make a causal claim requires a defensible causal design and assumptions beyond writing down a logit model. Nor should an odds ratio be described as a ratio of probabilities. An odds ratio of 1.5 means that one set of conditional odds is 1.5 times another set of conditional odds. It does not mean the probability is 1.5 times as large.
Common Mistakes
- Calling a slope a probability change. A slope is on the log-odds scale. Exponentiate it to obtain the odds ratio; do not describe the coefficient itself as a change in probability.
- Forgetting the unit. A coefficient per year is not a coefficient per decade. Multiply by the intended number of units before exponentiating for a multi-unit comparison.
- Confusing odds with probability. An odds ratio of 2 means twice the odds, not twice the probability. The probability implication depends on the starting odds.
- Leaving out the conditioning statement. State which other regressors are held fixed. The comparison is conditional on their included values.
- Making a causal claim from a model coefficient alone. A fitted logit model describes a conditional association unless additional causal assumptions and design justify a causal interpretation.
Check Your Understanding
Use the logit coefficient scale, regressor units, and outcome coding to answer each question.
- A continuous regressor has coefficient \(0.03\) per unit. What is the conditional odds ratio for a four-unit increase, holding other regressors fixed?
- A binary regressor has estimated coefficient \(-0.50\), with group \(1\) compared to group \(0\). What is the estimated conditional odds ratio for group \(1\) relative to group \(0\)?
- Why does an odds ratio of \(1.8\) not imply that the probability is 80 percentage points higher?
- A model records income in thousands of dollars. What income change does a one-unit increase represent, and what information should accompany an interpretation of its coefficient?
- What additional basis is needed before describing a conditional logit coefficient as a causal effect?