Tutorials › Generalized Linear Models › Interpreting the Logistic Intercept

Binary Logistic Regression · Tutorial 351 of 981

Interpreting the Logistic Intercept

Interpret the logistic intercept at a specified covariate profile, convert it to baseline odds and risk, and use centering to choose a more meaningful reference profile.

Intermediate 10 min read

What You'll Learn

  • Identify the covariate profile represented by a logistic intercept.
  • Convert an intercept from log odds to odds and probability.
  • Interpret the intercept when predictors are centered at chosen reference values.
  • Derive how centering changes the intercept while preserving fitted probabilities.
  • Recognize when a zero-covariate baseline is mathematically defined but substantively unhelpful.

What the Logistic Intercept Refers To

A logistic regression intercept is not automatically the outcome probability for a typical person, nor is it necessarily the probability for anyone in the study. Its meaning depends on the covariate values at which the model is evaluated. In the usual parameterization, the intercept describes the log odds when every modeled covariate equals zero. Interpreting it well therefore requires identifying what “zero” means for the variables in the model.

Let \(Y\) be a binary outcome, coded so that \(Y=1\) is the event of interest. For a covariate vector \(x=(x_1,\ldots,x_p)^\mathsf{T}\), write the logistic regression mean model as

$$ P(Y=1\mid x)=\pi(x),\qquad \operatorname{logit}\{\pi(x)\} =\log\!\left(\frac{\pi(x)}{1-\pi(x)}\right) =\beta_0+\sum_{j=1}^{p}\beta_j x_j. $$

Here \(\beta_0\) is the intercept, and \(\beta_j\) is the coefficient multiplying covariate \(x_j\). This tutorial concerns the meaning of \(\beta_0\) and its estimate, not the interpretation of the individual slope coefficients.

Definition: In a logistic regression with an intercept, \(\beta_0\) is the model log odds of \(Y=1\) at the covariate profile \(x_1=\cdots=x_p=0\). The corresponding odds are \(\exp(\beta_0)\), and the corresponding probability is \(\exp(\beta_0)/\{1+\exp(\beta_0)\}\).

From Log Odds to Baseline Odds and Probability

The intercept is on the log-odds scale. To express it on the odds scale, exponentiate it. To express it as a probability, apply the inverse-logit function. These conversions are exact consequences of the definition of log odds.

Result: If \(\operatorname{logit}(\pi_0)=\beta_0\), then the baseline odds are \(\exp(\beta_0)\), and the baseline probability is \(\pi_0=\exp(\beta_0)/\{1+\exp(\beta_0)\}=1/\{1+\exp(-\beta_0)\}\).

To verify the conversion, start with \(\log\{\pi_0/(1-\pi_0)\}=\beta_0\). Exponentiating both sides gives \(\pi_0/(1-\pi_0)=\exp(\beta_0)\). Multiplying by \(1-\pi_0\) and collecting the terms involving \(\pi_0\) yields \(\pi_0\{1+\exp(\beta_0)\}=\exp(\beta_0)\), which gives the stated probability. The baseline probability is strictly between zero and one for every finite \(\beta_0\).

When a fitted model supplies an estimated intercept \(\hat{\beta}_0\), the corresponding plug-in estimates are \(\exp(\hat{\beta}_0)\) for baseline odds and \(1/\{1+\exp(-\hat{\beta}_0)\}\) for baseline probability. These are model-based quantities at the zero-covariate profile; they are not necessarily the sample event proportion.

Worked Example: A Negative Intercept and a Low Baseline Risk

Suppose the fitted intercept is \(\hat{\beta}_0=\log(1/9)\), with all predictors set to zero at the reference profile. Find the baseline odds and probability.

Odds. Exponentiating the intercept gives \(\exp\{\log(1/9)\}=1/9\). Thus the estimated baseline odds of the event are 1 to 9.

Probability. Odds \(o\) correspond to probability \(o/(1+o)\). Therefore \((1/9)/(1+1/9)=(1/9)/(10/9)=1/10=0.10\). Equivalently, the inverse-logit of \(\log(1/9)\) is \(0.10\). The baseline event probability is 10%, not 11.1%; \(1/9\) is the odds, not the probability.

The Meaning of Zero Depends on the Covariates

The mathematical definition is simple, but its substantive interpretation depends on how the predictors are recorded. If age is measured in years, age zero means birth. If a biomarker is recorded in its original units, zero may be outside the range observed in the study. If a binary indicator is coded zero for “not exposed” and one for “exposed,” zero refers to the unexposed category. With several predictors, the intercept refers to the profile in which all predictors simultaneously take their zero values.

That profile need not occur in the data. A model can still define a fitted probability there, provided the linear predictor is defined, but an estimate at a profile far outside the observed covariate combinations may be an extrapolation. It is important to distinguish “the model’s value at zero” from “the average outcome in the study” or “the outcome for a representative participant.”

Worked Example: A Zero Age That Is Not a Useful Clinical Baseline

Consider a model with age \(A\), measured in years, and a treatment indicator \(T\), coded zero for standard care and one for the new treatment: \(\operatorname{logit}\{\pi(A,T)\}=-3+0.04A+0.7T\). Identify the intercept profile and calculate its fitted probability.

At \(A=0\) and \(T=0\), the linear predictor is \(-3+0.04(0)+0.7(0)=-3\). Thus \(\beta_0=-3\) is the log odds for a newborn receiving standard care. The odds are \(\exp(-3)\), approximately \(0.0498\).

The probability is \(1/\{1+\exp(3)\}\approx 1/(1+20.0855)\approx 0.0474\). So the fitted event probability at the intercept profile is about 4.74%.

The calculation is correct, but whether it answers a useful clinical question is another matter: if the study concerns adults, age zero is far from the study population. The intercept should not be described as the event risk for a typical study participant. A different reference age can give the intercept a more relevant meaning.

Centering Predictors Changes the Reference Profile

Centering replaces each predictor by its deviation from a selected value. For example, if \(A\) is age and \(c\) is a chosen reference age, define \(A^*=A-c\). Then \(A^*=0\) means age \(c\), rather than age zero. The model’s fitted probabilities need not change: centering changes the coordinates used to describe the same linear predictor.

Theorem: Consider a logistic linear predictor \(\eta(x)=\beta_0+\beta^\mathsf{T}x\), where \(x\in\mathbb{R}^p\). For any fixed reference vector \(c\in\mathbb{R}^p\), define \(z=x-c\) and \(\alpha_0=\beta_0+\beta^\mathsf{T}c\). Then \(\eta(x)=\alpha_0+\beta^\mathsf{T}z\) for every \(x\). Consequently, the two parameterizations give the same fitted probability at every covariate profile, and the new intercept \(\alpha_0\) is the log odds at \(x=c\).

Proof. Since \(z=x-c\), we have \(x=z+c\). Substitute this identity into the original linear predictor: \(\eta(x)=\beta_0+\beta^\mathsf{T}(z+c)=\beta_0+\beta^\mathsf{T}z+\beta^\mathsf{T}c=(\beta_0+\beta^\mathsf{T}c)+\beta^\mathsf{T}z=\alpha_0+\beta^\mathsf{T}z\). This equality holds for every \(x\). Applying the inverse-logit to equal linear predictors gives equal probabilities. At \(x=c\), \(z=0\), so the centered predictor is \(\eta(c)=\alpha_0\); by the logistic model, this is the log odds at that profile. \(\square\)

The same algebra applies to estimated coefficients: if the original fitted coefficients are \(\hat{\beta}_0,\hat{\beta}\), then the corresponding centered intercept is \(\hat{\alpha}_0=\hat{\beta}_0+\hat{\beta}^\mathsf{T}c\). The centered intercept estimates log odds at the chosen reference profile. If the same likelihood model is fitted with this one-to-one reparameterization, each parameter setting in one form corresponds to a parameter setting in the other, with identical probabilities for every observation. Thus centering does not, by itself, alter the model’s fitted probabilities.

Worked Example: Centering Age at 50 Years

Return to \(\operatorname{logit}\{\pi(A,T)\}=-3+0.04A+0.7T\). Center age at 50 by setting \(A^*=A-50\), leaving \(T\) unchanged. Find the new intercept and interpret its baseline probability.

Substitute \(A=A^*+50\): \(-3+0.04(A^*+50)+0.7T=-3+2+0.04A^*+0.7T=-1+0.04A^*+0.7T\). The centered intercept is \(-1\). Since \(A^*=0\) means \(A=50\), and \(T=0\) means standard care, the new intercept is the log odds for a 50-year-old receiving standard care.

The corresponding odds are \(\exp(-1)\approx0.3679\). The probability is \(0.3679/(1+0.3679)\approx0.269\), or about 26.9%. Direct substitution into the original model checks the result: at \(A=50,T=0\), the linear predictor is \(-3+0.04(50)=-1\), giving the same probability.

The two intercepts answer different reference-profile questions: the uncentered intercept concerns age zero and standard care; the centered intercept concerns age 50 and standard care. The predicted probabilities at any fixed age and treatment value are unchanged.

Choosing and Reporting a Reference Profile

A reference value should be selected to make the intercept interpretable for the scientific question. For a continuous predictor, a meaningful value may be a clinically relevant measurement or a typical value in the study population. For a collection of predictors, the reference profile should be described explicitly: centering age at 50 while leaving a treatment indicator at zero makes the intercept refer to age 50 in the indicator’s zero-coded category.

Centering at a sample mean can make the zero value correspond to an average predictor value, but it does not make the intercept an average predicted risk. In a model with multiple predictors, the vector of means may not describe an actual individual; moreover, the inverse-logit is nonlinear, so the predicted probability at the mean covariate vector need not equal the average of the individual predicted probabilities.

When reporting an intercept, state its scale and reference profile. For example: “The estimated intercept is \(-1.00\), corresponding to estimated event odds of \(0.368\) and estimated event probability of \(0.269\) for a 50-year-old in the zero-coded treatment category.” This avoids implying that the intercept represents the whole sample.

Common Mistakes and Why the Interpretation Matters

  • Calling the intercept a probability. The intercept is a log odds. Exponentiating gives odds; applying the inverse-logit gives probability.
  • Calling odds a probability. Odds of \(1/9\) correspond to probability \(1/10\), not \(1/9\). Convert using \(o/(1+o)\).
  • Ignoring the zero values. In a multiple-predictor model, the intercept sets every predictor to zero at once. State what each zero represents.
  • Calling the intercept the risk for a typical person. Zero values may be unusual or impossible in the study population. The intercept remains a model quantity at that profile, not automatically a sample summary.
  • Assuming centering changes predictions. Centering shifts the intercept to the chosen reference profile; with the corresponding coefficient transformation, the linear predictor and fitted probabilities remain the same.

The intercept matters because it anchors the model’s predicted probabilities to a specific covariate profile. A poorly chosen zero can make the intercept scientifically unhelpful even when the rest of the model is useful. Centering offers a transparent way to select a more interpretable baseline, provided the new reference values are reported clearly.

Check Your Understanding

Answer each question using the covariate profile, not just the coefficient value.

  1. A fitted logistic model has intercept \(\log(2)\). What are the baseline odds and baseline probability?
  2. In a model with age and a binary indicator, what profile does the uncentered intercept describe if age is measured in years and the indicator is coded zero for “No”?
  3. If age is centered at 40, what age does a centered value of zero represent? Does centering alone change fitted probabilities?
  4. A model has \(\hat{\beta}_0=-2\), \(\hat{\beta}_{\text{age}}=0.05\), and age is centered at 60. Calculate the centered intercept and identify its reference age profile, assuming all other predictors are zero.
  5. Why can the predicted probability at the vector of mean covariate values differ from the average of the fitted probabilities?
Clinical Biostats