Tutorials › Regression Analysis (Undergraduate) › Avoid Misreading Product Coefficients and Main Effects

Quantitative Predictor Interactions · Tutorial 341 of 991

Avoid Misreading Product Coefficients and Main Effects

Learn what product and main-effect coefficients mean in a quantitative-predictor interaction model, and how to interpret them in context.

Intermediate 9 min read

What You'll Learn

  • Write the conditional-mean model for two quantitative predictors and their product.
  • Interpret each main-effect coefficient at zero on the other predictor.
  • Explain why the product coefficient is not an overall effect or a conditional slope.
  • Calculate a predictor’s conditional slope at a stated value of the other predictor.
  • Describe how centering changes the reference values for main effects.
  • Avoid turning fitted associations into causal claims.

Why These Coefficients Are Easy to Misread

In a regression model with an interaction, the association between one predictor and the response depends on the value of the other predictor. That dependence is represented by a product term. It is tempting to read the coefficient of that product as if it were the effect of one predictor on the response, or to quote a main-effect coefficient without saying what value of the other predictor it refers to. Both readings can be misleading.

The key is to interpret the fitted equation as a whole. A main-effect coefficient describes a slope at a particular reference value of the other predictor. The product coefficient describes how that slope changes as the other predictor increases. Neither, on its own, gives the slope everywhere.

The Model and What Its Coefficients Represent

Let \(X\) and \(Z\) be quantitative predictors and \(Y\) a quantitative response. A two-predictor linear interaction model for observation \(i\) is

$$ Y_i=\beta_0+\beta_1X_i+\beta_2Z_i+\beta_3X_iZ_i+\varepsilon_i. $$

Here \(\beta_0,\beta_1,\beta_2,\beta_3\) are population model coefficients and \(\varepsilon_i\) is the error for observation \(i\). The fitted model uses estimated coefficients, often written \(b_0,b_1,b_2,b_3\), to give a predicted response:

$$ \hat{Y}=b_0+b_1X+b_2Z+b_3XZ. $$

This equation describes the fitted conditional mean of \(Y\) as a function of \(X\) and \(Z\), provided the mean model is appropriate. For usual regression interpretation, assume that the conditional mean is represented by this equation and that errors have mean zero given the predictors. Standard inferential procedures may also require conditions such as independent errors and constant error variance; those conditions do not change the algebraic meanings of the coefficients. The model describes an association, not necessarily a causal effect.

Definition: In the model \(\hat{Y}=b_0+b_1X+b_2Z+b_3XZ\), \(b_1\) is the fitted slope for \(X\) when \(Z=0\), and \(b_2\) is the fitted slope for \(Z\) when \(X=0\). The product coefficient \(b_3\) is the change in the fitted slope for \(X\) for each one-unit increase in \(Z\) (equivalently, the change in the fitted slope for \(Z\) for each one-unit increase in \(X\)).

These statements follow directly by holding one predictor fixed. At a fixed value \(Z=z\), collect the terms involving \(X\):

$$ \hat{Y}=(b_0+b_2z)+(b_1+b_3z)X. $$

So the fitted slope for \(X\) at \(Z=z\) is \(b_1+b_3z\), not generally \(b_1\). In the other direction, holding \(X=x\) fixed gives a fitted slope for \(Z\) of \(b_2+b_3x\). The intercept \(b_0\) is the fitted response at \(X=0\) and \(Z=0\).

A Short Derivation: Finite Changes at Fixed Predictor Values

The same algebra shows why a product coefficient is not an overall effect. Suppose \(X\) changes from \(x\) to \(x+\Delta x\) while \(Z=z\) stays fixed. The fitted response difference is

$$ \begin{aligned} \hat{Y}(x+\Delta x,z)-\hat{Y}(x,z) &=b_1\Delta x+b_3z\Delta x\\ &=\Delta x(b_1+b_3z). \end{aligned} $$

Thus, the fitted change depends on both the size of the change in \(X\) and the value of \(Z\). For a one-unit increase in \(X\), the fitted change is \(b_1+b_3z\). Meanwhile, increasing \(Z\) by one unit changes the \(X\)-slope from \(b_1+b_3z\) to \(b_1+b_3(z+1)\). Their difference is

$$ \bigl[b_1+b_3(z+1)\bigr]-\bigl[b_1+b_3z\bigr]=b_3. $$

That difference in slopes is the product coefficient’s interpretation. Its units are response units divided by one unit of \(X\) and one unit of \(Z\). It is not the response change for a one-unit increase in either predictor by itself.

Worked Example: A Study-Time Slope at Two Preparation Levels

Hypothetical example. Suppose a fitted model predicts a quiz score \(Y\), in points, from study time \(X\), in hours, and a prior-preparation score \(Z\), in points:

$$ \hat{Y}=40+2.0X+1.5Z+0.30XZ. $$

The \(X\)-slope at a fixed preparation score \(z\) is \(2.0+0.30z\) quiz points per study hour. At \(Z=4\), it is

$$ 2.0+0.30(4)=2.0+1.2=3.2\text{ quiz points per hour}. $$

At \(Z=7\), it is

$$ 2.0+0.30(7)=2.0+2.1=4.1\text{ quiz points per hour}. $$

The product coefficient, \(0.30\), says that the fitted study-time slope increases by \(0.30\) quiz points per hour for each additional preparation-score point. It does not say that a one-hour increase in study time raises the predicted quiz score by \(0.30\) points overall.

For a direct check, compare fitted scores for a change from \(X=2\) to \(X=5\) at \(Z=4\). The fitted change is

$$ (5-2)\bigl(2.0+0.30(4)\bigr)=3(3.2)=9.6\text{ quiz points}. $$

Evaluating both predictions gives the same result: at \(X=2,Z=4\), \(\hat{Y}=40+2.0(2)+1.5(4)+0.30(2)(4)=52.4\); at \(X=5,Z=4\), \(\hat{Y}=40+2.0(5)+1.5(4)+0.30(5)(4)=62.0\). Their difference is \(62.0-52.4=9.6\) points. This is an association in the fitted model; it does not by itself establish that extra study causes a score increase.

Main Effects Depend on the Reference Value

The coefficient \(b_1\) is sometimes called the main effect of \(X\), but that label must not hide its condition: it is the slope for \(X\) at \(Z=0\). Similarly, \(b_2\) is the slope for \(Z\) at \(X=0\). If zero is not a meaningful or relevant value for the other predictor, the corresponding main-effect coefficient may not have a useful standalone interpretation. It remains part of the model, but its reference condition should be stated.

Centering a predictor replaces it with its difference from a chosen reference value. For example, if \(X_c=X-c\), then \(X_c=0\) means that \(X=c\). In a model expressed using centered predictors, the main-effect coefficients are conditional slopes at those chosen reference values. Centering changes the reference point for interpreting coefficients, not the fitted predictions when the model is rewritten consistently.

Worked Example: Interpreting Main Effects After Centering

Hypothetical example. A fitted model relates a practice-test score \(Y\), in points, to weekly study hours \(X\) and a preparation score \(Z\), in points. Define \(X_c=X-5\) and \(Z_c=Z-70\), so zero represents 5 study hours and a preparation score of 70. Suppose the fitted model is

$$ \hat{Y}=78+1.4X_c+0.08Z_c+0.05X_cZ_c. $$

The coefficient \(1.4\) is the fitted slope for weekly study hours when \(Z_c=0\), which means when the preparation score is 70. Its units are quiz points per additional study hour at that preparation score. It is not the study-hours slope for every preparation score.

For a preparation score of 80, \(Z_c=80-70=10\). The fitted study-hours slope is

$$ 1.4+0.05(10)=1.4+0.5=1.9\text{ quiz points per study hour}. $$

The coefficient \(0.08\) is the fitted slope for preparation score when \(X_c=0\), or when weekly study time is 5 hours. At \(X_c=2\), representing 7 study hours, the preparation-score slope is

$$ 0.08+0.05(2)=0.08+0.10=0.18\text{ quiz points per preparation-score point}. $$

The intercept \(78\) is the fitted score at 5 study hours and a preparation score of 70. Centering makes the zero values correspond to these stated reference conditions; it does not turn the coefficients into unconditional effects.

Reading the Product Coefficient in Its Units

The units provide a useful check on interpretation. If \(Y\) is measured in kilograms, \(X\) in liters, and \(Z\) in kilograms, then \(b_1\) has units of kilograms per liter, while \(b_3\) has units of kilograms per (liter times kilogram). Multiplying \(b_3\) by a change in \(Z\) gives a change in the \(X\)-slope, measured in kilograms per liter.

A product coefficient can be positive or negative. A positive value means that the fitted slope for \(X\) increases as \(Z\) increases; it does not necessarily mean that the fitted slope for \(X\) itself is positive. If \(b_1\) is negative, a positive \(b_3\) might make that slope less negative or eventually positive, depending on the values considered. The conditional slope \(b_1+b_3z\) answers the direction-and-size question at a particular \(z\).

Worked Example: A Slope Change Is Not a Response Change

Hypothetical example. A fitted model predicts crop yield \(Y\), in kilograms per plot, from irrigation \(X\), in liters, and fertilizer \(Z\), in kilograms:

$$ \hat{Y}=12+0.8X+0.5Z+0.12XZ. $$

The irrigation slope at fertilizer level \(Z=2\) is

$$ 0.8+0.12(2)=0.8+0.24=1.04\text{ kilograms per liter}. $$

At \(Z=5\), it is

$$ 0.8+0.12(5)=0.8+0.60=1.40\text{ kilograms per liter}. $$

The difference between these two irrigation slopes is \(1.40-1.04=0.36\) kilograms per liter. This also follows from the product coefficient multiplied by the three-kilogram fertilizer difference:

$$ 0.12(5-2)=0.36\text{ kilograms per liter}. $$

So \(0.12\) is the increase in the irrigation slope per additional kilogram of fertilizer. It is not a yield increase of \(0.12\) kilograms for every liter of irrigation. For example, increasing irrigation by 10 liters at \(Z=5\) gives a fitted yield difference of

$$ 10\bigl(0.8+0.12(5)\bigr)=10(1.40)=14\text{ kilograms per plot}. $$

The value 14 is a response difference for this specified irrigation change and fertilizer level. The coefficient \(0.12\) instead describes how the irrigation slope changes with fertilizer.

Common Misreadings and a Reliable Check

A common mistake is to report, “The product coefficient is the effect of \(X\) on \(Y\).” That reasoning treats the \(XZ\) term as though its coefficient were the slope for \(X\). The correction is to hold \(Z=z\) fixed and calculate \(b_1+b_3z\). If the question is about a finite change \(\Delta x\), calculate \(\Delta x(b_1+b_3z)\).

Another mistake is to report “\(b_1\) is the effect of \(X\)” without naming the condition \(Z=0\). The correction is to state that \(b_1\) is the fitted \(X\)-slope when \(Z=0\), or to give the conditional slope at another specified value. If the predictors are centered, identify what their zero values represent.

Before interpreting any coefficient in an interaction model, check three things: which predictor is changing, what value the other predictor is held at, and what units the resulting slope or slope change has. These checks keep a coefficient from being mistaken for a different quantity. They also keep the interpretation tied to the fitted association rather than implying causation.

Key takeaway: In a two-predictor interaction model, \(b_1\) and \(b_2\) are conditional slopes at zero on the other predictor. The product coefficient \(b_3\) is a change in slope per unit of the other predictor. For an actual conditional slope, substitute the stated value into \(b_1+b_3z\) or \(b_2+b_3x\).

Check Your Understanding

For each question, state the relevant reference value or conditional calculation, and include units when possible.

  1. In \(\hat{Y}=10+3X-2Z+0.5XZ\), what is the fitted slope for \(X\) when \(Z=4\)?
  2. In the same model, explain what the coefficient \(0.5\) means. Why is it not the fitted response change for a one-unit increase in \(X\)?
  3. If \(b_2=-1.2\) and \(b_3=0.4\), find the fitted slope for \(Z\) when \(X=3\).
  4. A model uses \(X_c=X-8\). At what value of the original predictor \(X\) is the main-effect coefficient for the other predictor interpreted?
  5. Suppose \(X\) increases by 2 units while \(Z=5\). Write the formula for the fitted response difference in terms of \(b_1\), \(b_3\), and the stated values.