Adjustment Describes a Comparison, Not a Cause
Multiple regression lets us compare observations that have the same recorded values of other predictors. This can make an association more informative than a raw comparison, especially when the predictors are related to one another. But the phrase “holding the other predictors fixed” describes a comparison in the data. By itself, it does not tell us what would happen if we intervened and changed the focal predictor.
That distinction matters whenever a regression result is used to discuss a treatment, behavior, policy, or other potential cause. An adjusted coefficient can be useful evidence, but a causal conclusion requires a reason to believe that the comparison represents what would have happened under different values of the focal predictor—not merely that people with different observed predictor values had different outcomes.
What an Adjusted Coefficient Says
Suppose \(Y\) is an outcome, \(X\) is the focal predictor, and \(Z\) is a measured adjustment variable. An additive linear regression model for the conditional mean is
Here \(E(Y\mid X=x,Z=z)\) is the mean outcome among observations with \(X=x\) and \(Z=z\). The model assumes that this conditional mean follows the stated additive linear form. In this model, \(\beta_1\) is the change in the fitted conditional mean associated with a one-unit increase in \(X\), when \(Z\) is held fixed. That is a statement about the model’s conditional comparison. No intervention has yet been described.
Subtract the fitted conditional mean at \(X=x\) from the one at \(X=x+1\), keeping \(Z=z\):
The intercept and the contribution from \(Z\) cancel. This is why the coefficient is called an adjusted slope: it describes the model’s comparison at the same value of \(Z\). The derivation does not show that changing \(X\) would change \(Y\) by \(\beta_1\). The conditional means in the equation are calculated from observed cases; a causal effect concerns outcomes under a change made to \(X\).
Worked Example: Reading an Adjusted Study-Time Slope
Suppose a hypothetical observational analysis relates exam score \(Y\), in points, to study time \(X\), in hours, and a prior-score measure \(Z\), also in points. Its fitted equation is
For two students with the same prior score of 70 points, compare the fitted scores for 3 and 4 hours of study.
At 3 hours, the fitted score is \(40+2(3)+0.30(70)=40+6+21=67\) points. At 4 hours, it is \(40+2(4)+0.30(70)=40+8+21=69\) points. The adjusted fitted difference is \(69-67=2\) points for one additional study hour, at this fixed prior score.
This is a conditional association in the fitted model. If students who choose to study more also differ in motivation, health, or available study support, those differences could contribute to the score contrast. The calculation alone cannot establish that assigning a student one extra hour of study would raise that student's score by 2 points.
What a Causal Effect Means
A causal question asks about outcomes under possible interventions. Let \(Y(x)\) denote the outcome a unit would have if its focal predictor were set to \(x\). For example, \(Y(4)\) could represent a student's exam score if the student were assigned four hours of study under a clearly specified study plan. A causal contrast might be the difference between average outcomes under two settings, such as \(E[Y(4)-Y(3)]\). These potential outcomes are not both observed for the same person: in reality, the person follows one study condition, not both.
To connect an adjusted observed-data comparison to a causal contrast, researchers need substantive assumptions and a design that makes those assumptions plausible. In a simple setting with adjustment variable \(Z\), important conditions include the following:
- Consistency and a well-defined intervention: the intervention represented by setting \(X=x\) has a clear meaning, and a unit observed with \(X=x\) has observed outcome \(Y=Y(x)\). Vague or meaningfully different versions of “one more hour of study” can make this hard to satisfy.
- Conditional exchangeability: within each relevant value of \(Z\), the groups with different \(X\) values are comparable in their potential outcomes. In notation, \(Y(x)\) is independent of \(X\) given \(Z\). This rules out remaining confounding after conditioning on \(Z\); it is an assumption, not something guaranteed by fitting a regression.
- Positivity: at the values of \(Z\) being studied, there is a genuine possibility of observing each relevant value or range of \(X\). If no comparable observations exist, a fixed-\(Z\) comparison must rely on extrapolation.
- Appropriate modeling and measurement: the regression form should represent the conditional mean adequately for the intended comparison, and the relevant variables should be measured well enough for the assumptions to be credible.
The first three conditions explain the causal logic; the last connects that logic to a particular fitted regression. Even if a regression estimates an adjusted association precisely, precision does not establish that these conditions hold.
Why the Assumptions Matter
The link between conditional association and causal effect can be stated directly. Under consistency, among units observed with \(X=x\), their observed outcomes equal their potential outcomes under \(x\). Under conditional exchangeability, conditioning on \(Z=z\) makes the potential outcomes comparable across the observed \(X\) groups. Therefore,
The first equality uses consistency; the second uses conditional exchangeability. Applying the same reasoning at \(x_0\) and \(x_1\), and subtracting, gives
Thus, under these assumptions, the observed conditional mean difference identifies a causal contrast for units with \(Z=z\). If the additive linear model is also suitable, its slope gives the model’s per-unit conditional contrast. Without the causal assumptions, the left side remains an observed-data comparison, while the right side is a causal quantity; the equality has not been established.
Worked Example: When Random Assignment Supports a Causal Estimate
Imagine a hypothetical experiment that randomly assigns students to a study-support program or a control condition. The outcome is an exam score in points, and \(Z\) is a baseline-score group. The following are group means from the experiment:
| Baseline-score group | Control mean | Program mean | Program minus control |
|---|---|---|---|
| Lower | 71 | 77 | 6 |
| Higher | 81 | 87 | 6 |
Within the lower baseline group, the difference is \(77-71=6\) points. Within the higher baseline group, it is \(87-81=6\) points. If the groups are equally sized, the overall control mean is \((71+81)/2=76\) points and the program mean is \((77+87)/2=82\) points; the overall difference is \(82-76=6\) points.
Because assignment was random, it makes the assigned groups comparable on average in both measured and unmeasured pre-assignment characteristics. If assignment was followed as intended, outcomes were observed comparably, and the program is sufficiently well-defined, the 6-point difference can estimate the average causal effect of being assigned to this program in the experiment’s target group. It is still an estimate, with sampling uncertainty; the small example does not imply the exact population effect is known to be 6 points. If students did not follow their assignments, interpreting the difference as the effect of actually participating would require further care.
Adjustment Cannot Guarantee Comparability
In an observational study, the focal predictor is not randomly assigned. People with different values of \(X\) may differ in factors that also relate to \(Y\). Adjusting for recorded \(Z\) addresses differences represented by \(Z\), but it does not automatically address factors that were unmeasured, poorly measured, or omitted from the model. Consequently, a fitted adjusted slope can remain confounded.
Worked Example: A Remaining Difference in Motivation
Suppose an observational analysis of study time and exam score adjusts for prior score but does not measure motivation. A hypothetical fitted equation is
where \(X\) is study hours, \(Z\) is prior score in points, and \(Y\) is exam score in points. At a prior score of 60, the fitted score at 2 study hours is \(35+1.5(2)+0.40(60)=35+3+24=62\) points. At 3 hours it is \(35+1.5(3)+0.40(60)=35+4.5+24=63.5\) points. The model’s adjusted difference is \(63.5-62=1.5\) points per additional hour.
Suppose, however, that more motivated students tend to study longer and also tend to score higher, even among students with the same prior score. Then prior score alone does not make the study-hour groups comparable in their potential exam outcomes. The coefficient remains a conditional association, but the comparison may combine a study-time difference with a motivation difference. The arithmetic is correct; a causal interpretation is not justified by that arithmetic.
Adjustment can also change the causal question if it includes a variable affected by \(X\). For instance, if a program changes later study habits and those habits affect exam score, controlling for later study habits compares program and control cases at the same value of a possible pathway through which the program works. That is not automatically the program’s total effect. Whether such adjustment is useful depends on the causal question and additional assumptions; “include every available predictor” is not a safe general rule.
Common Mistake: Treating “Adjusted For” as “Caused By”
Wrong reasoning: “The coefficient for study time is positive after adjusting for prior score, so increasing study time causes exam scores to rise.”
The adjustment establishes only that the model’s conditional comparison is positive at fixed prior score. It does not establish that prior score captures every relevant difference between students, that study time is measured without important error, or that changing study time corresponds to a well-defined intervention.
Correction: First describe the result as an adjusted association. Then assess whether the study design and assumptions support a causal interpretation. Random assignment can provide a strong basis for comparability; observational adjustment can also be informative, but only when the adjustment variables and assumptions are defensible. Neither a large coefficient nor a small p-value resolves a causal-design problem.
Check Your Understanding
Try these questions before moving on.
- In an additive model for exam score, study hours, and prior score, what does the study-hours coefficient describe when prior score is held fixed?
- Why does a positive adjusted coefficient not, by itself, show that intervening to increase the focal predictor would raise the outcome?
- In the causal identification argument, which assumption connects an observed outcome at \(X=x\) to the potential outcome \(Y(x)\)?
- What problem arises if, at a particular value of \(Z\), the data contain no observations at one of the focal predictor values being compared?
- How might controlling for a variable measured after a program begins change the causal question?