One Number From a Model, or an Outcome From the Whole Model?
A regression output may list several coefficient estimates, while a question asks for a predicted outcome at particular predictor values. These numbers answer different questions. A coefficient estimate belongs to one term in the model; a fitted outcome is calculated by combining the intercept and all relevant term contributions for a specified set of predictor values.
The distinction matters in practical reading. A slope estimate might be \(2.4\) minutes per kilometre, for example. It describes the model's estimated association for one predictor, with other predictors held fixed. It is not a predicted travel time. To calculate a fitted travel time, one must use the intercept, the predictor values, and the estimates for the other terms in the model.
Definitions in an Additive Regression Model
Consider a response \(Y\) and \(k\) numeric predictors, denoted \(x_1,\ldots,x_k\). An additive regression model for observation \(i\) can be written as
Here, \(\beta_0\) is the intercept, \(\beta_j\) is the coefficient for predictor \(x_j\), and \(\epsilon_i\) represents the part of \(Y_i\) not accounted for by the model terms. The additive form means that the terms are added together. In an estimated model, the unknown coefficients are replaced by estimates.
A fitted outcome at predictor values \(x_1,\ldots,x_k\), written \(\hat y(x_1,\ldots,x_k)\), is the value calculated by substituting those values into the estimated regression equation. It is in the response's units and uses the intercept and all included terms.
Thus, a coefficient estimate is attached to a term, whereas a fitted outcome is attached to a predictor profile: a particular combination of predictor values. For a model with two numeric predictors, the fitted outcome is
The value \(\hat\beta_1\) alone does not tell us \(\hat y\). It supplies one part of the calculation; the intercept, the value of \(x_1\), and the other term's estimate and predictor value are also needed. Notice, too, that \(\hat\beta_1x_1\) is a term contribution in response units, but it is still not the fitted outcome by itself.
Why the Fitted Outcome Uses the Whole Equation
The estimated equation is obtained by replacing each unknown coefficient in the model with its estimate. A fitted outcome at a specified profile is then the value of that estimated equation at the profile. For two predictors, substituting \(x_1=a\) and \(x_2=b\) gives
This substitution shows why the two quantities cannot be interchanged. The coefficient \(\hat\beta_1\) is one number associated with \(x_1\), with units of response per unit of \(x_1\). The fitted outcome combines the intercept and all the evaluated terms, and has response units. In general, the numerical value and units differ.
A fitted outcome is a model-based estimate of the response at the stated predictor values. It is not a guarantee that a particular individual or unit will have exactly that outcome. The model describes an average response pattern, while individual outcomes can differ from that pattern.
Worked Calculations
In each example, the stated equation is a hypothetical estimated model. The calculations assume the response and predictors have the stated units, the model terms are as written, and the requested predictor profile is appropriate for using the model. The arithmetic produces a fitted outcome under that model; it does not establish that the model is suitable for every setting or that the outcome is certain.
Worked Example: A Coefficient Is Not a Predicted Travel Time
Suppose a hypothetical model estimates a route's travel time \(Y\), in minutes, using distance \(x_1\), in kilometres, and rainfall \(x_2\), in millimetres:
The estimates are an intercept of \(8\) minutes, a distance coefficient of \(2.4\) minutes per kilometre, and a rainfall coefficient of \(1.1\) minutes per millimetre. Find the fitted travel time for a route of \(6\) kilometres when rainfall is \(4\) millimetres.
Substitute the predictor values.
Calculate each part. The distance term is \(2.4\times6=14.4\) minutes, and the rainfall term is \(1.1\times4=4.4\) minutes. Therefore,
The fitted travel time is \(26.8\) minutes. The estimate \(2.4\) is the coefficient for distance, not the fitted travel time; its units are minutes per kilometre, not minutes. The model's intercept and rainfall term are also part of the fitted outcome.
Worked Example: A Coefficient Contribution Is Not the Fitted Outcome
A hypothetical model estimates daily laboratory output \(Y\), in grams, from operating temperature \(x_1\), in degrees Celsius, and catalyst amount \(x_2\), in grams:
At \(x_1=30\) degrees Celsius and \(x_2=2\) grams, calculate the fitted output and distinguish the coefficient estimate from its contribution.
The coefficient estimate for temperature is \(0.8\) grams per degree Celsius. At \(30\) degrees Celsius, that term contributes \(0.8\times30=24\) grams to the equation. The catalyst term contributes \(3.5\times2=7\) grams. Include the \(12\)-gram intercept:
The fitted outcome is \(43\) grams. The temperature coefficient is \(0.8\) grams per degree Celsius, and its evaluated term contribution is \(24\) grams. Neither number is the complete fitted outcome. The units confirm the distinction: the coefficient is measured per degree, while the contribution and final fitted outcome are measured in grams.
Worked Example: Reading Estimates and Calculating a Course Score
Suppose a hypothetical model estimates a course assessment score \(Y\), in points, from independent study time \(x_1\), in hours, and tutorial attendance \(x_2\), in sessions:
A student profile has \(x_1=5\) hours and \(x_2=8\) sessions. Identify what the coefficient estimates mean in the equation, then calculate the fitted score.
The intercept estimate is \(48\) points. The study-time coefficient estimate is \(3.2\) points per hour, and the attendance coefficient estimate is \(0.6\) points per session. For the given profile, the study-time term is \(3.2\times5=16\) points, and the attendance term is \(0.6\times8=4.8\) points. Adding both to the intercept gives
The two coefficient estimates, \(3.2\) and \(0.6\), belong to different terms and have different units. Neither is the predicted score. The model's fitted score for this complete profile is \(68.8\) points. This calculation describes the model's estimate at those values; it does not claim that every student with this profile would receive exactly \(68.8\) points.
Reading a Coefficient Table Without Confusing the Quantities
A coefficient table typically reports estimates for the model terms, not a separate fitted outcome for every possible predictor profile. To answer a prediction question from such a table, first reconstruct the estimated equation using the intercept and all listed coefficients, then substitute the requested predictor values.
Keep three related quantities separate:
| Quantity | What it belongs to | Typical units in a numeric-predictor model |
|---|---|---|
| Coefficient estimate | One model term | Response units per predictor unit for a slope |
| Evaluated term contribution | One term at a specified predictor value | Response units |
| Fitted outcome | A complete predictor profile and the whole estimated equation | Response units |
For example, if an estimate is \(3.2\) points per study hour, the number \(3.2\) describes the term's scale in the fitted equation. At \(5\) hours, the term contributes \(16\) points. The model's fitted score still depends on the intercept and the values and terms for all other predictors.
Assumptions and Scope of a Calculation
The distinction between an estimate and a fitted outcome is algebraic, but interpreting either number depends on the model. In the additive model written above, the conditional mean of the response is represented by an intercept plus the predictor terms, with errors having mean zero conditional on the predictors. In plain language, the model's average response pattern is assumed to follow the specified additive equation.
A hand calculation also depends on using the correct model and units. Predictor values must be matched to the terms they describe; for example, a value in metres cannot be substituted as though it were in kilometres. The equation must include the terms used to make the prediction, and the profile should be within a range where applying the model is reasonable. A coefficient table alone cannot verify that the model's form is appropriate or that a prediction is dependable.
These conditions do not turn a coefficient into a prediction. They clarify when the model-based quantities can be given a meaningful interpretation. The coefficient remains an estimate for a term, and the fitted outcome remains the equation's estimated response for a specified profile.
Common Mistake: Reporting the Slope as the Outcome
A common error is to read a slope estimate of \(2.4\) minutes per kilometre and write, “The predicted travel time is \(2.4\) minutes.” This treats a coefficient as if it were an outcome. The units expose the problem: \(2.4\) has units of minutes per kilometre, while a travel time is measured in minutes.
The correction is to identify the full profile and evaluate the complete equation. If the model is \(\hat y=8+2.4x_1+1.1x_2\), then for \(x_1=6\) kilometres and \(x_2=4\) millimetres, the fitted time is \(8+2.4(6)+1.1(4)=26.8\) minutes. The coefficient estimate \(2.4\) is still useful, but it answers a different question from the fitted outcome.
Check Your Understanding
Use the distinctions and calculation steps in this tutorial to answer the following questions.
- A model is \(\hat y=10+2x_1+5x_2\). What is the coefficient estimate for \(x_1\), and what are its units if \(Y\) is measured in dollars and \(x_1\) in hours?
- For the same model, calculate the fitted outcome at \(x_1=3\) and \(x_2=2\). Show the intercept and both term contributions.
- Explain why the contribution \(2x_1\) at \(x_1=3\) is not the fitted outcome.
- A coefficient estimate is reported as \(0.7\) kilograms per centimetre. What are the units of its term contribution after substituting a predictor value, and why?
- In one sentence, distinguish what a coefficient estimate belongs to from what a fitted outcome belongs to.