Tutorials › Regression Analysis (Undergraduate) › Coefficient Estimates Versus Predicted Outcomes

Building and Reading Model Terms · Tutorial 131 of 991

Coefficient Estimates Versus Predicted Outcomes

Separate the estimate attached to one regression term from the fitted outcome calculated for a complete set of predictor values.

Intermediate 9 min read

What You'll Learn

  • Define a coefficient estimate and a fitted outcome in an additive regression model.
  • Identify the units and role of an intercept, slope estimate, and predicted outcome.
  • Calculate a fitted outcome using every term in a multiple-predictor equation.
  • Explain why one coefficient alone does not specify a predicted outcome.
  • Check whether a prediction uses the stated model and a clearly specified predictor profile.

One Number From a Model, or an Outcome From the Whole Model?

A regression output may list several coefficient estimates, while a question asks for a predicted outcome at particular predictor values. These numbers answer different questions. A coefficient estimate belongs to one term in the model; a fitted outcome is calculated by combining the intercept and all relevant term contributions for a specified set of predictor values.

The distinction matters in practical reading. A slope estimate might be \(2.4\) minutes per kilometre, for example. It describes the model's estimated association for one predictor, with other predictors held fixed. It is not a predicted travel time. To calculate a fitted travel time, one must use the intercept, the predictor values, and the estimates for the other terms in the model.

Definitions in an Additive Regression Model

Consider a response \(Y\) and \(k\) numeric predictors, denoted \(x_1,\ldots,x_k\). An additive regression model for observation \(i\) can be written as

$$ Y_i=\beta_0+\beta_1x_{i1}+\cdots+\beta_kx_{ik}+\epsilon_i. $$

Here, \(\beta_0\) is the intercept, \(\beta_j\) is the coefficient for predictor \(x_j\), and \(\epsilon_i\) represents the part of \(Y_i\) not accounted for by the model terms. The additive form means that the terms are added together. In an estimated model, the unknown coefficients are replaced by estimates.

Definition: A coefficient estimate, written \(\hat\beta_j\), is the estimated coefficient attached to one model term. For a numeric predictor \(x_j\), its units are response units per unit of \(x_j\). The estimated intercept \(\hat\beta_0\) is the model's estimated response when all included numeric predictors equal zero.

A fitted outcome at predictor values \(x_1,\ldots,x_k\), written \(\hat y(x_1,\ldots,x_k)\), is the value calculated by substituting those values into the estimated regression equation. It is in the response's units and uses the intercept and all included terms.

Thus, a coefficient estimate is attached to a term, whereas a fitted outcome is attached to a predictor profile: a particular combination of predictor values. For a model with two numeric predictors, the fitted outcome is

$$ \hat y(x_1,x_2)=\hat\beta_0+\hat\beta_1x_1+\hat\beta_2x_2. $$

The value \(\hat\beta_1\) alone does not tell us \(\hat y\). It supplies one part of the calculation; the intercept, the value of \(x_1\), and the other term's estimate and predictor value are also needed. Notice, too, that \(\hat\beta_1x_1\) is a term contribution in response units, but it is still not the fitted outcome by itself.

Why the Fitted Outcome Uses the Whole Equation

The estimated equation is obtained by replacing each unknown coefficient in the model with its estimate. A fitted outcome at a specified profile is then the value of that estimated equation at the profile. For two predictors, substituting \(x_1=a\) and \(x_2=b\) gives

$$ \hat y(a,b)=\hat\beta_0+\hat\beta_1a+\hat\beta_2b. $$

This substitution shows why the two quantities cannot be interchanged. The coefficient \(\hat\beta_1\) is one number associated with \(x_1\), with units of response per unit of \(x_1\). The fitted outcome combines the intercept and all the evaluated terms, and has response units. In general, the numerical value and units differ.

A fitted outcome is a model-based estimate of the response at the stated predictor values. It is not a guarantee that a particular individual or unit will have exactly that outcome. The model describes an average response pattern, while individual outcomes can differ from that pattern.

Justification: Starting from the estimated equation for two predictors, substituting the profile \((a,b)\) yields \(\hat y(a,b)=\hat\beta_0+\hat\beta_1a+\hat\beta_2b\). Omitting a term or reporting only \(\hat\beta_1\) therefore does not evaluate the equation at \((a,b)\). The fitted outcome is the result of evaluating the complete estimated equation.

Worked Calculations

In each example, the stated equation is a hypothetical estimated model. The calculations assume the response and predictors have the stated units, the model terms are as written, and the requested predictor profile is appropriate for using the model. The arithmetic produces a fitted outcome under that model; it does not establish that the model is suitable for every setting or that the outcome is certain.

Worked Example: A Coefficient Is Not a Predicted Travel Time

Suppose a hypothetical model estimates a route's travel time \(Y\), in minutes, using distance \(x_1\), in kilometres, and rainfall \(x_2\), in millimetres:

$$ \hat y=8+2.4x_1+1.1x_2. $$

The estimates are an intercept of \(8\) minutes, a distance coefficient of \(2.4\) minutes per kilometre, and a rainfall coefficient of \(1.1\) minutes per millimetre. Find the fitted travel time for a route of \(6\) kilometres when rainfall is \(4\) millimetres.

Substitute the predictor values.

$$ \hat y(6,4)=8+(2.4)(6)+(1.1)(4). $$

Calculate each part. The distance term is \(2.4\times6=14.4\) minutes, and the rainfall term is \(1.1\times4=4.4\) minutes. Therefore,

$$ \hat y(6,4)=8+14.4+4.4=26.8\text{ minutes}. $$

The fitted travel time is \(26.8\) minutes. The estimate \(2.4\) is the coefficient for distance, not the fitted travel time; its units are minutes per kilometre, not minutes. The model's intercept and rainfall term are also part of the fitted outcome.

Worked Example: A Coefficient Contribution Is Not the Fitted Outcome

A hypothetical model estimates daily laboratory output \(Y\), in grams, from operating temperature \(x_1\), in degrees Celsius, and catalyst amount \(x_2\), in grams:

$$ \hat y=12+0.8x_1+3.5x_2. $$

At \(x_1=30\) degrees Celsius and \(x_2=2\) grams, calculate the fitted output and distinguish the coefficient estimate from its contribution.

The coefficient estimate for temperature is \(0.8\) grams per degree Celsius. At \(30\) degrees Celsius, that term contributes \(0.8\times30=24\) grams to the equation. The catalyst term contributes \(3.5\times2=7\) grams. Include the \(12\)-gram intercept:

$$ \hat y(30,2)=12+(0.8)(30)+(3.5)(2)=12+24+7=43\text{ grams}. $$

The fitted outcome is \(43\) grams. The temperature coefficient is \(0.8\) grams per degree Celsius, and its evaluated term contribution is \(24\) grams. Neither number is the complete fitted outcome. The units confirm the distinction: the coefficient is measured per degree, while the contribution and final fitted outcome are measured in grams.

Worked Example: Reading Estimates and Calculating a Course Score

Suppose a hypothetical model estimates a course assessment score \(Y\), in points, from independent study time \(x_1\), in hours, and tutorial attendance \(x_2\), in sessions:

$$ \hat y=48+3.2x_1+0.6x_2. $$

A student profile has \(x_1=5\) hours and \(x_2=8\) sessions. Identify what the coefficient estimates mean in the equation, then calculate the fitted score.

The intercept estimate is \(48\) points. The study-time coefficient estimate is \(3.2\) points per hour, and the attendance coefficient estimate is \(0.6\) points per session. For the given profile, the study-time term is \(3.2\times5=16\) points, and the attendance term is \(0.6\times8=4.8\) points. Adding both to the intercept gives

$$ \hat y(5,8)=48+(3.2)(5)+(0.6)(8)=48+16+4.8=68.8\text{ points}. $$

The two coefficient estimates, \(3.2\) and \(0.6\), belong to different terms and have different units. Neither is the predicted score. The model's fitted score for this complete profile is \(68.8\) points. This calculation describes the model's estimate at those values; it does not claim that every student with this profile would receive exactly \(68.8\) points.

Reading a Coefficient Table Without Confusing the Quantities

A coefficient table typically reports estimates for the model terms, not a separate fitted outcome for every possible predictor profile. To answer a prediction question from such a table, first reconstruct the estimated equation using the intercept and all listed coefficients, then substitute the requested predictor values.

Keep three related quantities separate:

QuantityWhat it belongs toTypical units in a numeric-predictor model
Coefficient estimateOne model termResponse units per predictor unit for a slope
Evaluated term contributionOne term at a specified predictor valueResponse units
Fitted outcomeA complete predictor profile and the whole estimated equationResponse units

For example, if an estimate is \(3.2\) points per study hour, the number \(3.2\) describes the term's scale in the fitted equation. At \(5\) hours, the term contributes \(16\) points. The model's fitted score still depends on the intercept and the values and terms for all other predictors.

Assumptions and Scope of a Calculation

The distinction between an estimate and a fitted outcome is algebraic, but interpreting either number depends on the model. In the additive model written above, the conditional mean of the response is represented by an intercept plus the predictor terms, with errors having mean zero conditional on the predictors. In plain language, the model's average response pattern is assumed to follow the specified additive equation.

A hand calculation also depends on using the correct model and units. Predictor values must be matched to the terms they describe; for example, a value in metres cannot be substituted as though it were in kilometres. The equation must include the terms used to make the prediction, and the profile should be within a range where applying the model is reasonable. A coefficient table alone cannot verify that the model's form is appropriate or that a prediction is dependable.

These conditions do not turn a coefficient into a prediction. They clarify when the model-based quantities can be given a meaningful interpretation. The coefficient remains an estimate for a term, and the fitted outcome remains the equation's estimated response for a specified profile.

Common Mistake: Reporting the Slope as the Outcome

A common error is to read a slope estimate of \(2.4\) minutes per kilometre and write, “The predicted travel time is \(2.4\) minutes.” This treats a coefficient as if it were an outcome. The units expose the problem: \(2.4\) has units of minutes per kilometre, while a travel time is measured in minutes.

The correction is to identify the full profile and evaluate the complete equation. If the model is \(\hat y=8+2.4x_1+1.1x_2\), then for \(x_1=6\) kilometres and \(x_2=4\) millimetres, the fitted time is \(8+2.4(6)+1.1(4)=26.8\) minutes. The coefficient estimate \(2.4\) is still useful, but it answers a different question from the fitted outcome.

Key takeaway: A coefficient estimate describes one model term. A fitted outcome is calculated for a complete predictor profile by using the intercept and all relevant terms in the estimated equation.

Check Your Understanding

Use the distinctions and calculation steps in this tutorial to answer the following questions.

  1. A model is \(\hat y=10+2x_1+5x_2\). What is the coefficient estimate for \(x_1\), and what are its units if \(Y\) is measured in dollars and \(x_1\) in hours?
  2. For the same model, calculate the fitted outcome at \(x_1=3\) and \(x_2=2\). Show the intercept and both term contributions.
  3. Explain why the contribution \(2x_1\) at \(x_1=3\) is not the fitted outcome.
  4. A coefficient estimate is reported as \(0.7\) kilograms per centimetre. What are the units of its term contribution after substituting a predictor value, and why?
  5. In one sentence, distinguish what a coefficient estimate belongs to from what a fitted outcome belongs to.