Why Residual Spread Matters
A fitted regression line summarizes how a response tends to change with a predictor. But a useful model must do more than capture that average trend: the vertical scatter around the line also matters. If the scatter grows as the predictor increases, predictions may be less variable in one part of the predictor range than another. A residual plot can reveal this change in spread.
The pattern to look for is a band of residuals that fans out or narrows across the horizontal axis. That pattern is different from a curved arrangement of residuals, which suggests the fitted line misses part of the mean trend, and different again from a single isolated residual. These distinctions matter because each pattern points to a different aspect of model fit.
What Unequal Spread Means
Consider the simple regression model \(Y_i=\beta_0+\beta_1x_i+\varepsilon_i\), where \(Y_i\) is the response for observation \(i\), \(x_i\) is its predictor value, and \(\varepsilon_i\) is the error around the model's conditional mean. For the residual-plot interpretation here, assume the conditional mean is linear, \(E(Y_i\mid x_i)=\beta_0+\beta_1x_i\), or equivalently \(E(\varepsilon_i\mid x_i)=0\). The constant-variance version of the model further assumes that \(\operatorname{Var}(\varepsilon_i\mid x_i)=\sigma^2\) for all predictor values. This equal conditional variance is called homoscedasticity; a variance that changes with \(x_i\) is called heteroscedasticity.
In practice, the true errors \(\varepsilon_i\) are not observed. After fitting a line, we calculate residuals \(e_i=y_i-\hat{y}_i\), where \(y_i\) is the observed response and \(\hat{y}_i\) is the fitted response. A residual plot places these residuals on the vertical axis and predictor values or fitted values on the horizontal axis. Because the fitted line estimates the conditional mean, residuals are useful—but imperfect—indicators of the errors.
Under a constant-variance model, residuals should form a roughly even vertical band across the horizontal axis, with no systematic curve. Unequal spread is suggested when that band becomes visibly wider or narrower over a range of predictor or fitted values. A fan may widen to the right or, just as plausibly, narrow to the right. The direction depends on the data; the key feature is a sustained change in vertical scatter, not whether the residuals themselves trend upward or downward.
How to Read the Plot
Ask whether residuals stay roughly centered around zero across the horizontal axis. A systematic sequence of positive, negative, and positive residuals suggests a changing mean pattern, such as curvature, rather than merely a change in spread.
Look across the range for a band that repeatedly becomes wider or narrower. Consider the overall pattern, not a single point or a small fluctuation among a few observations.
A single distant residual may be unusual, but it does not by itself show that the response variability changes with the predictor. Look for multiple observations supporting a wider or narrower band.
Describe the plot as showing evidence consistent with constant or changing spread. A visual pattern is a diagnostic clue, not proof that a particular variance model is true.
Residuals versus fitted values and residuals versus predictor values often convey similar information in simple linear regression: fitted values change linearly with the predictor. Either horizontal axis can help reveal a spread pattern. The predictor axis may be easier to describe in context, while the fitted-value axis focuses on the response scale predicted by the line.
Worked Example: A Residual Band That Widens
Suppose a hypothetical fitted line for study time \(x\), in hours, predicts quiz score \(\hat{y}=10+2x\), in points. The software reports the following observations and residuals.
| Study time \(x\) (hours) | Observed score \(y\) (points) | Fitted score \(\hat{y}\) (points) | Residual \(e=y-\hat{y}\) (points) |
|---|---|---|---|
| 1 | 11 | 12 | -1 |
| 1 | 13 | 12 | 1 |
| 2 | 12 | 14 | -2 |
| 2 | 16 | 14 | 2 |
| 3 | 13 | 16 | -3 |
| 3 | 19 | 16 | 3 |
For the first observation, \(e=11-12=-1\) point; for the second, \(e=13-12=1\) point. The same subtraction gives residuals \(-2,2\) at 2 hours and \(-3,3\) at 3 hours. At each study-time value the residuals are balanced around zero, but their vertical distance from zero increases.
As a descriptive comparison, calculate the mean squared residual at each study time. At 1 hour it is \(\big((-1)^2+1^2\big)/2=1\) point squared. At 2 hours it is \(\big((-2)^2+2^2\big)/2=4\) points squared. At 3 hours it is \(\big((-3)^2+3^2\big)/2=9\) points squared. These calculations summarize the displayed residuals; they are not formal estimates establishing a variance model. Together with the widening vertical band, they give evidence that response variability may increase with study time.
Distinguishing Spread from Curvature
A residual plot can show a changing center, a changing width, or both. Curvature is about the center: residuals tend to be positive in one region, negative in another, and perhaps positive again, indicating that the fitted line systematically overpredicts in some region and underpredicts in another. Unequal spread is about the width of the band around its center. Residuals can be centered near zero throughout while that width changes.
Worked Example: A Curved Center, Not a Funnel
For hypothetical observations at three predictor values, a fitted straight line produces the residuals below. The predictor is measured in units, and residuals are measured in response units.
| Predictor value | Residuals | Mean residual at that value |
|---|---|---|
| 1 | 0.8, 1.2 | \((0.8+1.2)/2=1.0\) |
| 2 | -1.8, -2.2 | \((-1.8-2.2)/2=-2.0\) |
| 3 | 0.9, 1.1 | \((0.9+1.1)/2=1.0\) |
The group means follow a positive, negative, positive pattern: \(1.0,-2.0,1.0\) response units. Within each group, deviations from its mean are only \(-0.2\) and \(0.2\), so the mean squared deviation around that group mean is \(\big((-0.2)^2+(0.2)^2\big)/2=0.04\) response units squared in every group. The main feature is therefore a changing center, not a growing vertical width. The residual plot would suggest curvature in the mean relationship rather than a funnel-shaped spread pattern.
This distinction is not always perfectly clear in a small or noisy plot. If the center shifts and the width also changes, both features should be reported rather than forcing the pattern into just one category. A residual plot is a diagnostic, and its interpretation should reflect what the full arrangement of points supports.
Distinguishing Unequal Spread from an Outlier
An outlier is an observation with a residual unusually far from zero compared with the rest of the plot. That observation may deserve investigation, but it is not the same as a band that becomes systematically wider across the predictor range. A fan is supported by a pattern among observations over a region; an isolated residual is a single point. A plot with one distant point and otherwise similar scatter does not, on that evidence alone, establish changing variance.
Worked Example: One Isolated Residual
In a hypothetical regression, five observations have predictor values \(x=1,2,3,4,5\). Their reported residuals, in response units, are \(-0.7,-0.5,2.4,-0.5,-0.7\).
The residual \(2.4\) at \(x=3\) is well separated from the other four, which range from \(-0.7\) to \(-0.5\). For comparison, their range is \((-0.5)-(-0.7)=0.2\) response units, while the isolated residual is 2.4 units above zero. This plot suggests one unusually large positive residual, not a sustained widening or narrowing band across \(x\). The appropriate conclusion is to note the isolated point and avoid labeling the pattern unequal spread on this evidence alone.
Why Variance Does Not Describe Every Large Error
Variance describes average squared deviation from the conditional mean, not the frequency of errors above every chosen cutoff. This distinction prevents an overinterpretation of a widening residual plot. Under the model assumption \(E(\varepsilon\mid X=x)=0\), the definition of conditional variance gives the following result:
Thus, if the conditional variance increases, the expected squared error increases. This does not by itself imply that squared errors above any particular threshold occur more often. The variance summarizes squared errors through their average, not the entire distribution of errors.
For example, at one predictor value suppose the error is \(+1\) or \(-1\), each with probability \(0.5\). Its mean is zero and its variance is \(1\); its squared error is always \(1\). At another predictor value, suppose the error is \(0\) with probability \(0.99\), and \(+\sqrt{200}\) or \(-\sqrt{200}\), each with probability \(0.005\). Its mean is also zero, and its variance is \(0.01(200)=2\). The second variance is larger, but its squared error exceeds 1 only 1% of the time, whereas the first squared error equals 1 every time. A variance comparison alone cannot say that squared errors above a chosen threshold will be more frequent.
Common Mistakes and Practical Meaning
- Calling any large residual a funnel. One distant point is not a sustained change in spread. Describe it as an isolated residual unless surrounding points also support a changing band.
- Confusing a changing center with a changing width. A curved sequence of residuals can have similar scatter around each local center. Look separately at where the band is centered and how wide it is.
- Claiming that larger variance means more errors above every cutoff. Variance concerns expected squared deviation. It does not determine the probability of exceeding each particular threshold.
- Treating a visual pattern as proof. Sparse data, noise, or a few unusual observations can make spread hard to judge. State what the plot suggests and how clearly it shows the pattern.
The constant-variance assumption matters because many regression calculations use a common error variance to characterize uncertainty. If residual spread clearly changes across the range, that assumption may be unsuitable, and conclusions relying on it may need further assessment. The plot itself does not quantify the consequences or determine a remedy; it alerts the analyst to a feature that should not be ignored.
Check Your Understanding
Use the residual-plot ideas to answer these questions.
- What does a band that grows wider across predictor values suggest about conditional response variance?
- A residual plot shows positive residuals at low and high predictor values, and negative residuals in the middle, with similar vertical width throughout. Is the main evidence about the center or the spread?
- Why does one large residual near the upper end of the predictor range not, by itself, establish unequal spread?
- If conditional variance increases, what happens to expected squared error under a zero conditional mean? What does that fact not imply about a chosen error threshold?
- In a residual plot, what two features should you examine separately before describing the pattern?