Tutorials › Regression Analysis (Undergraduate) › Interpreting Departures in Normal Quantile Plots

Residual and Assumption Diagnostics · Tutorial 502 of 991

Interpreting Departures in Normal Quantile Plots

Learn to read the shape and tail departures in a normal quantile plot without mistaking isolated points or a poorly chosen reference line for a distributional pattern.

Intermediate 10 min read

What You'll Learn

  • Interpret residual departures relative to a normal reference line.
  • Distinguish symmetric heavy- or light-tail patterns from asymmetric departures.
  • Use tail direction and magnitude to describe possible skewness.
  • Separate a broad distributional pattern from one unusual point.
  • State what a normal quantile plot can and cannot establish.

What a Normal Quantile Plot Can Show

A normal quantile plot compares the ordered residuals from a regression fit with the quantiles expected from a normal distribution. Its value is in the shape of the departures from a reference line: a sustained bend or a tail that departs more than the other may indicate a particular way the residual distribution differs from normality. A single point away from the line, by itself, is weaker evidence.

For a consistent description, this tutorial uses a plot with theoretical normal quantiles on the horizontal axis and ordered residuals on the vertical axis. The reference line represents the pattern expected if the residuals were approximately normal, allowing for their location and scale. Some software reverses the axes, so always check which quantity is on which axis before describing the direction of a bend.

In a regression model, residuals are observed differences between responses and fitted values. A normal quantile plot is used to assess whether their distribution is reasonably consistent with the model’s normal-error assumption. It does not show the unobserved errors directly, and a plot cannot establish that the assumption is true.

Definition: A departure from normality is a systematic difference between the ordered residuals and the values expected under a normal distribution, visible as a pattern relative to the plot’s reference line. A tail departure occurs at an extreme end of the ordered values. Interpret departures relative to the line, not automatically relative to zero.

Read the Reference Line Before the Bend

The reference line need not be the line \(y=x\). If the plot uses residuals in their original units and theoretical standard-normal quantiles, a normally distributed residual variable with mean \(\mu\) and standard deviation \(\sigma\) would follow approximately \(y=\mu+\sigma x\). The intercept and slope account for location and scale. Consequently, a straight pattern that is offset from zero or has a slope other than one is not, by itself, evidence of nonnormality.

The diagnostic question is whether the points follow an approximately straight pattern around the reference line. Small irregular departures are expected in finite samples. A sustained shape across several neighboring points is more informative than a single point, though its importance also depends on the sample size and the purpose of the analysis.

Worked Example: A Broad Bend Toward Lighter Tails

Suppose a hypothetical plot uses theoretical quantiles \(x\) and standardized residual quantiles \(y\), with reference line \(y=x\). At five selected positions, the plotted points are \((-2,-1.4)\), \((-1,-0.8)\), \((0,0)\), \((1,0.8)\), and \((2,1.4)\). Describe the pattern.

At the left end, the point has \(x=-2\) and \(y=-1.4\). Its vertical difference from the reference line is \(y-x=-1.4-(-2)=0.6\), so it lies above the line. At the right end, the point has \(x=2\) and \(y=1.4\), giving \(y-x=1.4-2=-0.6\), so it lies below the line. The intermediate points show the same inward tendency: for example, at \(x=1\), the difference is \(0.8-1=-0.2\).

Both ends are less extreme than the corresponding normal quantiles: \(|-1.4|<|-2|\) and \(|1.4|<|2|\). If this pattern persists across the tails, it is consistent with a distribution having lighter tails than the normal distribution. The five points are illustrative, not a formal test; a real plot should be read as a whole.

Symmetric Tail Departures

Compare the two ends of the plot to distinguish a symmetric tail pattern from an asymmetric one. With theoretical quantiles on the horizontal axis and residual quantiles on the vertical axis, heavier-than-normal tails tend to make the lower-tail points fall below the line and the upper-tail points rise above it. The observed extremes are farther from the central part of the distribution than the normal reference suggests. This often creates an outward-bending or S-like pattern.

Lighter-than-normal tails tend in the opposite direction: lower-tail points lie above the line and upper-tail points lie below it. The ends are comparatively close to the center. These are tendencies, not a rule that every finite-sample plot must follow exactly. The central points, tail length, and overall coherence of the bend all matter.

Interpretation guide: With theoretical normal quantiles on the horizontal axis and residual quantiles on the vertical axis, lower points below the line together with upper points above it suggest heavier tails. Lower points above the line together with upper points below it suggest lighter tails. Check both tails and the overall pattern before drawing a conclusion.

Worked Example: Evidence of Heavier Tails

In another hypothetical standardized-residual plot, selected theoretical quantiles are \(-2,-1,0,1,2\), and the corresponding residual quantiles are \(-2.7,-1.1,0,1.2,2.8\). The reference line is \(y=x\). Calculate the end departures and interpret them.

At the lower end, \(y-x=-2.7-(-2)=-0.7\), so the point is below the line. At the upper end, \(y-x=2.8-2=0.8\), so the point is above the line. The values at the ends are also more extreme than their reference quantiles: \(2.7>2\) and \(2.8>2\). At \(x=-1\), the difference is \(-1.1-(-1)=-0.1\); at \(x=1\), it is \(1.2-1=0.2\). Thus, the departures grow toward the tails rather than appearing only at one endpoint.

This outward pattern is consistent with heavier tails than a normal distribution. In context, it is evidence that unusually low and unusually high residuals may occur more often, or be more extreme, than the normal reference would suggest. The plot alone does not quantify those probabilities or establish why the pattern occurred.

Asymmetric Departures and Skewness

When one tail departs more strongly than the other, the pattern is asymmetric. For example, a relatively short lower tail together with a longer, more extreme upper tail is consistent with right-skewness. Conversely, a more extreme lower tail and a comparatively short upper tail is consistent with left-skewness. The key comparison is the relative extent of the two tails, not simply whether points are above or below the line at one location.

The shape can be affected by the placement and slope of the reference line, so avoid diagnosing skewness from a memorized curve direction alone. First identify the axes and line; then compare how far the lower and upper extremes extend from the central pattern. A broad, coherent imbalance across several points is more persuasive than an unusual value at just one end.

Worked Example: A More Extreme Upper Tail

Suppose selected theoretical quantiles are \(-2,-1,0,1,2\), and the corresponding standardized residual quantiles are \(-1.1,-0.7,0,0.8,2.6\), with reference line \(y=x\). Assess whether the plot shows a symmetric tail pattern.

At the lower extreme, the difference is \(-1.1-(-2)=0.9\): the point lies above the line, and its magnitude, \(1.1\), is less than the reference magnitude, \(2\). The lower tail is comparatively short at this position. At the upper extreme, the difference is \(2.6-2=0.6\): the point lies above the line, and its magnitude, \(2.6\), is greater than the reference magnitude, \(2\). The upper tail extends farther than expected at this position.

The ends therefore do not show the balanced pattern of heavier tails at both ends. Instead, they suggest an asymmetric departure, with a less extreme lower tail and a more extreme upper tail, consistent with right-skewness. This is a cautious description of the plotted pattern, not a claim that skewness has been proved or that a particular cause has been identified.

A Short Quantile-Based Justification

Why does comparing the tails with the line give information about tail weight? A quantile describes the value below which a stated proportion of a distribution falls. For example, under the standard normal distribution, the quantiles at probabilities \(0.025\) and \(0.975\) are approximately \(-1.96\) and \(1.96\). In a normal quantile plot, sample residual quantiles at those approximate positions are compared with the normal reference values, adjusted for the line’s location and scale.

If the adjusted lower sample quantile is more negative than its normal counterpart and the adjusted upper quantile is more positive, both tails extend farther than the normal reference. In standardized units this comparison is:

$$ q_{\text{lower}} < -1.96 \qquad\text{and}\qquad q_{\text{upper}} > 1.96 $$

where the \(q\)'s are the observed residual quantiles after accounting for the reference line. These inequalities describe more extreme tail quantiles at those probability positions, which supports the interpretation of heavier tails. If only the upper quantile is substantially more extreme, while the lower one is not, the evidence is asymmetric instead. This comparison is a justification for the visual reading, not a test with a specified significance level.

Patterns That Need Caution

A departure from the line is diagnostic evidence, not an explanation. The plot can suggest a distributional shape, but it does not show whether the cause is a few unusual observations, a feature of the data, or another issue with the fitted model. It also does not prove that the regression model’s other assumptions hold. Interpret the normal quantile plot alongside the analysis context and other appropriate diagnostics.

  • One extreme point: A single point far from the line may indicate an unusual residual, but it does not by itself establish a systematic tail pattern.
  • A straight line with a different slope: A straight pattern may reflect a different scale from the standard normal. Judge departures from the reference line, not from a fixed slope of one.
  • Small waviness: Ordered sample values will not fall perfectly on a line. Do not assign a strong distributional interpretation to minor irregularities.
  • One tail only: Describe which tail departs and how. Do not call a one-sided departure symmetric heavy tails.

A common mistake is to say, “The upper points are above the line, so the residuals have heavy tails.” That reasoning considers only one end. Heavy-tail evidence is stronger when the lower tail also departs outward in the corresponding direction. If the upper tail alone is unusually extended, the pattern may instead be asymmetric.

Key takeaway: Read a normal quantile plot by checking the reference line, the overall bend, and both tails. Outward departures at both ends suggest heavier tails; inward departures at both ends suggest lighter tails; unequal departures suggest asymmetry. Treat each reading as evidence, not proof.

Check Your Understanding

Use the stated axis convention: theoretical normal quantiles are horizontal and residual quantiles are vertical.

  1. At the lower end, points lie below the reference line; at the upper end, they lie above it. What tail pattern does this suggest?
  2. Both tails lie closer to the center than the normal reference line suggests. What is a reasonable interpretation?
  3. Only the upper tail extends substantially beyond the reference line. Why is “symmetric heavy tails” not an adequate description?
  4. Why should a straight pattern with a slope different from one not automatically be called nonnormal?
  5. What additional feature would make a tail departure more persuasive than one isolated point?