Why Interpret the Curve Rather Than Its Coefficients?
A spline can represent a changing relationship between a predictor and a response without requiring one straight-line slope to describe the whole range. That flexibility is useful for describing curvature, but it changes how the fitted model should be read. In a simple straight-line model, the slope has a direct interpretation as the same fitted change in response for every one-unit increase in the predictor. A spline’s slope can vary with the predictor, and its basis coefficients usually do not have that direct interpretation.
A practical interpretation starts with the fitted response at a predictor value, or with the difference between fitted responses at two values. A plotted curve helps show how those predictions change across the range. Coefficients are part of the calculation that produces the curve; they are not automatically effects at particular predictor values.
The Model and the Quantities to Interpret
For observations \((x_i,Y_i)\), a standard regression formulation is \(Y_i=m(x_i)+\varepsilon_i\), where \(m(x)=E(Y\mid X=x)\) is the conditional mean response and \(\varepsilon_i\) is the error. In a spline regression, \(m(x)\) is represented using spline basis functions. The usual regression assumptions include errors with mean zero conditional on the predictors, independent observations, and constant error variance for the classical standard-error calculations. Normal errors are additionally used for exact small-sample \(t\)- and \(F\)-inference, but are not needed simply to describe the fitted curve. No causal interpretation follows from this model by itself.
The spline coefficients are estimated from the data, giving the fitted function \(\hat{m}(x)\). For a basis representation, this can be written as:
Here, \(B_j(x)\) is the value of the \(j\)th basis function at \(x\), and \(\hat{\beta}_j\) is its estimated coefficient. The fitted prediction comes from the intercept and the combined contributions of the basis functions at that \(x\). The basis functions overlap in their contributions, so a single coefficient generally does not describe the slope or response change at one predictor value.
Predicted Values and Changes Across an Interval
For two specified predictor values \(x_1\) and \(x_2\), the fitted change is \(\hat{m}(x_2)-\hat{m}(x_1)\). Dividing by \(x_2-x_1\) gives the average rate of change across that interval. This is a summary of the curve over the chosen interval, not a claim that the curve has the same slope at every point within it. The interval and units are part of the interpretation.
Worked Example: Comparing Fitted Responses Over Two Intervals
Suppose a hypothetical spline fit relates a training time \(x\), measured in hours per week, to a test score \(Y\), measured in points. The fitted curve gives \(\hat{m}(2)=68\), \(\hat{m}(4)=73\), and \(\hat{m}(6)=76\). Interpret its changes from 2 to 4 hours and from 4 to 6 hours.
From 2 to 4 hours per week, the fitted change is:
The average rate of change over that interval is \(5/(4-2)=2.5\) points per additional hour per week. From 4 to 6 hours per week, the fitted change is \(76-73=3\) points, so the average rate is \(3/(6-4)=1.5\) points per additional hour per week.
These fitted averages differ, which is consistent with a curve whose rate of increase changes over the predictor range. The calculations describe the fitted relationship: they do not establish that increasing training time causes scores to rise. Nor do they show that the curve’s local slope is exactly 2.5 or 1.5 at every point in the corresponding interval.
When the fitted curve is differentiable at \(x\), its derivative \(\hat{m}'(x)\) is the local rate of change at that point. It describes how the fitted mean would change for a small change in the predictor near \(x\), with the other modeled conditions held fixed. For a cubic spline with the usual smoothness constraints, the curve and its first two derivatives agree across interior knots, so the local slope is well-defined there as well as within each polynomial segment.
A finite interval average and a local derivative answer different questions. The average summarizes the whole interval; the derivative describes the curve near one value. They are connected by a standard calculus result: the change between endpoints equals the integral of the derivative over the interval. Dividing by interval width gives the average derivative:
This follows by the fundamental theorem of calculus, \(\hat{m}(x_2)-\hat{m}(x_1)=\int_{x_1}^{x_2}\hat{m}'(x)\,dx\), followed by division by \(x_2-x_1\). The average rate equals the derivative at some point in the interval when the derivative is continuous, but it need not equal the derivative at either endpoint.
Worked Example: Finding a Local Slope From a Spline Segment
On one interval, suppose a hypothetical fitted spline segment for a plant-growth response is \(\hat{m}(x)=5+1.2u-0.10u^2+0.02u^3\), where \(u=x-2\), \(x\) is fertilizer amount in grams, and the response is mean plant height in centimetres. Find the fitted local rate of change at \(x=4\), and compare it with the average rate from \(x=3\) to \(x=5\).
Because \(u=x-2\), differentiating with respect to \(x\) is the same as differentiating with respect to \(u\). Thus:
At \(x=4\), \(u=4-2=2\), so the local fitted slope is:
The fitted mean height is changing at a local rate of 1.04 centimetres per additional gram near 4 grams. For the interval calculation, at \(x=3\), \(u=1\), giving \(\hat{m}(3)=5+1.2-0.10+0.02=6.12\) centimetres. At \(x=5\), \(u=3\), giving \(\hat{m}(5)=5+3.6-0.90+0.54=8.24\) centimetres. Therefore, the average rate over the interval is:
The average rate of 1.06 centimetres per gram is close to, but not identical to, the local rate of 1.04 at the midpoint. Both calculations describe the same fitted curve, but they summarize it over different ranges.
Why a Basis Coefficient Is Usually Not a Slope
A coefficient multiplies a basis function; its effect on the fitted curve at \(x\) is therefore tied to the value and shape of that function at \(x\). A coefficient can contribute at many predictor values, and several coefficients can contribute at the same value. The derivative of the fitted curve makes this especially clear:
The intercept’s derivative is zero, and each basis coefficient contributes through the derivative of its basis function. The total local slope is the sum of these contributions, not generally any one \(\hat{\beta}_j\). In a truncated power representation, for example, a coefficient on a truncated cubic term multiplies a function that is zero on one side of its knot and curved on the other. It is not a constant slope. In a B-spline representation, coefficients likewise combine through basis functions that have local support. A simple straight-line model is a special case where the coefficient of \(x\) is the slope; that familiar reading should not be transferred automatically to spline coefficients.
Worked Example: Combining Basis Contributions at Two Predictor Values
Suppose a hypothetical fitted curve uses four B-spline basis functions, with estimated coefficients \(12\), \(18\), \(10\), and \(16\), measured in score points. At \(x=3\), suppose the basis values are \(0.50\), \(0.35\), \(0.15\), and \(0\). At \(x=4\), suppose they are \(0.20\), \(0.50\), \(0.25\), and \(0.05\). These are illustrative basis evaluations from a fitted spline.
The fitted value at \(x=3\) is the weighted sum:
At \(x=4\), the fitted value is:
The fitted change from \(x=3\) to \(x=4\) is \(14.7-13.8=0.9\) points over one predictor unit. That change comes from all four basis contributions changing together. The coefficient \(18\), for example, is not itself a 18-point increase, nor does it say that the fitted curve rises by 18 points per predictor unit. Its contribution to the fitted value is \(18B_2(x)\), which depends on \(x\).
Reading a Plotted Spline in Context
A spline plot is a visual display of the fitted function across a range of predictor values. To interpret it carefully, first identify what each axis measures and its units. Then read the curve at relevant predictor values or compare its height across a stated interval. A rising segment indicates increasing fitted mean response as the predictor increases; a falling segment indicates decreasing fitted mean response. A flatter segment indicates a smaller local rate of change than a steeper segment, subject to the scales of both axes.
The fitted curve summarizes the modeled conditional mean, not the pattern of every individual observation. If a plot also shows observed data points, those points may lie above or below the curve because of residual variation. A confidence band, when shown, represents uncertainty about the fitted mean under its stated construction; it is not a guarantee that individual observations fall inside it. Interpretation should also stay within the predictor range supported by the data. A curve’s shape outside that range depends on the model’s boundary behavior and should not be treated as directly observed evidence.
As with other regression fits, a fitted difference is an association conditional on the model. For example, saying that the fitted mean score is higher at one study time than another describes the curve; it does not establish that changing an individual’s study time would cause that difference. The context and study design determine whether causal language is justified.
Common Mistake: Calling a Spline Coefficient “The Slope”
Incorrect reasoning: “The coefficient on the third spline basis function is 2, so the response increases by 2 units for every one-unit increase in the predictor near the third knot.”
Correction: A basis coefficient is a multiplier in the curve’s construction, not necessarily a slope or a knot-specific effect. To interpret the fit, calculate predicted values at relevant predictor values and compare them, or evaluate the derivative of the full fitted function at a specified value. State whether the result is a fitted difference, an interval-average rate, or a local rate, and include the units. Even if a coefficient happens to be numerically similar to one of these quantities in a particular fit, its interpretation must come from the model’s full basis representation.
Check Your Understanding
For each question, identify which quantity is being described and include units where they are available.
- A fitted mean is 42 at \(x=5\) and 50 at \(x=9\). What is the fitted change and average rate of change between these predictor values?
- Why is the average rate of change across an interval not necessarily the local slope at either endpoint?
- In a basis expansion, what determines the contribution of a coefficient to the fitted value at a particular predictor value?
- A spline curve is rising but becoming flatter. What does this say about the fitted response and its local rate of change?
- Why does a fitted difference between two predictor values, by itself, not establish a causal effect?