Tutorials › Regression Analysis (Undergraduate) › Interpreting Crossover Patterns and Uncertain Slopes

Simple Slopes and Marginal Effects · Tutorial 388 of 991

Interpreting Crossover Patterns and Uncertain Slopes

Use conditional slopes, contrasts, and their uncertainty to interpret fitted lines that appear to cross.

Intermediate 12 min read

What You'll Learn

  • Express a conditional slope as a coefficient combination in an interaction model.
  • Calculate standard errors and confidence intervals for conditional slopes and contrasts.
  • Find the estimated crossover of two fitted lines and explain what it does—and does not—show.
  • Distinguish evidence of a nonzero effect from evidence that an effect is practically important.
  • Identify why uncertainty in an estimated crossover cannot be judged from its point estimate alone.

Why a Visible Crossover Needs More Than a Plot

Two fitted lines may cross in a graph, or the estimated slope of a predictor may change sign across moderator values. These patterns are useful descriptions of the fitted model, but they are not, by themselves, evidence that the underlying effects differ meaningfully. The coefficient estimates are uncertain. A slope that looks positive at one moderator value and negative at another may have confidence intervals broad enough to include zero, and two fitted lines that intersect at one estimated point may still differ substantially elsewhere.

The key is to match the uncertainty calculation to the quantity being interpreted. A conditional slope is a linear combination of regression coefficients. A difference between two fitted lines at a chosen predictor value is another linear combination. Each has a standard error and can be summarized with a confidence interval. The estimated location where lines cross is a different quantity, and simply reporting its point estimate does not tell us how precisely it is located.

Model, Conditional Slopes, and Crossovers

For a continuous predictor \(x\) and a moderator \(z\), consider the interaction model

$$ Y_i=\beta_0+\beta_1x_i+\beta_2z_i+\beta_3x_iz_i+\varepsilon_i. $$

The fitted conditional mean at given \(x\) and \(z\) is \(\hat{Y}=\hat{\beta}_0+\hat{\beta}_1x+\hat{\beta}_2z+\hat{\beta}_3xz\). Holding \(z\) fixed, the fitted slope for a one-unit increase in \(x\) is \(\hat{\beta}_1+\hat{\beta}_3z\). Thus, the slope depends on the moderator value; \(\hat{\beta}_1\) alone is the slope only when \(z=0\).

Definition: A conditional slope is the fitted change in the conditional mean of \(Y\) for a one-unit increase in a predictor, holding the moderator at a specified value. In the model above, the conditional slope of \(x\) at \(z\) is \(\hat{\beta}_1+\hat{\beta}_3z\). A fitted crossover occurs where two fitted conditional means are equal. It describes equality of point predictions at a particular predictor value, not certainty that the population means are equal there.

For example, if \(z\) is a binary group indicator, the fitted difference between the group coded 1 and the group coded 0 at a given \(x\) is \(\hat{\beta}_2+\hat{\beta}_3x\). If \(\hat{\beta}_3\ne0\), the two fitted lines intersect at the \(x\)-value that makes this difference zero: \(\hat{x}_{\mathrm{cross}}=-\hat{\beta}_2/\hat{\beta}_3\). This algebra identifies an estimated intersection; it does not quantify its uncertainty.

Before using standard errors and \(t\)-based confidence intervals for these quantities, assume the interaction model is an appropriate description of the conditional mean, observations have independent errors with mean zero and constant variance, and the model matrix has full rank. For exact \(t\)-based inference, also assume normally distributed errors. In applications where these assumptions are doubtful, the reported standard errors and intervals may not have their stated properties. The examples below treat the assumptions as plausible for the hypothetical data and inference shown.

Uncertainty for a Conditional Slope

A conditional slope combines two estimated coefficients, so its uncertainty depends on both coefficient variances and their covariance. For estimates \(\hat{\beta}_1\) and \(\hat{\beta}_3\), the estimated variance of the slope at moderator value \(z\) is

$$ \widehat{\operatorname{Var}}(\hat{\beta}_1+z\hat{\beta}_3) =\widehat{\operatorname{Var}}(\hat{\beta}_1) +z^2\widehat{\operatorname{Var}}(\hat{\beta}_3) +2z\widehat{\operatorname{Cov}}(\hat{\beta}_1,\hat{\beta}_3). $$

This follows from the variance rule \(\operatorname{Var}(A+B)=\operatorname{Var}(A)+\operatorname{Var}(B)+2\operatorname{Cov}(A,B)\): take \(A=\hat{\beta}_1\) and \(B=z\hat{\beta}_3\), noting that \(z\) is fixed. The standard error is the square root of this variance. A confidence interval is the estimated slope plus or minus a \(t\) critical value times its standard error, using the model's residual degrees of freedom.

Worked Example: A Conditional Slope With a Wide Interval

Suppose a hypothetical model predicts exam score \(Y\), in points, from weekly study hours \(x\), stress score \(z\), and their interaction. The estimated coefficients of \(x\) and \(xz\) are \(\hat{\beta}_1=5\) points per study hour and \(\hat{\beta}_3=-2\) points per study hour per stress point. At \(z=1\), the estimated slope is

$$ \hat{\beta}_1+z\hat{\beta}_3=5+1(-2)=3 $$

points per study hour. Suppose the estimated coefficient variances are 4 and 1, respectively, and their estimated covariance is \(-0.6\). The standard error at \(z=1\) is

$$ SE=\sqrt{4+1^2(1)+2(1)(-0.6)} =\sqrt{3.8}=1.949. $$

With 36 residual degrees of freedom, use \(t^*=2.028\) for a 95% confidence interval:

$$ 3\pm2.028(1.949) =3\pm3.953 =[-0.953,\ 6.953]. $$

The point estimate is positive, but the interval includes zero and values on both sides of zero. Under the model assumptions, the data do not establish that the conditional slope at stress score 1 differs from zero at the 5% two-sided level. The interval is expressed in exam points per additional weekly study hour; it is not an interval for individual students' score changes.

Contrasts at the Estimated Intersection

When two fitted lines cross, their estimated contrast is zero at the estimated intersection by construction. That fact is about the fitted lines, not a test result. Uncertainty in the contrast at that \(x\)-value is still needed to assess whether the data are compatible with a nonzero difference in the conditional means.

For the binary-group model, let \(G=1\) identify one group and \(G=0\) the other:

$$ Y_i=\beta_0+\beta_1x_i+\beta_2G_i+\beta_3x_iG_i+\varepsilon_i. $$

Subtracting the fitted mean for \(G=0\) from the fitted mean for \(G=1\) gives \(\hat{\beta}_2+\hat{\beta}_3x\). Its estimated variance is \(\widehat{\operatorname{Var}}(\hat{\beta}_2)+x^2\widehat{\operatorname{Var}}(\hat{\beta}_3)+2x\widehat{\operatorname{Cov}}(\hat{\beta}_2,\hat{\beta}_3)\). The covariance matters: ignoring it can produce an incorrect standard error and interval.

Worked Example: A Group-Line Intersection With Substantial Uncertainty

Suppose a hypothetical model compares mean symptom scores for two groups across \(x\), hours of weekly activity. Scores are in points, and \(G=1\) labels the program group. The estimated group contrast is \(\hat{\beta}_2+\hat{\beta}_3x=12-4x\) points. The fitted lines therefore cross where

$$ 12-4x=0,\qquad \hat{x}_{\mathrm{cross}}=3\text{ hours}. $$

At \(x=3\), the estimated group contrast is \(12-4(3)=0\) points. Suppose the covariance information for the two contrast coefficients is \(\widehat{\operatorname{Var}}(\hat{\beta}_2)=4(4)\), \(\widehat{\operatorname{Var}}(\hat{\beta}_3)=4(0.25)\), and \(\widehat{\operatorname{Cov}}(\hat{\beta}_2,\hat{\beta}_3)=4(-0.4)\). The contrast standard error at the intersection is

$$ SE=\sqrt{4\{4+0.25(3^2)-2.4\}} =\sqrt{15.4}=3.924\text{ points}. $$

At \(x=3\), the plug-in standard error is 3.924 points, but because \(x=3\) was estimated from these same coefficients, the usual \(t\)-based calculation below is not generally a 95% confidence interval for the population contrast at the estimated crossover.

$$ 0\pm2.021(3.924) =[-7.93,\ 7.93]\text{ points (nominal range only)}. $$

The fitted means are equal at 3 hours by construction, but this calculation does not provide valid 95% coverage for the population contrast at that data-dependent value. It therefore cannot establish whether the population difference is within \(-5\) to \(5\) points or is practically unimportant. Inference about the crossover or the contrast at the estimated crossover requires a method that accounts for estimating the intersection, such as Fieller's method, a suitable bootstrap, or a simultaneous confidence procedure.

For comparison, at \(x=0\) the estimated contrast is 12 points and its standard error is \(\sqrt{16}=4\) points. The corresponding 95% interval is \(12\pm2.021(4)=[3.916,\ 20.084]\) points. This interval excludes zero. The contrast and its uncertainty depend on the chosen \(x\)-value.

Sign Reversals in Conditional Slopes

A plot may suggest that the association between \(x\) and \(Y\) changes direction as \(z\) changes. To assess that pattern, calculate the conditional slope at relevant moderator values and examine its uncertainty at each value. A positive estimate at one value and a negative estimate at another are not sufficient evidence that the underlying slopes have opposite signs.

Worked Example: One Slope Clearly Positive, the Other Uncertain

Consider a hypothetical model of the association between weekly activity \(x\), in hours, and a health score \(Y\), in points, with a continuous moderator \(z\), measured in stress-score units. Suppose \(\hat{\beta}_1=2\) points per hour and \(\hat{\beta}_3=-3\) points per hour per stress-score unit. The fitted conditional slopes are 5 points per hour at \(z=-1\) and \(-1\) point per hour at \(z=1\). Thus the point estimates suggest a reversal in slope.

Suppose the estimated variances of \(\hat{\beta}_1\) and \(\hat{\beta}_3\) are 1 and 0.25, and their covariance is 0.1. At \(z=-1\), the slope standard error is

$$ \sqrt{1+(-1)^2(0.25)+2(-1)(0.1)} =\sqrt{1.05}=1.025. $$

Using 50 residual degrees of freedom and \(t^*=2.009\), its 95% interval is \(5\pm2.009(1.025)=[2.941,\ 7.059]\) points per hour. At \(z=1\), the estimated slope is \(-1\), and its standard error is

$$ \sqrt{1+1^2(0.25)+2(1)(0.1)} =\sqrt{1.45}=1.204. $$

The 95% interval there is \(-1\pm2.009(1.204)=[-3.419,\ 1.419]\) points per hour. The data support a positive conditional slope at \(z=-1\), but the interval at \(z=1\) includes zero. The fitted estimates have opposite signs, yet these intervals do not establish a negative slope at \(z=1\), and they do not by themselves test whether the two slopes differ. That comparison requires an uncertainty calculation for their difference.

What a Crossover Does—and Does Not—Establish

A crossover can be a useful summary of an interaction: it identifies where the fitted contrast changes sign or where the fitted conditional means coincide. But several questions should remain separate:

  • Where do the fitted lines cross? Solve for the predictor value at which the estimated contrast is zero.
  • Is a contrast distinguishable from zero at a chosen value? Calculate its standard error and confidence interval at that value.
  • Is a difference large enough to matter? Interpret the interval against a context-appropriate threshold for practical importance, if one has been specified.

The first question concerns a point estimate; the second concerns statistical uncertainty; the third concerns practical meaning. A confidence interval that includes zero does not prove equality. A narrow interval around zero may rule out differences large enough to matter, while a wide interval that includes zero may simply be inconclusive. Conversely, an interval excluding zero does not automatically imply an important difference.

The estimated intersection \(-\hat{\beta}_2/\hat{\beta}_3\) is a ratio of estimates. Its location can be highly uncertain, especially when the estimated interaction \(\hat{\beta}_3\) is close to zero. Do not treat the calculated point as a precisely known boundary, or infer its uncertainty by separately inserting the endpoints of coefficient confidence intervals into the ratio. The contrast interval at a specified \(x\) answers a different question from an interval for the crossover location. Also check that the relevant predictor and moderator values are supported by the observed data; an intersection far outside that support is not a reliable basis for substantive interpretation.

Common Mistake

Wrong reasoning: “The fitted lines cross at 3 hours, so the groups are equal at 3 hours; and because they are on opposite sides of the crossover, the groups must differ meaningfully on either side.”

Correction: The fitted contrast is zero at the estimated intersection, but the population contrast there remains uncertain. Calculate its standard error and interval. At other predictor values, calculate the contrast and interval at those values too. Then distinguish evidence that a contrast differs from zero from evidence that its size is practically important. A plotted intersection alone answers none of these uncertainty questions.

Key takeaway: Interpret an apparent crossover by calculating conditional slopes or contrasts at specified values and attaching their uncertainty. A fitted intersection is an estimated feature of the model, not proof of equality, a precise boundary, or evidence of meaningful differences.

Check Your Understanding

Try these questions using the model and uncertainty principles above.

  1. In an interaction model, why is \(\hat{\beta}_1\) not generally the slope of \(x\) at every moderator value?
  2. What covariance term is required when calculating the variance of \(\hat{\beta}_1+z\hat{\beta}_3\), and why?
  3. If two fitted group lines intersect at \(x=4\), what does that tell you about the estimated contrast at \(x=4\), and what does it not tell you about the population contrast?
  4. A conditional-slope interval includes zero but is wide. Why is it incorrect to conclude that the slope is exactly zero?
  5. How would you decide whether an estimated group difference is practically important, rather than merely statistically distinguishable from zero?