Tutorials › Regression Analysis (Undergraduate) › Choose Values for Probing an Interaction Within the Data

Quantitative Predictor Interactions · Tutorial 335 of 991

Choose Values for Probing an Interaction Within the Data

Choose probe values that answer a scientific question while staying within the predictor values and combinations represented in the data.

Intermediate 10 min read

What You'll Learn

  • Explain what a probe value represents in a quantitative-predictor interaction model
  • Select scientifically meaningful values using reference points and the observed data
  • Check whether proposed values are within the observed range and supported by nearby data
  • Recognize why marginal ranges alone may not support a predictor combination
  • Avoid relying automatically on the mean and standard deviation when choosing probe values
  • Distinguish a preplanned scientific comparison from selective reporting

Why Probe Values Matter

In a model with an interaction between two quantitative predictors, the slope for one predictor depends on the value of the other. A conditional slope is therefore not one universal number: it describes the fitted change in the outcome for a one-unit increase in one predictor at a specified value of the other. To communicate or estimate that slope, we must choose the value at which to evaluate it.

A useful probe value should serve two purposes. It should correspond to a scientifically interpretable question, such as the slope at a clinically recognized benchmark, and it should be supported by the observed data. A value may be meaningful in principle but poorly represented in the data. Conversely, a value may occur frequently but have no particular scientific relevance. Careful probing considers both.

Model and Meaning of a Probe

Let \(x\) and \(z\) be quantitative predictors and \(Y\) the outcome. For a linear interaction model, the fitted conditional mean is

$$ \widehat{Y}=b_0+b_1x+b_2z+b_3xz. $$

Here \(b_0,b_1,b_2,b_3\) are estimated regression coefficients. At a chosen value \(z=z^*\), the fitted slope of \(Y\) with respect to \(x\) is \(b_1+b_3z^*\). Thus, \(z^*\) is the probe value: it identifies the condition under which the slope for \(x\) is evaluated. One can instead probe the slope for \(z\) at a chosen \(x\); the same selection principles apply.

Definition: A probe value is a specified value of one quantitative predictor at which a conditional slope for the other predictor is evaluated. A useful probe is scientifically interpretable and lies in a region of predictor space adequately represented by the data.

The model assumes that the conditional mean of \(Y\) follows the stated linear expression over the region being interpreted. In the usual regression formulation, the errors have mean zero conditional on the predictors; independence and constant error variance are used for standard regression inference, and normally distributed errors support exact small-sample \(t\) procedures. These assumptions do not make unsupported predictor combinations informative. In particular, choosing probe values does not validate the model or justify a causal interpretation.

To see why a probe matters, hold \(z\) fixed and compare fitted outcomes at \(x\) and \(x+\Delta x\):

$$ \begin{aligned} \widehat{Y}(x+\Delta x,z)-\widehat{Y}(x,z) &= b_1\Delta x+b_3z\Delta x\\ &=(b_1+b_3z)\Delta x. \end{aligned} $$

Dividing by \(\Delta x\), for a nonzero change, gives the fitted change per unit of \(x\), \(b_1+b_3z\). The probe value does not change the model; it specifies where within the interaction pattern we summarize its slope.

Choosing Values with Scientific Meaning and Data Support

Start with the scientific question, not with a formula for generating probe values. Ask which levels of \(z\) represent meaningful conditions or comparisons. A threshold defined by practice, a standard dose, or a value that separates recognizable conditions may be more useful than an arbitrary decimal. If no established reference points exist, values such as the observed median and selected percentiles can give interpretable summaries of the sample.

Then check support in the data. The minimum and maximum of \(z\) provide a first screen: a probe outside that interval asks the model to describe a condition beyond the observed values. But being within the marginal range is not enough. The interaction concerns combinations of \(x\) and \(z\). If observations at a proposed \(z\) occur only alongside a narrow set of \(x\) values, a slope in \(x\) at that \(z\) may be weakly supported. The joint distribution, not merely each predictor's separate range, matters.

1
State the scientific comparison.
Identify what condition a probe value represents and why the conditional slope at that condition would be useful.
2
Inspect observed values.
Check the range and distribution of the predictor being used as the probe, including whether observations are sparse near proposed values.
3
Check joint coverage.
Verify that relevant values of the other predictor also occur near the proposed probe. A marginal range does not guarantee that the required combinations were observed.
4
Choose and explain a small set of probes.
Use scientifically interpretable values supported by the data, and state why those values answer the question.

A common descriptive choice is the mean and values one standard deviation below and above it. This can be convenient when those values are meaningful and well supported, but it is not a rule. The resulting values may fall outside the observed range, land in sparse regions, or have no useful scientific interpretation. Observed quantiles, natural reference points, or a narrower set of values may be better.

Worked Example: Probing at Recognized Fitness Levels

Suppose a hypothetical exercise study fits a model for the predicted change in resting heart rate, measured in beats per minute, from weekly exercise time \(x\) (hours per week) and a prior-fitness score \(z\) (score points):

$$ \widehat{Y}=4.0-0.20x+0.10z-0.004xz. $$

The study's observed fitness scores range from 25 to 75. Investigators consider scores of 30, 50, and 70 meaningful low, middle, and high reference levels; observations are present near each score across a useful range of exercise time. These values are inside the observed range and are supported by the joint data, so they are defensible probes.

At \(z=30\), the fitted slope for exercise time is

$$ b_1+b_3z=-0.20+(-0.004)(30)=-0.32 \quad\text{beats per minute per additional weekly exercise hour.} $$

At \(z=50\), it is \(-0.20+(-0.004)(50)=-0.40\) beats per minute per additional weekly exercise hour. At \(z=70\), it is \(-0.20+(-0.004)(70)=-0.48\) in the same units. These are fitted conditional slopes at the stated fitness scores, not evidence that exercise causes the outcome to change. Choosing recognizable scores makes the comparison understandable, while checking coverage keeps it tied to the observed data.

Worked Example: Rejecting an Unsupported Benchmark

In a hypothetical academic study, \(x\) is weekly study time in hours and \(z\) is a prior-test score from 0 to 100. The fitted outcome model is

$$ \widehat{Y}=12+1.5x+0.20z+0.015xz, $$

where \(Y\) is a later assessment score in points. Observed prior-test scores range from 42 to 91. Their 25th, 50th, and 75th percentiles are 54, 68, and 82. Suppose a proposed probe is \(z=100\), because 100 has an obvious interpretation as a perfect prior score.

The fitted exercise slope at that proposed value would be \(1.5+(0.015)(100)=3.00\) assessment points per additional study hour. The arithmetic is correct, but the value 100 is outside the observed range. The fitted slope is therefore an extrapolation: the data do not show how the relationship behaves at that score. It should not be presented as a data-supported estimate for students with a perfect prior score.

The observed percentile values 54, 68, and 82 are more defensible candidates, provided study times are also represented near those scores. Their fitted slopes are:

$$ \begin{aligned} z=54 &: \quad 1.5+(0.015)(54)=2.31,\\ z=68 &: \quad 1.5+(0.015)(68)=2.52,\\ z=82 &: \quad 1.5+(0.015)(82)=2.73. \end{aligned} $$

Each value is in assessment points per additional study hour. The percentiles summarize levels represented in the sample; they do not guarantee support for every combination of score and study time. If, for example, students near a score of 82 were observed only at low study times, interpreting a slope across a broad study-time range there would still require caution.

Worked Example: Why Mean Plus Two Standard Deviations Can Mislead

A hypothetical environmental analysis models daily energy use \(Y\) in kilowatt-hours from outside temperature \(x\) in degrees and insulation rating \(z\). The fitted equation is

$$ \widehat{Y}=80-1.2x-3.0z+0.25xz. $$

The observed insulation ratings range from 0.5 to 3.5, with mean 1.8 and sample standard deviation \(s=0.9\). A mechanical choice of the mean and two standard deviations on either side gives \(1.8-2(0.9)=0.0\) and \(1.8+2(0.9)=3.6\). Both are outside the observed range.

For illustration, the fitted temperature slope at the upper candidate would be \(-1.2+0.25(3.6)=-0.30\) kilowatt-hours per additional degree. But 3.6 is not represented in the data, so this number should not be treated as a supported conditional slope. At the observed upper endpoint \(z=3.5\), the equation gives \(-1.2+0.25(3.5)=-0.325\) kilowatt-hours per additional degree. Even this endpoint needs checking: if few observations near 3.5 cover a useful range of temperatures, the slope may be imprecise or poorly supported.

A more appropriate plan might use observed insulation levels such as 1, 2, and 3, if those values are scientifically interpretable and the data include relevant temperatures near each. The lesson is not that a particular set of values is always best; it is that a convenient summary of the mean and standard deviation cannot substitute for checking range, meaning, and joint coverage.

Preplanned Probes and Responsible Interpretation

When possible, identify probe values before examining which conditional slopes appear strongest or most interesting. Choosing values only after seeing the results can encourage selective reporting: a reader may see a compelling slope at one value without learning that many alternatives were considered. A small set tied to scientific reference points or a clearly stated descriptive plan is easier to interpret and report transparently.

If a scientific benchmark falls outside the observed range, it can still be named as a question of interest, but the data at hand do not directly support an answer there. The appropriate response is to acknowledge the extrapolation and, when possible, obtain data covering that condition. Moving the probe to a nearby observed value may answer a related question, but it does not answer the original benchmark question.

Likewise, a value inside the range should not automatically be described as well supported. A predictor can have observations at both ends of its range while the combinations needed to estimate a conditional slope are rare. Inspecting the data jointly—for example, by tabulating ranges within bands of the probe predictor—helps reveal this limitation. Where support is thin, describe the slope cautiously and avoid implying that the estimate is equally reliable everywhere.

Common Mistakes

  • Using an appealing value without checking the data. A scientific threshold outside the observed range may produce a model calculation, but not a data-supported conclusion at that threshold.
  • Assuming any in-range value is safe. The other predictor may not vary near that probe value, so the slope can depend on a poorly represented combination.
  • Choosing mean plus or minus one or two standard deviations automatically. These values can be out of range or scientifically unhelpful; inspect them rather than treating them as mandatory.
  • Reporting only the most striking probe. Selective choice after examining results can conceal other examined values. State the basis for selecting probes and report the comparison transparently.
  • Interpreting a fitted conditional slope causally. A regression interaction describes an adjusted association under the model; probe selection alone does not establish a causal effect.
Key takeaway: Choose probe values to answer a defined scientific question, then check both their marginal range and the observed combinations of predictors. Meaningful values outside the data—or in sparsely represented regions—require explicit caution rather than confident interpretation.

Check Your Understanding

Use the model and data information in each question to explain your choice.

  1. In a fitted interaction model, what does it mean to evaluate the conditional slope for \(x\) at \(z=40\)?
  2. A scientifically important value of \(z\) lies above the largest observed value. What can and cannot be concluded from the fitted slope there?
  3. Why is checking the separate observed ranges of \(x\) and \(z\) insufficient to establish support for a conditional slope?
  4. When might observed percentiles be preferable to the mean and one standard deviation below and above it?
  5. What is the concern with selecting probe values only after identifying which conditional slopes look most interesting?