Tutorials › Regression Analysis (Undergraduate) › Relative Changes Depend on the Baseline Outcome

Statistical and Practical Significance · Tutorial 287 of 991

Relative Changes Depend on the Baseline Outcome

Calculate a regression-estimated change as a percentage of an explicitly chosen baseline, and explain why that percentage depends on the baseline outcome.

Intermediate 9 min read

What You'll Learn

  • Define a relative outcome change using an explicitly stated baseline.
  • Distinguish an absolute change in outcome units from a percentage change.
  • Calculate signed percentage changes for different baselines when the absolute change is held fixed.
  • Explain why a larger baseline can make the same absolute change look smaller in percentage terms.
  • Identify conditions that make a percentage comparison misleading or undefined.
  • Report a relative change with its reference value, outcome units, and context.

Introduction

A regression estimate may describe an outcome change in its original units, such as a decrease of 4 minutes or an increase of 12 liters. Those absolute changes can be identical while their percentage sizes differ substantially. The reason is simple but important: a percentage change is calculated relative to a baseline outcome, and different baselines produce different percentages.

For example, a 4-minute decrease is a larger proportional change from a 30-minute baseline than from a 60-minute baseline. Neither percentage is the uniquely correct one in isolation. Each answers a question tied to a specified reference value. This tutorial develops the calculation, shows how to connect it to fitted regression outcomes, and explains how to report it without obscuring the baseline.

From an Absolute Regression Estimate to a Relative Change

Let \(\widehat{\mu}(z)\) denote the regression-estimated mean outcome for a predictor profile \(z\). A profile specifies the predictor values at which the model's fitted mean is evaluated. For a comparison from profile \(z_0\) to profile \(z_1\), define the estimated absolute change as the fitted outcome at the second profile minus the fitted outcome at the first:

$$ \hat{\Delta}=\widehat{\mu}(z_1)-\widehat{\mu}(z_0). $$

The outcome units of \(\hat{\Delta}\) are the same as the outcome units of \(Y\). A positive value is an estimated increase; a negative value is an estimated decrease. To express that change relative to the fitted outcome at the reference profile \(z_0\), divide by the reference fitted outcome and multiply by 100.

Definition: The estimated relative change from reference profile \(z_0\) to profile \(z_1\), expressed as a percentage of the reference fitted outcome, is
$$ \hat{R}(z_0,z_1) = 100\frac{\widehat{\mu}(z_1)-\widehat{\mu}(z_0)} {\widehat{\mu}(z_0)} = 100\frac{\hat{\Delta}}{\widehat{\mu}(z_0)}\%. $$
The denominator is the reference outcome, not the outcome after the change. State that reference whenever reporting the percentage.

This is a signed percentage: a negative result indicates a decrease relative to the reference; a positive result indicates an increase. If a reader wants to describe a decrease as a positive-sized “percentage reduction,” the magnitude can be reported instead, but it should not be confused with the signed change. In either form, the absolute change and the reference outcome should remain clear.

The percentage calculation does not require that a regression have one common slope for every profile. It does require that the absolute change and the reference fitted outcome being used correspond to the particular comparison under discussion. When an additive model gives a common estimated change for several profiles, the same numerator can be compared with different reference fitted outcomes. In a model where the estimated change itself varies by profile, calculate the appropriate change separately for each comparison.

Why the Same Change Produces Different Percentages

Suppose the absolute change \(\hat{\Delta}\) is fixed and the reference fitted outcome \(B\) is positive. The relative change is \(100\hat{\Delta}/B\). Thus, changing the reference value changes the percentage even though the estimated change in outcome units has not changed.

The relationship can be seen by considering how the signed percentage varies with \(B\):

$$ R(B)=100\frac{\hat{\Delta}}{B}, \qquad \frac{dR(B)}{dB}=-100\frac{\hat{\Delta}}{B^2}. $$

For a fixed negative change, the derivative is positive: as a positive baseline grows, the signed percentage moves upward toward zero. Its absolute magnitude therefore becomes smaller. For a fixed positive change, the derivative is negative, so the signed percentage also moves toward zero as the baseline grows. This is a mathematical feature of dividing by the baseline, not evidence that the absolute regression estimate changed.

This interpretation depends on choosing an outcome scale for which ratios to the stated baseline are meaningful. The baseline must also be nonzero; with a zero reference outcome, the percentage is undefined. A negative reference may yield a calculable ratio but often makes the usual “percentage increase” or “percentage decrease” language hard to interpret. For the examples below, the outcome has a meaningful zero and the reference outcomes are positive.

Worked Example: One Estimated Decrease, Two Time Baselines

In a hypothetical analysis of appointment waiting time, an additive regression model estimates that a specified predictor contrast corresponds to a 4-minute decrease in mean waiting time. Consider two reference profiles whose fitted baseline waiting times are 30 minutes and 60 minutes. Assume both profiles are within the range for which the fitted model is being used, the comparison is the same predictor contrast at each profile, and the model estimates the same additive change of \(-4\) minutes for both. Waiting time has a meaningful zero, and both baselines are positive.

Reference baseline of 30 minutes. The estimated post-contrast fitted outcome is \(30-4=26\) minutes, so the signed relative change is

$$ 100\frac{26-30}{30} = 100\frac{-4}{30} = -13.33\%. $$

The estimated change is a 4-minute decrease, or \(-13.33\%\) relative to the 30-minute baseline.

Reference baseline of 60 minutes. The estimated post-contrast fitted outcome is \(60-4=56\) minutes, giving

$$ 100\frac{56-60}{60} = 100\frac{-4}{60} = -6.667\%. $$

Here the same 4-minute decrease is \(-6.667\%\) relative to the 60-minute baseline. The absolute estimated change is identical in the two comparisons. The percentage differs because the denominator differs. Reporting only “a 13.33% decrease” would leave out which baseline defines that percentage.

Worked Example: One Estimated Increase, Two Usage Baselines

Suppose a hypothetical regression model estimates that a particular change in operating conditions is associated with an increase of 12 liters in mean daily water use. Consider reference profiles with fitted baseline use of 40 liters per day and 120 liters per day. Assume the same operating-condition contrast is evaluated at both profiles and that the model's additive structure gives the same estimated increase, \(+12\) liters per day, at each. These profiles are within the model's applicable range, and daily water use has a meaningful zero.

At a 40-liter baseline: the fitted outcome after the contrast is \(40+12=52\) liters per day. The percentage change relative to the baseline is

$$ 100\frac{52-40}{40} = 100\frac{12}{40} = 30.00\%. $$

At a 120-liter baseline: the fitted outcome after the contrast is \(120+12=132\) liters per day. Relative to this baseline,

$$ 100\frac{132-120}{120} = 100\frac{12}{120} = 10.00\%. $$

The estimated increase is 12 liters per day in each case, but it is a 30.00% increase from 40 liters per day and a 10.00% increase from 120 liters per day. The percentage alone does not describe the absolute size of the increase, so reporting both measures is informative.

Making the Model Assumption Explicit

The examples above assumed a common additive change across the profiles being compared. One model form that has this property is a fitted mean with a shared slope for predictor \(x\):

$$ \widehat{\mu}(x,w)=\hat{a}(w)+\hat{\beta}x, $$

where \(w\) denotes the other predictor values defining a profile, and \(\hat{a}(w)\) is the fitted contribution associated with those values. For a contrast from \(x_0\) to \(x_1\) while holding \(w\) fixed, subtract the fitted means:

$$ \widehat{\mu}(x_1,w)-\widehat{\mu}(x_0,w) = \bigl[\hat{a}(w)+\hat{\beta}x_1\bigr] - \bigl[\hat{a}(w)+\hat{\beta}x_0\bigr] = \hat{\beta}(x_1-x_0). $$

The fitted contribution \(\hat{a}(w)\) cancels, so the estimated absolute change is the same across these profiles. The baseline fitted outcome, however, is \(\hat{a}(w)+\hat{\beta}x_0\), which can differ with \(w\). Dividing the common change by those different baselines yields different relative changes.

This derivation also shows why the shared-change assumption should not be silently imposed. If the regression model allows the effect of \(x\) to vary with \(w\), the estimated change for a given contrast can depend on \(w\). Then the correct calculation uses both the profile-specific numerator and its reference outcome. In all cases, fitted values should be calculated from the stated model at the stated profiles; a relative change is not a new regression coefficient.

Worked Example: A Fixed Cost Reduction at Two Spending Levels

A hypothetical regression model for monthly household energy cost estimates a \(\$15\) reduction for a specified predictor contrast. Consider reference profiles with fitted monthly costs of \(\$75\) and \(\$300\). Assume the contrast is within the model's applicable range, the same additive reduction applies at both profiles, and both fitted baselines are positive. Monthly cost has a meaningful zero.

At a \(\$75\) baseline: the fitted cost after the contrast is \(\$75-\$15=\$60\). Therefore,

$$ 100\frac{60-75}{75} = 100\frac{-15}{75} = -20.00\%. $$

At a \(\$300\) baseline: the fitted cost after the contrast is \(\$300-\$15=\$285\), so

$$ 100\frac{285-300}{300} = 100\frac{-15}{300} = -5.000\%. $$

The estimated reduction is \(\$15\) per month in both comparisons. It is \(-20.00\%\) relative to the \(\$75\) fitted baseline and \(-5.000\%\) relative to the \(\$300\) fitted baseline. Those are different relative descriptions of the same assumed absolute change, not conflicting estimates.

Assumptions and Limits of the Interpretation

The arithmetic is direct, but the interpretation depends on the model and on the outcome scale. Before reporting a relative change, check the following:

  • The comparison is defined. State the reference profile and the profile being compared. If the predictor contrast differs across comparisons, do not describe the numerators as the same absolute change.
  • The fitted values are relevant. Use predictor profiles within the range and setting to which the fitted regression is intended to apply. The calculation cannot make an unsuitable extrapolation trustworthy.
  • The reference is nonzero and appropriate. Division by zero is undefined. Even with a nonzero value, a percentage may be unhelpful if the outcome scale does not support meaningful ratios.
  • The model supports the claimed change. If the model specifies a common additive effect, it can support a shared numerator for the relevant contrasts. If the estimated change varies by profile, calculate the change separately for each one.
  • The language matches the evidence. A regression association is not automatically a causal effect. Use causal language only when the study design and assumptions justify it.

A percentage change is also distinct from a percentage-point change. For example, a change in a proportion from 20% to 25% is an increase of 5 percentage points; relative to the 20% baseline, it is a 25% increase. These descriptions use different calculations and answer different questions. State which one is intended.

Common Mistakes and Clear Reporting

A common mistake is to calculate a percentage using a baseline but then report it as if it were an inherent property of the regression estimate: “The estimated change is a 20% decrease.” That sentence can be misleading when another relevant baseline would give a different percentage. The correction is to give the reference explicitly: “The estimated \(\$15\) monthly decrease is \(-20.00\%\) relative to the \(\$75\) fitted baseline.” If the comparison has a second baseline, report its percentage separately.

Another mistake is to use the post-change fitted outcome as the denominator. For a change from a baseline of 40 to an outcome of 52, the relative increase from the baseline is \(100(52-40)/40=30\%\), not \(100(52-40)/52\). The latter divides by the final outcome and answers a different question. Likewise, dropping the negative sign from a decrease can hide direction. If using “percentage reduction” as a positive magnitude, label it as such and still identify the reference.

Key takeaway: An absolute regression-estimated change is measured in outcome units. Its relative change is that same change divided by an explicitly stated reference outcome. When the reference changes, the percentage can change even if the absolute estimate does not.

Check Your Understanding

For each question, state the reference outcome used or explain why a relative change is not justified.

  1. A fitted outcome decreases by 6 units from a reference value of 24. Calculate the signed relative change and state its direction.
  2. The same estimated increase of 8 units is compared with baselines of 40 and 160. Calculate both percentages and explain why they differ.
  3. Explain why a percentage change from a reference outcome of zero is undefined.
  4. A model estimates different absolute changes for two predictor profiles. What quantities must be used to calculate the relative change for each profile?
  5. A proportion rises from 0.20 to 0.25. Give the change in percentage points and the relative percentage increase from the original value.