From a Fitted Reference Model to Delta-Adjusted Imputations
A continuous-outcome delta analysis turns a fitted model for observed outcomes into a transparent set of imputations for missing outcomes. The calculation has two parts: predict from the reference model, then add a prespecified adjustment. Keeping those parts separate makes it easier to verify the arithmetic and interpret the resulting summaries.
Consider a clinical endpoint measured at a follow-up visit. Let \(Y\) denote the endpoint, \(X\) the observed covariates used in the imputation model, and \(R\) indicate whether the endpoint is observed: \(R=1\) means observed and \(R=0\) means missing. A fitted reference model supplies a conditional distribution for \(Y\) given \(X\), estimated from participants with observed outcomes. The sensitivity parameter \(\delta\) shifts that reference distribution for participants with missing outcomes. Its units are the same as those of \(Y\).
For example, if higher scores indicate better health, a negative delta represents worse outcomes among participants with missing data than the reference model predicts for participants with the same covariates. This is a sensitivity assumption, not a quantity estimated from the observed outcomes alone. The earlier material on interpreting delta-adjusted outcome distributions provides the context for choosing and interpreting delta values; here the emphasis is on calculating and summarizing the imputations.
Model, Assumptions, and the Shift Calculation
For clarity, suppose the reference model is a normal linear regression,
The fitted model replaces \(m(x)\), \(\beta_0\), \(\beta_1\), and \(\sigma\) with estimates. For a missing outcome, a conditional-mean imputation is \(\hat m(x)+\delta\). A stochastic imputation also includes a residual draw:
The formula makes an important distinction. The delta-adjusted mean prediction is \(\hat m(x)+\delta\); an individual stochastic imputation generally differs from it because it includes residual variation. Adding the same fixed delta moves every conditional mean by the same amount. Under the stated normal location-shift model, it leaves the residual variance unchanged.
These calculations rely on assumptions that should be made explicit:
- The reference model adequately describes the conditional outcome distribution among participants with observed outcomes over the covariate values of participants with missing outcomes. Its functional form and residual distribution are reasonable for this use.
- The delta-shift assumption is appropriate for the sensitivity scenario: conditional on the modeled covariates, the missing-outcome distribution has the reference shape and spread, shifted by \(\delta\). A constant delta does not allow the shift to vary with covariates.
- The chosen delta is expressed on the same scale and in the same units as the outcome, and the resulting predictions are clinically and mathematically plausible.
- When point estimates of the reference-model parameters are used, the calculation treats them as fixed. It does not, by itself, propagate uncertainty in the fitted model.
The normal model is a working assumption for the examples, not a requirement for every continuous outcome. With another suitable reference distribution, an additive delta still shifts its location, but the resulting distribution must be checked on the actual outcome scale. For bounded outcomes, for instance, a shifted distribution can place mass outside the feasible range.
The shift in a pattern-specific mean follows directly from the definition. For participants with missing outcomes, average the reference predictions and then add the common delta:
If \(n_1\) outcomes are observed with mean \(\bar Y_{R=1}\) and \(n_0\) are missing, the corresponding completed-data marginal mean based on these pattern means is
Thus, when the observed outcomes and fitted reference predictions are held fixed, changing delta by one outcome unit changes the overall mean by \(n_0/(n_1+n_0)\) outcome units. The missing pattern receives the full shift; the overall sample receives a shift weighted by the fraction missing.
Worked Example: Predicting and Shifting Individual Missing Outcomes
Suppose a hypothetical clinical study measures a health score in points, with higher scores indicating better health. A fitted reference model for observed outcomes is \(\hat m(x)=40+2x\), where \(x\) is a baseline covariate. Its residual standard deviation is estimated as 4 points. Three participants have missing follow-up scores and covariate values \(x=0,5,10\). Consider \(\delta=-5\) points.
First calculate each reference prediction: \(40+2(0)=40\), \(40+2(5)=50\), and \(40+2(10)=60\) points. Add the same delta to each prediction. The delta-adjusted conditional means are therefore \(40-5=35\), \(50-5=45\), and \(60-5=55\) points.
Their missing-pattern mean is \((35+45+55)/3=135/3=45\) points. Equivalently, the mean reference prediction is \((40+50+60)/3=50\) points, and \(50+(-5)=45\) points. The two calculations agree.
For stochastic imputations, suppose illustrative residual draws are \(-1,2,-2\) points. The imputed values are \(35-1=34\), \(45+2=47\), and \(55-2=53\) points. Their realized mean is \((34+47+53)/3=134/3=44.67\) points, not 45. This difference is due to the particular residual draws, not a different delta-adjusted mean. Under the model, each participant’s predictive distribution has mean 35, 45, or 55 points and residual variance \(4^2=16\) square points.
Summarizing the Missing Pattern and Its Distribution
A pattern-specific mean is only one summary. When the fitted model supplies a predictive distribution, the missing-pattern distribution can be described as a mixture over the participants’ covariate values. Under the normal location-shift model, participant \(i\)'s predictive distribution is \(N\bigl(\hat m(X_i)+\delta,\hat\sigma^2\bigr)\). Averaging those distributions gives the missing-pattern predictive distribution. Its mean is the average of the shifted means; its variance includes both residual variation and variation in predicted means across participants.
For a finite set of \(n_0\) missing participants, treating their covariates as fixed, the variance of that equally weighted predictive mixture is
The delta does not appear in the second term because adding the same number to every predicted mean does not change their spread. Nor does it change \(\hat\sigma^2\) under this model. This distributional summary describes predictive variation conditional on the fitted parameters; it is not a confidence interval and does not account for uncertainty in estimating those parameters.
Worked Example: Pattern-Specific and Overall Summaries
In a hypothetical study, six observed follow-up scores are 48, 50, 51, 52, 55, and 56 points. Four participants have missing scores. Their reference-model predictive means are 42, 46, 50, and 54 points, and the fitted residual standard deviation is 6 points. Use \(\delta=-3\) points.
The missing participants’ adjusted means are \(42-3=39\), \(46-3=43\), \(50-3=47\), and \(54-3=51\) points. Their pattern-specific mean is \((39+43+47+51)/4=180/4=45\) points. The observed-pattern mean is \((48+50+51+52+55+56)/6=312/6=52\) points.
There are 10 participants in total, so the marginal mean based on the observed outcomes and missing-pattern adjusted means is \[ \frac{6(52)+4(45)}{10} =\frac{312+180}{10} =49.2\text{ points}. \] This is the pattern-weighted mean. It is 2.8 points below the observed-pattern mean; it does not imply that the delta-adjusted missing-pattern mean is 2.8 points below that mean. The difference between the two pattern means is 7 points.
The four missing participants’ adjusted predictive distributions are normal with means 39, 43, 47, and 51 points and variance \(6^2=36\) square points. The average of their means is 45 points. The variance of the four means around 45 is \(\{(-6)^2+(-2)^2+2^2+6^2\}/4=80/4=20\) square points. Thus the variance of the equally weighted missing-pattern predictive mixture is \(36+20=56\) square points, and its standard deviation is \(\sqrt{56}=7.483\) points. The mixture is not generally a single normal distribution, even though each participant’s conditional predictive distribution is normal.
For comparison, if one simply inserts the four conditional means into a completed data set, the 10 values sum to 492 and have mean 49.2 points. Their sample standard deviation is \(\sqrt{243.6/9}=5.203\) points, where 243.6 is the sum of squared deviations from 49.2. That standard deviation describes this particular set of point-filled values. It is not the predictive-mixture standard deviation: point filling omits residual variation for missing outcomes.
How the Overall Mean Changes Across Delta Values
The same predictions can be reused to examine several fixed delta scenarios. This is useful for checking that pattern summaries and the overall mean change in the expected direction and by the expected amount. It is a calculation under each specified scenario, not an estimate of which delta is correct.
Worked Example: Comparing Three Delta Scenarios
Suppose a hypothetical trial has 12 observed scores with mean 54 points and eight missing scores. The reference predictions for the eight missing participants are 46, 50, 54, 58, 46, 50, 54, and 58 points. Their mean is \((46+50+54+58)\times2/8=208/8=52\) points. The reference-model residual standard deviation is 5 points. Compare \(\delta=-2,0,\) and \(+3\) points.
The missing-pattern means are \(52-2=50\), \(52+0=52\), and \(52+3=55\) points. There are 20 participants, of whom 8 have missing outcomes. The overall means are, respectively, \[ \frac{12(54)+8(50)}{20} =\frac{648+400}{20} =52.4\text{ points}, \] \[ \frac{12(54)+8(52)}{20} =\frac{648+416}{20} =53.2\text{ points}, \qquad \frac{12(54)+8(55)}{20} =\frac{648+440}{20} =54.4\text{ points}. \]
The missing-pattern prediction centers have mean 52 and variance 20 square points: their four distinct values, 46, 50, 54, and 58, each occur twice. Under each delta, the residual variance is \(5^2=25\) square points, so the predictive-mixture variance is \(25+20=45\) square points and its standard deviation is \(\sqrt{45}=6.708\) points. The three scenarios shift the mixture’s location but, under the assumed common additive shift, leave this spread unchanged.
Checks, Alternatives, and Limitations
Before interpreting a calculation, check the fitted reference model over the covariate range of the missing participants, the direction and units of delta, and the plausibility of every adjusted prediction. These checks do not establish that the missing outcomes truly follow the shifted distribution; they can reveal when the proposed scenario or its reference model is unsuitable. Model diagnostics and implausible predictions are important because a perfectly executed shift can still be applied to poor predictions.
A frequent mistake is to add delta to the overall mean, or to the observed outcomes, instead of to the missing-pattern predictions. If \(\delta=-3\) points and 40% of outcomes are missing, the missing-pattern mean shifts by \(-3\) points, whereas the overall mean shifts by \(0.40(-3)=-1.2\) points. Only the missing pattern receives the full shift. Another mistake is to treat \(\hat m(x)+\delta\) as a stochastic individual draw; it is the conditional mean, and stochastic imputation also requires residual variation.
Delta adjustment is not the only way to handle missing outcomes. Complete-case analysis excludes the missing pattern and can target a different population summary. Conditional-mean imputation gives missing participants predictions without residual variation. Stochastic multiple imputation adds predictive variation and can propagate reference-model uncertainty, while the delta specifies the sensitivity shift applied to the missing pattern. A selection-model analysis instead specifies missingness conditional on the outcome; it is a different modeling route, not a reason to interpret delta as an observed-data estimate.
The additive model is limited when the departure from the reference distribution varies across covariates, when a shift also changes variance or shape, or when a constant shift violates the outcome’s feasible range. A fixed fitted model and delta also omit uncertainty in the fitted coefficients and residual scale unless that uncertainty is explicitly propagated. Accordingly, report the reference model, the delta and its units, the pattern-specific summaries, and whether summaries reflect conditional means, stochastic imputations, or predictive distributions.
Check Your Understanding
Answer each question, then compare with the solutions below.
- A reference prediction is 70 points and \(\delta=-4\) points. What is the adjusted conditional mean, and what does it mean if the imputation also includes a residual draw?
- There are 30 participants, 10 with missing outcomes. Their reference predictions average 18 units, and \(\delta=2\) units. The observed-pattern mean is 20 units. Find the missing-pattern mean and the overall pattern-weighted mean.
- A missing-pattern predictive mixture has residual variance 9 square units and variance 4 square units among its predicted means. Find its variance and standard deviation under a common additive delta.
- Why can the standard deviation of a point-filled completed data set be smaller than the predictive-mixture standard deviation?
Solutions. (1) The adjusted conditional mean is \(70+(-4)=66\) points. A stochastic imputation adds a residual draw to 66, so its realized value need not equal 66. (2) The missing-pattern mean is \(18+2=20\) units. The overall mean is \(\{20(20)+10(20)\}/30=600/30=20\) units. (3) The mixture variance is \(9+4=13\) square units and its standard deviation is \(\sqrt{13}=3.606\) units. A common additive delta changes neither component of this variance. (4) Point filling inserts conditional means but omits residual variation among missing outcomes. The predictive mixture includes that residual variation as well as variation among predicted means.