Why Adjust Imputations?
Multiple imputation under a missing-at-random assumption supplies draws for missing values from a predictive distribution informed by observed data. That assumption is often a useful starting point, but it cannot be verified from the observed data alone. A sensitivity analysis asks a focused question: how would the result change if, within a missingness pattern, missing outcomes tended to differ from their missing-at-random predictions?
A pattern-mixture model describes the outcome distribution separately for each pattern of observed and missing variables. A delta adjustment modifies the conditional distribution used to impute missing values in a specified pattern. The delta is a sensitivity parameter: it describes a departure from the MAR imputation model rather than an effect estimated from the observed data.
The pattern \(R\) can encode which variables are observed, not merely whether \(Y\) is observed. In the simple case of one incomplete outcome, it is often enough to distinguish responders from nonresponders. With multiple incomplete variables, different patterns can receive different adjustments. The adjustment is applied conditional on the observed information used by the imputation model, such as \(X\) and any observed components of \(Y\).
What the Observed Data Can and Cannot Identify
For a pattern in which some outcome values are missing, write its conditional distribution as \(f(y_{\mathrm{obs}},y_{\mathrm{mis}}\mid r,x)\). It can be factored into the observed-data distribution and a conditional distribution for the missing part:
The observed-data likelihood for a case in that pattern depends on \(f(y_{\mathrm{obs}}\mid r,x)\), because integrating the second factor over all possible missing values gives one. It does not identify the conditional distribution of the missing values. A delta adjustment makes a transparent choice about that unidentified part; it does not recover a parameter that the observed data estimate.
To verify the result, integrate the joint model over the missing values:
The conditional density integrates to one for every fixed \(y_{\mathrm{obs}},r,x\). The pattern probability and observed-data density are unchanged by a replacement of that conditional density. This is why a sensitivity analysis reports results across specified delta values rather than presenting a single delta as data-estimated. \(\square\)
Choosing and Applying an Adjustment
For a continuous outcome, an additive shift is easy to interpret and preserves the shape and conditional variance of each MAR predictive distribution. If \(Y_{\mathrm{mis}}^{\mathrm{MAR}}\mid y_{\mathrm{obs}},r,x\) has mean \(\mu_r\) and variance \(v_r\), then the shifted draw has mean \(\mu_r+\delta_r\) and variance \(v_r\). The change is in outcome units: for example, a shift of \(-4\) points means missing scores are assumed to average four points below their MAR predictions, conditional on the model information.
For a binary outcome, adding a constant to a zero-or-one draw is not suitable. A common alternative shifts the predicted log odds. If the MAR predicted probability is \(p\), define the adjusted probability by:
Here \(\delta\) is a log-odds shift; \(\exp(\delta)\) is the multiplicative change in odds relative to the MAR prediction. A value of zero returns the MAR probability. For counts or other restricted outcomes, the adjustment must respect the support of the outcome; the continuous additive rule should not be applied in a way that creates impossible values.
Worked Example: Shifting Continuous Imputations
Suppose two missing test scores have MAR predictive means of 70 and 80 points. In one imputation, predictive draws are 68 and 83. The analysis considers \(\delta=-5\) points for this missingness pattern.
Apply the shift to each missing draw: \(68+(-5)=63\) and \(83+(-5)=78\). The mean of these two imputed values is \((63+78)/2=70.5\). Under MAR, the corresponding draw mean was \((68+83)/2=75.5\), so this imputation’s missing-value mean has decreased by exactly 5 points.
The individual draws retain their difference: \(78-63=15\), the same as \(83-68=15\). The adjustment changes their location, not their within-imputation spread. Across multiple imputations, the predictive draws and imputation-model parameters still vary; the same fixed \(\delta\) is applied to each imputation.
Worked Example: A Binary Outcome and an Odds-Scale Shift
For nonresponders, suppose the MAR model predicts a probability of \(p=0.30\) for a binary outcome. Consider \(\delta=\log(2)\), which doubles the predicted odds.
The MAR odds are \(0.30/(1-0.30)=0.30/0.70=3/7\). After doubling, the odds are \(6/7\). Converting back to a probability gives \(p^\delta=(6/7)/(1+6/7)=6/13\), approximately \(0.462\). Equivalently, the logit formula gives \(\operatorname{logit}(p^\delta)=\log(3/7)+\log(2)=\log(6/7)\).
If there are 40 nonresponders, their adjusted expected number of positive outcomes is \(40(6/13)=240/13\), approximately \(18.46\). Under MAR, it is \(40(0.30)=12\). The expected increase is about \(6.46\), not an assertion that exactly \(6.46\) people have the outcome: binary imputation draws remain zero or one.
How Pattern-Specific Deltas Change a Population Mean
The effect of a delta on an overall mean depends both on its size and on the proportion of the population in the adjusted pattern. Let \(R\) take values \(1,\ldots,K\), let \(P(R=r)=\pi_r\), and let \(\mu_r^{\mathrm{MAR}}\) be the MAR-implied mean outcome in pattern \(r\). If the conditional mean in each pattern is shifted by \(\delta_r\), then the overall mean is:
This identity is a direct application of the law of total expectation. Conditional on \(R=r\), the adjusted mean is \(\mu_r^{\mathrm{MAR}}+\delta_r\). Averaging those conditional means using the pattern probabilities gives:
Subtracting the MAR mean \(\sum_r\pi_r\mu_r^{\mathrm{MAR}}\) proves that the change is \(\sum_r\pi_r\delta_r\). In a setting where only the nonresponding pattern is shifted, the overall mean change is the nonresponse proportion multiplied by that pattern’s delta. \(\square\)
Worked Example: Combining Two Pattern-Specific Adjustments
Suppose 70% of the population is in a pattern with a fully observed outcome and mean 50. The remaining 30% is split between two missingness patterns: pattern B has proportion 20% and MAR mean 60, while pattern C has proportion 10% and MAR mean 70. Consider \(\delta_B=-5\) and \(\delta_C=-12\); the fully observed pattern is not adjusted.
The MAR overall mean is \(0.70(50)+0.20(60)+0.10(70)=35+12+7=54\). Under the adjustments, the pattern means are 50, \(60-5=55\), and \(70-12=58\). The adjusted overall mean is \(0.70(50)+0.20(55)+0.10(58)=35+11+5.8=51.8\).
The change is \(51.8-54=-2.2\). The weighted-delta formula gives the same answer: \(0.70(0)+0.20(-5)+0.10(-12)=-1-1.2=-2.2\). This calculation makes clear why a large shift in a small pattern can have less influence on the overall mean than a smaller shift in a common pattern.
A Practical Multiple-Imputation Workflow
A delta-adjusted analysis is most useful when it is implemented as a planned set of interpretable scenarios. For each fixed scenario, retain the observed values, generate predictive imputations under the MAR model, adjust only the missing values in the designated patterns, and apply the same analysis to every completed data set. The parameter uncertainty and predictive variation in the imputations should be retained rather than replaced by fitted means.
Use observed data and appropriate predictors to generate multiple imputations, including draws that reflect uncertainty in the imputation model.
Choose the affected missingness patterns, the scale of the adjustment, and values that have a substantive interpretation. Include \(\delta_r=0\) as the MAR reference scenario.
For a continuous outcome, add \(\delta_r\) to each missing draw in pattern \(r\). For a binary outcome, shift the predicted log odds and draw from the resulting probability. Leave observed outcomes unchanged.
Estimate the target quantity and its standard error in every completed data set, then combine within that fixed scenario using Rubin’s combining rules.
Report the delta values, adjusted estimates, uncertainty intervals, and whether the substantive conclusion changes. Interpret the results as conditional on each specified departure.
Interpreting Results and Avoiding Common Errors
Rubin’s combining rules summarize uncertainty from sampling and imputation under a given imputation model and fixed sensitivity scenario. They do not express uncertainty about which delta scenario is correct. A sensitivity analysis therefore presents results across scenarios; it should not treat a range of delta values as though it were automatically incorporated into the usual multiple-imputation standard error. If substantive knowledge supports a probability distribution over delta values, that uncertainty requires an explicit additional model and analysis.
Choose delta values on a scale a reader can interpret. For a continuous outcome, relate shifts to meaningful units or a clinically relevant difference. For a binary outcome, describe the odds multiplier as well as the resulting probabilities at representative MAR risks, because the same odds shift does not produce the same probability change for every starting risk. It is also useful to identify a tipping point: a delta value at which an important conclusion, such as whether an interval includes zero, changes.
- Wrong: “The data estimate the delta.” The missing outcomes are unobserved, so their conditional distribution is not identified by the observed-data likelihood. Correction: justify delta values substantively and report the conclusions conditional on them.
- Wrong: “Shift every value in the data set.” That changes observed outcomes as well as the hypothesized missing outcomes. Correction: apply the adjustment only to missing draws in the selected patterns.
- Wrong: “Use the same numerical delta for every outcome type.” A five-unit additive shift and a five-unit log-odds shift have different meanings and scales. Correction: define the adjustment on an outcome-appropriate scale and state its interpretation.
- Wrong: “A single pooled standard error covers all sensitivity assumptions.” The standard error within a scenario does not account for uncertainty about the delta choice. Correction: show estimates and intervals across the specified scenarios.
The central benefit of delta adjustment is not that it makes the unobserved outcomes known. It exposes the consequence of a clear, interpretable departure from MAR, pattern by pattern, while preserving the observed data and the ordinary uncertainty represented within each multiple-imputation analysis.
Check Your Understanding
Use these questions to check both the interpretation and implementation of delta-adjusted pattern-mixture analyses.
- For a continuous outcome, what does \(\delta_r=-3\) mean for missing values in pattern \(r\), relative to their MAR predictive distribution?
- Why can the observed-data likelihood not estimate the conditional distribution of missing outcomes within a pattern?
- A binary MAR probability is 0.20. If the log-odds delta is \(\log(3)\), what are the adjusted odds and adjusted probability?
- If 25% of the population is in a pattern shifted by \(\delta=-8\), and no other pattern is adjusted, what is the change in the overall mean?
- Why should a sensitivity analysis report uncertainty intervals separately for each fixed delta scenario?