Why Adjustment Order Matters
When several variables have missing values, a delta adjustment to one variable can affect the imputation of another. The effect arises when the later conditional model uses the earlier variable as a predictor. Thus, it is not enough to specify a delta for each variable in isolation: the imputation sequence determines which adjusted values are available when each conditional model is used.
This tutorial focuses on that sequence. It does not imply that changing the order must change the final result. In a well-behaved chained-equation procedure with compatible conditional models, different update orders can target the same joint distribution. But adjusted conditionals need not correspond to a compatible joint distribution, and finite chains can also show order-dependent behavior. The practical question is therefore whether and how the specified sequence changes the imputations and conclusions.
Each delta must be interpreted on the scale of its conditional model. For a continuous outcome modeled on its original scale, an additive \(\delta_Y\) shifts its conditional mean by that amount. For a binary variable, an adjustment may instead be defined on the log-odds or probability scale. The deltas for different variables may therefore have different units and meanings; they should not be added directly unless their scales make that operation meaningful.
A Linear Derivation of the Propagated Shift
Consider a simple conditional model for a continuous \(Y\), measured in mmHg, given a continuous \(X\):
Suppose an MAR reference draw for a missing \(X\) is \(x^{\mathrm{MAR}}\), and its additive adjustment is \(\delta_X\). The adjusted draw is \(x^{\mathrm{adj}}=x^{\mathrm{MAR}}+\delta_X\). If the conditional model for \(Y\) is updated afterward, and its own additive adjustment is \(\delta_Y\), then the conditional mean used for missing \(Y\) is
The difference from the MAR conditional mean before either adjustment is \(\beta\delta_X+\delta_Y\). If we compare two imputations that both use the same \(\delta_Y\), the difference attributable to changing \(X\) is only \(\beta\delta_X\): the \(Y\) adjustment is common to both. This distinction prevents a common error in describing sequential effects.
This calculation concerns the conditional mean. In a stochastic imputation, parameter uncertainty and residual variation remain; the formula does not mean every individual draw changes by exactly the same amount in every fitted model. The calculation also assumes the stated linear conditional mean is appropriate over the relevant values of \(X\), and that the adjustment to \(Y\) is additive on the model’s outcome scale.
Worked Example: Propagation Through a Conditional Mean
Suppose a hypothetical study records a predictor \(X\), measured in units, and an outcome \(Y\), measured in mmHg. For illustration, take the MAR conditional mean to be \(E(Y\mid X)=50+2X\). For a record with missing \(X\), the MAR draw is 10 units. Apply \(\delta_X=-3\) units, then impute missing \(Y\) with \(\delta_Y=-4\) mmHg.
First adjust \(X\): \(x^{\mathrm{adj}}=10+(-3)=7\) units. The later conditional mean before the \(Y\) adjustment is \(50+2(7)=64\) mmHg. After applying the \(Y\) adjustment, it is \(64+(-4)=60\) mmHg.
For comparison, retaining the MAR draw \(X=10\) but applying the same \(Y\) adjustment gives \(50+2(10)-4=66\) mmHg. The sequential result is therefore \(60-66=-6\) mmHg lower because the \(X\) shift changes the later conditional mean by \(2(-3)=-6\) mmHg. The common \(-4\) mmHg adjustment to \(Y\) does not contribute to this difference. Relative to the MAR conditional mean before either adjustment, which is \(50+2(10)=70\) mmHg, the sequential result is \(60-70=-10\) mmHg: the two shifts contribute \(-6\) and \(-4\) mmHg.
This is a conditional-mean calculation, not a claim that all imputed \(Y\) values equal their conditional means. Actual draws would also include the model’s parameter and residual variation.
What the Update Sequence Does
In a chained-equation sweep, each incomplete variable is updated from its conditional model using the current values of the other variables. With an order \(X\) then \(Y\), the imputation of missing \(Y\) can use the newly updated, delta-adjusted \(X\). With an order \(Y\) then \(X\), the \(Y\) update uses the current \(X\) values before the new \(X\) update. The two sequences therefore use different predictor values during that sweep whenever the relevant values change.
State each conditional model, its predictors, and the scale and value of its delta. Use the same observed data and missingness pattern across the sensitivity scenarios being compared.
Draw missing values from its conditional model and apply its adjustment to those missing values. Leave observed values unchanged.
Fit or use its conditional model, draw its missing values, and apply its own adjustment. Its predictors include the most recently available values, including earlier adjusted draws.
Continue sweeps as required by the imputation procedure. Check mixing and stability, and examine whether conclusions are sensitive to the chosen adjustment sequence.
Worked Example: A Single Sweep Under Two Orders
Consider hypothetical continuous variables \(X\) and \(Y\), with \(Y\) measured in mmHg. Let the conditional mean be \(E(Y\mid X)=30+1.5X\). For a record, suppose the current MAR reference value of \(X\) is 8 units, \(\delta_X=+2\) units, and \(\delta_Y=-5\) mmHg. Compare the \(Y\) update in one sweep under the two possible orders.
Order \(X\) then \(Y\). The adjusted \(X\) value is \(8+2=10\). The conditional mean for \(Y\) before its own adjustment is \(30+1.5(10)=45\) mmHg. Applying \(\delta_Y\) gives \(45-5=40\) mmHg.
Order \(Y\) then \(X\). The \(Y\) update uses the current \(X=8\), so its conditional mean before adjustment is \(30+1.5(8)=42\) mmHg. After \(\delta_Y\), it is \(42-5=37\) mmHg. The \(X\) update later in that sweep changes \(X\) to 10, but does not retroactively change the \(Y\) value already drawn.
The \(Y\) results at the end of this sweep differ by \(40-37=3\) mmHg, equal to the change in its conditional mean from the \(X\) shift: \(1.5(10-8)=3\) mmHg. The \(-5\) mmHg \(Y\) adjustment is common to both orders and cancels in the comparison. In the next sweep, an order that updates \(Y\) after \(X\) can use \(X=10\); this one-sweep calculation alone does not establish the long-run behavior of the chains.
Missingness Patterns and Which Values Are Adjusted
A delta applies only to imputations for the variable to which it belongs. If \(X\) is observed, its value is not shifted by \(\delta_X\), even when \(Y\) is missing. If \(Y\) is observed, it remains observed even when an earlier adjustment changes the value of an \(X\) predictor. The conditional model for a missing variable can still use observed or imputed predictor values as appropriate.
Worked Example: Applying Deltas Only to Missing Cells
Suppose the hypothetical conditional mean is \(E(Y\mid X)=10+4X\), with \(Y\) measured in outcome units. Set \(\delta_X=-2\) units and \(\delta_Y=+3\) outcome units. Consider three records, each with a current reference value or observed value \(X=5\).
Record A: both \(X\) and \(Y\) are missing. Suppose the MAR reference draw for \(X\) is 5. Its adjusted value is \(5-2=3\). The conditional mean for \(Y\) is then \(10+4(3)=22\), and the adjusted conditional mean is \(22+3=25\) outcome units.
Record B: \(X\) is observed and \(Y\) is missing. The observed \(X=5\) stays at 5; \(\delta_X\) is not applied. The conditional mean is \(10+4(5)=30\), and the adjusted mean for missing \(Y\) is \(30+3=33\) outcome units.
Record C: \(X\) is missing and \(Y\) is observed at 28. The \(X\) imputation can be adjusted from 5 to 3, but the observed \(Y=28\) remains 28. Replacing it with \(10+4(3)+3=25\) would incorrectly alter observed data.
Assumptions, Diagnostics, and Limitations
Sequential delta adjustment is a sensitivity analysis, not a way to identify the unobserved values from the observed data alone. Its interpretation depends on the stated reference conditional models and on the chosen deltas. The reference models should include appropriate predictors and represent the intended MAR reference analysis; the sensitivity parameters should have meaningful scales and signs. Conditional models must also be suitable for their variable types, and adjustments must preserve valid values where relevant.
The order comparison is informative only when the update is implemented as described. A delta adjustment must be applied at the intended stage, and downstream conditional models must use the adjusted current values. If software applies the shifts only after completing all imputations, those shifts cannot affect earlier or later conditional draws within that sweep.
- Check chain behavior. Inspect trace plots or other appropriate convergence summaries for imputed quantities and analysis estimates. Poor mixing, drift, or persistent dependence on starting values makes a sequential comparison unreliable.
- Check conditional predictions. Look for implausible values, sparse predictor regions, extrapolation, or instability in the conditional model after earlier variables are shifted.
- Compare sequences deliberately. Repeat the sensitivity analysis with the specified alternative update order while holding the reference models, deltas, observed data, and other settings fixed. Distinguish differences within a sweep from differences in stabilized imputations and estimates.
- Check scale and constraints. A shift appropriate on one scale may be inappropriate on another. For example, an additive shift can produce values outside a variable’s allowable range unless the model and adjustment account for that constraint.
There is no general rule that an order effect is evidence of a coding error. It can arise from the way conditional models interact, from finite-chain behavior, or because separately adjusted conditionals are not compatible with a single joint distribution. Conversely, finding little order sensitivity does not establish that the deltas are correct or that the missingness assumptions are true. The results describe consequences of the specified assumptions, not proof of them.
A practical comparison is between a joint sequential implementation and adjustments made independently to completed variable draws. Independent post-processing may be useful for a stated sensitivity question, but it cannot propagate an adjusted predictor into a later conditional imputation. Sequential adjustment does propagate that value; it also makes the update sequence and chain diagnostics especially important.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions.
- For \(E(Y\mid X)=12+0.8X\), a missing \(X\) has MAR draw 20 and \(\delta_X=-5\). If missing \(Y\) has \(\delta_Y=+2\), what is the adjusted conditional mean? How much lower is it than the result using the same \(\delta_Y\) but no \(X\) shift?
- Why can the \(Y\) imputation at the end of one sweep differ when the order changes from \(X\)-then-\(Y\) to \(Y\)-then-\(X\)?
- If \(X\) is observed and \(Y\) is missing, should \(\delta_X\) alter \(X\)? Explain.
- Does a difference between update orders in one sweep prove that the chains have different long-run distributions? Why or why not?
Solutions. (1) The adjusted \(X\) is \(20-5=15\). The conditional mean before the \(Y\) shift is \(12+0.8(15)=24\); after the shift it is \(24+2=26\), in \(Y\) units. Without the \(X\) shift but with the same \(\delta_Y\), it is \(12+0.8(20)+2=30\). Thus the sequential result is \(26-30=-4\) units lower, matching \(0.8(-5)=-4\); the common \(+2\) shift cancels. (2) In the first order, the \(Y\) model can use the newly adjusted \(X\); in the second, it uses the current \(X\) before that sweep’s update. (3) No. The delta for \(X\) shifts imputations of missing \(X\), not observed values; the observed \(X\) can still predict missing \(Y\). (4) No. A one-sweep difference is not a result about long-run behavior. Further iterations, chain convergence, and whether the adjusted conditional models are compatible all matter.