Tutorials › Pattern-Mixture and Selection Models › Common Errors in Delta Parameterization

Delta Adjustment and Its Assumptions · Tutorial 345 of 499

Common Errors in Delta Parameterization

Use a consistent definition of delta to check its direction, scale, application to missing outcomes, and role in sensitivity analysis.

Advanced 11 min read

What You'll Learn

  • Define delta as a shift to the reference-model distribution for missing outcomes.
  • Trace how the sign of delta changes an adjusted mean and a treatment contrast.
  • Distinguish additive outcome-scale shifts from shifts on a link scale.
  • Check that observed outcomes remain unchanged by a missing-data adjustment.
  • Explain why a fixed sensitivity value is not an estimated parameter.
  • Diagnose common implementation and interpretation errors.

Why Delta Parameterization Errors Matter

A delta adjustment is meaningful only when its direction, scale, and target are clearly specified. A minus sign may represent worse outcomes or better outcomes depending on the outcome’s direction; a numerical shift in outcome units is not the same as a shift in log odds; and an adjustment for missing outcomes must not alter outcomes that were observed. These distinctions are easy to lose when a sensitivity analysis is implemented across several imputation steps.

This tutorial uses one explicit convention throughout. First, a reference model predicts the distribution of an outcome for a person with missing data, conditional on the information included in that model. Delta then shifts that reference distribution for missing outcomes only. Under this convention, positive delta means shifting the missing-outcome distribution upward on the stated scale, and negative delta means shifting it downward. Whether “upward” is clinically better depends on how the outcome is defined.

Definition: Let \(Y\) be an outcome, \(R=1\) indicate that it is observed, and \(R=0\) indicate that it is missing. Let \(X\) denote the covariates or observed history used by a reference model. On an additive outcome scale, define delta by $$ E(Y\mid X,R=0;\delta)=E_{\mathrm{ref}}(Y\mid X,R=0)+\delta. $$ Here \(E_{\mathrm{ref}}\) is the reference-model expectation, and delta is a prespecified sensitivity value in the same units as \(Y\). The observed outcomes are not shifted.

This definition does not make delta an observed-data quantity. The reference model is informed by observed data and its assumptions; delta represents an additional sensitivity assumption about outcomes that are missing. Unless a model explicitly assigns a probability distribution to delta and estimates it, a chosen delta value is fixed for that sensitivity analysis.

Trace the Sign Before Doing the Arithmetic

For an outcome where higher values are better, a negative delta says that missing outcomes are assumed to be worse than their reference-model predictions. For an outcome where lower values are better, the same negative delta says the missing outcomes are assumed to be better. The sign has no clinical interpretation without the outcome’s direction and the stated definition of the shift.

A useful check is to write the defining equation before entering a delta value into software. If the intended assumption is that missing outcomes are worse on a higher-is-better scale, the adjusted expectation should be less than the reference expectation. This simple inequality catches sign reversals before they affect a treatment comparison.

Worked Example: Reversing the Shift Sign

Suppose a higher continuous score means better health. In a hypothetical study, the reference-model means for missing outcomes are 9 points in the treatment arm and 8.5 points in the control arm. The observed-data means are 10 and 8 points, respectively. Twenty percent of treatment outcomes and 25% of control outcomes are missing. The sensitivity assumption is that missing outcomes are 2 points worse than their reference predictions, so \(\delta=-2\) points in both arms.

The adjusted missing-outcome means are \(9+(-2)=7\) points for treatment and \(8.5+(-2)=6.5\) points for control. Combining observed and adjusted missing outcomes gives the treatment mean $$ 0.80(10)+0.20(7)=8+1.4=9.4\text{ points} $$ and the control mean $$ 0.75(8)+0.25(6.5)=6+1.625=7.625\text{ points}. $$ The adjusted treatment-minus-control contrast is \(9.4-7.625=1.775\) points.

If the sign is mistakenly reversed, the missing-outcome means become \(9+2=11\) and \(8.5+2=10.5\) points. The resulting arm means are \(0.80(10)+0.20(11)=10.2\) and \(0.75(8)+0.25(10.5)=8.625\), for a contrast of \(1.575\) points. Both calculations are arithmetically valid, but the second does not implement the stated assumption of worse missing outcomes. The direction check is \(9-2<9\) and \(8.5-2<8.5\).

The Scale Is Part of the Parameterization

A delta value has units, even when those units are not immediately visible. For a continuous outcome, an additive delta may be measured in points, kilograms, or another outcome unit. For a binary outcome, a shift can instead be defined on the probability scale or on a link scale such as the logit. Those are different parameterizations: the same numerical value does not have the same meaning across scales.

For example, a logit-scale delta adds to the reference-model log odds. If the reference probability is \(p_{\mathrm{ref}}\), then the adjusted probability is $$ p_{\delta}=\frac{\exp\{\operatorname{logit}(p_{\mathrm{ref}})+\delta\}}{1+\exp\{\operatorname{logit}(p_{\mathrm{ref}})+\delta\}}. $$ Equivalently, delta multiplies the reference odds by \(\exp(\delta)\). It does not add directly to the probability.

Worked Example: Applying Delta on the Wrong Scale

Suppose a hypothetical binary outcome has reference-model probability \(p_{\mathrm{ref}}=0.60\) for a missing case. Define delta on the logit scale and set \(\delta=-0.8\). The reference odds are \(0.60/(1-0.60)=1.5\). The adjusted odds are $$ 1.5\exp(-0.8)=1.5(0.4493)=0.6740. $$ Converting back to a probability gives $$ p_{\delta}=\frac{0.6740}{1+0.6740}=0.4026. $$ Thus this logit-scale shift changes the reference probability from 0.60 to about 0.403.

Subtracting 0.8 directly from 0.60 would give \(-0.20\), which is not a valid probability. Even when a probability-scale shift is numerically possible, it is a separate assumption. For instance, a probability-scale shift of \(-0.20\) would give \(0.60-0.20=0.40\), a similar value here by coincidence, but it is not the same parameterization. The calculation must follow the scale stated in the model.

For binary data, a probability-scale shift must also keep adjusted probabilities between 0 and 1 for the cases to which it is applied. A constant logit-scale shift keeps probabilities within that interval automatically, although it may still imply implausible probabilities. For bounded continuous outcomes, an additive shift can also produce values outside the possible range; feasibility must be checked rather than assumed.

Apply the Adjustment to Missing Outcomes Only

The reference prediction and its delta adjustment describe the distribution assigned to outcomes that were not observed. They do not revise an observed measurement. In longitudinal settings, this means an observed visit remains observed at its recorded value; delta affects a missing visit’s imputed distribution, conditional on the information the model uses. A later missing visit can be adjusted without changing an earlier observed visit.

The consequence for an overall mean follows directly from averaging observed and missing outcomes. Write \(q=P(R=0)\) for the missing fraction, \(\mu_{\mathrm{obs}}=E(Y\mid R=1)\), and \(\mu_{\mathrm{ref,mis}}=E_{\mathrm{ref}}(Y\mid R=0)\). Under an additive delta applied to missing outcomes, $$ E(Y;\delta)=(1-q)\mu_{\mathrm{obs}}+q(\mu_{\mathrm{ref,mis}}+\delta) =E(Y;0)+q\delta. $$ The observed component has no delta term. For a treatment-minus-control contrast, the corresponding shift is \(q_T\delta_T-q_C\delta_C\). This identity is also a useful implementation check: shifting all outcomes rather than missing outcomes would not produce the stated adjustment.

Worked Example: Shifting an Observed Visit by Mistake

In a hypothetical longitudinal study, a participant has an observed baseline score of 50 points and an observed week-4 score of 62 points. Another participant has an observed baseline score of 50 points but a missing week-4 score. The reference model predicts 58 points at week 4 for the second participant, given the available history. Higher scores mean better health, and the prespecified week-4 sensitivity value is \(\delta=-5\) points.

For the participant with a missing week-4 score, the adjusted prediction is \(58+(-5)=53\) points. The first participant’s observed week-4 score remains 62 points. A procedure that subtracts 5 from both week-4 scores would change the observed value to 57 points, despite there being no missing outcome for that participant. That procedure does not implement a missing-outcome delta adjustment.

The check is to identify which values are observed and which are imputed before applying the shift. Here, only the missing week-4 value changes from its reference prediction, 58, to 53 points. The baseline values and the observed week-4 value remain as recorded.

A Fixed Sensitivity Value Is Not an Estimated Parameter

In a fixed-delta sensitivity analysis, the analyst chooses delta (or a set of values) to represent assumptions not identified by the observed outcomes. The imputation model may estimate regression coefficients, residual variation, or other quantities from observed data, but those estimates do not turn the chosen delta into an estimated parameter. At each fixed delta, uncertainty in the reference model and the completed-data analysis can still be represented according to the analysis method.

In multiple imputation, the same fixed delta is used for each imputation in a given sensitivity analysis. Imputed values can vary across imputations because the reference-model parameters and imputation draws vary. That variation is not evidence that delta itself has been estimated. If several delta values are examined, they define separate sensitivity analyses; they should not be averaged together as though they were repeated estimates of one unknown delta unless a separate probabilistic model for delta has been specified.

Worked Example: Keeping Delta Fixed Across Imputations

Suppose a hypothetical multiple-imputation analysis uses a continuous outcome measured in points. The sensitivity choice is fixed at \(\delta=-3\) points. Three completed data sets produce treatment-minus-control estimates of 2.4, 2.0, and 2.3 points after applying that same shift to missing outcomes.

The average estimate is $$ \bar{Q}=\frac{2.4+2.0+2.3}{3}=\frac{6.7}{3}=2.233\text{ points}. $$ The estimates differ because the imputed data differ across completed data sets, not because the sensitivity value changed. The delta used in each is still \(-3\) points. A second analysis at, for example, \(\delta=-5\) points would be a different fixed-delta sensitivity analysis, not another draw from an estimated delta distribution.

A common mistake is to report the spread across analyst-selected delta values as if it were the sampling uncertainty of an estimated parameter. That spread describes how the result responds to alternative assumptions. It should be distinguished from uncertainty calculated within a single fixed-delta analysis.

Derivation and Practical Checks

The overall-mean identity above follows from conditioning on whether the outcome is observed. Because \(R\) takes the values 0 and 1, the law of total expectation gives

$$ E(Y;\delta)=P(R=1)E(Y\mid R=1)+P(R=0)E(Y\mid R=0;\delta). $$

With \(P(R=0)=q\), \(P(R=1)=1-q\), and the definition \(E(Y\mid R=0;\delta)=\mu_{\mathrm{ref,mis}}+\delta\), substitution yields

$$ E(Y;\delta)=(1-q)\mu_{\mathrm{obs}}+q\mu_{\mathrm{ref,mis}}+q\delta =E(Y;0)+q\delta. $$

This derivation assumes the additive shift is applied to the missing-outcome expectation, the observed-outcome distribution is left unchanged, and \(q\) is the relevant missing fraction. For covariate-specific shifts, the analogous adjustment is averaged over the covariate distribution among missing cases; it need not equal \(q\) times one constant unless delta is constant.

Before trusting a result, check the implementation in a small, inspectable set of records. Confirm that each shifted value belongs to a missing outcome, that its scale matches the stated delta, and that its direction agrees with the clinical assumption. Compare the adjusted and reference predictions for a few cases. Also check for impossible values, unexpected changes to observed records, and discrepancies between the claimed and implemented delta.

How This Choice Relates to Alternatives

A zero delta on the stated scale reproduces the reference-model assumption for missing outcomes. A nonzero fixed delta departs from that reference assumption in a transparent, specified way. Other delta values can be considered to assess sensitivity, but each value must retain the same definition and scale for comparisons to be interpretable.

A delta adjustment is one way to represent assumptions about missing outcomes. Selection models instead represent missingness through a model for the probability of observation conditional on outcomes and other information. These approaches parameterize different parts of the joint distribution and their parameters should not be treated as interchangeable. Whichever approach is used, the assumptions about unobserved outcomes are not diagnosed solely from observed data; the purpose of sensitivity analysis is to examine conclusions under explicit alternatives.

Key takeaway: Write the delta equation, name its scale and units, state which outcomes receive the shift, and label the value as fixed or estimated. A numerical result is interpretable only if all four choices agree with the intended assumption.

Check Your Understanding

Answer each question, then compare with the solutions.

  1. On a higher-is-better outcome scale, the reference prediction for a missing value is 24 points. What does \(\delta=-4\) imply, and what adjusted prediction does it give?
  2. A binary reference probability is 0.30 and delta is defined on the logit scale as \(0.5\). Should the adjusted probability be calculated as \(0.30+0.5\)? State the correct transformation.
  3. A participant’s outcome is observed as 18 points. Under an additive missing-outcome delta of \(-2\) points, should that value be changed? Explain.
  4. In five imputations, a fixed delta of \(-1.5\) points is used, and the completed-data estimates vary. Has delta been estimated from those five estimates?

Solutions. (1) The assumption is that the missing outcome is 4 points below its reference prediction; the adjusted prediction is \(24+(-4)=20\) points. (2) No. The shift is applied to the logit: \(p_{\delta}=\operatorname{expit}\{\operatorname{logit}(0.30)+0.5\}\), which is approximately \(\operatorname{expit}(-0.3473)=0.4141\). (3) No. The value is observed, so it remains 18 points; delta applies to missing outcomes. (4) No. Delta remains fixed at \(-1.5\) points in each imputation. Variation in completed-data estimates reflects imputation and analysis variation under that fixed assumption.

Clinical Biostats