Tutorials › Pattern-Mixture and Selection Models › Delta Adjustment as a Pattern-Mixture Sensitivity Parameter

Delta Adjustment and Its Assumptions · Tutorial 308 of 499

Delta Adjustment as a Pattern-Mixture Sensitivity Parameter

Learn to define a delta-indexed family of missing-outcome distributions, interpret its reference point, and trace how alternative assumptions affect an estimand.

Advanced 11 min read

What You'll Learn

  • Define a reference distribution and a delta-indexed family of alternatives for missing outcomes.
  • Distinguish a sensitivity parameter from a quantity identified by observed data.
  • Derive an overall mean by combining pattern-specific means with pattern probabilities.
  • Calculate how alternative missing-outcome distributions change a summary or treatment contrast.
  • Check whether a delta specification is coherent, interpretable, and clinically plausible.
  • Compare delta adjustments with reference-based assumptions and selection-model approaches.

Why Parameterize a Departure?

A pattern-mixture analysis describes outcomes separately for groups defined by their missingness patterns. For people whose outcome is missing, the data alone do not reveal the distribution of that outcome. An analysis must therefore specify, directly or indirectly, what that distribution would be. A delta sensitivity parameter gives a structured way to describe departures from a chosen reference distribution, rather than treating that reference as the only possibility.

The reference distribution is a starting assumption, not an observed fact about people with missing outcomes. Delta labels or indexes alternative distributions relative to it. The parameter can concern a whole distribution, not just its mean: an alternative may differ in location, spread, shape, or other features. No universal numerical scale or sign convention follows from the word “delta”; these depend on how the family of alternatives is defined.

Definition: Let \(R\) denote a missingness pattern, \(Y_{\mathrm{mis}}\) the outcome values missing under that pattern, and \(H\) the observed information used to describe those outcomes (such as observed outcomes and covariates). Let \(Q_0(\,\cdot\mid H,R)\) be a specified reference distribution for \(Y_{\mathrm{mis}}\). A delta-indexed family \(Q_\delta(\,\cdot\mid H,R)\) is a collection of alternative conditional distributions indexed by a sensitivity parameter \(\delta\). A common convention is \(Q_{\delta=0}=Q_0\). Values other than zero represent departures as defined by the chosen family; they do not have a universal interpretation without that definition.

The notation allows \(\delta\) to be scalar for a simple sensitivity analysis, but the family must still be explicit: one needs to know which distributions its values select. In particular, \(\delta\) is not automatically an additive change in outcome units, nor must it move every feature of a distribution in the same way. Those are possible choices of parameterization, not part of the general definition.

A valid \(Q_\delta\) must be a probability distribution on plausible outcome values, conditional on the stated information and pattern. It should also be clear whether the same family applies across patterns and covariate histories. The sensitivity analysis then compares conclusions under specified values of \(\delta\), including the reference value, rather than pretending that the missing outcomes have been observed.

How Delta Enters a Pattern-Mixture Summary

For clarity, consider a single outcome \(Y\) and two patterns: observed outcome and missing outcome. Let \(R=1\) indicate that \(Y\) is observed and \(R=0\) that it is missing. The pattern probabilities are \(P(R=1)\) and \(P(R=0)\). The observed-pattern distribution can be summarized from observed data; the missing-pattern distribution is supplied by the reference assumption and its delta alternatives.

The overall mean under a specified \(\delta\) follows from conditioning on the pattern. Provided the outcome has a finite mean in each pattern, the law of total expectation gives:

$$ E_\delta(Y) = P(R=1)E(Y\mid R=1) + P(R=0)E_\delta(Y\mid R=0). $$

This identity is a mixture calculation, not an extra missing-data assumption. The sensitivity assumption enters through \(E_\delta(Y\mid R=0)\), which is the mean implied by \(Q_\delta\). The pattern probability and the observed-pattern mean also need to be estimated or specified appropriately; the formula does not make those quantities known.

Justification: Write \(Y=Y\mathbf{1}(R=1)+Y\mathbf{1}(R=0)\), where \(\mathbf{1}(\cdot)\) is an indicator. Taking expectation under the distribution indexed by \(\delta\), and using \(E[Y\mathbf{1}(R=r)]=P(R=r)E(Y\mid R=r)\) for each pattern with positive probability, yields the displayed mixture formula.

With several missingness patterns, the same reasoning sums across them: each pattern-specific mean is weighted by the probability of that pattern. With covariates or observed histories, the conditional distribution is indexed by that information and the relevant quantities must be averaged over its distribution. A delta specification therefore needs to say what information conditions the reference and alternative distributions, not merely give a number.

Worked Example: A Discrete Reference Distribution and Two Departures

Suppose, hypothetically, that 70% of participants have an observed endpoint with mean 12 points, while 30% have a missing endpoint. The reference distribution for a missing endpoint assigns probabilities 0.20, 0.50, and 0.30 to 4, 8, and 12 points, respectively. For this example, define \(\delta=0\) as that reference and \(\delta=1\) and \(\delta=2\) as two explicitly specified alternatives. These labels are scenario indices, not equal-sized steps on a universal scale.

ScenarioProbability at 4Probability at 8Probability at 12
\(\delta=0\), reference0.200.500.30
\(\delta=1\)0.300.500.20
\(\delta=2\)0.400.500.10

Each row is a valid distribution: its probabilities are nonnegative and sum to 1. The mean missing endpoint under the reference is \(0.20(4)+0.50(8)+0.30(12)=0.80+4.00+3.60=8.40\) points. Under \(\delta=1\), it is \(0.30(4)+0.50(8)+0.20(12)=1.20+4.00+2.40=7.60\) points. Under \(\delta=2\), it is \(0.40(4)+0.50(8)+0.10(12)=1.60+4.00+1.20=6.80\) points.

The overall means are therefore \(0.70(12)+0.30(8.40)=8.40+2.52=10.92\) points for \(\delta=0\), \(0.70(12)+0.30(7.60)=8.40+2.28=10.68\) points for \(\delta=1\), and \(0.70(12)+0.30(6.80)=8.40+2.04=10.44\) points for \(\delta=2\). In this constructed family, higher scenario indices move probability toward lower values. That direction is a property of the table, not a general rule about delta.

Assumptions and Interpretation

A delta analysis is meaningful only when its ingredients are stated. At minimum, specify the outcome and missingness patterns, the information \(H\) conditioning the missing-outcome distribution, the reference distribution \(Q_0\), and the family \(Q_\delta\). State which values of \(\delta\) are examined and what each means in that family. If pattern probabilities or the observed-pattern distribution are estimated, the analysis also relies on those estimates being suitable for the target population and estimand.

The reference distribution must be a defensible benchmark for the target pattern and conditioning information. A departure family should preserve the outcome’s support and produce coherent distributions for relevant histories. For example, probabilities must remain between 0 and 1 and sum to 1; a distribution for a bounded outcome must not assign probability outside its allowable range. These checks apply to every scenario, not only the reference.

Crucially, observed outcomes generally do not identify the distribution of outcomes that are missing. Delta is therefore a sensitivity parameter, not an ordinary model coefficient that the observed data can estimate without further assumptions. Data can inform the reference model and observed portions of the analysis, but selecting among plausible departures requires substantive judgment or external information. Reporting a single delta value as if the data established it overstates what is learned.

Worked Example: Conditional Distributions Across Two Histories

Suppose, hypothetically, that 40 participants have missing outcomes: 25 with a lower baseline score and 15 with a higher baseline score. A specified reference model gives missing-outcome means of 6 and 10 points in the two groups. Consider a defined sensitivity scenario \(\delta=1\) under which the corresponding conditional distributions have means of 5 and 8 points. Assume the group counts describe the target missing pattern and that these conditional means apply to the participants in their respective groups.

The mean among participants with missing outcomes under this scenario is the weighted average of the two conditional means: \((25/40)(5)+(15/40)(8)=3.125+3.000=6.125\) points. At the reference, the corresponding mean is \((25/40)(6)+(15/40)(10)=3.750+3.750=7.500\) points.

Thus this specified alternative lowers the missing-pattern mean by \(7.500-6.125=1.375\) points relative to the reference. The calculation preserves the observed composition of the missing pattern across baseline groups. Simply averaging 5 and 8 to obtain 6.5 points would be wrong because the groups have different sizes. This example also shows why a delta specification must state how it applies conditional on observed history; an unqualified marginal number may hide important differences.

Comparing Scenarios and Diagnosing Problems

The purpose of varying \(\delta\) is to show how conclusions depend on unobserved-outcome assumptions. A useful report gives the reference result alongside alternative scenarios and explains the substantive meaning of each. Where an estimand is a contrast, compute it under each scenario using the same target population and clearly stated assumptions. Do not describe one scenario as empirically confirmed merely because its result is more desirable or statistically significant.

Worked Example: Sensitivity of a Treatment Contrast

Consider a hypothetical treatment group with 60% observed outcomes averaging 15 points and 40% missing outcomes. A control-group mean of 11 points is treated as fixed for this illustration. Suppose the reference missing-outcome distribution in the treatment group has mean 12 points, and three specified alternative distributions have means 10, 8, and 6 points. Each alternative is a complete assumed distribution; only its mean is needed for this calculation.

Under the reference, the treatment-group mean is \(0.60(15)+0.40(12)=9.00+4.80=13.80\) points, so the treatment-minus-control contrast is \(13.80-11=2.80\) points. For the first alternative, the treatment mean is \(0.60(15)+0.40(10)=9.00+4.00=13.00\), giving a contrast of \(13.00-11=2.00\) points. For the next, it is \(0.60(15)+0.40(8)=9.00+3.20=12.20\), giving \(1.20\) points. For the last, it is \(0.60(15)+0.40(6)=9.00+2.40=11.40\), giving \(0.40\) points.

These calculations show how this particular set of missing-outcome assumptions changes the point estimate. They do not account for sampling uncertainty, establish that any scenario is true, or by themselves provide a confidence interval or test. A full analysis must address uncertainty in estimated quantities as well as sensitivity to the assumed distributions.

Several checks help identify a specification that may be going wrong. Confirm that every proposed distribution is normalized and respects the outcome’s support. Compare its implied summaries and shape with observed outcomes and relevant external knowledge, while recognizing that observed outcomes cannot verify the missing-outcome distribution. Examine whether conditional distributions vary implausibly across histories or whether small changes in delta create abrupt, unexplained changes in the estimand. Such patterns can indicate a poorly chosen parameterization, unstable estimation, or a scenario that lacks substantive credibility.

Delta sensitivity analysis is related to, but distinct from, other approaches. Reference-based imputation specifies a particular reference rule for missing outcomes; a delta family can be used to examine departures from a chosen reference. A selection model instead describes how the probability of being observed depends on outcome information. These approaches encode missingness assumptions differently, and results need not agree. Delta analysis does not remove the need to justify a reference or guarantee robustness; it makes selected departures explicit so their consequences can be assessed.

Common Pitfalls and Limits

  • Assuming delta has a universal meaning. The correction is to define the reference point and the family \(Q_\delta\) before interpreting a value. A positive value might indicate a particular departure in one parameterization and something different in another.
  • Changing only a summary while leaving the distribution undefined. A mean alone does not specify tails, spread, or support. If the analysis requires draws or distributional probabilities, define a full valid distribution rather than only a target mean.
  • Treating delta as estimated from the observed outcomes. Its role is to index assumptions about missing outcomes that are not identified by those outcomes. Separate data-estimated quantities from sensitivity choices in both analysis and reporting.
  • Ignoring conditioning and pattern composition. The missing-outcome distribution can depend on observed history, and pattern weights affect the overall result. State both clearly and use the appropriate weights.
  • Calling a scenario “conservative” without specifying the target. A departure that lowers one group’s mean may not be conservative for every contrast or decision. Describe its consequences for the estimand actually being reported.
Key takeaway: Delta is a label for a defined departure from a specified reference distribution, not a universal shift or a quantity automatically learned from observed data. The family, conditioning information, and interpretation must be stated before comparing sensitivity scenarios.

Check Your Understanding

Answer each question, then compare with the brief solutions below.

  1. In a delta-indexed family, what does \(\delta=0\) mean if the analyst defines \(Q_{\delta=0}=Q_0\)? Does that make \(Q_0\) empirically verified?
  2. Suppose \(P(R=1)=0.80\), the observed-pattern mean is 9 points, and the missing-pattern mean under a specified scenario is 6 points. Find the overall mean under that scenario.
  3. Why is a marginal missing-pattern mean potentially insufficient when outcome distributions depend on baseline history?
  4. Name two checks for a proposed delta family and explain why observed data cannot usually select the true delta value.

Solutions. (1) It denotes the reference distribution by convention; it does not verify that distribution for missing outcomes. (2) \(0.80(9)+0.20(6)=7.20+1.20=8.40\) points. (3) A marginal mean can conceal different conditional distributions and will depend on the composition of histories; use the appropriate conditional distributions and weights. (4) Check that each distribution is valid and respects the outcome’s support, and assess whether its implied outcomes are substantively plausible. Outcomes that are missing are not observed to distinguish among the assumed departures, so delta is a sensitivity choice unless additional identifying information or assumptions are supplied.

Clinical Biostats