Tutorials › Pattern-Mixture and Selection Models › Diabetes Trial HbA1c Missing After Adverse Events

Case Studies · Tutorial 478 of 499

Diabetes Trial HbA1c Missing After Adverse Events

Work through how clinically chosen delta adjustments for HbA1c missing after adverse events change a diabetes trial’s treatment contrast, including assumptions, diagnostics, and a tipping-point calculation.

Advanced 12 min read

What You'll Learn

  • Define a missingness pattern for HbA1c outcomes missing after an adverse event.
  • Apply an additive delta to MAR-imputed outcomes in that pattern.
  • Calculate how pattern-specific missingness rates alter the treatment contrast.
  • Distinguish a clinical sensitivity assumption from an estimable parameter.
  • Find and interpret a point-estimate tipping value for delta.
  • Diagnose implausible adjustments and compare delta analysis with alternative approaches.

Why Missing HbA1c After an Adverse Event Needs a Clinical Assumption

In a diabetes trial, an adverse event may lead a participant to interrupt or stop assigned treatment, miss a visit, or withdraw from follow-up. The HbA1c measurement that would have been recorded at the endpoint is then unavailable. A model can predict that value from observed information, but the prediction relies on an assumption about the unobserved outcome. In particular, an assumption that missing outcomes are like comparable observed outcomes after conditioning on recorded history may not capture the possibility that HbA1c would have been systematically higher after an adverse event.

A delta adjustment makes that uncertainty explicit. It starts from an imputation model under missing at random (MAR), then shifts the imputed HbA1c values for a specified missingness pattern by a clinically chosen amount. The adjustment does not establish what the missing HbA1c values really were. It answers a conditional question: how would the treatment contrast change if those outcomes averaged a specified amount above or below their MAR predictions?

Definition: Let \(Y\) be endpoint HbA1c, measured in percentage points, and let \(R=1\) indicate that the endpoint is observed and \(R=0\) that it is missing. Define the pattern \(A\) as an endpoint outcome missing after a recorded adverse event. For a participant in treatment arm \(g\) with \(R=0\) and pattern \(A\), an additive delta-adjusted imputation is \(Y^{(\delta)}=Y^{(\mathrm{MAR})}+\delta_{g,A}\). Here \(Y^{(\mathrm{MAR})}\) is an imputed value from the specified MAR model, and \(\delta_{g,A}\) is a sensitivity parameter in HbA1c percentage points. A positive delta assumes the missing value is higher, on average, than its MAR prediction; a negative delta assumes it is lower.

Use the treatment-minus-control contrast throughout: \(\theta=\mu_T-\mu_C\), where \(\mu_T\) and \(\mu_C\) are the endpoint mean HbA1c values under the analysis being considered. Lower HbA1c is generally favorable, so a negative contrast favors treatment on this scale. The direction of benefit does not determine the direction of a plausible delta: an adverse event may or may not imply worse subsequent glycemic control.

Assumptions and the Contrast Shift

A practical analysis first specifies the endpoint, treatment contrast, and adverse-event pattern before choosing delta values. The MAR imputation model should use relevant observed information, such as baseline HbA1c, earlier HbA1c measurements, treatment assignment, and recorded adverse-event history, as appropriate to the trial and estimand. Within the model, the MAR assumption says that, conditional on the information included, the distribution of missing outcomes follows the distribution used to predict them from observed outcomes. This is a working identifying assumption, not something verified by the observed data.

The delta model adds further assumptions. It treats the chosen shift as appropriate for the particular missingness pattern and arm, and usually applies the same additive shift to all missing outcomes in that pattern. If the shift is added to each imputed value, it translates that pattern’s imputed distribution without changing its residual spread. A constant shift may be inadequate if the difference from MAR varies with baseline severity or time since the event; those possibilities call for a more tailored sensitivity model, not a claim that one delta is known to be correct.

For an intuitive calculation, let \(q_{g,A}\) be the fraction of all randomized participants in arm \(g\) whose endpoint is missing after an adverse event, and let \(\delta_{g,A}\) be their additive shift. If the MAR complete-data mean in arm \(g\) is \(\bar{Y}^{(\mathrm{MAR})}_g\), shifting those missing values changes the arm mean by \(q_{g,A}\delta_{g,A}\). Thus, for one such pattern in each arm, the adjusted treatment contrast is:

$$ \theta^{(\delta)} = \theta^{(\mathrm{MAR})} + q_{T,A}\delta_{T,A} - q_{C,A}\delta_{C,A}. $$

The subtraction for the control arm follows directly from defining the contrast as treatment minus control. With multiple patterns, add the shift contribution for each pattern in each arm, using the appropriate arm-specific missing fraction and delta. In a multiple-imputation analysis, the same adjustment is made to each imputed data set, and uncertainty is calculated by pooling estimates and their within- and between-imputation variability. The simple formula above explains the point-estimate movement; it does not replace that uncertainty calculation.

Worked Example: A Treatment-Arm Adverse-Event Pattern

Suppose a hypothetical randomized trial has 100 participants per arm. The MAR-imputed endpoint means are 7.20 percentage points in treatment and 7.50 in control, so the MAR contrast is \(7.20-7.50=-0.30\) percentage points. In treatment, 12 participants have missing endpoint HbA1c after an adverse event; in control, 2 do. For this illustration, all other missing outcomes have delta zero. Consider a treatment-arm delta of \(+0.80\) percentage points and a control-arm delta of zero.

The treatment-arm missing fraction for this pattern is \(q_{T,A}=12/100=0.12\); the control-arm fraction is \(q_{C,A}=2/100=0.02\). The pattern’s treatment-mean shift is \(0.12(0.80)=0.096\) percentage points, while its control-mean shift is \(0.02(0)=0\).

Therefore the adjusted contrast is \(-0.30+0.096-0=-0.204\) percentage points. Equivalently, the adjusted means are \(7.20+0.096=7.296\) for treatment and \(7.50\) for control. Under this sensitivity assumption, treatment still has the lower estimated mean HbA1c, but the estimated advantage is smaller: 0.204 rather than 0.30 percentage points. This is a point-estimate comparison, not a statement about statistical significance.

Choosing and Interpreting Delta Values

Delta is not estimated from the observed outcomes: the outcomes to which it applies are missing. Its values should therefore be justified as sensitivity assumptions, for example by clinical discussion of what might happen to HbA1c after treatment interruption, review of observed trajectories before the adverse event, and consideration of how large a difference from MAR would be clinically meaningful. Observed pre-event values can inform the MAR prediction, but they cannot reveal the unobserved post-event endpoint.

A transparent analysis reports the delta scale and direction, the affected pattern and arm, and the resulting contrast. It is often useful to evaluate a range of values, including zero as the MAR reference, rather than presenting one clinical judgment as uniquely correct. For instance, a positive delta may represent a scenario in which HbA1c after an adverse event would be worse than predicted under MAR. That scenario is not automatically conservative: its effect on the contrast depends on the fractions missing in each arm and on the control-arm assumptions as well.

Worked Example: Different Shifts in Both Arms

Consider another hypothetical trial with 120 randomized participants in each arm. Its MAR treatment-minus-control contrast is \(-0.25\) percentage points. Endpoint HbA1c is missing after an adverse event for 12 treatment participants and 3 control participants. Suppose clinicians specify deltas of \(+0.60\) percentage points in treatment and \(+0.20\) percentage points in control for this pattern.

The pattern fractions are \(q_{T,A}=12/120=0.10\) and \(q_{C,A}=3/120=0.025\). The net contrast shift is \(0.10(0.60)-0.025(0.20)=0.060-0.005=0.055\) percentage points.

The adjusted contrast is \(-0.25+0.055=-0.195\) percentage points. Both arms’ assumed missing outcomes are worse than their MAR predictions, but the treatment arm’s contribution to the shift is larger because its missing fraction and delta are larger. The adjusted estimate still favors treatment on the HbA1c scale. The example also shows why it is not enough to say “positive deltas worsen outcomes”: the contrast depends on their arm-specific weighted difference.

A Tipping-Point Calculation

A tipping-point calculation asks which value of a sensitivity parameter changes a stated conclusion. The conclusion must be defined precisely. For example, the delta at which the point estimate reaches zero is not necessarily the delta at which a confidence interval first includes zero. The latter also depends on the uncertainty calculation at each delta.

Worked Example: Delta That Erases the Point-Estimate Advantage

Suppose a hypothetical trial has a MAR treatment-minus-control contrast of \(-0.18\) percentage points. Of 100 randomized treatment participants, 15 have HbA1c missing after an adverse event. In control, 3 of 100 have this pattern, but set the control delta to zero for this calculation. Let the treatment delta be \(\delta_{T,A}\). The adjusted point estimate is:

$$ \theta^{(\delta)} = -0.18+\frac{15}{100}\delta_{T,A}-\frac{3}{100}(0) = -0.18+0.15\delta_{T,A}. $$

Set this contrast equal to zero to find the point-estimate tipping value: \(0=-0.18+0.15\delta_{T,A}\), so \(0.15\delta_{T,A}=0.18\) and \(\delta_{T,A}=0.18/0.15=1.20\) percentage points. At this assumed shift, the adjusted point estimate is \(0.00\) percentage points. A larger treatment-arm delta makes the point estimate positive under these assumptions; a smaller one leaves it negative. This calculation identifies a threshold for the point estimate only. It does not establish that a 1.20-point shift is clinically plausible or determine the confidence interval.

Diagnostics, Alternatives, and Limitations

Before interpreting a delta analysis, check that the pattern is coded as intended and that the missing fractions use the correct denominators. In the examples, the denominator is the number randomized in the arm because the displayed means are complete-data means over those participants. If the estimand or analysis population differs, the denominator and weighting must match that analysis. Also verify that delta is applied only to missing outcomes in the designated adverse-event pattern—not to observed HbA1c values or to every missing value indiscriminately.

Inspect the imputed values after adjustment. Large positive shifts can produce values outside a clinically credible range or imply implausible changes from observed pre-event measurements. Such findings do not automatically invalidate a sensitivity scenario, but they signal that the constant additive shift, pattern definition, or chosen delta may not be a useful representation of clinical uncertainty. Check whether the chosen shifts are arm-specific as intended, whether all imputation runs completed, and whether the adjusted estimates move in the direction predicted by the weighted-shift formula. A mismatch can reveal a coding or denominator error. Sensitivity analyses should also report uncertainty, not just point estimates.

Delta adjustment is one pattern-mixture approach: it describes departures from MAR directly on the outcome scale for a specified missingness pattern. A selection model instead represents missingness through a model relating observation probability to the outcome, which is a different way to express sensitivity assumptions. Reference-based imputation uses assumptions tied to outcomes in a reference arm or treatment trajectory; it is not the same as choosing a constant adverse-event delta. These approaches answer related but distinct questions, and their assumptions should not be treated as interchangeable.

The main limitation is fundamental: observed data alone cannot identify the mean HbA1c among outcomes missing after adverse events without additional assumptions. A delta grid shows how conclusions depend on specified assumptions; it does not identify a correct delta. Clinical input is important, but disagreement among reasonable judgments should be shown rather than concealed. Finally, a constant shift in HbA1c may fail to represent heterogeneous consequences of an adverse event, and a pattern defined only by “after an adverse event” may combine clinically different events. Narrower patterns or varying shifts may be worth examining when the data support them, while recognizing that finer patterns can leave fewer observed data to estimate the MAR predictions.

Key takeaway: For missing HbA1c after adverse events, delta adjustment translates the MAR-imputed outcomes in a defined pattern by a stated amount. The treatment contrast changes according to each arm’s pattern-specific missing fraction and delta. The result is a sensitivity analysis conditional on those clinical assumptions, not a recovered truth about unobserved outcomes.

Check Your Understanding

Answer each question, then compare with the worked solutions below.

  1. In a trial with 80 participants per arm, 8 treatment and 4 control participants have HbA1c missing after an adverse event. The MAR contrast is \(-0.20\) percentage points. If both pattern-specific deltas are \(+0.50\), what is the adjusted contrast?
  2. In your own words, what does a treatment-arm delta of \(-0.30\) percentage points mean relative to the MAR imputation?
  3. A MAR contrast is \(-0.12\) percentage points. The treatment pattern fraction is 0.10, the control fraction is 0.04, and the control delta is zero. What treatment delta makes the adjusted point estimate zero?
  4. Why does a point-estimate tipping value not, by itself, identify when a confidence interval includes zero?

Solutions. (1) The net shift is \((8/80)(0.50)-(4/80)(0.50)=0.050-0.025=0.025\) percentage points. The adjusted contrast is \(-0.20+0.025=-0.175\) percentage points. (2) It assumes that missing treatment-arm HbA1c values in the specified adverse-event pattern are 0.30 percentage points lower, on average, than their MAR-imputed values; it does not shift observed outcomes. (3) Solve \(0=-0.12+0.10\delta_{T,A}\), giving \(\delta_{T,A}=1.20\) percentage points. (4) A confidence interval depends on the estimate’s uncertainty, including within- and between-imputation variability, as well as the point estimate. A zero point estimate and a confidence interval containing zero are different conditions.

Clinical Biostats