Tutorials › Pattern-Mixture and Selection Models › Joint Assumptions For Both Trial Arms

Sensitivity Analysis for Treatment Effects · Tutorial 415 of 499

Joint Assumptions For Both Trial Arms

Set up a two-parameter sensitivity analysis and see how joint assumptions in both trial arms change the treatment-effect estimate.

Advanced 10 min read

What You'll Learn

  • Define separate sensitivity parameters for missing outcomes in the treatment and control arms.
  • Derive how each arm’s missing-outcome fraction weights its assumption departure.
  • Calculate treatment contrasts under joint, equal, and asymmetric departures.
  • Interpret the signs and units of the two parameters in context.
  • Diagnose implausible scenarios and distinguish assumption sensitivity from sampling uncertainty.

Why vary both arms together?

A treatment-effect estimate can depend on what is assumed about outcomes that were not observed. It is tempting to change the assumption for one arm while leaving the other fixed. That can be useful for isolating an arm’s contribution, but it does not necessarily represent the joint scenario of interest: missing outcomes may be less favorable than predicted in both arms, or the departures may differ between arms. A joint sensitivity analysis makes both assumptions explicit and evaluates the treatment contrast under their combination.

The key is to keep the two questions separate: what is assumed about the missing outcomes in each arm, and what treatment contrast follows from those assumptions? A pair of sensitivity parameters answers the first question; an assumption-indexed contrast answers the second. The parameters are not quantities estimated from the observed outcomes. They encode alternative assumptions for outcomes that are unavailable.

Definition: Let \(\delta_T\) and \(\delta_C\) be additive departures, in the outcome’s units, from specified reference predictions for missing outcomes in the treatment and control arms. A joint assumption is an ordered pair \((\delta_T,\delta_C)\). The treatment-effect estimate calculated under that pair is the assumption-indexed contrast \(\hat{\theta}(\delta_T,\delta_C)\).

The meaning of “positive” depends on the outcome scale. For an outcome where larger values are better, a positive departure means that the mean among missing participants is assumed higher than its reference prediction. For an outcome where smaller values are better, the clinical interpretation reverses, even though the arithmetic does not. State the outcome scale and the direction of benefit before interpreting a scenario.

A two-arm mixture model

Consider a simple marginal-mean analysis with a continuous outcome measured in the same units in both arms. In arm \(a\), where \(a\) is \(T\) for treatment or \(C\) for control, let \(q_a\) be the fraction with observed outcomes, \(\bar{y}_{a,\mathrm{obs}}\) the observed-outcome mean, and \(m_a^0\) the reference predicted mean for participants whose outcomes are missing. The reference prediction could, for example, come from a specified reference analysis. The sensitivity parameter \(\delta_a\) shifts that missing-outcome mean from \(m_a^0\) to \(m_a^0+\delta_a\); it does not shift the observed outcomes.

This setup treats the arm’s outcome distribution as a mixture of an observed group and a missing group. The target arm mean under the chosen assumption is the observed fraction’s contribution plus the missing fraction’s contribution. The treatment contrast is defined here as treatment minus control; positive values favor treatment only when higher outcomes are better.

$$ \hat{\mu}_a(\delta_a) = q_a\bar{y}_{a,\mathrm{obs}}+(1-q_a)(m_a^0+\delta_a) $$
$$ \hat{\theta}(\delta_T,\delta_C) = \hat{\mu}_T(\delta_T)-\hat{\mu}_C(\delta_C) = \hat{\theta}(0,0)+(1-q_T)\delta_T-(1-q_C)\delta_C $$

The reference contrast \(\hat{\theta}(0,0)\) is the contrast when both departures are zero. Each departure is weighted by its arm’s missing fraction: a one-unit change in the assumed missing-outcome mean changes that arm’s estimated overall mean by the fraction missing. The minus sign before the control term follows from defining the contrast as treatment minus control.

The formula relies on a clearly specified reference prediction in each arm, an additive shift on the stated outcome scale, and fixed observed data and response fractions across scenarios. It also assumes that each \(\delta_a\) is a shift in the mean for missing participants, not a shift in the observed-group mean. The formula is exact for this marginal mixture calculation. Other estimators, such as covariate-adjusted estimators with different standardization weights, require their own corresponding derivation; the mixture weights should not be transferred without justification.

Interpretation: A joint scenario must specify both parameters. Setting \(\delta_T=0\) does not mean that treatment-arm outcomes are all observed; it means that the missing treatment outcomes retain their reference prediction. Likewise for \(\delta_C=0\). When both are zero, the result is the reference analysis, not an analysis with no missing data.

Worked joint scenarios

Worked Example: Establishing the Reference Contrast

Suppose, hypothetically, that higher scores are better and the score is measured in points. In the treatment arm, 70% of outcomes are observed, the observed mean is 12 points, and the reference predicted mean for missing outcomes is 10 points. In the control arm, 80% are observed, the observed mean is 10 points, and the reference predicted mean for missing outcomes is 9 points. Calculate the reference contrast.

For treatment, \(q_T=0.70\), so the missing fraction is \(1-q_T=0.30\). Its reference overall mean is

$$ \hat{\mu}_T(0)=0.70(12)+0.30(10)=8.4+3.0=11.4\text{ points}. $$

For control, \(q_C=0.80\), so the missing fraction is \(0.20\). Its reference overall mean is

$$ \hat{\mu}_C(0)=0.80(10)+0.20(9)=8.0+1.8=9.8\text{ points}. $$

Therefore, \(\hat{\theta}(0,0)=11.4-9.8=1.6\) points. This is the treatment-minus-control contrast under the stated reference predictions. It is not yet a statement about how robust that estimate is to other assumptions.

Worked Example: Equal Departures in Both Arms

Continue with the hypothetical data above. Suppose the missing-outcome mean in each arm is assumed to be 2 points below its own reference prediction. This is an equal, same-direction departure: \(\delta_T=\delta_C=-2\) points. Calculate the joint contrast and explain why it does not simply remain unchanged.

The treatment missing fraction is 0.30 and the control missing fraction is 0.20. Substituting into the contrast formula gives

$$ \hat{\theta}(-2,-2) =1.6+0.30(-2)-0.20(-2) =1.6-0.6+0.4 =1.4\text{ points}. $$

Both missing-outcome means have moved downward, but the treatment estimate is reduced by 0.6 points while the control estimate is reduced by 0.4 points. The treatment-minus-control contrast consequently falls by 0.2 points. Equal departures do not cancel unless their weighted contributions are equal. Here they differ because the missing fractions differ.

More generally, along the equal-departure scenario \(\delta_T=\delta_C=\delta\), the contrast changes from its reference value by \(\{(1-q_T)-(1-q_C)\}\delta\). Thus equal parameter values can have unequal effects on the contrast when the arms have different missing fractions.

Worked Example: An Asymmetric Joint Scenario

Using the same hypothetical data, suppose treatment-arm missing outcomes are assumed to be 3 points below their reference prediction, while control-arm missing outcomes are assumed to be 1 point above theirs. Thus \(\delta_T=-3\) points and \(\delta_C=+1\) point. Calculate the contrast and interpret the directions.

The treatment contribution to the change is \(0.30(-3)=-0.90\) points. The control arm’s overall mean rises by \(0.20(1)=0.20\) points; because the contrast subtracts the control mean, this also reduces the contrast. Therefore,

$$ \hat{\theta}(-3,+1) =1.6+0.30(-3)-0.20(+1) =1.6-0.90-0.20 =0.50\text{ points}. $$

Under these assumptions, the treatment-minus-control estimate is 0.50 points, rather than the reference value of 1.6 points. With higher scores defined as better, both departures move the contrast in a less favorable direction: the treatment missing mean is lower, and the control missing mean is higher, than their respective reference predictions. The arithmetic does not establish that either assumption is plausible; that judgment requires substantive justification.

Symmetry, asymmetry, and interpretation

“Symmetric” can refer to more than one scenario, so a report should state the actual parameter values rather than rely on the label alone. In an equal-departure scenario, \(\delta_T=\delta_C\): the two arms’ missing means move by the same number of outcome units from their own reference predictions. In an equal-magnitude, opposite-direction scenario, \(\delta_T=-\delta_C\): one arm is shifted above its reference by the same amount that the other is shifted below. Neither construction implies that the resulting changes in the arm means, or in the treatment contrast, have equal magnitude.

An asymmetric scenario simply assigns different departures to the two arms, such as \((-3,+1)\) points. Asymmetry may be important when there are substantive reasons to expect the arms’ missing outcomes to differ in their departures from the reference predictions. The chosen values should be described in terms of those predictions and the outcome’s units, not just as “more favorable” or “less favorable.” In particular, a zero departure in one arm can coexist with a nonzero departure in the other.

A useful check is to calculate each arm’s change before interpreting the contrast. For any pair, those changes are \((1-q_T)\delta_T\) for treatment and \((1-q_C)\delta_C\) for control. The contrast change is the treatment change minus the control change. This check catches sign errors and makes clear why two assumptions that sound similar may have different effects on the estimate.

Setting up and checking a joint analysis

A disciplined analysis specifies the assumptions before calculating scenario-specific estimates. It should identify the reference predictions, the outcome scale and direction of benefit, the meaning and units of each departure, and the joint pairs to be examined. A pair is a scenario: changing one coordinate while silently holding the other fixed answers a different question.

1
Define the reference.
State how missing-outcome means are predicted when \(\delta_T=\delta_C=0\), and identify the reference contrast.
2
Specify both departures.
Give \((\delta_T,\delta_C)\) in the outcome’s units and explain what each value assumes about missing outcomes in that arm.
3
Compute each arm’s mean.
Use its own observed fraction, observed mean, reference missing mean, and departure. Check that the missing fraction is \(1-q_a\).
4
Subtract in the declared order.
Calculate treatment minus control, then describe the result using the outcome scale and units.

Diagnostics are substantive as well as arithmetic. Check that assumed missing means are possible on the outcome scale; for a bounded score, a shifted mean must remain within its feasible range. Compare departures with clinically interpretable differences and the uncertainty of the reference predictions. Check that a proposed scenario is internally coherent across arms and consistent with the reasons outcomes are missing. If the assumptions imply impossible values or lack a defensible interpretation, revise or reject the scenario rather than relying on a precise calculation.

How this approach differs from alternatives

Changing one arm’s departure at a time is useful for showing how sensitive the estimate is to that arm, but it does not capture joint departures. Constraining both parameters to be equal reduces the analysis to a one-dimensional set of assumptions; it is transparent, but excludes asymmetric possibilities. Allowing separate parameters permits those possibilities, provided the joint scenarios are selected and explained rather than chosen after seeing which result is most favorable.

A pattern-mixture analysis expresses assumptions through distributions or means within observed and missing patterns. A selection-model analysis instead expresses assumptions through the relationship between outcome and the probability of being observed. These are different parameterizations of assumptions about missingness; neither makes unobserved outcomes directly observable. The two-parameter mean-shift calculation here is a deliberately simple way to show how arm-specific assumptions enter a particular marginal contrast.

The limitations matter. The calculation does not identify the departures from observed data alone, validate the reference predictions, or account for sampling uncertainty. Nor does one pair summarize all plausible assumptions. Conclusions can depend on the outcome scale, the reference model, response fractions, and the set of joint scenarios considered. A numerical contrast under a scenario should therefore be reported as conditional on that scenario, not as an assumption-free estimate. Interval estimation for each fixed pair and conclusions across a sensitivity set are separate inferential questions.

Common mistakes

  • Changing only one parameter without saying so. A result at \((\delta_T,0)\) is a joint scenario with the control departure fixed at zero, not a general two-arm assessment.
  • Assuming equal shifts cancel. They cancel in the contrast only if their missing-fraction-weighted changes are equal. Different missing fractions usually prevent exact cancellation.
  • Reversing the control sign. For a treatment-minus-control contrast, a positive control departure contributes \(-(1-q_C)\delta_C\).
  • Calling sensitivity values estimated effects. Departures are assumptions about unobserved outcomes, not treatment effects estimated from observed data.
  • Confusing assumption sensitivity with precision. A changed point estimate across scenarios reflects changed assumptions; by itself it does not quantify sampling uncertainty.
Key takeaway: A two-parameter sensitivity analysis specifies a pair of missing-outcome departures, one for each arm. In the marginal mixture model, each departure changes the treatment-minus-control estimate in proportion to that arm’s missing fraction, with the control contribution subtracted. State the pair, reference, scale, and units whenever interpreting a scenario.

Check Your Understanding

Answer each question, then compare your work with the solutions below.

  1. An outcome has \(q_T=0.60\), \(q_C=0.90\), and reference contrast \(\hat{\theta}(0,0)=2\) units. What is the contrast under \((\delta_T,\delta_C)=(1,1)\)?
  2. For a treatment-minus-control contrast, why does a positive control departure reduce the contrast when the outcome is higher-is-better?
  3. With missing fractions 0.25 in treatment and 0.40 in control, calculate the change in the contrast under \((\delta_T,\delta_C)=(-2,-1)\) units.
  4. What must be checked before using an additive departure for a bounded outcome?
  5. Does a scenario-specific point estimate describe sampling uncertainty? Explain.

Solutions. (1) The change is \(0.40(1)-0.10(1)=0.30\), so the contrast is \(2+0.30=2.30\) units. (2) The control mean is subtracted; increasing it by \((1-q_C)\delta_C\) lowers treatment minus control by that amount. (3) The change is \(0.25(-2)-0.40(-1)=-0.50+0.40=-0.10\) units. (4) Check that the assumed missing-outcome mean remains within the outcome’s feasible range and has a defensible interpretation. (5) No. It is conditional on the specified assumptions; sampling uncertainty requires separate inferential calculations.

Clinical Biostats