Tutorials › Pattern-Mixture and Selection Models › Assumption-Indexed Treatment Effects

Sensitivity Analysis for Treatment Effects · Tutorial 410 of 499

Assumption-Indexed Treatment Effects

Learn to index treatment-effect estimates by missing-outcome assumptions and report each estimate with its target contrast and assumed-data basis.

Advanced 11 min read

What You'll Learn

  • Separate the treatment-effect target from assumptions used to fill in unobserved outcomes.
  • Write an assumption-indexed estimate of each treatment-arm mean and their contrast.
  • Calculate estimates from observed fractions and explicitly assumed missing-outcome means.
  • Label the target, effect scale, follow-up, and missing-data assumption in a result.
  • Recognize when a reported estimate is not reproducible or is being overinterpreted.

Why Index an Estimate by Its Assumptions?

When follow-up outcomes are missing, the observed data alone do not generally determine the treatment effect for the full target population. An analysis therefore needs assumptions about the unobserved outcomes. The estimate is not fully described by a number such as “a difference of 1.8 points”: its interpretation also depends on which treatment contrast is targeted and what was assumed about the missing data.

Assumption-indexing makes that dependence explicit. It treats the estimate as a function: hold the observed data and target contrast fixed, state an assumption about unobserved outcomes, and calculate the estimate implied by that assumption. This is different from changing the estimand. The target can remain, for example, the mean difference between randomized treatment policies at a specified follow-up, while the assumptions used to identify that target vary.

The earlier material on estimands establishes why the population, treatment conditions, outcome, and handling of intercurrent events must be specified. Here the focus is narrower: once the target has been defined, how should its estimate be indexed and reported when some outcomes are missing?

Definition and Basic Formula

Definition: An assumption-indexed treatment-effect estimate is an estimate of a specified treatment contrast, computed from the observed data under a stated assumption about unobserved outcomes. Write \(\hat{\tau}(\eta)\), where \(\eta\) labels that assumption. The label does not change the target contrast; it identifies the assumed-data basis used to estimate it.

Consider a two-arm randomized trial with a continuous outcome \(Y\) measured at a fixed follow-up. Let \(A=a\) denote assignment to arm \(a\), for \(a=0,1\), and let \(R=1\) indicate that the follow-up outcome is observed and \(R=0\) that it is missing. In arm \(a\), let \(n_a\) be the number assigned, \(n_{a,\mathrm{obs}}\) the number with observed outcomes, and \(\bar{Y}_{a,\mathrm{obs}}\) their mean. Define the observed fraction as \(\hat{\pi}_a=n_{a,\mathrm{obs}}/n_a\).

An assumption index \(\eta\) specifies a mean \(m_{a,\mathrm{mis}}(\eta)\) for the missing outcomes in arm \(a\). In this simple mean-based pattern-mixture representation, the estimated full-arm mean is the observed fraction’s contribution plus the missing fraction’s assumed contribution:

$$ \hat{\mu}_a(\eta) = \hat{\pi}_a\bar{Y}_{a,\mathrm{obs}} + (1-\hat{\pi}_a)m_{a,\mathrm{mis}}(\eta). $$

For a treatment-minus-control mean difference, the assumption-indexed estimate is

$$ \hat{\tau}(\eta)=\hat{\mu}_1(\eta)-\hat{\mu}_0(\eta). $$

This formula is a plug-in estimate, not a claim that each missing person’s outcome is known. It uses the assumed missing-outcome mean to represent the unobserved part of each arm. Its simple form also has a scope: it assumes the chosen arm-level means are adequate for the target. If assumptions are made conditional on baseline covariates, or the analysis uses a different estimator, the corresponding calculation must represent those assumptions and the target population rather than silently substituting this formula.

Conditions for Interpreting the Estimate

The formula is useful only when its ingredients match a clearly stated question. For a causal interpretation as a randomized-treatment contrast, the treatment conditions and outcome must be well-defined, the randomized assignment must support comparison of the arms, and observed outcomes must correspond to outcomes under assigned treatment in the target estimand. The endpoint, follow-up time, population, and handling of intercurrent events must also match that estimand.

The missing-outcome component requires an additional assumption. For each arm, the value \(m_{a,\mathrm{mis}}(\eta)\) must be a defensible representation of the mean among participants whose outcomes are missing under the stated assumption. It is not estimated directly from those missing outcomes. If an assumption is given in terms of a shift from an observed mean, that shift and its reference mean must be stated. If it is given as a direct assumed mean, the mean and its units must be stated. A bare label such as “adjusted” does not identify either basis.

The target contrast also needs a label. “Treatment effect” alone is incomplete: state whether it is a treatment-minus-control mean difference, a ratio, or another contrast, and give its outcome units where applicable. State the direction of subtraction. For a randomized trial, the causal language should refer to the specified treatment conditions and population; an estimated association from a nonrandomized comparison should not be presented as causal merely because the same arithmetic was used.

Worked Example: Calculating One Assumption-Indexed Mean Difference

Hypothetical data: At the specified follow-up, 80 of 100 participants assigned to treatment have observed outcomes, with mean 12.0 points. In control, 90 of 100 have observed outcomes, with mean 10.0 points. Suppose the stated assumption assigns a missing-outcome mean of 11.0 points in treatment and 9.5 points in control. The target is the treatment-minus-control mean difference in points.

The observed fractions are \(\hat{\pi}_1=80/100=0.80\) and \(\hat{\pi}_0=90/100=0.90\). Applying the assumed missing means gives

$$ \begin{aligned} \hat{\mu}_1(\eta) &=0.80(12.0)+0.20(11.0)\\ &=9.60+2.20=11.80,\\ \hat{\mu}_0(\eta) &=0.90(10.0)+0.10(9.5)\\ &=9.00+0.95=9.95. \end{aligned} $$

Therefore,

$$ \hat{\tau}(\eta)=11.80-9.95=1.85\text{ points}. $$

A suitable interpretation is: under the stated assumptions for the missing-outcome means, the estimated treatment-minus-control mean difference at this follow-up is 1.85 points. This calculation alone does not quantify sampling uncertainty, establish clinical importance, or show that the missing-outcome assumptions are correct.

Derivation: Why the Assumed Mean Enters With Its Fraction

The weighting in the formula follows from partitioning the arm’s full outcome mean by whether the outcome is observed. In population notation, let \(\pi_a=P(R=1\mid A=a)\), and let \(m_{a,\mathrm{obs}}=E(Y\mid A=a,R=1)\). Under an assumption \(\eta\) that supplies \(m_{a,\mathrm{mis}}(\eta)=E(Y\mid A=a,R=0)\), the law of total expectation gives

$$ \begin{aligned} E(Y\mid A=a) &=P(R=1\mid A=a)E(Y\mid A=a,R=1)\\ &\quad+P(R=0\mid A=a)E(Y\mid A=a,R=0)\\ &=\pi_a m_{a,\mathrm{obs}}+(1-\pi_a)m_{a,\mathrm{mis}}(\eta). \end{aligned} $$

Replacing the population observed fraction and observed mean with their sample counterparts yields the plug-in expression for \(\hat{\mu}_a(\eta)\). Subtracting the two arm means then yields the stated treatment-minus-control contrast. The key point is that the observed outcomes supply only the first component; the second component depends on the assumption. The calculation does not turn the assumption into observed evidence.

This derivation also clarifies a frequent ambiguity around “assuming missing outcomes equal observed outcomes.” At the arm-mean level, that assumption sets \(m_{a,\mathrm{mis}}(\eta)=m_{a,\mathrm{obs}}\), giving \(\hat{\mu}_a(\eta)=\bar{Y}_{a,\mathrm{obs}}\). It is a particular mean restriction. It should not be called a general missing-at-random assumption without qualification: conditional missing-at-random assumptions can require covariates and appropriate adjustment, and do not in general imply equality of the two unconditional arm means.

Worked Example: Same Target, Different Assumption Index

Hypothetical data: Use the observed counts and means from the previous example. First, under an equal-arm-mean assumption, set the missing mean in each arm equal to that arm’s observed mean. Then calculate the estimate under the separately stated missing means of 11.0 points for treatment and 9.5 points for control. The target remains the treatment-minus-control mean difference at the same follow-up.

Under the equal-arm-mean assumption, the treatment mean estimate is

$$ 0.80(12.0)+0.20(12.0)=12.0\text{ points}, $$

and the control mean estimate is

$$ 0.90(10.0)+0.10(10.0)=10.0\text{ points}. $$

Thus \(\hat{\tau}(\eta_{\mathrm{equal}})=12.0-10.0=2.00\) points. Under the other assumption index, the calculation in the first example gives \(\hat{\tau}(\eta_{\mathrm{specified}})=1.85\) points. These are two estimates of the same target contrast, based on the same observed data, but with different assumed missing-outcome means.

The difference of 0.15 points is not a change in the estimand. It is a consequence of changing the assumed-data basis. Neither result should be reported without naming the assumption that produced it.

Reporting the Target and Assumed-Data Basis

A report should let a reader identify both the question being estimated and the missing-data assumption used to obtain the number. At minimum, include the target population or trial population, treatment conditions, outcome and follow-up, contrast and direction, and the assumption used for missing outcomes. For a mean-based calculation, report the arm-specific observed fractions and the assumed missing-outcome means, or refer to a clearly defined model that supplies them.

For example: “For the randomized population, the estimated treatment-minus-control difference in mean [outcome] at [follow-up] was 1.85 points under the assumption that missing outcomes had means of 11.0 points in treatment and 9.5 points in control; the observed fractions were 80% and 90%, respectively.” This phrasing exposes the result’s basis without implying that the missing means were observed or that the assumption is empirically verified.

An assumption index can be a descriptive label, such as \(\eta_{\mathrm{equal}}\), or a parameter that defines a model. Either way, define it in words and specify its role. A label with no definition is not reproducible. Conversely, a full list of mathematical details without naming the target contrast can leave the reader unsure what the estimate means.

Worked Example: Repairing an Incomplete Result

Hypothetical report: “The effect was 2 points after handling missing data.” The underlying trial had a mean-difference target for a continuous outcome at week 12. In the treatment arm, 75 of 100 participants had observed outcomes with mean 8.0 points; in control, 90 of 100 had observed outcomes with mean 7.0 points. The analysis assumed missing-outcome means of 7.0 points in treatment and 6.0 points in control.

The arm estimates are

$$ \begin{aligned} \hat{\mu}_1 &=0.75(8.0)+0.25(7.0)=6.00+1.75=7.75,\\ \hat{\mu}_0 &=0.90(7.0)+0.10(6.0)=6.30+0.60=6.90. \end{aligned} $$

The treatment-minus-control estimate is \(7.75-6.90=0.85\) points, not 2 points. The quoted report is therefore not just incomplete: it is inconsistent with the supplied data and assumptions. A corrected report would state the week-12 mean difference, its direction and units, the observed fractions, and the assumed missing means. This check illustrates why a label is valuable: it makes the arithmetic and interpretation auditable.

Diagnostics, Alternatives, and Limitations

Before interpreting an assumption-indexed estimate, check that the arithmetic and the label agree. The observed fractions must be between zero and one and must correspond to the stated arm counts. The assumed missing means must use the outcome’s units and refer to the correct arm and follow-up. The contrast must use the stated direction. If all outcomes are observed in an arm, its missing fraction is zero, so the assumed missing mean has no effect on that arm’s estimate. If no outcomes are observed in an arm, the estimate for that arm depends entirely on the assumption; the data provide no observed mean for that arm at that follow-up.

This mean-based calculation is one approach to missing outcomes, not a universal replacement for other analyses. A complete-case analysis uses observed outcomes and targets or estimates a quantity based on that observed subset unless additional assumptions justify extending its interpretation. Likelihood-based methods, inverse-probability weighting, and multiple imputation are alternative approaches whose validity depends on their own models and conditions. They may use covariate information or the outcome distribution in ways this simple arm-mean formula does not. Whatever approach is used, the treatment contrast and the assumptions needed to interpret it must remain clear.

A common mistake is to call an estimate “the treatment effect” and treat a missing-data assumption as a harmless technical detail. The correction is to report the estimate as \(\hat{\tau}(\eta)\), define \(\eta\) in substantive terms, and name the target contrast. Another mistake is to infer that an assumption is supported simply because the resulting estimate looks plausible. Plausibility is not verification; missing outcomes are unobserved, so the assumed part cannot be checked directly from those outcomes.

Key takeaway: A treatment-effect estimate with missing outcomes is interpretable only when its target contrast and its assumed-data basis are both explicit. Keep the estimand fixed in the description, and make the missing-outcome assumption visible in the estimate’s label and report.

Check Your Understanding

Answer each question, then compare with the solutions below.

  1. In a trial, 40 of 50 participants in one arm have observed outcomes with mean 6 points. The assumed mean among the missing outcomes is 5 points. Calculate the estimated full-arm mean.
  2. Why is “a difference of 1.2 points after adjustment” not a sufficient description of an assumption-indexed estimate?
  3. In the mean-based formula, what happens to an arm’s estimate when every outcome in that arm is observed?
  4. Does setting the assumed missing mean equal to the observed arm mean establish that outcomes are missing at random? Explain.
  5. Suppose an arm has no observed outcomes at the specified follow-up. What does its estimated mean depend on under this formula?

Solutions. (1) The observed fraction is \(40/50=0.80\), so the estimate is \(0.80(6)+0.20(5)=4.8+1.0=5.8\) points. (2) It omits the target population, outcome and follow-up, contrast direction, and the missing-data assumption; without these, the number is not fully interpretable or reproducible. (3) Its missing fraction is zero, so the estimate equals the observed mean and is unaffected by the assumed missing mean. (4) No. It is an equality of arm-level means, not a general statement about conditional missingness given covariates. (5) The observed fraction is zero, so the estimated mean equals the assumed missing-outcome mean; it is entirely assumption-dependent.

Clinical Biostats