Tutorials › Pattern-Mixture and Selection Models › Relapse-Related Missing Reports in a Smoking Cessation Trial

Case Studies · Tutorial 496 of 499

Relapse-Related Missing Reports in a Smoking Cessation Trial

Learn to calculate abstinence estimates under explicit assumptions about whether missing smoking reports are related to relapse, and see how those assumptions can alter the comparison between trial arms.

Advanced 10 min read

What You'll Learn

  • Define an all-randomized abstinence estimand when end-of-trial smoking reports are missing.
  • Calculate arm-specific abstinence estimates under a missing-at-random assumption and relapse-related alternatives.
  • Use an odds-scale sensitivity parameter to describe how abstinence among nonreporters differs from abstinence among reporters.
  • Assess how differential missingness and arm-specific assumptions can change the estimated treatment contrast.
  • Use auxiliary verification data, diagnostics, and bounds to assess the plausibility and limitations of assumptions.

Why Missing Smoking Reports Need Special Attention

In a smoking-cessation trial, an end-of-study self-report may be absent because a participant stopped responding, but it may also be absent because the participant relapsed and disengaged. Those explanations matter: if participants who do not report are less likely to be abstinent than participants who do report, treating the reporters as representative can overstate abstinence. The direction and size of that distortion can differ between trial arms.

The analysis below focuses on a binary endpoint at a fixed follow-up time: whether a participant is abstinent. The target is the abstinence proportion among all randomized participants in each arm, not only among those who supplied a report. This is a hypothetical worked case; the values are invented to illustrate the calculations, not results from a real trial.

Definition: For arm \(a\), let \(Y=1\) indicate abstinence at the specified follow-up and \(Y=0\) indicate smoking. Let \(R=1\) mean the smoking-status report is observed and \(R=0\) mean it is missing. Write \(m_a=P(R=0\mid A=a)\) for the missing-report proportion, \(p_a=P(Y=1\mid R=1,A=a)\) for abstinence among reporters, and \(q_a=P(Y=1\mid R=0,A=a)\) for abstinence among nonreporters. The all-randomized arm-specific abstinence proportion is \(\theta_a=P(Y=1\mid A=a)\).

The treatment contrast used here is the absolute difference \(\theta_T-\theta_C\), in percentage points, where \(T\) denotes the intervention arm and \(C\) the control arm. Positive values favor the intervention on the abstinence scale. Randomization supports comparing the arms, but it does not reveal \(q_a\): when smoking status is unreported, the observed data alone do not establish how many nonreporters were abstinent.

The Mixture Calculation and Its Assumptions

Within each arm, the full group consists of reporters and nonreporters. Partitioning on report status gives the identity

$$ \theta_a=P(R=1\mid A=a)p_a+P(R=0\mid A=a)q_a =(1-m_a)p_a+m_aq_a. $$

The identity is exact, but \(q_a\) is unknown when outcomes are missing. An assumption about \(q_a\), or information that helps estimate it, is needed to produce an all-randomized estimate. Under a missing-at-random assumption for this endpoint, conditional on the information being used in the analysis, missing reports do not carry additional information about abstinence. In a simple arm-only calculation this sets \(q_a=p_a\), and therefore \(\theta_a=p_a\). If baseline or other observed predictors are used, the corresponding assumption is that abstinence among nonreporters equals the predicted abstinence for otherwise comparable reporters; the simple formula should then be applied within predictor strata or through an appropriate prediction model.

A relapse-related sensitivity analysis instead allows \(q_a<p_a\). One convenient parameter expresses the abstinence odds among nonreporters relative to the abstinence odds among reporters:

Definition: The odds-scale sensitivity parameter \(\gamma_a\) is \(\{q_a/(1-q_a)\}/\{p_a/(1-p_a)\}\). Given \(p_a\) and a chosen \(\gamma_a\), the implied nonreporter abstinence probability is \(q_a=\gamma_a p_a/(1-p_a+\gamma_a p_a)\). Here \(\gamma_a=1\) gives the simple missing-at-random value \(q_a=p_a\), while \(0<\gamma_a<1\) represents lower abstinence odds among nonreporters.

The parameter is a sensitivity assumption, not an estimate obtained from the reports alone. Setting the same \(\gamma\) in both arms means assuming the same relative odds departure in both arms; it does not mean the same number of missed reports or the same abstinence probability among nonreporters. Setting different values allows the relationship between relapse and missing reporting to differ by arm. If every nonreporter is assumed to be smoking, set \(q_a=0\) directly; that is a strong boundary scenario, not a fact implied by a missing report.

Worked Analyses

Worked Example: A Shared Relapse-Related Odds Departure

Suppose each arm randomized 200 participants. In the intervention arm, 170 reported and 102 reported abstinence. In the control arm, 180 reported and 99 reported abstinence. Thus the intervention has 30 missing reports and the control has 20.

Among reporters, the observed abstinence proportions are \(p_T=102/170=0.6000\) and \(p_C=99/180=0.5500\). The missing proportions are \(m_T=30/200=0.1500\) and \(m_C=20/200=0.1000\). Under the simple missing-at-random assumption, the estimated arm proportions are 60.0% and 55.0%; the estimated difference is \(0.6000-0.5500=0.0500\), or 5.00 percentage points.

Now suppose, for sensitivity analysis, that \(\gamma_T=\gamma_C=0.5\). For the intervention arm, \(q_T=(0.5)(0.6000)/(0.4000+(0.5)(0.6000))=0.3000/0.7000=0.4286\). For control, \(q_C=(0.5)(0.5500)/(0.4500+(0.5)(0.5500))=0.2750/0.7250=0.3793\). These choices mean that the abstinence odds among nonreporters are half the odds among reporters in each arm.

The mixture estimates are \(\theta_T=(0.8500)(0.6000)+(0.1500)(0.4286)=0.5100+0.0643=0.5743\) and \(\theta_C=(0.9000)(0.5500)+(0.1000)(0.3793)=0.4950+0.0379=0.5329\). The estimated difference is \(0.5743-0.5329=0.0414\), or 4.14 percentage points. Under this shared odds-departure assumption, the estimated difference is smaller than the missing-at-random difference, but it remains positive.

Worked Example: Differential Reporting Can Change the Conclusion

Consider another hypothetical trial with 160 participants in each arm. In the intervention arm, 128 report and 80 are abstinent; in control, 144 report and 90 are abstinent. Thus \(p_T=p_C=0.6250\), but the missing proportions differ: \(m_T=32/160=0.2000\) and \(m_C=16/160=0.1000\).

Suppose subject-matter investigators consider a scenario in which the abstinence probability among nonreporters is the same in both arms, denoted \(r\). This is a particular assumption, not a default consequence of randomization. Substitution into the mixture identity gives \(\theta_T=(0.8000)(0.6250)+0.2000r=0.5000+0.2000r\) and \(\theta_C=(0.9000)(0.6250)+0.1000r=0.5625+0.1000r\). Consequently, \(\theta_T-\theta_C=-0.0625+0.1000r\).

The contrast is zero when \(-0.0625+0.1000r=0\), so \(r=0.0625/0.1000=0.6250\). If all nonreporters are assumed to be smoking (\(r=0\)), the estimated difference is \(-0.0625\), or −6.25 percentage points. If \(r=0.6250\), it is 0. If \(r=1\), it is \(0.0375\), or 3.75 percentage points. Thus, with equal observed abstinence proportions, the different missing fractions alone can make the estimated contrast depend strongly on the assumed outcome among nonreporters. The zero-crossing is a tipping value under this shared-\(r\) assumption, not evidence that \(r\) actually equals that value.

Worked Example: Using a Hypothetical Verification Subsample

Return to the first trial. Suppose a randomly selected subset of 20 intervention nonreporters is reached through a separate follow-up procedure, and 5 are verified abstinent at the target time. If selection into this verification subset is representative of the intervention nonreporters and verification correctly classifies their status, the estimated \(q_T\) is \(5/20=0.2500\). Using the mixture formula gives \(\theta_T=(0.8500)(0.6000)+(0.1500)(0.2500)=0.5100+0.0375=0.5475\).

Suppose, separately, 5 of a representative 20 control nonreporters are verified abstinent. Then \(q_C=0.2500\), and \(\theta_C=(0.9000)(0.5500)+(0.1000)(0.2500)=0.4950+0.0250=0.5200\). The estimated difference is \(0.5475-0.5200=0.0275\), or 2.75 percentage points.

The verification data also suggest arm-specific odds departures. In the intervention arm, \(\gamma_T=\{0.25/0.75\}/\{0.60/0.40\}=0.3333/1.500=0.2222\). In control, \(\gamma_C=\{0.25/0.75\}/\{0.55/0.45\}=0.3333/1.222=0.2727\). These are estimates from a small hypothetical subset and may be imprecise. If the subset was selected because participants were easier to reach, or status was measured inaccurately, its proportions need not represent all nonreporters. Verification helps only under defensible sampling and measurement assumptions.

Why the Mixture Result Holds

The key derivation is a partition of the abstinence event by whether a report was observed. Within arm \(a\), the events \(R=1\) and \(R=0\) are disjoint and cover all participants. Therefore,

$$ P(Y=1\mid A=a) =P(Y=1,R=1\mid A=a)+P(Y=1,R=0\mid A=a) $$

Applying the multiplication rule to each term gives \(P(Y=1\mid R=1,A=a)P(R=1\mid A=a)+P(Y=1\mid R=0,A=a)P(R=0\mid A=a)\). Replacing these probabilities by \(p_a\), \(q_a\), \(1-m_a\), and \(m_a\) yields the mixture identity. No assumption that missingness is random is needed for this identity. The assumption enters only when assigning a value to the unobserved \(q_a\).

The odds transformation follows by setting the nonreporter odds equal to \(\gamma_a\) times reporter odds: \(q_a/(1-q_a)=\gamma_a p_a/(1-p_a)\). Multiplying through by \((1-q_a)(1-p_a)\) and collecting the \(q_a\) terms gives \(q_a(1-p_a+\gamma_a p_a)=\gamma_a p_a\), which yields the stated formula. For \(0<p_a<1\), its implied \(q_a\) increases as \(\gamma_a\) increases. The sensitivity parameter therefore moves the assumed missing-outcome distribution in a controlled, interpretable direction.

Diagnostics, Alternatives, and Limits

The observed data cannot directly prove whether relapse caused a report to be missed, because the smoking status of nonreporters is precisely what is unknown. They can, however, reveal warning signs and help discipline sensitivity assumptions. Examine missing-report rates by randomized arm, baseline smoking intensity, prior quit attempts, earlier abstinence reports, and recorded reasons for nonresponse. Check whether missingness clusters after visits at which relapse was reported or suspected. A pattern linking observed relapse indicators to later missingness makes an assumption of no relapse-related departure less comfortable, although it does not determine \(q_a\).

Where feasible, use contact attempts, biochemical verification, or other auxiliary information to estimate outcomes in a representative sample of nonreporters. Check whether verification participation and measurement quality plausibly support that use. Also inspect the implied \(q_a\) values: probabilities outside \([0,1]\), or values inconsistent with reliable auxiliary evidence, signal an invalid calculation or an implausible scenario. Extreme sensitivity values may still be useful as bounds, but should be identified as such.

The main alternatives answer different questions or rely on different assumptions. A complete-case comparison uses \(p_T-p_C\) and describes reporters; it is not the all-randomized contrast unless the missingness assumptions justify that interpretation. A missing-at-random analysis can use observed predictors to model outcomes, but it depends on adequately measured predictors and a credible conditional missing-at-random assumption. A relapse-related pattern-mixture analysis directly varies \(q_a\) or \(\gamma_a\), making the untestable departure explicit. Declaring every missing participant to be smoking provides a simple conservative scenario for abstinence, but it is not automatically conservative for every treatment contrast: its effect depends on the missing fractions in both arms.

A practical limitation is that sensitivity parameters are not identified by the observed self-reports alone. A range of plausible assumptions is more informative than presenting one chosen value as if it were known. These calculations also give point estimates; they do not account for sampling uncertainty in reported proportions or in a verification subset. Inference requires uncertainty calculations consistent with the chosen model and the trial design. Finally, an end-of-study report may not establish abstinence over the entire follow-up period; the endpoint definition and timing must match the clinical question.

Common pitfall: “The intervention arm has 60% abstinence among reporters, so its all-randomized abstinence rate is 60%.” This silently assumes that nonreporters have the same abstinence probability as reporters (or comparable participants after conditioning on modeled predictors). If relapse makes reporting less likely, the assumption may be wrong. State the assumption, calculate the implied \(q_a\), and show how plausible alternatives change both arm estimates and their contrast.
Key takeaway: The all-randomized abstinence estimate is a weighted mixture of observed and unobserved outcomes. The weights—the report and missing-report proportions—are observed; the nonreporter abstinence probability is not. A clear relapse-related analysis makes that uncertainty visible rather than hiding it inside a complete-case result.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. An arm has \(p=0.50\), \(m=0.20\), and a sensitivity assumption \(q=0.25\). What is its all-randomized abstinence estimate?
  2. For \(p=0.40\) and \(\gamma=0.50\), calculate the implied abstinence probability among nonreporters using the odds-scale formula.
  3. Why does an assumption that every nonreporter is smoking not automatically make the treatment contrast conservative?
  4. In the shared-\(r\) example, what is the treatment contrast if \(r=0.50\)?
  5. Name one condition needed to use a verification subset to estimate abstinence among all nonreporters.

Solutions. (1) \(\theta=(1-0.20)(0.50)+(0.20)(0.25)=0.400+0.050=0.450\), or 45.0%. (2) \(q=(0.50)(0.40)/(0.60+(0.50)(0.40))=0.20/0.80=0.250\). (3) The assumption lowers both arm estimates, but the amount of lowering depends on each arm’s missing fraction; different missing fractions can move the contrast in either direction. (4) \(-0.0625+(0.1000)(0.50)=-0.0125\), or −1.25 percentage points. (5) For example, the subset must represent the nonreporters, or its selection must be appropriately accounted for, and the verification must measure smoking status accurately at the target time.

Clinical Biostats