Tutorials › Pattern-Mixture and Selection Models › Dropout After A Poor Last-Observed Outcome

Mechanisms and Ignorability in Longitudinal Studies · Tutorial 9 of 499

Dropout After A Poor Last-Observed Outcome

See when symptom-driven dropout is MAR, how the conditioning history determines the classification, and what the observed data cannot establish.

Intermediate 9 min read

What You'll Learn

  • Define dropout at a visit using the last symptom score recorded before that visit.
  • Classify dropout as MAR when its dependence is limited to the observed history.
  • Calculate and interpret hypothetical visit-specific dropout probabilities.
  • Distinguish MAR given the full observed history from classification using a reduced history.
  • Identify assumptions and limits of what observed dropout patterns can tell us.

Why the Last Recorded Score Matters

A participant may be more likely to leave a follow-up study after reporting severe symptoms. That fact alone does not make dropout depend on a missing outcome: if the severe score was recorded before the participant left, it is observed information. The classification depends on what outcomes and other variables are included in the conditioning history, and on whether dropout also depends on outcomes that were not observed.

Consider visits \(1,\ldots,T\). Let \(Y_{it}\) be participant \(i\)'s symptom score at visit \(t\), with larger values indicating worse symptoms, and let \(R_{it}=1\) if that score is observed and \(R_{it}=0\) otherwise. For simplicity, suppose dropout is monotone: after the first missed visit, no later outcomes are recorded. Let \(D_i=t\) mean participant \(i\) first misses visit \(t\), so the last recorded score is \(Y_{i,t-1}\). The participant is at risk of dropout before visit \(t\) if they were observed through visit \(t-1\).

Definition: Dropout after a poor last-observed outcome is MAR relative to the recorded outcome history if, among participants at risk before visit \(t\), the probability of dropout can depend on the observed outcomes \(Y_{i1},\ldots,Y_{i,t-1}\), including the last score \(Y_{i,t-1}\), but has no additional dependence on the unobserved outcome \(Y_{it}\) or other unobserved outcomes. More generally, MAR means that, conditional on the observed data, the probability of the observation pattern does not depend on the missing outcomes.

The word “poor” describes the clinical direction of the score, not a special statistical category. The threshold for calling a score poor may be useful for communication, but the MAR classification does not require a threshold: a dropout probability can vary smoothly with the recorded score. The key is temporal order. \(Y_{i,t-1}\) is observed before dropout at visit \(t\); \(Y_{it}\) is missing for a participant who drops out before that visit.

Visit-Specific Dropout and the MAR Condition

For a participant at risk before visit \(t\), define the dropout probability conditional on the recorded history as

$$ q_{it}(y_{i1},\ldots,y_{i,t-1}) = P(D_i=t \mid D_i\ge t,\, Y_{i1}=y_{i1},\ldots,Y_{i,t-1}=y_{i,t-1}). $$

Here \(D_i\ge t\) means the participant has not dropped out before visit \(t\), and so their outcomes through visit \(t-1\) are available under the monotone-dropout setup. Dropout can be more likely for participants whose last score is poor: \(q_{it}\) may increase as \(y_{i,t-1}\) increases. This dependence is on an observed value. If, given this history, dropout has no further dependence on \(Y_{it}\) or other missing outcomes, the visit-specific mechanism is MAR.

For this conclusion to describe the whole dropout process, the assumption must apply at each visit where dropout can occur. In particular, the process must not have an additional dependence on a missing current or future outcome that is left out of the stated conditional probability. The fact that a participant’s prior score predicts dropout is compatible with MAR; it does not by itself show that the MAR assumption is true.

Key distinction: Dependence on \(Y_{i,t-1}\), when that score is observed for the at-risk participant, is dependence on observed history. Dependence on \(Y_{it}\), when that score is unobserved because the participant dropped out before visit \(t\), is dependence on a missing outcome. These are different conditions and lead to different mechanism classifications.

Worked Examples

Worked Example: Dropout Risk Rises With the Recorded Score

Suppose a hypothetical study records a symptom score at visit 1 and follows participants to visit 2. A specified model for dropout before visit 2 is

$$ \operatorname{logit}(q_{i2})=-2+0.5(Y_{i1}-4), \qquad q_{i2}=\frac{\exp\{-2+0.5(Y_{i1}-4)\}} {1+\exp\{-2+0.5(Y_{i1}-4)\}}. $$

The score at visit 1 is observed for everyone at risk. At \(Y_{i1}=4\), the linear predictor is \(-2+0.5(4-4)=-2\), so

$$ q_{i2}=\frac{\exp(-2)}{1+\exp(-2)} =\frac{0.1353}{1.1353} \approx 0.1192. $$

The modeled dropout probability is about 11.9%. At the poorer recorded score \(Y_{i1}=8\), the linear predictor is \(-2+0.5(8-4)=0\), giving

$$ q_{i2}=\frac{\exp(0)}{1+\exp(0)} =\frac{1}{2}=0.5000. $$

Under this hypothetical model, dropout is more likely after a worse recorded score. If the model fully describes the mechanism—so there is no additional dependence on the unobserved visit-2 score—this is MAR given the recorded history. The model alone cannot verify that last assumption.

Worked Example: Comparing Dropout Proportions by Last Score

In a hypothetical visit-specific risk set, 30 participants have a poor last-recorded score and 70 have a less severe score. Before the next visit, 12 of the 30 in the poor-score group and 7 of the 70 in the other group drop out. Calculate the observed dropout proportions.

For the poor-score group, the proportion is \(12/30=0.400\), or 40.0%. For the other group, it is \(7/70=0.100\), or 10.0%. The difference is \(0.400-0.100=0.300\), or 30.0 percentage points.

These hypothetical data show that dropout is more frequent among participants with a poor recorded score in this risk set. Because that score was measured before the next visit, this pattern is consistent with dropout depending on observed history. It is not proof that dropout is MAR: the proportions do not reveal whether dropout also depends on the next, unobserved symptom score.

Worked Example: Changing the Conditioning History

Suppose two equally sized groups are at risk before a visit. Participants with a poor last-recorded score have dropout probability \(0.40\); participants with a less severe last score have probability \(0.10\). If the score is included in the conditioning history, these different probabilities depend on an observed value and can be compatible with MAR.

Now consider a model that conditions only on a baseline group label and omits the last score. If the baseline group contains half of each score group, its average dropout probability is

$$ (0.50)(0.40)+(0.50)(0.10)=0.20+0.05=0.25. $$

That 25% average does not imply that the true dropout probability is constant within the baseline group: it averages over different observed scores. Omitting the score may misrepresent the mechanism for analyses based on that reduced history. It does not change the underlying fact that the score is observed, nor does it turn the mechanism into MNAR when the full observed history is used.

Why the Classification Follows

The justification is the distinction between a recorded history and the outcomes still missing after dropout. For a participant who drops out before visit \(t\), the observed outcome history is \(Y_{i1},\ldots,Y_{i,t-1}\), while \(Y_{it},\ldots,Y_{iT}\) are missing. If the conditional dropout probability is a function only of the recorded history, then changing the values assigned to those missing outcomes does not change that probability.

$$ P(D_i=t \mid D_i\ge t,\, Y_{i1},\ldots,Y_{i,t-1},Y_{it},\ldots,Y_{iT}) = P(D_i=t \mid D_i\ge t,\, Y_{i1},\ldots,Y_{i,t-1}). $$

The same reasoning must hold for the dropout and continuation probabilities at each subsequent visit. Under monotone dropout, the probability of a complete observation pattern can be written as a product of these visit-specific probabilities. If every factor depends only on information observed before its corresponding dropout decision, the product depends on the observed history for that pattern, not on the missing outcomes. This is why a score-driven dropout mechanism can be MAR when the score is recorded before dropout.

Assumptions, Comparisons, and Failure Modes

This classification relies on a clear visit order and accurate information about which outcomes were actually recorded. It also assumes that the relevant last score is available in the history for the participants at risk. If dropout is decided before the score is measured, or the score is missing for another reason, it cannot be treated as an observed predictor for that decision without further assumptions. With several recorded predictors, the same principle applies: dependence on recorded history is compatible with MAR if the mechanism has no additional dependence on missing outcomes.

The contrast with MCAR is that MCAR requires the observation pattern to be independent of outcomes, whereas MAR permits dependence on observed outcomes. The contrast with MNAR is that MNAR involves dependence on outcomes that remain unobserved after conditioning on the observed data. These labels describe a mechanism relative to a stated conditioning set, as emphasized in the earlier material on why mechanism labels depend on the conditioning set.

A frequent error is to say, “Dropout is related to symptoms, so it must be MNAR.” That reasoning does not check whether the symptom score was observed before dropout. The correction is to identify the decision time and ask whether the relevant score belongs to the recorded history. A second error is to see a strong association between poor scores and dropout and declare MAR established. That is also too strong: the association is consistent with observed-history dependence, but the missing outcomes cannot be used to rule out additional dependence on them.

Useful checks are therefore conceptual as well as empirical. Confirm that the purported predictor was measured before the dropout decision; distinguish the last recorded score from the score at the missed visit; and state which history is being conditioned on. Observed dropout rates can describe how dropout varies across recorded histories, but they cannot, by themselves, determine whether missing outcomes also influenced leaving. The MAR assumption is not directly confirmed by observing the recorded data alone.

Key takeaway: Dropout after a poor last-observed symptom score can be MAR because the score is known at the time of dropout. The classification requires the further assumption that, after conditioning on the observed history, dropout does not depend on the unobserved outcomes.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. A participant reports a score of 9 at visit 2 and misses visit 3. Is the visit-3 dropout decision depending on a recorded or missing score if it depends on that score of 9?
  2. In a hypothetical risk set, 8 of 20 participants with poor last scores drop out, compared with 6 of 60 participants with other scores. Calculate both proportions and the difference.
  3. If dropout depends on the last recorded score and also on the unobserved score at the missed visit, is MAR given the observed outcome history justified?
  4. What changes when an analysis omits the last recorded score from its conditioning history?

Solutions. (1) It depends on a recorded score: the visit-2 score was observed before the missed visit 3. This is compatible with MAR, provided there is no additional dependence on missing outcomes. (2) The proportions are \(8/20=0.400\) and \(6/60=0.100\); the difference is \(0.400-0.100=0.300\), or 30.0 percentage points. (3) No. Dependence on the unobserved score remains after conditioning on the observed history, so the stated MAR condition is not satisfied. (4) The reduced history no longer includes an observed predictor of dropout. The mechanism may then be inadequately represented relative to that reduced conditioning set; omitting the score does not make it unobserved in the data or alter the full-history classification.

Clinical Biostats