Tutorials › Pattern-Mixture and Selection Models › Monotone Dropout Histories in Longitudinal Studies

Diggle-Kenward and Related Models · Tutorial 79 of 499

Monotone Dropout Histories in Longitudinal Studies

Learn to represent longitudinal observation histories by their last observed visit, recognize intermittent nonresponse, and check what a monotone pattern does—and does not—say about missing outcomes.

Advanced 10 min read

What You'll Learn

  • Define a monotone dropout history over a fixed schedule of visits.
  • Encode observed and unobserved outcomes with a visit-by-visit observation mask.
  • Use the last observed visit to label each monotone pattern.
  • Distinguish permanent dropout from a missed visit followed by later observation.
  • Count the possible monotone patterns and check whether recorded histories satisfy monotonicity.
  • Explain why a dropout pattern alone does not identify a missingness mechanism.

Why the Shape of a Missingness History Matters

In a longitudinal study, the order in which outcomes are observed can carry useful structural information. A participant who provides outcomes at the first two visits and then leaves follow-up has a different observation history from one who misses the second visit but returns at the third. The first history is a dropout pattern; the second is intermittent nonresponse. Distinguishing them is necessary before describing the missing-data patterns or choosing a model for them.

This tutorial considers a fixed schedule of \(K\) planned visits. Its purpose is to describe and encode observation histories—not to explain why participants drop out or to specify a model for the dropout process. A monotone pattern is a property of the observed-versus-missing record, not evidence by itself about whether missingness is ignorable or depends on unobserved outcomes.

Definition: For subject \(i\), let \(Y_{ij}\) denote the outcome scheduled at visit \(j\), for \(j=1,\ldots,K\). Define the observation mask \(O_{ij}\) to equal 1 if \(Y_{ij}\) is observed and 0 if it is missing. The history is monotone if, once an outcome is missing, all outcomes at later scheduled visits are also missing. Equivalently, \(O_{i,j+1}\leq O_{ij}\) for every \(j=1,\ldots,K-1\).

For a monotone history, the observed visits form an initial segment of the schedule. Define \(D_i\) as the number of consecutive observed visits from the start of follow-up. Thus \(D_i=0\) means no scheduled outcomes were observed, \(D_i=d\) for \(1\leq d<K\) means the first \(d\) outcomes were observed and all later ones were missing, and \(D_i=K\) means all scheduled outcomes were observed. Under this convention, \(D_i<K\) describes a history with incomplete follow-up; \(D_i=K\) is complete follow-up, not dropout before a scheduled visit.

$$ O_{ij} = \begin{cases} 1, & j \leq D_i,\\ 0, & j > D_i. \end{cases} $$

This convention assumes a defined cohort of enrolled subjects and a common set of planned visits. If the first planned measurement is at baseline, \(D_i=0\) records that none of the scheduled outcomes was observed. It does not, by itself, tell us whether the subject withdrew before baseline, was not measured for another reason, or had an outcome that was not recorded. Those circumstances require study-specific information.

Encoding Histories and Checking Monotonicity

An observation mask lists the status of each planned visit in order. For example, with four planned visits, \((1,1,0,0)\) records two observed outcomes followed by two missing outcomes, so \(D_i=2\). In contrast, \((1,0,1,0)\) is not monotone: visit 3 is observed after visit 2 is missing. That history contains intermittent nonresponse and cannot be represented by a single last-observed-visit value without losing information.

Worked Example: Encoding Four Scheduled Visits

Suppose a hypothetical study schedules outcomes at months 0, 3, 6, and 12. One participant has recorded values of 14, 12, missing, and missing points on a symptom scale, respectively. The visit-level mask is \((1,1,0,0)\). Because exactly the first two scheduled outcomes are observed, \(D_i=2\). The history is monotone: each zero is followed only by zeros.

A second participant has recorded values of 11, missing, 8, and 7 points. The mask is \((1,0,1,1)\). It is not monotone because \(O_{i2}=0\) but \(O_{i3}=1\). The participant missed the month-3 outcome and returned at month 6; this is intermittent nonresponse, not permanent dropout at month 3.

The distinction concerns the observed record, not the values themselves. The number 8 at month 6 does not turn the second history into a monotone one. Nor does a monotone mask establish why the later outcomes are absent.

Worked Example: Finding the Last Observed Visit

A hypothetical cohort has five planned visits. For one subject, the recorded outcome values are 6.2, 5.8, 5.1, missing, and missing units on a clinical scale. The mask is \((1,1,1,0,0)\). The last observed visit index is \(D_i=3\), so this subject belongs to the pattern with three initial observed visits.

For another subject, the mask is \((1,1,1,1,1)\), giving \(D_i=5=K\): complete follow-up. A third subject has \((0,0,0,0,0)\), giving \(D_i=0\). This is a valid monotone mask under the definition, although its real-world interpretation may require checking enrollment and measurement records.

The possible values of \(D_i\) are \(0,1,2,3,4,5\), one for each length of observed initial segment. There are six possible monotone patterns when \(K=5\).

Why a Last-Observed-Visit Label Is Enough

For a monotone history, \(D_i\) and the full mask contain exactly the same information about which visits were observed. To see this, take any monotone mask and let \(d\) be the number of initial ones. If \(d=0\), the first visit is missing, and monotonicity forces every later visit to be missing. If \(0<d<K\), the first \(d\) visits are observed; the next visit is missing, and monotonicity forces all subsequent visits to be missing. If \(d=K\), every visit is observed. In each case the mask must have the form \((1,\ldots,1,0,\ldots,0)\), with exactly \(d\) ones. Thus \(D_i\) uniquely determines the mask, and the mask uniquely determines \(D_i\).

$$ \#\{\text{monotone masks for }K\text{ visits}\}=K+1, \qquad D_i\in\{0,1,\ldots,K\}. $$

The count includes the all-missing history and the complete history. If a study’s definition of the analysis cohort excludes subjects with no observed outcomes, the patterns represented in that cohort may instead have \(D_i\in\{1,\ldots,K\}\), giving \(K\) patterns. The cohort rule changes which patterns are present; it does not change the definition of monotonicity.

Worked Example: Counting Patterns and Auditing a Record

A hypothetical longitudinal study schedules \(K=6\) outcome measurements. Under the definition above, the possible monotone masks are \((0,0,0,0,0,0)\), \((1,0,0,0,0,0)\), \((1,1,0,0,0,0)\), and so on through \((1,1,1,1,1,1)\). There are \(K+1=6+1=7\) such patterns.

Now consider a subject whose recorded mask is \((1,1,0,0,0,0)\). It has two initial ones and then only zeros, so \(D_i=2\); it is one of the seven possible monotone patterns. A second record is \((1,1,0,1,0,0)\). It is not among the seven: the fourth visit is observed after the third is missing. A check by adjacent visits finds \(O_{i4}=1\not\leq O_{i3}=0\), which directly violates monotonicity.

The seven-pattern count is a structural check, not a claim that all seven patterns occur in the sample. For instance, a study might have no participants with \(D_i=0\) or \(D_i=4\), while every individual record that is present still satisfies monotonicity.

What the Pattern Does—and Does Not—Establish

A monotone pattern is useful because it reduces a potentially long visit-by-visit record to a single label, \(D_i\). It can help organize outcome histories, tabulate how many subjects are complete at each visit, and describe which later outcomes are unavailable after an observed prefix. In pattern-mixture terminology, the label can identify a group with a particular observation pattern. That descriptive grouping does not supply the missing outcome values or determine their distribution.

In particular, observing that a participant has \(D_i=2\) does not show whether the probability of leaving follow-up was related to the participant’s health, to an unobserved future outcome, or to other factors. The same observed mask could arise under different missingness mechanisms. Identification and the assumptions used to extrapolate beyond observed data require separate arguments, as emphasized in the earlier material on identification.

For each record, monotonicity can be checked by scanning adjacent visits: a zero followed later by a one is a violation. If the intended study process permits participants to miss visits and return, those histories should not be forced into a single-dropout representation. If the intended process is permanent withdrawal but the database shows later outcomes, the discrepancy may indicate a coding, timing, or data-linkage issue. Conversely, a string of missing outcomes is not enough to prove that a participant formally withdrew; a reason for missingness must come from additional records or a clearly stated operational definition.

FeatureMonotone dropout historyIntermittent nonresponse
Typical mask\((1,1,1,0,0)\)\((1,0,1,0,1)\)
Observed visitsInitial consecutive segmentMay resume after a missed visit
Single \(D_i\) label captures the mask?Yes, given the fixed visit orderNo; the complete mask is needed
What the pattern alone says about the cause of missingnessNothing definitiveNothing definitive

Common Mistakes and Practical Limits

  • Calling every missing value dropout. One absent visit followed by a recorded outcome is intermittent nonresponse, not a monotone dropout history.
  • Assuming monotonicity reveals the missingness mechanism. A mask records which outcomes are observed, not why they are missing or how the unobserved outcomes are distributed.
  • Using only \(D_i\) when histories are nonmonotone. A single last-observed visit cannot represent a participant who later returns. Preserve the full visit-level mask in that case.
  • Confusing complete follow-up with dropout. Under this tutorial’s convention, \(D_i=K\) is complete follow-up; an incomplete history has \(D_i<K\).
  • Ignoring visit definitions and data quality. The encoding assumes visits are ordered and their observation status is known. Unclear windows, delayed measurements, or inconsistent record linkage can create apparent violations that need investigation.

The main alternatives are to retain the full observation mask for arbitrary missingness patterns or to use the last-observed-visit label when the patterns are monotone. The first representation is more general and preserves intermittent returns; the second is more compact and organizes subjects by dropout history. Neither representation is a substitute for a model of the outcome distribution or missingness process. In particular, a standard monotone pattern description should not be applied if the visit schedule differs across subjects unless the schedule and the definition of the observation history are first made explicit.

Key takeaway: With \(K\) ordered planned visits, a monotone history consists of an observed prefix followed by a missing suffix and is uniquely encoded by \(D_i\), the number of initial observed visits. A missed visit followed by a later observed outcome is intermittent nonresponse, and neither pattern alone explains why outcomes are missing.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. For four planned visits, is \((1,0,0,0)\) monotone? What is \(D_i\)?
  2. For five planned visits, classify \((1,1,0,1,0)\). Can a single \(D_i\) encode this history without losing information?
  3. How many monotone masks are possible for \(K=8\) visits if the all-missing pattern is included?
  4. Does a monotone mask prove that missingness depends on unobserved outcomes? Explain.

Solutions. (1) Yes. The observed outcomes form an initial segment of length one, so \(D_i=1\). (2) It is nonmonotone because visit 4 is observed after visit 3 is missing. A single \(D_i\) cannot encode the returning observation while preserving the full history; retain the mask. (3) There are \(K+1=8+1=9\) possible monotone masks, including all missing and complete follow-up. (4) No. Monotonicity describes the shape of the observation history. It does not establish why outcomes are missing or identify their relationship to unobserved outcomes.

Clinical Biostats