Why the Shape of a Missingness History Matters
In a longitudinal study, the order in which outcomes are observed can carry useful structural information. A participant who provides outcomes at the first two visits and then leaves follow-up has a different observation history from one who misses the second visit but returns at the third. The first history is a dropout pattern; the second is intermittent nonresponse. Distinguishing them is necessary before describing the missing-data patterns or choosing a model for them.
This tutorial considers a fixed schedule of \(K\) planned visits. Its purpose is to describe and encode observation histories—not to explain why participants drop out or to specify a model for the dropout process. A monotone pattern is a property of the observed-versus-missing record, not evidence by itself about whether missingness is ignorable or depends on unobserved outcomes.
For a monotone history, the observed visits form an initial segment of the schedule. Define \(D_i\) as the number of consecutive observed visits from the start of follow-up. Thus \(D_i=0\) means no scheduled outcomes were observed, \(D_i=d\) for \(1\leq d<K\) means the first \(d\) outcomes were observed and all later ones were missing, and \(D_i=K\) means all scheduled outcomes were observed. Under this convention, \(D_i<K\) describes a history with incomplete follow-up; \(D_i=K\) is complete follow-up, not dropout before a scheduled visit.
This convention assumes a defined cohort of enrolled subjects and a common set of planned visits. If the first planned measurement is at baseline, \(D_i=0\) records that none of the scheduled outcomes was observed. It does not, by itself, tell us whether the subject withdrew before baseline, was not measured for another reason, or had an outcome that was not recorded. Those circumstances require study-specific information.
Encoding Histories and Checking Monotonicity
An observation mask lists the status of each planned visit in order. For example, with four planned visits, \((1,1,0,0)\) records two observed outcomes followed by two missing outcomes, so \(D_i=2\). In contrast, \((1,0,1,0)\) is not monotone: visit 3 is observed after visit 2 is missing. That history contains intermittent nonresponse and cannot be represented by a single last-observed-visit value without losing information.
Worked Example: Encoding Four Scheduled Visits
Suppose a hypothetical study schedules outcomes at months 0, 3, 6, and 12. One participant has recorded values of 14, 12, missing, and missing points on a symptom scale, respectively. The visit-level mask is \((1,1,0,0)\). Because exactly the first two scheduled outcomes are observed, \(D_i=2\). The history is monotone: each zero is followed only by zeros.
A second participant has recorded values of 11, missing, 8, and 7 points. The mask is \((1,0,1,1)\). It is not monotone because \(O_{i2}=0\) but \(O_{i3}=1\). The participant missed the month-3 outcome and returned at month 6; this is intermittent nonresponse, not permanent dropout at month 3.
The distinction concerns the observed record, not the values themselves. The number 8 at month 6 does not turn the second history into a monotone one. Nor does a monotone mask establish why the later outcomes are absent.
Worked Example: Finding the Last Observed Visit
A hypothetical cohort has five planned visits. For one subject, the recorded outcome values are 6.2, 5.8, 5.1, missing, and missing units on a clinical scale. The mask is \((1,1,1,0,0)\). The last observed visit index is \(D_i=3\), so this subject belongs to the pattern with three initial observed visits.
For another subject, the mask is \((1,1,1,1,1)\), giving \(D_i=5=K\): complete follow-up. A third subject has \((0,0,0,0,0)\), giving \(D_i=0\). This is a valid monotone mask under the definition, although its real-world interpretation may require checking enrollment and measurement records.
The possible values of \(D_i\) are \(0,1,2,3,4,5\), one for each length of observed initial segment. There are six possible monotone patterns when \(K=5\).
Why a Last-Observed-Visit Label Is Enough
For a monotone history, \(D_i\) and the full mask contain exactly the same information about which visits were observed. To see this, take any monotone mask and let \(d\) be the number of initial ones. If \(d=0\), the first visit is missing, and monotonicity forces every later visit to be missing. If \(0<d<K\), the first \(d\) visits are observed; the next visit is missing, and monotonicity forces all subsequent visits to be missing. If \(d=K\), every visit is observed. In each case the mask must have the form \((1,\ldots,1,0,\ldots,0)\), with exactly \(d\) ones. Thus \(D_i\) uniquely determines the mask, and the mask uniquely determines \(D_i\).
The count includes the all-missing history and the complete history. If a study’s definition of the analysis cohort excludes subjects with no observed outcomes, the patterns represented in that cohort may instead have \(D_i\in\{1,\ldots,K\}\), giving \(K\) patterns. The cohort rule changes which patterns are present; it does not change the definition of monotonicity.
Worked Example: Counting Patterns and Auditing a Record
A hypothetical longitudinal study schedules \(K=6\) outcome measurements. Under the definition above, the possible monotone masks are \((0,0,0,0,0,0)\), \((1,0,0,0,0,0)\), \((1,1,0,0,0,0)\), and so on through \((1,1,1,1,1,1)\). There are \(K+1=6+1=7\) such patterns.
Now consider a subject whose recorded mask is \((1,1,0,0,0,0)\). It has two initial ones and then only zeros, so \(D_i=2\); it is one of the seven possible monotone patterns. A second record is \((1,1,0,1,0,0)\). It is not among the seven: the fourth visit is observed after the third is missing. A check by adjacent visits finds \(O_{i4}=1\not\leq O_{i3}=0\), which directly violates monotonicity.
The seven-pattern count is a structural check, not a claim that all seven patterns occur in the sample. For instance, a study might have no participants with \(D_i=0\) or \(D_i=4\), while every individual record that is present still satisfies monotonicity.
What the Pattern Does—and Does Not—Establish
A monotone pattern is useful because it reduces a potentially long visit-by-visit record to a single label, \(D_i\). It can help organize outcome histories, tabulate how many subjects are complete at each visit, and describe which later outcomes are unavailable after an observed prefix. In pattern-mixture terminology, the label can identify a group with a particular observation pattern. That descriptive grouping does not supply the missing outcome values or determine their distribution.
In particular, observing that a participant has \(D_i=2\) does not show whether the probability of leaving follow-up was related to the participant’s health, to an unobserved future outcome, or to other factors. The same observed mask could arise under different missingness mechanisms. Identification and the assumptions used to extrapolate beyond observed data require separate arguments, as emphasized in the earlier material on identification.
For each record, monotonicity can be checked by scanning adjacent visits: a zero followed later by a one is a violation. If the intended study process permits participants to miss visits and return, those histories should not be forced into a single-dropout representation. If the intended process is permanent withdrawal but the database shows later outcomes, the discrepancy may indicate a coding, timing, or data-linkage issue. Conversely, a string of missing outcomes is not enough to prove that a participant formally withdrew; a reason for missingness must come from additional records or a clearly stated operational definition.
| Feature | Monotone dropout history | Intermittent nonresponse |
|---|---|---|
| Typical mask | \((1,1,1,0,0)\) | \((1,0,1,0,1)\) |
| Observed visits | Initial consecutive segment | May resume after a missed visit |
| Single \(D_i\) label captures the mask? | Yes, given the fixed visit order | No; the complete mask is needed |
| What the pattern alone says about the cause of missingness | Nothing definitive | Nothing definitive |
Common Mistakes and Practical Limits
- Calling every missing value dropout. One absent visit followed by a recorded outcome is intermittent nonresponse, not a monotone dropout history.
- Assuming monotonicity reveals the missingness mechanism. A mask records which outcomes are observed, not why they are missing or how the unobserved outcomes are distributed.
- Using only \(D_i\) when histories are nonmonotone. A single last-observed visit cannot represent a participant who later returns. Preserve the full visit-level mask in that case.
- Confusing complete follow-up with dropout. Under this tutorial’s convention, \(D_i=K\) is complete follow-up; an incomplete history has \(D_i<K\).
- Ignoring visit definitions and data quality. The encoding assumes visits are ordered and their observation status is known. Unclear windows, delayed measurements, or inconsistent record linkage can create apparent violations that need investigation.
The main alternatives are to retain the full observation mask for arbitrary missingness patterns or to use the last-observed-visit label when the patterns are monotone. The first representation is more general and preserves intermittent returns; the second is more compact and organizes subjects by dropout history. Neither representation is a substitute for a model of the outcome distribution or missingness process. In particular, a standard monotone pattern description should not be applied if the visit schedule differs across subjects unless the schedule and the definition of the observation history are first made explicit.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions.
- For four planned visits, is \((1,0,0,0)\) monotone? What is \(D_i\)?
- For five planned visits, classify \((1,1,0,1,0)\). Can a single \(D_i\) encode this history without losing information?
- How many monotone masks are possible for \(K=8\) visits if the all-missing pattern is included?
- Does a monotone mask prove that missingness depends on unobserved outcomes? Explain.
Solutions. (1) Yes. The observed outcomes form an initial segment of length one, so \(D_i=1\). (2) It is nonmonotone because visit 4 is observed after visit 3 is missing. A single \(D_i\) cannot encode the returning observation while preserving the full history; retain the mask. (3) There are \(K+1=8+1=9\) possible monotone masks, including all missing and complete follow-up. (4) No. Monotonicity describes the shape of the observation history. It does not establish why outcomes are missing or identify their relationship to unobserved outcomes.