Tutorials › Pattern-Mixture and Selection Models › Pattern Labels and Conditional Outcome Distributions

Identifying Restrictions · Tutorial 233 of 499

Pattern Labels and Conditional Outcome Distributions

Learn to label monotone dropout patterns and express outcome distributions conditional on each pattern’s observed history.

Advanced 10 min read

What You'll Learn

  • Define the last-observed-visit index for monotone dropout.
  • Write the observed history and the conditional law of future outcomes within a pattern.
  • Distinguish pattern-specific distributions from distributions among people observed at a visit.
  • Identify complete-case, available-case, and neighboring-pattern labels without treating them as assumptions.
  • Check when conditional distributions can be compared and recognize what the observed data do not reveal.

Why Pattern Labels Need Precise Notation

A pattern-mixture analysis organizes people by their missingness patterns and describes outcomes within those groups. The pattern label is not itself a model for the outcomes: it tells us which visits were observed. To state a restriction about missing outcomes precisely, we also need to specify the outcome being described and the information on which its distribution is conditioned.

For a study with scheduled visits, monotone dropout gives a particularly simple set of labels. Each participant has an observed prefix of visits followed by a missing suffix. Once that pattern is named, we can distinguish the distribution of outcomes within a pattern from the distribution conditional on that pattern’s observed history. These distinctions are essential when describing complete-case, available-case, or neighboring-case restrictions; the labels alone do not imply any of those restrictions.

Definition: Suppose outcomes \(Y_1,\ldots,Y_T\) are scheduled after baseline, and baseline covariates \(X\) are observed for everyone. Let \(R_j=1\) if \(Y_j\) is observed and \(R_j=0\) otherwise. Missingness is monotone when \(R_1\ge R_2\ge\cdots\ge R_T\) for every participant. Define \(K=\sum_{j=1}^T R_j\), the index of the last observed visit. Thus \(K\in\{0,\ldots,T\}\); \(K=0\) means no scheduled outcome was observed, and \(K=T\) identifies complete cases.

Under this definition, pattern \(K=k\) means that \(Y_1,\ldots,Y_k\) are observed and \(Y_{k+1},\ldots,Y_T\) are missing. The convention for \(k=0\) is that the observed outcome history is empty. If a study has intermittent missingness, such as an unobserved \(Y_2\) followed by an observed \(Y_3\), the monotone pattern labels do not describe it without an additional rule. Do not silently classify such a record as monotone dropout.

Histories and Pattern-Specific Laws

Write the observed history in pattern \(k\) as \(H_k=(X,Y_1,\ldots,Y_k)\). In particular, \(H_0=X\). The history is the information on which a conditional outcome distribution may depend. For \(j>k\), the outcome \(Y_j\) is missing in pattern \(k\), but its conditional distribution can still be defined as a feature of the joint data-generating distribution.

Definition: The pattern-specific conditional distribution of a future outcome \(Y_j\), for \(j>k\), is \(F_{j\mid k}(y\mid h_k)=P(Y_j\le y\mid H_k=h_k,K=k)\). The joint conditional distribution of all future outcomes is \(\mathcal L(Y_{k+1:T}\mid H_k=h_k,K=k)\), where \(Y_{a:b}\) denotes the vector \((Y_a,\ldots,Y_b)\). For \(k=T\), there are no future outcomes, so this future vector is empty.

The condition \(K=k\) matters. A conditional distribution among people who stop after visit \(k\) is not automatically the same as one among people who continue beyond that visit, even when their recorded histories match. Also distinguish the conditional law above from the full pattern-specific law \(\mathcal L(Y_{1:T}\mid X=x,K=k)\). The latter describes the complete outcome vector within pattern \(k\) at covariate value \(x\); the former conditions on the pattern’s observed outcomes as well as \(X\).

These are definitions of distributions, not claims that every distribution can be estimated from observed data. For \(j>k\), \(Y_j\) is unobserved in pattern \(k\), so its conditional distribution there is not directly tabulated from that pattern’s records. An assumption or model is needed to connect such an unobserved distribution to observed information. That distinction is especially important when later specifying identifying restrictions.

Worked Example: Assigning Monotone Pattern Labels

Consider a hypothetical study with \(T=3\) follow-up visits. The observed-visit indicators for four participants are \((1,1,1)\), \((1,1,0)\), \((1,0,0)\), and \((0,0,0)\). Assign each participant’s pattern label and history.

For \((1,1,1)\), \(K=1+1+1=3\). This is the complete-case pattern; the observed history is \(H_3=(X,Y_1,Y_2,Y_3)\).

For \((1,1,0)\), \(K=1+1+0=2\). This participant belongs to pattern \(K=2\), with \(H_2=(X,Y_1,Y_2)\); \(Y_3\) is missing.

For \((1,0,0)\), \(K=1\). The history is \(H_1=(X,Y_1)\), and \(Y_2,Y_3\) are missing. For \((0,0,0)\), \(K=0\), so the history is \(H_0=X\), with all three scheduled outcomes missing.

Every indicator sequence is a string of observed visits followed by missing visits, so all four records satisfy monotonicity. A sequence such as \((1,0,1)\) would not: it has an observed visit after a missed one and cannot be assigned one of these last-observed-visit patterns without changing the data or the pattern definition.

From Conditional Laws to a Pattern Mixture

Pattern-specific distributions are components of a population distribution. Let \(\pi_k(x)=P(K=k\mid X=x)\) be the probability of pattern \(k\) at covariate value \(x\), and let \(\mathcal F_k(\cdot\mid x)\) denote the distribution of the full outcome vector \(Y_{1:T}\) conditional on \(X=x,K=k\). The pattern-mixture representation combines these components using the pattern probabilities.

$$ P(Y_{1:T}\in A\mid X=x) = \sum_{k=0}^{T}\pi_k(x)\, P(Y_{1:T}\in A\mid X=x,K=k) $$

Here \(A\) is any set of possible outcome vectors. This identity follows by partitioning the event \(Y_{1:T}\in A\) according to the mutually exclusive and exhaustive values of \(K\), conditional on \(X=x\):

$$ \begin{aligned} P(Y_{1:T}\in A\mid X=x) &=\sum_{k=0}^{T}P(Y_{1:T}\in A,K=k\mid X=x)\\ &=\sum_{k=0}^{T}P(K=k\mid X=x) P(Y_{1:T}\in A\mid X=x,K=k). \end{aligned} $$

The second equality is the conditional product rule. The identity is a bookkeeping decomposition, not an identifying assumption: it does not tell us how to determine the unobserved parts of \(\mathcal F_k\). Within each pattern, the conditional laws given \(H_k\) provide a more detailed description of those components.

Worked Example: A Visit-Specific Distribution Among Available Participants

In a hypothetical three-visit study, suppose 3 participants have \(K=2\) and their observed \(Y_2\) values are 8, 10, and 12 points. Suppose 6 participants have \(K=3\), with observed \(Y_2\) values 6, 9, 10, 10, 11, and 14 points. Participants with \(K=0\) or \(K=1\) do not have an observed \(Y_2\).

The participants observed at visit 2 are exactly those with \(K\ge2\): there are \(3+6=9\) of them. Their pattern weights within this observed group are \(3/9\) for \(K=2\) and \(6/9\) for \(K=3\).

The \(K=2\) mean at visit 2 is \((8+10+12)/3=10\) points. The \(K=3\) mean is \((6+9+10+10+11+14)/6=60/6=10\) points. Pooling all nine observed values gives \((30+60)/9=90/9=10\) points. In this example, the pooled mean equals each pattern mean, but that equality is a feature of these hypothetical values, not a property guaranteed by the pattern labels.

The pooled empirical distribution can also be checked at a threshold. Six of the nine \(Y_2\) values are at most 10, so the observed proportion at or below 10 points is \(6/9=0.667\). The calculation uses only patterns in which visit 2 is observed. It says nothing directly about \(Y_2\) in the \(K=0\) and \(K=1\) patterns.

How the Labels Organize Restrictions

The terms used for common pattern-mixture restrictions refer to different groups or comparisons. A complete-case label refers to \(K=T\). For a particular visit \(j\), the available-case group consists of participants with \(K\ge j\), since they have an observed \(Y_j\). A neighboring-case comparison refers to adjacent pattern labels, such as \(K=k\) and \(K=k+1\). These names identify which pattern-specific distributions are involved; they do not state that those distributions are equal or otherwise related.

The conditional distribution notation also makes the conditioning set explicit. For example, a comparison at the boundary between \(K=k\) and \(K=k+1\) may involve the future outcome \(Y_{k+1}\) conditional on a history through \(Y_k\). If the compared distributions are conditioned on different histories, they are not directly the same conditional quantity. Any substantive restriction must state its conditioning variables and the outcome law it relates.

Worked Example: Writing a Conditional Law at a Pattern Boundary

Suppose a hypothetical study measures blood pressure at three visits, and consider participants with the same recorded baseline covariates and visit-1 and visit-2 measurements, \(H_2=(x,120,128)\) mmHg. In pattern \(K=2\), visit 3 is unobserved. In pattern \(K=3\), visit 3 is observed.

The pattern-\(K=2\) conditional distribution for the missing visit-3 measurement is written \(F_{3\mid2}(y\mid H_2=(x,120,128))\). It describes \(Y_3\) among people with \(K=2\) and that recorded history. The corresponding observed-outcome conditional distribution in pattern \(K=3\) is written \(P(Y_3\le y\mid H_2=(x,120,128),K=3)\).

For illustration only, suppose a hypothetical model assigns the first conditional mean as \(0.5(120)+0.25(128)+2=94\) mmHg, and a separate hypothetical model assigns the second as \(0.4(120)+0.3(128)+3=89.4\) mmHg. These calculations show how pattern and history appear in the notation; they do not establish either model or a restriction connecting them. Since \(Y_3\) is missing in pattern \(K=2\), that pattern’s conditional mean cannot be checked from its observed visit-3 values.

Diagnostics, Comparisons, and Limits

Before interpreting pattern-specific distributions, check that the pattern labels match the recorded data and that the conditioning information is clearly specified. Common warning signs include nonmonotone records being forced into a monotone scheme, sparse patterns, and a conditional comparison being described without saying which history is held fixed. For a conditional comparison, also check whether the relevant history values occur in both patterns. If they do not, a model-based comparison at those values relies on extrapolation.

Pattern-mixture and selection models organize the joint distribution differently. A pattern-mixture description specifies outcome distributions by missingness pattern and combines them with pattern probabilities. A selection-model description instead factors the joint distribution into an outcome distribution and a model for the missingness process conditional on outcomes or covariates. Neither factorization by itself resolves what the observed data leave unobserved. The notation here supports pattern-specific descriptions; it does not provide a method for choosing or verifying a restriction.

A further limitation is that \(K\) records only the last observed visit. It does not encode the reasons for dropout, measurement timing deviations, or unrecorded features of the observation process. If those features matter, a richer pattern definition may be needed, with its assumptions made explicit. Even with a well-defined pattern variable, conditional distributions can be unstable when few participants occupy a pattern or when histories have little overlap.

Common pitfall: “Visit 3 is observed for complete cases, so the observed distribution in \(K=T\) is the distribution of \(Y_3\) for everyone.” This treats a pattern-specific distribution as a population distribution. The correction is to label the conditioning event: the complete-case distribution is conditional on \(K=T\); extending it to other patterns requires an additional restriction, not just a relabeling.

Check Your Understanding

Answer each question using the pattern and conditional-distribution definitions above. Brief solutions follow the questions.

  1. For \(T=4\), what pattern label and history correspond to \((R_1,R_2,R_3,R_4)=(1,1,0,0)\)?
  2. In a three-visit study, which pattern labels contribute observed \(Y_2\) values to the available-case group at visit 2?
  3. Write the conditional distribution of the missing \(Y_4\) among participants in pattern \(K=3\), given their observed history.
  4. Why does the definition of \(F_{4\mid3}\) not mean that its values can be directly calculated from observed visit-4 outcomes in pattern \(K=3\)?
  5. A record has indicators \((1,0,1)\). Does it satisfy monotone dropout as defined here? Explain.

Solutions. (1) \(K=2\), with \(H_2=(X,Y_1,Y_2)\); visits 3 and 4 are missing. (2) Patterns \(K=2\) and \(K=3\), because \(K\ge2\) is exactly the condition that visit 2 is observed. (3) Write \(P(Y_4\le y\mid H_3=h_3,K=3)\), or \(F_{4\mid3}(y\mid h_3)\). (4) \(Y_4\) is missing whenever \(K=3\), so the conditional law is defined in the joint distribution but is not directly observed in that pattern. (5) No. The visit-3 observation follows a missed visit 2, violating \(R_1\ge R_2\ge R_3\).

Clinical Biostats