Tutorials › Pattern-Mixture and Selection Models › Deriving Neighboring-Case Constraints Across Visits

Identifying Restrictions · Tutorial 251 of 499

Deriving Neighboring-Case Constraints Across Visits

Learn to map missing visits to their neighboring observed patterns and derive the implied marginal distributions and means across visits.

Advanced 9 min read

What You'll Learn

  • Define monotone dropout patterns using the last visit observed.
  • Identify the nearest longer-followed pattern that observes a particular missing visit.
  • Write the neighboring-case distribution constraints across all visits.
  • Derive population visit margins and means using pattern weights.
  • Distinguish marginal borrowing from assumptions about joint outcomes or individual imputation.
  • Recognize when sparse or empty donor patterns limit the restriction.

From Adjacent Patterns to Constraints Across Visits

With monotone dropout, a participant is observed through some visit and then has no later outcomes recorded. A restriction that links only adjacent dropout patterns addresses the first missing visit after dropout. To specify restrictions for later missing visits too, we need a systematic way to find an observed counterpart for each one. The rule here is direct: for a missing outcome at visit \(j\), use its marginal distribution in the nearest longer-followed pattern that observed visit \(j\).

The rule is an identifying assumption, not a consequence of monotone dropout. It can supply missing pattern-specific distributions for population summaries, but it does not say that dropout is random, nor does it determine how the missing outcomes relate jointly to one another or to observed outcomes for the same participant.

Definition: Suppose outcomes \(Y_1,\ldots,Y_J\) are scheduled at visits \(1,\ldots,J\). Let \(C\) be the last visit observed, so pattern \(C=c\) contains outcomes \(Y_1,\ldots,Y_c\) and has \(Y_{c+1},\ldots,Y_J\) missing. For \(j\leq c\), define \(F_{j\mid c}\) as the distribution of \(Y_j\) among participants in pattern \(c\). For \(j>c\), \(F_{j\mid c}\) is the unobserved distribution of that outcome in pattern \(c\). The neighboring-case constraint across visits is \(F_{j\mid c}=F_{j\mid j}\) for every \(c<j\): the marginal distribution of a missing visit \(j\) in pattern \(c\) is set equal to the observed marginal distribution at visit \(j\) in pattern \(j\).

Patterns are ordered by how long participants were followed. For a missing visit \(j\) in pattern \(c<j\), patterns \(c+1,\ldots,j-1\) are longer-followed than pattern \(c\) but still do not observe visit \(j\). Pattern \(j\) is the first pattern in that ordering that does observe it. This is why the donor pattern is \(j\), rather than necessarily the immediately adjacent pattern \(c+1\).

The equality is marginal: it concerns \(Y_j\) alone within each pattern. In precise terms, for every measurable set \(A\),

$$ P(Y_j\in A\mid C=c)=P(Y_j\in A\mid C=j),\qquad c<j. $$

If the outcome has a finite mean, equality of distributions also equates the pattern-specific means. The rule does not, by itself, equate conditional distributions such as the distribution of \(Y_j\) given \(Y_1\), or specify the joint distribution of \(Y_{c+1},\ldots,Y_J\).

Deriving the Visit-Specific Population Margins

Let \(\pi_c=P(C=c)\) be the proportion in pattern \(c\), with \(\sum_{c=1}^J\pi_c=1\). For visit \(j\), patterns \(c\geq j\) observed that visit, while patterns \(c<j\) did not. Applying the law of total probability first gives the population distribution as a weighted sum of all the pattern-specific distributions. The constraints replace each unobserved distribution in that sum with its donor distribution:

$$ \begin{aligned} P(Y_j\in A) &=\sum_{c=1}^{J}\pi_c P(Y_j\in A\mid C=c)\\ &=\left(\sum_{c=1}^{j-1}\pi_c\right)P(Y_j\in A\mid C=j) +\sum_{c=j}^{J}\pi_c P(Y_j\in A\mid C=c). \end{aligned} $$

The first term combines all patterns that dropped out before visit \(j\); under the restriction, each contributes the same visit-\(j\) marginal as pattern \(j\). The remaining terms use distributions observed in their own patterns. If \(\mu_{j\mid c}=E(Y_j\mid C=c)\) exists, the corresponding population mean is

$$ E(Y_j)=\left(\sum_{c=1}^{j-1}\pi_c\right)\mu_{j\mid j} +\sum_{c=j}^{J}\pi_c\mu_{j\mid c}. $$

These expressions clarify what the restriction does: it fills in missing pattern-specific margins, after which the population margin follows by weighting patterns by their population proportions. The restriction is not a statement that all observed pattern means are equal. Patterns that observed visit \(j\) retain their own observed distributions in the sum.

1
List the dropout patterns.
Record each pattern’s last observed visit \(c\) and its pattern weight \(\pi_c\).
2
Match each missing outcome.
For a missing \(Y_j\) in pattern \(c<j\), use pattern \(j\), the shortest-followed pattern that observed visit \(j\).
3
Form the population margin.
Weight the observed pattern-specific distributions and the borrowed missing-pattern distributions by their pattern proportions.

Worked Implications

Worked Example: Four Visits and a Missing Third-Visit Mean

Consider a hypothetical study with four visits and 100 participants. The pattern counts are \(n_1=20\), \(n_2=15\), \(n_3=25\), and \(n_4=40\). Among participants in pattern 3, the observed mean at visit 3 is 12 points; among pattern 4 participants, the observed mean at visit 3 is 14 points. Assume outcomes are measured in points and that the relevant means are finite. Pattern 3 is present, so its visit-3 distribution can serve as the donor.

For patterns 1 and 2, visit 3 is missing. The restriction assigns both groups the pattern-3 visit-3 mean of 12 points. Pattern 3 has its observed mean of 12 points, and pattern 4 keeps its own observed mean of 14 points. The pattern proportions are \(0.20\), \(0.15\), \(0.25\), and \(0.40\). Therefore,

$$ \begin{aligned} E(Y_3) &=(0.20)(12)+(0.15)(12)+(0.25)(12)+(0.40)(14)\\ &=2.4+1.8+3.0+5.6\\ &=12.8\text{ points}. \end{aligned} $$

Equivalently, the first three patterns together contribute \(0.60\) of the population at the donor mean of 12 points, and pattern 4 contributes \(0.40\) at 14 points. The result is an assumed-restriction estimate of the population mean, not a mean calculated from observed visit-3 outcomes alone.

Worked Example: Binary Outcomes at Two Visits

In a hypothetical three-visit study, suppose the pattern counts are \(n_1=10\), \(n_2=20\), and \(n_3=30\). At visit 2, pattern 2 has 6 successes among 20 participants, and pattern 3 has 21 successes among 30. At visit 3, pattern 3 has 18 successes among 30. The binary outcome is coded as success or failure. All three patterns are represented, so the needed donor patterns have observed data.

For visit 2, pattern 1’s outcome is missing. Its success probability is constrained to equal the observed pattern-2 success proportion, \(6/20=0.30\). Pattern 2 also has proportion \(0.30\), while pattern 3 has observed proportion \(21/30=0.70\). Weighting these pattern-specific probabilities gives

$$ P(Y_2=1) =\frac{10(0.30)+20(0.30)+30(0.70)}{60} =\frac{3+6+21}{60} =0.50. $$

For visit 3, both patterns 1 and 2 borrow their marginal success probability from pattern 3, which is \(18/30=0.60\). Pattern 3 itself has the same observed proportion. Thus,

$$ P(Y_3=1) =\frac{10(0.60)+20(0.60)+30(0.60)}{60} =0.60. $$

These are visit-specific population proportions under the stated restrictions. The calculations do not establish a relationship between a participant’s visit-2 and visit-3 outcomes.

Worked Example: Borrowing a Visit Distribution, Not Individual Values

Suppose a hypothetical four-visit study has four participants in pattern 3, and their observed visit-3 outcomes, in points, are 4, 6, 10, and 12. Suppose patterns 1 and 2 also occur, and the pattern-3 distribution is used as the donor for their missing visit-3 outcomes. For this empirical distribution, the mean is

$$ \frac{4+6+10+12}{4}=8\text{ points}, \qquad \widehat{P}(Y_3\geq 10\mid C=3)=\frac{2}{4}=0.50. $$

The distributional constraint gives the same 8-point mean and the same 0.50 proportion at or above 10 points for patterns 1 and 2. If the pattern counts are 5, 3, and 4 for patterns 1, 2, and 3 respectively, the implied population mean is

$$ \frac{5(8)+3(8)+4(8)}{12}=8\text{ points}. $$

This is a statement about the assumed distribution within each pattern. It does not say that each participant in pattern 1 or 2 should receive one of the four donor values in a particular way, or that the observed donor values reveal their actual missing outcomes.

Assumptions, Diagnostics, and Alternatives

The construction requires a valid monotone pattern classification: pattern \(c\) must mean that visits through \(c\) are observed and later visits are not. It also requires a nonempty donor pattern \(j\) for every visit \(j\) whose missing margins are to be supplied. In a sample, an observed donor pattern is needed to estimate the donor distribution; a very small donor group can make that estimate unstable. For mean calculations, the relevant means must exist. These conditions make the procedure usable, but they do not make its identifying equality true.

A practical diagnostic is to check whether the observed-data layout really follows the assumed monotone pattern structure and whether every needed donor pattern has adequate data. Check the visit labels carefully: a one-visit indexing error changes which distribution is borrowed. Also distinguish pattern proportions from donor sample size. The population mean weights each dropout pattern by its own \(\pi_c\); it does not give every pattern equal weight merely because one pattern supplied the donor distribution.

The key untestable part is the equality involving a missing outcome: the data do not reveal \(F_{j\mid c}\) when \(c<j\). Observed data can describe \(F_{j\mid j}\) and the pattern weights, but cannot verify that the missing pattern has that same visit-\(j\) distribution. Results should therefore be understood as conditional on the restriction, rather than as empirical confirmation of it.

The earlier material on complete-case and available-case restrictions concerns different ways of constraining or combining pattern information. Here, the distinctive feature is the visit-by-visit donor match across patterns. Compared with a restriction limited to adjacent dropout patterns, this rule specifies a missing visit directly from the nearest pattern that actually observed that visit. It still supplies only marginal distributions. Additional assumptions would be needed to specify dependence among multiple missing visits or dependence between missing and observed outcomes.

Common pitfall: “Pattern 1 dropped out first, so every missing visit in pattern 1 should be borrowed from pattern 2.” This is wrong for visits that pattern 2 also missed. For missing \(Y_j\) in pattern \(c\), the donor must have observed visit \(j\); under monotone patterns, the nearest such pattern is \(j\). A second mistake is to treat equality of marginal distributions as a recipe for copying individual outcomes. The restriction equates distributions, not participant-level values or joint outcome histories.
Key takeaway: For each missing visit \(j\) in pattern \(c<j\), the neighboring-case constraint uses the observed visit-\(j\) distribution from pattern \(j\). Apply these constraints separately by visit, then combine pattern margins using the dropout-pattern proportions.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. In a five-visit study, which pattern supplies the constraint for missing \(Y_4\) in pattern 2?
  2. In a four-visit study, how many pairwise constraints \(F_{j\mid c}=F_{j\mid j}\) are specified across patterns with \(c\geq1\)?
  3. At visit 3, suppose patterns 1 and 2 each have proportion 0.20, pattern 3 has proportion 0.30, and pattern 4 has proportion 0.30. The donor pattern-3 mean is 10 points and the observed pattern-4 mean is 14 points. What is the implied population mean?
  4. Does the constraint for missing \(Y_3\) specify the joint distribution of \(Y_2\) and \(Y_3\) in a dropout pattern? Why or why not?
  5. What problem arises if pattern \(j\) is empty in the sample when it is needed as a donor?

Solutions. (1) Pattern 4: it is the shortest-followed pattern that observed visit 4. (2) There are \(4(4-1)/2=6\) constraints, one for each pair \(c<j\): three for \(j=2\), two for \(j=3\), and one for \(j=4\). (3) Patterns 1, 2, and 3 all contribute at the donor mean of 10 points, with total weight \(0.20+0.20+0.30=0.70\). Thus the mean is \((0.70)(10)+(0.30)(14)=7+4.2=11.2\) points. (4) No. It equates only the marginal distribution of \(Y_3\); it does not specify dependence between visits. (5) The donor distribution cannot be estimated from that sample, so this restriction cannot supply the missing margin without an additional modeling choice or data source.

Clinical Biostats