Tutorials › Pattern-Mixture and Selection Models › A Two-Visit Dropout Factorization Worked Example

Factorizations of the Joint Distribution · Tutorial 39 of 499

A Two-Visit Dropout Factorization Worked Example

Work through a binary two-visit dropout example, converting the full joint distribution into selection and pattern-mixture factors and calculating the induced observed-data likelihood.

Intermediate 12 min read

What You'll Learn

  • Code the three possible response patterns under two-visit monotone dropout.
  • Calculate pattern probabilities and conditional outcome distributions from a joint table.
  • Obtain selection probabilities by conditioning on the complete outcome.
  • Verify that selection and pattern-mixture factors give the same full-data joint probabilities.
  • Marginalize missing outcomes to calculate observed-data probabilities and a sample likelihood.
  • Check normalizations and identify common errors when interpreting the factors.

Setting Up a Two-Visit Dropout Example

With two outcome visits, monotone dropout allows a participant to miss the second visit only after having responded at the first. A useful way to understand the resulting factorizations is to begin with one complete joint distribution, enumerate the response patterns, and calculate each factor directly. This separates algebraic identities from assumptions about how missingness arose.

Let \(Y=(Y_1,Y_2)\) denote the two outcomes, and let \(R=(R_1,R_2)\), where \(R_t=1\) means \(Y_t\) is observed and \(R_t=0\) means it is missing. Under monotone dropout, \(R_2\leq R_1\). Suppose, purely for illustration, that both outcomes are binary. The possible response patterns are \(11\), \(10\), and \(00\); pattern \(01\) is excluded by monotonicity.

Definition: A response pattern is the vector \(r=(r_1,r_2)\) indicating which visit outcomes are observed. In this two-visit monotone-dropout example, \(11\) means both outcomes are observed, \(10\) means only the first is observed, and \(00\) means neither is observed. The selection factorization writes the full joint law as \(p(y)p(r\mid y)\); the pattern-mixture factorization writes that same full joint law as \(p(r)p(y\mid r)\). The observed-data law is induced by this joint law by summing over outcomes that are missing.

The example below specifies a hypothetical joint distribution for the complete outcome pair and response pattern. In rows with \(R=10\) or \(R=00\), \(Y_2\) is included to describe the full joint law even though it is not observed. This is a mathematical description of the complete-data distribution, not a claim that missing outcomes were actually measured.

Response pattern \(r\)\(Y_1Y_2=00\)\(Y_1Y_2=01\)\(Y_1Y_2=10\)\(Y_1Y_2=11\)\(P(R=r)\)
110.120.090.050.140.40
100.080.040.100.080.30
000.120.060.070.050.30

The entries are joint probabilities \(P(Y_1=y_1,Y_2=y_2,R=r)\). Each row sums to its pattern probability, and the three pattern probabilities sum to one. For example, the \(10\) row sums to \(0.08+0.04+0.10+0.08=0.30\). The outcome margins, found by adding down each outcome column, are \(P(Y=00)=0.32\), \(P(Y=01)=0.19\), \(P(Y=10)=0.22\), and \(P(Y=11)=0.27\); these also sum to one.

Worked Example: Enumerating the Patterns and Their Probabilities

For the joint distribution above, list the allowable response patterns and calculate the probability of each. Then give the probability of observing \(Y_1=1\) among participants with pattern \(10\).

Since \(R_2\leq R_1\), if \(R_1=0\), then \(R_2\) must also be zero. If \(R_1=1\), then \(R_2\) can be either zero or one. Thus the allowable patterns are \(11\), \(10\), and \(00\), with \(01\) ruled out.

Sum each row of the joint table to obtain the pattern probabilities:

$$ \begin{aligned} P(R=11)&=0.12+0.09+0.05+0.14=0.40,\\ P(R=10)&=0.08+0.04+0.10+0.08=0.30,\\ P(R=00)&=0.12+0.06+0.07+0.05=0.30. \end{aligned} $$

For pattern \(10\), \(Y_1=1\) occurs in the \(10\) and \(11\) outcome columns, whose joint probabilities with that pattern are \(0.10\) and \(0.08\). Therefore,

$$ P(Y_1=1\mid R=10) =\frac{0.10+0.08}{0.30} =\frac{0.18}{0.30} =0.60. $$

The denominator is the probability of the pattern, and the numerator is the probability of both the pattern and the specified observed outcome. The calculation is valid because \(P(R=10)=0.30>0\).

Calculating Both Full-Joint Factorizations

For each complete outcome \(y=(y_1,y_2)\), the outcome margin is \(p(y)=\sum_r p(y,r)\). The selection factorization uses this margin and the conditional pattern probabilities \(p(r\mid y)=p(y,r)/p(y)\). The pattern-mixture factorization instead uses \(p(r)=\sum_y p(y,r)\) and \(p(y\mid r)=p(y,r)/p(r)\). These divisions are defined here because all the relevant margins are positive.

For example, at \(Y=10\), the four quantities needed for the selection factorization are:

$$ \begin{aligned} p(Y=10)&=0.05+0.10+0.07=0.22,\\ p(R=11\mid Y=10)&=\frac{0.05}{0.22}\approx0.2273,\\ p(R=10\mid Y=10)&=\frac{0.10}{0.22}\approx0.4545,\\ p(R=00\mid Y=10)&=\frac{0.07}{0.22}\approx0.3182. \end{aligned} $$

The conditional pattern probabilities sum to one, up to rounding. For the pattern-mixture factorization, the conditional probabilities of the four outcome pairs within each pattern are:

$$ \begin{aligned} p(Y\mid R=11)&=(0.3000,\ 0.2250,\ 0.1250,\ 0.3500),\\ p(Y\mid R=10)&\approx(0.2667,\ 0.1333,\ 0.3333,\ 0.2667),\\ p(Y\mid R=00)&\approx(0.4000,\ 0.2000,\ 0.2333,\ 0.1667), \end{aligned} $$

Within each line, the entries are ordered \(00,01,10,11\). Each line sums to one. These are distributions for the complete outcome pair conditional on a pattern, including outcomes that would be unobserved under that pattern.

Worked Example: Converting a Joint Cell in Both Directions

Use the joint cell \(Y=10,R=10\) to verify the selection and pattern-mixture factorizations.

The joint table gives \(p(Y=10,R=10)=0.10\). From the outcome margin and selection calculation above,

$$ p(Y=10)p(R=10\mid Y=10) =0.22\left(\frac{0.10}{0.22}\right) =0.10. $$

For the pattern-mixture factorization, \(p(R=10)=0.30\), and the conditional probability of \(Y=10\) within that pattern is \(0.10/0.30=1/3\). Hence,

$$ p(R=10)p(Y=10\mid R=10) =0.30\left(\frac{0.10}{0.30}\right) =0.10. $$

Both products recover the same full-joint cell. This is an identity obtained by conditioning the same joint distribution in two different orders; the numbers do not establish that either factorization is a scientifically adequate model for a particular study.

Why the Two Products Agree

The equality can be justified for any cell with positive joint probability. By the definition of conditional probability, \(p(r\mid y)=p(y,r)/p(y)\) and \(p(y\mid r)=p(y,r)/p(r)\). Multiplying by the corresponding marginal recovers the joint cell:

$$ p(y)p(r\mid y)=p(y,r)=p(r)p(y\mid r). $$

This calculation is the complete justification for the conversion in this discrete example. In a model with zero-probability margins, a conditional distribution given that zero-probability event is not defined by division; the displayed identity applies to cells for which the relevant conditionals are defined. For the table here, all outcome and pattern margins are positive.

The distinction between the full-joint factorizations and the observed-data law matters. The two products above describe \(p(y,r)\), including complete outcomes that are missing under some patterns. The observed-data law describes only the quantities available from the recorded data, and is obtained by summing the full joint probabilities over the missing outcome components.

Marginalizing to the Observed-Data Law

For pattern \(11\), both outcomes are observed, so the observed-data probability for a record \((y_1,y_2,11)\) is the corresponding joint cell. For pattern \(10\), only \(Y_1\) is observed, so sum over both possible values of \(Y_2\). For pattern \(00\), neither outcome is observed, so sum over all four outcome pairs.

$$ \begin{aligned} p(Y_1=0,R=10)&=p(00,10)+p(01,10)=0.08+0.04=0.12,\\ p(Y_1=1,R=10)&=p(10,10)+p(11,10)=0.10+0.08=0.18,\\ p(R=00)&=\sum_{y_1,y_2}p(y_1,y_2,R=00)=0.30. \end{aligned} $$

The notation \(p(00,10)\), for instance, denotes \(p(Y=00,R=10)\). The observed-data probabilities for \(R=10\) sum to \(0.12+0.18=0.30=P(R=10)\); adding the \(11\) probability mass \(0.40\) and the \(00\) mass \(0.30\) gives one. This checks that the observed-data distribution is normalized.

Worked Example: An Observed-Data Likelihood

Suppose a hypothetical sample of 20 participants has the following observed records: among the eight with pattern \(11\), there are three \(00\), two \(01\), one \(10\), and two \(11\) outcomes; among the six with pattern \(10\), two have observed \(Y_1=0\) and four have observed \(Y_1=1\); the remaining six have pattern \(00\). Calculate the likelihood under the specified joint distribution and its log.

The pattern counts are \(8+6+6=20\), as required. Each complete record in pattern \(11\) contributes its joint cell probability. A record with pattern \(10\) contributes the marginalized probability for its observed \(Y_1\), and a record with pattern \(00\) contributes \(P(R=00)\). Thus the observed-data likelihood is

$$ \begin{aligned} L_{\mathrm{obs}} &=(0.12)^3(0.09)^2(0.05)^1(0.14)^2 (0.12)^2(0.18)^4(0.30)^6. \end{aligned} $$

The first four factors correspond, in order, to the four \(11\) outcome counts. The next two are the marginalized \(10\) probabilities, not full outcome-pair probabilities. The final factor is the probability of the \(00\) response pattern. Taking natural logarithms gives:

$$ \begin{aligned} \log L_{\mathrm{obs}} ={}&3\log(0.12)+2\log(0.09)+\log(0.05)+2\log(0.14)\\ &+2\log(0.12)+4\log(0.18)+6\log(0.30)\\ \approx{}&-36.4282. \end{aligned} $$

The exponents in the log expression match the likelihood term by term. This is the likelihood of these observed records under the fixed numerical distribution; it is not an estimate of model parameters, since no parameterized model is being fitted here.

Assumptions, Checks, and Common Errors

The numerical exercise assumes that the displayed entries form a joint probability distribution: every entry is nonnegative and all entries sum to one. It also uses the monotone response-pattern restriction, the binary outcome support, and positive margins wherever a conditional probability is calculated. No missing-at-random, independence, or ignorability assumption is needed for the algebraic conversion. In an application, additional modeling assumptions might be required to interpret or estimate factors, but they are not implied by this table.

Useful checks for this calculation are direct and should be done before interpreting any factor:

  • Each joint-table entry must be nonnegative, and all cells must sum to one.
  • Pattern probabilities must equal their row sums, and outcome margins must equal their column sums.
  • Conditional probabilities within a fixed conditioning value must sum to one, allowing for rounding.
  • For a pattern with missing outcomes, the observed probability must sum the joint cells across every possible value of each missing outcome.
  • Each record type in a likelihood must use its observed-data probability, rather than a probability for an unobserved complete outcome.

A common mistake is to call the observed-data law a third factorization of the full joint law. It is not: the selection and pattern-mixture expressions factor the full joint law, while the observed-data law is a marginal distribution induced by it. A related error is to use \(p(Y=y,R=10)\) as the probability of observing only \(Y_1=y_1\) with pattern \(10\). The correct observed-data probability is \(\sum_{y_2}p(Y_1=y_1,Y_2=y_2,R=10)\), because \(Y_2\) is unobserved and either value is compatible with that record.

The selection representation organizes the joint law by the outcome distribution and response probabilities conditional on the complete outcome. The pattern-mixture representation organizes it by pattern frequencies and outcome distributions within patterns. The observed-data law retains only distributions of recorded quantities. These are complementary descriptions, but the full-data factors involving unobserved outcomes are not necessarily identifiable from observed data alone. The example calculates them because a complete numerical joint distribution was stipulated; it does not show that a real dataset uniquely determines them.

Key takeaway: First calculate the full joint table and its margins. Then obtain selection factors by conditioning on \(Y\), or pattern-mixture factors by conditioning on \(R\). To get an observed-data probability, sum over every outcome component that the response pattern leaves missing.

Check Your Understanding

Use the hypothetical joint table in this tutorial. Give each answer in terms of the table, and check that probabilities are properly normalized.

  1. What is \(P(Y=01)\), and what is \(P(R=11\mid Y=01)\)?
  2. Calculate \(P(Y_1=0,R=10)\) and \(P(Y_1=0\mid R=10)\).
  3. Verify the pattern-mixture product for the cell \(Y=00,R=00\).
  4. Why does a pattern \(01\) have probability zero in this example?
  5. For one participant observed with \(R=10\) and \(Y_1=1\), what probability contributes to the observed-data likelihood, and why?

Solutions. (1) \(P(Y=01)=0.09+0.04+0.06=0.19\), so \(P(R=11\mid Y=01)=0.09/0.19\approx0.4737\). (2) \(P(Y_1=0,R=10)=0.08+0.04=0.12\), and \(P(Y_1=0\mid R=10)=0.12/0.30=0.40\). (3) The pattern probability is \(0.30\), and \(P(Y=00\mid R=00)=0.12/0.30=0.40\); their product is \(0.30(0.40)=0.12\), the joint cell. (4) Monotone dropout requires \(R_2\leq R_1\), but \(01\) has \(R_1=0\) and \(R_2=1\). (5) The contribution is \(P(Y_1=1,R=10)=0.10+0.08=0.18\), summing over both possible values of the unobserved \(Y_2\).

Clinical Biostats