Why factor outcomes within a response pattern?
A pattern-mixture representation describes the outcome distribution separately for each response pattern. Within one such pattern, the outcomes can themselves be described visit by visit: the distribution at a visit may depend on baseline information and on the outcomes at earlier visits. This sequential view makes the pattern-specific distribution easier to interpret and can support models built from familiar conditional distributions.
The key point is that writing a distribution as a sequence of conditional distributions is an exact probability identity. It does not say that outcomes at different visits are independent, and it does not specify which parametric distributions should be used. Those would be additional modeling choices.
The sequential factorization and its conditions
The displayed factorization is the chain rule applied to the conditional joint distribution of \(Y\) after fixing \(R=r\) and \(X=x\). It applies to discrete outcomes through probability mass functions, to continuous outcomes through densities, and to mixed outcome types using the corresponding conditional distributions. For continuous variables, the product is a joint density, not the probability of observing one exact outcome vector.
The factor \(f_{rt}\) is conditional on the whole pattern \(R=r\), as well as on baseline covariates and earlier outcomes. Thus, a later-visit conditional distribution can differ between patterns even when the earlier outcome history and baseline covariates are the same. The response pattern is part of the conditioning information; it is not replaced by the earlier outcome history.
The identity requires a well-defined joint conditional distribution and conditional distributions at the histories being considered. In discrete settings, a factor is needed only for histories with positive conditional probability under \(R=r,X=x\). In continuous settings, conditional distributions are understood in the usual almost-everywhere sense. No assumption of independent outcomes, missing at random, or a particular regression form is needed for the identity itself.
To see the justification, the definition of conditional probability (or conditional density) gives the two-part identity whenever the conditioning event has positive probability. Apply it first to \(Y_1\) and \(Y_2\), then to the resulting history and \(Y_3\), continuing through the visits:
This derivation does not require the successive factors to have the same functional form or parameters. Each can be modeled separately, and a model may include interactions between pattern, baseline covariates, and earlier outcomes. But the factorization alone neither estimates those factors nor establishes that a particular model fits.
Worked Example: A Two-Visit Binary Outcome Distribution
Consider a hypothetical study with binary outcomes \(Y_1\) and \(Y_2\), and fix one baseline covariate value \(X=x\) and one response pattern \(R=r\). Suppose the pattern-specific conditional probabilities are \(P(Y_1=1\mid R=r,X=x)=0.60\), \(P(Y_2=1\mid Y_1=1,R=r,X=x)=0.70\), and \(P(Y_2=1\mid Y_1=0,R=r,X=x)=0.25\). These are stipulated model probabilities for illustration, not observations from a real study.
For the outcome pair \((Y_1,Y_2)=(1,1)\), the sequential factorization gives \(P(Y_1=1,Y_2=1\mid R=r,X=x)=0.60\times0.70=0.42\). Thus the probability of this pair within the specified pattern and baseline stratum is \(0.42\).
For \((Y_1,Y_2)=(0,1)\), the calculation is \(P(Y_1=0,Y_2=1\mid R=r,X=x)=(1-0.60)\times0.25=0.40\times0.25=0.10\). Adding the two ways for \(Y_2\) to equal 1 gives \(P(Y_2=1\mid R=r,X=x)=0.42+0.10=0.52\).
The conditional probability for \(Y_2\) depends on \(Y_1\), so treating the visits as independent would not reproduce these probabilities. The factors are conditional distributions, not marginal visit distributions.
Pattern-specific factors need not be the same
The pattern index on each factor is substantive. It allows the outcome distribution among people in one response pattern to differ from that among people in another pattern. A sequential model that omits the pattern index, or constrains its effects to be identical across patterns, imposes additional restrictions; those restrictions are not consequences of the chain rule.
Worked Example: Continuous Outcomes and a Conditional Normal Model
Suppose, hypothetically, that within a particular pattern \(r\) and baseline stratum \(X=x\), a two-visit model is \(Y_1\sim N(5,4)\), and \(Y_2\mid Y_1=y_1,R=r,X=x\sim N(2+0.5y_1,9)\). Here the second argument of each normal distribution is the variance. These are assumed model distributions for this pattern, not claims about a real study.
The joint density is the product of the first-visit density and the second-visit conditional density: \(f(y_1,y_2\mid R=r,X=x)=f_1(y_1\mid r,x)f_{r2}(y_2\mid y_1,x)\). At \(y_1=6\), the conditional mean for \(Y_2\) is \(2+0.5(6)=5\). At the point \((6,4)\), the first density is \(\frac{1}{\sqrt{2\pi(4)}}\exp[-(6-5)^2/(2(4))]\approx0.1760\). The second conditional density is \(\frac{1}{\sqrt{2\pi(9)}}\exp[-(4-5)^2/(2(9))]\approx0.1258\). Therefore the joint density at that point is approximately \(0.1760\times0.1258=0.02214\), in squared inverse outcome units if both outcomes use the same unit. This is a density value, not the probability of the exact pair.
The example also shows how the conditional model describes dependence: the mean of \(Y_2\) changes with \(Y_1\). Its form and parameters are choices made for this pattern-specific model, not requirements of the factorization.
Estimating conditional factors from pattern-specific data
When outcomes and covariates needed for a factor are observed for members of a pattern, empirical conditional distributions can be calculated within that pattern. Such calculations describe the available data; they do not automatically identify factors involving outcomes that are missing for that pattern. In particular, a pattern-specific distribution of an unobserved outcome may require modeling assumptions or other information beyond the observed data.
Worked Example: Factoring an Empirical Distribution
In a hypothetical sample, 60 people share pattern \(r\) and baseline stratum \(X=x\). Their fully classified binary outcome pairs have these counts: 18 have \((Y_1,Y_2)=(0,0)\), 12 have \((0,1)\), 20 have \((1,0)\), and 10 have \((1,1)\). This table is hypothetical and is used only to demonstrate the arithmetic.
There are 30 people with \(Y_1=0\) and 30 with \(Y_1=1\). The empirical first factor is \(\widehat P(Y_1=1\mid R=r,X=x)=(20+10)/60=30/60=0.50\). Among the 30 with \(Y_1=0\), 12 have \(Y_2=1\), so \(\widehat P(Y_2=1\mid Y_1=0,R=r,X=x)=12/30=0.40\). Among the 30 with \(Y_1=1\), 10 have \(Y_2=1\), so \(\widehat P(Y_2=1\mid Y_1=1,R=r,X=x)=10/30=0.3333\).
The factorization recovers the empirical joint probability of \((1,1)\): \(0.50\times0.3333\approx0.1667\), which agrees with \(10/60=0.1667\), up to rounding. This agreement is expected: the empirical conditionals were computed from the same table and the chain rule is exact. It is not evidence that the conditional probabilities generalize to a population.
Diagnostics, alternatives, and limitations
A sequential specification can be useful because each factor has a direct interpretation: it describes one visit’s outcome given the pattern, baseline covariates, and earlier outcomes. It also gives a structured way to inspect model fit by visit and history. For example, compare fitted and observed conditional outcome distributions within patterns where the necessary outcomes are observed; look for sparse histories, implausible fitted probabilities, and residual patterns that remain associated with earlier outcomes or covariates.
These checks have limits. A factor involving a missing outcome for the pattern may not be empirically checkable from that pattern’s observed outcomes alone. Sparse histories can make conditional estimates unstable, and a fitted model may extrapolate where little data are available. A good fit to observed conditional distributions does not, by itself, verify unobserved parts of the pattern-specific outcome distribution.
The main alternative is to specify the pattern-specific joint outcome distribution directly, without expressing it through visit-level conditionals. These representations can describe the same distribution when fully specified consistently; the sequential representation is a chain-rule decomposition, not a competing probability law. A further alternative is to impose restrictions such as independence or shared conditional parameters across patterns. Such restrictions can simplify modeling, but require justification and should not be mistaken for consequences of factorization.
A common mistake is to say, “Because the joint distribution factors into visit-specific terms, the visits are independent.” That conclusion is wrong: the factors after the first are explicitly conditional on earlier outcomes. Independence would require the additional equality \(f_{rt}(y_t\mid y_{1:t-1},x)=f_{rt}(y_t\mid x)\) for every visit and relevant history. Without that restriction, the later outcomes may depend on earlier ones.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions.
- For three visits, write the sequential factorization of \(f(y_1,y_2,y_3\mid R=r,X=x)\).
- In a two-visit binary model, suppose \(P(Y_1=1\mid r,x)=0.40\), \(P(Y_2=1\mid Y_1=1,r,x)=0.75\), and \(P(Y_2=1\mid Y_1=0,r,x)=0.20\). What is \(P(Y_1=1,Y_2=1\mid r,x)\)?
- Does the chain-rule factorization imply that the visit outcomes are independent? State the additional condition that would be needed for independence.
- Why might a factor involving a later outcome be difficult to check empirically within a particular response pattern?
Solutions. (1) The factors are \(f(y_1\mid r,x)f(y_2\mid y_1,r,x)f(y_3\mid y_1,y_2,r,x)\). (2) Multiply the first probability by the second: \(0.40\times0.75=0.30\). (3) No. Independence would require each later outcome’s conditional distribution not to depend on the earlier outcomes, for example \(f_{rt}(y_t\mid y_{1:t-1},x)=f_{rt}(y_t\mid x)\). (4) The outcome may be unobserved for members of that pattern, leaving no direct within-pattern data to assess its conditional distribution across histories.