Tutorials › Pattern-Mixture and Selection Models › Including Treatment And Baseline Covariates

Factorizations of the Joint Distribution · Tutorial 43 of 499

Including Treatment And Baseline Covariates

You will learn to condition each part of a shared-parameter joint model on treatment and baseline covariates and to check what those conditioning choices imply.

Intermediate 11 min read

What You'll Learn

  • Write a joint factorization conditional on treatment and baseline covariates.
  • Distinguish a covariate’s role in the outcome model from its role in the response-pattern model.
  • Specify when the latent-effect distribution may depend on treatment or baseline covariates.
  • Calculate a full-data joint probability from its conditional factors.
  • Diagnose omitted covariate pathways and distinguish conditioning from causal adjustment.

Why Include Treatment and Baseline Covariates?

A shared-parameter factorization connects the outcome process and the response pattern through a latent effect. In an applied study, treatment and baseline characteristics can also be related to outcomes, response, and the distribution of that latent effect. Leaving them out of the factorization can conceal important assumptions: for example, a model may implicitly assert that response is unrelated to treatment after conditioning on the latent effect, even when treatment predicts response in the data.

The goal here is to place treatment and baseline covariates explicitly in the joint law. Doing so does not by itself establish a causal treatment effect, make missingness ignorable, or guarantee that the model is identifiable. It makes the conditional distributions and the assumptions they encode visible.

Definition: Let \(A\) denote treatment, \(X\) a vector of fully observed baseline covariates, \(Y=(Y_1,\ldots,Y_T)\) the complete outcome vector, \(R=(R_1,\ldots,R_T)\) the response pattern, and \(B\) a latent shared effect. Here \(R_j=1\) means \(Y_j\) is observed and \(R_j=0\) means it is missing. A treatment- and covariate-conditional shared-parameter factorization is $$ f(x,a,b,y,r) = f(x)f(a\mid x)f(b\mid a,x)f(y\mid b,a,x)f(r\mid y,b,a,x). $$ Equivalently, conditional on \(A=a\) and \(X=x\), $$ f(b,y,r\mid a,x) = f(b\mid a,x)f(y\mid b,a,x)f(r\mid y,b,a,x). $$

The first expression includes the distributions of baseline covariates and treatment assignment. The second conditions on their realized values and focuses on the latent effect, outcomes, and response pattern. The notation \(f\) can represent a probability mass function, a density, or an appropriate mixture of the two. For a longitudinal outcome, \(f(y\mid b,a,x)\) may itself be written as a sequence of conditional outcome distributions.

What Each Factor Says

The factor \(f(a\mid x)\) describes treatment assignment given baseline covariates. In a randomized study, it may be known from the randomization scheme; if assignment is independent of \(X\), it can be written \(f(a)\). In an observational study, assignment may depend on \(X\). When analysis conditions on treatment and covariates, this assignment factor is not part of the conditional law \(f(b,y,r\mid a,x)\), but it remains part of the full joint distribution.

The outcome factor \(f(y\mid b,a,x)\) allows outcomes to be associated with treatment and baseline characteristics, as well as with the latent effect. For example, a regression model may include treatment, age, disease severity at baseline, and interactions between treatment and baseline severity. The response-pattern factor \(f(r\mid y,b,a,x)\) allows response to depend on treatment, baseline characteristics, the latent effect, and outcomes. Conditioning on the complete \(Y\) in this selection-style factorization permits response probabilities to depend on outcomes that are missing; that possibility is one way the model can represent nonignorable missingness.

Finally, \(f(b\mid a,x)\) specifies the distribution of the latent effect across treatment and baseline-covariate groups. Its form must match the meaning assigned to \(B\). If \(B\) represents a pre-treatment subject characteristic, a model may posit \(f(b\mid a,x)=f(b\mid x)\), particularly under randomized assignment. If it represents a latent quantity that can vary with treatment, dependence on \(A\) may be appropriate. Neither choice follows automatically from the factorization.

The product above is a chain-rule decomposition for the ordering \(X,A,B,Y,R\). As written, it does not require a conditional-independence assumption beyond the stated conditioning sets: each factor is a conditional distribution in that ordering. Substantive restrictions arise when a factor is simplified—for example, replacing \(f(r\mid y,b,a,x)\) by \(f(r\mid y,b)\) asserts that response is conditionally independent of treatment and baseline covariates given \(Y\) and \(B\).

A Chain-Rule Justification

The factorization can be derived by repeatedly applying the definition of conditional probability. For variables with a joint density or mass function, start with the chosen ordering and write

$$ \begin{aligned} f(x,a,b,y,r) &= f(x)f(a,b,y,r\mid x)\\ &= f(x)f(a\mid x)f(b,y,r\mid a,x)\\ &= f(x)f(a\mid x)f(b\mid a,x)f(y,r\mid b,a,x)\\ &= f(x)f(a\mid x)f(b\mid a,x)f(y\mid b,a,x)f(r\mid y,b,a,x). \end{aligned} $$

Each equality follows from \(f(U,V\mid W)=f(U\mid W)f(V\mid U,W)\). Thus, adding \(A\) and \(X\) to the conditioning sets is not merely a notational adjustment: it specifies which covariates each conditional distribution may use. A more restrictive model can then be stated by removing a variable from a factor, but that removal is an assumption to defend, not a consequence of the chain rule.

Worked Example: Multiplying the Conditional Factors

Consider a hypothetical one-visit study with binary treatment \(A\), a binary baseline covariate \(X\), a binary latent effect \(B\), binary outcome \(Y\), and response indicator \(R\). Suppose the model gives the following probabilities for the indicated values: \(P(X=1)=0.40\), \(P(A=1\mid X=1)=0.50\), \(P(B=1\mid A=1,X=1)=0.70\), \(P(Y=1\mid B=1,A=1,X=1)=0.80\), and \(P(R=1\mid Y=1,B=1,A=1,X=1)=0.60\).

The probability of the joint event \(X=1,A=1,B=1,Y=1,R=1\) is the product of the corresponding factors:

$$ \begin{aligned} P(X=1,A=1,B=1,Y=1,R=1) &=0.40(0.50)(0.70)(0.80)(0.60)\\ &=0.0672. \end{aligned} $$

This is a full-data joint probability, including the latent event \(B=1\) and the outcome-response pair. It is not a probability conditional on \(A\) and \(X\). For the conditional probability given \(A=1,X=1\), omit the first two factors and obtain \(0.70(0.80)(0.60)=0.336\). The example shows why it matters to distinguish a joint law from its conditional version.

Regression Models Show Where Covariates Enter

One convenient way to specify factors is with regression models. For a binary outcome, a possible conditional mean model is \(P(Y=1\mid A,X,B)=\operatorname{expit}(\beta_0+\beta_A A+\beta_X X+\beta_B B)\), where \(\operatorname{expit}(u)=1/(1+\exp(-u))\). A response model might use a separate linear predictor, \(P(R=1\mid Y,A,X,B)=\operatorname{expit}(\gamma_0+\gamma_A A+\gamma_X X+\gamma_B B+\gamma_Y Y)\). These are model choices, not requirements of the factorization. Continuous or categorical covariates can be represented with suitable terms, and longitudinal models can include visit-specific predictors and histories.

The response equation above conditions on \(Y\), including its value when \(R=0\). Consequently it specifies a complete-data response mechanism, not a regression that can be fitted by simply substituting an unobserved outcome. The factorization identifies where the variables belong conceptually; the treatment of unobserved values in a likelihood is a separate calculation.

Worked Example: Computing Outcome and Response Probabilities

Suppose, hypothetically, a one-visit binary outcome model has \(\operatorname{logit}P(Y=1\mid A,X,B)=-1+0.8A+0.5X+0.4B\). A response model is \(\operatorname{logit}P(R=1\mid Y,A,X,B)=1+0.3A-0.4X+0.5B-0.7Y\). For \(A=1,X=1,B=1,Y=1\), the outcome linear predictor is \(-1+0.8+0.5+0.4=0.7\). Therefore,

$$ P(Y=1\mid A=1,X=1,B=1) =\frac{\exp(0.7)}{1+\exp(0.7)} \approx 0.6682. $$

For the same values, the response linear predictor is \(1+0.3-0.4+0.5-0.7=0.7\), so \(P(R=1\mid Y=1,A=1,X=1,B=1)\approx0.6682\). The conditional probability of the joint event \(Y=1,R=1\), given these values of \(A,X,B\), is

$$ \begin{aligned} P(Y=1,R=1\mid A=1,X=1,B=1) &=P(Y=1\mid A=1,X=1,B=1)\\ &\quad{}\times P(R=1\mid Y=1,A=1,X=1,B=1)\\ &\approx(0.6682)(0.6682)=0.4465. \end{aligned} $$

The covariate \(X\) appears in both predictors. Omitting it from the response model would impose a different conditional response probability, even if it remains in the outcome model. The numerical result depends on the specified coefficients and covariate values; it is not a general property of shared-parameter models.

Worked Example: Allowing the Latent-Effect Distribution to Vary

Suppose a hypothetical model treats \(B\) as binary and specifies \(\operatorname{logit}P(B=1\mid A,X)=-1+0.6X+0.4A\). At \(X=1,A=1\), the linear predictor is \(-1+0.6+0.4=0\), giving \(P(B=1\mid A=1,X=1)=0.5000\). At \(X=1,A=0\), it is \(-1+0.6=-0.4\), giving

$$ P(B=1\mid A=0,X=1) =\frac{\exp(-0.4)}{1+\exp(-0.4)} \approx 0.4013. $$

This specification assigns different latent-effect distributions across treatment values at the same \(X\). If \(B\) is meant to be a pre-treatment characteristic and treatment is randomized, that dependence may be scientifically inappropriate; one might instead specify \(P(B=1\mid A,X)=P(B=1\mid X)\). Randomization balances pre-treatment characteristics in expectation, but it does not dictate the model for every quantity called a latent effect. The definition and timing of \(B\) determine which restriction is defensible.

Assumptions, Diagnostics, and Alternatives

Before interpreting fitted factors, check that their assumptions match the study and the role of each variable. The model presumes that \(A\) and \(X\) are defined and measured as intended, that the conditional distributions are well-defined in the relevant covariate groups, and that the chosen dependence on \(B\) adequately represents the shared latent structure. If treatment effects vary by baseline severity, a model containing only an additive treatment term may be too restrictive. If response depends on treatment after conditioning on \(Y,B,X\), a response factor that omits \(A\) will not represent that dependence.

Useful diagnostics include examining whether treatment and response are sparse within important covariate groups, checking that the model’s predicted outcome and response rates are compatible with observed summaries, and assessing whether the chosen functional forms and interactions are plausible. In longitudinal settings, assess predictions by visit and response history rather than relying only on a pooled response rate. A lack of overlap—for example, almost no treated participants at some values of \(X\)—can make comparisons or parameter estimates unstable. Diagnostics can reveal poor fit or weak information, but they cannot establish an untestable assumption about dependence on outcomes that are missing.

There are two important comparisons. First, the conditional shared-parameter expression models outcomes and response through factors linked by \(B\); omitting \(B\), or imposing conditional independence after conditioning on \(B\), changes the model’s assumptions. Second, a pattern-mixture factorization organizes the joint law by response pattern rather than by a response mechanism conditional on complete outcomes. These are alternative organizations of a joint distribution, but restrictions and parameterizations can make the resulting models substantively different. Neither becomes equivalent to the other merely by adding treatment and covariates to its notation.

Including treatment and baseline covariates also does not by itself solve confounding. In an observational study, a causal interpretation generally requires additional assumptions about treatment assignment and measured confounders. Likewise, specifying a response model that depends on unobserved outcomes does not make that dependence empirically verifiable from observed data alone. A careful analysis separates the factorization, the scientific assumptions, and the target interpretation.

Common pitfall: A researcher includes \(X\) in the outcome factor and then claims that the whole model “adjusts for \(X\).” That is not necessarily true: if \(X\) is omitted from \(f(r\mid y,b,a,x)\), the response model asserts no additional dependence on \(X\) given its other arguments. Correction: inspect every factor separately and state which variables condition each one. Covariate adjustment is a collection of model specifications, not a label conferred by including a variable somewhere.

Check Your Understanding

Answer each question, then compare with the solutions below.

  1. Write the conditional shared-parameter factorization for \(B,Y,R\) given \(A,X\).
  2. Suppose \(P(B=1\mid A=1,X=0)=0.30\), \(P(Y=1\mid B=1,A=1,X=0)=0.70\), and \(P(R=1\mid Y=1,B=1,A=1,X=0)=0.50\). Find \(P(B=1,Y=1,R=1\mid A=1,X=0)\).
  3. If the response factor is written \(f(r\mid y,b)\) rather than \(f(r\mid y,b,a,x)\), what restriction is being made?
  4. Does random treatment assignment alone imply that a latent-effect distribution must depend on treatment? Explain.

Solutions. (1) \(f(b,y,r\mid a,x)=f(b\mid a,x)f(y\mid b,a,x)f(r\mid y,b,a,x)\). (2) Multiply the three conditional probabilities: \(0.30(0.70)(0.50)=0.105\). This is the conditional probability of the specified joint event given \(A=1,X=0\). (3) The response factor is restricted to have no further dependence on \(A\) or \(X\) once \(Y,B\) are given; this is a modeling assumption, not a chain-rule result. (4) No. If \(B\) represents a pre-treatment characteristic, randomization may support specifying its distribution independently of assigned treatment, conditional on \(X\). A treatment-dependent distribution requires a substantive reason tied to what \(B\) represents.

Clinical Biostats