Tutorials › Multiple Imputation by Chained Equations (MICE) › Shared-Parameter Models For Informative Missingness

Missingness Mechanisms · Tutorial 31 of 497

Shared-Parameter Models For Informative Missingness

You will learn to formulate and interpret shared-parameter MNAR models, including how a latent variable can make response depend on an outcome that is not observed.

Beginner 11 min read

What You'll Learn

  • Define a shared-parameter model for an outcome and its response indicator.
  • Derive how dependence on a latent variable can induce MNAR.
  • Calculate response probabilities conditional on outcome values in binary and Gaussian examples.
  • Identify assumptions and practical failure modes of shared-parameter models.
  • Distinguish shared-parameter models from selection and pattern-mixture formulations.

Why Share a Latent Variable?

A response indicator may be associated with an outcome even when the model gives no direct response effect to the outcome. For example, a latent characteristic such as underlying illness severity could influence both a patient’s measured health score and the likelihood of completing a follow-up assessment. If severity is not fully observed, the outcome and its response indicator can remain associated after that latent characteristic is averaged out. When response then depends on the outcome itself, the missingness mechanism is MNAR.

A shared-parameter model represents this idea by placing the same latent variable in both an outcome model and a response model. It is a substantive model for the joint relationship among the outcome, response, observed predictors, and latent variable—not a guarantee that the missing values can be recovered uniquely from observed data.

Definition: Let \(Y\) be an outcome that may be missing, \(R=1\) if \(Y\) is observed and \(R=0\) otherwise, \(X\) be fully observed predictors, and \(Z\) be an unobserved latent variable. A shared-parameter model specifies an outcome distribution \(f(y\mid x,z)\) and a response distribution \(P(R=r\mid x,z)\), both depending on the same \(Z\). A common conditional-independence assumption is \(Y \perp R \mid X,Z\). After \(Z\) is integrated out, \(R\) can depend on \(Y\) given \(X\); in that case the missingness is MNAR.

Here \(Y \perp R \mid X,Z\) means that, conditional on \(X\) and \(Z\), knowing the outcome gives no additional information about response. It does not mean that \(Y\) and \(R\) are independent given only \(X\). The distinction is central: the latent variable is shared, but it is not observed for conditioning in an ordinary observed-data analysis.

Model and Assumptions

A basic specification has three parts: a distribution for \(Z\) given \(X\), an outcome model, and a response model. The shared-parameter factorization is

$$ f(y,r,z\mid x)=f(z\mid x)f(y\mid x,z)P(R=r\mid x,z). $$

This factorization assumes conditional independence of \(Y\) and \(R\) given \(X,Z\). It also assumes that the chosen distributions and their parameters adequately describe the latent-variable distribution, the outcome, and response. These are substantive modeling assumptions; observed response rates alone do not establish that they are correct.

For \(R=1\), the observed-data contribution at \(Y=y\) is

$$ f(y,R=1\mid x)=\int f(z\mid x)f(y\mid x,z)P(R=1\mid x,z)\,dz. $$

For \(R=0\), the value \(y\) is not observed, so the contribution is

$$ P(R=0\mid x)=\int f(z\mid x)P(R=0\mid x,z)\,dz. $$

The response probability conditional on a particular outcome value is instead

$$ P(R=1\mid Y=y,X=x) = \int P(R=1\mid x,z)f(z\mid y,x)\,dz. $$

The distribution \(f(z\mid y,x)\) generally differs across values of \(y\). Thus, even though response and outcome are conditionally independent given \(X,Z\), their response probability can vary with \(y\) given \(X\). If it does, the mechanism is MNAR. In this scalar setting, \(Y\) is unavailable precisely when \(R=0\), so dependence of response on \(Y\) cannot generally be checked directly from the observed data.

A Binary Latent-Variable Derivation

A two-category latent variable makes the induced dependence transparent. Suppose \(Z\) is either 0 or 1, and the fully observed predictors \(X\) are held fixed. Write \(\pi=P(Z=1\mid X)\), \(a_z=P(Y=1\mid Z=z,X)\), and \(q_z=P(R=1\mid Z=z,X)\). Under conditional independence, Bayes’ rule gives

$$ P(R=1\mid Y=y,X) = q_1P(Z=1\mid Y=y,X)+q_0P(Z=0\mid Y=y,X). $$

If \(Y\) is binary, then

$$ P(Z=1\mid Y=1,X)=\frac{\pi a_1}{\pi a_1+(1-\pi)a_0}, \qquad P(Z=1\mid Y=0,X)=\frac{\pi(1-a_1)}{\pi(1-a_1)+(1-\pi)(1-a_0)}. $$

When \(Y\) informs us about \(Z\) and \(Z\) informs us about response, these posterior weights can differ by outcome value. The resulting response probabilities can differ too. In this model, if \(a_1=a_0\), \(Y\) provides no information about \(Z\); if \(q_1=q_0\), response does not vary by \(Z\). Either condition removes this particular path from \(Y\) to \(R\), though other direct dependencies could still make missingness MNAR.

Worked Example: Response Dependence Induced by a Binary Latent Variable

Suppose, hypothetically, that \(P(Z=1)=P(Z=0)=0.5\), \(P(Y=1\mid Z=1)=0.8\), and \(P(Y=1\mid Z=0)=0.2\). Let \(P(R=1\mid Z=1)=0.8\) and \(P(R=1\mid Z=0)=0.2\). Assume \(Y\) and \(R\) are conditionally independent given \(Z\).

For \(Y=1\), the marginal probability is \(P(Y=1)=0.5(0.8)+0.5(0.2)=0.5\). Therefore,

$$ P(Z=1\mid Y=1)=\frac{0.5(0.8)}{0.5}=0.8, \qquad P(R=1\mid Y=1)=0.8(0.8)+0.2(0.2)=0.68. $$

For \(Y=0\), \(P(Y=0)=0.5\), and \(P(Z=1\mid Y=0)=0.5(0.2)/0.5=0.2\). Thus,

$$ P(R=1\mid Y=0)=0.2(0.8)+0.8(0.2)=0.32. $$

Response probabilities differ by outcome value: 0.68 when \(Y=1\), versus 0.32 when \(Y=0\). The model is MNAR. The dependence arose by averaging over \(Z\), not from a direct \(Y\) term in the response model.

Implications for the Observed Sample

When response depends on the outcome through \(Z\), respondents and nonrespondents can have different outcome distributions. Complete cases then need not represent the full outcome distribution, even if the outcome and response are independent within latent-variable strata. The following calculation uses the same hypothetical probabilities as above.

Worked Example: Comparing Respondents With Nonrespondents

Using the binary model just specified, first calculate the joint probabilities for \(Y\) and \(R\). For \(Y=1\),

$$ P(Y=1,R=1)=0.5(0.8)(0.8)+0.5(0.2)(0.2)=0.34. $$

Since \(P(Y=1)=0.50\), it follows that \(P(Y=1,R=0)=0.50-0.34=0.16\). Similarly,

$$ P(Y=0,R=1)=0.5(0.2)(0.8)+0.5(0.8)(0.2)=0.16, \qquad P(Y=0,R=0)=0.50-0.16=0.34. $$

The overall response probability is \(P(R=1)=0.34+0.16=0.50\). Among respondents, the proportion with \(Y=1\) is \(0.34/0.50=0.68\). Among nonrespondents, it is \(0.16/0.50=0.32\). In the full population it is \(0.50\). Thus, a complete-case estimate of the proportion with \(Y=1\) would be 0.68 in expectation under this model, rather than the full-population value 0.50.

This comparison concerns the model’s population probabilities, not a claim that every finite sample will have exactly these proportions. It also does not show that the observed data identify the missing outcomes: the nonrespondents’ outcome values are absent.

A Continuous Shared-Parameter Model

A useful continuous example separates latent variation in the outcome from measurement noise. Suppose \(Z\sim N(0,1)\), \(Y=\mu+\beta Z+\varepsilon\), and response is determined by a latent threshold: \(R=1\) when \(\delta+\gamma Z+u>0\), and \(R=0\) otherwise. Assume \(\varepsilon\sim N(0,\sigma^2)\), \(u\sim N(0,1)\), and that \(Z,\varepsilon,u\) are mutually independent. The response model is a probit model conditional on \(Z\): \(P(R=1\mid Z)=\Phi(\delta+\gamma Z)\), where \(\Phi\) is the standard normal cumulative distribution function.

These assumptions matter. The shared variable \(Z\) affects the mean of \(Y\) when \(\beta\ne0\), and affects response when \(\gamma\ne0\). Conditional independence of \(Y\) and \(R\) given \(Z\) follows from the independent disturbances \(\varepsilon\) and \(u\). The following derivation shows the induced response probability given \(Y=y\).

$$ Z\mid Y=y \sim N\left( \frac{\beta(y-\mu)}{\beta^2+\sigma^2}, \frac{\sigma^2}{\beta^2+\sigma^2} \right). $$

To see the posterior parameters, the conditional density is proportional to the prior density times the outcome density. The terms involving \(z\) in the exponent are

$$ -\frac{z^2}{2}-\frac{(y-\mu-\beta z)^2}{2\sigma^2}. $$

Collecting the quadratic and linear terms in \(z\) gives precision \(1+\beta^2/\sigma^2\) and linear coefficient \(\beta(y-\mu)/\sigma^2\). Completing the square therefore gives posterior variance \(1/(1+\beta^2/\sigma^2)=\sigma^2/(\beta^2+\sigma^2)\) and posterior mean \(\beta(y-\mu)/(\beta^2+\sigma^2)\), as stated.

Given \(Y=y\), the threshold quantity \(\delta+\gamma Z+u\) is normal with mean \(\delta+\gamma E(Z\mid y)\) and variance \(1+\gamma^2\operatorname{Var}(Z\mid y)\). Hence

$$ P(R=1\mid Y=y) = \Phi\left( \frac{\delta+\gamma\beta(y-\mu)/(\beta^2+\sigma^2)} {\sqrt{1+\gamma^2\sigma^2/(\beta^2+\sigma^2)}} \right). $$

When \(\beta\gamma\ne0\), this probability varies with \(y\), so the model is MNAR. If either coefficient is zero, this shared-\(Z\) pathway does not produce dependence of \(R\) on \(Y\).

Worked Example: Calculating Response Probabilities in a Gaussian Model

Suppose, hypothetically, that \(\mu=50\), \(\beta=10\), \(\sigma=10\), \(\delta=0\), and \(\gamma=1\), using the Gaussian model above. For \(Y=60\), the posterior mean of \(Z\) is \(10(60-50)/(10^2+10^2)=0.5\), and its posterior variance is \(10^2/(10^2+10^2)=0.5\). Therefore,

$$ P(R=1\mid Y=60) = \Phi\left(\frac{0+1(0.5)}{\sqrt{1+1^2(0.5)}}\right) = \Phi(0.4082) \approx 0.6583. $$

For \(Y=40\), the posterior mean is \(-0.5\) with the same variance, giving

$$ P(R=1\mid Y=40) = \Phi\left(\frac{-0.5}{\sqrt{1.5}}\right) = \Phi(-0.4082) \approx 0.3417. $$

The two response probabilities differ, demonstrating MNAR under these assumptions. The values 50 and 60 are in the units of \(Y\); the probabilities are unitless. This calculation illustrates the model, not an estimate from actual clinical data.

Model Checks, Alternatives, and Limitations

A shared-parameter model is useful when a plausible latent characteristic would affect both the outcome and response. Its assumptions should be made explicit, because the latent structure is not directly observed. In practice, investigate whether the fitted model reproduces observed outcome distributions among respondents, response rates across observed predictors, and any available repeated-measure or auxiliary-variable patterns. Poor fit to these observed features is evidence against the specification. Good fit, however, cannot confirm the assumed dependence on unobserved outcomes.

Several warning signs deserve attention:

  • Little variation in response by modeled latent predictors: if the fitted response model effectively has \(\gamma=0\), it does not capture the proposed shared pathway.
  • Weak outcome information about the latent variable: if \(\beta\) is near zero, outcome values provide little information about \(Z\), weakening the induced response-outcome association.
  • Extrapolation or near-zero response probabilities: estimates for poorly represented latent strata can be highly sensitive to distributional assumptions.
  • Unstable estimates: a complex latent model can be weakly identified, especially when there are few observed outcomes or limited predictors. Convergence alone does not establish identification or model adequacy.

Shared-parameter models are one way to formulate MNAR. Selection models express response conditional on the outcome and observed predictors; pattern-mixture models specify outcome distributions within response patterns. These are different factorizations of the joint data structure, not interchangeable assumptions. The earlier material on selection models for MNAR and pattern-mixture models for MNAR introduces those formulations; the shared-parameter approach instead makes the latent common cause explicit.

The main limitation is that observed data generally cannot determine how outcomes among nonrespondents relate to their unobserved values. Different MNAR assumptions may be compatible with the same observed-data distribution. This is the nonidentifiability of MNAR mechanisms: a shared-parameter model imposes a structure that can support analysis, but it does not make that structure empirically verifiable from the observed outcomes and response indicators alone. Consequently, its conclusions depend on the latent-variable distribution, link functions, and parameter restrictions. Standard MICE conditional models do not automatically account for such a shared latent response mechanism; an MNAR analysis needs an explicit model or sensitivity assumptions that represent it.

A common mistake is to say, “The outcome and response are independent given the latent variable, so missingness is MAR.” That conclusion conditions on \(Z\), which is unobserved. The relevant question is whether \(P(R=1\mid Y,X)\) depends on \(Y\) after \(Z\) is averaged out. In the examples, it does; therefore, the mechanism is MNAR. Conditional independence given an unobserved variable is not the same as conditional independence given observed data.

Key takeaway: A shared-parameter model links an incomplete outcome and its response indicator through a common latent variable. If the outcome informs that latent variable and the latent variable informs response, response can depend on the unseen outcome, producing MNAR. The model makes this dependence explicit but does not remove the need to justify its assumptions.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. In a shared-parameter model, what does \(Y \perp R\mid X,Z\) mean, and why does it not establish MAR?
  2. In the binary example, what is \(P(Z=1\mid Y=1)\), and what response probability follows?
  3. Using the binary example, calculate the proportion with \(Y=1\) among respondents and compare it with the full-population proportion.
  4. In the Gaussian example, what happens to the shared-\(Z\) pathway if \(\beta=0\) or \(\gamma=0\)?
  5. Can a good fit to observed response rates prove that a shared-parameter MNAR model is correct? Explain.

Solutions. 1. It means that \(Y\) and \(R\) are independent after conditioning on both observed \(X\) and latent \(Z\). Since \(Z\) is unobserved, it does not establish independence given the observed data \(X\); averaging over \(Z\) can make response depend on \(Y\), so MAR does not follow. 2. Bayes’ rule gives \(0.5(0.8)/0.5=0.8\). Thus \(P(R=1\mid Y=1)=0.8(0.8)+0.2(0.2)=0.68\). 3. The respondent proportion is \(P(Y=1,R=1)/P(R=1)=0.34/0.50=0.68\), compared with the full-population proportion \(P(Y=1)=0.50\). 4. If \(\beta=0\), the outcome does not inform \(Z\); if \(\gamma=0\), response does not depend on \(Z\). Either removes this shared-variable pathway to dependence between \(Y\) and \(R\). 5. No. Observed fit can reveal some failures, but the association of response with the unobserved outcomes is not generally verifiable from observed data alone.

Clinical Biostats