Tutorials › Multiple Imputation by Chained Equations (MICE) › Selection Models For MNAR

Missingness Mechanisms · Tutorial 29 of 497

Selection Models For MNAR

Learn to write and interpret a selection-model factorization, identify its MNAR component, and calculate likelihood contributions when some values are unobserved.

Beginner 11 min read

What You'll Learn

  • Factor the joint distribution of complete values and response indicators.
  • Distinguish MAR from MNAR through the conditioning variables in the response model.
  • Derive observed-data likelihood contributions by integrating over missing values.
  • Calculate selection probabilities and likelihood contributions under hypothetical models.
  • Recognize what observed-data diagnostics can and cannot reveal about an MNAR model.
  • Compare selection models with MAR analyses and other formulations without treating them as empirically interchangeable.

Why Model Response Given Complete Values?

A missingness indicator records whether a value is observed, but it does not explain why that value is missing. A selection model makes that explanation explicit by modeling the probability of the response pattern as a function of the underlying complete-data values. Its defining feature is that the response model can depend on values that are themselves unobserved.

That feature matters because two people with the same recorded information may have different probabilities of responding if their unrecorded outcomes differ. For example, people with more severe unobserved symptoms might be less likely to complete a follow-up questionnaire. The recorded data alone cannot directly compare symptom levels among responders and nonresponders; the model must therefore specify how those unobserved levels relate to response.

Definition: Let \(Y\) denote the complete data that would be available if no values were missing, and let \(R\) denote the response indicator or vector of response indicators, with \(R_j=1\) when component \(Y_j\) is observed and \(R_j=0\) when it is missing. A selection-model factorization writes the joint distribution as $$ p(Y,R;\theta,\psi)=f(Y;\theta)\,g(R\mid Y;\psi). $$ Here \(f\) models the complete-data distribution and \(g\) models response conditional on complete-data values. The model is MNAR for a response pattern when \(g\), for that pattern, depends on a value that is missing in that pattern, even after conditioning on the observed values.

The factorization is a probability identity when \(f\) and \(g\) are the corresponding conditional distributions; it does not assert that \(Y\) and \(R\) are independent. In a parametric analysis, \(f\) and \(g\) are given specific models indexed by parameters \(\theta\) and \(\psi\). Those models must define valid distributions and probabilities. If the likelihood is written as a product across individuals, that product additionally assumes independent sampling units, or a suitable model for their dependence.

From Complete Data to the Observed-Data Likelihood

A likelihood for observed data cannot use an unobserved value as though it had been recorded. Instead, it sums or integrates the complete-data joint distribution over every possible value of the missing components. Write \(Y_{\mathrm{obs}}\) and \(Y_{\mathrm{mis}}\) for the observed and missing components under the realized response pattern \(R=r\). The observed-data contribution is

$$ p(Y_{\mathrm{obs}}=y_{\mathrm{obs}},R=r;\theta,\psi) = \int f(y_{\mathrm{obs}},y_{\mathrm{mis}};\theta)\, g(r\mid y_{\mathrm{obs}},y_{\mathrm{mis}};\psi)\, d y_{\mathrm{mis}}. $$

For discrete missing values, the integral is replaced by a sum. This equation is the key operational consequence of the selection factorization: the response probability remains inside the integral whenever it depends on missing values. The observed-data likelihood is therefore generally not obtained by fitting \(f\) to observed values alone and ignoring the response process.

Worked Example: A Binary Outcome With Outcome-Dependent Response

Suppose a hypothetical population has a binary outcome \(Y\), where \(Y=1\) denotes a high outcome. Assume \(P(Y=1)=0.40\), and specify response probabilities \(P(R=1\mid Y=1)=0.50\) and \(P(R=1\mid Y=0)=0.80\). These probabilities are model assumptions for illustration, not estimates from a real study.

The complete-data model is \(f(1)=0.40\) and \(f(0)=0.60\). The response model assigns different response probabilities to the two outcome values. In particular, high-outcome individuals have a 0.50 probability of response, whereas low-outcome individuals have a 0.80 probability. Since \(Y\) is unobserved when \(R=0\), this is an MNAR selection model.

The joint probability of an observed high outcome is

$$ P(Y=1,R=1)=P(Y=1)P(R=1\mid Y=1)=0.40(0.50)=0.20. $$

Similarly, the probability of an observed low outcome is \(0.60(0.80)=0.48\). The probability of a missing outcome sums over both possible values:

$$ P(R=0)=0.40(1-0.50)+0.60(1-0.80)=0.20+0.12=0.32. $$

The three observable categories have probabilities \(0.20\), \(0.48\), and \(0.32\), which sum to 1. Among nonresponders, the model-implied proportion with \(Y=1\) is

$$ P(Y=1\mid R=0) = \frac{P(Y=1,R=0)}{P(R=0)} = \frac{0.40(0.50)}{0.32} = 0.625. $$

Thus, although 40% of the complete population has \(Y=1\), the model implies that 62.5% of nonresponders have \(Y=1\). The difference follows from the assumed lower response probability for \(Y=1\); it is not directly observed among the missing cases.

Response Models With Observed Predictors

In multivariate data, a response model can include both observed and missing variables. Consider a scalar outcome \(Y\) that may be missing and a fully observed predictor \(Z\). One possible selection model is logistic:

$$ \operatorname{logit}\{P(R=1\mid Y,Z)\} = \alpha+\beta Y+\gamma Z, \qquad \operatorname{logit}(u)=\log\left(\frac{u}{1-u}\right). $$

The model assumes that the log odds of observing \(Y\) are linear in \(Y\) and \(Z\), and that the resulting probability is given by the inverse-logit transformation. If \(\beta=0\), response depends on \(Z\) but not on the missing \(Y\), which is compatible with MAR for this outcome when \(Z\) is observed. If \(\beta\ne 0\), the response probability varies with \(Y\) even at fixed \(Z\), so the model is MNAR for records in which \(Y\) is missing. This is a statement about the specified model, not a conclusion established by observing a nonzero estimate from data that do not reveal the missing \(Y\) values.

Worked Example: Interpreting a Logistic Selection Model

For hypothetical data, suppose the response model is \(\operatorname{logit}\{P(R=1\mid Y,Z)\}=1-0.70Y+0.40Z\). Both \(Y\) and \(Z\) are coded in units for which this linear predictor is meaningful; \(Z\) is fully observed and \(Y\) may be missing. Calculate response probabilities for \(Z=0\) at \(Y=0\) and \(Y=1\).

At \(Z=0,Y=0\), the linear predictor is \(1-0.70(0)+0.40(0)=1\), so

$$ P(R=1\mid Y=0,Z=0) = \frac{e^1}{1+e^1} \approx 0.7311. $$

At \(Z=0,Y=1\), the linear predictor is \(1-0.70(1)+0.40(0)=0.30\), giving

$$ P(R=1\mid Y=1,Z=0) = \frac{e^{0.30}}{1+e^{0.30}} \approx 0.5744. $$

Holding \(Z\) fixed, a one-unit increase in \(Y\) multiplies the response odds by \(e^\beta=e^{-0.70}\approx0.4966\). Thus the model says the response odds are about 0.497 times as large for a value of \(Y\) one unit higher, conditional on \(Z\). Because the response probability depends on the potentially missing \(Y\), this is an MNAR specification. The calculation interprets the assumed model; it does not show that the data identify \(\beta\).

A Likelihood Contribution Under a Continuous Model

For a continuous outcome, a selection model combines a density for the complete outcome with a response probability. The density contribution for a respondent includes both factors. For a nonrespondent, the outcome is unknown, so its contribution requires integration across its possible values.

Worked Example: A Normal Outcome and Logistic Response

Suppose, hypothetically, \(Y\sim N(10,4)\), so the mean is 10 units and the standard deviation is 2 units. Assume \(P(R=1\mid Y=y)=\operatorname{logit}^{-1}(5-0.50y)\). This model specifies a normal complete-data distribution and a logistic selection equation; it assumes the log odds of response are linear in \(y\).

At \(y=8\), the response logit is \(5-0.50(8)=1\), giving a response probability of \(e/(1+e)\approx0.7311\). At \(y=12\), the logit is \(5-0.50(12)=-1\), giving a response probability of \(e^{-1}/(1+e^{-1})\approx0.2689\). The response probability therefore depends on the outcome value, including values that would be missing for nonrespondents.

For one respondent with observed \(y=12\), the joint density contribution is \(f(12)P(R=1\mid Y=12)\). The normal density is

$$ f(12) = \frac{1}{2\sqrt{2\pi}} \exp\left\{-\frac{(12-10)^2}{2(2^2)}\right\} \approx 0.1210. $$

The respondent's joint density contribution is therefore approximately \(0.1210(0.2689)=0.03254\) per unit of \(Y\). For a nonrespondent, the contribution is not \(f(12)\), because that person's outcome is not known to equal 12. It is the integrated probability

$$ P(R=0) = \int_{-\infty}^{\infty} f(y)\left[1-\operatorname{logit}^{-1}(5-0.50y)\right]\,dy. $$

The integral averages the probability of nonresponse over the modeled distribution of \(Y\). In this example it has no simple elementary closed form, but it can be evaluated numerically under the stated model. The assumptions justify the form of the contribution; they do not make the missing outcome directly known.

Justification, Assumptions, and What Can Be Checked

The observed-data likelihood follows directly from the complete-data factorization. For each possible value \(y_{\mathrm{mis}}\), the joint probability of the complete values and realized response pattern is \(f(y_{\mathrm{obs}},y_{\mathrm{mis}};\theta)g(r\mid y_{\mathrm{obs}},y_{\mathrm{mis}};\psi)\). Since the missing value is not observed, the observed event includes every possible \(y_{\mathrm{mis}}\). Summing or integrating those mutually exclusive possibilities gives the observed-data likelihood contribution. In particular, if \(g\) changes across possible missing values, it cannot be taken outside that sum or integral.

$$ \begin{aligned} p(y_{\mathrm{obs}},r;\theta,\psi) &=\sum_{y_{\mathrm{mis}}} p(y_{\mathrm{obs}},y_{\mathrm{mis}},r;\theta,\psi)\\ &=\sum_{y_{\mathrm{mis}}} f(y_{\mathrm{obs}},y_{\mathrm{mis}};\theta) g(r\mid y_{\mathrm{obs}},y_{\mathrm{mis}};\psi). \end{aligned} $$

For continuous variables, the same reasoning uses an integral in place of the sum. A sound analysis also requires that the complete-data distribution and response model are appropriate for the scientific setting, the response indicators are correctly defined, and the probability model assigns valid probabilities to possible response patterns. For likelihood-based estimation, relevant parameter values must also be informed by the observed-data likelihood; a mathematically specified model is not automatically estimable or identified.

Observed-data checks can reveal conflicts between a proposed model and recorded information. For example, the model may imply response rates or distributions among respondents that are inconsistent with observed summaries. But the dependence of response on the missing value cannot generally be checked by comparing response rates across the unobserved values: those values are unavailable precisely for nonrespondents. In particular, observed data alone do not establish that an MNAR coefficient such as \(\beta\) is zero or nonzero. This is the nonidentifiability problem already encountered in the earlier material on nonidentifiability of MNAR mechanisms.

A practical response is to treat the unverified part of the selection model as an explicit assumption and examine how conclusions change over scientifically plausible values. If estimated response probabilities are near zero for parts of the outcome distribution, the model may also rely on extrapolation with little data support. Such weak support, implausible probabilities, or severe sensitivity of conclusions to small changes in the response model are warning signs, not evidence that one chosen MNAR specification is correct.

How Selection Models Fit Among Alternatives

A selection model specifies the complete-data distribution first and then models response conditional on complete values. A MAR analysis instead assumes that, conditional on observed information, response does not additionally depend on the missing values; this can allow the missingness process to be ignored for some likelihood analyses under the usual parameter distinctness and model conditions. The selection formulation does not make that assumption when its response model includes missing values. Pattern-mixture models express the joint distribution using distributions conditional on response patterns, a different factorization rather than a resolution of the same identification problem.

These formulations can describe the same observed-data distribution while making different assumptions about unobserved quantities. A selection model is useful when a response mechanism can be described meaningfully in terms of complete values, but it does not make MNAR dependence empirically verifiable. Nor does merely writing a response regression solve the problem: estimation and interpretation depend on the specified complete-data model, the response model, and the assumptions that connect them. The introductory material on observed-data equivalence of MAR and MNAR motivates why observed fit by itself cannot choose between these assumptions.

Common Pitfall

Key takeaway: In a selection model, the response probability is conditioned on complete-data values. If it depends on a value missing in the realized pattern, the model is MNAR for that pattern. The resulting observed-data likelihood averages over possible missing values; it does not substitute a guessed missing value or reveal the true response mechanism.

A common mistake is to argue, “The response model contains \(Y\), so the data prove response depends on the unobserved \(Y\).” That reverses assumption and evidence. The term involving \(Y\) is part of the model specification; for nonrespondents, the relevant \(Y\) values are not available to verify it. The correction is to report the dependence as an MNAR assumption, state how its parameters are chosen or varied, and distinguish model-based conclusions from directly observed findings.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. In \(p(Y,R)=f(Y)g(R\mid Y)\), what feature makes the model MNAR for a pattern with \(Y\) missing?
  2. Suppose \(P(Y=1)=0.30\), \(P(R=1\mid Y=1)=0.60\), and \(P(R=1\mid Y=0)=0.90\). Calculate \(P(R=0)\) and \(P(Y=1\mid R=0)\).
  3. For \(\operatorname{logit}\{P(R=1\mid Y,Z)\}=\alpha+\beta Y+\gamma Z\), with fully observed \(Z\), what does \(\beta=0\) imply about dependence on missing \(Y\)?
  4. Why must a nonrespondent's likelihood contribution sum or integrate across possible values of the missing outcome?
  5. Can observed response rates alone establish that the response probability depends on an outcome missing for nonrespondents? Explain.

Solutions. (1) The response probability for that pattern depends on the missing \(Y\), even after conditioning on the observed values. (2) \(P(R=0)=0.30(0.40)+0.70(0.10)=0.12+0.07=0.19\). Also \(P(Y=1,R=0)=0.30(0.40)=0.12\), so \(P(Y=1\mid R=0)=0.12/0.19\approx0.6316\). (3) At fixed \(Z\), response does not depend on \(Y\) under this model, which is compatible with MAR for this outcome because \(Z\) is observed. (4) The observed event \(R=0\) does not specify the missing outcome; its likelihood contribution must include every possible value weighted by its complete-data probability and its response probability. (5) No. The missing outcome is unavailable for nonrespondents, so the dependence cannot generally be verified from response rates alone; it must be treated as a model assumption or sensitivity specification.

Clinical Biostats