Tutorials › Statistical Genetics › Selection From Missing Mediator or Outcome Data

Genetic Mediation and Selection Bias · Tutorial 883 of 989

Selection From Missing Mediator or Outcome Data

Learn to diagnose missing-data assumptions in genetic mediation, weight observations under a justified MAR model, and quantify how outcome-dependent selection could change conclusions.

Advanced 11 min read

What You'll Learn

  • Distinguish MCAR, MAR, and missingness that depends on an unobserved mediator or outcome
  • State the conditional independence and positivity assumptions required for inverse-probability weighting
  • Derive the weighted estimating-equation identity and understand what it does not guarantee
  • Calculate a normalized inverse-probability weighted estimate from selected observations
  • Use a sensitivity parameter to examine outcome-dependent selection when the response mechanism is unidentified

Why Missing Mediators and Outcomes Can Change a Genetic Mediation Analysis

A genetic mediation analysis may have genotype, exposure, mediator, and outcome information for different subsets of participants. For example, molecular measurements may be available only for people with usable tissue, while outcome follow-up may be incomplete. An analysis restricted to participants with every variable recorded can then describe a selected subset rather than the target population. The central question is not simply how many values are missing, but what determines which values are observed.

Selection can alter mediator and outcome distributions and can also induce or distort associations among genotype, exposure, mediator, and outcome. This tutorial distinguishes three missingness mechanisms, states the conditions under which inverse-probability weighting can address selection, and shows how a sensitivity analysis can represent outcome-dependent selection that the observed data cannot identify by themselves.

Definition: Let \(W\) denote the complete data relevant to a target analysis, such as genotype \(G\), exposure \(X\), mediator \(M\), outcome \(Y\), and covariates \(C\). Let \(R=1\) indicate that the required data are observed for an individual and \(R=0\) that they are not. Missing completely at random (MCAR) means \(R\) is independent of \(W\). Missing at random (MAR) means that, for each missing-data pattern, the probability of that pattern may depend on values observed in that pattern but not on the values missing in it, conditional on the observed values. Missing not at random (MNAR) means that the probability of a missingness pattern still depends on one or more values that are missing under that pattern.

These definitions concern a specified set of variables and a specified missingness pattern. They are not properties of a data set in isolation. For instance, outcome availability may be MAR if it depends on a fully observed baseline covariate, but MNAR if it depends on the unrecorded outcome itself after conditioning on available information. Selection into a study based on an observed variable is not automatically MNAR; the relevant issue is whether selection depends on information unavailable for the selected analysis.

Reading the Mechanism in a Mediation Setting

For mediator data, let \(R_M=1\) indicate that \(M\) is measured. If mediator measurement depends on observed genotype, exposure, outcome, and covariates, then the missing mediator may be MAR conditional on those variables, provided they are observed for everyone in the relevant analysis. If the chance that a mediator is measured also depends on the unobserved mediator value after conditioning on those observed variables, the mechanism is MNAR.

The same logic applies to \(R_Y\), the indicator that the outcome is observed. If outcome follow-up depends on observed baseline variables, MAR may be plausible. If people with more severe, unrecorded outcomes are more or less likely to remain in follow-up, outcome missingness is MNAR unless the relevant severity information is observed and included in the conditioning set. Complete-case analysis is not automatically protected by calling a mechanism MAR: the assumptions must match the actual variables available and the analysis being performed.

Worked Example: Classifying Mediator and Outcome Missingness

Hypothetical setting. A study records \(G\), \(X\), and age \(C\) for all enrolled participants. The mediator \(M\) is measured in a tissue subsample, and \(Y\) is recorded at follow-up. Consider three possible mechanisms.

Mediator measurement depends on age only. Suppose the probability of \(R_M=1\) varies with the recorded age \(C\), but not with \(M\) after conditioning on \(C\). This is MAR for \(M\), conditional on \(C\). If measurement probability is constant and independent of all the complete-data variables, it is MCAR instead.

Follow-up depends on recorded exposure. Suppose \(R_Y\) depends on \(X\), which is known for everyone, and not on \(Y\) after conditioning on \(X\). This is MAR for outcome availability conditional on \(X\). It can still change the unweighted distribution of \(X\) among observed outcomes, so MAR alone does not justify ignoring missingness.

Follow-up depends on the unrecorded outcome. Suppose participants with high \(Y\) are less likely to return, even among people with the same observed \(G\), \(X\), and \(C\). Because the determining \(Y\) values are missing for nonresponders, this is outcome-dependent MNAR selection. The observed data alone generally cannot establish the size or direction of this dependence.

Inverse-Probability Weighting Under a Stated MAR Model

Inverse-probability weighting (IPW) gives greater weight to observed individuals who represent groups with lower observation probabilities. To use a simple complete-case version, let \(O\) contain the relevant variables that are fully observed for everyone, and let \(\pi(O)=P(R=1\mid O)\). For the weighting identity below, \(O\) must include all relevant observed components of \(W\), and the required assumption is stronger and more precise than merely saying that the missing values do not predict response:

Assumptions for the complete-case IPW identity: The observation mechanism satisfies \(P(R=1\mid W)=P(R=1\mid O)=\pi(O)\), equivalently \(R\) is conditionally independent of \(W\) given \(O\); and positivity holds, so \(\pi(O)>0\) for every covariate pattern represented in the target population. The observation probability model must also be correctly specified, or consistently estimated, for the weighting procedure to target the stated population quantity.

The conditional independence condition matters. If response can depend on an observed component of \(W\) omitted from \(O\), then the response probability in the weights need not be the response probability conditional on the full data. In that case, weighting by \(\pi(O)\) may fail even if response is independent of the missing component. MAR in a general pattern-specific analysis can condition on variables observed for that pattern; a simple complete-case weight based only on common predictors requires the more explicit condition just stated.

For any integrable function \(\psi(W)\), the population expectation can be recovered by weighting observed individuals under these assumptions:

$$ E\left\{\frac{R}{\pi(O)}\psi(W)\right\}=E\{\psi(W)\}. $$

To see why, condition on the complete data \(W\). Since \(O\) is included in, or determined by, \(W\), the assumption gives \(E(R\mid W)=P(R=1\mid W)=\pi(O)\). Therefore,

$$ E\left\{\frac{R}{\pi(O)}\psi(W)\mid W\right\} = \frac{\psi(W)}{\pi(O)}E(R\mid W) = \psi(W), $$

and taking expectations over \(W\) proves the identity. The proof uses the response probability conditional on the full data; assuming only independence from missing values while omitting relevant observed components does not justify the step.

For a parameter \(\theta\) defined by an estimating equation \(E\{\psi(W;\theta)\}=0\), the weighted estimating equation replaces the population expectation with its observed-data counterpart:

$$ \sum_{i:R_i=1}\frac{1}{\hat{\pi}(O_i)}\psi(W_i;\theta)=0. $$

Here \(\hat{\pi}(O_i)\) estimates the probability that individual \(i\)'s required data are observed. The estimating function must correspond to the target parameter, and the observation model must match the missingness pattern. When mediator and outcome availability have different patterns, a single complete-case indicator and one propensity model may not suffice; each pattern needs an appropriate observed-data model and assumptions. Weighting cannot recover information in covariate strata with zero probability of observation.

Worked Example: A Weighted Outcome Mean Among Respondents

Hypothetical data. Suppose age group \(O\) is recorded for all participants, and \(Y\) is observed only when \(R=1\). There are two age groups. The response probabilities are known to be \(\pi(0)=0.50\) and \(\pi(1)=0.80\). Among respondents, the observed outcomes are \(2,4\) in group \(O=0\), and \(5,7,9\) in group \(O=1\). Assume response is independent of \(Y\) conditional on age group, and both response probabilities are positive.

The normalized IPW estimate is the weighted sum of observed outcomes divided by the sum of their weights. Each respondent in group 0 receives weight \(1/0.50=2\), and each respondent in group 1 receives weight \(1/0.80=1.25\):

$$ \hat{\mu}_{\mathrm{IPW}} = \frac{(2+4)/0.50+(5+7+9)/0.80} {2/0.50+3/0.80} = \frac{12+26.25}{4+3.75} = \frac{38.25}{7.75} \approx 4.935. $$

The unweighted respondent mean is \((2+4+5+7+9)/5=5.4\). The weighted estimate is lower because the observed respondents in age group 0 represent a group with a lower response probability and therefore receive more total weight. Under the stated MAR and positivity assumptions, the weighted mean targets the population mean outcome; it is not proof that those assumptions hold. The normalized ratio is generally a consistent weighted estimator under suitable conditions, not an exactly unbiased estimator in every finite sample.

Outcome-Dependent Selection Requires Sensitivity Analysis

When missingness depends on the unobserved mediator or outcome, the response probability \(P(R=1\mid W)\) cannot generally be learned from the observed data alone. An ordinary MAR-based propensity model omits the very dependence at issue. A principled response is to state a sensitivity parameter, examine results across plausible values, and report how strongly conclusions depend on it. Such an analysis does not turn an unidentified mechanism into an identified one; it makes the unverifiable assumption visible.

For a simple binary outcome illustration, let \(Y\) equal 1 or 0, let \(q=P(Y=1\mid R=1)\) be the prevalence among respondents, and define the selection ratio \(\lambda=P(R=1\mid Y=1)/P(R=1\mid Y=0)\). This parameter describes how much more or less likely people with \(Y=1\) are to be observed than people with \(Y=0\). If \(p=P(Y=1)\) is the population prevalence, then Bayes' rule gives:

$$ \frac{q}{1-q} = \lambda\frac{p}{1-p}, \qquad p=\frac{q}{\lambda(1-q)+q}. $$

The observed prevalence \(q\) does not determine both \(p\) and \(\lambda\). Different plausible selection ratios imply different population prevalences. In mediation, selection may depend on a continuous outcome or mediator and may vary with genotype or exposure; a single binary sensitivity parameter is then only a teaching illustration. A practical analysis should define a parameterization that matches the outcome scale and selection process, and examine how the mediation estimate changes across specified values.

Worked Example: Correcting a Binary Outcome Prevalence Across Sensitivity Values

Hypothetical data. Among participants with an observed outcome, \(q=2/7\), or about 0.286, have \(Y=1\). The data do not identify \(\lambda\), so consider three sensitivity values: equal observation probabilities (\(\lambda=1\)), a 1.6-fold observation probability for \(Y=1\) (\(\lambda=1.6\)), and a 2.5-fold observation probability (\(\lambda=2.5\)).

For \(\lambda=1\), the formula gives \(p=(2/7)/\{1(5/7)+2/7\}=2/7\approx0.286\). For \(\lambda=1.6\),

$$ p=\frac{2/7}{1.6(5/7)+2/7} =\frac{2}{8+2} =0.200. $$

For \(\lambda=2.5\), \(p=2/\{2.5(5)+2\}=2/14.5\approx0.138\). Thus, if people with \(Y=1\) are more likely to be observed, the respondent prevalence exceeds the implied population prevalence. The value \(\lambda=1.6\) recovers 0.200 under this stipulated selection model; it is not estimated from the observed prevalence. In a genetic mediation analysis, corresponding sensitivity values would be used to refit or adjust the target analysis and assess whether its substantive conclusion changes.

Choosing and Reporting an Analysis

1
Define the target and the observation pattern.
Specify whether the target uses the mediator, the outcome, or both, and identify which individuals contribute to each pattern.
2
State the missingness assumptions.
Name the variables that predict observation, distinguish observed predictors from values missing under the pattern, and state whether the assumption is MCAR, MAR, or MNAR.
3
Check positivity and model observation.
Confirm that every target-population stratum has a nonzero chance of contributing data. Estimate observation probabilities using variables available for the relevant individuals.
4
Weight only under a defensible model.
Use inverse probabilities when the conditional independence and positivity conditions hold; for outcome-dependent missingness, vary an explicit sensitivity parameter instead of claiming MAR correction.

In genetic mediation, the consequences are not limited to a shifted mean. If selection depends on variables associated with genotype and mediator or outcome, conditioning on observation can change their joint distribution. The weighted estimating equation may address this under its assumptions, but it does not repair other identification failures, such as unmeasured confounding or an invalid genetic instrument. Likewise, a sensitivity analysis for selection is distinct from sensitivity analysis for mediator–outcome confounding: the parameters describe different uncertainties.

Common Pitfalls

  • Calling a mechanism MAR without naming the conditioning variables. “Missingness is MAR” is incomplete unless the observed information used to condition on it is specified for each pattern.
  • Leaving relevant observed components out of the weights. If \(R\) depends on an observed component of \(W\) omitted from \(O\), then \(P(R=1\mid W)\) need not equal \(\pi(O)\), and the IPW identity need not hold.
  • Treating positive estimated probabilities as proof of positivity. A model that returns nonzero values does not establish that every target stratum has a genuine chance of observation. Extremely small probabilities can also create unstable, high-variance weights.
  • Claiming that weighting solves MNAR selection. IPW based on observed predictors cannot identify dependence on an unobserved outcome without additional assumptions or information. State and vary a sensitivity parameter instead.
  • Interpreting weighted estimates causally by default. Correcting one selection mechanism does not establish all assumptions needed for a causal mediation interpretation.
Key takeaway: IPW is justified only when observation probabilities condition on all relevant observed information, missingness is conditionally independent of the complete data given that information, and positivity holds. When observation depends on an unobserved mediator or outcome, make the unidentified dependence explicit through sensitivity analysis.

Check Your Understanding

Answer each question by stating the assumption or calculation that supports your conclusion.

  1. A mediator is observed more often among participants with higher recorded age, but within age groups observation is independent of the mediator value. How would you classify the mechanism, and what variables should enter the observation model?
  2. Why is independence of \(R\) from the missing component alone insufficient for the IPW identity if \(O\) omits another observed component of \(W\)?
  3. What does positivity require for a covariate stratum, and why can near-zero observation probabilities cause difficulty even if they are not exactly zero?
  4. If the observed binary-outcome prevalence is \(q=0.30\) and \(\lambda=2\), use \(p=q/\{\lambda(1-q)+q\}\) to find the implied population prevalence.
  5. Why does an MAR-based inverse-probability model not, by itself, address selection that depends on an unobserved outcome?
Clinical Biostats