Tutorials › Statistical Genetics › Sensitivity Analysis for Nonrandomly Missing Omics

Multi-Omic Genetic Integration · Tutorial 938 of 989

Sensitivity Analysis for Nonrandomly Missing Omics

Learn to parameterize departures from random missingness in omics data and determine whether cross-layer association conclusions persist across plausible assumptions.

Advanced 12 min read

What You'll Learn

  • Define selection and pattern-mixture sensitivity parameters for missing molecular measurements
  • Explain why the observed data alone generally cannot identify an MNAR mechanism
  • Recalculate a cross-layer association under explicit pattern-mixture shifts
  • Interpret a selection-model parameter as a change in observation odds
  • Summarize which conclusions are robust and which depend on unverifiable assumptions

Why Missingness Assumptions Matter

A protein or metabolite may be unmeasured because its concentration falls below an assay’s detection limit, because a sample fails quality control, or because sample availability depends on participant characteristics. If the chance of observing a measurement depends on the unobserved measurement itself, the data are missing not at random (MNAR). In that case, the observed molecular profiles may not represent the full set of profiles that would have been measured.

This matters when estimating a cross-layer association. For example, an association between gene expression and protein abundance calculated only among samples with both measurements can differ from the association in all eligible samples if protein availability depends on protein abundance or on its relationship with expression. The observed data generally cannot determine the extent of that dependence. Sensitivity analysis makes the uncertainty explicit by recalculating the association under a range of specified, scientifically plausible missingness assumptions.

Definition: Let \(Y\) be a protein or metabolite measurement, and let \(R=1\) indicate that \(Y\) is observed and \(R=0\) indicate that it is missing. Missingness is MNAR when the distribution of \(R\), conditional on observed information, still depends on the unobserved value of \(Y\). A sensitivity analysis varies one or more parameters that describe this dependence and reports how the target association changes.

For concreteness, let \(X\) be an expression measurement, \(G\) a genotype variable, and \(C\) a vector of measured covariates. Suppose the target is the coefficient \(\beta_X\) in a regression of \(Y\) on \(X\), \(G\), and \(C\). This coefficient describes a conditional association in the specified model; it does not, by itself, establish a causal effect. The analysis below assumes \(X\), \(G\), and \(C\) are available for the samples under study, while some values of \(Y\) are missing.

Two Ways to Represent Nonrandom Missingness

A selection model specifies how the probability of observing \(Y\) depends on its value. One common formulation uses a logistic model for the observation indicator and an outcome model for \(Y\). For example:

$$ Y_i\mid X_i,G_i,C_i \sim f_Y(\,\cdot\,;\beta), \qquad \operatorname{logit}\{P(R_i=1\mid Y_i,X_i,G_i,C_i)\} =\alpha_0+\alpha_X X_i+\alpha_G G_i+\alpha_C^\mathsf{T}C_i+\gamma Y_i^* . $$

Here \(Y_i^*\) is \(Y_i\) on a prespecified scale, such as a standardized scale, and \(\gamma\) is the sensitivity parameter. If \(Y_i^*\) increases by one unit while the other terms stay fixed, the conditional odds of observing the measurement are multiplied by \(\exp(\gamma)\). A positive \(\gamma\) represents greater observation odds at higher values of \(Y\); a negative \(\gamma\) represents lower odds. The outcome distribution \(f_Y\) and the logistic form are modeling assumptions, not facts established by the sensitivity parameter.

For an observed measurement, the likelihood contribution includes both its outcome density and its probability of being observed. For a missing measurement, the unobserved \(Y_i\) must be integrated out:

$$ L_i = \begin{cases} f_Y(Y_i\mid X_i,G_i,C_i;\beta)\, P(R_i=1\mid Y_i,X_i,G_i,C_i), & R_i=1,\\[4pt] \displaystyle\int f_Y(y\mid X_i,G_i,C_i;\beta)\, P(R_i=0\mid y,X_i,G_i,C_i)\,dy, & R_i=0. \end{cases} $$

The second approach, a pattern-mixture model, describes the distribution of \(Y\) separately for observed and missing cases. Its sensitivity parameter directly specifies how the missing-case distribution differs from the observed-case distribution, conditional on measured predictors. For example, one can specify a shift in the conditional mean among missing cases. This is often convenient when the scientific question can be expressed as “how much lower or higher might the unobserved values be?”

Key distinction: A selection model parameterizes observation given the outcome; a pattern-mixture model parameterizes the outcome distribution within missingness groups. Both require assumptions about unobserved values. Neither makes MNAR dependence identifiable from the observed data alone.

Worked Example: A Pattern-Mixture Shift Changes the Association

Worked Example: A Pattern-Mixture Shift Changes the Association

Suppose a hypothetical study has 200 samples, with expression \(X=0\) for 100 samples and \(X=1\) for 100 samples. Here \(X\) is a binary expression grouping, and \(Y\) is protein abundance in assay units. Among the \(X=0\) samples, 80 protein measurements are observed, with mean 10; the other 20 are missing. Among the \(X=1\) samples, 60 are observed, with mean 12; the other 40 are missing. We estimate the unadjusted difference in mean protein abundance between the two expression groups.

First consider the complete-case estimate. The observed group means are 10 and 12, so the observed difference is \(12-10=2\) assay units. To examine departures from this estimate, use the pattern-mixture assumption that, conditional on \(X=x\), the mean among missing measurements differs from the observed mean by \(\delta_0+\delta_X x\). Thus:

$$ E(Y\mid X=x,R=0)=E(Y\mid X=x,R=1)+\delta_0+\delta_X x. $$

For a first scenario, set \(\delta_0=-1\) and \(\delta_X=-2\), both in assay units. The assumed missing-case mean is \(10-1=9\) when \(X=0\), and \(12-1-2=9\) when \(X=1\). Weighting observed and missing means by their group counts gives:

$$ \bar{Y}_{X=0,\mathrm{full}}=\frac{80(10)+20(9)}{100}=9.8,\qquad \bar{Y}_{X=1,\mathrm{full}}=\frac{60(12)+40(9)}{100}=10.8. $$

The sensitivity-adjusted difference is \(10.8-9.8=1.0\) assay unit. Under this assumption, the association remains positive but is smaller than the complete-case difference of 2 assay units. This is a scenario-based estimate, not a correction known to be true.

What the Pattern-Mixture Calculation Shows

For two expression groups, the calculation above has a simple general form. Let \(n_x\) be the total number in group \(x\), \(m_x\) the number with observed \(Y\), and \(r_x=n_x-m_x\) the number with missing \(Y\). Let \(\bar{y}_{1x}\) be the observed mean in that group. Under the mean-shift assumption, the implied mean for all samples in group \(x\) is:

$$ \bar{y}_{x,\mathrm{full}}= \frac{m_x\bar{y}_{1x} +r_x\{\bar{y}_{1x}+\delta_0+\delta_X x\}}{n_x} = \bar{y}_{1x}+\frac{r_x}{n_x}(\delta_0+\delta_X x). $$

The last equality follows by collecting the two terms involving \(\bar{y}_{1x}\) and using \(m_x+r_x=n_x\). If \(X\) is binary and the target is the difference between the \(X=1\) and \(X=0\) means, subtracting the two group means gives:

$$ \widehat{\Delta}_{\mathrm{full}} = (\bar{y}_{11}-\bar{y}_{10}) +\frac{r_1}{n_1}(\delta_0+\delta_X) -\frac{r_0}{n_0}\delta_0. $$

This expression makes an important feature visible: a common shift \(\delta_0\) can alter the association when the missing fractions differ between groups. A differential shift \(\delta_X\) can change it further because it allows the missing-versus-observed difference to vary with expression group. If both groups had the same missing fraction, a common \(\delta_0\) would cancel from the difference, but \(\delta_X\) would not necessarily cancel.

In an adjusted regression with continuous \(X\), genotype, and covariates, the same principle applies, but the coefficient is usually recalculated by fitting the prespecified analysis model to completed data or by fitting a likelihood under each fixed sensitivity setting. The simple group-mean formula is not a substitute for that model; it illustrates how assumptions about unobserved values can move an association estimate.

Worked Example: Interpreting a Selection Parameter

Worked Example: Interpreting a Selection Parameter

Suppose a hypothetical selection model uses standardized protein abundance \(Y^*\), and the fitted observation model at a fixed sensitivity setting has \(\gamma=\log(2)\). At the same values of expression, genotype, and covariates, compare two samples whose standardized protein values differ by one unit. The model says the sample with the higher \(Y^*\) has twice the odds of having an observed measurement.

To see what that means for probabilities, suppose the observation probability at \(Y^*=0\), with the other predictors fixed, is 0.75. Its odds are \(0.75/(1-0.75)=3\). At \(Y^*=1\), the odds are \(3\exp\{\log(2)\}=6\), giving an observation probability of \(6/(1+6)=0.8571\). At \(Y^*=-1\), the odds are \(3\exp\{-\log(2)\}=1.5\), giving a probability of \(1.5/(1+1.5)=0.6000\).

These calculations interpret the sensitivity parameter under the stated model. In an actual sensitivity analysis, the intercept and other observation-model parameters must also be estimated or calibrated so the model is compatible with the observed missingness patterns. The example’s fixed baseline probability is illustrative; it does not imply that the data identify \(\gamma\).

Choosing Scenarios and Reporting the Result

A sensitivity analysis is informative only if its parameter values are interpretable. For a selection model, report the scale of \(Y^*\), the meaning of \(\gamma\), and the corresponding odds multipliers \(\exp(\gamma)\). For a pattern-mixture model, state the units of the shifts and whether they represent a common difference or a difference that varies with \(X\), genotype, or another predictor. Choose a range that can be defended using assay knowledge, prior measurements, or explicit expert judgment. Since the parameter cannot generally be estimated from the observed data alone, do not present a single chosen value as data-determined.

Worked Example: Reporting Conclusions Across Scenarios

Return to the hypothetical data with an observed difference of 2 assay units, 20% missingness in the \(X=0\) group, and 40% missingness in the \(X=1\) group. The derived formula is:

$$ \widehat{\Delta}_{\mathrm{full}} =2+0.4(\delta_0+\delta_X)-0.2\delta_0 =2+0.2\delta_0+0.4\delta_X. $$

Consider three prespecified scenarios. The first is the reference setting \(\delta_0=0,\delta_X=0\); the second assumes modestly lower missing-case values, \(\delta_0=-1,\delta_X=-1\); the third assumes a stronger expression-dependent shift, \(\delta_0=-1,\delta_X=-5\). Substitution gives:

$$ \begin{aligned} \widehat{\Delta}_{\mathrm{full}}(0,0)&=2+0+0=2.0,\\ \widehat{\Delta}_{\mathrm{full}}(-1,-1)&=2-0.2-0.4=1.4,\\ \widehat{\Delta}_{\mathrm{full}}(-1,-5)&=2-0.2-2.0=-0.2. \end{aligned} $$

The association is positive in the first two scenarios and slightly negative in the third. A suitable conclusion is that the direction is not robust to the strongest assumed expression-dependent shift. It would be incorrect to conclude that the observed data establish either a positive or a negative full-sample association irrespective of the missingness mechanism.

For inferential analyses, report uncertainty as well as point estimates. Under each scenario, describe how standard errors or intervals were obtained and state whether they account for estimation of model parameters and imputation or integration uncertainty. An interval calculated under one sensitivity setting reflects uncertainty conditional on that setting; it does not account for uncertainty about which MNAR setting is appropriate. Presenting estimates across scenarios makes that second uncertainty visible rather than hiding it inside one interval.

Assumptions, Diagnostics, and a Common Pitfall

Sensitivity analysis does not remove the need for a defensible analysis model. State the outcome model, the observation model or pattern-mixture specification, and the adjustment variables. Check that the assumed outcome distribution and relationship with \(X\) are reasonable for the observed data, while recognizing that observed-data diagnostics cannot validate the distribution of missing \(Y\). In likelihood-based analyses, the likelihood contributions must correctly reflect whether each \(Y\) is observed or missing. In scenario-based imputation, the completed values must follow the stated conditional model, rather than an informal rule that ignores the covariates related to the association.

A common mistake is to say, “The missingness rate is explained by measured covariates, so missingness is random.” A model predicting \(R\) from observed variables does not rule out additional dependence on unobserved \(Y\). The correction is to distinguish the assumption that missingness is conditionally independent of \(Y\) given observed information from the MNAR alternatives considered here. The observed data may support a reference analysis under a stated assumption, but they generally cannot decide between that assumption and all possible MNAR mechanisms.

Key takeaway: Report the target association, the exact MNAR parameterization, the plausible parameter range and its rationale, and the estimate and uncertainty under each setting. State plainly whether the sign, magnitude, or substantive conclusion changes across those settings.

Check Your Understanding

Answer each question using the assumptions and calculations in this tutorial.

  1. In a selection model with standardized \(Y^*\), what does \(\gamma=\log(1.5)\) say about the observation odds for a one-unit increase in \(Y^*\), holding the other predictors fixed?
  2. Why can the observed data generally not identify the MNAR sensitivity parameter?
  3. In the pattern-mixture example, what happens to the group difference if \(\delta_X=0\) but the missing fractions are unequal and \(\delta_0\) is negative?
  4. Why does a common pattern-mixture shift not necessarily cancel from a cross-layer association estimate?
  5. What should be reported if the estimated association changes sign across plausible sensitivity settings?
Clinical Biostats