Tutorials › Statistical Genetics › Missing-Indicator Methods and Their Pitfalls

Covariates, Missingness, and Robust Inference · Tutorial 326 of 989

Missing-Indicator Methods and Their Pitfalls

See why a missingness flag cannot replace the unobserved covariate value, and learn when indicator coding can still serve a clearly limited purpose.

Intermediate 11 min read

What You'll Learn

  • Define missing-indicator coding for an incomplete covariate in a genetic association model
  • Derive the omitted-variable bias that can remain after adding a missingness flag
  • Distinguish an adjusted genetic effect from an association conditional on recorded-data status
  • Identify assumptions under which omitting the incomplete covariate does not confound a linear genotype effect
  • Recognize when missingness is itself a meaningful category rather than a substitute for the unseen value
  • Choose a defensible interpretation for indicator-coded regression results

Why a Missingness Flag Is Not a Replacement Covariate

In a genetic association model, an incomplete covariate can be consequential when it helps control confounding or otherwise defines the adjusted association of interest. A tempting shortcut is to fill in its missing values with a fixed number and add a binary indicator for whether the value was missing. The indicator records that a value is absent; it does not generally recover what the value would have been. Those are different pieces of information.

Let \(G\) denote genotype dosage, \(C\) an incomplete covariate, and \(Y\) an outcome. Define \(R=1\) when \(C\) is observed and \(R=0\) otherwise, and set \(M=1-R\). For simplicity, suppose the placeholder is zero (for example, after centering \(C\)), so the coded covariate is \(C^*=RC\). A common indicator-coded regression includes \(G\), \(C^*\), and \(M\). The missingness flag can allow a different intercept for records with missing \(C\), but in that group \(C^*=0\) for everyone. The fitted model therefore has no information about individual differences in the unobserved values of \(C\).

Definition: Missing-indicator coding replaces each missing value of an incomplete covariate with a fixed placeholder and includes an indicator \(M\) for whether that value was missing. The procedure models the placeholder-coded covariate and missingness status; it does not, by itself, impute or adjust for the unseen covariate values.

To see the problem, consider the correctly specified full-data linear mean model \(\mathbb{E}(Y\mid G,C)=\alpha+\beta G+\gamma C\), where \(\beta\) is the genotype association conditional on \(C\), and \(\gamma\) is the covariate effect. If the distribution of \(C\) among records with missing values varies with genotype, then \(C\) can still be associated with \(G\) in precisely the records where its value is unavailable. A flag that is identical for all those records cannot adjust for that variation.

Deriving the Remaining Bias

The issue can be stated precisely for ordinary least squares. Assume the full-data conditional mean is linear as above and the error has conditional mean zero given \(G\), \(C\), and \(M\). Fit a population regression of \(Y\) on an intercept, \(G\), \(C^*\), and \(M\). Let \(\widetilde{G}\) be the residual from projecting \(G\) on the other included predictors: the intercept, \(C^*\), and \(M\). The coefficient of \(G\) in this regression is

$$ \beta_{\mathrm{MI}} = \beta + \gamma \frac{\operatorname{Cov}(\widetilde{G},C)} {\operatorname{Var}(\widetilde{G})}. $$

This is the omitted-variable bias formula applied after accounting for the predictors that the indicator-coded model actually includes. The full outcome equation contains \(C\), but the fitted model uses \(C^*\), which equals zero rather than \(C\) when \(M=1\). Unless the residualized genotype is uncorrelated with the true covariate, the second term does not vanish. Adding \(M\) removes the part of the missingness pattern represented by \(M\); it does not guarantee that \(\widetilde{G}\) and the unobserved \(C\) are uncorrelated.

Worked Example: A Covariate Associated With Genotype Among Missing Records

Suppose a hypothetical study uses a linear outcome model with a true conditional genotype effect of \(\beta=0.40\) outcome units per genotype-allele copy and a covariate effect of \(\gamma=2.0\) outcome units per covariate unit. For the study's indicator-coded regression, suppose the hypothetical residualized moments are \(\operatorname{Cov}(\widetilde{G},C)=0.08\) and \(\operatorname{Var}(\widetilde{G})=0.16\). These moments represent residual association with the true covariate after accounting for the included predictors.

The bias term is

$$ 2.0\left(\frac{0.08}{0.16}\right) =2.0(0.50) =1.0 \quad\text{outcome units per allele copy.} $$

Thus the indicator-coded genotype coefficient is

$$ \beta_{\mathrm{MI}}=0.40+1.0=1.40 \quad\text{outcome units per allele copy.} $$

The value \(1.40\) is not the stipulated covariate-adjusted effect \(0.40\). The extra \(1.0\) arises because the residualized genotype remains associated with the true covariate. The calculation illustrates the bias formula; it does not claim that these hypothetical moments apply to every study.

What Happens Within the Missing Group

A second view is to compare expected outcomes across genotype values among records with \(M=1\). Under the linear model,

$$ \mathbb{E}(Y\mid G=g,M=1) = \alpha+\beta g+\gamma\mathbb{E}(C\mid G=g,M=1). $$

The missingness flag is fixed at one within this group. If the mean covariate value changes with genotype, the outcome difference includes both the genetic effect and a covariate-composition difference. An indicator can shift the fitted intercept for this group, but a constant shift cannot generally remove a difference that varies with genotype.

Worked Example: The Genotype Difference Within Missing Records

In a hypothetical study, let the conditional genotype effect be \(0.30\) outcome units per allele copy and the effect of an incomplete covariate be \(1.5\) outcome units per covariate unit. Among records with missing covariate values, suppose the mean true covariate is \(0.20\) for genotype dosage \(G=0\) and \(0.70\) for dosage \(G=1\). These are hypothetical conditional means, not values observed by the analyst.

For \(G=0\), the expected outcome among records with missing \(C\) is

$$ \alpha+0.30(0)+1.5(0.20)=\alpha+0.30. $$

For \(G=1\), it is

$$ \alpha+0.30(1)+1.5(0.70)=\alpha+1.35. $$

The difference is \(1.35-0.30=1.05\) outcome units per allele copy. It consists of the true conditional genotype effect, \(0.30\), plus \(1.5(0.70-0.20)=0.75\) units due to the covariate distribution. Since the missingness indicator is one in both groups, it cannot distinguish these differing covariate means.

This comparison shows why the missing group can retain confounding. A single regression coefficient pooling observed and missing records need not equal \(1.05\); its value depends on the full design and model. The example isolates the within-missing-group contrast to show what the flag alone cannot adjust.

When Indicator Coding Can Be Useful

Indicator coding is not universally useless. It can serve a limited purpose when the scientific target or the assumptions make the missing values themselves unnecessary for estimating the coefficient of interest. The purpose must be stated clearly: a model that accounts for missingness status is not automatically a model adjusted for the unobserved covariate.

  • Missingness is itself a meaningful category. If the variable of interest is whether a measurement was recorded, then “not recorded” is an actual status category. Modeling that status can be appropriate for describing or predicting outcomes by recorded-data status. It does not estimate the association adjusted for the missing underlying value.
  • The incomplete covariate does not confound the genotype coefficient under the specified model. In the linear setting above, if \(\operatorname{Cov}(\widetilde{G},C)=0\), the bias term is zero. This is a substantive condition about the relation between genotype and the true covariate after adjustment, not a consequence of adding \(M\). For example, a covariate may be prognostic for \(Y\) but not associated with \(G\) after the other model terms are accounted for.
  • A randomized exposure provides a distinct setting. In a randomized study, random assignment can make the exposure independent of baseline covariates by design. That can protect a treatment contrast from baseline-covariate confounding under suitable analysis assumptions, even if an incomplete baseline covariate is not fully adjusted. Genotype in an observational association study is not automatically randomized independently of ancestry or other structure, so this rationale cannot simply be transferred to GWAS.

These are restricted cases, not general guarantees. The zero-covariance condition is tied to the stated linear coefficient and model; it should not be assumed to protect a different estimand or regression scale. Likewise, if missingness status is included as a category for a descriptive purpose, the resulting contrast is conditional on recorded status, not on the covariate value that was never observed.

Worked Example: A Restricted Case With No Linear Confounding

Suppose a hypothetical study has a linear outcome model with a genotype effect of \(0.25\) outcome units per allele copy and a covariate effect of \(2.0\) outcome units per covariate unit. Within records whose covariate is missing, assume the mean true covariate is \(0.40\) for both \(G=0\) and \(G=1\). Also assume the full linear model is correct and the error has conditional mean zero.

The expected outcome at dosage \(G=0\) in the missing group is

$$ \alpha+0.25(0)+2.0(0.40)=\alpha+0.80. $$

At dosage \(G=1\), it is

$$ \alpha+0.25(1)+2.0(0.40)=\alpha+1.05. $$

The difference is \(1.05-0.80=0.25\) outcome units per allele copy, the stipulated genotype effect. Here the missing-group covariate mean does not vary with genotype, so it contributes no difference to this contrast. This illustrates one way the covariate need not confound the linear genotype coefficient. It is not evidence that indicator coding has recovered the missing covariate or that the same conclusion holds if the equal-mean assumption fails.

Choices for an Association Analysis

Before using a missingness indicator, identify the estimand: for example, a genotype association adjusted for the true covariate \(C\), or an association conditional on whether \(C\) was recorded. Then ask whether the indicator-coded regression identifies that target under defensible assumptions. If adjustment for \(C\) is needed and those assumptions are not credible, coding a placeholder and adding a flag is not a substitute for an appropriate missing-data analysis. Multiple imputation is one approach already used for incomplete covariates, although its validity depends on its own model and assumptions.

The indicator procedure also does not automatically fix other features of the analysis. It does not guarantee a correct outcome model, eliminate selection effects, or ensure that the reported standard error is appropriate. The coefficient's units and interpretation still depend on the outcome scale and the model. For example, a linear-regression coefficient is a difference in expected outcome per allele copy, conditional on included terms; it is not, by itself, a causal effect.

Common Mistake

Common mistake: “I filled missing covariate values with zero and included a missingness flag, so the regression has adjusted for the covariate.” The correction is that the model has adjusted for the observed values where available and for missingness status. Within records with missing values, it has not adjusted for differences in the unseen covariate. That distinction matters whenever those unseen values are associated with genotype and predict the outcome.

A reliable interpretation therefore names exactly what was modeled. “Adjusted for the observed covariate values and an indicator of missingness” is precise. “Adjusted for the covariate” is justified only when the analysis actually supports adjustment for the underlying covariate under its assumptions, not merely because a flag was added.

Check Your Understanding

Use the model and distinctions in this tutorial to answer the following questions.

  1. In missing-indicator coding, what information does \(M\) record, and what information about \(C\) does it not recover?
  2. In the linear omitted-variable bias formula, what condition makes the bias term zero when \(\gamma\ne 0\)?
  3. Among records with \(M=1\), why can the genotype contrast in expected outcome differ from the conditional genotype effect?
  4. Give an example of a goal for which “missing” can be a meaningful category, and state what that goal does not establish about the unseen covariate values.
  5. Why should the independence assumptions of a randomized treatment setting not be automatically applied to genotype in an observational GWAS?
Clinical Biostats