Tutorials › High-Dimensional Genomic Data Analysis › Weak-Instrument Bias In Mendelian Randomization

Mendelian Randomization · Tutorial 667 of 795

Weak-Instrument Bias In Mendelian Randomization

Learn how weak-instrument bias depends on whether exposure and outcome associations are estimated in the same participants, and how partial sample overlap can change its direction.

Advanced 12 min read

What You'll Learn

  • Explain why one-sample weak-instrument bias tends toward the confounded exposure–outcome association.
  • Derive the approximate weak-instrument attenuation in two-sample Mendelian randomization without sample overlap.
  • Show how correlated estimation errors from sample overlap can pull estimates toward the observational association.
  • Distinguish expected bias patterns from the noisy result of any one weak-instrument analysis.
  • Identify design features and diagnostics relevant to weak-instrument bias.

Why Sample Structure Changes Weak-Instrument Bias

A genetic instrument can be valid in the population and still yield a biased estimate in a finite sample when its association with the exposure is weak. The direction of this bias depends in part on how the exposure and outcome associations are estimated. If the same participants contribute to both associations, random errors in those estimates can be correlated. If entirely separate samples are used, those errors are usually independent, and the dominant weak-instrument effect is different.

The comparison is about expected behavior across repeated samples, not a rule that predicts the direction of every observed estimate. A single weak-instrument estimate can be far from either its target or the usual direction of bias. The key quantities are the strength of the genetic associations with the exposure and the covariance between errors in the estimated exposure and outcome associations.

Definition: Weak-instrument bias is the finite-sample tendency of an instrumental-variable estimate to differ from the causal effect because the instruments explain little of the exposure variation. In one-sample Mendelian randomization, the estimate tends toward the confounded exposure–outcome association under standard linear-model conditions. In two-sample Mendelian randomization with independent samples, the usual summary-data approximation gives attenuation toward zero. With overlapping samples, correlated estimation errors can move the estimate away from zero and toward the confounded association.

For this discussion, suppose a linear causal model has exposure \(X\), outcome \(Y\), and valid genetic instruments \(G_1,\ldots,G_m\). Let \(\theta\) be the causal effect of \(X\) on \(Y\), measured in outcome units per exposure unit. Write \(\gamma_j\) for the population association of variant \(j\) with \(X\), and \(\theta\gamma_j\) for its population association with \(Y\). Validity here means the variants are relevant, independent of causes of the exposure and outcome, and affect the outcome only through the exposure. We also assume, for the basic comparison, that the variants are independent or that their dependence has been handled correctly, and that the association estimates are on compatible scales.

One-Sample Bias: The Pull Toward the Observational Association

In one-sample Mendelian randomization, the same participants are used to estimate variant–exposure and variant–outcome associations. In individual-level two-stage least squares, the first stage predicts exposure from the instruments, and the second stage relates that predicted exposure to the outcome. Because the first-stage predictions are estimated in the same data used in the second stage, they can retain accidental sample relationships with the outcome-model residuals. When the instruments explain little exposure variation, this finite-sample effect is more influential.

Under the usual linear instrumental-variable model, with valid instruments and appropriate model specification, the finite-sample bias of two-stage least squares tends toward the ordinary least-squares association between \(X\) and \(Y\), rather than toward the true causal effect. That ordinary association can be confounded. The tendency is not a claim that every one-sample estimate lies between the causal effect and the observational association; sampling variation can place it elsewhere. Nor does it mean that using one sample automatically invalidates an analysis: strong instruments reduce this problem, while weak instruments make it more consequential.

Worked Example: Reading a One-Sample Estimate Carefully

Suppose a hypothetical one-sample study estimates a variant–exposure association of \(0.05\) exposure standard deviations per allele and a variant–outcome association of \(0.035\) outcome standard deviations per allele. The study's observational exposure–outcome association is \(0.70\) outcome standard deviations per exposure standard deviation. For illustration, treat these as estimated associations, not as known population values.

The single-variant Wald estimate is the outcome association divided by the exposure association:

$$ \hat{\theta}_{\mathrm{Wald}}=\frac{0.035}{0.05}=0.70 $$

The ratio is \(0.70\) outcome standard deviations per exposure standard deviation, equal here to the reported observational association. This numerical agreement does not show that weak-instrument bias caused the result, or that the causal effect is \(0.70\). It illustrates why, in a one-sample setting with weak instruments, a result close to the observational association deserves careful interpretation. The expected direction of bias is toward that association under the stated model; the ratio from this one study is still subject to sampling error.

Two-Sample Bias: Attenuation Without Overlap

In two-sample Mendelian randomization, variant–exposure associations are estimated in one sample and variant–outcome associations in another. When the samples do not overlap, and the samples are otherwise independent, errors in the two sets of association estimates are approximately uncorrelated. The exposure associations in the denominator of a Wald ratio or inverse-variance weighted estimate are nevertheless noisy. Treating these noisy estimates as if they were exact generally dilutes the estimated relationship between variant–exposure and variant–outcome associations.

The following derivation makes the direction of this effect explicit for an inverse-variance weighted (IVW) slope through the origin. It is an approximation to the repeated-sampling behavior of the estimator: it uses the ratio of expected weighted sums, which is informative when many variants contribute and those sums are reasonably concentrated. It is not an exact formula for the expectation of every finite-sample ratio.

Approximation: Write the estimated associations as \(\hat{\beta}_{Xj}=\gamma_j+e_{Xj}\) and \(\hat{\beta}_{Yj}=\theta\gamma_j+e_{Yj}\), where the estimation errors have mean zero. With fixed positive weights \(w_j\), the IVW estimate is \(\hat{\theta}_{\mathrm{IVW}}=\sum_j w_j\hat{\beta}_{Xj}\hat{\beta}_{Yj}/\sum_j w_j\hat{\beta}_{Xj}^{\,2}\). If the errors are independent of the true associations, then its approximate repeated-sampling value is
$$ \frac{\sum_j w_j\left(\theta\gamma_j^2+\operatorname{Cov}(e_{Xj},e_{Yj})\right)} {\sum_j w_j\left(\gamma_j^2+\operatorname{Var}(e_{Xj})\right)}. $$

To see why, expand the numerator for each variant:

$$ E\!\left[(\gamma_j+e_{Xj})(\theta\gamma_j+e_{Yj})\right] =\theta\gamma_j^2+\operatorname{Cov}(e_{Xj},e_{Yj}), $$

where the mean-zero errors have zero expected cross-products with the fixed \(\gamma_j\). Expanding the denominator gives

$$ E\!\left[(\gamma_j+e_{Xj})^2\right] =\gamma_j^2+\operatorname{Var}(e_{Xj}). $$

With nonoverlapping samples, the covariance term is approximately zero. The denominator still includes exposure-association error variance, so the causal signal in the numerator is divided by a larger quantity. For a positive causal effect this pulls the approximation toward zero; for a negative effect it pulls it upward toward zero. This is the errors-in-variables, or regression-dilution, explanation for the usual two-sample attenuation.

Worked Example: Two Independent Samples

Consider a hypothetical collection of independent variants. For a simplified calculation, suppose their weighted signal sums satisfy \(\sum_j w_j\gamma_j^2=0.040\) and \(\sum_j w_j\operatorname{Var}(e_{Xj})=0.010\), in the corresponding squared exposure-association units. Let the true causal effect be \(\theta=0.50\) outcome units per exposure unit. Assume nonoverlapping samples, so the weighted error-covariance sum is zero.

Substitute these values into the approximation:

$$ \frac{0.50(0.040)+0}{0.040+0.010} =\frac{0.020}{0.050} =0.400. $$

The approximate value is \(0.400\) outcome units per exposure unit, below the true positive effect of \(0.50\) and closer to zero. The attenuation occurs because the noisy exposure associations increase the denominator without adding a corresponding causal signal to the numerator. The calculation illustrates the approximation; it does not imply that an actual analysis with these values must return exactly \(0.400\).

Sample Overlap: Correlated Errors Change the Direction

With overlap, some participants contribute to both association estimates. If the exposure and outcome residuals are correlated in those participants, the errors \(e_{Xj}\) and \(e_{Yj}\) can also be correlated. The covariance term in the derivation is then no longer zero. When its sign and size align with the confounded observational association, it can pull the IVW estimate away from zero and toward that association. Partial overlap often produces behavior between the nonoverlapping two-sample pattern and the one-sample pattern, but the amount and direction are not determined by the overlap fraction alone: they also depend on residual covariance, sample sizes, instrument strengths, and the analysis design.

The term “toward the observational association” describes a common pattern under standard conditions, not a universal law. If the residual covariance has the opposite sign, overlap can instead reduce attenuation or move the estimate in another direction. Differences in ancestry, measurement, or model specification between samples can also complicate the simple comparison.

Worked Example: Partial Overlap Adds a Covariance Term

Continue the hypothetical calculation above, with causal effect \(0.50\), weighted signal sum \(0.040\), and weighted exposure-error variance \(0.010\). Suppose the confounded observational association is \(0.80\) outcome units per exposure unit. Assume, solely for this illustration, that complete overlap would produce a weighted estimation-error covariance of \(0.020\), and that half overlap produces half that covariance, \(0.010\). This proportionality is an illustrative assumption, not a general formula for how overlap works.

For half overlap, the approximation is:

$$ \frac{0.50(0.040)+0.010}{0.040+0.010} =\frac{0.030}{0.050} =0.600. $$

The approximate estimate is \(0.600\), between the nonoverlap value \(0.400\) and the observational association \(0.800\). Under the stipulated complete-overlap covariance, the corresponding calculation is:

$$ \frac{0.50(0.040)+0.020}{0.040+0.010} =\frac{0.040}{0.050} =0.800. $$

Thus the assumed covariance moves the approximation toward the observational association. The arithmetic demonstrates the mechanism, not a general prediction that half of the participants overlapping will cause a particular numerical shift.

What to Check in Practice

Weak-instrument bias is a design and interpretation issue, not something that can be resolved by comparing a single result with a preferred value. Check how the samples were assembled and whether participants overlap, including overlap through related cohorts or shared controls. Assess how precisely the variants predict the exposure, and whether estimates come from comparable populations and measurement scales. If an observational exposure–outcome association is available, it can help contextualize the expected direction of one-sample bias, but closeness to that association is not proof of bias.

A useful design comparison is:

Analysis designTypical weak-instrument tendencyImportant qualification
One sampleToward the confounded observational associationA finite-sample tendency under standard linear-model conditions, not a guaranteed direction for one estimate.
Two samples with no overlapToward zero through exposure-association errorRequires independent estimation errors and compatible association estimates.
Two samples with overlapMay move away from zero and toward the observational associationThe direction and magnitude depend on error covariance, not overlap percentage alone.

Where feasible, independent exposure and outcome samples reduce the correlated-error component, although weak exposure associations can still cause attenuation. A separate sample is not automatically a cure: it must provide sufficiently informative exposure associations and a population relevant to the outcome sample. Conversely, the one-sample design is not inherently unusable, but weak instruments warrant attention to finite-sample behavior. The balance between sample size, instrument strength, and overlap matters.

Common Mistakes and Limitations

  • “Two-sample MR has no weak-instrument bias.” Independence removes the overlap covariance under the idealized conditions, not the exposure-association measurement error that produces attenuation.
  • “Overlap always makes the estimate more biased in the same direction.” Overlap can correlate errors, but the covariance sign and size depend on the data-generating process. The pull toward the observational association is a common result under standard conditions, not an unconditional guarantee.
  • “An estimate close to the observational association proves one-sample bias.” Sampling variation, confounding, model differences, or other problems can also produce that result. Directional expectations do not diagnose a particular estimate on their own.
  • “The overlap percentage determines the bias.” The numerical illustration assumed covariance proportional to overlap for simplicity. Real covariance also depends on residual relationships, sample sizes, and how associations were estimated.

The approximation derived here is deliberately limited: it treats weights as fixed, assumes mean-zero association errors, and uses a ratio of expected sums as an approximation. More complicated designs may require explicit modeling of the joint estimation errors. Weak instruments can also make ratios unstable, especially when an estimated exposure association is near zero. These limitations are reasons to interpret estimates with their design and uncertainty in view, rather than to infer that a particular bias correction is automatically appropriate.

Key takeaway: With weak instruments, one-sample estimates tend to be pulled toward the confounded observational association, while two-sample estimates with independent samples tend to be attenuated toward zero. Sample overlap can correlate association-estimation errors and alter that pattern; its effect depends on the covariance, not simply on the presence of overlap.

Check Your Understanding

Answer each question, then compare with the solutions below.

  1. Why does exposure-association estimation error attenuate a two-sample IVW estimate when the exposure and outcome samples are independent?
  2. In the approximation, let the weighted signal sum be \(0.030\), the weighted exposure-error variance be \(0.010\), the causal effect be \(0.40\), and the error-covariance sum be zero. Calculate the approximate estimate.
  3. For the values in question 2, suppose instead that the error-covariance sum is \(0.006\). Calculate the new approximate estimate and describe the change.
  4. Does a one-sample estimate equal to the observational association establish that weak-instrument bias is responsible? Why or why not?
  5. Why is the percentage of sample overlap insufficient by itself to determine the direction and size of weak-instrument bias?

Solutions. (1) Exposure-association error increases the expected denominator through \(\operatorname{Var}(e_{Xj})\), while independent samples give approximately zero error covariance in the numerator. The causal signal is therefore divided by an inflated denominator, producing attenuation toward zero. (2) The approximation is \([0.40(0.030)+0]/(0.030+0.010)=0.012/0.040=0.300\) outcome units per exposure unit. (3) It becomes \([0.40(0.030)+0.006]/0.040=0.018/0.040=0.450\) outcome units per exposure unit. The positive covariance has moved the approximation upward, away from zero; whether that is toward the observational association depends on the data-generating process. (4) No. The expected one-sample tendency does not establish the cause of an individual result; sampling variation and other features could also explain the equality. (5) Overlap affects estimation-error covariance, whose size and sign also depend on residual covariance, sample sizes, and how the associations were estimated.

Clinical Biostats