Tutorials › Statistical Theory III - Theories of Inference, Multivariate Methods, and Contingency Tables › Why Conventional 2SLS Wald Inference Fails

Weak Instruments · Tutorial 547 of 972

Why Conventional 2SLS Wald Inference Fails

Learn why strong-instrument Wald approximations can break down under weak identification, and see how the resulting statistics and confidence intervals behave in a scalar IV model.

Advanced 12 min read

What You'll Learn

  • Express the scalar IV model under a local-to-zero first-stage sequence
  • Derive the limit of the conventional residual-based 2SLS t statistic
  • Explain why the t and Wald limits need not be normal and chi-square
  • Work through an example where the 2SLS limit is Cauchy
  • Show how a weak-IV confidence interval can miss nominal coverage

Why Strong-Instrument Wald Inference Can Fail

Conventional 2SLS Wald inference relies on the first stage being strong enough that the estimator is approximately normal after scaling by its estimated standard error. Under weak identification, the first-stage signal can be the same order as its sampling noise. The 2SLS estimator then behaves like a ratio of random quantities, rather than concentrating around the structural coefficient. Its usual residual-based standard error can also remain random in the limit. As a result, the familiar normal and chi-square reference distributions need not apply.

The issue is not simply that a weak first stage makes the standard error large. The estimator and its estimated standard error are both affected by the same random first-stage denominator. Their ratio need not have the distribution assumed by the conventional t or Wald test.

Scalar IV Model and Local Weakness

Consider a scalar structural equation and first stage, with no intercept:

$$ y_i=\beta x_i+u_i,\qquad x_i=\pi_n z_i+v_i,\qquad i=1,\ldots,n. $$

The instrument \(z_i\) is valid: it is independent of \((u_i,v_i)\), and the errors have mean zero. They may be correlated with each other, so \(x_i\) may be endogenous. For clarity, take \(z_i\) to be independent Rademacher variables, with \(P(z_i=1)=P(z_i=-1)=1/2\). Thus \(n^{-1}\sum_i z_i^2=1\). Assume the observations are independent and identically distributed, the error covariance matrix is positive definite, and the moments needed for the central limit theorem and laws of large numbers below are finite.

The local-to-zero sequence \(\pi_n=c/\sqrt n\), for a fixed constant \(c\), describes a first stage whose signal does not dominate its sampling noise as \(n\) grows. Define

$$ U_n=\frac{1}{\sqrt n}\sum_{i=1}^n z_i u_i,\qquad V_n=\frac{1}{\sqrt n}\sum_{i=1}^n z_i v_i. $$

The joint central limit theorem gives \((U_n,V_n)\xrightarrow{d}(U,V)\), where \((U,V)\) is mean-zero bivariate normal with covariance matrix

$$ \begin{pmatrix} \sigma_u^2 & \sigma_{uv}\\ \sigma_{uv} & \sigma_v^2 \end{pmatrix}, \qquad \sigma_u^2=E[u_i^2],\quad \sigma_v^2=E[v_i^2],\quad \sigma_{uv}=E[u_i v_i]. $$
Definition: In this scalar model, the exactly identified 2SLS estimator is \(\hat\beta=(\sum_i z_i y_i)/(\sum_i z_i x_i)\), provided the denominator is nonzero. A conventional homoskedastic standard error is \(\widehat{\operatorname{se}}(\hat\beta)=\sqrt{\hat\sigma^2 z'z/(z'x)^2}\), where \(\hat\sigma^2=n^{-1}\sum_i(y_i-\hat\beta x_i)^2\). The t statistic for \(H_0:\beta=\beta_0\) is \(t=(\hat\beta-\beta_0)/\widehat{\operatorname{se}}(\hat\beta)\); the scalar Wald statistic is \(W=t^2\).

What the Weak-IV Limit Implies for the Estimator

Under the null \(\beta_0=\beta\), the estimator’s error and its denominator have a direct expression in the reduced-form sums. Since \(z_i^2=1\), \(\sum_i z_i x_i=c\sqrt n+\sum_i z_i v_i=\sqrt n(c+V_n)\). The corresponding numerator for \(\hat\beta-\beta\) is \(\sum_i z_i u_i=\sqrt n U_n\). Therefore

$$ \hat\beta-\beta=\frac{U_n}{c+V_n} \ \xrightarrow{d}\ \frac{U}{c+V}. $$

The denominator of the limit is nonzero with probability one because \(V\) has a continuous normal distribution. But it can be arbitrarily close to zero with positive probability. Consequently, this limit is not generally normal and does not collapse to zero: increasing \(n\) does not make the 2SLS estimator concentrate around \(\beta\) along this sequence.

Worked Example: A Random-Denominator Limit

Take \(c=0.5\) and \(\sigma_u^2=\sigma_v^2=1\), with \(U\) and \(V\) independent standard normal variables. The weak-IV limit is

$$ \hat\beta-\beta\ \xrightarrow{d}\ \frac{U}{0.5+V}. $$

For instance, at \(U=0.8\) and \(V=-0.3\), the denominator is \(0.5-0.3=0.2\), giving a ratio of \(0.8/0.2=4\). These values are in the support of the joint normal limit. More generally, for any small \(\varepsilon>0\), the event \(|0.5+V|<\varepsilon\) has positive probability, and ratios can be very large when the numerator is not close to zero. The limit is thus a random ratio, not the normal approximation used under strong identification.

Worked Example: The Exactly Unidentified Limit Is Cauchy

Set \(c=0\), and again let \(U\) and \(V\) be independent standard normal variables. Then the limit is \(U/V\). Its density at \(r\) is obtained by transforming \(U=rV\):

$$ f_{U/V}(r) =\int_{-\infty}^{\infty}|v|\phi(rv)\phi(v)\,dv =\frac{1}{\pi(1+r^2)}, $$

where \(\phi\) is the standard normal density. This is the standard Cauchy density. It has no finite mean or variance, and it is plainly not a normal limit. In particular, a large sample does not make this estimator approximately normal when the first-stage coefficient is zero along the sequence.

Deriving the Conventional t Limit

Under the null, the residual from the fitted structural equation is \(y_i-\hat\beta x_i=u_i-(\hat\beta-\beta)x_i\). Write \(\delta_n=\hat\beta-\beta\) and \(S_{ab}=n^{-1}\sum_i a_i b_i\). Because \(\delta_n\) is bounded in probability and \(\pi_n\to0\), the first-stage term \(\pi_n z_i\) vanishes in the residual sum of squares per observation. The law of large numbers for \(u_i^2,u_iv_i,v_i^2\), together with the continuous mapping theorem for the random coefficient \(\delta_n\), gives the joint limit

$$ \hat\sigma^2 =S_{uu}-2\delta_n S_{ux}+\delta_n^2S_{xx} \ \xrightarrow{d}\ Q(\delta) =\sigma_u^2-2\delta\sigma_{uv}+\delta^2\sigma_v^2, \qquad \delta=\frac{U}{c+V}. $$

The covariance matrix of \((u_i,v_i)\) is positive definite, so \(Q(\delta)>0\) for every real \(\delta\). The conventional standard error has the exact form \(\sqrt{\hat\sigma^2 n}/|\sum_i z_i x_i|\). Substituting the expressions for the numerator and denominator of the estimator error yields the t statistic’s limit.

Theorem: Under the model and moment conditions stated above, with \(\pi_n=c/\sqrt n\), the conventional residual-based 2SLS t statistic under \(H_0:\beta_0=\beta\) satisfies
$$ t =\frac{\hat\beta-\beta}{\widehat{\operatorname{se}}(\hat\beta)} \ \xrightarrow{d}\ T=\frac{\operatorname{sign}(c+V)\,U} {\sqrt{Q\!\left(U/(c+V)\right)}}. $$

In general, this is not a standard normal variable, and \(T^2\) is not a \(\chi^2_1\) variable.

Proof. By the estimator calculation, \(\delta_n=U_n/(c+V_n)\xrightarrow{d}U/(c+V)=\delta\). Also, \(n^{-1/2}\sum_i z_i x_i=c+V_n\). Using \(z'z=n\), the standard error is \(\sqrt{\hat\sigma^2 n}/|\sum_i z_i x_i|\). Hence

$$ t =\frac{U_n}{c+V_n} \frac{\sqrt n\,|c+V_n|}{\sqrt{\hat\sigma^2 n}} =\frac{\operatorname{sign}(c+V_n)\,U_n}{\sqrt{\hat\sigma^2}}. $$

The joint convergence of \((U_n,V_n,\hat\sigma^2)\) to \((U,V,Q(\delta))\), and the fact that \(c+V\ne0\) and \(Q(\delta)>0\) almost surely, allow the continuous mapping theorem to be applied. This gives the stated limit. Since the t limit need not be normal, its square need not have the conventional chi-square reference distribution. \(\square\)

Worked Example: A Nonstandard Wald Limit

Let \(c=0\), and suppose \((U,V)\) are independent standard normal variables. Then \(\delta=U/V\), \(\sigma_{uv}=0\), and \(\sigma_u^2=\sigma_v^2=1\). The residual-variance limit is

$$ Q(\delta)=1+\delta^2=1+\frac{U^2}{V^2}. $$

The t limit simplifies to

$$ T =\frac{\operatorname{sign}(V)U}{\sqrt{1+U^2/V^2}} =\frac{UV}{\sqrt{U^2+V^2}}, \qquad W=T^2=\frac{U^2V^2}{U^2+V^2}. $$

For \(U,V\ne0\), \(W<U^2\), since \(U^2V^2/(U^2+V^2)<U^2\). Thus \(W\) cannot have the \(\chi^2_1\) distribution: a \(\chi^2_1\) variable has the distribution of \(U^2\), while \(W\) is strictly smaller almost surely in this example. The usual Wald reference distribution therefore fails even in this simple scalar setting.

Confidence-Interval Coverage and a Useful Caution

A conventional two-sided interval based on a critical value \(q\) is \(\hat\beta\pm q\,\widehat{\operatorname{se}}(\hat\beta)\). Under the true coefficient, it covers precisely when \(|t|\le q\). If the t statistic has a nonstandard limit, the limiting coverage is \(P(|T|\le q)\), not automatically the nominal probability associated with a standard normal critical value.

Worked Example: Coverage Exceeds the Nominal Level

Continue with the preceding example, and use the conventional 95% large-sample critical value \(q=1.96\). The limiting coverage is

$$ P(|T|\le1.96) =P\!\left(\frac{|UV|}{\sqrt{U^2+V^2}}\le1.96\right). $$

Since \(T^2=W<U^2\) almost surely, the event \(|U|\le1.96\) is contained in the event \(|T|\le1.96\). The former has probability \(0.95\). The containment is strict with positive probability: for example, whenever \(2<U<3\) and \(0<V<1\), we have \(|U|>1.96\), but \(|T|<|V|<1<1.96\). Independence and the positive normal density make this event have positive probability. Therefore the limiting coverage is strictly greater than \(0.95\), not equal to its nominal 95% level. This example is conservative; it illustrates that conventional coverage is not guaranteed, rather than claiming it must always be too low.

A useful caution is that not every simplified Wald calculation fails in every special case. For example, if one substitutes the true structural error variance rather than estimating it from the 2SLS residuals, the exact-identified statistic can simplify through cancellation of the first-stage denominator. That special calculation is not the residual-based statistic derived here, and it does not justify treating conventional 2SLS inference as generally valid under weak identification. The relevant limit depends on the statistic, the variance estimator, and the weak-instrument sequence.

The practical point is that a conventional standard error and a familiar critical value do not by themselves ensure reliable inference. Under weak identification, the estimator can have a random-ratio limit, its residual-based standard error can also have a nondegenerate limit, and the resulting confidence interval can have coverage different from its advertised level. Inference methods designed to remain valid under weak instruments address this problem without relying on the strong-first-stage normal approximation.

Check Your Understanding

Use the scalar weak-IV model and distinguish the estimator limit from the limit of its conventional t statistic.

  1. Why can \(\hat\beta-\beta\) fail to converge to zero when \(\pi_n=c/\sqrt n\)?
  2. In the exactly unidentified example with independent standard normal \(U\) and \(V\), what is the distribution of \(U/V\), and why does that matter for a normal approximation?
  3. What random quantity appears as the limit of the residual variance estimate, and why is it not generally a fixed constant?
  4. In the example with \(c=0\) and independent standard normal \(U,V\), explain why the Wald limit is strictly smaller than \(U^2\) almost surely.
  5. Why does a nonstandard t limit mean that a conventional confidence interval is not guaranteed to attain its nominal coverage?
Clinical Biostats