Why Stock-Yogo Critical Values Are Criterion-Specific
A first-stage statistic summarizes how strongly the excluded instruments predict the endogenous regressors. But a statistic such as the Cragg-Donald statistic does not, by itself, say how much weakness is acceptable. A critical value gives the statistic a more specific interpretation: it compares instrument strength with a chosen tolerance for relative bias or for the size of a nominal test. The tolerance must be stated because different tolerances produce different critical values and can produce different assessments from the same statistic.
Stock-Yogo critical values are used with the conventional, homoskedastic Cragg-Donald statistic. They depend on the number of endogenous regressors, the number of excluded instruments, and the selected criterion. A valid comparison therefore begins by identifying all three. Looking up a value for the wrong instrument count or the wrong criterion can reverse the practical conclusion.
The Setup and the Assumptions Behind the Comparison
Suppose a linear instrumental-variables model has \(K_1\) endogenous regressors and \(L\) excluded instruments, alongside any included exogenous controls. The Cragg-Donald statistic is a conventional measure of first-stage strength for this setting; with multiple endogenous regressors it reflects the weakest relevant first-stage direction. Stock-Yogo tables translate this statistic into a benchmark assessment for a specified tolerance.
The standard Stock-Yogo critical values are derived for the conventional homoskedastic linear IV setting and its associated distributional framework. In applying them, the observations and errors must fit the assumptions underlying that framework; in particular, the errors must be homoskedastic for the conventional Cragg-Donald comparison to have its intended calibration. The instruments must also satisfy the model's exclusion and exogeneity requirements for an IV analysis to be causally meaningful. However, the Stock-Yogo comparison assesses strength, not whether those validity requirements hold.
The tables offer two distinct kinds of tolerance:
- Maximum relative bias: a specified upper bound on the relative bias of 2SLS compared with the bias of the corresponding OLS estimator, under the framework used to construct the table. For example, a 10% maximum relative-bias criterion asks whether the statistic reaches the threshold associated with limiting that relative bias to the specified level.
- Maximum size: an upper bound on the actual rejection probability of a nominal 5% Wald test of an IV coefficient under the weak-instrument configurations considered. For example, a 20% maximum-size criterion asks whether the statistic reaches the threshold associated with keeping that actual size at or below 20%.
“Maximum size” here means a maximum actual rejection probability, not a 20% probability that a particular null hypothesis is true. A 20% maximum-size benchmark is also not the same as a 20% relative-bias benchmark. The two criteria address different consequences of weak instruments, so their critical values need not agree.
How to Use the Table
First determine \(K_1\) and \(L\) from the model, counting endogenous regressors and excluded instruments, respectively. Then choose the criterion that matches the concern being evaluated and find the critical value for that exact combination. Compare the Cragg-Donald statistic with the lookup value. The conclusion should name the criterion: the statistic either meets or falls short of that specific benchmark.
Record the number of endogenous regressors and excluded instruments in the model being assessed.
Choose the maximum relative-bias criterion or maximum-size criterion relevant to the analysis. Do not silently substitute one for the other.
Use a Stock-Yogo table entry with the same dimensions and criterion, then compare it with the Cragg-Donald statistic.
Say whether the statistic meets the stated benchmark, and also state that this is not a test of instrument validity or a guarantee of reliable inference under every alternative criterion.
This comparison is not a conventional hypothesis test that yields a p-value. The critical value is a threshold linked to a performance criterion. Exceeding it means the statistic passes that selected screen; it does not mean that weak instruments have been disproved in every sense.
Worked Example: Three Instruments Under a Maximum-Size Criterion
Suppose a hypothetical homoskedastic IV analysis has one endogenous regressor and three excluded instruments. Its Cragg-Donald statistic is 11.7. The analyst wants to apply the 20% maximum-size criterion for a nominal 5% Wald test.
Check the table dimensions. There is \(K_1=1\) endogenous regressor and \(L=3\) excluded instruments. The applicable Stock-Yogo value for a 20% maximum-size criterion is 10.56.
Compare the statistic with the critical value.
The statistic exceeds the threshold by
Thus, the statistic meets the selected 20% maximum-size benchmark. In context, this means it reaches the Stock-Yogo threshold associated with limiting the actual size of a nominal 5% Wald test to at most 20% in the framework used for the table. It does not mean that the actual size in this particular application has been measured to be 20%, nor does it show that the instruments satisfy exclusion or exogeneity.
Maximum Relative Bias and Maximum Size Can Disagree
Choosing the criterion is a substantive part of the assessment, not a minor table detail. A researcher concerned about 2SLS bias relative to OLS may select a maximum relative-bias benchmark. A researcher concerned about the over-rejection of conventional Wald tests may select a maximum-size benchmark. Neither criterion is a universal definition of “strong enough.” The selected benchmark should be named when reporting the result, and the analysis should not switch criteria simply because one yields a more favorable conclusion.
Worked Example: Applying a Relative-Bias Threshold
Consider a hypothetical model with one endogenous regressor and one excluded instrument. Suppose its Cragg-Donald statistic is 8.4, and the analyst selects the 10% maximum relative-bias criterion. The corresponding Stock-Yogo critical value is 9.08.
The comparison is
The statistic falls short of the selected threshold by
So this statistic does not meet the 10% maximum relative-bias benchmark. The proper conclusion is not that the 2SLS estimate has been shown to have more than 10% relative bias in this sample. Rather, the observed statistic does not reach the table threshold associated with that bound under the table's assumptions. This is a warning about the strength evidence under the chosen criterion.
Worked Example: One Statistic, Two Different Benchmarks
Suppose a hypothetical model has one endogenous regressor and one excluded instrument, with a Cragg-Donald statistic of 12.0. For this dimension, the 10% maximum relative-bias critical value is 9.08, while the 10% maximum-size critical value is 16.38.
Under the relative-bias criterion,
so the statistic meets the 10% maximum relative-bias benchmark. Under the maximum-size criterion,
so it does not meet the 10% maximum-size benchmark. The statistic has not changed; the criterion has. These results are not contradictory: one says the statistic reaches a particular relative-bias threshold, while the other says it does not reach the threshold for controlling actual size to 10%.
Why the Comparison Works
The justification is a direct consequence of how the table is constructed. For a fixed \(K_1\), \(L\), and selected criterion, the Stock-Yogo critical value is the threshold at which the corresponding bound is attained in the model used to derive the table. The Cragg-Donald statistic measures strength on the scale used by that derivation. Comparing the observed statistic with the threshold therefore tells us whether it reaches that criterion's benchmark.
The logic can be stated explicitly. Let \(c(K_1,L,\tau)\) denote the critical value for dimensions \(K_1,L\) and criterion \(\tau\), and let \(CD\) denote the observed Cragg-Donald statistic. The decision rule is:
If \(CD<c(K_1,L,\tau)\), it falls short of that benchmark. This implication is deliberately limited: meeting a table benchmark does not establish that the model's assumptions are true, and falling short does not prove that a particular coefficient estimate is biased by a specific amount. The table supplies a criterion-based diagnostic, not a sample-specific estimate of bias or size.
Diagnostics, Alternatives, and Limitations
Before relying on a Stock-Yogo comparison, check the instrument count, the number of endogenous regressors, the selected criterion, and the statistic's construction. A common practical error is to use a conventional critical value with a statistic based on a different covariance structure. In particular, heteroskedasticity can invalidate the conventional homoskedastic calibration. The later material on heteroskedasticity-robust first-stage tests addresses diagnostics designed for that setting; conventional Stock-Yogo values should not be treated as robust substitutes.
Other failure modes include reporting a critical value without naming its criterion, using a threshold for one endogenous regressor when the model has several, and interpreting a pass as proof that conventional 2SLS inference is reliable. Even with a pass, the instruments may be invalid, the model may be misspecified, or another performance criterion may not be met. If a comparison fails, it is evidence that strength does not satisfy the selected benchmark, not a reason to change the criterion after seeing the result.
The main alternative is to report a different weak-instrument diagnostic suited to the data and assumptions. For example, a heteroskedasticity-robust first-stage procedure is needed when the conventional homoskedastic assumptions do not hold. A Stock-Yogo result remains useful when its assumptions fit and its target criterion is relevant, but it should be presented alongside the model and assumptions that justify its use. It does not replace assessment of instrument exogeneity, exclusion, or the broader identification argument.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions.
- A model has one endogenous regressor, three excluded instruments, and a Cragg-Donald statistic of 10.2. Does it meet the 20% maximum-size benchmark with critical value 10.56?
- For one endogenous regressor and one excluded instrument, a statistic is 17.0. Does it meet both the 10% maximum relative-bias benchmark of 9.08 and the 10% maximum-size benchmark of 16.38?
- Why is a Stock-Yogo comparison not a p-value test of the null hypothesis that instruments are weak?
- What is wrong with using the conventional Stock-Yogo values unchanged when the errors are heteroskedastic?
- If a statistic exceeds its selected critical value, what can and cannot be concluded about the instruments?
Solutions. (1) No. Since \(10.2<10.56\), the statistic falls short of the specified 20% maximum-size benchmark. (2) Yes, it exceeds both thresholds: \(17.0>9.08\) and \(17.0>16.38\). It meets both stated benchmarks, subject to the assumptions behind the conventional tables. (3) The critical value is a threshold tied to a maximum-bias or maximum-size performance criterion, not a cutoff that produces a p-value for a conventional hypothesis test. (4) Heteroskedasticity changes the relevant calibration, so the conventional homoskedastic statistic and its Stock-Yogo threshold may not provide the intended assessment. (5) One may conclude that the statistic meets the specified strength benchmark under the applicable assumptions. One cannot conclude from that comparison alone that the instruments are exogenous, satisfy exclusion, or meet every other definition of adequate strength.