Tutorials › Propensity Score Matching and Instrumental Variables › The Wald Ratio as a Scaled Outcome Contrast

IV Assumptions and Local Average Treatment Effects · Tutorial 451 of 699

The Wald Ratio as a Scaled Outcome Contrast

Learn to calculate the Wald ratio from binary-instrument outcome and treatment contrasts, interpret its scale, and recognize when a numerical ratio is unstable or its causal interpretation is unsupported.

Advanced 9 min read

What You'll Learn

  • Define the reduced-form outcome contrast and first-stage treatment contrast for a binary instrument.
  • Calculate the sample Wald ratio from observed group means and treatment proportions.
  • Interpret the ratio in outcome units per full-unit change in treatment receipt.
  • Check how reversing instrument coding affects the signs of the contrasts and their ratio.
  • Recognize why a small first stage can make the ratio unstable and why the ratio alone does not establish causality.

From Two Contrasts to One Ratio

A binary instrument can shift both the probability of receiving a treatment and the average outcome. The Wald ratio combines these two contrasts: it scales the outcome change associated with the instrument by the treatment-receipt change associated with the same instrument. This calculation is simple, but its interpretation depends on keeping the numerator, denominator, and assumptions distinct.

Let \(Z\) be a binary instrument, with \(Z=1\) and \(Z=0\) denoting its two values. Let \(D\) be a binary treatment indicator, where \(D=1\) means the person received treatment, and let \(Y\) be the outcome. In a population, the reduced-form outcome contrast is the difference in mean outcomes between the two instrument groups. The first-stage treatment contrast is the difference in treatment-receipt proportions between those groups.

Definition: For a binary instrument \(Z\), binary treatment \(D\), and outcome \(Y\), the reduced-form contrast is \(\Delta_Y=E[Y\mid Z=1]-E[Y\mid Z=0]\). The first-stage contrast is \(\Delta_D=E[D\mid Z=1]-E[D\mid Z=0]\). If \(\Delta_D\ne 0\), the Wald ratio is \(\Delta_Y/\Delta_D\). In a sample, replace the expectations with the corresponding group sample means or proportions.

Because \(D\) is binary, \(E[D\mid Z=z]=P(D=1\mid Z=z)\): the average of the treatment indicator is the proportion receiving treatment. The numerator is measured in units of \(Y\). The denominator is a difference in treatment probabilities, or a difference in proportions. Their ratio therefore has the same units as \(Y\), interpreted as the outcome contrast scaled to a full, one-unit change in treatment probability.

For example, if the instrument raises treatment receipt by 0.25 and is associated with a 2-unit increase in mean outcome, the Wald ratio is \(2/0.25=8\) outcome units. The ratio is not the 2-unit outcome contrast itself: that contrast corresponds to a 0.25 change in treatment probability. Nor is the ratio automatically a causal treatment effect. A causal interpretation requires assumptions about the instrument, not just division of two observed contrasts.

What Must Be in Place Before Interpreting the Ratio

The calculation can always be made when the sample first-stage contrast is nonzero. Interpreting it as causal requires more. The assumptions below describe the framework for a binary instrument and treatment; the earlier material on instrumental-variable assumptions develops their roles.

  • Relevance: the instrument changes treatment receipt in the population, so \(\Delta_D\ne 0\). A sample difference alone does not guarantee a meaningful population shift.
  • Independence: the instrument is independent of the potential treatment receipts and potential outcomes. Informally, instrument assignment does not systematically select people with different potential responses.
  • Exclusion: the instrument affects the outcome only through treatment receipt; it has no separate pathway to \(Y\).
  • Monotonicity: changing the instrument from 0 to 1 does not make some people less likely to receive treatment while making others more likely. In potential-treatment notation, \(D(1)\ge D(0)\) for every individual.
  • Consistency and a well-defined treatment: observed treatment and outcome correspond to the relevant potential values, and the treatment contrast has a coherent meaning.

Relevance is the assumption directly reflected in the denominator, but it is not the only one that matters. Independence, exclusion, and monotonicity are not established by obtaining a nonzero ratio. They require design knowledge and substantive justification. Without those conditions, the Wald ratio remains a scaled association between instrument groups rather than a justified causal effect.

Worked Examples

Worked Example: Calculating the Ratio From Two Instrument Groups

Hypothetical data: Suppose a randomized encouragement instrument is assigned to 200 people in each group. In the \(Z=1\) group, 140 receive treatment and the mean outcome is 12 points. In the \(Z=0\) group, 80 receive treatment and the mean outcome is 9 points. Calculate and interpret the sample Wald ratio.

The treatment proportions are \(140/200=0.70\) and \(80/200=0.40\). Thus the first-stage contrast is

$$ \hat{\Delta}_D=0.70-0.40=0.30. $$

The reduced-form outcome contrast is

$$ \hat{\Delta}_Y=12-9=3\text{ points}. $$

Divide the outcome contrast by the treatment contrast:

$$ \hat{\tau}_{W}=\frac{\hat{\Delta}_Y}{\hat{\Delta}_D} =\frac{3\text{ points}}{0.30}=10\text{ points}. $$

The encouragement group has a treatment-receipt proportion 0.30 higher and a mean outcome 3 points higher. The Wald ratio rescales that 3-point outcome contrast to 10 points per full-unit increase in treatment probability. This arithmetic is correct, but interpreting 10 points as a causal effect still requires the IV assumptions; the two observed group contrasts do not verify them.

Worked Example: Reversing the Instrument Coding

Hypothetical data: Consider the same kind of outcome, but code \(Z=1\) as receiving a standard invitation and \(Z=0\) as receiving a more intensive invitation. Suppose the standard-invitation group has a treatment proportion of 0.45 and a mean outcome of 8 points. The more-intensive-invitation group has a treatment proportion of 0.65 and a mean outcome of 10 points. Calculate the Wald ratio using the stated coding.

With \(Z=1\) denoting the standard invitation, the first-stage contrast is

$$ \hat{\Delta}_D=0.45-0.65=-0.20. $$

The reduced-form contrast, using the same order of groups, is

$$ \hat{\Delta}_Y=8-10=-2\text{ points}. $$

Therefore,

$$ \hat{\tau}_{W}=\frac{-2\text{ points}}{-0.20}=10\text{ points}. $$

Both contrasts are negative because the \(Z=1\) group is the less-intensive invitation group. Their ratio is positive because reversing the order changes both signs. If the instrument coding is reversed consistently, the Wald ratio does not change. Reporting the coding and contrast order prevents a sign from being mistaken for an effect direction.

Worked Example: A Small First Stage Produces a Large Ratio

Hypothetical data: Suppose an instrument group has a mean outcome 0.9 points higher than the comparison group, while its treatment proportion is only 0.03 higher. Calculate the Wald ratio and explain what should be checked before emphasizing it.

Here, \(\hat{\Delta}_Y=0.9\) points and \(\hat{\Delta}_D=0.03\). Thus,

$$ \hat{\tau}_{W}=\frac{0.9\text{ points}}{0.03}=30\text{ points}. $$

The ratio is 30 points per full-unit treatment-probability change. But the observed instrument contrast changed treatment receipt by only 0.03, or 3 percentage points. A small denominator magnifies the numerator: even modest sampling variation in either contrast can substantially alter the ratio. Before giving this estimate a strong interpretation, inspect the treatment proportions, the precision of both contrasts, and whether the instrument plausibly meets the IV assumptions. A large ratio is not, by itself, evidence of a large or precise causal effect.

Why the Scaling Works—and What It Does Not Show

The arithmetic can be seen directly. Write the first-stage contrast as \(\delta\), where \(\delta\ne 0\), and the reduced-form contrast as \(\gamma\). The ratio \(\gamma/\delta\) is the number that, when multiplied by the treatment contrast, reproduces the outcome contrast:

$$ \delta\left(\frac{\gamma}{\delta}\right)=\gamma. $$

Thus, the Wald ratio answers a scaling question: how large is the observed outcome contrast relative to the instrument-induced treatment contrast? This identity explains the units and the rescaling, but it does not prove that the ratio equals an effect of treatment. Such an interpretation comes from the assumptions connecting instrument assignment, treatment receipt, and outcomes. For instance, if exclusion fails because the instrument changes outcomes through another pathway, the numerator can include that direct pathway even when the denominator is calculated correctly.

The sample version uses the same calculation with observed group summaries:

$$ \hat{\tau}_{W} = \frac{\bar{Y}_{Z=1}-\bar{Y}_{Z=0}} {\hat{p}_{Z=1}-\hat{p}_{Z=0}}, $$

where \(\bar{Y}_{Z=z}\) is the sample mean outcome in instrument group \(z\), and \(\hat{p}_{Z=z}\) is the sample proportion treated in that group. The numerator and denominator must use the same groups and the same ordering. Using \(Z=1\) minus \(Z=0\) in the numerator but \(Z=0\) minus \(Z=1\) in the denominator flips the reported sign and does not represent the defined Wald ratio.

Diagnostics, Alternatives, and Limits

Begin with the two contrasts rather than reporting only their ratio. Show the instrument-group sample sizes, treatment proportions, and outcome means, and state which group is subtracted from which. These summaries make it possible to detect coding errors, a reversed treatment direction, or an unexpectedly small first stage. If the first-stage contrast is zero, the Wald ratio is undefined. If it is close to zero, the ratio can be highly sensitive to small changes in the data.

The contrasts also have distinct roles. The reduced form describes the outcome difference by instrument group; the first stage describes the treatment-receipt difference by instrument group. Reporting the reduced form alone avoids dividing by a small treatment shift but does not express an outcome change per treatment shift. Reporting only the first stage establishes the observed treatment shift but says nothing about the outcome contrast. The Wald ratio combines them, and so inherits the assumptions and uncertainty relevant to both.

A ratio calculated from group summaries is a transparent binary-instrument calculation. Other IV analyses may use regression or additional covariates, but those approaches do not make a problematic instrument valid merely by changing the calculation. Ordinary comparisons of treated and untreated people answer a different question and can be confounded when treatment receipt is related to outcome determinants. Conversely, if the instrument is not independent or has a direct effect on the outcome, the Wald ratio does not repair those failures.

A final limitation is that the ratio alone does not identify which people or which population average its causal interpretation concerns. That target depends on the IV framework and its assumptions, not on the numerical division. Keep the descriptive calculation, the causal assumptions, and the substantive interpretation separate when presenting results.

Common Mistakes

  • Calling the numerator the treatment effect. The numerator is the outcome contrast by instrument status. It can reflect the instrument's effect on treatment uptake, and it is not automatically the effect of treatment itself.
  • Forgetting what the denominator measures. The first stage is a difference in treatment probabilities, not a treatment-group mean outcome or a count of treated individuals.
  • Reversing only one contrast. Both contrasts must use the same instrument-group order; otherwise their ratio has an erroneous sign.
  • Interpreting a large ratio as automatically convincing. A small first stage can inflate the ratio and make it unstable. Check the component contrasts and their uncertainty.
  • Treating a nonzero first stage as proof of validity. Relevance does not establish independence, exclusion, or monotonicity.
Key takeaway: The Wald ratio is the reduced-form outcome contrast divided by the first-stage treatment contrast. Its units and scaling follow from that division; its causal meaning depends on IV assumptions that the calculation itself cannot verify.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. An instrument group has a treatment proportion of 0.62 and mean outcome of 15 units. The comparison group has a treatment proportion of 0.42 and mean outcome of 13 units. What are the first-stage contrast, reduced-form contrast, and Wald ratio?
  2. Why does the Wald ratio have the same units as the outcome, even though it divides by a treatment-probability difference?
  3. If both instrument contrasts change sign when the instrument coding is reversed, what happens to the Wald ratio?
  4. An estimated first-stage contrast is zero. Can the Wald ratio be calculated? Explain.
  5. True or false: a nonzero first-stage contrast is enough to establish that the Wald ratio has a causal interpretation. Explain.

Solutions. (1) The first stage is \(0.62-0.42=0.20\), and the reduced form is \(15-13=2\) units. The ratio is \(2/0.20=10\) outcome units. (2) The denominator is a dimensionless probability difference, so dividing outcome units by it leaves outcome units; the value scales the contrast to a full-unit treatment-probability change. (3) The ratio is unchanged because both signs reverse and \((-a)/(-b)=a/b\). (4) No. Division by zero is undefined, and a zero first stage provides no instrument-induced treatment shift to scale by. (5) False. Relevance concerns the first stage; independence, exclusion, and monotonicity also matter for a causal interpretation.

Clinical Biostats