When the Instrument Changes Outcomes Apart From Treatment
An instrumental-variable argument needs more than an instrument that changes treatment uptake. The instrument must not also change the outcome through a route that bypasses treatment. That requirement is the exclusion restriction. If an encouragement provides useful information, an eligibility notice changes income, or an offer affects stigma or access even for people whose treatment status does not change, exclusion may fail. The outcome contrast between instrument groups then combines treatment effects with those additional effects.
The central consequence is specific: even if the instrument is randomized, relevant, and monotone, the Wald ratio need not equal the local average treatment effect (LATE) for compliers. It can contain a direct-effect contribution, which may inflate, attenuate, or even reverse the ratio. The issue is not simply whether the instrument is associated with outcomes; a valid instrument is expected to affect outcomes by changing treatment. The concern is an effect that remains when treatment is held fixed.
A direct effect here means any effect of changing \(Z\) on \(Y\) that does not operate through the treatment \(D\). For example, a program offer could increase knowledge among everyone who receives it, whether or not they enroll. If knowledge changes the measured outcome, the offer has an outcome pathway beyond enrollment. Similarly, an eligibility designation might alter disposable income or access to services without changing the treatment whose effect is being estimated.
To derive the consequence for the Wald ratio, assume a binary instrument and treatment, random assignment of \(Z\) independent of the potential treatment statuses and outcomes, monotonicity \(D_i(1)\ge D_i(0)\), and a nonzero first stage. Monotonicity rules out defiers. These assumptions identify the proportions of always-takers (A), never-takers (N), and compliers (C) in the population. Do not assume exclusion for the derivation below.
How Direct Effects Enter the Wald Ratio
For each compliance type, compare the outcome under \(Z=1\) with the outcome under \(Z=0\). Always-takers and never-takers keep the same treatment status across instrument values, so their outcome contrasts are direct effects at their fixed treatment levels. Compliers change treatment from 0 to 1. Their contrast includes both a treatment effect and a direct effect. Using the treatment effect at \(Z=1\), the complier contrast can be written as:
Random assignment makes the observed mean outcome difference by instrument value equal to the corresponding average potential-outcome contrast. Write \(p_A\), \(p_N\), and \(p_C\) for the proportions of the three compliance types. The first-stage difference is \(E[D\mid Z=1]-E[D\mid Z=0]=p_C\): only compliers change treatment. Define \(\tau_C(1)=E[Y_i(1,1)-Y_i(0,1)\mid C]\). The reduced-form outcome difference is then:
Dividing by the first stage gives the decomposition:
This is the key justification: the ratio equals a complier treatment contrast at \(Z=1\) plus a direct-effect term divided by the complier proportion. Under exclusion, every \(\delta_i(d)\) is zero, and the treatment contrast at \(Z=1\) is the usual complier treatment effect. If exclusion fails, the added term is generally not zero. It can be large when the direct effects are modest but compliers are rare, because the term is divided by \(p_C\). A different decomposition can use the treatment contrast at \(Z=0\) and direct effects at \(D=1\); either way, the observed ratio mixes pathways unless the relevant direct-effect contribution vanishes.
Worked Example: A Direct Effect Across Compliance Types
Consider a hypothetical randomized encouragement study with 100 participants: 20 always-takers, 30 never-takers, and 50 compliers. Thus \(p_A=0.20\), \(p_N=0.30\), and \(p_C=0.50\). Suppose the average direct effect is 2 outcome points for always-takers at \(D=1\), 1 point for never-takers at \(D=0\), and 3 points for compliers at \(D=0\). Suppose the complier treatment contrast at \(Z=1\) is 5 points. Assume random assignment, monotonicity, and the stated type proportions; the first stage is relevant because \(p_C>0\).
The reduced-form outcome difference is:
The first-stage difference is \(0.50\), so the Wald ratio is:
The complier treatment contrast is 5 points, not 9.40. The extra 4.40 points in the ratio are the direct-effect contribution: \(\{(0.20)(2)+(0.30)(1)+(0.50)(3)\}/0.50=2.20/0.50=4.40\). All assumptions used for the decomposition are satisfied by the hypothetical setup, but exclusion is not. Therefore the ratio does not have the usual LATE interpretation.
Examples of Direct-Effect Pathways
The pathway may be concrete even when it is difficult to measure. An information campaign can change behavior or knowledge without changing the treatment of interest. An offer with a cash payment can alter an income-related outcome even for someone who does not take up the treatment. A public eligibility label can create stigma, and a referral or authorization can improve access to other services. Each is a reason to ask what the instrument itself changes, not merely whether it predicts treatment.
Worked Example: Information Changes the Outcome
Suppose a hypothetical randomized encouragement increases participation in a treatment, and the first stage is \(0.40\). Imagine the encouragement also gives participants information that raises the outcome by 2 points for every compliance type, holding treatment status fixed. Suppose the treatment contrast among compliers at \(Z=1\) is 3 points. Random assignment, monotonicity, and relevance are assumed; a nonzero information effect means exclusion is false.
With the direct effect equal to 2 points for all types and treatment levels, the direct-effect contribution to the reduced form is 2 points. The treatment contribution is \(p_C\tau_C(1)=(0.40)(3)=1.20\) points. Thus:
The ratio is 8 points per uptake, whereas the specified complier treatment contrast is 3 points. The encouragement's information pathway accounts for the difference: \(2.00/0.40=5.00\) points in the ratio. A large ratio therefore does not, by itself, show that treatment has a large effect.
Worked Example: Stigma Can Attenuate a Treatment Effect
Consider another hypothetical study of 100 people. Assume random assignment and monotonicity, with 25 always-takers, 50 never-takers, and 25 compliers. An eligibility notice produces stigma that lowers the outcome by 1 point at \(D=0\); assume no direct effect at \(D=1\). Suppose compliers have a treatment contrast of 4 points at \(Z=1\). Relevance holds because the first stage is \(p_C=0.25\); exclusion fails because the notice affects outcomes at \(D=0\).
The always-takers have no direct effect in this example. The never-takers' direct-effect contribution is \((0.50)(-1)=-0.50\) points, and the compliers' outcome contrast is their treatment effect plus the direct effect at \(D=0\): \(4+(-1)=3\) points. Their weighted contribution is \((0.25)(3)=0.75\) points. The reduced form and Wald ratio are:
The Wald ratio is 1 point per uptake, although the treatment contrast specified for compliers is 4 points. The stigma pathway offsets much of the treatment contribution. In other settings, a sufficiently large negative direct contribution could make the reduced form, and hence the ratio, negative even when the complier treatment contrast is positive.
What to Check, and What the Data Cannot Settle
The exclusion restriction concerns potential outcomes under instrument values that are not both observed for the same person. It is therefore not directly verified by comparing observed outcomes alone. Diagnostics can identify plausible pathways or contradictions, but passing a diagnostic does not establish exclusion.
- Map the instrument's actual consequences. List what assignment or receipt of the instrument changes besides treatment, including information, payments, labels, referrals, or access to other services. Ask whether each could affect the outcome while \(D\) is held fixed.
- Look for effects among people whose treatment status does not change. If a credible design or subgroup identifies an instrument effect on outcomes for non-takers, that is evidence against exclusion. In ordinary data, however, compliance types are not directly observed, so a simple comparison of observed non-takers does not automatically identify such an effect.
- Use negative-control outcomes carefully. An effect on an outcome that treatment could not plausibly affect may reveal a direct pathway or another design problem. A null result is not proof of exclusion: the chosen outcome may be insensitive, or direct effects may be specific to the primary outcome.
- Separate the reduced form from the Wald ratio. Report the instrument-outcome contrast and the instrument-treatment contrast. A weak first stage makes the ratio especially sensitive to even small direct effects, since their contribution is divided by the first stage.
A common mistake is to reason, “The instrument was randomized, so its effect on the outcome must be causal, and the Wald ratio is therefore the treatment effect.” Randomization supports a causal interpretation of the instrument's total effect, but that total effect includes every path from \(Z\) to \(Y\), not only the path through \(D\). The correction is to state the exclusion restriction separately and justify why assignment does not change the outcome at fixed treatment.
When a direct pathway is credible, the reduced-form effect of assignment can still be a meaningful policy effect of offering the instrument, under the design's other assumptions. It is not automatically the effect of treatment uptake. Alternatives include reporting the assignment effect without relabeling it as a treatment effect, or conducting a sensitivity analysis that specifies plausible bounds for direct effects and shows how those bounds alter the ratio. Such analyses depend on their stated bounds; they do not make exclusion true. If the direct effect is unknown and unrestricted, the observed reduced form and first stage alone cannot separate it from the treatment effect.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions.
- A randomized instrument has a first stage of 0.25 and a reduced-form effect of 2 outcome units. What is the Wald ratio, and does that calculation alone establish a LATE?
- An offer gives a cash payment to everyone offered, whether or not they take up treatment. Explain why this can violate exclusion for an income outcome.
- In a hypothetical design, \(p_C=0.20\), the complier treatment contrast at \(Z=1\) is 6 points, and the direct-effect contribution to the reduced form is 1 point. Calculate the reduced form and Wald ratio.
- Why does a null result on one negative-control outcome fail to prove exclusion?
Solutions. (1) The Wald ratio is \(2/0.25=8\) outcome units per treatment uptake. This calculation does not establish a LATE; a direct effect could contribute to the reduced form. (2) The payment can change income even when treatment status is held fixed, so \(Y_i(d,1)\) may differ from \(Y_i(d,0)\). (3) The treatment contribution is \((0.20)(6)=1.20\) points, so the reduced form is \(1.20+1.00=2.20\) points and the Wald ratio is \(2.20/0.20=11.0\) points per uptake. The extra 5 points in the ratio reflect the direct-effect contribution divided by the first stage. (4) The control outcome might not respond to the particular direct pathway, or the diagnostic might lack sensitivity; a null finding is not proof that all direct effects on the main outcome are zero.