Tutorials › Causal Inference › Worked Wald Estimates with Compliance-Type Tables

Instrumental Variable Assumptions and Estimands · Tutorial 499 of 972

Worked Wald Estimates with Compliance-Type Tables

Work from compliance-type tables to calculate a Wald estimate and assess whether the IV assumptions support a complier-average interpretation.

Intermediate 11 min read

What You'll Learn

  • Identify each compliance type’s treatment under each instrument assignment
  • Calculate first-stage and reduced-form contrasts from type shares and outcomes
  • Compute a Wald ratio with its outcome units
  • Check how independence, exclusion, monotonicity, and relevance support interpretation
  • Recognize why violating exclusion can change what the Wald ratio represents

From Compliance Types to a Wald Estimate

A Wald estimate is a ratio of two assignment contrasts: the change in treatment receipt associated with changing the instrument, divided by the corresponding change in the outcome. A compliance-type table makes both contrasts concrete. It shows which individuals change treatment when assignment changes, and how their outcomes contribute to the assignment contrast.

The calculation is straightforward; its interpretation is conditional. Under the instrumental-variable assumptions, the ratio identifies an average treatment effect for compliers. Without those assumptions, the same arithmetic still produces a number, but that number need not be a causal effect for compliers. This tutorial works through both situations using hypothetical population tables.

Definition: Let \(Z\) be a binary instrument or assignment, with values 0 and 1; let \(D\) be a binary treatment; and let \(Y\) be an outcome. Write \(D(z)\) for the treatment an individual would receive under assignment \(z\), and \(Y(d)\) for the outcome under treatment \(d\). A complier has \(D(0)=0,D(1)=1\); a never-taker has \(D(0)=D(1)=0\); an always-taker has \(D(0)=D(1)=1\); and a defier has \(D(0)=1,D(1)=0\).

The tables below report type counts or proportions and, where needed, average potential outcomes within types. They describe hypothetical populations, not real studies. Under independence of assignment from the relevant potential outcomes and treatment responses, the type composition is the same across assignment groups in expectation. Under exclusion, assignment affects the outcome only through treatment, so the outcome under treatment \(d\) is \(Y(d)\), regardless of \(Z\).

Monotonicity rules out defiers, and relevance requires a nonzero first-stage contrast. In this setting the first stage is the difference in treatment rates between assignment groups; the reduced form is the difference in their mean outcomes. The Wald ratio divides the latter by the former.

Key formula: With assignment group means calculated as \(E(D\mid Z=z)\) and \(E(Y\mid Z=z)\), the first-stage contrast is \(\Delta_D=E(D\mid Z=1)-E(D\mid Z=0)\), the reduced-form contrast is \(\Delta_Y=E(Y\mid Z=1)-E(Y\mid Z=0)\), and the Wald ratio is \(\Delta_Y/\Delta_D\), provided \(\Delta_D\ne 0\). Its units are outcome units per unit of treatment; for binary treatment, this is the outcome difference associated with receiving treatment.

Worked Calculation Under the IV Assumptions

For each table, use the assigned-treatment pattern to work out who receives treatment under each value of \(Z\). Then calculate treatment and outcome means separately for \(Z=1\) and \(Z=0\). Do not confuse the reduced form, which is an outcome contrast, with the Wald ratio, which rescales that contrast by the first stage.

Worked Example: A Clear First Stage and an Outcome in Points

Consider a hypothetical population of 60 people. The table gives each compliance type’s count and its average outcome under each treatment level. The outcome is a score measured in points. Assume assignment is independent of the potential treatment and outcome values, exclusion holds, and there are no defiers.

TypeCount\(D(0)\)\(D(1)\)Mean \(Y(0)\)Mean \(Y(1)\)
Never-takers200025
Compliers300137
Always-takers101148

First stage. Under \(Z=1\), compliers and always-takers receive treatment, so the treatment rate is \((30+10)/60=40/60\). Under \(Z=0\), only always-takers receive treatment, so the rate is \(10/60\). Therefore,

$$ \Delta_D=\frac{40}{60}-\frac{10}{60} =\frac{30}{60}=0.5000. $$

Reduced form. Under \(Z=1\), never-takers have \(Y(0)\), while compliers and always-takers have \(Y(1)\). The mean outcome is

$$ E(Y\mid Z=1) =\frac{20(2)+30(7)+10(8)}{60} =\frac{330}{60}=5.500\text{ points}. $$

Under \(Z=0\), never-takers and compliers have \(Y(0)\), and always-takers have \(Y(1)\):

$$ E(Y\mid Z=0) =\frac{20(2)+30(3)+10(8)}{60} =\frac{210}{60}=3.500\text{ points}. $$

Thus, \(\Delta_Y=5.500-3.500=2.000\) points. The Wald ratio is

$$ \frac{\Delta_Y}{\Delta_D} =\frac{2.000\text{ points}}{0.5000} =4.000\text{ points}. $$

The compliers’ mean treatment effect in this table is \(7-3=4\) points, matching the ratio. Under the stated assumptions, the Wald ratio identifies the average treatment effect for compliers. It is not, just from this calculation, an effect for every person in the population.

Why the Ratio Identifies a Complier Effect

The table calculation follows a general cancellation argument. Under independence, assignment groups have the same compliance-type proportions and potential outcome distributions in expectation. Under exclusion, an individual’s outcome depends on treatment rather than directly on assignment. Under monotonicity, only compliers change treatment status when \(Z\) changes. Never-takers and always-takers therefore contribute no treatment-rate change.

Let \(C\) denote the event that a person is a complier, and let \(P(C)\) be the complier proportion. The treatment-rate difference is the proportion who move from untreated to treated:

$$ \Delta_D=P(C). $$

To see what happens to the outcome contrast, compare the two assignments by compliance type. Never-takers receive treatment 0 under either assignment, so their outcomes cancel from the contrast. Always-takers receive treatment 1 under either assignment, so their outcomes also cancel. Compliers have \(Y(1)\) under \(Z=1\) and \(Y(0)\) under \(Z=0\). Their contribution to the population outcome contrast is their proportion times their mean treatment effect:

$$ \Delta_Y=P(C)E\{Y(1)-Y(0)\mid C\}. $$

When \(P(C)>0\), dividing the reduced form by the first stage gives

$$ \frac{\Delta_Y}{\Delta_D} = \frac{P(C)E\{Y(1)-Y(0)\mid C\}}{P(C)} = E\{Y(1)-Y(0)\mid C\}. $$

This short derivation explains why each assumption matters to interpretation: independence makes the assignment groups comparable in their potential responses, exclusion removes a direct assignment effect on outcomes, and monotonicity ensures that the first stage represents compliers rather than a net of people moving in opposite directions. Relevance ensures the denominator is nonzero.

A Smaller First Stage and an Outcome in Days

A smaller first stage means the reduced form is divided by a smaller number. This can produce a larger Wald ratio even when the outcome contrast is modest. In this example, the assumptions still support the complier interpretation, but the ratio must be read in the outcome’s units.

Worked Example: A Smaller First Stage and an Outcome in Days

In a hypothetical population of 100 people, 40 are never-takers, 10 are compliers, and 50 are always-takers. The outcome is recovery time in days, and the table gives mean potential outcomes. Assume assignment is independent, exclusion holds, and there are no defiers.

TypeCount\(D(0)\)\(D(1)\)Mean \(Y(0)\), daysMean \(Y(1)\), days
Never-takers400025
Compliers1001410
Always-takers501169

Under \(Z=1\), 60 people receive treatment: 10 compliers and 50 always-takers. Under \(Z=0\), 50 always-takers receive treatment. Hence,

$$ \Delta_D=\frac{60}{100}-\frac{50}{100}=0.1000. $$

The \(Z=1\) outcome mean is \(\{40(2)+10(10)+50(9)\}/100=630/100=6.300\) days. The \(Z=0\) outcome mean is \(\{40(2)+10(4)+50(9)\}/100=570/100=5.700\) days. Therefore,

$$ \Delta_Y=6.300-5.700=0.6000\text{ days}, \qquad \frac{\Delta_Y}{\Delta_D} =\frac{0.6000}{0.1000} =6.000\text{ days}. $$

Among compliers, the mean treatment effect is \(10-4=6\) days, exactly the Wald ratio. With recovery time as the outcome, a positive effect means longer recovery under treatment in this table. The ratio is an effect in days, not a percentage or a treatment probability.

When the Arithmetic Does Not Give a Complier Effect

The same recipe can be used when an assumption fails, but the usual causal interpretation no longer follows automatically. In particular, if assignment can affect the outcome directly, the reduced form includes more than the pathway through treatment. Dividing that combined contrast by the first stage does not generally remove the direct effect.

Worked Example: A Direct Assignment Effect Breaks the Interpretation

Consider a hypothetical population with 50 never-takers, 30 compliers, and 20 always-takers. There are no defiers, assignment is independent, and the first stage is positive. However, suppose \(Z=1\) directly increases the outcome by 2 points for everyone, even at the same treatment level. The table gives mean outcomes under each treatment and assignment combination.

TypeCount\(D(0)\)\(D(1)\)Mean \(Y(0,0)\)Mean \(Y(1,0)\)Mean \(Y(0,1)\)Mean \(Y(1,1)\)
Never-takers50003—5—
Compliers300148610
Always-takers2011—6—8

Here \(Y(d,z)\) explicitly allows the outcome to depend on assignment as well as treatment. The first stage remains \(30/100=0.3000\), because 30 compliers change treatment and the other types do not. Under \(Z=1\), the outcome mean is

$$ E(Y\mid Z=1) =\frac{50(5)+30(10)+20(8)}{100} =\frac{710}{100}=7.100\text{ points}. $$

Under \(Z=0\), the outcome mean is

$$ E(Y\mid Z=0) =\frac{50(3)+30(4)+20(6)}{100} =\frac{390}{100}=3.900\text{ points}. $$

Thus the reduced form is \(7.100-3.900=3.200\) points, and the Wald ratio is

$$ \frac{3.200\text{ points}}{0.3000} =10.67\text{ points}. $$

But the complier treatment effect at either assignment level is \(8-4=4\) points. The discrepancy is explained by the direct assignment effect: the reduced form contains the compliers’ treatment contribution, \(0.3000(4)=1.200\) points, plus the 2-point direct effect. Their sum is \(3.200\) points, as calculated. Dividing by \(0.3000\) scales both contributions, so the ratio is not the complier treatment effect. Exclusion is therefore essential for the standard interpretation.

Practical Checks and Common Mistakes

Before interpreting a computed ratio, check the table’s treatment patterns and the assumptions behind its outcome entries. A useful calculation order is to find treatment rates first, then outcome means, then contrasts, and only then the ratio. This makes it easier to locate errors and keeps the estimand distinct from its components.

1
Classify treatment response.
Read \(D(0)\) and \(D(1)\) for each type. Under monotonicity, identify compliers, never-takers, and always-takers, with no defiers.
2
Calculate the first stage.
Find the treatment proportion under each assignment and subtract the \(Z=0\) rate from the \(Z=1\) rate. Confirm the result is nonzero.
3
Calculate the reduced form.
For each assignment, use the treatment actually received by each type to select its corresponding outcome, then take the difference in mean outcomes.
4
Form and qualify the ratio.
Divide the reduced form by the first stage, state the outcome units, and check independence, exclusion, and monotonicity before calling it a complier effect.

A common mistake is to stop at the reduced form and report it as the treatment effect. The reduced form is the outcome contrast between assignment groups; it is not generally the effect of treatment because not everyone changes treatment when assignment changes. Another mistake is to compute the ratio correctly but label it an average treatment effect for the entire population. Under the assumptions used here, its interpretation is specific to compliers. Finally, a nonzero first stage alone does not establish that the other assumptions hold.

Key takeaway: A compliance-type table lets you calculate the first stage and reduced form by tracking who receives treatment and which outcome applies under each assignment. Their ratio is a complier-average treatment effect only when the assumptions justify that interpretation; otherwise, it remains a ratio of assignment contrasts whose causal meaning requires further qualification.

Check Your Understanding

Use the definitions and calculation sequence above to answer these questions.

  1. In a table with 25 compliers among 100 people and no defiers, what is the first-stage contrast under independence?
  2. Why do never-takers and always-takers contribute no treatment-rate change when the assignment changes?
  3. A table gives a reduced form of 1.5 points and a first stage of 0.30. What is the Wald ratio, and what are its units?
  4. In the direct-effect example, identify the part of the reduced form due to compliers’ treatment effect and the part due to direct assignment.
  5. Why does a positive first stage not, by itself, show that the Wald ratio identifies a complier-average treatment effect?
Clinical Biostats