Tutorials › Causal Inference › Deriving the Wald Ratio from Assignment Effects

Instrumental Variable Assumptions and Estimands · Tutorial 497 of 972

Deriving the Wald Ratio from Assignment Effects

Learn to construct and interpret the Wald ratio as the outcome assignment contrast divided by the treatment-receipt assignment contrast.

Intermediate 9 min read

What You'll Learn

  • Define the outcome and treatment-receipt contrasts across instrument levels.
  • Derive the Wald ratio from assignment-based differences in means.
  • Distinguish the ratio from either assignment effect on its own.
  • Calculate the ratio from hypothetical assignment-group data and state its units.
  • Identify when the ratio is undefined or unstable because the first stage is small.

Why Divide One Assignment Contrast by Another?

An instrument changes the opportunity or encouragement to receive a treatment; it does not necessarily determine who receives it. Two differences therefore matter. The outcome contrast compares average outcomes across instrument levels, while the treatment-receipt contrast compares treatment uptake across those same levels. The Wald ratio divides the first contrast by the second.

This division puts the outcome contrast on a scale per unit of instrument-induced change in treatment receipt. The numerator and denominator are each assignment-based contrasts, so it is important to keep track of which quantity is being reported: the outcome contrast alone, the first-stage contrast alone, or their ratio. The ratio is not itself an assignment effect.

Definition: Let \(Z\) be a binary instrument, with levels \(0\) and \(1\); let \(D\) indicate treatment receipt, with \(D=1\) for receipt and \(D=0\) otherwise; and let \(Y\) be the outcome. Define the outcome assignment contrast as \(\Delta_Y=E[Y\mid Z=1]-E[Y\mid Z=0]\), and the treatment-receipt assignment contrast, or first stage, as \(\Delta_D=E[D\mid Z=1]-E[D\mid Z=0]\). If \(\Delta_D\ne 0\), the Wald ratio is \(\Delta_Y/\Delta_D\).

These definitions describe contrasts between instrument groups. To interpret them as causal effects of assignment, one needs an appropriate assignment mechanism. In a randomized encouragement study, a standard condition is that assignment is independent of the relevant potential outcomes and treatment-receipt potential outcomes. Consistency links each person’s observed outcome and treatment to the instrument level actually assigned. Both instrument levels must occur with positive probability in the population being studied. Under these conditions, the group-mean contrasts equal the corresponding average effects of assignment on outcome and treatment receipt.

Those conditions justify calling the two contrasts assignment effects; they do not, by themselves, ensure that the ratio has a particular causal interpretation for treatment. Instrument validity also involves conditions such as exclusion, and a nonzero first stage is needed to define the ratio. Here the derivation is about how the Wald ratio is built from assignment contrasts.

From Assignment Effects to the Wald Ratio

For a binary outcome or treatment-receipt variable, a conditional expectation given an instrument level is the mean within that group. Thus the population contrasts can be written as differences in group means. If \(\bar{Y}_z\) and \(\bar{D}_z\) denote the population means among units with \(Z=z\), then

$$ \Delta_Y=\bar{Y}_1-\bar{Y}_0,\qquad \Delta_D=\bar{D}_1-\bar{D}_0,\qquad \text{Wald ratio}=\frac{\bar{Y}_1-\bar{Y}_0}{\bar{D}_1-\bar{D}_0}. $$

The numerator measures how much average outcome differs between those assigned to instrument level 1 and those assigned to level 0. The denominator measures how much average treatment receipt differs between the same instrument groups. Dividing one by the other expresses the outcome difference relative to the treatment-receipt difference.

For a sample, replace population group means by observed sample means. Write \(\bar{Y}_{z}\) for the mean observed outcome among the \(n_z\) units with \(Z=z\), and \(\bar{D}_{z}\) for their mean treatment receipt. The sample Wald estimate is

$$ \widehat{\Delta}_Y=\bar{Y}_1-\bar{Y}_0,\qquad \widehat{\Delta}_D=\bar{D}_1-\bar{D}_0,\qquad \widehat{\theta}_{W} =\frac{\widehat{\Delta}_Y}{\widehat{\Delta}_D} =\frac{\bar{Y}_1-\bar{Y}_0}{\bar{D}_1-\bar{D}_0}, \quad \widehat{\Delta}_D\ne 0. $$

The corresponding population ratio is \(\theta_W=\Delta_Y/\Delta_D\), provided \(\Delta_D\ne 0\). This algebra does not require a model for the outcome conditional on treatment, nor does it turn the numerator into a treatment effect. It uses two contrasts indexed by instrument assignment and forms their ratio.

Worked Example: Computing the Ratio From Group Means

Suppose a hypothetical randomized encouragement study assigns 500 people to each of two instrument levels. The mean outcome is 14 points in the \(Z=1\) group and 10 points in the \(Z=0\) group. Treatment receipt is recorded for each person: 300 of the 500 in the \(Z=1\) group received treatment, compared with 200 of the 500 in the \(Z=0\) group. Find the outcome contrast, first stage, and sample Wald estimate.

Outcome contrast. The difference in mean outcome is

$$ \widehat{\Delta}_Y=14-10=4\text{ points}. $$

Treatment-receipt contrast. The group proportions receiving treatment are \(300/500=0.60\) and \(200/500=0.40\). Therefore,

$$ \widehat{\Delta}_D=0.60-0.40=0.20. $$

The assignment contrast in treatment receipt is 20 percentage points. The Wald estimate is

$$ \widehat{\theta}_{W} =\frac{4\text{ points}}{0.20} =20\text{ points per unit change in treatment receipt}. $$

The arithmetic gives 20 points per unit change in the treatment-receipt probability. Equivalently, because the denominator is 0.20, the estimate is five times the 4-point outcome contrast. The observed 4-point difference remains the outcome contrast between instrument groups; it should not be reported as the Wald ratio.

The hypothetical study is described as randomized, so the group contrasts can be interpreted as assignment effects under valid random assignment, consistency, and positive probability of both assignments. The calculation also checks that the estimated first stage is nonzero. Those facts justify the construction and the assignment-contrast interpretation, not any additional interpretation of the ratio as an effect for a particular population.

Why the Denominator Matters

The denominator is not a technical detail: it sets the scale of the ratio. If assignment changes treatment receipt only slightly, a given outcome contrast translates into a much larger ratio. If assignment has no effect on average treatment receipt, the ratio is undefined. A ratio with a very small estimated denominator can also vary substantially when the observed data change modestly.

The sign of the denominator also matters for arithmetic. If the instrument reduces treatment receipt, then \(\Delta_D<0\), and the ratio’s sign is the sign of \(\Delta_Y\) divided by a negative number. One should not silently replace a negative first stage with its absolute value: doing so changes the defined ratio.

Worked Example: A Small First Stage

In a second hypothetical randomized study, the mean outcome is 8.6 units for \(Z=1\) and 8.0 units for \(Z=0\). Treatment receipt is 0.42 in the \(Z=1\) group and 0.40 in the \(Z=0\) group. Calculate the ratio and explain what the denominator implies for the calculation.

The outcome contrast is

$$ \widehat{\Delta}_Y=8.6-8.0=0.60\text{ outcome units}. $$

The first stage is

$$ \widehat{\Delta}_D=0.42-0.40=0.02. $$

Thus,

$$ \widehat{\theta}_{W} =\frac{0.60}{0.02} =30\text{ outcome units per unit change in treatment receipt}. $$

The ratio is large because the outcome contrast is divided by a 2-percentage-point treatment-receipt contrast. This calculation is valid arithmetic, but the small denominator makes the estimate sensitive: a small change in either group contrast, especially the first stage, can substantially change the ratio. The estimate alone does not express how much sampling uncertainty there is; that requires inference beyond this ratio calculation.

For the causal interpretation of the group contrasts, this hypothetical example assumes valid random assignment, consistency, and positive probability of both assignment levels. The numerical first stage is nonzero, so the ratio is defined. A small but nonzero denominator does not make the ratio undefined; it does make its value potentially unstable.

Sample Contrasts and a Second Calculation

In practice, the group means are computed from observed data. When \(D\) is binary, its mean within an instrument group is exactly the proportion receiving treatment in that group. For \(Y\), the group mean is the average outcome among the units assigned to that level. The same formula therefore applies whether the data are summarized as means or, for binary treatment receipt, as proportions.

Worked Example: Using Counts to Find Both Contrasts

Consider a hypothetical randomized study with 250 people assigned to each instrument level. In the \(Z=1\) group, 150 receive treatment and the mean outcome is 5.4 hours. In the \(Z=0\) group, 100 receive treatment and the mean outcome is 4.8 hours. Find the first stage and Wald estimate, stating the units.

The treatment-receipt means are the observed proportions:

$$ \bar{D}_1=\frac{150}{250}=0.60,\qquad \bar{D}_0=\frac{100}{250}=0.40. $$

So the first-stage contrast is

$$ \widehat{\Delta}_D=0.60-0.40=0.20. $$

The outcome contrast is

$$ \widehat{\Delta}_Y=5.4-4.8=0.6\text{ hours}. $$

Dividing gives

$$ \widehat{\theta}_{W} =\frac{0.6\text{ hours}}{0.20} =3.0\text{ hours per unit change in treatment receipt}. $$

Here the denominator is a 20-percentage-point difference, not a difference of 20 people. The resulting ratio is expressed on the outcome scale per unit change in the treatment-receipt probability. If the outcome had been measured in minutes instead, the numerator and ratio would be multiplied by 60; the underlying contrasts would otherwise be the same.

As in the previous randomized examples, interpreting the observed group differences as assignment effects relies on valid randomization, consistency, and positive probability of both instrument levels. The ratio calculation additionally requires a nonzero first stage, which is satisfied here.

A Short Derivation and an Interpretation Check

The ratio follows directly by substituting the definitions of the assignment contrasts. Starting from the outcome assignment contrast and the treatment-receipt assignment contrast, divide the former by the latter:

$$ \theta_W =\frac{\Delta_Y}{\Delta_D} =\frac{E[Y\mid Z=1]-E[Y\mid Z=0]} {E[D\mid Z=1]-E[D\mid Z=0]}, \qquad \Delta_D\ne 0. $$

Under the assignment conditions stated above, the numerator is the average effect of assignment on the outcome, and the denominator is the average effect of assignment on treatment receipt. Thus, the Wald ratio is the outcome assignment effect divided by the treatment-receipt assignment effect. The derivation is complete: it is a substitution of two assignment-based contrasts, not a claim that either contrast is a treatment effect.

Units provide a useful check. If \(Y\) is measured in blood-pressure points and \(D\) is binary, then \(\Delta_Y\) has units of blood-pressure points and \(\Delta_D\) is a probability difference. The ratio is in blood-pressure points per unit change in treatment receipt. A unit change is a change in the probability from 0 to 1; if the first stage is 0.10, the ratio divides by that 0.10 rather than by 10 percentage points as a number.

The ratio is unchanged if both assignment contrasts are reversed together: switching which instrument level is called 1 and which is called 0 multiplies both contrasts by \(-1\), leaving their quotient unchanged. Reversing only one contrast, by contrast, is an error. This is another reason to compute and label the two differences before dividing.

Common Mistakes and Practical Checks

  • Reporting only the outcome difference as the Wald estimate. The outcome difference is the numerator, not the ratio. Divide it by the difference in treatment-receipt means.
  • Using the wrong denominator. The denominator compares treatment receipt across instrument levels. It is not the treatment rate in just one group, nor the overall treatment rate.
  • Forgetting that a binary-treatment mean is a proportion. If 60% versus 40% receive treatment, the first stage is \(0.60-0.40=0.20\), not a difference of 20 unless the percentage-point scale is explicitly used and the ratio’s units are adjusted accordingly.
  • Dividing by a zero first stage. If \(\Delta_D=0\), the Wald ratio is undefined. A ratio should not be reported by treating zero as a negligible denominator.
  • Calling the ratio an assignment effect. The numerator and denominator are assignment contrasts; the ratio is their quotient. Its further causal interpretation requires assumptions beyond the arithmetic of the ratio.
Key takeaway: Compute the outcome contrast across instrument levels, compute the treatment-receipt contrast across those same levels, and divide the first by the second. Keep the two assignment effects distinct from their ratio, check that the first stage is nonzero, and report the ratio in outcome units per unit change in treatment receipt.

Check Your Understanding

Use the definitions and distinctions above to answer the following questions.

  1. An encouragement group has a mean outcome of 12, compared with 9 in the control group. Treatment receipt is 0.70 versus 0.50. What are the outcome contrast, the first stage, and the Wald ratio? State the ratio’s units in terms of the outcome.
  2. Why is the first stage \(0.55-0.45=0.10\) when the treatment-receipt proportions are 55% and 45%?
  3. If the outcome contrast is 2 units and the first stage is \(-0.25\), what is the Wald ratio, and why should the denominator not be replaced by its absolute value?
  4. What happens to the Wald ratio when the first stage is exactly zero? How does that differ from a small, nonzero first stage?
  5. Which parts of the Wald ratio are assignment-based contrasts, and what conditions allow observed instrument-group differences to be interpreted as assignment effects?
Clinical Biostats