Tutorials › Causal Inference › Defiers and the Consequences of Nonmonotonicity

Instrumental Variable Assumptions and Estimands · Tutorial 505 of 972

Defiers and the Consequences of Nonmonotonicity

Use principal-strata algebra to see how defiers change the first stage, the reduced form, and the interpretation of the Wald ratio.

Intermediate 10 min read

What You'll Learn

  • Define compliers and defiers using their potential treatment values under each instrument assignment.
  • Derive the first-stage contrast as the complier proportion minus the defier proportion.
  • Derive the reduced-form contrast using treatment effects in both strata.
  • Calculate a Wald ratio when defiers are present and interpret its limits.
  • Recognize when defiers cancel the first stage or make the Wald ratio misleading.

Why Defiers Matter

With a binary instrument and a binary treatment, individuals can respond to the instrument in different ways. Some take treatment only when encouraged; others do the reverse. The second group consists of defiers. Their responses matter because their contributions to the first stage and reduced form have the opposite sign from compliers’ contributions. As a result, the Wald ratio need not be the average treatment effect for compliers.

To isolate this consequence, suppose the instrument \(Z\) and treatment \(D\) are binary. Write \(D(z)\) for the treatment an individual would receive if the instrument were set to \(z\), and \(Y(d)\) for the outcome under treatment level \(d\). Assume consistency, so the observed treatment and outcome are \(D=D(Z)\) and \(Y=Y(D)\); exclusion, so the instrument affects the outcome only through treatment; and independence, so \(Z\) is independent of the joint potential values \(\{D(0),D(1),Y(0),Y(1)\}\). These assumptions let us express contrasts by instrument assignment in terms of potential values. The algebra below does not assume monotonicity.

Definition: A complier has \(D(0)=0,D(1)=1\); a defier has \(D(0)=1,D(1)=0\). An always-taker has \(D(0)=D(1)=1\), and a never-taker has \(D(0)=D(1)=0\). These four principal strata partition the population, with proportions \(p_C,p_F,p_A,p_N\), respectively.
Principal stratum\(D(0)\)\(D(1)\)Change in treatment \(D(1)-D(0)\)
Compliers011
Defiers10-1
Always-takers110
Never-takers000

How Defiers Enter the First Stage

The population first stage is the difference in mean treatment across instrument levels, \(E[D\mid Z=1]-E[D\mid Z=0]\). By independence and consistency, the mean treatment in each assignment group identifies the corresponding mean potential treatment. Thus the first stage equals \(E[D(1)-D(0)]\). The table shows that compliers add one, defiers subtract one, and always-takers and never-takers add zero.

$$ \Delta_D = E[D\mid Z=1]-E[D\mid Z=0] = E[D(1)-D(0)] = p_C-p_F. $$

This equation says that the first stage is a net change in treatment uptake. It is not the proportion of people whose treatment changes unless there are no defiers. A positive first stage means compliers outnumber defiers, not that defiers are absent. If \(p_C=p_F\), their changes cancel and the first stage is zero, even though many individuals may change treatment in response to the instrument.

How Defiers Enter the Reduced Form

Define an individual’s treatment effect on the outcome as \(\tau_i=Y_i(1)-Y_i(0)\). Under exclusion, the potential outcome under instrument level \(z\) is \(Y(D(z))\). A complier’s outcome changes from \(Y(0)\) to \(Y(1)\) as \(Z\) changes from 0 to 1, so the change is \(\tau_i\). For a defier, treatment changes from 1 to 0, so the outcome change is \(-\tau_i\). The outcome does not change with the instrument for always-takers or never-takers, because their treatment remains fixed.

Let \(\tau_C=E[Y(1)-Y(0)\mid C]\) when \(p_C>0\), and let \(\tau_F=E[Y(1)-Y(0)\mid F]\) when \(p_F>0\). If a stratum has zero proportion, its weighted contribution is defined to be zero; its conditional mean treatment effect need not be defined. Equivalently, the expression can be written using stratum indicators, which is valid whether or not either stratum is present.

$$ \begin{aligned} \Delta_Y &=E[Y\mid Z=1]-E[Y\mid Z=0]\\ &=E\!\left[Y(D(1))-Y(D(0))\right]\\ &=E[\mathbf{1}_C\{Y(1)-Y(0)\}] -E[\mathbf{1}_F\{Y(1)-Y(0)\}]\\ &=p_C\tau_C-p_F\tau_F. \end{aligned} $$

Here \(\mathbf{1}_C\) and \(\mathbf{1}_F\) are indicators of membership in the complier and defier strata. In the last line, \(p_C\tau_C\) means \(E[\mathbf{1}_C\{Y(1)-Y(0)\}]\), and is zero if \(p_C=0\); \(p_F\tau_F\) is interpreted in the same way. This convention avoids assigning a conditional average effect to an absent stratum.

What the Wald Ratio Represents

When the first stage is nonzero, the Wald ratio is the reduced-form contrast divided by the first-stage contrast. Combining the expressions above gives the relevant algebra.

$$ \text{Wald} = \frac{\Delta_Y}{\Delta_D} = \frac{p_C\tau_C-p_F\tau_F}{p_C-p_F}, \qquad p_C\ne p_F. $$

If there are no defiers and there is a positive proportion of compliers, this reduces to \(\tau_C\), the average treatment effect among compliers. When defiers are present, the ratio instead combines treatment effects from both groups, with the defier contribution subtracted in both numerator and denominator. It is not generally \(\tau_C\), nor is it generally an ordinary population average of the two stratum effects. If the first stage is zero, the Wald ratio is undefined.

A special case makes the contrast clear: if there are no compliers but there are defiers, the ratio—when defined—equals \(\tau_F\), not a complier effect. More generally, the ratio can differ substantially from the complier effect, and can even have the opposite sign. The next examples show these possibilities with hypothetical values.

Worked Example: A Positive First Stage with a Shifted Wald Ratio

Suppose a hypothetical population has \(p_C=0.40\), \(p_F=0.10\), \(p_A=0.20\), and \(p_N=0.30\). Assume the instrument is independent of the potential values, exclusion holds, and the average treatment effects are \(\tau_C=5\) and \(\tau_F=2\) outcome points. Compute the first stage, reduced form, and Wald ratio.

The proportions sum to \(0.40+0.10+0.20+0.30=1.00\). The first stage is

$$ \Delta_D=p_C-p_F=0.40-0.10=0.30. $$

Equivalently, the mean treatment under \(Z=1\) is \(p_A+p_C=0.20+0.40=0.60\), while under \(Z=0\) it is \(p_A+p_F=0.20+0.10=0.30\); their difference is \(0.30\).

The reduced form is

$$ \Delta_Y=p_C\tau_C-p_F\tau_F =(0.40)(5)-(0.10)(2) =2.00-0.20 =1.80\text{ outcome points}. $$

Therefore,

$$ \text{Wald}=\frac{1.80\text{ outcome points}}{0.30}=6.00\text{ outcome points}. $$

The Wald ratio is \(6.00\) outcome points per treatment change in this binary-treatment setup, whereas the complier average treatment effect is \(5\) outcome points. Defiers raise the ratio above the complier effect in this example. The result is a consequence of the signed weighting, not evidence that the compliers’ effect equals 6.

Worked Example: Equal Numbers of Compliers and Defiers

In a second hypothetical population, let \(p_C=0.25\), \(p_F=0.25\), \(p_A=0.20\), and \(p_N=0.30\), with \(\tau_C=4\) and \(\tau_F=1\) outcome points. The proportions sum to one, and suppose independence and exclusion hold. Find both assignment contrasts and decide whether a Wald ratio exists.

The first stage is

$$ \Delta_D=0.25-0.25=0. $$

For example, treatment uptake under \(Z=1\) is \(p_A+p_C=0.45\), and under \(Z=0\) it is \(p_A+p_F=0.45\). Despite the presence of compliers and defiers, the two assignment groups have equal mean treatment.

The reduced form is

$$ \Delta_Y=(0.25)(4)-(0.25)(1)=1.00-0.25=0.75\text{ outcome points}. $$

The reduced form is nonzero, but the first stage is zero. Thus \(\Delta_Y/\Delta_D=0.75/0\) is undefined; no finite Wald estimate can be formed. This example shows why a reduced-form difference does not by itself provide a treatment-effect ratio. The distinct effects in the two changing strata allow their outcome contributions not to cancel even though their treatment contributions do.

Worked Example: The Wald Ratio Can Have the Opposite Sign

Consider a third hypothetical population with \(p_C=0.20\), \(p_F=0.10\), \(p_A=0.30\), and \(p_N=0.40\). Assume independence and exclusion, and suppose both stratum-average treatment effects increase the outcome: \(\tau_C=2\) and \(\tau_F=8\) points. Calculate the ratio and compare it with the complier effect.

The first stage is positive:

$$ \Delta_D=p_C-p_F=0.20-0.10=0.10. $$

The reduced form is

$$ \Delta_Y=(0.20)(2)-(0.10)(8)=0.40-0.80=-0.40\text{ outcome points}. $$

Consequently,

$$ \text{Wald}=\frac{-0.40}{0.10}=-4.00\text{ outcome points}. $$

The ratio is negative even though the complier effect is \(+2\) points and the defier effect is \(+8\) points. The defiers’ larger effects contribute negatively to the reduced form, while their presence also reduces the first-stage contrast. The ratio therefore cannot be interpreted as the complier average treatment effect in this population.

Derivation and a Key Interpretation Check

The principal-strata derivation can be summarized directly. For each individual, the treatment contrast \(D(1)-D(0)\) is \(1\) for a complier, \(-1\) for a defier, and \(0\) otherwise. Averaging gives \(p_C-p_F\). Under exclusion, the outcome contrast is \(Y(D(1))-Y(D(0))\). It equals \(Y(1)-Y(0)\) for compliers, its negative for defiers, and zero for always-takers and never-takers. Averaging therefore gives the signed reduced form \(p_C\tau_C-p_F\tau_F\). Dividing the second average by the first yields the Wald expression whenever the denominator is nonzero.

This argument also identifies exactly what the no-defiers condition contributes. If \(p_F=0\) and \(p_C>0\), then \(\Delta_D=p_C\), \(\Delta_Y=p_C\tau_C\), and the ratio is \(\tau_C\). If \(p_F>0\), the formula includes a defier term; the ratio equals \(\tau_C\) only under special additional relationships, not merely because the first stage is positive. A positive first stage alone establishes \(p_C>p_F\), not \(p_F=0\).

Common Mistake

Wrong reasoning: “The instrument increases treatment on average, so the Wald ratio is the average effect for people whose treatment it changes; those people are compliers.” This silently assumes that nobody moves in the opposite direction. A positive first stage only means the complier proportion exceeds the defier proportion. Defiers can still be present and can contribute strongly to the reduced form.

Correction: Under the stated independence and exclusion assumptions, first compute the signed contrasts: \(\Delta_D=p_C-p_F\) and \(\Delta_Y=p_C\tau_C-p_F\tau_F\). The ratio identifies the complier average effect under no defiers and a nonzero complier proportion. With defiers, use the signed-ratio formula and do not label it a complier effect without further justification. Also check that the first stage is nonzero before forming the ratio.

Key takeaway: Defiers subtract from both the first stage and the reduced form. Nonmonotonicity can change the Wald ratio, reverse its sign relative to the complier effect, or cancel the first stage entirely. A positive first stage does not establish that defiers are absent.

Check Your Understanding

Use the principal-strata formulas to answer each question.

  1. If \(p_C=0.35\) and \(p_F=0.05\), what is the first-stage contrast? What does its sign tell you, and what does it not establish?
  2. Suppose \(p_C=0.20\), \(p_F=0.10\), \(\tau_C=3\), and \(\tau_F=1\). Calculate the reduced form and Wald ratio.
  3. Why can a population have a zero first stage even when some individuals respond to the instrument?
  4. When \(p_F=0\) and \(p_C>0\), show why the Wald ratio equals \(\tau_C\).
  5. In the opposite-sign example, which signed contribution makes the reduced form negative despite positive treatment effects in both strata?
Clinical Biostats