Tutorials › Propensity Score Matching and Instrumental Variables › Policy Eligibility as an Instrument

IV Assumptions and Local Average Treatment Effects · Tutorial 475 of 699

Policy Eligibility as an Instrument

You will learn to translate a policy eligibility rule into an instrumental-variable argument, identify the assumptions it needs, and calculate the correctly standardized Wald estimand when independence holds conditional on covariates.

Advanced 12 min read

What You'll Learn

  • Distinguish eligibility from treatment receipt and define the corresponding potential treatment and outcome variables.
  • Classify people as compliers, never-takers, always-takers, or defiers under an eligibility rule.
  • State what relevance, independence, exclusion, and monotonicity mean for a policy instrument.
  • Derive conditional first-stage and outcome contrasts and standardize them over a common covariate distribution.
  • Recognize policy features that threaten independence or exclusion and diagnose weak or implausible instruments.
  • Interpret a Wald ratio as a complier effect only for the population and assumptions that justify it.

Eligibility Is an Assignment Mechanism, Not the Treatment

A policy may make people eligible for a service without ensuring that they receive it. That distinction is exactly why eligibility can serve as an instrument: eligibility may shift treatment receipt, while receipt itself may be related to health, income, motivation, or other causes of the outcome. The central question is not whether eligible people have different outcomes. It is whether the policy rule supplies a credible source of variation in treatment that can be used to interpret an instrumental-variable contrast.

Let \(Z=1\) indicate that a person is eligible under the policy rule and \(Z=0\) indicate ineligibility. Let \(D=1\) indicate receipt of the treatment or service of interest and \(D=0\) indicate no receipt. Let \(Y\) be the outcome. These variables must refer to a clearly defined population, policy, treatment, and follow-up period. Eligibility is the proposed instrument; it is not interchangeable with treatment receipt.

Definition: \(D(z)\) is the treatment receipt that would occur under eligibility status \(z\). \(Y(d)\) is the outcome that would occur under treatment status \(d\), under the exclusion restriction. The observed values satisfy \(D=D(Z)\) and, if exclusion holds, \(Y=Y(D)\). A person’s compliance type is the pair \((D(0),D(1))\).

The four possible compliance types are compliers \((0,1)\), who take treatment only when eligible; never-takers \((0,0)\), who do not take it under either eligibility status; always-takers \((1,1)\), who take it regardless; and defiers \((1,0)\), who take it when ineligible but not when eligible. These types are defined by potential behavior, not by a person’s observed status alone. For any one person, only one of \(D(0)\) and \(D(1)\) is observed.

What Must Be Plausible for Eligibility to Work?

An eligibility rule is a substantive claim about how policy creates variation, not a validity guarantee. The instrumental-variable interpretation needs assumptions about the rule, treatment, outcomes, and population. Consistency and no interference require that observed treatment and outcome agree with the relevant potential values and that one person’s eligibility or treatment does not alter another person’s outcome in a way that matters for the analysis. The treatment must also be defined clearly enough that materially different versions are not being treated as the same intervention.

Key assumptions: Relevance means eligibility changes the probability of treatment receipt. Independence means eligibility is independent of the potential treatment statuses and potential outcomes, either unconditionally or conditional on pre-eligibility covariates \(X\). Exclusion means eligibility affects the outcome only through treatment, so the outcome potential value depends on \(d\), not directly on \(z\). Monotonicity means \(D(1)\geq D(0)\) for every person, ruling out defiers when \(Z=1\) denotes eligibility.

In a policy setting, independence is often the most demanding assumption. Eligibility might be determined by age, income, disability, location, or prior need, and those characteristics can also predict treatment uptake or outcomes. Conditional independence can be plausible if the relevant causes are measured before eligibility and compared appropriately, but it does not justify an unadjusted comparison of all eligible and ineligible people. Exclusion also deserves a direct substantive argument: the eligibility designation may change outcomes through other services, financial support, information, or administrative contact, even when the person does not receive the treatment being studied.

Monotonicity is a claim about responses to eligibility. It may be reasonable when eligibility only opens access to a service and does not make anyone less likely to receive it. It is less plausible if eligibility changes incentives in opposite directions for different groups, or if ineligible people can obtain a substitute that eligible people cannot. Relevance should be assessed empirically, but a detectable first stage alone cannot establish independence or exclusion.

Wald Contrasts and Conditional Standardization

Under unconditional independence, exclusion, consistency, and monotonicity, the difference in mean treatment receipt between eligibility groups equals the proportion of compliers. The outcome difference equals that proportion multiplied by the average treatment effect among compliers. Their ratio is therefore the complier average causal effect, also called the local average treatment effect (LATE), when the first-stage difference is nonzero.

When independence holds only conditional on pre-eligibility covariates \(X\), these identities apply within covariate strata. Let \(\Delta_D(x)=E[D\mid Z=1,X=x]-E[D\mid Z=0,X=x]\) and \(\Delta_Y(x)=E[Y\mid Z=1,X=x]-E[Y\mid Z=0,X=x]\). To form an overall contrast, choose one common target distribution \(q(x)\) over covariate values in which both eligibility statuses are represented. Standardize each conditional contrast over that same distribution.

$$ \Delta_D^{q}=\sum_x q(x)\Delta_D(x), \qquad \Delta_Y^{q}=\sum_x q(x)\Delta_Y(x), \qquad \text{Wald}^{q}=\frac{\Delta_Y^{q}}{\Delta_D^{q}}. $$

For continuous \(X\), the sums are replaced by integrals. To see the interpretation, conditional independence allows the observed within-\(x\) contrasts to identify the corresponding contrasts in potential values. With binary treatment and monotonicity, only compliers have \(D(1)\ne D(0)\), and each complier has \(D(1)-D(0)=1\). Thus:

$$ \Delta_D(x)=E[D(1)-D(0)\mid X=x]=P(C\mid X=x), $$
$$ \Delta_Y(x)=E[Y(D(1))-Y(D(0))\mid X=x] =P(C\mid X=x)E[Y(1)-Y(0)\mid C,X=x]. $$

Here \(C\) denotes the complier type. Standardizing gives \(\Delta_D^q=\sum_x q(x)P(C\mid X=x)\), while \(\Delta_Y^q=\sum_x q(x)P(C\mid X=x)E[Y(1)-Y(0)\mid C,X=x]\). If \(\Delta_D^q>0\), their ratio is a weighted average of covariate-specific complier effects, with weights proportional to \(q(x)P(C\mid X=x)\). It is the complier effect for the complier population induced by the chosen target distribution, not automatically the effect for all eligible people or the entire population.

Conditional independence does not generally justify the raw contrasts \(E[D\mid Z=1]-E[D\mid Z=0]\) and \(E[Y\mid Z=1]-E[Y\mid Z=0]\) as the two terms in this derivation. The covariate distributions can differ across eligibility groups. Unadjusted contrasts are justified by unconditional independence; under conditional independence, use conditional contrasts and a common standardization distribution, or an equivalent correctly specified adjustment.

Worked Example: Standardizing an Eligibility Rule Across Covariate Strata

Suppose a hypothetical program uses eligibility \(Z\) to encourage treatment \(D\). Let \(X\) be a pre-eligibility risk group, low or high, and choose a target distribution with \(q(\text{low})=q(\text{high})=0.5\). Assume conditional independence, exclusion, monotonicity, and adequate representation of both eligibility statuses within each group. The following hypothetical observed means are consistent with those assumptions.

Risk groupMean treatment, \(Z=0\)Mean treatment, \(Z=1\)Mean outcome, \(Z=0\)Mean outcome, \(Z=1\)
Low0.100.501012
High0.400.602021

The within-group first stages are \(0.50-0.10=0.40\) for the low-risk group and \(0.60-0.40=0.20\) for the high-risk group. The standardized first stage is \(0.5(0.40)+0.5(0.20)=0.30\). The within-group outcome contrasts are \(12-10=2\) and \(21-20=1\), so the standardized outcome contrast is \(0.5(2)+0.5(1)=1.50\). The standardized Wald ratio is \(1.50/0.30=5.00\) outcome units per treatment-induced change. Under the stated assumptions, this is the standardized complier effect for the chosen target distribution.

A raw comparison would not produce the same result if eligibility groups had different risk-group compositions. For instance, suppose the low-risk group has eligibility probability \(0.20\) and the high-risk group has probability \(0.80\), with equal proportions of the two groups in the target population. Then 80% of eligible people are high-risk, while only 20% of ineligible people are high-risk. The raw treatment means are \(0.8(0.60)+0.2(0.50)=0.58\) among eligible people and \(0.2(0.40)+0.8(0.10)=0.16\) among ineligible people, giving a raw first stage of \(0.42\), not \(0.30\). The raw outcome means are \(0.8(21)+0.2(12)=19.2\) and \(0.2(20)+0.8(10)=12\), giving a raw outcome contrast of \(7.20\). Their ratio, \(7.20/0.42\approx17.14\), is not the standardized complier effect. The difference arises from covariate composition as well as eligibility contrasts.

Working Through Compliance Types

A policy’s first stage has a direct interpretation under monotonicity: it is the share of compliers, either overall under unconditional independence or within covariate strata under conditional independence. Never-takers and always-takers may be present, but their treatment status does not change with eligibility. This interpretation depends on the assumptions; the observed first stage by itself does not label any individual’s compliance type.

Worked Example: Eligibility Changes Treatment for Compliers

In a hypothetical population with unconditional independence, suppose 30% are compliers, 50% are never-takers, and 20% are always-takers, with no defiers. Eligibility is relevant because it raises treatment receipt. Suppose the mean outcome effect of treatment among compliers is 4 points, and exclusion holds.

Under ineligibility, only always-takers receive treatment, so the treatment rate is \(0.20\). Under eligibility, always-takers and compliers receive it, so the rate is \(0.20+0.30=0.50\). The first stage is \(0.50-0.20=0.30\), equal to the complier share. The outcome contrast is \(0.30(4)=1.20\) points: always-takers’ treatment status does not change, never-takers remain untreated, and compliers contribute their treatment effect. Therefore the Wald ratio is \(1.20/0.30=4.00\) points per treatment. This recovers the complier effect under the assumptions, not an effect for the 100% of people in the population.

Substantive Checks and Common Failure Modes

A policy instrument is strongest when its assignment mechanism can be described precisely and the assumptions can be defended using institutional knowledge, not just statistical output. Useful checks include examining how eligibility is determined, confirming that the relevant covariates precede the rule, estimating the first stage in the intended population, and checking whether both eligibility statuses occur across the covariate strata used for adjustment. If some strata contain only eligible or only ineligible people, their within-stratum contrasts are not identified from observed data without additional modeling or extrapolation.

Covariate balance can reveal conspicuous differences, but balance on measured variables does not prove independence from unmeasured potential outcomes or treatment statuses. A strong first stage is also not evidence that exclusion holds. In addition, the treatment and outcome definitions should be audited for hidden pathways: if eligibility provides a separate benefit that affects the outcome, the exclusion restriction fails even if eligibility substantially changes treatment receipt.

The main alternative is to compare people receiving and not receiving treatment after adjustment for measured confounders, as in regression adjustment or propensity score methods. Those approaches require that the relevant treatment-outcome confounders be measured and controlled. An instrumental-variable analysis instead relies on the eligibility rule satisfying independence and exclusion and generally identifies an effect for compliers. A randomized encouragement design has the same conceptual distinction between assignment and receipt, but policy eligibility is not randomized merely because it is written as a rule.

Worked Example: A Direct Eligibility Pathway Breaks Exclusion

Suppose a hypothetical policy raises treatment receipt by \(0.25\), and the true treatment effect among compliers is 6 outcome points. If eligibility also changes the outcome directly by 1 point through an additional benefit, then the eligibility outcome contrast is \(0.25(6)+1=2.50\) points. The Wald ratio is \(2.50/0.25=10.0\) points per treatment.

That ratio does not identify the 6-point treatment effect: its numerator contains both the treatment-mediated contrast, \(1.50\) points, and the direct eligibility effect, \(1.00\) point. The correct interpretation is that this instrument violates exclusion, so the usual complier-effect interpretation is not justified. Removing or measuring the extra pathway may help only if a defensible design and assumptions then restore an appropriate exclusion restriction; a large first stage cannot repair the violation.

A common mistake is to say, “Eligibility is independent of potential outcomes within each risk group, so I can compare all eligible people with all ineligible people.” That reasoning is incorrect because the two groups can contain different proportions of risk groups, and those groups can have different baseline treatment rates and outcomes. The correction is to use within-group contrasts and standardize both the outcome contrast and the treatment contrast over the same explicitly chosen distribution of pre-eligibility covariates. Another mistake is to call the resulting ratio “the policy’s effect on everyone.” It is a complier effect only under the assumptions, and its target depends on the standardization population.

Key takeaway: Treat policy eligibility as a candidate instrument, not as proof of causal identification. Specify the eligibility contrast, assess independence and exclusion in context, and use a common covariate distribution when independence is conditional rather than unconditional.

Check Your Understanding

Try each question, then compare your reasoning with the solutions.

  1. A policy raises treatment receipt from 0.25 among ineligible people to 0.40 among eligible people. Under unconditional independence and monotonicity, what share are compliers?
  2. Why is a raw eligibility-group comparison generally not justified by independence conditional on \(X\) alone?
  3. In two equally weighted covariate strata, suppose first stages are 0.20 and 0.40, and outcome contrasts are 1.0 and 2.0 points. Compute the standardized Wald ratio.
  4. Give one policy pathway that could violate exclusion even if eligibility clearly increases treatment receipt.

Solutions. (1) The first stage is \(0.40-0.25=0.15\), so the complier share is 0.15, or 15%, under the stated assumptions. (2) The distributions of \(X\) may differ between eligibility groups, so raw contrasts combine within-stratum eligibility differences with composition differences. Use conditional contrasts standardized to one common distribution of \(X\). (3) The standardized first stage is \(0.5(0.20)+0.5(0.40)=0.30\); the standardized outcome contrast is \(0.5(1.0)+0.5(2.0)=1.50\). The ratio is \(1.50/0.30=5.00\) outcome points per treatment, interpretable as the standardized complier effect only if the IV assumptions hold. (4) For example, eligibility might independently grant a financial benefit or connect people to another service that affects the outcome. That pathway makes the outcome respond to eligibility other than through the treatment being studied.

Clinical Biostats