Tutorials › Propensity Score Matching and Instrumental Variables › Treatment-Effect Heterogeneity In Nonlinear IV Models

Binary and Nonlinear Outcome IV Methods · Tutorial 572 of 699

Treatment-Effect Heterogeneity In Nonlinear IV Models

Learn to distinguish heterogeneity on a nonlinear model’s index from heterogeneity in causal outcomes, and to identify the assumptions needed for subgroup interpretations.

Advanced 13 min read

What You'll Learn

  • Distinguish treatment-effect heterogeneity on a latent index from heterogeneity in outcome risks.
  • State the additional assumptions that support subgroup interpretations in nonlinear instrumental-variable models.
  • Standardize control-function predictions over a target distribution instead of treating a fitted coefficient as a causal effect.
  • Interpret treatment-by-covariate interactions without overclaiming what they identify.
  • Recognize when an IV contrast describes compliers rather than the full population.
  • Diagnose weak support, misspecification, and unsupported subgroup claims.

Why Heterogeneity Is Harder in Nonlinear IV Models

A fitted treatment coefficient can look like a single answer to the question “What is the effect?” In a nonlinear instrumental-variable (IV) model, that interpretation is especially risky. The coefficient may describe a shift in a latent index, while the causal contrast of interest is a difference in outcome probabilities or means. Those are not generally the same quantity. In addition, IV identifies effects through variation induced by the instrument, and that variation need not represent every subgroup equally.

The key distinction is between a model parameter and a causal estimand. Heterogeneity may be represented by treatment interactions in a structural model, may arise from the nonlinear link even without such interactions, or may appear in subgroup IV effects because different subgroups have different distributions of compliers. A subgroup interpretation requires assumptions connecting all these pieces.

Definition: For a binary treatment \(D\), let \(Y(1)\) and \(Y(0)\) denote an individual's potential outcomes under treatment and no treatment. The individual treatment effect is \(Y(1)-Y(0)\). For a covariate-defined subgroup \(X=x\), the conditional average treatment effect is \(\tau(x)=E[Y(1)-Y(0)\mid X=x]\). In a binary-outcome model, this is a risk difference and is measured in probability points.

Index Interactions and Causal Contrasts

Consider a binary-outcome structural probit model with a binary treatment and covariates \(X\):

$$ Y(d)=1\{\eta_d(X)+\varepsilon>0\}, \qquad \eta_d(X)=\beta_0+\beta_X X+\beta_D d+\beta_{DX}dX. $$

Here \(d\) is an intervention setting of treatment. The model specifies the potential outcome under that setting, not merely the association among people observed with \(D=d\). For the following risk formula, assume the structural outcome error has a standard normal marginal distribution conditional on \(X\), so that \(P(Y(d)=1\mid X=x)=\Phi(\eta_d(x))\). In an IV setting, treatment may still be associated with \(\varepsilon\); the instrument and the model’s identification assumptions are what support estimation of the structural parameters.

$$ \tau(x)=P(Y(1)=1\mid X=x)-P(Y(0)=1\mid X=x) =\Phi(\eta_1(x))-\Phi(\eta_0(x)). $$

The treatment coefficient \(\beta_D\) is the treatment shift in the latent index at \(X=0\). The interaction \(\beta_{DX}\) changes that shift as \(X\) changes. Neither coefficient is, by itself, a risk difference. Also, even if \(\beta_{DX}=0\), the risk difference can vary with \(x\), because the same index shift passes through different parts of the nonlinear link.

Worked Example: A Probit Interaction Is Not a Risk Difference

Suppose a hypothetical fitted structural model is \(\eta_d(x)=-0.8+0.7x+0.5d-0.4dx\), with a standard normal structural error. Take \(X\) to be a binary subgroup indicator.

At \(X=0\), the untreated index is \(-0.8\) and the treated index is \(-0.3\). Thus the subgroup risk difference is \(\Phi(-0.3)-\Phi(-0.8)\approx0.38209-0.21186=0.17023\), or about 17.02 percentage points.

At \(X=1\), the untreated index is \(-0.1\), while the treated index is \(0\). The subgroup risk difference is \(\Phi(0)-\Phi(-0.1)\approx0.50000-0.46017=0.03983\), or about 3.983 percentage points.

The treatment shift on the index is \(0.5\) at \(X=0\) and \(0.5-0.4=0.1\) at \(X=1\). Those are not the risk differences. The structural model implies different subgroup risk contrasts after applying the probit link. This interpretation is justified only if the model and its structural-error assumptions are adequate for the target population; the arithmetic alone does not establish that.

Why Nonlinearity Creates Heterogeneity

The risk difference implied by the model can be written as an integral over the index shift. Let \(\delta(x)=\beta_D+\beta_{DX}x\) and \(\eta_0(x)=\beta_0+\beta_Xx\). Then:

$$ \tau(x)=\Phi\{\eta_0(x)+\delta(x)\}-\Phi\{\eta_0(x)\} =\int_{\eta_0(x)}^{\eta_0(x)+\delta(x)}\phi(t)\,dt. $$

This equality follows from the definition of the normal cumulative distribution function: \(\Phi(b)-\Phi(a)=\int_a^b\phi(t)\,dt\). The risk contrast therefore depends both on the index shift and on the baseline index, through the values of the density \(\phi(t)\) along that interval. For a small shift, a first-order approximation is \(\tau(x)\approx\phi(\eta_0(x))\delta(x)\). It is an approximation, not an exact causal effect formula. This derivation explains why a constant latent-index treatment coefficient can imply different risk differences across baseline-risk subgroups.

Consequently, evidence that \(\beta_{DX}\) differs from zero is evidence of interaction on the model’s index scale, conditional on the model being correct. It is not a complete test of whether risk differences vary. Conversely, a varying risk difference does not require a nonzero index interaction. To discuss heterogeneity, specify the outcome scale first, then calculate or estimate contrasts on that scale.

Control Functions: Condition, Then Standardize

A control-function model accounts for endogeneity by including a control variable from the treatment-assignment process in the outcome model. The basic logic is that, under a suitable control-function sufficiency assumption, conditioning on the control variable makes the remaining treatment variation independent of the relevant outcome error. A fitted outcome regression might, for example, specify the conditional mean as \(m(d,x,v)=g^{-1}\{\eta(d,x,v)\}\), where \(v\) is a valid control variable and \(g^{-1}\) is the inverse link.

The causal subgroup mean under treatment setting \(d\) is not automatically \(m(d,x,v)\) at the observed value of \(v\). To obtain the mean for a target subgroup \(X=x\), the model-based prediction generally needs to be averaged over that subgroup’s target distribution of the control variable:

$$ \mu_d(x)=E\{m(d,x,V)\mid X=x\}, \qquad \tau(x)=\mu_1(x)-\mu_0(x). $$

This calculation requires more than a convenient regression form. The control variable must satisfy the model’s sufficiency conditions; the outcome mean must be correctly specified over the relevant values of \(d,x,v\); and the distribution used for standardization must describe the intended target subgroup. With a generated residual, its construction and the first-stage model also matter. A generalized residual calculated from observed treatment is not automatically an observed, pre-treatment latent rank that can be held fixed under intervention. The structural control-function interpretation must justify the averaging operation.

Worked Example: Standardizing a Control-Function Model

Suppose a hypothetical binary-outcome control-function model uses the logit mean \(m(d,x,v)=\operatorname{expit}(-1+0.6x+0.8d+0.5dx+0.4v+0.3dv)\), where \(\operatorname{expit}(a)=1/(1+e^{-a})\). For illustration, assume the control-function assumptions hold and, within each \(X\) subgroup, the target distribution of \(V\) puts equal probability on \(-1\) and \(1\). Calculate subgroup risk differences by averaging the two predicted risks for each treatment setting.

For \(X=0,D=0\), the indices at \(V=-1,1\) are \(-1.4,-0.6\); the corresponding risks are \(0.1978,0.3543\). Their average is \(\mu_0(0)=(0.1978+0.3543)/2=0.2761\). For \(X=0,D=1\), the indices are \(-0.9,0.5\), giving risks \(0.2891,0.6225\). Thus \(\mu_1(0)=(0.2891+0.6225)/2=0.4558\), and the risk difference is \(0.4558-0.2761=0.1797\), about 17.97 percentage points.

For \(X=1,D=0\), the indices are \(-0.8,0\), giving risks \(0.3100,0.5000\) and \(\mu_0(1)=0.4050\). For \(X=1,D=1\), the indices are \(0.2,1.6\), giving risks \(0.5498,0.8320\) and \(\mu_1(1)=0.6909\). The subgroup risk difference is \(0.6909-0.4050=0.2859\), about 28.59 percentage points.

These are model-based standardized contrasts under the stated hypothetical control-variable distribution and assumptions. They are not the treatment coefficients \(0.8\) or \(0.5\), and they would change if the target distribution of \(V\) changed. In an application, uncertainty in fitted parameters and generated control variables must also be reflected in inference.

Subgroup IV Effects and Compliers

A different source of heterogeneity comes from the population represented by the IV comparison. With a binary instrument \(Z\) and binary treatment \(D\), the familiar subgroup Wald ratio is \((E[Y\mid Z=1,X=x]-E[Y\mid Z=0,X=x])/(E[D\mid Z=1,X=x]-E[D\mid Z=0,X=x])\). Under instrument independence within \(X\), exclusion, relevance, and monotonicity, this ratio identifies the average treatment effect among compliers in subgroup \(X=x\), not generally the average effect for everyone in that subgroup. Monotonicity rules out individuals whose treatment moves opposite to the instrument; exclusion says the instrument affects outcomes only through treatment.

If the instrument changes treatment for different proportions of people across subgroups, a pooled IV effect can weight subgroup complier effects differently from an average across subgroups. Parametric nonlinear models can impose additional structure and produce other estimands, but a fitted interaction does not remove the need to state what population and effect scale the result represents.

Worked Example: A Pooled IV Effect Need Not Average Subgroup Effects Equally

Imagine two equally large hypothetical subgroups, \(X=0\) and \(X=1\). Suppose the instrument increases treatment probability by \(0.8\) in the first subgroup and \(0.2\) in the second, and the subgroup complier risk differences are \(0.10\) and \(0.40\), respectively. Assume the binary-instrument conditions above hold within each subgroup.

The subgroup reduced forms are first-stage change times the subgroup complier effect: \(0.8(0.10)=0.08\) for \(X=0\), and \(0.2(0.40)=0.08\) for \(X=1\). Averaging the reduced forms across equally sized subgroups gives \(0.08\). The pooled first stage is \(\{0.8+0.2\}/2=0.50\), so the pooled Wald ratio is \(0.08/0.50=0.16\).

The simple equally weighted mean of the two subgroup complier effects is \((0.10+0.40)/2=0.25\), not \(0.16\). The pooled IV ratio weights subgroup effects in proportion to subgroup size times the first-stage change: here, the weights are \(0.8/(0.8+0.2)=0.8\) and \(0.2/(0.8+0.2)=0.2\), giving \(0.8(0.10)+0.2(0.40)=0.16\). Thus the pooled contrast is not an equally weighted subgroup average. Neither contrast identifies effects for always-takers or never-takers without further assumptions.

Diagnostics, Alternatives, and Limits

A plausible-looking interaction can be misleading when the model is weakly supported or too restrictive. Before interpreting subgroup contrasts, inspect whether the instrument predicts treatment within the subgroups being reported, whether there is meaningful overlap in covariates and control-function values, and whether predictions rely on extrapolation. Very small subgroup first stages can make subgroup IV estimates unstable. In a nonlinear model, inspect predicted probabilities for impossible or implausible patterns and compare reasonable specifications of the outcome link and control-function terms. These checks can reveal problems; they cannot prove the exclusion restriction or validate the structural distributional assumptions.

The main alternatives answer different questions. A reduced-form analysis describes the effect of the instrument on the outcome, not the treatment effect unless additional identification conditions translate it. A subgroup Wald analysis makes its complier target explicit under binary-IV assumptions, but may be imprecise within small subgroups. A structural nonlinear model can use stronger functional-form and distributional assumptions to estimate standardized potential-outcome contrasts, potentially for a broader target population. It gains interpretability only to the extent those assumptions are credible. If treatment interactions or control-function interactions are omitted, the resulting model may force away heterogeneity; if they are added without enough data or support, estimates may be unstable.

Common pitfall: “The treatment-by-subgroup coefficient is 0.4, so treatment increases the outcome risk by 40 percentage points in that subgroup.” This confuses an index-scale coefficient with a probability-scale causal contrast. In a nonlinear IV model, calculate the potential-outcome predictions under \(D=1\) and \(D=0\), standardize over the target distribution when required, and subtract them. Then state the assumptions and target population supporting that contrast.

The practical conclusion is not that parametric nonlinear IV models cannot describe heterogeneity. They can, but the fitted coefficient alone rarely settles the causal question. Report the outcome scale, subgroup definition, standardization distribution, and identification assumptions; give subgroup contrasts with uncertainty; and distinguish model-based population effects from complier effects.

Check Your Understanding

Answer each question, then compare with the solutions.

  1. In a probit structural model with no treatment-by-\(X\) interaction, can the risk difference still vary with \(X\)? Why?
  2. A logit control-function model is fitted. Why might evaluating its prediction at one observed residual fail to give the target subgroup causal mean?
  3. Under the binary-IV conditions, what population does a subgroup Wald ratio generally describe?
  4. In the pooled example, what are the weights on subgroup complier effects, and why are they not equal?

Solutions. (1) Yes. A constant index shift passes through the nonlinear probit link at different baseline indices, so the corresponding probability difference can vary. (2) The target mean generally averages predictions over the target subgroup distribution of the valid control variable; one observed residual need not represent that distribution or remain fixed under intervention. (3) Compliers within that subgroup, not necessarily everyone in it. (4) The weights are \(0.8\) and \(0.2\), proportional to each equally sized subgroup’s first-stage change. The instrument induces treatment changes at different rates, so the pooled Wald ratio weights the complier effects accordingly.

Clinical Biostats