Tutorials › Propensity Score Matching and Instrumental Variables › Structural And Reduced-Form Models For Nonlinear Outcomes

Binary and Nonlinear Outcome IV Methods · Tutorial 552 of 699

Structural And Reduced-Form Models For Nonlinear Outcomes

Learn to separate structural predictions under treatment interventions from reduced-form outcome patterns across instrument values, and interpret each on the scale its model supports.

Advanced 11 min read

What You'll Learn

  • Distinguish a structural outcome equation from a reduced-form regression of the outcome on the instrument.
  • Interpret a probit structural coefficient on the latent-index scale rather than as a probability difference.
  • Calculate intervention-specific risks and risk differences from a nonlinear structural model.
  • Explain why a reduced-form instrument effect is not automatically a structural treatment effect.
  • Identify assumptions needed for causal interpretations and checks that can reveal model misfit.

Two Models, Two Questions

With a nonlinear outcome, it is especially important to distinguish a model for the outcome under treatment from a model for the outcome across instrument values. They can both predict probabilities, but those probabilities answer different questions. A structural model asks what the outcome would be under a specified treatment intervention; a reduced-form model asks how the outcome varies with the instrument. Confusing the two can turn a valid description of instrument groups into an unsupported claim about treatment effects.

Let \(Y\) be an outcome, \(D\) a treatment, \(Z\) an instrument, and \(X\) observed covariates. For a binary outcome, \(Y\) takes values 0 and 1, so its conditional mean is a probability. Potential outcomes \(Y(d)\) denote the outcome that would be observed under treatment level \(d\). The structural and reduced-form perspectives connect these quantities to different predictors.

Definition: A structural outcome model specifies how the outcome responds to treatment and covariates, allowing for unobserved factors. Its causal interpretation concerns outcomes under interventions on \(D\). A reduced-form model describes the outcome as a function of the instrument and covariates, without using the treatment as the predictor of interest. It summarizes the instrument–outcome relationship; interpreting that relationship causally requires assumptions about how \(Z\) is assigned.

A common structural specification for a binary outcome is a latent-index model:

$$ Y(d)=\mathbf{1}\{\alpha+\beta d+\gamma X+U>0\}. $$

Here \(U\) collects unobserved determinants of the outcome, and \(\mathbf{1}\{\cdot\}\) equals 1 when its condition holds and 0 otherwise. If \(U\mid X\sim N(0,1)\), the structural probability under treatment \(d\), at covariate value \(x\), is

$$ P\{Y(d)=1\mid X=x\}=\Phi(\alpha+\beta d+\gamma x), $$

where \(\Phi\) is the standard normal cumulative distribution function. The coefficient \(\beta\) shifts the latent index. It is not, in general, a change in outcome probability or a risk difference. The probability change depends on the starting index and hence can differ across covariate values.

A reduced-form regression instead models \(E[Y\mid Z,X]\). For binary \(Z\), its conditional means are the outcome probabilities in the two instrument groups. A linear probability model might describe their difference directly; a probit or logit reduced form uses a nonlinear link. In either case, the predictor is \(Z\), not \(D\). The model does not by itself decompose an instrument–outcome pattern into a treatment effect.

Assumptions Behind Interpretation

A structural equation can be given a causal interpretation only when its treatment intervention is well defined and the model’s assumptions support its counterfactual predictions. For the probit expression above, the assumed distribution of \(U\mid X\) is part of the model, not a consequence of observing binary outcomes. If treatment is endogenous, \(D\) may be related to \(U\); fitting a probit of \(Y\) on observed \(D\) does not automatically recover the structural parameters. Instrumental-variable assumptions and additional modeling choices are needed for identification and estimation.

A reduced-form conditional mean \(E[Y\mid Z=z,X=x]\) is always a descriptive quantity for the observed data, subject to adequate data at those values. To interpret differences across \(z\) as causal effects of the instrument, one needs, for example, conditional independence of \(Z\) from relevant potential outcomes given \(X\). To use \(Z\) as an instrument for \(D\), one additionally needs an exclusion restriction: \(Z\) affects \(Y\) only through \(D\). Relevance is also needed for the instrument to generate treatment variation. These assumptions have distinct roles: instrument randomization can support an effect of assignment on \(Y\), while exclusion is needed to attribute that effect to treatment.

The reason the two models cannot generally be swapped is visible by averaging over treatment and unobserved outcome factors. The reduced-form probability is a mixture of structural outcomes across the treatment and latent-error distribution in each instrument group:

$$ P(Y=1\mid Z=z,X=x) = \sum_{d\in\{0,1\}}\int P(Y=1\mid D=d,U=u,X=x,Z=z)\, f_{U,D\mid Z,X}(u,d\mid z,x)\,du. $$

The distribution being averaged can change with \(z\), and it can reflect dependence between \(D\) and \(U\). Because the outcome response is nonlinear, evaluating a structural response at a predicted or average treatment does not generally equal this mixture. This is the central distinction: structural predictions concern specified treatment interventions; reduced-form predictions average what happens under the instrument’s observed treatment and latent-factor distributions.

Worked Example: A Structural Probit Coefficient Is Not a Risk Difference

Suppose a hypothetical structural probit model has \(\alpha=-1.2\), \(\beta=0.7\), and \(X=0\). Assume the latent error has the stated standard normal distribution and that the model’s parameters are available for structural prediction. Calculate the outcome probabilities under \(d=0\) and \(d=1\).

For \(d=0\), the index is \(-1.2+0.7(0)=-1.2\), so the probability is \(\Phi(-1.2)\approx0.1151\). For \(d=1\), the index is \(-1.2+0.7(1)=-0.5\), so the probability is \(\Phi(-0.5)\approx0.3085\).

The structural risk difference is calculated from the unrounded probabilities: \(\Phi(-0.5)-\Phi(-1.2)\approx0.1934679\), which rounds to \(0.1935\), or 19.35 percentage points. The coefficient \(0.7\) is the change in latent index, not a 70-percentage-point increase in probability. This calculation illustrates the model’s implications; by itself it does not establish that the parameters are identified from data when treatment is endogenous.

Reduced-Form Predictions and Their Meaning

For a binary instrument, a reduced-form risk difference compares the outcome probabilities at two instrument values. If \(Z\) is randomly assigned, the difference can be interpreted as the causal effect of instrument assignment on the outcome, even when \(Y\) is binary. It is not automatically the effect of treatment. The distinction matters because assignment may change treatment for only some people, and because treatment can be related to unobserved outcome determinants.

Worked Example: Calculating a Reduced-Form Risk Difference

In hypothetical data, 200 people are assigned to each instrument group. In the \(Z=0\) group, 40 have \(Y=1\); in the \(Z=1\) group, 52 have \(Y=1\). The corresponding numbers with \(D=1\) are 60 and 120. Calculate the reduced-form outcome difference and the first-stage difference.

The outcome probabilities are \(40/200=0.20\) when \(Z=0\) and \(52/200=0.26\) when \(Z=1\). Thus the reduced-form risk difference is \(0.26-0.20=0.060\), or 6.0 percentage points in this sample. If assignment to \(Z\) was randomized, this estimates the effect of assignment on the probability of \(Y=1\), subject to sampling uncertainty.

The treatment probabilities are \(60/200=0.30\) and \(120/200=0.60\), giving a first-stage difference of \(0.60-0.30=0.30\), or 30 percentage points. Dividing the two differences gives \(0.060/0.30=0.20\). That ratio is not a probit coefficient and is not automatically the population treatment effect. Under the additional assumptions for a binary-instrument design—including exclusion, independence, monotonicity, and a nonzero first stage—it can identify an average treatment effect for compliers on the risk-difference scale. The assumptions, not the arithmetic alone, determine that interpretation.

A reduced-form probit has its own coefficient scale. If it specifies \(P(Y=1\mid Z,X)=\Phi(a+bZ+cX)\), then \(b\) shifts the reduced-form latent index for \(Z\). It is not a structural treatment coefficient, nor is it a risk difference. To report a probability-scale contrast, calculate predicted probabilities at the two instrument values and subtract them, keeping \(X\) fixed or averaging over a stated covariate distribution.

Structural Predictions Need Appropriate Averaging

Even when a structural model is correctly specified, a probability contrast at one covariate value need not equal an average contrast for a target population. For a binary treatment, a population-average structural risk difference can be calculated by predicting both intervention-specific risks for each covariate pattern and averaging those risks over the target distribution of \(X\). This is often called standardization. It preserves the nonlinearity rather than applying the link function to an average covariate value.

Worked Example: Standardizing Structural Risks Across Covariate Groups

Use the hypothetical model \(P\{Y(d)=1\mid X=x\}=\Phi(-1.2+0.7d+0.8x)\), with binary \(X\). Suppose 70% of the target population has \(X=0\) and 30% has \(X=1\). Assume the structural model and its error distribution are appropriate for these intervention predictions.

For \(X=0\), the untreated and treated probabilities are \(\Phi(-1.2)\approx0.1151\) and \(\Phi(-0.5)\approx0.3085\). For \(X=1\), they are \(\Phi(-0.4)\approx0.3446\) and \(\Phi(0.3)\approx0.6179\).

The standardized untreated risk is \(0.70(0.1150697)+0.30(0.3445783)\approx0.1839\). The standardized treated risk is \(0.70(0.3085375)+0.30(0.6179114)\approx0.4013\). Therefore the standardized risk difference is approximately \(0.4013-0.1839=0.2174\), or 21.74 percentage points.

The mean covariate value is \(E[X]=0.30\). Plugging it into the model gives \(\Phi(-1.2+0.8(0.3))=\Phi(-0.96)\approx0.1685\) under \(d=0\), and \(\Phi(-0.26)\approx0.3974\) under \(d=1\). Their difference is about 22.89 percentage points, not 21.74. The discrepancy occurs because a nonlinear function of the mean index is not generally the mean of the nonlinear predictions. The target population’s covariate distribution must be specified for an average prediction.

Model Checks, Alternatives, and Limits

Structural and reduced-form models are complementary rather than competing descriptions of the same coefficient. A structural model can answer intervention questions and support predictions under alternative treatment levels, but its conclusions depend on structural form, distributional assumptions, and identification. A reduced-form model is closer to the observed instrument–outcome relationship and can provide a useful assignment-effect estimate when instrument assignment is exogenous. It generally does not provide the full treatment-response function.

FeatureStructural outcome modelReduced-form outcome model
Main predictorTreatment \(D\) and covariates \(X\)Instrument \(Z\) and covariates \(X\)
QuestionWhat outcome is predicted under a specified treatment intervention?How does the outcome vary across instrument values?
Coefficient meaningDepends on the link and scale; in probit, a latent-index shiftDepends on the link and scale; not automatically a treatment effect
Main limitationRequires a credible structural model and identification assumptionsDoes not, by itself, separate treatment effects from other instrument-group differences

Useful checks include comparing predicted and observed outcome probabilities across instrument and covariate groups, checking whether predictions are systematically too high or low, and examining whether conclusions change under reasonable alternative specifications. For structural predictions, also check whether the treatment and covariate combinations being predicted are supported by the data; extrapolation can make an apparently precise model-based prediction unreliable. A good fit to observed probabilities does not prove instrument validity or validate counterfactual predictions. Conversely, a reduced-form model can be useful even when it cannot answer a structural treatment question.

A frequent mistake is to take a reduced-form coefficient on \(Z\), rename it the effect of \(D\), and interpret it as a structural treatment effect. That reasoning skips the role of the first stage, exclusion, and the assumptions connecting instrument-induced treatment changes to the target effect. The correction is to state which predictor generated the coefficient, identify its scale, and name the assumptions needed for the causal interpretation. For nonlinear models, report predicted probabilities or probability contrasts when those are the quantities of substantive interest.

Key takeaway: A structural model predicts outcomes under treatment interventions; a reduced-form model describes outcomes as a function of the instrument. Their coefficients live on model-specific scales, and neither causal interpretation nor treatment-effect meaning follows from a coefficient’s label alone.

Check Your Understanding

Answer each question, then check the brief solutions below.

  1. In a structural probit model, what does the treatment coefficient represent, and why is it not generally a risk difference?
  2. A randomized binary instrument changes outcome risk from 0.12 to 0.17. What is the reduced-form risk difference, and what does it estimate?
  3. Why can applying a probit link to the average covariate value give a different answer from averaging predicted risks across covariate groups?
  4. Name one assumption needed to interpret a reduced-form instrument–outcome contrast as an effect of instrument assignment, and one additional assumption needed to use the instrument to infer a treatment effect.

Solutions. (1) It is a shift in the latent index; the probability change depends on the index before treatment. (2) The difference is \(0.17-0.12=0.05\), or 5 percentage points; with randomized assignment, it estimates the assignment effect on outcome risk. (3) The link is nonlinear, so the link of an average index need not equal the average of linked predictions. (4) Conditional independence of assignment from potential outcomes supports a causal assignment contrast; exclusion is additionally needed to attribute the instrument’s effect to treatment.

Clinical Biostats