From a Nonlinear IV Fit to Counterfactual Risks
A nonlinear IV model may report an outcome-equation coefficient on a probit or logit scale. That coefficient describes a change in a model’s linear predictor; it is not itself a change in the probability of the outcome. To report a treatment effect as a risk difference or risk ratio, first predict the outcome risk under treatment and under no treatment, then average those risks over a specified target population.
The predictions must come from the fitted structural or control-function model, not from an ordinary outcome regression that treats the endogenous treatment as if it were unconfounded. In particular, the IV assumptions and the model’s distributional or control-function assumptions are what support interpreting the predictions as counterfactual risks.
Model, Assumptions, and the Prediction Rule
For a bivariate probit IV model, one common specification has a latent outcome equation \(Y^*=X^\top\beta+\tau D+\varepsilon\), with \(Y=1\) when \(Y^*>0\), and a latent treatment equation \(D^*=Z^\top\gamma+X^\top\delta+u\), with \(D=1\) when \(D^*>0\). The errors \(\varepsilon\) and \(u\) are standard normal with correlation \(\rho\). The instrument \(Z\) is excluded from the outcome equation.
A causal reading requires more than fitting these equations. The instrument must be relevant for treatment, independent of the relevant potential outcomes conditional on included covariates, and excluded from the outcome equation except through treatment. The equations and joint error distribution must also be correctly specified; the bivariate probit interpretation relies on its distributional assumptions. There must be adequate instrument and covariate support for the population being studied. These assumptions are substantive and cannot be confirmed merely by a good numerical fit.
Under an intervention setting \(D=d\), the outcome latent index becomes \(X^\top\beta+\tau d\). The outcome error has its standard normal marginal distribution, so integrating over that error gives the counterfactual risk conditional on \(X=x\). The treatment-equation error correlation matters for modelling treatment selection and estimating the parameters; it does not mean that the intervention-specific risk is obtained by conditioning on the naturally observed treatment.
Here \(\Phi\) is the standard normal cumulative distribution function. With fitted coefficients, calculate a prediction for each member of the target population, or for each covariate pattern with its target-population weight. Average those predictions separately for \(d=1\) and \(d=0\), then contrast the two averages. If the target population is represented by a sample of \(n\) units, the plug-in standardization is
The average is over the covariate distribution of the stated target population, which need not be the estimation sample. If the target population is represented by strata with weights \(w_j\), use \(\widehat R(d)=\sum_j w_j\widehat P\{Y(d)=1\mid X=x_j\}\), where the weights sum to one.
Worked Example: Standardizing Risks Across Covariate Strata
Suppose a hypothetical fitted bivariate probit outcome equation is \(\widehat\eta=-1.1+0.7D+0.4X\). A target population has three covariate strata \(X=0,1,2\), with respective weights 0.20, 0.50, and 0.30. Assume the IV model and its identifying assumptions are appropriate for this target. Calculate both standardized risks and their risk difference.
For \(D=0\), the indices are \(-1.1,-0.7,-0.3\). The corresponding risks are \(\Phi(-1.1)=0.1357\), \(\Phi(-0.7)=0.2420\), and \(\Phi(-0.3)=0.3821\). Thus
For \(D=1\), the indices are \(-0.4,0,0.4\), giving risks \(0.3446,0.5000,0.6554\). Therefore
The marginal risk difference is \(0.5155-0.2628=0.2527\), or about 25.3 percentage points, using the displayed rounded risks. The calculation from unrounded predictions is approximately 0.2528. State which rounding convention is being used; the unrounded calculation is the preferred reported estimate. It describes the model-implied change in average outcome risk for this target population, under the stated assumptions.
Why a Link-Scale Coefficient Is Not a Risk Difference
In a probit model, \(\tau\) shifts the latent outcome index for a one-unit treatment change. Because \(\Phi\) is nonlinear, the resulting probability change depends on the starting index. For a binary treatment, the relevant conditional risk difference at covariate value \(x\) is the finite contrast \(\Phi(x^\top\beta+\tau)-\Phi(x^\top\beta)\), not \(\tau\) itself. A derivative such as \(\phi(\eta)\tau\) is a local approximation for a continuous change in an index; it is not the exact binary-treatment contrast.
The same distinction applies to logistic models: a treatment coefficient is a log-odds contrast conditional on the model’s other terms, whereas the marginal risk difference and risk ratio require predicted probabilities and averaging. Even when a coefficient is causal under a correctly specified IV model, its scale and conditioning differ from those of a population-average risk effect.
Worked Example: A Probit Coefficient Versus a Risk Contrast
Consider a hypothetical fitted probit outcome equation \(\widehat\eta=-1.2+0.8D+0.5X\). At \(X=0.5\), the no-treatment index is \(-1.2+0.5(0.5)=-0.95\), and the treatment index is \(-1.2+0.8+0.5(0.5)=-0.15\).
The model-implied risks are \(\Phi(-0.95)\approx0.1711\) under no treatment and \(\Phi(-0.15)\approx0.4404\) under treatment. Hence the conditional risk difference at this covariate value is
This is about 26.9 percentage points at \(X=0.5\). The coefficient 0.8 is the treatment shift on the probit index, not an 80-percentage-point risk increase. The probability-scale contrast changes with \(X\), even though the fitted index shift is 0.8.
Averaging Predictions, Not Covariates
For nonlinear links, the risk at the mean covariate value need not equal the mean risk. Standardization therefore predicts under each treatment value at each target covariate pattern and then averages. This also makes the estimand explicit: changing the target population’s covariate distribution can change its average risks and risk difference.
Worked Example: Why Prediction at the Mean Is Different
Use the hypothetical model \(\widehat\eta=-1.2+0.8D+0.5X\), and consider a target population with equal weights at \(X=0\) and \(X=2\). Under no treatment, the risks are \(\Phi(-1.2)\approx0.1151\) and \(\Phi(-0.2)\approx0.4207\), so the average is \((0.1151+0.4207)/2=0.2679\). Under treatment, the risks are \(\Phi(-0.4)\approx0.3446\) and \(\Phi(0.6)\approx0.7257\), so the average is approximately \(0.5352\).
The standardized risk difference is about \(0.5352-0.2679=0.2673\), using rounded displayed values. By contrast, the mean covariate is \(X=1\). Predicting at that value gives risks \(\Phi(-0.7)\approx0.2420\) and \(\Phi(0)=0.5000\), a difference of 0.2580. That is a different calculation and, in general, a different estimand. The discrepancy arises because averaging a nonlinear function is not the same as applying that function to an average.
Control-Function Models and Practical Diagnostics
The same risk-first principle applies to other nonlinear IV approaches, but the prediction rule must match the fitted model. A control-function outcome model includes a first-stage residual or generalized residual to account for endogeneity. Do not automatically replace \(D\) by 0 or 1 in an observed-data conditional prediction while holding every residual term fixed: some residual controls depend on the observed treatment and instrument. A causal counterfactual prediction requires a model-specific account of the latent control variable and its distribution under the intervention. If the model does not supply a justified counterfactual prediction rule, its fitted conditional probabilities alone do not establish counterfactual risks.
For a bivariate probit model, a direct diagnostic is to inspect whether predicted risks are within \([0,1]\), compare fitted and observed outcome patterns across covariate and instrument strata, and check for sparse or unsupported combinations that make standardization extrapolative. Also examine first-stage relevance and sensitivity to plausible changes in model specification. These checks can reveal instability or poor fit, but none proves instrument validity, exclusion, or the assumed joint error distribution.
Uncertainty in standardized risks and their contrasts must account for estimation of the model parameters. A delta-method calculation can use the gradient of the standardized estimand and the estimated parameter covariance matrix; a bootstrap can refit the full IV procedure and recompute both risks in each resample. For a bootstrap, resample at the independent sampling unit and preserve any design features that determine the target population. Report an interval for the estimand in context; do not interpret a confidence interval as a probability statement about a fixed parameter.
Choosing and Reporting the Effect
The risk difference is an absolute change in outcome probability and is often useful for expressing the number of additional or prevented outcomes per population size. The risk ratio compares relative risks, but it can be unstable or undefined when the no-treatment risk is zero or close to zero. Both are marginal summaries after standardization. They need not be constant across populations, even when the fitted structural treatment coefficient is common, because baseline risks and covariate distributions differ.
These model-based population contrasts should not be confused with the local effects identified by some IV designs or with an unadjusted association between observed treatment and outcome. Their interpretation depends on the model’s identifying assumptions and on the target population used for averaging. Report the model, target population, treatment-specific risks, contrast scale, units, and uncertainty. If a treatment effect is reported only as a link-scale coefficient, readers cannot directly infer the size of the average risk change.
Check Your Understanding
Answer each question, then compare with the solutions below.
- In a probit outcome equation, what does a treatment coefficient represent, and why is it not generally a risk difference?
- A target population has two equally weighted covariate strata. What is the correct order for computing a standardized risk?
- Why can an observed-data control-function prediction fail to represent a counterfactual risk after treatment is set to a different value?
- For a fitted model, the standardized risks are \(R(1)=0.30\) and \(R(0)=0.20\). Calculate the marginal risk difference and risk ratio, and state their interpretation.
- Name two IV or model checks that are useful, and explain one thing they cannot establish.
Solutions. (1) It is a shift in the probit linear predictor; applying the nonlinear normal CDF means the probability contrast depends on the baseline index. (2) Predict under the treatment value of interest in each stratum, multiply each risk by its target-population weight, and add the weighted risks; repeat for the other treatment value. (3) The residual control may depend on observed treatment and the instrument, so retaining it unchanged or mechanically recomputing it may not represent the model’s latent control distribution under intervention. (4) The risk difference is \(0.30-0.20=0.10\), a 10-percentage-point increase; the risk ratio is \(0.30/0.20=1.5\), meaning the treated counterfactual risk is 1.5 times the untreated risk in the specified target population. (5) Examples include checking first-stage relevance and examining predicted fit across covariate or instrument strata. Such checks can flag weaknesses but cannot prove exclusion, instrument independence, or correct distributional specification.