Tutorials › Propensity Score Matching and Instrumental Variables › Additive Structural Mean Models On The Risk-Difference Scale

Binary and Nonlinear Outcome IV Methods · Tutorial 566 of 699

Additive Structural Mean Models On The Risk-Difference Scale

Learn to interpret and estimate an additive structural mean model for a binary outcome, while checking the assumptions that give its parameter a risk-difference meaning.

Advanced 10 min read

What You'll Learn

  • Define an additive structural mean model using counterfactual risks.
  • Interpret its parameter as a risk difference in probability units.
  • Derive the instrument moment condition and the Wald-type estimate.
  • Distinguish the model’s constant-effect interpretation from effects identified under weaker assumptions.
  • Diagnose weak instruments, invalid instruments, and incompatible risk predictions.
  • Compare the additive model with other IV approaches without changing the estimand silently.

Why Use an Additive Structural Mean Model?

For a binary outcome, a difference in risks is often directly interpretable: a treatment that changes risk from 20% to 35% raises it by 15 percentage points. An additive structural mean model (SMM) expresses a treatment effect on this risk-difference scale while using an instrument to address treatment endogeneity. The model does not make treatment assignment random. Instead, it combines a model for the treatment effect with assumptions that make the instrument informative about that effect.

The central parameter is measured in probability units. Its interpretation depends on the model and the IV assumptions: a fitted additive effect is not automatically the average treatment effect for everyone in a population. This tutorial defines the model, derives its instrument-based moment condition, and makes clear what extra assumptions support a particular interpretation.

Definition: Let \(A\in\{0,1\}\) denote treatment, \(Y\in\{0,1\}\) a binary outcome, and \(Y^a\) the outcome that would be observed under treatment level \(a\). An additive structural mean model with constant parameter \(\psi\) specifies $$ E(Y^1-Y^0\mid A,Z,X)=\psi. $$ Equivalently, the conditional mean difference between the potential outcome under the treatment actually received and the potential outcome under no treatment is $$ E(Y^A-Y^0\mid A,Z,X)=\psi A. $$ Here \(Z\) is an instrument and \(X\) denotes measured covariates. The parameter \(\psi\) is a risk difference, in probability units; for example, \(\psi=0.10\) means a 10-percentage-point increase in risk under the model.

This is a structural restriction on counterfactual outcomes, not simply a regression of observed \(Y\) on \(A\). It says that the conditional mean treatment effect is constant across the conditioning groups in the model. It does not require every individual to have exactly the same treatment effect; it restricts a conditional mean. Consistency, \(Y=Y^A\), connects the observed outcome to the potential outcome under the treatment received.

From the Model to an Instrument Moment

To obtain an instrument-based estimate, suppose the following conditions hold. First, consistency holds and the instrument satisfies exclusion: changing \(Z\) does not directly change the outcome, apart from any change it causes in treatment. Second, conditional on \(X\), the instrument is independent of the potential outcomes and potential treatment assignments. Third, the instrument is relevant: treatment probability varies with \(Z\) for at least some values of \(X\). Finally, the additive SMM is correctly specified with a common \(\psi\). These conditions are substantive, not consequences of observing an association between \(Z\), \(A\), and \(Y\).

Define the outcome after subtracting the modeled treatment effect as \(Y-\psi A\). By consistency and the SMM,

$$ E(Y-\psi A\mid A,Z,X)=E(Y^0\mid A,Z,X). $$

Averaging over \(A\) conditional on \(Z,X\) gives \(E(Y-\psi A\mid Z,X)=E(Y^0\mid Z,X)\). Under instrument independence and exclusion, the mean of \(Y^0\) does not vary with \(Z\) conditional on \(X\), so

$$ E(Y-\psi A\mid Z,X)=E(Y^0\mid X). $$

Thus, the instrument should not predict the mean of the adjusted outcome \(Y-\psi A\), conditional on \(X\). One corresponding population moment is

$$ E\left[\{Z-E(Z\mid X)\}(Y-\psi A)\right]=0. $$

With no covariates and a binary instrument, this moment is equivalent to equating the instrument-group differences in the outcome and treatment, after scaling the latter by \(\psi\). If the first stage is nonzero, solving the equation yields the ratio below. With covariates, estimation uses conditional or appropriately weighted moments; the simple unadjusted ratio need not be suitable when the instrument groups differ in \(X\).

Identification result: With a binary instrument \(Z\), no covariates, a nonzero first stage, the IV assumptions above, and a correctly specified constant additive SMM, the parameter is identified by $$ \psi= \frac{E(Y\mid Z=1)-E(Y\mid Z=0)} {E(A\mid Z=1)-E(A\mid Z=0)}. $$ The numerator is the reduced-form risk difference by instrument group; the denominator is the first-stage difference in treatment probability. The ratio is a risk difference per unit of treatment induced by the instrument. Relevance requires the denominator to be nonzero.

The derivation is direct: the moment condition implies that the mean of \(Y-\psi A\) is the same in the two instrument groups. Subtracting the \(Z=0\) equation from the \(Z=1\) equation gives

$$ \{E(Y\mid Z=1)-E(Y\mid Z=0)\} -\psi\{E(A\mid Z=1)-E(A\mid Z=0)\}=0. $$

Rearranging gives the stated ratio. This equation establishes an estimand only when the assumptions and model hold. If treatment effects differ across people, or the instrument is invalid, the ratio may still be calculable but need not equal the constant \(\psi\) in the model.

Worked Example: Estimating a Risk Difference From a Binary Instrument

Consider hypothetical data from 1,000 individuals, split evenly by a binary instrument \(Z\). Treatment and outcome counts are:

Instrument groupNumberTreatedOutcome events among treatedOutcome events among untreated
\(Z=0\)5001004560 of 400
\(Z=1\)50030013530 of 200

The treatment probabilities are \(100/500=0.20\) for \(Z=0\) and \(300/500=0.60\) for \(Z=1\). The outcome risks are \((45+60)/500=0.210\) for \(Z=0\) and \((135+30)/500=0.330\) for \(Z=1\). Therefore,

$$ \hat{\psi}_{IV} = \frac{0.330-0.210}{0.600-0.200} = \frac{0.120}{0.400} =0.300. $$

Under the stated model and IV assumptions, the estimate is a 0.300 risk difference, or a 30-percentage-point increase in outcome risk for treatment. The first-stage difference is 40 percentage points, so the instrument is relevant in these data. The arithmetic alone does not verify independence, exclusion, or the constant-effect restriction; those must be defended using the study design and subject-matter knowledge.

Interpreting the Estimate Carefully

Under a correctly specified constant-effect SMM, \(\psi\) is the model’s common conditional mean risk difference. This is stronger than saying that an instrument is valid. In settings where treatment effects vary, a binary-instrument Wald ratio can instead have a complier-average interpretation under additional assumptions such as monotonicity (no individual whose treatment moves in the opposite direction from the instrument). That is a different interpretation and does not make the constant-effect model true. Without the constant-effect restriction or assumptions that support another specific estimand, the ratio should not be labelled the population average treatment effect.

The model is additive on the risk scale, not on the odds or log-odds scale. It also has a feasibility implication: predicted risks must remain between 0 and 1 in the covariate and treatment groups to which the model is applied. A constant risk difference can be implausible across groups with very different baseline risks, even when it summarizes an effect adequately over a narrower range.

Worked Example: Checking Risk-Scale Feasibility

Suppose a hypothetical analysis estimates a baseline counterfactual risk of 0.78 for a specified covariate group and estimates \(\psi=0.30\). Under the additive model, the corresponding treated risk would be

$$ 0.78+0.30=1.08. $$

A binary outcome cannot have risk 1.08. The result signals that the model or its application to this group is incompatible with valid probabilities. It does not mean that the probability should be truncated to 1 and the model left unchanged: truncation would change the implied treatment effect and violate the stated additive specification. The analyst should examine model fit, the relevant covariate range, and whether a constant additive effect is defensible there.

Diagnostics, Alternatives, and Limitations

Diagnostics cannot prove the IV assumptions, particularly exclusion. They can reveal warning signs. Report the first-stage difference and its uncertainty; a small denominator makes the ratio unstable, so minor sampling variation in either contrast can produce a large change in \(\hat{\psi}_{IV}\). Inspect instrument and treatment distributions across covariate groups, and assess whether the proposed adjustment accounts for important differences in instrument assignment. Consider whether a direct pathway from the instrument to the outcome is plausible. Finally, check whether fitted risks remain in the unit interval and whether one constant risk difference is credible across the intended population.

A common mistake is to interpret a large Wald ratio as evidence of a large treatment effect. The ratio can be large because the first-stage denominator is close to zero, not because the outcome contrast is large. Another mistake is to treat a statistically strong association between \(Z\) and \(A\) as proof that \(Z\) is independent of potential outcomes or satisfies exclusion. Relevance is necessary, but it does not establish instrument validity.

The additive SMM is useful when risk differences are the intended scale and a constant conditional mean effect is plausible. It is not the only IV approach. A linear IV analysis can produce a similar ratio in the binary-instrument setting, but its causal interpretation still depends on the relevant assumptions and estimand. A control-function approach specifies a model for outcome dependence on unobserved treatment selection and requires its own structural assumptions. A conventional regression of \(Y\) on \(A\) estimates an association unless treatment assignment is adequately addressed; it does not become an IV analysis by including \(Z\) as an ordinary predictor.

This model’s main limitations are substantive and statistical. Exclusion and instrument independence cannot usually be fully tested from observed data. Weak relevance undermines precision and can make ordinary large-sample approximations unreliable. A constant additive effect can be too restrictive when effects vary, and risk differences can behave poorly when baseline risks approach 0 or 1. When those concerns are serious, the analyst should state which alternative estimand and assumptions are being used rather than silently changing the interpretation of the additive SMM estimate.

1
State the model and estimand.
Specify the binary outcome, treatment, instrument, covariates, and whether the common risk-difference restriction is credible.
2
Defend the instrument assumptions.
Explain relevance, conditional independence, and exclusion using design knowledge; do not infer validity from the first stage alone.
3
Estimate and diagnose.
Compute the reduced-form and first-stage contrasts, inspect denominator strength, and assess probability-scale fit and effect heterogeneity.
4
Report the interpretation with its conditions.
Give the estimate in risk-difference units and state the assumptions that justify treating it as the additive SMM parameter.

Worked Example: Why Relevance Does Not Rescue an Invalid Instrument

Suppose a hypothetical instrument changes treatment probability from 0.25 to 0.65, while outcome risk changes from 0.20 to 0.32. The computed ratio is

$$ \frac{0.32-0.20}{0.65-0.25} = \frac{0.12}{0.40} =0.30. $$

Now suppose, contrary to the required exclusion condition, \(Z=1\) also increases outcome risk by 0.08 through a direct pathway unrelated to treatment. The observed reduced-form contrast includes that direct effect. The ratio 0.30 is therefore not justified as the treatment risk difference by the IV moment derivation, even though the first stage is substantial. The appropriate conclusion is that the instrument may be relevant but invalid; the ratio remains a descriptive calculation, not a supported causal estimate under this model.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. In an additive SMM for a binary outcome, what does \(\psi=0.08\) mean on the risk-difference scale?
  2. A binary instrument produces an outcome-risk contrast of 0.06 and a treatment-probability contrast of 0.30. Compute the Wald-type estimate.
  3. Why is a nonzero first stage insufficient to establish that the IV estimate is causal?
  4. If the first stage is nearly zero, what happens to the ratio estimate’s stability?
  5. A model predicts a treated risk of 1.04 for one group. What does this imply for the additive specification in that group?

Solutions. (1) Under the model, treatment raises the conditional mean outcome risk by 0.08, or 8 percentage points. (2) The estimate is \(0.06/0.30=0.20\), a 20-percentage-point risk difference under the model and IV assumptions. (3) Relevance only says that the instrument changes treatment probability. Independence and exclusion are also needed for the moment condition to identify a treatment effect. (4) The denominator is small, so sampling variation in the contrasts can cause large changes in their ratio; the estimate is unstable. (5) A binary outcome risk cannot exceed 1. The prediction indicates incompatibility between the fitted additive model and that group, so the model or its target range should be reconsidered rather than the probability simply truncated.

Clinical Biostats