Tutorials › Causal Inference › Bounds for Continuous Outcomes With Known Outcome Limits

Instrumental Variable Extensions · Tutorial 575 of 972

Bounds for Continuous Outcomes With Known Outcome Limits

Learn to bound treatment effects separately at each randomized encouragement level, then combine the bounds for a clearly specified target.

Advanced 12 min read

What You'll Learn

  • Define treatment effects at fixed encouragement levels when exclusion may fail
  • Derive sharp lower and upper bounds from outcome limits and observed arm data
  • Calculate bounds for a weighted average across encouragement levels
  • Distinguish treatment-effect bounds from the randomized encouragement effect
  • Separate identification uncertainty from sampling uncertainty

Why Outcome Limits Matter

A randomized encouragement can change treatment uptake, but it may also affect the outcome through routes other than treatment. If that direct effect is possible, the usual instrumental-variable interpretation of the encouragement contrast is not justified without further assumptions. When the outcome is continuous but known to lie within a fixed range, we can still learn something: the observed outcome in each encouragement arm places limits on the unobserved treatment outcomes.

This tutorial derives those limits for a binary treatment and a randomized encouragement with a finite number of levels. The result does not require the exclusion restriction or monotonicity. It is an identification result: it describes which treatment effects are compatible with the assumptions and observed population distributions. It does not, by itself, account for sampling uncertainty in estimated bounds.

Potential Outcomes and the Target

Let \(Z\) denote randomized encouragement, with levels \(z\) in a finite set, and let \(D\in\{0,1\}\) denote treatment received. Because exclusion may fail, define \(Y(d,z)\) as the outcome that would occur if treatment were set to \(d\) and encouragement to \(z\). Thus \(Y(1,z)-Y(0,z)\) compares treatment states while holding encouragement fixed. Assume the outcome is known to satisfy \(L\leq Y(d,z)\leq U\), where \(L\) and \(U\) are fixed, substantively justified limits.

Definition: The average treatment effect at encouragement level \(z\) is \(\tau_z=E[Y(1,z)-Y(0,z)]\). For specified probability weights \(q_z\) over the encouragement levels, the weighted target is \(\tau_q=\sum_z q_z\tau_z\), where \(q_z\geq 0\) and \(\sum_z q_z=1\). The weights \(q_z\) may be any explicitly chosen target distribution. They equal \(P(Z=z)\) only when the target is the average effect under the actual assignment distribution.

This target concerns treatment effects at fixed encouragement levels. It is not the effect of being assigned encouragement, which compares outcomes under different values of \(Z\). Allowing \(Y(d,z)\) to vary with \(z\) permits a direct effect of encouragement and does not assert exclusion.

The assumptions for the bounds are:

  • Random assignment: \(Z\) is independent of the potential treatments and outcomes, \(\{D(z),Y(d,z):z,d\}\).
  • Consistency and no interference: a person assigned \(Z=z\) receives \(D=D(z)\) and has observed outcome \(Y=Y(D(z),z)\); one person's assignment does not change another person's outcome.
  • Known outcome limits: every \(Y(d,z)\) lies in \([L,U]\).
  • Arm positivity: each encouragement level receiving positive target weight has positive assignment probability, so its population distribution can be observed.

No assumption says that encouragement affects outcomes only through treatment. Nor is a particular direction of treatment response to encouragement required. Randomization makes the people observed in an encouragement arm representative of the population for that arm's potential outcomes; it does not randomize treatment receipt within that arm.

Bounds Within One Encouragement Arm

Fix an encouragement level \(z\). Write \(p_z=P(D=1\mid Z=z)\), the treatment proportion in that arm, and define the observed outcome contributions \(m_{1z}=E[Y\,1(D=1)\mid Z=z]\) and \(m_{0z}=E[Y\,1(D=0)\mid Z=z]\). These are contributions to the arm's overall mean, not conditional means among treated or untreated people. For example, if the treated proportion is \(p_z\) and their mean outcome is \(\mu_{1z}\), then \(m_{1z}=p_z\mu_{1z}\).

In arm \(z\), the observed treated outcomes reveal \(Y(1,z)\) for the fraction with \(D(z)=1\). For the remaining fraction \(1-p_z\), \(Y(1,z)\) is unobserved but lies between \(L\) and \(U\). In the same way, observed untreated outcomes reveal \(Y(0,z)\) for fraction \(1-p_z\), while the missing \(Y(0,z)\) values for the treated fraction lie between the outcome limits. Random assignment allows these arm-specific quantities to represent the population.

Theorem: Under random assignment, consistency, no interference, and \(L\leq Y(d,z)\leq U\), the sharp bounds on \(\tau_z\) are
$$ m_{1z}+(1-p_z)L-m_{0z}-p_zU \ \leq\ \tau_z\ \leq\ m_{1z}+(1-p_z)U-m_{0z}-p_zL. $$

Here “sharp” means that, without additional assumptions, both endpoints can be attained by distributions of the unobserved potential outcomes consistent with the observed arm data and the stated outcome limits. The lower endpoint assigns the lowest permitted values to missing \(Y(1,z)\) and the highest permitted values to missing \(Y(0,z)\); the upper endpoint does the reverse.

Why the Bounds Hold

The population mean of \(Y(1,z)\) includes the observed outcomes among people who take treatment in arm \(z\), plus the missing treatment outcomes for people who do not. The outcome limits therefore imply

$$ m_{1z}+(1-p_z)L \ \leq\ E[Y(1,z)]\ \leq\ m_{1z}+(1-p_z)U. $$

Similarly, the observed untreated contribution is \(m_{0z}\), and the fraction \(p_z\) who take treatment have unobserved outcomes under no treatment. Hence

$$ m_{0z}+p_zL \ \leq\ E[Y(0,z)]\ \leq\ m_{0z}+p_zU. $$

To obtain a lower bound on a difference, subtract the largest permitted value of \(E[Y(0,z)]\) from the smallest permitted value of \(E[Y(1,z)]\). To obtain an upper bound, subtract the smallest permitted value of the former from the largest permitted value of the latter. This gives the stated interval. These endpoint assignments are feasible: the unobserved potential outcomes can be set to the corresponding limits without changing any observed outcome. Thus the bounds are sharp under the stated assumptions.

Worked Example: Bounding an Effect at One Encouragement Level

Suppose a hypothetical randomized encouragement study has outcomes on a 0-to-100 scale. In the arm \(Z=0\), 40% receive treatment and their mean outcome is 60 points; the other 60% do not receive treatment and their mean outcome is 50 points. Take \(L=0\) and \(U=100\). The observed outcome contributions are

$$ p_0=0.40,\qquad m_{10}=0.40(60)=24,\qquad m_{00}=0.60(50)=30. $$

The lower bound on the average treatment effect at \(Z=0\) is

$$ 24+(1-0.40)(0)-30-(0.40)(100) =24+0-30-40=-46\text{ points}. $$

The upper bound is

$$ 24+(1-0.40)(100)-30-(0.40)(0) =24+60-30-0=54\text{ points}. $$

Thus the population effect at \(Z=0\) is bounded between \(-46\) and \(54\) points under these assumptions. This wide interval reflects missing outcomes under the counterfactual treatment state; it is not a confidence interval.

Combining Encouragement Levels

For a weighted target \(\tau_q=\sum_z q_z\tau_z\), let \(\ell_z\) and \(u_z\) denote the lower and upper endpoints of the bound for \(\tau_z\). Because the weights are nonnegative, summing the arm-specific inequalities gives

$$ \sum_z q_z\ell_z\ \leq\ \tau_q\ \leq\ \sum_z q_zu_z. $$

With no restrictions linking outcomes across encouragement levels, these weighted endpoints are sharp: the arm-specific endpoint assignments can be made for each level, and the assumptions place no further constraint on their joint distribution. The choice of weights defines the target and should be reported alongside the resulting bounds.

Worked Example: Choosing Target Weights Explicitly

Continue the hypothetical study, and suppose the \(Z=1\) arm has a 70% treatment rate, a mean outcome of 70 points among treated people, and a mean of 55 points among untreated people. Then

$$ p_1=0.70,\qquad m_{11}=0.70(70)=49,\qquad m_{01}=0.30(55)=16.5. $$

With outcome limits 0 and 100, the \(Z=1\) lower and upper bounds are

$$ 49+(0.30)(0)-16.5-(0.70)(100)=-37.5, $$ $$ 49+(0.30)(100)-16.5-(0.70)(0)=62.5. $$

Now define the target to place weight \(q_0=0.80\) on \(Z=0\) and \(q_1=0.20\) on \(Z=1\). These are explicitly chosen target weights, not the assignment probabilities. The weighted lower bound is

$$ (0.80)(-46)+(0.20)(-37.5)=-36.8-7.5=-44.3\text{ points}, $$

and the weighted upper bound is

$$ (0.80)(54)+(0.20)(62.5)=43.2+12.5=55.7\text{ points}. $$

The weighted target effect is therefore bounded by \([-44.3,55.7]\) points. If the goal instead were an average over the actual assignment distribution, the weights would be the assignment probabilities; that is a different target whenever the chosen \(q_z\)'s differ from those probabilities.

What Randomized Encouragement Does—and Does Not—Identify

The randomized assignment contrast is identifiable: it is \(E[Y\mid Z=1]-E[Y\mid Z=0]\). In the hypothetical data above, the mean outcome in the \(Z=0\) arm is

$$ (0.40)(60)+(0.60)(50)=54\text{ points}, $$

and the mean in the \(Z=1\) arm is

$$ (0.70)(70)+(0.30)(55)=65.5\text{ points}. $$

Thus assignment to \(Z=1\), rather than \(Z=0\), increases the mean outcome by \(65.5-54=11.5\) points in this hypothetical population. That is an effect of the encouragement assignment. It need not equal a treatment effect because the encouragement can affect outcomes directly.

The treatment rate also rises by \(0.70-0.40=0.30\). Dividing the assignment contrast by this first-stage difference gives \(11.5/0.30=38.33\) points per unit increase in treatment probability. This ratio is not established as a treatment effect here: interpreting it causally requires assumptions that rule out or otherwise control direct effects, among other requirements. The bounds above do not make that interpretation; they use the outcome limits while permitting direct effects.

Worked Example: A Nonzero Lower Outcome Limit

Suppose a different hypothetical outcome is measured on a validated scale known to range from 10 to 50 points. In one randomized encouragement arm, 25% receive treatment with mean outcome 30, and 75% do not with mean outcome 26. Then \(p_z=0.25\), \(m_{1z}=0.25(30)=7.5\), and \(m_{0z}=0.75(26)=19.5\). The lower endpoint is

$$ 7.5+(0.75)(10)-19.5-(0.25)(50) =7.5+7.5-19.5-12.5=-17\text{ points}. $$

The upper endpoint is

$$ 7.5+(0.75)(50)-19.5-(0.25)(10) =7.5+37.5-19.5-2.5=23\text{ points}. $$

The bounds use the stated scale limits, not an arbitrary recoding to zero and one. The lower limit contributes to the missing-outcome terms just as the upper limit does. A bound is only as defensible as the substantive claim that every potential outcome lies within the specified range.

Interpretation, Sampling, and Common Mistakes

These are population identification bounds. In an actual sample, the quantities \(p_z\), \(m_{1z}\), and \(m_{0z}\) are estimated, so sampling variability remains. Substituting sample proportions and means produces estimated endpoints; it does not make those endpoints a confidence interval or account for uncertainty in them. Any inferential procedure for the endpoints must address that additional sampling uncertainty.

Outcome limits should be justified by the measurement scale or a defensible scientific restriction. The observed sample minimum and maximum are not automatically valid limits for unobserved potential outcomes. If the true outcome range is wider than the range used in the calculation, the resulting bounds can be too narrow and misleading.

A frequent error is to treat the encouragement contrast as a treatment effect simply because encouragement was randomized. Randomization identifies the effect of assignment to encouragement. If encouragement can directly change the outcome, its assignment effect combines pathways and does not by itself identify the effect of treatment. The correction is to define the target precisely, allow outcomes to depend on both treatment and encouragement, and use assumptions appropriate to that target. Here, known outcome limits yield valid, generally non-point bounds without requiring exclusion.

Key takeaway: With randomized encouragement, bounded continuous outcomes, and no exclusion restriction, bound the treatment effect separately at each encouragement level using the observed treated and untreated outcome contributions. Combine those bounds using explicitly stated target weights; do not confuse the result with the effect of encouragement assignment.

Check Your Understanding

Use the definitions and bounds above to answer the following questions.

  1. Why does random assignment of \(Z\) not imply that treatment receipt \(D\) is randomized within an encouragement arm?
  2. In one arm, \(p_z=0.30\), \(m_{1z}=18\), \(m_{0z}=28\), and outcomes lie in \([0,100]\). Calculate the lower and upper bounds on \(\tau_z\).
  3. What changes in the target when \(q_z\) is chosen differently from the actual assignment probabilities?
  4. Why can the randomized encouragement contrast differ from the treatment effect when exclusion fails?
  5. What additional uncertainty is not represented by plugging sample quantities into the population bound formulas?
Clinical Biostats