Tutorials › Propensity Score Matching and Instrumental Variables › Using Auxiliary Data To Tighten Bounds

Partial Identification and Bounds · Tutorial 424 of 699

Using Auxiliary Data To Tighten Bounds

Use auxiliary information as explicit constraints on missing potential outcomes, and determine how much those constraints narrow a worst-case identified interval.

Advanced 12 min read

What You'll Learn

  • Express the average treatment effect using observed and missing potential-outcome means.
  • Translate auxiliary population-margin ranges into restrictions on missing counterfactual means.
  • Calculate tightened bounds and verify that the constraints are compatible with the observed data.
  • Distinguish valid auxiliary measurements from proxies or estimates that require additional assumptions.
  • Recognize when bound endpoints are attainable and when narrower bounds would overstate what the data establish.
  • Separate identification from sampling uncertainty in auxiliary estimates.

Why Auxiliary Information Can Tighten Bounds

Worst-case bounds leave unobserved potential outcomes as unrestricted as the outcome scale permits. That caution is useful when nothing else is known, but sometimes a study has valid auxiliary information: for example, a measurement of a potential outcome in a relevant validation sample, or a credible range for a population-wide outcome mean. Such information can rule out some counterfactual values without assuming that treatment assignment is unconfounded.

The key is to use auxiliary information as a constraint on the same population quantities that define the causal effect. A measurement from a different population, a proxy with an unverified relationship to the outcome, or a noisy estimate treated as if it were an exact truth does not automatically provide a valid constraint. The analysis must state why the auxiliary quantity corresponds to the target population and how its uncertainty is represented.

Definition: An auxiliary constraint is information not contained in the treatment-group outcome means alone that restricts one or more potential-outcome quantities in the target population. A tightened identified set is the set of causal effect values satisfying both the observed-data restrictions and the valid auxiliary constraints. It cannot be wider than the set obtained from the observed data alone.

Set Up the Bounds Before Adding Information

Let \(D\) indicate treatment, with \(D=1\) for treated units and \(D=0\) for untreated units. Let \(Y(1)\) and \(Y(0)\) be the outcomes each unit would have under treatment and no treatment, respectively. The observed outcome is \(Y=DY(1)+(1-D)Y(0)\). The target here is the average treatment effect, \(E[Y(1)-Y(0)]\). No assumption of random assignment or conditional exchangeability is imposed.

For a binary outcome, define \(p=P(D=1)\), \(m_1=E[Y\mid D=1]\), and \(m_0=E[Y\mid D=0]\). Also write \(a=E[Y(1)\mid D=0]\) and \(b=E[Y(0)\mid D=1]\). The observed data identify \(p,m_1,m_0\), but not \(a\) or \(b\). Since a binary outcome has conditional means between zero and one, \(a,b\in[0,1]\). Decomposing each population potential-outcome mean by treatment status gives

$$ \tau=E[Y(1)-Y(0)] =p m_1+(1-p)a-pb-(1-p)m_0. $$

With no other restrictions, the smallest value sets \(a=0\) and \(b=1\); the largest sets \(a=1\) and \(b=0\). Thus the worst-case interval is

$$ \left[p m_1-(1-p)m_0-p,\quad p m_1+(1-p)-(1-p)m_0\right]. $$

An auxiliary population mean can constrain these missing means. For example, if \(M_1=E[Y(1)]\), then \(M_1=p m_1+(1-p)a\). A valid range for \(M_1\) therefore restricts \(a\). Similarly, \(M_0=E[Y(0)]=p b+(1-p)m_0\) links an auxiliary range for \(M_0\) to \(b\). The narrowed effect interval follows by minimizing and maximizing the effect expression over the remaining feasible values.

Worked Example: Two Auxiliary Population-Margin Ranges

Suppose a hypothetical study has \(p=0.40\), \(m_1=0.70\), and \(m_0=0.30\). The outcome is binary. Without auxiliary information, the lower bound is

$$ 0.40(0.70)-0.60(0.30)-0.40 =0.28-0.18-0.40=-0.30, $$

and the upper bound is

$$ 0.40(0.70)+0.60-0.60(0.30) =0.28+0.60-0.18=0.70. $$

So the observed data alone give \([-0.30,0.70]\). Now suppose valid auxiliary information restricts the target population means to \(E[Y(1)]\in[0.52,0.60]\) and \(E[Y(0)]\in[0.34,0.42]\). These are stipulated compatibility ranges for the population quantities, not confidence intervals being treated as certain truths. The treatment-potential-outcome margin is \(E[Y(1)]=0.28+0.60a\), so

$$ a\in\left[\frac{0.52-0.28}{0.60},\frac{0.60-0.28}{0.60}\right] =[0.40,0.5333]. $$

Likewise, \(E[Y(0)]=0.18+0.40b\), giving

$$ b\in\left[\frac{0.34-0.18}{0.40},\frac{0.42-0.18}{0.40}\right] =[0.40,0.60]. $$

Substitute these ranges into the effect formula. The minimum uses \(a=0.40\) and \(b=0.60\):

$$ \tau_{\min}=0.28+0.60(0.40)-0.40(0.60)-0.18 =0.10. $$

The maximum uses \(a=0.5333\) and \(b=0.40\):

$$ \tau_{\max}=0.28+0.60(0.5333)-0.40(0.40)-0.18 \approx0.26. $$

The tightened identified interval is approximately \([0.10,0.26]\), or 10 to 26 percentage points for a binary outcome. It lies inside the original worst-case interval. The margin ranges are compatible with the observed means because the implied \(a\) and \(b\) both lie in \([0,1]\). With no further restrictions linking the two potential outcomes, either endpoint can be attained by distributions having these conditional means; their unobserved joint dependence need not be specified to attain the ATE bounds.

One Margin Can Tighten Only Part of the Uncertainty

Auxiliary information need not identify both population potential-outcome means. A constraint on just one of them can still improve one or both endpoints. It is important to leave the other missing mean unrestricted rather than silently treating it as known.

Worked Example: Constraining the No-Treatment Population Mean

Use the same hypothetical observed quantities: \(p=0.40\), \(m_1=0.70\), and \(m_0=0.30\). Suppose auxiliary information supports \(E[Y(0)]\in[0.38,0.42]\), while providing no additional information about \(E[Y(1)]\). Since \(E[Y(0)]=0.18+0.40b\), the restriction implies

$$ b\in\left[\frac{0.38-0.18}{0.40},\frac{0.42-0.18}{0.40}\right] =[0.50,0.60]. $$

The other missing mean remains unrestricted: \(a\in[0,1]\). In this example the effect simplifies to

$$ \tau=0.28+0.60a-0.40b-0.18 =0.10+0.60a-0.40b. $$

The minimum is at \(a=0,b=0.60\), yielding \(0.10-0.24=-0.14\). The maximum is at \(a=1,b=0.50\), yielding \(0.10+0.60-0.20=0.50\). Thus the new interval is \([-0.14,0.50]\), narrower than \([-0.30,0.70]\), but it still includes both negative and positive effects. The auxiliary measurement has not resolved the causal direction.

When Is the Tightened Interval Sharp?

A bound is sharp when every value inside it is compatible with the stated restrictions and its endpoints can be attained by at least one data-generating arrangement satisfying them. For the calculations above, the feasible set is described by independent intervals for the two missing conditional means, together with the observed means. The effect is linear in those missing means, so its minimum and maximum occur at feasible endpoints. If no restrictions are imposed on the joint distribution of \(Y(1)\) and \(Y(0)\), binary potential outcomes with any specified marginal probabilities can be jointly distributed; for example, the two potential outcomes can be generated independently conditional on treatment status. This allows the endpoint conditional means to be realized without adding a cross-world assumption.

That justification depends on the absence of additional constraints. If auxiliary data also restrict how potential outcomes co-occur, or if several reported margins must hold simultaneously, taking separate endpoint ranges may combine values that cannot jointly occur. In that case, the bounds must be computed over the joint feasible set rather than by optimizing each restriction in isolation. A claim of sharpness requires checking joint feasibility, not merely showing that each auxiliary range looks plausible by itself.

1
Define the target and observed quantities.
State the treatment, outcome scale, target population, observed treatment share, and observed outcome summaries used in the bound.
2
Write the original feasible set.
Express the effect in terms of observed quantities and missing potential-outcome means, and impose the outcome-scale restrictions.
3
Translate each auxiliary fact.
Write the exact population quantity measured and its constraint, then check that it refers to the same outcome definition and target population.
4
Check compatibility and optimize.
Verify that at least one assignment of the missing quantities satisfies all restrictions, then find the minimum and maximum effect over that feasible set.

Diagnostics, Alternatives, and Limits

A first diagnostic is feasibility. If a proposed auxiliary range implies \(a<0\), \(a>1\), \(b<0\), or \(b>1\) for binary outcomes, the restrictions conflict with the observed data and outcome scale. Other conflicts can arise when multiple auxiliary facts overlap. An empty feasible set is a warning that at least one input, population definition, measurement assumption, or data source needs review; it is not evidence for an unusually precise effect.

A second diagnostic is how much each constraint changes the endpoints. A very small change may mean the auxiliary information is weak, redundant with the observed data, or attached to a missing mean that barely affects the bound. A large change deserves careful scrutiny of transportability, outcome measurement, and whether the range really covers the target population quantity. Wider or narrower should not be confused with more or less credible: credibility comes from the assumptions supporting the constraint.

The relevant alternative depends on what information is genuinely available. The worst-case bound uses only the observed data and the outcome scale, so it is robust but can be wide. A point estimate based on a stronger assignment or modeling assumption may be more precise, but answers the question only if that assumption is justified. Auxiliary constraints occupy a middle ground: they add information while retaining a set of compatible effects. They do not, by themselves, establish unconfoundedness or turn the interval into a point estimate.

An auxiliary estimate also has sampling uncertainty. If it is estimated from a finite validation sample, its uncertainty must be accounted for when constructing an inferential procedure; substituting a sample estimate as an exact population equality generally understates uncertainty. Further, a direct measurement of a potential outcome is not interchangeable with a proxy. A proxy can impose a constraint only when a defensible measurement or calibration relationship links it to the target potential outcome. These issues are separate from the algebra of identification.

Common pitfall: “The auxiliary sample reports an average of 0.55, so I can set the target population mean to exactly 0.55.” This is not justified merely because the number is observed. The auxiliary sample must measure the same potential outcome for a relevant target population, and uncertainty or transport differences must be addressed. Use a justified population value or compatibility range; otherwise the resulting bounds may be falsely narrow.

Worked Example: A Direct Auxiliary Restriction on One Missing Mean

Suppose a hypothetical validation design supports \(a=E[Y(1)\mid D=0]\in[0.42,0.48]\) for the same target units who were untreated in the main study. Assume the validation design truly measures the treatment potential outcome for those units and has no unresolved measurement or transport error. Keep \(b\in[0,1]\), since there is no added information about \(Y(0)\) among treated units.

With the same observed quantities, \(\tau=0.10+0.60a-0.40b\). The lower endpoint uses \(a=0.42\) and \(b=1\):

$$ \tau_{\min}=0.10+0.60(0.42)-0.40(1) =0.10+0.252-0.40=-0.048. $$

The upper endpoint uses \(a=0.48\) and \(b=0\):

$$ \tau_{\max}=0.10+0.60(0.48)-0.40(0) =0.388. $$

The resulting identified interval is \([-0.048,0.388]\), or approximately a 4.8-percentage-point decrease to a 38.8-percentage-point increase. It is narrower than the original interval, but still permits effects in either direction. This calculation is valid only because the stipulated auxiliary restriction concerns the missing potential outcome for the relevant untreated group; a generic outcome measurement from another group would not establish the same range.

Check Your Understanding

Answer each question, then compare with the solutions.

  1. In the first worked example, what is the worst-case interval before auxiliary information is used, and what are the two missing means?
  2. If an auxiliary restriction implies \(a=1.10\) for a binary outcome, what should the analyst conclude?
  3. Why is it not generally valid to treat an auxiliary sample average as an exact target-population mean?
  4. Suppose an auxiliary constraint narrows the effect interval but the result still includes zero. What causal conclusion is warranted from the identified interval alone?

Solutions. (1) The interval is \([-0.30,0.70]\); the missing means are \(a=E[Y(1)\mid D=0]\) and \(b=E[Y(0)\mid D=1]\). (2) The restrictions are incompatible with a binary outcome, since its mean must lie in \([0,1]\); check the data, definitions, and assumptions rather than reporting the resulting bound. (3) The average is estimated with sampling error and may refer to a different population or measurement process; its relation to the target quantity must be justified and uncertainty addressed. (4) The restrictions still allow effects on both sides of zero, so they do not establish a positive or negative effect. The interval gives the range compatible with the stated information and assumptions.

Clinical Biostats