Tutorials › Econometrics (Graduate) › Counterfactual Bounds Under Functional-Form Restrictions

Partial Identification and Sensitivity · Tutorial 822 of 952

Counterfactual Bounds Under Functional-Form Restrictions

Derive counterfactual mean bounds from functional-form restrictions and see how weaker extrapolation assumptions change the identified set.

Advanced 10 min read

What You'll Learn

  • Define counterfactual bounds as extrema over an explicit class of admissible mean functions
  • Identify the assumptions needed to extend an observed conditional mean beyond its covariate support
  • Calculate bounds from uncertain affine coefficients
  • Derive bounds from a restriction on curvature and understand when they are sharp
  • Compare nested functional-form restrictions and their effect on bound width
  • Translate counterfactual mean bounds into bounds on an average treatment effect

Why Functional-Form Restrictions Produce Bounds

A counterfactual mean may depend on covariate values that are not represented among the observations used to estimate it. For example, a treated population may include values of \(X\) outside the range observed for untreated units. The untreated outcome at those values is unobserved, so the data alone do not determine its conditional mean. Extending the observed relationship requires an assumption about its form.

An exact linear model gives one extrapolated value, but that value can depend heavily on treating linearity as certain. A useful alternative is to specify a class of possible functions—such as affine functions with uncertain coefficients, or smooth functions whose curvature is bounded—and report the smallest and largest counterfactual means allowed by that class. These are bounds conditional on the stated restrictions, not bounds justified by the observed data alone.

Definition: Let \(Y(0)\) be the outcome a unit would have under the untreated condition, \(D\) indicate treatment, and \(X\) be a covariate. The target counterfactual mean for treated units is \(\mu_{0,T}=E[Y(0)\mid D=1]\). A functional-form restriction specifies an admissible class \(\mathcal{M}\) for the conditional mean \(m_0(x)=E[Y(0)\mid D=1,X=x]\), anchored to observed untreated outcomes where they are available. The resulting identified set is the range of \(\int m(x)\,dF_{X\mid D=1}(x)\) over \(m\in\mathcal{M}\); its infimum and supremum are the lower and upper bounds.

This setup needs care about what the observed outcomes identify. Consistency means that an untreated unit's observed outcome equals \(Y(0)\). On covariate values shared by treated and untreated units, one may use the untreated conditional mean \(E[Y\mid D=0,X=x]\) to anchor the treated counterfactual mean only under a conditional mean transportability assumption: \(E[Y(0)\mid D=1,X=x]=E[Y(0)\mid D=0,X=x]\) there. Outside that shared support, the functional-form restriction supplies the extrapolation. It does not follow from consistency or from the observed outcomes there.

For simplicity, the examples below treat the observed conditional means and restrictions as known population quantities. In applications, they are estimated, and sampling uncertainty is a separate issue from the width of the identified set.

Bounds from an Affine Mean Function

Suppose the admissible counterfactual mean functions are affine in a scalar covariate: \(m_0(x)=a+bx\). If observed untreated conditional means identify both coefficients exactly, this restriction yields a point value even beyond observed support. If the coefficients are only restricted to ranges, or to a joint parameter set, optimizing the target mean over that set yields bounds.

The restriction is informative only if the observed support can anchor the parameters. For an affine function, two distinct covariate values with known conditional means identify \(a\) and \(b\) in the exact model. If all observed covariate values are the same, the slope is not identified by those data; any bound then depends on additional restrictions on the slope or on the function class.

Worked Example: An Affine Extrapolation with Uncertain Coefficients

Suppose a hypothetical analysis uses the affine form \(m_0(x)=a+bx\). Based on its observed anchors and a sensitivity specification, the admissible coefficients are \(9.8\leq a\leq10.2\) and \(3.8\leq b\leq4.2\). All target units have \(X=2\), beyond the untreated covariate support. Find the counterfactual mean bounds.

At \(x=2\), the target conditional mean is \(a+2b\). Since both coefficients enter with positive weights, its minimum uses their lower limits and its maximum uses their upper limits:

$$ \begin{aligned} \underline{\mu}_{0,T} &=9.8+2(3.8)=9.8+7.6=17.4,\\ \overline{\mu}_{0,T} &=10.2+2(4.2)=10.2+8.4=18.6. \end{aligned} $$

Thus the counterfactual mean is bounded by 17.4 and 18.6 outcome units under this coefficient rectangle. The interval is not a confidence interval: it describes the range allowed by the stated parameter restrictions, with sampling uncertainty set aside.

More generally, if the coefficient vector \(\theta=(a,b)\) lies in a set \(\Theta\), and the treated covariate mean \(E[X\mid D=1]\) exists, then \(E[m_0(X)\mid D=1]=a+bE[X\mid D=1]\). The bounds are the minimum and maximum of this expression over \(\Theta\). If the set couples \(a\) and \(b\), optimizing each coefficient independently can give incorrect endpoints; the joint restrictions must be respected. With several covariates and an affine mean, the target mean is still linear in the coefficients, so the same optimization principle applies.

Relaxing Linearity with a Curvature Bound

An exact affine restriction rules out any curvature. One way to relax it is to retain observed anchor values while allowing departures from the straight line, with a bound on the second derivative. This is a restriction on how rapidly the slope can change, not a claim that the function is exactly quadratic.

Restriction: Suppose \(m_0\) is twice continuously differentiable over the interval containing the observed anchors and target values, and \(|m_0''(x)|\leq K\) throughout that interval for a specified \(K\geq0\). With two known anchor values at \(x_0\) and \(x_1\), this condition bounds the discrepancy between the function and its linear interpolant or extrapolant.

For distinct anchors, let \(L(x)\) be the line through \((x_0,m_0(x_0))\) and \((x_1,m_0(x_1))\). The interpolation remainder has the form \(m_0(x)-L(x)=m_0''(\xi)(x-x_0)(x-x_1)/2\) for some \(\xi\) between the three relevant points. It follows that \(|m_0(x)-L(x)|\leq K|(x-x_0)(x-x_1)|/2\). The same bound applies when \(x\) lies outside the two anchors, provided the differentiability and curvature restriction hold over the whole interval reaching \(x\). The sign of the product is not used for this absolute bound.

Worked Example: Bounding Extrapolation Error by Curvature

Suppose hypothetical untreated conditional means are known to be \(m_0(0)=10\) and \(m_0(1)=14\). The target value is \(x=2\), and the mean function is twice continuously differentiable on \([0,2]\), with \(|m_0''(x)|\leq1\) outcome units per squared covariate unit. Find the bound at \(x=2\).

The line through the anchors has slope \((14-10)/(1-0)=4\), so its extrapolated value is \(L(2)=10+4(2)=18\). The curvature remainder is bounded by

$$ \left|m_0(2)-L(2)\right| \leq \frac{1}{2}\left|(2-0)(2-1)\right| =\frac{1}{2}(2)=1. $$

Therefore \(17\leq m_0(2)\leq19\) outcome units. This bound is sharp under these assumptions: the functions \(m_0(x)=10+4x+c\,x(x-1)\), with \(c=1/2\) or \(c=-1/2\), match both anchors, have constant second derivative \(2c\) satisfying the restriction, and give \(m_0(2)=19\) or \(m_0(2)=17\), respectively.

The derivation also shows why distance from the observed support matters. The error bound grows with \(|(x-x_0)(x-x_1)|\); a curvature limit that gives a narrow interval near the anchors may permit a much wider interval farther away. If the target covariate varies across treated units, the counterfactual mean is an average of the conditional means over their covariate distribution. Pointwise lower and upper envelopes can be integrated to give valid bounds, although they need not be sharp when restrictions jointly link function values at different covariate values.

Why Relaxing Restrictions Widens Bounds

The direction of change follows directly from set inclusion. If \(\mathcal{M}_1\) is a stricter class of admissible functions and \(\mathcal{M}_2\) is a relaxed class with \(\mathcal{M}_1\subseteq\mathcal{M}_2\), then minimizing over the larger class cannot raise the lower endpoint, and maximizing over it cannot lower the upper endpoint:

$$ \inf_{m\in\mathcal{M}_2} E[m(X)\mid D=1] \leq \inf_{m\in\mathcal{M}_1} E[m(X)\mid D=1], \qquad \sup_{m\in\mathcal{M}_1} E[m(X)\mid D=1] \leq \sup_{m\in\mathcal{M}_2} E[m(X)\mid D=1]. $$

For example, allowing a larger curvature limit \(K\) enlarges the class of functions and weakly widens the counterfactual bounds. At \(K=0\), the second derivative restriction forces an affine function on the interval; a positive \(K\) allows departures. This comparison makes the assumption's role visible: narrower bounds reflect stronger functional-form commitments, not necessarily more information in the observed outcomes.

Worked Example: Translating Counterfactual Bounds into an ATT Bound

Suppose a hypothetical treated population has observed mean outcome \(E[Y\mid D=1]=22\) outcome units. From the curvature analysis above, its mean untreated potential outcome is bounded by 17 and 19. Calculate the corresponding bounds for the average treatment effect on the treated, \(E[Y(1)-Y(0)\mid D=1]\).

The treated outcome is observed for treated units, so subtracting the largest plausible untreated counterfactual mean gives the smallest effect, and subtracting the smallest counterfactual mean gives the largest:

$$ \begin{aligned} \underline{\tau}_{ATT} &=22-19=3,\\ \overline{\tau}_{ATT} &=22-17=5. \end{aligned} $$

Under the stated restrictions, the ATT is bounded between 3 and 5 outcome units. These are bounds on the effect parameter, not a claim that every treated unit's individual effect lies between 3 and 5. If the curvature restriction were relaxed, the counterfactual interval could widen, and these ATT bounds would widen correspondingly.

Assumptions and Common Pitfalls

Functional-form bounds are only as credible as the restrictions used to define the admissible class. An affine restriction is easy to interpret but can be fragile far beyond the observed support. A curvature bound allows more flexibility, but its numerical value \(K\) is itself a substantive sensitivity choice and must be expressed in units consistent with the outcome and covariate scales. Rescaling \(X\) changes the numerical value of a second-derivative bound.

  • Confusing extrapolation with observation. The counterfactual mean outside untreated support is not learned directly from untreated outcomes there. It is constrained by the chosen functional form.
  • Treating a point estimate as a bound. An exact affine model may imply one extrapolated value, but that point conclusion relies on exact linearity and known coefficients. Coefficient uncertainty or permitted departures can produce an interval.
  • Ignoring target covariate weights. The target quantity averages over the treated covariate distribution. Evaluating the function at an unrelated covariate value does not generally give that average.
  • Assuming that wider restrictions narrow the set. Admitting additional functions cannot make the identified set smaller. A wider model class weakly lowers the lower endpoint and weakly raises the upper endpoint.
  • Omitting transportability on shared support. Equality of treated and untreated conditional counterfactual means on overlap is an assumption, not a consequence of observing both groups at the same \(X\).

A disciplined analysis states the target population, the support covered by observed anchors, the transportability assumption used on shared support, and the functional restriction imposed outside it. It then reports how the bounds change under plausible relaxations. This presents extrapolation as a transparent sensitivity analysis rather than disguising it as a purely data-driven prediction.

Check Your Understanding

Answer each question using the definitions and assumptions in this tutorial.

  1. Why does an exact affine restriction yield a point extrapolation when its coefficients are known, and what additional restriction could turn it into bounds?
  2. A mean function is anchored at \(x=0\) and \(x=1\), and \(|m_0''(x)|\leq K\). Write the curvature-based bound on the deviation from the anchor line at \(x=3\).
  3. What assumption permits an untreated conditional mean to anchor the treated counterfactual mean at covariate values represented in both groups?
  4. If an admissible function class is enlarged while the target population and observed anchors remain fixed, what happens to the lower and upper bounds? Explain using infima and suprema.
  5. A counterfactual mean is bounded by 12 and 15, and the treated observed mean is 20. What are the corresponding ATT bounds, in outcome units?
Clinical Biostats