Tutorials › Propensity Score Matching and Instrumental Variables › Treatment-Specific Support Restrictions

Overlap, Trimming and Positivity · Tutorial 247 of 699

Treatment-Specific Support Restrictions

Define support restrictions for each treatment group, form their common score region, and see how asymmetric rules change which units—and which target population—are retained.

Intermediate 9 min read

What You'll Learn

  • Define group-specific propensity-score support using the standard distributional definition.
  • Construct a common restriction by intersecting treated- and control-group support sets.
  • Apply operational support intervals without mistakenly retaining observations outside their own group’s set.
  • Distinguish exact-support equivalences from rules based on estimated or chosen boundaries.
  • Interpret asymmetric retention counts and their consequences for the target population.
  • Diagnose when a support restriction does not justify causal interpretation by itself.

Why Treatment-Specific Support Sets Matter

A propensity-score overlap plot can show that treated and control units occupy different score ranges. A support restriction makes that diagnosis operational: it specifies which scores are considered usable in each treatment group, then retains units only where both groups have adequate support. This matters because a score can be familiar in one group yet poorly represented in the other. Keeping a unit on the basis of only one group’s score range does not establish that the comparison group is available at that score.

Let \(A\in\{0,1\}\) denote treatment status, let \(X\) be the measured covariates, and let \(e(X)=P(A=1\mid X)\) be the propensity score. The aim here is to define and apply a support restriction, not to select its numerical boundaries. The introductory material on positivity and common-support restrictions motivates why unsupported comparisons are problematic; the key task here is to keep the group-specific rules logically consistent.

Definition: For \(a\in\{0,1\}\), let \(S_a\) be the support of the score distribution among units with \(A=a\). For a real-valued score, a value \(t\) is in \(S_a\) if every open neighborhood around \(t\) has positive probability under the distribution of \(e(X)\mid A=a\). For a discrete score, this reduces to score values with positive probability in that group. The common-support set is \(C=S_1\cap S_0\).

The neighborhood condition is important for continuous scores: a particular score value can have probability zero even when it is a plausible value in the group’s distribution. For example, a continuously distributed score can have positive probability in every small interval around 0.40 even though \(P(e(X)=0.40\mid A=a)=0\). Defining support by positive probability at the individual value would therefore be wrong.

In practice, analysts usually work with estimated or operational sets, such as score intervals judged to have adequate representation in each arm. Denote these sets by \(G_1\) and \(G_0\). They need not be exact population supports, and an observed unit can fall outside the operational set assigned to its own group. The safe common restriction is therefore explicit:

$$ C_{\mathrm{op}}=G_1\cap G_0,\qquad \text{retain unit }i\text{ if and only if } e(X_i)\in C_{\mathrm{op}}. $$

This rule is applied to both treated and control units. It checks membership in both sets, rather than assuming that observed scores automatically lie in their own group’s operational set.

From Group-Specific Rules to a Common Restriction

A common way to describe the rule is in terms of the comparison group: retain treated units only where controls have support, and retain controls only where treated units have support. In symbols, these are \(e(X)\in G_0\) for treated units and \(e(X)\in G_1\) for controls. Those opposite-group checks alone are equivalent to the intersection rule only when membership in each unit’s own group set is already guaranteed.

For exact population supports, that own-group membership holds with probability one: a random score drawn from the distribution whose support is \(S_a\) lies in \(S_a\) almost surely. Thus the opposite-group check yields the common support, up to probability-zero exceptions. With estimated or deliberately defined adequate-support sets, that guarantee does not generally hold. In that setting, require both own- and opposite-group membership, or simply apply \(G_1\cap G_0\) to every unit.

Key rule: For operational or estimated support sets, retain a unit only when its score belongs to the intersection of the two sets. Do not use the opposite-group test alone unless own-group membership is guaranteed.

The short justification for the exact-support statement is that the score distribution in arm \(a\) assigns probability zero to the complement of its support. For a real-valued random variable, the complement can be covered by a countable collection of open intervals, each having probability zero by the definition of support. Their countable union also has probability zero. Consequently, a treated score lies in \(S_1\) almost surely and a control score lies in \(S_0\) almost surely. Intersecting with the other group’s support then leaves scores in \(S_1\cap S_0\).

Worked Example: Applying Two Operational Intervals

Suppose a hypothetical analysis defines the adequate-support intervals as \(G_1=[0.15,0.78]\) for treated units and \(G_0=[0.28,0.66]\) for controls. These are operational intervals, not asserted to be exact population supports. The common interval is

$$ C_{\mathrm{op}}=[0.15,0.78]\cap[0.28,0.66]=[0.28,0.66]. $$

The hypothetical observed scores are:

  • Treated: 0.18, 0.28, 0.51, 0.66, 0.74.
  • Control: 0.22, 0.35, 0.64, 0.69.

For treated units, retain scores in \([0.28,0.66]\): 0.28, 0.51, and 0.66. Thus 3 of 5 treated units remain. For controls, the same intersection retains 0.35 and 0.64, so 2 of 4 controls remain. The endpoints are included because the intervals are closed.

The need for the intersection is visible at 0.69: it lies in \(G_1\), so an opposite-group-only check for this control would retain it, even though it lies outside its own group’s operational set \(G_0\). The intersection rule correctly excludes it. The same principle excludes the treated score 0.18 because it falls outside \(G_0\).

Asymmetric Sets and Unequal Retention

The two group-specific support sets can be asymmetric: they may have different lower or upper limits, or differ in shape when they are not intervals. Their intersection is determined by the region both sets share. The common score region applies to both treatment groups, but the number or proportion retained in each group can still differ because the two groups have different score distributions.

This distinction separates asymmetric support information from different retention rules by treatment arm. The first is compatible with a common restriction: construct \(G_1\cap G_0\), then apply it to both arms. The second can retain treated scores in one region and control scores in another. Unless the regions coincide, the retained treated and control units are no longer selected from one shared score-defined population. That may be a different design with a different estimand, and it should not be presented as the ordinary common-support restriction.

Worked Example: Preventing an Asymmetric-Rule Error

In another hypothetical analysis, let \(G_1=[0.10,0.72]\) and \(G_0=[0.25,0.88]\). The ranges are asymmetric, and their intersection is

$$ C_{\mathrm{op}}=[0.10,0.72]\cap[0.25,0.88]=[0.25,0.72]. $$

Suppose the observed scores are treated: 0.12, 0.25, 0.58, 0.72, 0.80; and controls: 0.15, 0.31, 0.70, 0.74, 0.86. Applying the intersection to treated units retains 0.25, 0.58, and 0.72, giving 3 of 5. Applying it to controls retains 0.31 and 0.70, giving 2 of 5.

An opposite-group-only rule would make two errors here. It would retain the treated score 0.80 because it lies in \(G_0\), although it is outside \(G_1\). It would also retain the control score 0.15 because it lies in \(G_1\), although it is outside \(G_0\). Both scores are excluded by the intersection. The example shows why operational boundaries do not justify assuming own-group membership.

The fact that 3 treated units and 2 controls remain does not mean the rule treated the groups asymmetrically: both were subject to exactly the same score interval. It means that the hypothetical samples placed different numbers of units inside that interval.

Worked Example: When the Opposite-Group Description Is Equivalent

Now suppose, as a hypothetical population model, that the exact support of \(e(X)\mid A=1\) is \(S_1=[0.20,0.80]\), and the exact support of \(e(X)\mid A=0\) is \(S_0=[0.35,0.65]\). Their intersection is \(C=[0.35,0.65]\). Consider hypothetical observed scores that lie within their own group’s exact support: treated scores 0.24, 0.40, 0.63, 0.76; control scores 0.36, 0.52, 0.64.

For the treated group, the opposite-group check asks whether each score lies in \(S_0=[0.35,0.65]\). It retains 0.40 and 0.63, or 2 of 4 treated units. For controls, the opposite-group check asks whether each score lies in \(S_1=[0.20,0.80]\). All three control scores pass, or 3 of 3.

Because every treated score in this example lies in its own exact support \(S_1\), and every control score lies in \(S_0\), these opposite-group checks produce the same retained scores as the intersection rule. This equivalence depends on the stated own-support condition. It should not be carried over automatically to estimated intervals, which may exclude observed values from their own arm.

What Population Does the Restriction Describe?

A shared score restriction defines a retained population, not merely a convenient subset of the original data. If \(C\) is the selected score region, the target population consists of units with \(e(X)\in C\). For example, a causal estimand for that restricted population can be written

$$ E\!\left[Y(1)-Y(0)\mid e(X)\in C\right], $$

where \(Y(1)\) and \(Y(0)\) are the potential outcomes under treatment and control. Interpreting an estimate as this causal effect still requires the relevant causal assumptions, including consistency and conditional exchangeability given the measured covariates. A restriction aimed at positivity does not establish those assumptions, nor does it guarantee adequate support for every covariate pattern merely because score ranges overlap.

If treated and control units instead receive different score restrictions, the retained treated units may correspond to one target population and the retained controls to another. A contrast between their outcomes does not automatically estimate the effect in either group’s retained population. The analyst must define and justify the target estimand rather than treating different arm-specific samples as interchangeable.

Diagnostics, Alternatives, and Common Pitfalls

Before using a support restriction, inspect the score distributions by treatment group and report the actual sets applied. Useful checks include confirming the interval intersection, checking endpoint inclusion, counting retained and excluded units separately by arm, and verifying that each retained score belongs to both operational sets. A table of counts by arm can reveal a mistaken implementation, although unequal counts alone do not indicate an error.

The main alternatives answer related but distinct design questions. Symmetric trimming uses a shared score rule, often specified with the same cutoff logic for both groups. Treatment-specific support sets allow the evidence about adequate coverage to differ by arm, but their intersection still supplies a common retained score region. Weighting can retain more observations while giving some observations greater influence; it does not make unsupported comparisons reliable merely by assigning weights. Outcome-model extrapolation may produce predictions in regions with little or no comparison-group data, but those predictions depend on modeling assumptions rather than observed overlap.

  • Wrong reasoning: “This control score lies in the treated support, so it must be retained.”
  • Correction: With estimated or operational sets, also check that it lies in the control set. Retain it only if it belongs to their intersection.
  • Wrong reasoning: “The intervals are asymmetric, so the restriction must retain different score ranges by arm.”
  • Correction: Asymmetric group-specific sets can define a single shared range through their intersection. Apply that range to both groups; different retained counts can result from different group distributions.
  • Wrong reasoning: “Every observed score must belong to the support range reported for its own arm.”
  • Correction: This is true almost surely for exact population supports, not necessarily for estimated boundaries or operational adequate-support sets.

Support restrictions also have limitations. Their boundaries may be uncertain, and a restriction can reduce sample size or change the population to which findings apply. A shared score range is not proof of covariate balance, adequate sample size, or causal identification. Those questions require additional diagnostics and assumptions.

Key takeaway: Define a support set for each treatment group, intersect the sets, and retain both groups only inside that common region. Opposite-group-only checks are safe only when own-group membership is guaranteed.

Check Your Understanding

Answer each question using the stated rules. Solutions follow the questions.

  1. Let \(G_1=[0.20,0.70]\) and \(G_0=[0.35,0.80]\). What is the common operational support interval, including its endpoints?
  2. A control unit has score 0.75. It lies in \(G_1=[0.20,0.80]\), but not in \(G_0=[0.30,0.70]\). Should it be retained under the intersection rule?
  3. For exact population supports \(S_1\) and \(S_0\), when is an opposite-group-only rule equivalent to the common-support rule?
  4. Both treatment groups are restricted to the same common score interval, but 60% of treated units and 30% of controls remain. Does this alone show that different rules were applied?
  5. Why does restricting to common score support not, by itself, establish a causal effect?

Solutions. (1) The intersection is \([0.35,0.70]\); both endpoints are included. (2) No. The score is outside \(G_0\), so it is not in \(G_1\cap G_0=[0.30,0.70]\), despite passing the opposite-group check. (3) It is equivalent when units are in their own exact group support almost surely, so checking membership in the other group’s support also places them in the intersection. (4) No. Applying the same interval can retain different proportions because the score distributions differ by arm. (5) The restriction addresses support in the score dimension; causal interpretation still requires assumptions such as consistency and conditional exchangeability, and score overlap does not guarantee every needed covariate pattern is supported.

Clinical Biostats