Tutorials › Marginal Structural Models › Positivity at Each Treatment Decision

Sequential Exchangeability, Consistency and Positivity · Tutorial 47 of 501

Positivity at Each Treatment Decision

Learn to assess whether every treatment level required by a fixed regime is supported at each decision for the histories that can arise under that regime.

Intermediate 10 min read

What You'll Learn

  • Define the history available at each discrete treatment decision and the histories reachable under a fixed regime.
  • State sequential positivity using treatment probabilities conditional on each reachable history.
  • Check positivity separately at baseline and at later treatment decisions.
  • Distinguish a zero-probability treatment level from a history that cannot arise under the regime.
  • Explain why a zero treatment probability prevents nonparametric identification of the corresponding counterfactual mean.
  • Recognize why overall treatment frequencies and regression extrapolation do not establish positivity.

Why Positivity Is a Decision-by-Decision Requirement

A treatment regime specifies what treatment is to be assigned at each decision time. To learn the outcome that would result under that regime from observed data, the data must include people who could receive each prescribed treatment at the histories the regime can produce. It is not enough that each treatment occurs somewhere in the study: a treatment may be common overall and absent among people with a particular history.

This requirement is called sequential positivity. It is about the support of treatment assignment at each decision, conditional on the history available then. It is distinct from exchangeability: exchangeability concerns whether treatment assignment is confounded after conditioning on history, whereas positivity concerns whether the required assignment occurs at all.

Definition: Consider discrete treatment decisions at times \(t=0,\ldots,K\). Let \(A_t\) be treatment at time \(t\), and let \(H_t\) be the observed history available immediately before that decision. For example, \(H_0=L_0\), and \(H_t=(L_0,A_0,L_1,\ldots,A_{t-1},L_t)\) for \(t\geq 1\). A fixed regime is \(g=(a_0,\ldots,a_K)\). Write \(H_t^g\) for the history that would be available at time \(t\) under the regime’s prescribed treatments up to that time. Sequential positivity for \(g\) requires

\(P(A_t=a_t\mid H_t=h)>0\)

at each time \(t\), for every history \(h\) with \(P(H_t^g=h)>0\). The conditional treatment probability is understood on histories in the observed support. Thus, the requirement concerns histories that can occur under the regime, not every logically imaginable history.

For a discrete history \(h\), the condition can be checked by inspecting the relevant conditional probability in the population treatment-assignment law. At baseline, check \(P(A_0=a_0\mid L_0=l_0)\) for baseline values that occur under the regime. At a later decision, check \(P(A_t=a_t\mid H_t=h)\) among histories reachable after the regime’s earlier prescribed treatments. Each time has its own condition; a positive probability at one decision does not establish support at another.

This tutorial focuses on a fixed regime and discrete histories. It does not require the prescribed treatment to be equally likely across histories, nor does it require every possible treatment to occur at every history. Only the level prescribed by the regime must have positive probability at histories the regime can produce.

Checking Support in Concrete Examples

Worked Example: A One-Decision Regime

Suppose the baseline covariate \(L_0\) is binary, with \(P(L_0=0)=0.6\) and \(P(L_0=1)=0.4\). A fixed regime prescribes \(A_0=1\). The treatment probabilities are \(P(A_0=1\mid L_0=0)=0.70\) and \(P(A_0=1\mid L_0=1)=0.25\). Does the regime satisfy positivity?

Both baseline values occur under the regime because treatment at time 0 does not change the baseline distribution, and both probabilities are positive. The required checks are therefore \(P(A_0=1\mid L_0=0)=0.70>0\) and \(P(A_0=1\mid L_0=1)=0.25>0\). The regime satisfies positivity at its only treatment decision. The fact that treatment 1 is less common among people with \(L_0=1\) does not violate positivity: its conditional probability is still positive.

For a check on the arithmetic, the observed probabilities of the two baseline-and-treatment combinations are \(P(L_0=0,A_0=1)=0.6(0.70)=0.42\) and \(P(L_0=1,A_0=1)=0.4(0.25)=0.10\). Both combinations have positive probability, as required.

Worked Example: Checking Reachable Histories at a Later Decision

Consider two treatment decisions, \(A_0\) and \(A_1\), with an intermediate binary covariate \(L_1\). Let \(P(L_0=0)=0.75\) and \(P(L_0=1)=0.25\). The regime is \(g=(1,0)\). Under \(A_0=1\), suppose \(P(L_1=1\mid L_0=0,A_0=1)=0.25\) and \(P(L_1=1\mid L_0=1,A_0=1)=0.80\). At time 1, suppose the probabilities of the prescribed treatment \(A_1=0\) are \(0.60,0.40,0.30,0.20\), respectively, at histories \((L_0,L_1)=(0,0),(0,1),(1,0),(1,1)\), with \(A_0=1\) in each history. Check positivity.

At time 0, the regime’s reachable baseline values have probabilities \(0.75\) and \(0.25\), both positive. Positivity at that decision requires \(P(A_0=1\mid L_0=0)>0\) and \(P(A_0=1\mid L_0=1)>0\). Suppose these probabilities are \(0.50\) and \(0.70\); both checks pass.

Next calculate the probabilities of the four histories under the regime. For \((L_0,L_1)=(0,0)\), the probability is \(0.75(1-0.25)=0.5625\). For \((0,1)\), it is \(0.75(0.25)=0.1875\). For \((1,0)\), it is \(0.25(1-0.80)=0.05\). For \((1,1)\), it is \(0.25(0.80)=0.20\). These probabilities are nonnegative and sum to \(0.5625+0.1875+0.05+0.20=1\).

All four histories are reachable, so all four specified conditional probabilities for \(A_1=0\) must be checked. Each is positive: \(0.60, 0.40, 0.30,\) and \(0.20\). The regime satisfies positivity at time 1 as well as time 0.

The within-history calculations matter. For example, the history \((L_0=0,L_1=1)\) is reachable because \(P(L_0=0)=0.75>0\) and \(P(L_1=1\mid L_0=0,A_0=1)=0.25>0\). A positive marginal probability of \(L_1=1\) alone would not establish that this particular history is reachable.

Worked Example: A Treatment Failure at One Reachable History

Use the same baseline distribution and intermediate-covariate probabilities as in the previous example, and keep the regime \(g=(1,0)\). Now suppose \(P(A_1=0\mid L_0=0,L_1=1,A_0=1)=0\), while the other three time-1 probabilities remain positive.

The history \((L_0=0,L_1=1)\) has regime probability \(0.75(0.25)=0.1875>0\). It must therefore be included in the time-1 check. But the prescribed treatment has probability zero at that history. Sequential positivity fails, even if \(A_1=0\) is common in the study overall and even if it occurs at each of the other three histories.

By contrast, if a history had probability zero under the regime, its treatment probability would not be required for this fixed regime. A condition on an unreachable history cannot create a support failure for the regime being assessed.

Two Consequences of the Condition

The first consequence is that positivity lets the observed assignment process include the prescribed treatment at each reachable decision. More precisely, in a finite discrete setting, positive treatment probabilities at the successive reachable histories ensure positive probability for each regime-compatible observed trajectory that has positive probability under the regime’s covariate process.

Result: Suppose the histories and covariate values are discrete, the regime is fixed, and the conditional covariate-transition probabilities under the regime agree with those in the observed process at histories supported by the prescribed treatment prefix. If a regime-compatible covariate history has positive probability under \(g\), and the prescribed treatment has positive probability at each decision along its prefix, then the corresponding observed trajectory has positive probability.

To see this, take a trajectory \((l_0,a_0,l_1,a_1,\ldots,l_K,a_K)\) compatible with \(g\). Its observed probability factors by the chain rule as

$$ P(L_0=l_0) \prod_{t=0}^{K} \left[ P(A_t=a_t\mid H_t=h_t)\, P(L_{t+1}=l_{t+1}\mid H_t=h_t,A_t=a_t) \right], $$

where the final covariate-transition factor is omitted when there is no \(L_{K+1}\). A positive-probability trajectory under \(g\) has a positive baseline factor and positive covariate-transition factors along that trajectory. Sequential positivity makes each treatment factor positive. The product of these finitely many positive factors is positive, proving the result.

A second consequence explains why a zero probability is more than a technical inconvenience. If a treatment is never observed at a reachable history, the observed data cannot determine the outcome that would have followed that treatment at that history without additional assumptions.

Result: If \(P(H_t=h)>0\) but \(P(A_t=a_t\mid H_t=h)=0\), then the observed-data distribution alone does not nonparametrically identify the conditional mean of the potential outcome under treatment \(a_t\) at that history.

For a direct proof, consider one decision, a history stratum \(H=h\) with positive probability, and binary outcomes. Suppose treatment \(a\) is never given in that stratum. Construct two causal models with exactly the same observed data: in the first, set the unobserved potential outcome \(Y^a=0\) for everyone with \(H=h\); in the second, set \(Y^a=1\) for everyone in that stratum. Keep all other potential outcomes and the treatment assignment mechanism the same. Since no one with \(H=h\) receives \(a\), consistency implies that \(Y^a\) is never observed there. The two models therefore induce the same observed-data distribution, yet their conditional means \(E[Y^a\mid H=h]\) are 0 and 1. The observed data cannot distinguish them, so that mean is not nonparametrically identified. \(\square\)

Practical Assessment and Common Pitfalls

In practice, assess positivity by organizing the check around decision times and the regime’s reachable histories. For each decision, list the prescribed treatment level and the histories that can arise under the earlier regime assignments. Then examine the corresponding conditional assignment probabilities. In a sample, empty cells are a warning sign, but a nonempty cell by itself does not prove that the population probability is positive.

  • Overall frequencies are not enough. A treatment can have a substantial marginal frequency and still have probability zero at a particular reachable history.
  • Do not infer a specific history from a marginal covariate probability. To establish reachability, verify the relevant conditional probabilities along the history, not merely that each covariate value occurs somewhere.
  • Do not test irrelevant histories. The fixed regime requires support at histories it can produce, not at every combination of values one can write down.
  • Regression extrapolation is not observed support. A fitted model may return a predicted outcome for an unsupported treatment-history combination, but that prediction relies on modeling assumptions rather than data support there.

The main alternative to a history-specific check is to look only at marginal treatment proportions or to rely on an outcome model to extend across empty treatment-history cells. Neither establishes sequential positivity. The former can miss conditional zero probabilities; the latter may produce estimates only through extrapolation. Positivity is a property of the treatment-assignment distribution relative to the regime, not a guarantee that any particular estimation method will behave well.

Finally, distinguish a structural zero from an apparent sample zero. A population probability may be positive even when a finite study happens to contain no treated individuals in a small history stratum. That sample pattern signals uncertainty about support, but it does not by itself prove population positivity or its failure. Conversely, a genuinely zero population probability violates the condition regardless of sample size. Very small positive probabilities also deserve attention because they can make estimates unstable, even though they do not violate the strict mathematical condition.

Check Your Understanding

For each question, first decide which histories are reachable under the stated regime. Then compare your reasoning with the solutions.

  1. At a single decision, \(P(L_0=0)=0.4\), \(P(L_0=1)=0.6\), and the regime prescribes \(A_0=1\). The conditional probabilities are 0.2 and 0. Is positivity satisfied?
  2. Under a two-decision regime, a history has probability 0.3 under the regime and the prescribed treatment probability there is 0. What does this imply?
  3. Suppose \(P(L_0=0)=0.5\) and \(P(L_1=1\mid L_0=0,A_0=a_0)=0\). Is the history \((L_0=0,L_1=1)\) reachable under a regime prescribing \(A_0=a_0\)?
  4. Why does a positive marginal probability of treatment \(A_1=1\) not establish sequential positivity for a regime prescribing \(A_1=1\)?
  5. In a reachable history stratum, no one receives the regime-prescribed treatment. Why can the observed data not, by themselves, determine the corresponding conditional potential-outcome mean?

Solutions. (1) No. Both baseline values occur, and the prescribed treatment probability is zero when \(L_0=1\). (2) Positivity fails at that decision because the history is reachable but the required treatment has zero probability. (3) No. The conditional probability of the required intermediate covariate value is zero, so this particular history has zero probability under the regime. (4) The marginal probability may come entirely from other histories; positivity requires a positive conditional probability at each reachable history. (5) The potential outcome under that treatment is never observed in the stratum. Two models can agree on all observed data while assigning different values to that unobserved potential outcome, so its conditional mean is not nonparametrically identified.

Clinical Biostats