Tutorials › Marginal Structural Models › Identification of Blip Parameters Under Sequential Exchangeability

Structural Nested Models and g-Estimation · Tutorial 327 of 501

Identification of Blip Parameters Under Sequential Exchangeability

Learn how to express SNMM blip parameters as contrasts of identified counterfactual means, and when those contrasts determine a unique parameter value.

Advanced 12 min read

What You'll Learn

  • Define a longitudinal SNMM blip as a contrast between counterfactual mean outcomes under specified treatment regimes.
  • State the consistency, sequential exchangeability, and positivity assumptions used for identification.
  • Use the longitudinal g-formula to identify the counterfactual means that form blip contrasts.
  • Distinguish identification of a blip function from identification of its parameter.
  • Diagnose lack of treatment support and non-unique parameterizations.
  • Compare regime-based identification with inverse-probability weighting and identify its limits.

What It Means to Identify a Blip Parameter

A structural nested mean model (SNMM) describes how the mean outcome changes when treatment at one decision time is changed, while the rest of the treatment regime is specified. Identification asks whether the distribution of observed treatment, covariate, and outcome data determines that change. It is a population-level question, distinct from whether a particular estimator has small bias or variance.

Consider decision times \(t=1,\ldots,K\). Let \(L_t\) be the covariate history measured before treatment \(A_t\), and write \(H_t=(\bar L_t,\bar A_{t-1})\) for the observed history available at that decision. Let \(Y^{\bar a}\) denote the outcome that would be observed under treatment regime \(\bar a=(a_1,\ldots,a_K)\). Similarly, \(L_t^{\bar a_{t-1}}\) is the covariate value at time \(t\) under the preceding treatment history. The reference treatment is denoted \(0\), and \(\bar 0\) is the regime that assigns the reference treatment at every time.

Definition: For a history \(h_t=(\bar l_t,\bar a_{t-1})\), define the time-\(t\) blip for treatment level \(a_t\) as \[ \gamma_t(h_t,a_t;\psi) = E\!\left[Y^{(\bar a_{t-1},a_t,\bar 0_{t+1:K})} - Y^{(\bar a_{t-1},0,\bar 0_{t+1:K})} \mid \bar L_t^{\bar a_{t-1}}=\bar l_t \right]. \] An SNMM specifies this function using a parameter \(\psi\). The blip compares two regimes that agree through time \(t-1\), differ at time \(t\), and use reference treatment thereafter.

This definition makes the target precise: it is a conditional mean contrast for specified counterfactual regimes and a specified history. In a recursive SNMM, later blips are used to remove treatment effects from the outcome before an earlier blip is assessed. The earlier material on sequential blip-down establishes that recursive construction; here the question is whether the counterfactual means, and therefore the blips, are determined by observed data.

Assumptions and the Identification Formula

The assumptions concern the connection between observed and counterfactual data. For clarity, suppose there is no loss to follow-up; censoring would require additional assumptions and methods.

  • Consistency. If a person follows regime \(\bar a\), then the observed outcome equals \(Y^{\bar a}\), and covariates observed up to time \(t\) equal the corresponding counterfactual covariates under the treatment history actually received. The treatment versions represented by each \(a_t\) must be well defined.
  • Sequential exchangeability. At each \(t\), conditional on \(H_t\), treatment assignment is independent of the counterfactual covariates and outcomes under every regime of interest. In notation, \(A_t\) is conditionally independent of \(\{L_{s}^{\bar a_{s-1}}:s>t,\;Y^{\bar a}: \bar a\}\) given \(H_t\).
  • Positivity. For each regime and history used in the target contrast, every treatment value required by that regime has positive conditional probability given the history. For discrete treatments, this means \(P(A_t=a_t\mid H_t=h_t)>0\) on the relevant support.

For a fixed regime \(\bar a\), the longitudinal g-formula identifies its outcome mean by combining the observed covariate transition distributions under that regime with the observed outcome distribution. To make the factorization explicit, suppose the covariates and treatment are discrete. Then

$$ E[Y^{\bar a}] = \sum_{\bar l_K} E[Y\mid \bar L_K=\bar l_K,\bar A_K=\bar a]\, \prod_{t=1}^{K}P(L_t=l_t\mid \bar L_{t-1}=\bar l_{t-1},\bar A_{t-1}=\bar a_{t-1}). $$

For continuous covariates, replace the sums by integrals. Conditional regime means are identified by the corresponding conditional version of this same factorization, restricted to histories with positive probability under the specified past regime. These identified means give the blip contrast: calculate the mean under \((\bar a_{t-1},a_t,\bar 0)\), calculate it under \((\bar a_{t-1},0,\bar 0)\), and subtract.

Theorem: Under consistency, sequential exchangeability, and positivity for the regimes and histories in question, each conditional counterfactual mean in the blip definition is identified from the observed-data distribution by the longitudinal g-formula. Consequently, the blip function \(\gamma_t(h_t,a_t)\) is identified on the histories where both compared regimes have support. If the SNMM parameterization is injective on that support, its parameter \(\psi\) is identified as well.

Proof. Fix a regime \(\bar a\). By consistency, among individuals whose observed treatment history is \(\bar a\), the observed outcome and covariates equal the counterfactual outcome and covariates under that regime. Sequential exchangeability permits the conditional distribution of each next covariate under the intervention to be replaced by its observed conditional distribution given the preceding history and treatment. Positivity ensures that each such observed conditional distribution is defined for the treatment values required by \(\bar a\). Applying the law of total expectation successively over \(L_1,\ldots,L_K\) gives the displayed product formula for \(E[Y^{\bar a}]\). The same argument conditional on the past-regime history identifies the conditional means used in the blip definition, on their supported histories. Their difference is therefore identified. Finally, if two parameter values \(\psi_1,\psi_2\) yield the same blip function on that support, injectivity implies \(\psi_1=\psi_2\); thus the parameter itself is identified. \(\square\)

Worked Identification Calculations

Worked Example: A Blip at One Treatment Decision

Suppose there is one binary treatment \(A_1\), no covariates, and higher values of \(Y\) are worse. Assume treatment is randomized, so exchangeability holds, and both treatment levels occur with positive probability. The observed mean outcomes are \(E[Y\mid A_1=0]=10\) and \(E[Y\mid A_1=1]=14\). Under consistency and randomization,

\[ E[Y^{1}]=E[Y\mid A_1=1]=14,\qquad E[Y^{0}]=E[Y\mid A_1=0]=10. \]

The blip for treatment \(1\) relative to \(0\) is therefore \(14-10=4\). If the model is \(\gamma_1(1;\psi)=\psi\), then the observed-data distribution identifies \(\psi=4\). If instead the model is \(\gamma_1(1;\psi)=2\psi\), it identifies \(\psi=2\). The causal contrast is the same, but its parameter value depends on the specified parameterization.

Worked Example: Blipping at the First of Two Decisions

Let \(A_1,A_2\) be binary, and let \(L_2\) be measured between the decisions. To identify the time-1 blip with \(A_2\) set to its reference value \(0\), the relevant regime mean is

\[ E[Y^{a_1,0}] = \sum_{l_2}E[Y\mid A_1=a_1,L_2=l_2,A_2=0]\, P(L_2=l_2\mid A_1=a_1). \]

Suppose under \(A_1=0\), the probabilities of \(L_2=0,1\) are \(0.75,0.25\), and the conditional outcome means with \(A_2=0\) are \(8,16\). Then \(E[Y^{0,0}]=0.75(8)+0.25(16)=6+4=10\). Under \(A_1=1\), suppose those probabilities are \(0.25,0.75\), and the corresponding means are \(12,20\). Then \(E[Y^{1,0}]=0.25(12)+0.75(20)=3+15=18\). The time-1 blip contrast in this example is \(18-10=8\).

The covariate distribution is treatment-specific. Using the \(L_2\) distribution from one treatment group for both regimes would not calculate either regime mean correctly.

Worked Example: When the Parameter Is Not Identified

Suppose a binary treatment is observed only at \(A_1=0\): \(P(A_1=1)=0\). An analyst proposes the linear blip model \(\gamma_1(1;\psi)=\psi\), but the data contain no outcomes under treatment \(1\). The observed distribution can determine \(E[Y^0]\), but it cannot determine \(E[Y^1]\). For example, two causal models can agree on every observed value when \(A_1=0\), while one sets \(E[Y^1]=E[Y^0]+2\) and the other sets \(E[Y^1]=E[Y^0]+9\). Both are compatible with these observed data, yet they imply \(\psi=2\) and \(\psi=9\), respectively. Positivity fails, so neither the blip nor its parameter is identified without additional assumptions.

Even with positivity, the parameter can fail to be unique. If a model is \(\gamma_1(1;\psi)=\psi^2\), and the identified contrast is \(4\), then both \(\psi=2\) and \(\psi=-2\) produce the same blip. The function is identified, but the signed parameter is not, unless the parameter space or model is restricted to make the mapping injective.

What the Assumptions Do—and Do Not—Guarantee

The theorem separates three distinct obstacles. Consistency connects the observed outcome to the counterfactual outcome for the treatment actually received. Sequential exchangeability rules out unmeasured confounding conditional on the recorded history. Positivity ensures the data include the treatment choices needed to learn each regime-specific quantity. None of these assumptions alone is enough: exchangeability does not supply outcomes for a treatment level that never occurs, and positivity does not eliminate confounding.

There are two further qualifications. First, identification is only on the relevant history support. If a history can occur under one past regime but not another, the conditional contrast at that history may not be identified for both regimes. Second, identification of the entire blip function is not automatically identification of a finite-dimensional parameter. The map from \(\psi\) to \(\gamma_t(\cdot;\psi)\) must distinguish parameter values on the observed support. A model whose covariate modifier varies only outside that support cannot identify its coefficient.

A useful alternative route is the inverse-probability-weighted marginal structural model (MSM), which reweights observations to represent treatment regimes. The g-formula directly models covariate transitions and outcomes; weighting instead models treatment probabilities. Both rely on appropriate exchangeability and positivity conditions, and both can be unstable when treatment probabilities are near zero. The present argument identifies the regime means and blip contrasts; it does not choose an estimator or derive the g-estimation moment conditions.

In practice, inspect estimated treatment probabilities and regime-specific history counts. Empty or sparse treatment-history combinations are warnings about positivity, not merely inconveniences for computation. Large standard errors or extreme weights can indicate weak practical support. Diagnostics cannot prove exchangeability, which is an assumption about unmeasured causes, and a well-fitting model cannot repair a structural lack of support. Parametric extrapolation can produce a number where positivity fails, but that number is supplied by the extrapolation assumptions rather than identified nonparametrically from the observed data.

Common Pitfall

Wrong reasoning: “The observed treatment groups have different mean outcomes, so the difference identifies the blip.” This conclusion generally ignores both time-varying covariates and treatment assignment. A raw group difference need not compare the same history distribution, and treatment groups may differ because of confounding.

Correction: First specify the two regimes in the blip contrast. Then identify each regime-specific conditional mean using consistency, sequential exchangeability, and positivity—for example, through the longitudinal g-formula—and take their difference. Finally, check that the proposed SNMM maps this function to one unique parameter value on the supported histories.

Key takeaway: Under consistency, sequential exchangeability, and positivity, the longitudinal g-formula identifies the counterfactual means that define an SNMM blip. A blip parameter is identified only when its model is also uniquely determined by the blip function on the relevant support.

Check Your Understanding

For each question, give the requested conclusion before checking the short solution.

  1. In a one-decision study, treatment is randomized, both treatment levels occur, and the observed means are 7 under \(A=0\) and 11 under \(A=1\). What is the blip for \(A=1\) versus \(A=0\)?
  2. In a two-decision study, why must the distribution of an intermediate covariate be allowed to differ across the two first-stage treatment regimes when calculating their outcome means?
  3. What assumption fails if some histories have zero probability of receiving a treatment required by the target regime?
  4. An identified blip contrast is 6, and the model is \(\gamma(1;\psi)=3\psi\). Is \(\psi\) identified, and what is its value?
  5. An identified contrast is 9 and the model is \(\gamma(1;\psi)=\psi^2\), with unrestricted real \(\psi\). Is the parameter uniquely identified?

Solutions. (1) The blip is \(11-7=4\), by randomization and consistency. (2) The intermediate covariate distribution is part of the regime-specific data-generating process; the g-formula averages the conditional outcome means over the distribution induced by each regime. (3) Positivity fails, so the required regime mean is not identified nonparametrically from the observed data. (4) Yes: \(3\psi=6\), hence \(\psi=2\). (5) No: \(\psi^2=9\) has solutions \(\psi=3\) and \(\psi=-3\); an additional restriction is needed for unique parameter identification.

Clinical Biostats