Tutorials › Marginal Structural Models › Sequentially Randomized Treatment as a Reference Case

Sequential Exchangeability, Consistency and Positivity · Tutorial 62 of 501

Sequentially Randomized Treatment as a Reference Case

Learn why sequential randomization provides a clear reference case for exchangeability, and how consistency and positivity complete the conditions for interpreting regime-specific outcomes.

Intermediate 11 min read

What You'll Learn

  • Define sequential exchangeability using treatment histories and potential outcomes.
  • Show how conditional randomization implies exchangeability at each decision.
  • Distinguish a probability along one history path from a treatment-sequence probability averaged over histories.
  • State the consistency and positivity conditions needed alongside exchangeability.
  • Derive the regime-specific mean under these assumptions and recognize common failures.

Why Sequential Randomization Is a Reference Case

In a longitudinal study, treatment may be assigned more than once. At each decision, the assignment can depend on information already recorded, such as a participant’s current health. A trial that randomizes treatment conditional on that recorded history is a useful reference case: it shows precisely what sequential exchangeability means when assignment is controlled by design rather than inferred from observational data.

Randomization at each decision does not by itself guarantee that every causal comparison is identified. The treatments must have well-defined versions, observed outcomes must correspond to the potential outcomes for the treatments actually received, and the design must give relevant treatment options positive probability at the histories where they are needed. These are the roles of consistency and positivity.

Definition: Consider decisions at times \(t=0,\ldots,K\). Let \(A_t\) be treatment at time \(t\), and let \(L_t\) be covariates measured before that decision. Write \(\bar A_t=(A_0,\ldots,A_t)\), \(\bar L_t=(L_0,\ldots,L_t)\), and \(H_t=(\bar L_t,\bar A_{t-1})\), with \(H_0=L_0\). For a fixed treatment sequence \(\bar a=(a_0,\ldots,a_K)\), let \(Y^{\bar a}\) denote the outcome that would occur under that sequence. Sequential exchangeability requires, for each \(t\) and each \(\bar a\), that \(A_t\) be conditionally independent of the relevant potential outcomes under \(\bar a\), given \(H_t\) and the past treatment history \(\bar A_{t-1}=\bar a_{t-1}\). The condition is required at histories with positive probability under the regime being considered.

The relevant potential outcomes include \(Y^{\bar a}\) and, when covariates evolve over time, future covariates under the specified past treatment sequence. This matters because a later treatment may be randomized conditional on a covariate affected by earlier treatment. The randomization condition is therefore local to each decision: treatment is independent of relevant future potential outcomes after conditioning on what is known at that decision.

How the Design Implies Exchangeability

Suppose that at each decision the trial uses a randomization mechanism whose probabilities may depend on \(H_t\), but whose random draw is independent of the relevant potential outcomes conditional on \(H_t\) and the past treatment history. In particular, an adaptive design can assign different probabilities to different recorded histories. It remains randomized as long as its random draw does not use unrecorded information about the potential outcomes.

Theorem: If, at each time \(t\), treatment is generated using a randomization draw independent of the relevant potential outcomes conditional on the recorded history and past treatment, then sequential exchangeability holds at that decision. For a treatment value \(a_t\), the assignment probability is \(g_t(a_t\mid h_t)=P(A_t=a_t\mid H_t=h_t,\bar A_{t-1}=\bar a_{t-1})\).

Proof. Fix a decision time \(t\), a history \(h_t\), and a past treatment sequence \(\bar a_{t-1}\). Let \(Q_t\) denote the vector of relevant potential outcomes. The randomization assumption says that, conditional on this history and past treatment, the assignment draw is independent of \(Q_t\). Since \(A_t\) is generated from that draw and the recorded history, its conditional distribution does not depend on \(Q_t\). Thus, for every treatment value \(a_t\) and every measurable set \(B\),

$$ P(A_t=a_t,Q_t\in B\mid H_t=h_t,\bar A_{t-1}=\bar a_{t-1}) = g_t(a_t\mid h_t)\, P(Q_t\in B\mid H_t=h_t,\bar A_{t-1}=\bar a_{t-1}). $$

This factorization is conditional independence, which proves the required exchangeability statement. The argument applies at each decision, not just at baseline. \(\square\)

Worked Example: Averaging Over Histories in a Two-Decision Design

Suppose baseline is fixed, \(P(A_0=1)=0.5\), and among participants with \(A_0=1\), the covariate \(L_1\) equals 0 or 1 with probability 0.5 each. At the second decision, the design assigns \(A_1=1\) with probability 0.1 if \(L_1=0\), and with probability 0.9 if \(L_1=1\). Assume both decisions use random draws independent of the relevant potential outcomes conditional on the recorded history.

At the second decision, the assignment probability is history-specific: it is 0.1 on the \(L_1=0\) path and 0.9 on the \(L_1=1\) path. The probability of the treatment sequence \((A_0,A_1)=(1,1)\), however, averages over the possible \(L_1\) histories among those with \(A_0=1\):

$$ P(A_0=1,A_1=1) =0.5\{0.5(0.1)+0.5(0.9)\} =0.5(0.5) =0.25. $$

Multiplying probabilities along the \(L_1=1\) path gives \(0.5(0.9)=0.45\), while the \(L_1=0\) path gives \(0.5(0.1)=0.05\). Neither is the marginal sequence probability. The design provides sequential randomization on each path; it does not make a single path-specific product equal the probability of the sequence after averaging over histories.

Consistency and Positivity Are Additional Conditions

Sequential exchangeability concerns how treatment is assigned relative to potential outcomes. Two further conditions connect that assignment process to causal quantities defined for treatment regimes.

Definition: Consistency requires that if a participant’s observed treatment history is \(\bar A=\bar a\), then the observed outcome equals \(Y^{\bar a}\). For time-varying covariates, the corresponding observed covariate values must also equal their potential values under the observed past treatment history. Consistency presumes that the treatment versions represented by each \(a_t\) are sufficiently well defined for these potential outcomes to be meaningful.
Definition: Sequential positivity for a regime \(\bar a\) requires \(g_t(a_t\mid h_t)>0\) at every history \(h_t\) that can arise with positive probability under that regime, for each decision \(t\). The condition is about support along regime-relevant histories, not merely whether each treatment occurs somewhere in the study.

For randomized studies, positivity is often built into the design by assigning every relevant option a nonzero probability at each eligible history. But a design that deterministically assigns treatment for some histories does not meet positivity for a regime that requests the opposite treatment there. Consistency can also fail even in a randomized study if a treatment label combines versions that have different effects and are not specified by the intervention.

Worked Example: Randomization, Exchangeability, and a Regime Mean

At baseline, half the participants have \(L_0=0\) and half have \(L_0=1\). A trial randomizes \(A_0\) with probability 0.5 in either group. Under the regime \(A_0=1\), suppose the potential outcome means are \(E[Y^1\mid L_0=0]=4\) and \(E[Y^1\mid L_0=1]=10\). Assume consistency and the randomization condition above.

Because randomization is independent of the potential outcome conditional on \(L_0\), exchangeability gives \(E[Y^1\mid L_0=l,A_0=1]=E[Y^1\mid L_0=l]\). Consistency then identifies each conditional potential-outcome mean from observed outcomes among those assigned \(A_0=1\). Positivity holds because the treatment probability is 0.5 in both groups. The regime mean is therefore

$$ E[Y^1] =0.5(4)+0.5(10) =2+5 =7. $$

The calculation averages over the baseline distribution, which is the same under this baseline intervention. It does not average the two conditional means equally because the treatment was randomized; it does so because the two baseline groups each have probability 0.5.

Deriving a Regime Mean

The connection between the assumptions and identification can be seen directly in a discrete-data setting. Suppose the covariates and treatments have finite support, there is no loss to follow-up, and the regime \(\bar a\) has sequential positivity. Let \(p(l_0)\) denote the baseline covariate mass function and \(p(l_{t+1}\mid \bar l_t,\bar a_t)\) the observed covariate transition distribution under the indicated treatment history.

Result: Under consistency, sequential exchangeability, and sequential positivity, the mean potential outcome under \(\bar a\) is
$$ E[Y^{\bar a}] = \sum_{\bar l_K} E[Y\mid \bar L_K=\bar l_K,\bar A_K=\bar a]\, p(l_0) \prod_{t=0}^{K-1}p(l_{t+1}\mid \bar l_t,\bar a_t). $$

Derivation. First condition on the covariate history that would occur under the regime. By the law of total expectation,

$$ E[Y^{\bar a}] =\sum_{\bar l_K}E[Y^{\bar a}\mid \bar L_K^{\bar a_{K-1}}=\bar l_K]\, P(\bar L_K^{\bar a_{K-1}}=\bar l_K). $$

At each time, exchangeability says that among people with the specified observed history, treatment assignment does not select people on the relevant potential covariates or outcome. Consistency equates those potential values with observed values for people who followed the corresponding treatment history. Positivity ensures that the conditional observed distributions used in this substitution exist for each regime-relevant history. Applying these facts successively, the regime covariate-history probability becomes

$$ P(\bar L_K^{\bar a_{K-1}}=\bar l_K) =p(l_0)\prod_{t=0}^{K-1}p(l_{t+1}\mid \bar l_t,\bar a_t), $$

and the conditional mean of the final potential outcome becomes \(E[Y\mid \bar L_K=\bar l_K,\bar A_K=\bar a]\). Substitution yields the displayed result. This derivation uses the finite-support assumption to write sums; with continuous covariates, the corresponding expression uses integrals and conditional densities. \(\square\)

Worked Example: A Two-Decision Regime Mean

Consider a regime that sets \(A_0=1\) and \(A_1=1\). Suppose \(L_0=0\) with probability 0.6 and \(L_0=1\) with probability 0.4. Under \(A_0=1\), let \(L_1=1\) have probability 0.25 when \(L_0=0\), and probability 0.75 when \(L_0=1\). Assume the conditional outcome means under the full regime are 5 for \((L_0,L_1)=(0,0)\), 9 for \((0,1)\), 7 for \((1,0)\), and 11 for \((1,1)\).

The history probabilities under the regime are \(P(0,0)=0.6(0.75)=0.45\), \(P(0,1)=0.6(0.25)=0.15\), \(P(1,0)=0.4(0.25)=0.10\), and \(P(1,1)=0.4(0.75)=0.30\). They sum to \(0.45+0.15+0.10+0.30=1\). The regime mean is

$$ E[Y^{(1,1)}] =0.45(5)+0.15(9)+0.10(7)+0.30(11) =2.25+1.35+0.70+3.30 =7.60. $$

This calculation uses covariate transitions under the imposed treatment history. Replacing those transitions with their overall observed distributions would generally give a different answer if earlier treatment affects later covariates.

Common Pitfalls and Practical Checks

A randomized design is a reference case, not a label that automatically validates every causal analysis. The design must randomize the treatment actually used in the causal question, and its assignment probabilities must support the regime of interest.

  • Confusing conditional and marginal probabilities. A product of assignment probabilities along one specified history is a path-specific probability. The sequence probability conditional only on baseline averages over intermediate histories, as in the first worked example.
  • Calling baseline randomization sufficient for every later decision. Later assignments can be associated with potential outcomes if clinicians choose treatment using evolving prognostic information. Exchangeability must hold at each decision, conditional on the recorded history.
  • Ignoring treatment versions. If “treatment” includes materially different doses or delivery methods, consistency for that broad label may not hold. Define the intervention precisely enough that the potential outcome is well specified.
  • Checking support only in the whole sample. A treatment may occur often overall but never occur for a particular relevant history. That is a local positivity failure for regimes requiring that treatment at that history.

In practice, inspect the design protocol and the recorded history used at every randomization, verify that the treatment definition matches the causal question, and tabulate or model assignment probabilities by relevant history. In observational studies, these same assumptions must be defended from substantive knowledge and data; they do not follow from an observed association pattern. Positivity diagnostics can reveal sparse or unsupported histories, but no diagnostic alone establishes exchangeability or consistency.

Check Your Understanding

Answer each question, then compare with the brief solutions below.

  1. A trial randomizes \(A_1\) using \(L_1\), with both treatment options possible at every relevant \(L_1\) value. What conditional independence is central to sequential exchangeability at time 1?
  2. Why can the probability of a treatment sequence conditional on baseline differ from the product of assignment probabilities evaluated along one intermediate-covariate path?
  3. A treatment is randomized, but “treatment” combines two versions with potentially different effects. Which assumption is in question, and why?
  4. Among participants with a particular regime-relevant history, the requested treatment has probability zero. Which condition fails?

Solutions. (1) Conditional on the recorded history and prior treatment, \(A_1\) must be independent of the relevant potential outcomes under the regime. (2) The conditional-baseline sequence probability averages the path-specific products over the distribution of intermediate histories; a single path gives only one component. (3) Consistency is in question because the treatment label may not define a unique intervention version and corresponding potential outcome. (4) Sequential positivity fails at that history, so the observed data do not support the requested treatment there.

Clinical Biostats