Tutorials › Marginal Structural Models › Why Baseline Adjustment Misses Evolving Confounding

Time-Varying Treatments and Confounder Feedback · Tutorial 3 of 501

Why Baseline Adjustment Misses Evolving Confounding

Learn why updated patient status can confound later treatment even within baseline strata, and how to diagnose the resulting failure of baseline-only adjustment.

Intermediate 10 min read

What You'll Learn

  • Distinguish baseline covariates from updated status measured before a later treatment decision.
  • State the assumptions under which adjustment for treatment history and updated status identifies a conditional treatment contrast.
  • Derive how differences in updated-status distributions can create a baseline-adjusted association when treatment has no effect.
  • Calculate baseline-adjusted contrasts in binary examples, including within baseline strata.
  • Recognize diagnostics for residual confounding and the limits of baseline-only adjustment.

Why Baseline Information Can Become Out of Date

At the start of follow-up, baseline covariates may describe patients well enough to compare treatment decisions. But a later decision is made after patients have changed: symptoms may have worsened, a laboratory measure may have shifted, or a new complication may have appeared. If that updated status helps determine treatment and also predicts the outcome, patients receiving different later treatments are not comparable merely because their baseline covariates match.

The issue is not that baseline covariates are useless. They can be important predictors of treatment and outcome. The problem is that baseline adjustment cannot account for differences in a relevant covariate that arises or is measured later. The following argument isolates this issue at the later treatment decision.

Definition: Let \(L_0\) denote baseline covariates, \(A_0\) an earlier treatment, \(L_1\) patient status measured before the later treatment decision, \(A_1\) that later treatment, and \(Y\) the outcome. Write \(B=(L_0,A_0)\) for baseline information and prior treatment history held fixed. Baseline-only adjustment compares later treatment groups conditional on \(B\), but does not also account for \(L_1\). A later treatment is confounded by \(L_1\), within levels of \(B\), when \(L_1\) is associated with both \(A_1\) and the outcome that would be observed under a specified value of \(A_1\).

Holding \(A_0\) fixed in \(B\) makes the point precise: any failure below is not simply due to comparing different earlier treatment histories. Let \(Y^a\) denote the outcome that would be observed if the later treatment were set to \(a\), for \(a\in\{0,1\}\). A common identification condition at this decision is conditional exchangeability, \(Y^a\perp A_1\mid (B,L_1)\), together with consistency and positivity. Consistency means that \(Y=Y^a\) for a person with \(A_1=a\); positivity means that each treatment value has positive probability within covariate histories being compared. These conditions do not imply exchangeability given \(B\) alone.

How Updated Status Produces a Baseline-Adjusted Association

The next result spells out the source of the association. It uses discrete \(L_1\) for a transparent sum; with continuous covariates, the same argument uses conditional expectations and integrals, provided the relevant expectations exist.

Result: Suppose consistency holds and \(Y^a\perp A_1\mid(B,L_1)\). For a fixed history \(B=b\), define \(m_a(b,l)=E[Y^a\mid B=b,L_1=l]\). Then
$$ E[Y\mid A_1=a,B=b] = \sum_l m_a(b,l)P(L_1=l\mid A_1=a,B=b). $$

Consequently, if the later treatment has no effect within these histories, so that \(m_1(b,l)=m_0(b,l)=m(b,l)\), then the baseline-adjusted contrast is

$$ E[Y\mid A_1=1,B=b]-E[Y\mid A_1=0,B=b] = \sum_l m(b,l)\left\{P(L_1=l\mid A_1=1,B=b)-P(L_1=l\mid A_1=0,B=b)\right\}. $$

Proof. For either treatment value \(a\), consistency gives \(Y=Y^a\) among those with \(A_1=a\). Conditional exchangeability gives \(E[Y^a\mid A_1=a,B=b,L_1=l]=E[Y^a\mid B=b,L_1=l]=m_a(b,l)\). Averaging this conditional mean over the distribution of \(L_1\) among people with \(A_1=a,B=b\), by the law of total expectation, yields the first equation. Subtracting the equation for \(a=0\) from the one for \(a=1\), and setting both conditional means equal to \(m(b,l)\) under the no-effect condition, yields the second equation. \(\square\)

The equation shows why a baseline-adjusted contrast can be nonzero even when treatment has no effect: the two treatment groups can contain different mixes of updated patient status, and that status can predict \(Y\). It also gives two sufficient ways this particular source of bias disappears: either the distribution of \(L_1\) is the same across later treatment groups within \(B\), or the outcome mean \(m(b,l)\) does not vary with \(l\). Neither condition follows merely from having measured and adjusted for \(L_0\).

Worked Examples

Worked Example: A Prognostic Status Drives the Later Decision

Suppose \(L_0\) and \(A_0\) are constant in the study, \(P(L_1=1)=0.5\), and later treatment is more likely when status is poor: \(P(A_1=1\mid L_1=1)=0.8\) and \(P(A_1=1\mid L_1=0)=0.2\). Let the outcome be \(Y=L_1\), regardless of treatment. Thus treatment has no effect, while the updated status perfectly predicts the outcome.

First calculate the treatment prevalence: \(P(A_1=1)=0.5(0.8)+0.5(0.2)=0.5\). Among treated patients, \(P(L_1=1,A_1=1)=0.5(0.8)=0.4\), so \(P(L_1=1\mid A_1=1)=0.4/0.5=0.8\). Among untreated patients, \(P(L_1=1,A_1=0)=0.5(0.2)=0.1\), and \(P(A_1=0)=0.5\), so \(P(L_1=1\mid A_1=0)=0.1/0.5=0.2\).

Because \(Y=L_1\), the observed outcome means are \(E[Y\mid A_1=1]=0.8\) and \(E[Y\mid A_1=0]=0.2\). The baseline-adjusted contrast is therefore \(0.8-0.2=0.6\), despite the true treatment effect being zero for every patient. Adjustment for the constant baseline covariates changes nothing. The association comes from the different distributions of \(L_1\).

Worked Example: Baseline Stratification Still Leaves the Difference

Now let \(L_0\) have two equally common levels, \(0\) and \(1\). Within each level, suppose \(P(L_1=1\mid L_0=0)=0.25\) and \(P(L_1=1\mid L_0=1)=0.75\). In both strata, treatment probabilities are \(0.8\) if \(L_1=1\) and \(0.2\) if \(L_1=0\). Again let \(Y=L_1\), with no treatment effect.

For \(L_0=0\), the treated proportion is \(0.25(0.8)+0.75(0.2)=0.35\). Hence \(P(L_1=1\mid A_1=1,L_0=0)=0.25(0.8)/0.35=0.2/0.35=4/7\). The untreated proportion is \(0.25(0.2)+0.75(0.8)=0.65\), giving \(P(L_1=1\mid A_1=0,L_0=0)=0.25(0.2)/0.65=0.05/0.65=1/13\). The within-stratum outcome contrast is \(4/7-1/13=45/91\), about \(0.495\).

For \(L_0=1\), the treated proportion is \(0.75(0.8)+0.25(0.2)=0.65\), so the treated status probability is \(0.75(0.8)/0.65=0.6/0.65=12/13\). The untreated proportion is \(0.75(0.2)+0.25(0.8)=0.35\), so the untreated status probability is \(0.75(0.2)/0.35=0.15/0.35=3/7\). The contrast is \(12/13-3/7=45/91\), again about \(0.495\).

With equal baseline-stratum weights, standardizing these contrasts to the baseline distribution gives \(\{(45/91)+(45/91)\}/2=45/91\). Thus adjustment for \(L_0\) has been performed within every stratum and still leaves a substantial association. The unadjusted baseline status mix differs across treatment groups inside each stratum.

Worked Example: Conditioning on Updated Status Removes This Particular Contrast

Return to the first example. Within \(L_1=1\), everyone has \(Y=1\), whether \(A_1=1\) or \(A_1=0\). Within \(L_1=0\), everyone has \(Y=0\), also under either treatment. Therefore \(E[Y\mid A_1=1,L_1=l]=E[Y\mid A_1=0,L_1=l]=l\) for both \(l=0\) and \(l=1\), whenever both treatment values are possible in that stratum.

The treatment probability is \(0.8\) when \(L_1=1\), and \(0.2\) when \(L_1=0\); both treatment values therefore occur in each status group, satisfying positivity here. Standardizing the within-status outcome means to the same status distribution, for example \(P(L_1=1)=0.5\), gives \(0.5(1)+0.5(0)=0.5\) under \(A_1=1\), and the same \(0.5(1)+0.5(0)=0.5\) under \(A_1=0\). The standardized contrast is zero.

This calculation shows how accounting for the updated prognostic status addresses the confounding illustrated in this example. It does not establish that simply including every updated covariate in an outcome regression is appropriate for every longitudinal causal question. In particular, the history used to make a later comparison and the effect being targeted must be specified carefully.

A Practical Condition and Its Limits

The preceding result also provides a useful sufficient condition for baseline-only adjustment to work for a later treatment comparison. If \(Y^a\perp A_1\mid B\), with consistency and positivity given \(B\), then \(E[Y\mid A_1=a,B=b]=E[Y^a\mid B=b]\). The observed conditional means then identify the corresponding potential-outcome means within \(B\). The difficulty is that exchangeability given \(B\) is an assumption, not a consequence of exchangeability given the richer history \((B,L_1)\).

Corollary: Under the assumptions of the result above, if either \(L_1\perp A_1\mid B\), or the common no-effect mean \(m(B,L_1)\) is constant in \(L_1\), the baseline-adjusted contrast is zero when treatment has no effect.

Proof. In the no-effect contrast formula, independence gives equal conditional distributions of \(L_1\) across \(A_1\) at each \(B=b\), making every difference of probabilities zero. Alternatively, if \(m(b,l)=c\) for every \(l\), the contrast equals \(c\) times the difference between two probability sums, each of which is one; that difference is zero. \(\square\)

These are sufficient conditions, not a checklist that can be verified from an outcome table alone. In applied work, ask whether clinical knowledge suggests that the updated measure both influences treatment choice and predicts the outcome. Examine treatment frequencies across levels of the updated measure within baseline strata, and check whether meaningful status groups have little or no chance of receiving one treatment. Such patterns indicate possible confounding or a positivity problem; a fitted model cannot create comparisons absent from the data.

The main alternatives are not interchangeable. Baseline stratification or regression adjustment can control baseline differences, but cannot by itself balance updated status. A time-updated comparison conditions on relevant measured history, subject to suitable assumptions and careful choice of estimand. Inverse-probability weighting and marginal structural models are standard approaches in longitudinal causal inference when treatment-confounder feedback complicates ordinary adjustment; their construction and assumptions require separate development. No approach repairs unmeasured confounding, poor measurement of status, or a lack of treatment overlap.

Common Mistakes and Diagnostics

  • Assuming baseline adjustment covers all later confounding. It does not balance covariates that vary among people with the same baseline values. Check whether updated status predicts both the later decision and the outcome.
  • Calling an observed contrast a treatment effect. The examples show that a large contrast can occur when treatment has no effect. State the identifying assumptions before interpreting it causally.
  • Ignoring treatment overlap. If some status-history groups almost always receive one treatment, conditional comparisons rely on little information. Inspect treatment probabilities or cell counts by relevant history.
  • Treating an adjusted model as proof of no confounding. Adjustment only addresses variables measured and represented adequately. Unmeasured severity, measurement error, and model misspecification can leave bias.

A further limitation matters in longitudinal settings: \(L_1\) may itself have been affected by \(A_0\). The examples above isolate confounding of the later decision; they do not settle how to estimate the effect of an entire treatment history when earlier treatment changes later status. The key conclusion here is narrower: baseline covariates alone do not generally make later treatment groups comparable.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. In the first worked example, why is the baseline-adjusted contrast equal to \(0.6\) even though treatment has no effect?
  2. Suppose \(L_1\) predicts the outcome but, within each \(B\) stratum, is independent of \(A_1\). Does that particular source of baseline-adjusted confounding remain?
  3. What does positivity require for the later treatment comparison within updated-status histories?
  4. Why does adjusting for \(L_0\) separately within strata fail in the second worked example?

Solutions. (1) Treatment groups have different proportions with \(L_1=1\): \(0.8\) versus \(0.2\). Since \(Y=L_1\), their outcome means differ by \(0.6\), although \(Y\) is unchanged by treatment. (2) No. Under the stated independence, the conditional distributions of \(L_1\) are equal across treatment groups within \(B\), so this mechanism does not produce the contrast in the derived formula. Other confounding could still remain. (3) Each treatment value must have positive probability for the histories included in the comparison; otherwise the corresponding treatment-specific outcome mean is unsupported by observed data. (4) Within each baseline stratum, people with \(L_1=1\) are more likely to receive treatment, and \(L_1\) determines \(Y\). Stratification on \(L_0\) leaves that within-stratum imbalance intact.

Clinical Biostats