Tutorials › Marginal Structural Models › Handling Treatment Changes After Assignment

Target Trial Emulation · Tutorial 456 of 501

Handling Treatment Changes After Assignment

Learn to classify post-assignment treatment changes according to the emulated protocol, rather than assuming that every change is nonadherence.

Intermediate 11 min read

What You'll Learn

  • Distinguish an initiation-based strategy from a sustained-treatment strategy.
  • Specify how a protocol treats switching, discontinuation, dose changes, and augmentation.
  • Determine the first time a treatment history deviates from a sustained strategy.
  • Explain why post-initiation treatment changes can be allowed under one strategy and prohibited under another.
  • Identify common errors in classifying adherence from observed treatment histories.
  • Check the assumptions needed to interpret strategy-specific outcomes causally.

Why the Protocol, Not the Drug Label, Determines What Counts as a Change

After treatment assignment, patients may stop the assigned treatment, switch to another treatment, change dose, or add a second treatment. These events are clinically important, but none has a universal statistical classification. A switch is a protocol deviation only if the protocol rules out that switch. Discontinuation is nonadherence only if continuing treatment is required. Adding another treatment may be allowed, prohibited, or explicitly required.

The key is to define the treatment strategy over follow-up before classifying observed histories. An initiation-based strategy specifies whether and when a treatment is started, while leaving subsequent treatment changes unrestricted or governed by a stated usual-care policy. A sustained strategy specifies a treatment course over time, so stopping or switching may violate the strategy. The same observed history can therefore conform to one strategy and depart from another.

Definition: Let \(t=0,1,\ldots,K\) index the protocol’s treatment-decision times, and let \(A_t\) denote the treatment actually received at time \(t\). A treatment strategy \(g\) is a protocol rule that specifies which treatment actions are permitted at each time, given the history to that time. Write \(\mathcal{G}_t\) for the actions permitted by \(g\) at time \(t\). A participant follows \(g\) through time \(t\) if every observed action up to \(t\) is permitted by the protocol. A treatment change is a deviation precisely when it makes the observed history incompatible with \(g\).

Write the Strategy as a Rule for a Treatment History

A useful protocol description answers four concrete questions: What treatment must be initiated, and by when? What must happen after initiation? Are dose adjustments permitted? Are switches, discontinuation, or add-on treatments allowed? “Receive treatment X” is not sufficiently precise if the protocol does not say whether that means start X once, remain on X, or use X with specified co-treatments.

For an initiation-based strategy, the protocol may require starting treatment X within a grace period and then allow later care to proceed as it otherwise would. In that case, later discontinuation, switching, and augmentation do not retroactively undo the fact that the initiation rule was met. This is not a claim that those later events are irrelevant to outcomes. It means that the strategy being compared does not prescribe them.

A sustained strategy instead describes an allowable course. For example, it might require starting X within 30 days, continuing X thereafter, and permitting dose titration and a specified add-on treatment. A switch to Y or discontinuation of X would then be a deviation; a permitted titration or add-on would not. The exact details determine the answer.

Worked Example: The Same Treatment History Under Two Protocols

Suppose treatment is recorded on days 0, 30, 90, and 180. A patient starts X on day 20, is taking X on days 30 and 90, stops X on day 120, and takes no study treatment on day 180.

Protocol A: initiation-based. The strategy requires starting X by day 30 and allows subsequent treatment to follow usual care. The patient started on day 20, so the initiation requirement was met. Stopping on day 120 does not count as a deviation from this strategy, because continued use was not required.

Protocol B: sustained X. The strategy requires starting X by day 30 and continuing it through day 180. The patient follows the initiation rule, but stopping on day 120 violates the continuation rule. The first deviation occurs at the time X is stopped, not at day 180 when the absence of X is next recorded. If the data only establish that X was absent on day 180, the exact deviation time may be interval-censored by the visit schedule.

The observed history is identical in both assessments. Its classification changes because the protocol changes, not because the patient’s clinical course does.

Representing Adherence and the First Deviation

For a discrete sequence of decision times, define \(I_t^g=1\) when the action observed at time \(t\) is permitted by strategy \(g\), and \(I_t^g=0\) otherwise. The indicator that the history has remained compatible with the strategy through time \(t\) is

$$ C_t^g=\prod_{k=0}^{t} I_k^g. $$

Because each factor is either zero or one, \(C_t^g=1\) exactly when every action from time 0 through time \(t\) was permitted. Once a disallowed action occurs, \(C_t^g\) becomes zero and remains zero. The first deviation time is the earliest \(t\) for which \(I_t^g=0\). With irregularly timed records, the protocol should specify how event dates map to decision times; the recorded visit date need not be the actual date of a change.

This representation is a classification rule, not a causal adjustment method. In an emulation that uses artificial censoring at deviation, the rule identifies when censoring occurs. It does not by itself make those who remain adherent comparable to those who do not.

Result: Under the definition above, \(C_t^g=1\) if and only if the observed treatment history through \(t\) conforms to strategy \(g\). If \(t^\ast\) is the first time an action is disallowed, then \(C_t^g=1\) for \(t<t^\ast\) and \(C_t^g=0\) for \(t\geq t^\ast\).

Proof. If every action through \(t\) is permitted, then \(I_k^g=1\) for all \(k\leq t\), so their product is 1. Conversely, if at least one action through \(t\) is disallowed, then at least one factor is zero, so the product is zero. By definition, there are no disallowed actions before \(t^\ast\), and there is a disallowed action at \(t^\ast\). Thus the product is 1 before \(t^\ast\) and zero at and after \(t^\ast\). \(\square\)

Switching, Discontinuation, and Augmentation in Practice

Treatment records often contain more detail than a single category such as “on treatment.” A patient can stop X but continue a related treatment, take X intermittently, or add Y while remaining on X. Protocols should state whether treatment means a specific drug, a drug class, a dose range, or a regimen consisting of multiple components.

Worked Example: Does Augmentation Violate the Strategy?

A protocol requires starting X by day 30 and continuing X through day 180. It permits dose adjustment and adding Y after day 60 if symptoms remain above a specified threshold. A patient starts X on day 10, increases the dose on day 40, adds Y on day 80 after meeting the threshold, and continues X through day 180.

At day 10, the initiation rule is met. The dose increase on day 40 is permitted, so it does not create a deviation. The addition of Y on day 80 is also permitted because the stated condition is met. The patient remains on X through day 180. Therefore, this treatment history conforms to the strategy throughout follow-up.

If the protocol instead required X alone and prohibited add-on treatment, adding Y on day 80 would be the first deviation. Merely calling Y “augmentation” does not settle the classification: the protocol’s permitted regimen does.

Worked Example: Finding the First Deviation Under a Sustained Regimen

Consider a protocol that requires starting X by day 30, permits dose changes, and requires X to continue through day 180. Switching to another drug or stopping X is not allowed. A patient starts X on day 25, changes dose on day 60, switches from X to Y on day 100, and remains on Y through day 180.

The start on day 25 meets the day-30 deadline. The dose change on day 60 is allowed. The switch on day 100 is the first disallowed action, so the patient follows the strategy through day 60 but not from day 100 onward. The fact that the patient receives an active treatment after day 100 does not restore adherence: the strategy requires X, not simply any treatment.

If the switch date were unknown and the records showed X at day 90 and Y at day 120, the data would locate the deviation between those observations, not establish that it occurred exactly on day 120. The protocol and analysis must handle that timing uncertainty honestly.

What the Strategy-Specific Outcome Means

Let \(Y^g\) denote the outcome that would be observed under strategy \(g\). Its meaning depends on the complete strategy, including what is allowed after initiation. Under a sustained strategy, \(Y^g\) refers to the outcome under the specified treatment course. Under an initiation-based strategy that leaves later care to usual practice, \(Y^g\) refers to the outcome under the initiation rule together with that downstream-care policy.

A consistency argument links observed outcomes to these potential outcomes: when a participant’s observed treatment history is generated by the strategy being considered, the observed outcome equals that participant’s potential outcome under the strategy. This link requires that the strategy and relevant treatment versions be well-defined. If “usual care” can mean substantially different downstream policies, the intended policy or target population must be clear enough for \(Y^g\) to have a stable interpretation.

Result: Suppose a participant’s observed treatment and downstream care through outcome time are consistent with a fully specified strategy \(g\), and suppose consistency holds for that strategy and its treatment versions. Then the participant’s observed outcome equals \(Y^g\).

Proof. Consistency states that a participant’s observed outcome equals the potential outcome under the treatment history and care policy the participant actually experienced. By assumption, that experienced history and care policy are those specified by \(g\). Substituting the strategy-generated history for the observed history gives \(Y=Y^g\). This equality is an individual-level consistency statement; it does not imply that outcomes among observed adherers identify the population mean \(E[Y^g]\). \(\square\)

For an initiation-based strategy, later switching or discontinuation can be compatible with \(g\), so consistency does not require the participant to remain on the initiated treatment. For a sustained strategy, those same events may make the observed history incompatible with \(g\). In observational data, interpreting a contrast of strategy-specific outcomes also requires appropriate control of confounding at assignment and, when adherence over time matters, of time-varying factors that influence subsequent treatment and outcome. Positivity and a well-defined intervention are also needed. Those assumptions cannot be supplied merely by labeling a history “adherent.”

Diagnostics, Alternatives, and Common Mistakes

A practical protocol audit should compare each treatment-change rule with the recorded data. Check whether initiation dates, stops, switches, doses, and add-on treatments are observed at adequate resolution; whether permitted exceptions have explicit criteria; and whether apparent deviations arise from genuine changes or from missing records. Summarize the frequency and timing of each type of change under the strategy definition. If nearly everyone deviates at a particular time, the sustained strategy may be infeasible in the target population or poorly matched to available care.

There are two common estimand choices, not two interchangeable ways to code the same treatment history. An initiation-based, treatment-policy approach asks about the consequences of adopting an initiation rule while allowing later care to unfold as specified. A per-protocol approach under sustained strategies asks about outcomes if participants followed the specified regimen. The latter typically requires handling deviations, for example by artificial censoring and appropriate adjustment for informative adherence. Simply comparing those who happened to remain on treatment with those who did not can be biased, because health changes may affect both continuation and outcome.

  • Mistake: treating every stop as nonadherence. Correction: a stop is a deviation only when the strategy requires continuing treatment.
  • Mistake: defining groups by eventual treatment history. For example, calling participants “initiators” only if they start by day 30 uses future information to classify them. Define strategies at time zero and apply the protocol’s grace-period rules instead.
  • Mistake: assuming any active drug satisfies a sustained strategy. Correction: specify whether the requirement concerns a particular drug, a class, or a regimen.
  • Mistake: treating a permitted add-on as automatically nonadherence. Correction: check whether the protocol allows it, and under what conditions.

The protocol’s precision is a limitation as well as a strength. Very strict sustained regimens may be difficult to emulate when treatment is measured coarsely or exceptions are common. Broad initiation strategies can be more feasible, but they answer a different question and may combine many downstream treatment patterns. No classification rule removes confounding, measurement error, or ambiguity in the intervention itself.

Check Your Understanding

For each question, decide what the protocol implies before classifying the treatment history. Solutions follow.

  1. A strategy requires starting A by day 14 and leaves later care to usual practice. A participant starts on day 9, stops on day 50, and switches to B on day 70. Is the history a deviation from this strategy?
  2. A strategy requires starting A by day 30 and continuing through day 90, while permitting dose changes. A participant starts on day 20, changes dose on day 40, and stops on day 60. Identify the first deviation.
  3. A strategy requires continuing A and permits adding B if a laboratory value exceeds 8. A participant adds B after the value is recorded as 9 and continues A. Is adding B a deviation?
  4. Why does observing only participants who stayed on treatment not, by itself, identify the mean outcome under a sustained strategy?

Solutions. (1) No. The participant met the initiation deadline, and subsequent care is unrestricted under the stated strategy. (2) Stopping A on day 60 is the first deviation; the dose change was permitted. (3) No. The add-on condition was met, and A was continued. (4) Staying on treatment can depend on evolving health factors that also predict the outcome, so adherers may differ systematically from the target population. A causal analysis needs assumptions and methods that address this selection, not just an adherer-only comparison.

Clinical Biostats