Why Feedback Creates a Regression Trade-Off
In a longitudinal study, treatment decisions occur at different times, and information collected between decisions can affect what happens next. A covariate measured after an earlier treatment may therefore have two roles: it can carry part of that treatment’s effect forward, and it can confound the relationship between a later treatment and the outcome. This is treatment-confounder feedback.
The difficulty is not that regression is always unsuitable. It is that a conventional regression adjustment typically conditions on a chosen set of covariates, and that same conditioning choice can have different consequences for treatment effects at different times. Controlling a covariate may help address later confounding while blocking a pathway through which earlier treatment affects the outcome.
The treatment sequence \((a_0,a_1)\) specifies the treatment assigned at both decision times. Write \(Y(a_0,a_1)\) for the outcome that would be observed under that sequence. A total effect of changing the first treatment compares outcomes under different first-treatment assignments while allowing consequences of that assignment—including changes in \(L_1\) and later treatment—to contribute. It is different from an effect that holds \(L_1\) fixed.
For observational data, interpreting an adjusted regression causally also requires suitable assumptions. In particular, treatment assignment at each decision must be unconfounded given the relevant observed history, treatment options must have positive probability across histories being compared, and the observed outcome under a treatment sequence must agree with the corresponding potential outcome (consistency). These assumptions do not make every regression coefficient a total effect; the adjustment and the target still have to match.
The Two Roles of the Intermediate Covariate
The relevant paths can be read directly from the DAG. Because \(L_1\) predicts both \(A_1\) and \(Y\), it can create confounding in the later-treatment–outcome relationship. For example, if greater disease severity increases the chance of a dose increase and also predicts a worse outcome, a comparison of patients receiving different later doses can partly reflect their severity rather than the dose.
At the same time, if \(A_0\) changes \(L_1\), then \(L_1\) lies on a pathway from the earlier treatment toward the outcome. That pathway can run directly through \(L_1\) to \(Y\), or continue from \(L_1\) to \(A_1\) and then to \(Y\). Conditioning on \(L_1\) blocks those routes in the usual path-based interpretation of regression adjustment.
Thus a regression such as \(Y \sim A_0 + A_1 + L_1\) uses \(L_1\) as an adjustment variable for both treatment terms. Its coefficient for \(A_0\) describes a comparison holding \(L_1\) and \(A_1\) fixed, under the model’s assumptions. That is not generally the total effect of changing \(A_0\), because the comparison excludes effects carried through \(L_1\). If \(L_1\) is omitted instead, the regression may fail to control confounding of the \(A_1\)-outcome relationship.
Worked Example: Locating the Conflicting Paths
Suppose a hypothetical study records initial treatment \(A_0\), a post-treatment severity measure \(L_1\), a later treatment \(A_1\), and a final outcome \(Y\). Assume the graph includes \(A_0 \rightarrow L_1\), \(L_1 \rightarrow A_1\), \(L_1 \rightarrow Y\), and \(A_1 \rightarrow Y\). The question is whether one conventional adjustment choice can both preserve the full effect of \(A_0\) and control confounding for \(A_1\).
For the later treatment: the path \(A_1 \leftarrow L_1 \rightarrow Y\) is an open backdoor path. The arrow into \(A_1\) means \(L_1\) influences later treatment; its arrow into \(Y\) means it also predicts the outcome. Adjusting for \(L_1\) closes this path.
For the earlier treatment: the path \(A_0 \rightarrow L_1 \rightarrow Y\) is a causal pathway. Another possible pathway is \(A_0 \rightarrow L_1 \rightarrow A_1 \rightarrow Y\). Adjusting for \(L_1\) blocks both pathways at \(L_1\). If, in a hypothetical additive causal description, changing \(A_0\) shifts \(L_1\) by 2 severity units and each unit contributes 3 outcome units along the first pathway, that pathway contributes \(2 \times 3 = 6\) outcome units to the total effect. Holding \(L_1\) fixed removes that contribution from the comparison.
The two requirements therefore point in opposite directions: include \(L_1\) to close the stated backdoor path for \(A_1\), but do not condition on it if the target is the full \(A_0\) effect transmitted through \(L_1\). This conclusion follows from the graph’s arrows; it does not depend on a particular numerical regression estimate.
Why a Single Adjustment Set Does Not Generally Solve Both Problems
A conventional adjustment set is a collection of variables conditioned on together. When the same regression includes treatment terms for multiple decision times, it does not ordinarily assign a different causal role to a covariate for each treatment term. Including \(L_1\) conditions on it in the comparison of \(A_0\) as well as in the comparison of \(A_1\); leaving it out means it is not controlled for either treatment term.
This is the key limitation: a set that is useful for removing later confounding can be inappropriate for estimating an earlier total effect. Conversely, a set that avoids blocking the earlier treatment’s mediated effect can leave later confounding open. The problem is about the target effect and the causal structure, not merely about choosing more or fewer predictors or improving a model’s fit.
Worked Example: Comparing the Two Regression Choices
Consider the graph from the previous example. Assume \(L_1\) is affected by \(A_0\), predicts \(A_1\), and predicts \(Y\). Compare two proposed regressions for estimating effects of both treatment times.
Choice 1: include \(L_1\). The regression \(Y \sim A_0 + A_1 + L_1\) adjusts for \(L_1\), so it can close the path \(A_1 \leftarrow L_1 \rightarrow Y\), provided the model and other identification assumptions are adequate. But the coefficient for \(A_0\) compares observations at the same \(L_1\) and \(A_1\). It consequently does not capture the part of the \(A_0\) effect carried along \(A_0 \rightarrow L_1 \rightarrow Y\), or along \(A_0 \rightarrow L_1 \rightarrow A_1 \rightarrow Y\). The coefficient is not generally the total effect of changing the first treatment.
Choice 2: omit \(L_1\). The regression \(Y \sim A_0 + A_1\) no longer conditions on \(L_1\). The path \(A_1 \leftarrow L_1 \rightarrow Y\) remains open, so the \(A_1\) coefficient can mix the effect of later treatment with differences in \(L_1\). Avoiding adjustment for a treatment-affected covariate has not, by itself, resolved confounding at the later decision.
The comparison is not a proof that every regression containing \(L_1\) is biased for every possible target, or that every regression omitting it must be biased. It shows why one common adjustment choice does not generally deliver both the earlier total effect and control of later confounding. Special causal structures or different targets can change the conclusion.
A Numerical Illustration of Later Confounding
The following hypothetical calculation isolates the later-treatment problem. Let \(L_1=1\) indicate high severity and \(L_1=0\) low severity. Suppose, within a fixed \(A_0\) group, half the individuals have high severity. Let the probability of receiving \(A_1=1\) be 0.8 for high-severity individuals and 0.2 for low-severity individuals. For illustration, suppose the mean outcome follows the stated relationship \(E[Y\mid A_0,L_1,A_1]=10+A_0+4L_1+2A_1\). Thus, holding \(A_0\) and \(L_1\) fixed, the outcome difference associated with changing \(A_1\) is 2 units.
Worked Example: How Severity Distorts the Later-Treatment Contrast
Use the hypothetical probabilities above to compare the observed mean outcome for \(A_1=1\) versus \(A_1=0\) within the fixed \(A_0\) group. The high-severity proportion is 0.5, and treatment probabilities are 0.8 at high severity and 0.2 at low severity.
First calculate the proportion receiving later treatment:
Among those receiving \(A_1=1\), the high-severity proportion is \(0.5(0.8)/0.50=0.80\). Among those receiving \(A_1=0\), it is \(0.5(0.2)/0.50=0.20\). The observed severity difference between treatment groups is therefore \(0.80-0.20=0.60\).
The outcome relationship assigns 4 units to high rather than low severity and 2 units to later treatment. The observed outcome contrast is consequently:
The contrast is 4.4 units, although the stipulated treatment difference holding severity fixed is 2 units. The remaining \(4(0.60)=2.4\) units arise from the groups’ severity imbalance. In this illustration, adjustment for \(L_1\) is needed to remove that particular source of later-treatment confounding. But \(L_1\) is also affected by \(A_0\), so the same adjustment blocks pathways that contribute to the earlier treatment’s total effect.
Deriving the Trade-Off From the Graph
The logic can be summarized as a short path argument. Suppose the graph contains the four arrows \(A_0 \rightarrow L_1\), \(L_1 \rightarrow A_1\), \(L_1 \rightarrow Y\), and \(A_1 \rightarrow Y\). For the later treatment, the path \(A_1 \leftarrow L_1 \rightarrow Y\) is a backdoor path. Conditioning on the non-collider \(L_1\) blocks it. For the earlier treatment, the directed paths \(A_0 \rightarrow L_1 \rightarrow Y\) and \(A_0 \rightarrow L_1 \rightarrow A_1 \rightarrow Y\) pass through that same variable. Conditioning on \(L_1\) blocks those directed paths. A single adjustment set that includes \(L_1\) therefore has opposing consequences for these two targets.
This is a graph-based justification, not a claim about every possible data-generating process. If \(A_0\) does not affect \(L_1\), for example, the specific earlier-treatment pathways just described are absent. If \(L_1\) does not cause \(Y\) or later treatment, its role may also differ. Whether conventional adjustment is adequate depends on the actual graph and target; the general lesson is that one must not treat a post-treatment covariate as an ordinary baseline confounder.
Specify whether the goal is the total effect of an earlier treatment, a later-treatment effect, or another contrast. These targets need not call for the same adjustment.
Determine whether each covariate precedes a treatment, follows an earlier treatment, or both. Temporal position helps distinguish baseline confounding from treatment-confounder feedback.
Ask which paths adjustment would close for later treatment and which causal pathways from earlier treatment would also be blocked.
A coefficient conditional on \(L_1\) is not automatically a total effect for \(A_0\). An unadjusted coefficient for \(A_1\) is not automatically free of confounding.
Common Mistake
A frequent mistake is to reason, “\(L_1\) predicts both later treatment and the outcome, so it is a confounder; therefore I should adjust for it in the regression.” The first sentence may correctly describe its role for \(A_1\), but it omits the fact that \(L_1\) occurs after and may be caused by \(A_0\). Conditioning on it can remove part of the earlier treatment’s total effect. The opposite shortcut—“never adjust for post-treatment variables”—also fails, because leaving \(L_1\) uncontrolled can leave the later-treatment backdoor path open.
The correction is to state the effect being targeted, draw the time-ordered causal graph, and assess the consequence of conditioning on each covariate for each treatment time. No variable’s label alone determines whether it belongs in an adjustment set.
Check Your Understanding
Use the time ordering and paths, rather than a covariate’s label alone, to answer these questions.
- In the graph \(A_0 \rightarrow L_1 \rightarrow A_1 \rightarrow Y\), which pathway from \(A_0\) is blocked by conditioning on \(L_1\)?
- What open backdoor path can make the \(A_1\)-outcome relationship confounded when \(L_1\) affects both \(A_1\) and \(Y\)?
- Why does including \(L_1\) in \(Y \sim A_0 + A_1 + L_1\) not generally make the \(A_0\) coefficient a total effect?
- In the numerical illustration, calculate the observed severity imbalance between later-treatment groups and the resulting added outcome contrast.
- Why is “never adjust for a post-treatment covariate” not a sufficient general rule for longitudinal treatment decisions?