Tutorials › Causal Inference › Worked Algebra: A Two-Period Linear Feedback Model

Time-Varying Treatments and Confounding · Tutorial 694 of 972

Worked Algebra: A Two-Period Linear Feedback Model

Trace the pathways in a linear feedback model to calculate the total treatment effect and distinguish it from a regression coefficient adjusted for the later confounder and treatment.

Intermediate 9 min read

What You'll Learn

  • Write structural equations for first-period treatment, a treatment-affected confounder, second-period treatment, and outcome.
  • Calculate how an intervention on first-period treatment changes the later covariate and treatment.
  • Derive the total effect when later treatment follows its usual assignment mechanism.
  • Identify the first-period coefficient in a regression adjusted for both later variables.
  • Compare full adjustment with adjustment for the later confounder alone.
  • Recognize why an adjusted regression coefficient need not equal the total effect.

Why the Algebra Matters

In a longitudinal study, a first-period treatment can change a covariate measured before the next treatment decision. That covariate can then influence both the second-period treatment and the outcome. It is therefore a confounder of the later treatment–outcome relationship, but it is also affected by earlier treatment. A regression that adjusts for it answers a different question from the total effect of changing the first-period treatment.

A linear model makes this distinction visible. We can calculate the changes in the covariate and later treatment under an intervention, carry those changes through the outcome equation, and then compare the resulting total effect with the coefficient of first-period treatment in an adjusted regression.

A Two-Period Structural Model

Let \(A_1\) denote treatment in period 1, \(L\) a covariate measured after period 1 but before the next treatment decision, \(A_2\) treatment in period 2, and \(Y\) the final outcome. Consider the following additive structural equations:

$$ \begin{aligned} L &= \alpha_0+\alpha_1 A_1+U_L,\\ A_2 &= \gamma_0+\gamma_1 A_1+\gamma_2 L+U_A,\\ Y &= \beta_0+\beta_1 A_1+\beta_2 A_2+\beta_3 L+U_Y. \end{aligned} $$

The equations specify the order of events: \(A_1\) changes \(L\), then \(A_1\) and \(L\) help determine \(A_2\), and all three variables may affect \(Y\). In particular, \(L\) is treatment-affected and predicts both \(A_2\) and \(Y\). The model has no interactions, so each coefficient represents a constant additive change holding the other variables in that equation fixed.

Model assumptions: The equations are correctly specified and additive over the treatment contrasts being considered. The disturbances have mean zero and are mutually independent, and they are independent of \(A_1\). Thus, there is no unmeasured common cause represented by these disturbances that confounds the treatment–outcome relations. For the adjusted regression interpretation, assume the relevant treatment and covariate values have sufficient overlap to make the conditional comparisons meaningful. These are strong simplifying assumptions; the algebra does not make them true in an actual study.

For a total effect of \(A_1\), intervene on \(A_1\) but let \(L\) and \(A_2\) follow their structural equations. For an increase of \(\delta\) units in \(A_1\), the equations imply a change in \(L\), followed by a change in \(A_2\), followed by a change in \(Y\). The total effect includes all of these pathways.

Deriving the Total Effect

Write \(L(a)\), \(A_2(a)\), and \(Y(a)\) for the values that the variables would take if \(A_1\) were set to \(a\), while the later variables were generated by their equations. First, the covariate changes by \(\alpha_1\delta\) when \(A_1\) increases by \(\delta\). Substituting that change into the second-period treatment equation gives the change in \(A_2\):

$$ \Delta L=\alpha_1\delta,\qquad \Delta A_2=\gamma_1\delta+\gamma_2\Delta L =(\gamma_1+\gamma_2\alpha_1)\delta. $$

The outcome equation then gives the total change. The direct contribution of \(A_1\) is \(\beta_1\delta\); the changes through \(A_2\) and \(L\) contribute \(\beta_2\Delta A_2\) and \(\beta_3\Delta L\), respectively. Combining them and dividing by \(\delta\) gives the total effect per unit increase in \(A_1\):

$$ \frac{\Delta Y}{\delta} =\beta_1+\beta_2(\gamma_1+\gamma_2\alpha_1)+\beta_3\alpha_1. $$

This is a finite contrast for any \(\delta\) under the stated linear, additive model. The term \(\beta_2\gamma_1\) is the pathway from \(A_1\) to \(A_2\) that does not pass through \(L\). The term \(\beta_2\gamma_2\alpha_1\) passes through both \(L\) and \(A_2\), and \(\beta_3\alpha_1\) passes from \(A_1\) through \(L\) to \(Y\). The remaining term, \(\beta_1\), is the direct contribution holding \(L\) and \(A_2\) fixed.

Worked Example: Calculating the Total Effect

Suppose a hypothetical system follows the equations

$$ \begin{aligned} L&=2+0.5A_1+U_L,\\ A_2&=1+0.4A_1+0.6L+U_A,\\ Y&=10+2A_1+3A_2+4L+U_Y. \end{aligned} $$

The coefficients are in compatible units: the treatment contrast is one unit of \(A_1\), and \(Y\) is measured in outcome units. Under an intervention setting \(A_1=0\), the expected covariate is \(2\), so the expected second-period treatment is \(1+0.6(2)=2.2\). The expected outcome is

$$ E[Y(0)]=10+2(0)+3(2.2)+4(2)=24.6. $$

Under an intervention setting \(A_1=1\), the expected covariate is \(2+0.5=2.5\). The expected second-period treatment is \(1+0.4+0.6(2.5)=2.9\), and the expected outcome is

$$ E[Y(1)]=10+2(1)+3(2.9)+4(2.5)=30.7. $$

Thus the total effect of changing \(A_1\) from 0 to 1 is \(30.7-24.6=6.1\) outcome units. The formula gives the same result: \(2+3(0.4+0.6(0.5))+4(0.5)=2+2.1+2=6.1\).

What the Fully Adjusted Regression Coefficient Represents

Now consider the regression of \(Y\) on \(A_1\), \(A_2\), and \(L\). Under the model assumptions, the conditional mean of \(Y\) given those variables is

$$ E[Y\mid A_1,A_2,L] =\beta_0+\beta_1A_1+\beta_2A_2+\beta_3L. $$

The error term has conditional mean zero under the stated independence assumption. Consequently, the population coefficient of \(A_1\) in this correctly specified adjusted regression is \(\beta_1\). It compares outcome predictions at the same values of \(L\) and \(A_2\), changing \(A_1\) while holding both later variables fixed. It is not, in general, the total effect of intervening on \(A_1\) and allowing those later variables to respond.

Worked Example: Finding the Fully Adjusted Coefficient

Use the hypothetical equations from the previous example. In the outcome equation, the coefficient on \(A_1\) is \(2\). To see what the fully adjusted comparison means, compare the predicted outcomes at \(L=4\) and \(A_2=3\), first with \(A_1=0\), then with \(A_1=1\).

With \(A_1=0\), the prediction is \(10+2(0)+3(3)+4(4)=35\) outcome units. With \(A_1=1\), it is \(10+2(1)+3(3)+4(4)=37\) outcome units. The adjusted difference is \(37-35=2\) outcome units, exactly \(\beta_1\).

This comparison deliberately holds the post-treatment variables fixed. The total-effect calculation did not: when \(A_1\) changed, \(L\) and then \(A_2\) changed as well. The difference between \(2\) and \(6.1\) is therefore not an arithmetic inconsistency; the two quantities answer different questions.

Adjusting for the Covariate but Not the Later Treatment

A different regression adjusts for \(L\) but omits \(A_2\). Its coefficient can also be derived from the structural equations. Conditional on \(A_1\) and \(L\), the expected second-period treatment is \(\gamma_0+\gamma_1A_1+\gamma_2L\). Substituting that expectation into the outcome equation gives

$$ \begin{aligned} E[Y\mid A_1,L] &=\beta_0+\beta_1A_1 +\beta_2(\gamma_0+\gamma_1A_1+\gamma_2L)+\beta_3L\\ &=(\beta_0+\beta_2\gamma_0) +(\beta_1+\beta_2\gamma_1)A_1 +(\beta_3+\beta_2\gamma_2)L. \end{aligned} $$

Under these assumptions, the coefficient of \(A_1\) in this regression is \(\beta_1+\beta_2\gamma_1\). It includes the pathway from \(A_1\) to \(A_2\) that remains when \(L\) is held fixed. It does not include the pathways through changes in \(L\), because the regression conditions on \(L\).

Worked Example: Interpreting Adjustment for \(L\) Alone

For the same hypothetical model, \(\beta_1=2\), \(\beta_2=3\), and \(\gamma_1=0.4\). Therefore, the \(A_1\) coefficient in a regression of \(Y\) on \(A_1\) and \(L\), but not \(A_2\), is

$$ \beta_1+\beta_2\gamma_1=2+3(0.4)=3.2. $$

The same result follows by simplifying the conditional mean: \(E[Y\mid A_1,L]=13+3.2A_1+5.8L\). Thus, for a one-unit contrast in \(A_1\) at the same \(L\), this regression predicts a \(3.2\)-unit outcome difference while allowing \(A_2\) to respond through its \(0.4A_1\) term. This is neither the fully adjusted coefficient of \(2\) nor the total effect of \(6.1\). Its interpretation depends on which variables are held fixed and which are allowed to vary.

Why This Distinction Is Useful

The algebra prevents a common error: treating “adjusted for more variables” as if it automatically meant “closer to the total effect.” In this model, full adjustment for \(L\) and \(A_2\) produces a coefficient that holds both treatment-affected variables fixed. It removes the contributions of the pathways through them rather than adding those contributions into the total effect.

The calculations also depend on the model and assumptions. If the outcome equation has interactions, such as an \(A_1A_2\) term, the effect of changing \(A_1\) while holding \(A_2\) fixed can depend on the value of \(A_2\); a single constant coefficient may no longer summarize the contrast. If the disturbances are associated, the regression conditional mean may not equal the structural outcome equation. In either case, the simple coefficient identities above need not hold.

Key takeaway: In this additive model, the total effect per unit increase in \(A_1\) is \(\beta_1+\beta_2(\gamma_1+\gamma_2\alpha_1)+\beta_3\alpha_1\). The coefficient of \(A_1\) in the regression adjusted for both \(L\) and \(A_2\) is \(\beta_1\). The first allows the later variables to respond; the second holds them fixed.

Common Mistakes

  • Calling the fully adjusted coefficient the total effect. That coefficient holds \(L\) and \(A_2\) fixed. The total-effect contrast allows both to change according to their equations.
  • Counting only one pathway. The change in \(A_2\) includes both \(\gamma_1\delta\) and \(\gamma_2\alpha_1\delta\). Leaving out either term omits a pathway.
  • Adding coefficients without following the equations. Coefficients from different equations must be multiplied along a pathway and added across pathways. For example, the \(A_1\to L\to Y\) contribution is \(\alpha_1\beta_3\), not \(\alpha_1+\beta_3\).
  • Assuming the identity is automatic in observational data. The derivation relies on the specified model and disturbance assumptions. A fitted regression alone does not establish those assumptions or identify a causal effect.

Check Your Understanding

Use the model and assumptions stated above to answer these questions.

  1. Write the total-effect formula for a one-unit increase in \(A_1\), and identify the term for the pathway through both \(L\) and \(A_2\).
  2. If \(\alpha_1=0\), which pathways through \(L\) disappear from the total-effect formula?
  3. Why does the regression of \(Y\) on \(A_1\), \(L\), and \(A_2\) have an \(A_1\) coefficient of \(\beta_1\) under the stated assumptions?
  4. For the hypothetical numerical model, what is the coefficient of \(A_1\) in a regression adjusted for \(L\) but not \(A_2\)?
  5. State one assumption whose failure could make the adjusted regression coefficient differ from the structural coefficient \(\beta_1\).
Clinical Biostats