Tutorials › Quantitative Systems Pharmacology (QSP) › Diagnosing Bias From Omitted Feedback Loops

Defining Model Scope and Boundaries · Tutorial 23 of 799

Diagnosing Bias From Omitted Feedback Loops

Learn to identify when excluding a return path changes a predicted intervention effect, and calculate the direction and size of that change.

Intermediate 12 min read

What You'll Learn

  • Represent a local feedback loop with a direct intervention effect and a return-path gain.
  • Derive the closed-loop response and relate it to the open-loop prediction.
  • Distinguish reinforcing feedback from balancing feedback by the sign of the loop gain.
  • Trace how feedback can change a measured endpoint as well as an internal state.
  • Check whether an omitted loop matters for the specific output used in a decision.
  • Recognize when a linear, quasi-steady feedback approximation is inadequate.

Why an Omitted Return Path Can Change an Intervention Prediction

A model can include the direct pathway from a drug target to a biological response and still mispredict the intervention effect if a downstream response feeds back to the target or an upstream process. The essential question is not simply whether a feedback mechanism exists. It is whether the intervention changes a state that travels around the omitted return path, and whether that return path changes the output being predicted.

An open-loop representation allows the intervention to produce a response but does not send that response back through the pathway that generated it. A closed-loop representation includes the return path. Comparing these two predictions helps diagnose the direction and possible scale of distortion attributable to the omitted loop. The calculations below use local, scaled changes from a baseline, rather than absolute biological concentrations.

Definition: An open-loop prediction is a prediction in which a specified feedback return path is excluded, so the downstream response does not alter the upstream state through that path. A closed-loop prediction includes that return path. The loop gain \(L\) is the product of the local gains along one complete traversal of the loop. For the simple linear loop used here, the direct intervention response is \(d\), the upstream change is \(x\), the mediator change is \(z=bx\), and the return contribution to \(x\) is \(rz\). Thus \(L=rb\).

A Local Model and Its Assumptions

For a fixed intervention, suppose \(d\) is its direct effect on state \(x\), before the return path is applied. The mediator \(z\) responds locally in proportion to \(x\), and then affects \(x\) in return:

$$ z=bx,\qquad x=d+rz. $$

Here \(b\) and \(r\) are signed local gains. Their units need not be identical: the product \(rb\) must be dimensionless because it maps a change in \(x\) back to a change in \(x\). Substituting the mediator equation gives \(x=d+rbx=d+Lx\). If \(L\ne 1\), the closed-loop response is therefore:

$$ x_{\mathrm{closed}}=\frac{d}{1-L}. $$

Under the open-loop boundary assumption, the return contribution is removed, so \(x_{\mathrm{open}}=d\). The signed difference between predictions is:

$$ x_{\mathrm{closed}}-x_{\mathrm{open}} =\frac{d}{1-L}-d =\frac{dL}{1-L}. $$

These expressions are local approximations. They assume that the intervention and response are in the range where the gains are approximately constant; that the same baseline, intervention, and other model inputs are used in both predictions; and that the represented return path is the only feedback path being compared. The algebraic calculation also assumes a quasi-steady response: it does not describe the transient trajectory or establish dynamic stability. If the loop is interpreted as repeated contributions \(d+Ld+L^2d+\cdots\), that geometric series converges when \(|L|<1\). The closed-form algebraic solution itself requires only \(L\ne1\), but values near 1 can yield a very large response and should prompt scrutiny of the local approximation and supporting evidence.

Reading the Sign of the Loop

When \(L>0\), the return contribution has the same sign as the change it responds to: the loop is reinforcing locally. When \(L<0\), the return contribution opposes that change: the loop is balancing locally. These labels describe the sign of the complete path, not the sign of any single link. For example, two negative links can produce a positive loop gain.

A positive loop gain below 1 in magnitude amplifies the magnitude of a direct response in this simple model, because \(1-L\) is positive and less than 1. A negative loop gain attenuates the response relative to the open-loop prediction, because \(1-L>1\). The endpoint need not follow the same pattern as \(x\): an endpoint may depend on both \(x\) and the mediator, and those contributions can reinforce or cancel one another.

Worked Example: A Mediator Returns to the Upstream State

Suppose a hypothetical intervention directly changes \(x\) by \(d=-10\) scaled units. The mediator responds as \(z=-0.60x\), and its return effect on \(x\) is \(-0.50z\). The endpoint is \(y=x+2z\), measured in endpoint units. Compare the open- and closed-loop predictions.

Closed-loop state. Here \(b=-0.60\), \(r=-0.50\), and the loop gain is \(L=rb=(-0.50)(-0.60)=+0.30\). The two negative links give a positive, reinforcing loop. Using the structural equations:

$$ x=-10-0.50z=-10-0.50(-0.60x) =-10+0.30x, \qquad 0.70x=-10, \qquad x_{\mathrm{closed}}=-14.29\ \text{scaled units}. $$

The mediator response is \(z=-0.60(-14.2857)=+8.571\) mediator units. The endpoint prediction is \(y_{\mathrm{closed}}=-14.2857+2(8.5714)=+2.857\) endpoint units.

Open-loop comparison. Excluding the return path gives \(x_{\mathrm{open}}=d=-10\) scaled units. The downstream mediator can still be calculated as \(z=-0.60(-10)=+6.000\) mediator units, but it does not feed back to \(x\). Thus \(y_{\mathrm{open}}=-10+2(6)=+2.000\) endpoint units. The closed-loop prediction for \(x\) is 4.286 scaled units more negative than the open-loop prediction; the endpoint is 0.8571 endpoint units higher. These are differences between model predictions, not statistical bias estimates from observed data.

Worked Comparisons Under Different Loop Signs

Worked Example: Reinforcing Feedback Amplifies a Positive Response

In a hypothetical local model, an intervention has direct effect \(d=+8\) scaled units. The state affects a mediator with gain \(b=+0.50\), and the mediator returns to the state with gain \(r=+0.60\). Find the open-loop and closed-loop state responses.

The loop gain is \(L=(0.60)(0.50)=+0.30\), so the return path reinforces the positive change. The open-loop response is \(x_{\mathrm{open}}=+8.000\) scaled units. Including the loop:

$$ x_{\mathrm{closed}}=\frac{8}{1-0.30} =\frac{8}{0.70} =+11.43\ \text{scaled units}. $$

The mediator response is \(z=0.50(11.4286)=+5.714\) mediator units. The state prediction increases by \(11.4286-8=3.429\) scaled units when the loop is included. Since \(|L|=0.30<1\), the repeated-path interpretation \(8+2.4+0.72+\cdots\) converges to the same closed-loop value. This calculation does not by itself show that the biological system is dynamically stable.

Worked Example: Balancing Feedback Attenuates a Negative Response

Consider a different hypothetical model with direct response \(d=+12\) scaled units, mediator gain \(b=-0.50\), and return gain \(r=+0.80\). Compare the state predictions and explain their direction.

The loop gain is \(L=(0.80)(-0.50)=-0.40\). The mediator change opposes the initial positive change, so the complete loop is balancing. The open-loop response is \(+12.00\) scaled units. With feedback:

$$ x_{\mathrm{closed}}=\frac{12}{1-(-0.40)} =\frac{12}{1.40} =+8.571\ \text{scaled units}. $$

The mediator response is \(z=-0.50(8.5714)=-4.286\) mediator units. The return effect is \(0.80(-4.2857)=-3.429\) scaled units, so it reduces the direct response from \(+12.00\) to \(+8.571\). This is attenuation, not reversal: the closed-loop response remains positive. A balancing loop can attenuate an intervention effect without eliminating it.

When the Endpoint Changes the Diagnosis

A loop can substantially change an internal state yet have little effect on a particular output, or it can shift an endpoint through a mediator even when the state response is attenuated. For an endpoint represented locally as \(y=cx+qz\), the two predictions are \(y_{\mathrm{closed}}=cx_{\mathrm{closed}}+qz_{\mathrm{closed}}\) and \(y_{\mathrm{open}}=cx_{\mathrm{open}}+qz_{\mathrm{open}}\). Their difference, not the change in \(x\) alone, determines whether omitting the loop distorts that endpoint.

In the first worked example, \(x\) became more negative with feedback, while the endpoint became more positive because the mediator contributed positively to \(y\). The endpoint comparison therefore has to retain the mediator's direct contribution. If the decision depends on a biomarker, clinical outcome, or safety measure, trace the loop all the way to that specified output rather than using an internal state as a substitute.

Diagnosis, Alternatives, and Limitations

A practical diagnosis begins with a causal trace: identify the direct intervention path, follow the response to the proposed mediator, and ask whether a plausible return path reaches an upstream state that influences the intervention response or endpoint. Then assign the signs of the links in the return path and determine the sign of their product. Finally, compare open- and closed-loop predictions using the same intervention and endpoint definition. A loop is decision-relevant when its inclusion changes the predicted output enough to matter for the intended use; a loop's mere biological existence does not establish that it must be modeled in detail.

A reduced-form alternative is to adjust an empirical dose-response relationship so it matches observed intervention data without representing the return mechanism explicitly. This may be adequate for interpolation in a well-characterized setting, but it does not reveal whether the correction will hold when the mechanism or context changes. A mechanistic closed-loop model makes the return path explicit, at the cost of needing evidence for its links and gains. An open-loop model is simpler and may be adequate when the loop is weak, the endpoint is insensitive to it, or the return path is outside the question's relevant timescale.

The linear calculation is a diagnostic, not a substitute for biological validation. Gains can vary with state, drug exposure, time, or disease context; saturation and delays can change the response; and multiple loops can interact. A large predicted amplification near \(L=1\) may signal genuine sensitivity, but it may also indicate that a local linear approximation is being extrapolated beyond its useful range. The algebra cannot establish that a proposed path exists, quantify uncertainty in its gains, or determine transient dynamics. Those judgments require evidence and a model suited to the question.

Common pitfall: A learner sees a negative link in the loop and concludes that feedback must reduce the intervention response. That reasoning ignores the signs of the other links. Compute the product \(L=rb\) around the complete loop: two negative links yield positive \(L\), which is reinforcing in this local model. Also keep the output explicit: the sign of the change in an internal state does not, by itself, determine the sign of the endpoint change.
1
Trace the candidate loop.
Write down the direct response, the downstream mediator, and the return path to the upstream state or endpoint.
2
Calculate its signed gain.
Multiply the local gains around the full path and check the units and sign of \(L\).
3
Compare matched predictions.
Calculate open-loop and closed-loop responses for the same intervention, baseline, and decision output.
4
Check the approximation.
Ask whether the local gains, quasi-steady assumption, and represented pathway are credible for the response being interpreted.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. A local model has \(d=5\) scaled units and \(L=0.20\). What are the open- and closed-loop responses?
  2. If \(b=+0.40\) and \(r=-0.50\), is the loop reinforcing or balancing? State the loop gain.
  3. For \(d=10\) and \(L=-0.25\), calculate the closed-loop response and describe its relation to the open-loop response.
  4. Why can the internal-state comparison be insufficient when the decision output depends directly on a mediator?

Solutions. 1. The open-loop response is \(5.000\) scaled units. The closed-loop response is \(5/(1-0.20)=6.250\) scaled units, so the positive loop amplifies the response. 2. \(L=rb=(-0.50)(+0.40)=-0.20\); the negative loop gain is balancing locally. 3. \(x_{\mathrm{closed}}=10/[1-(-0.25)]=10/1.25=8.000\) scaled units, compared with the open-loop \(+10.00\) scaled units; balancing feedback attenuates, but does not reverse, the response. 4. The endpoint may include an additional mediator contribution, so its change depends on both the state and mediator responses. Compare the endpoint under each boundary assumption rather than infer it from the state alone.

Clinical Biostats