Tutorials › Marginal Structural Models › Fluctuation Models for Continuous Outcomes

Longitudinal Targeted Maximum Likelihood · Tutorial 369 of 501

Fluctuation Models for Continuous Outcomes

Learn to select and fit continuous-outcome fluctuation submodels while preserving, or recognizing when you cannot preserve, the outcome’s support.

Advanced 12 min read

What You'll Learn

  • Derive the identity fluctuation update by minimizing squared error.
  • Construct a bounded-outcome fluctuation by rescaling outcomes and using a logistic link.
  • Interpret the score equations as weighted residual-balance conditions.
  • Identify when a fluctuation preserves the outcome range and when it does not.
  • Diagnose boundary initial predictions, unstable updates, and non-finite logistic estimates.
  • Compare the assumptions and limitations of identity and bounded-outcome updates.

Why the Fluctuation Link Matters

A fluctuation submodel changes an initial outcome regression in a restricted direction so that the updated regression can respond to an empirical score equation. For continuous outcomes, the choice of link is consequential: an identity-link update is simple and directly adjusts predictions, while a bounded-outcome update can keep predictions inside a known range. Neither choice is universally preferable.

The setup here is one targeting step. For observation \(i\), let \(Y_i\) be the outcome or current regression target, \(Q_{0i}\) its initial prediction, and \(H_i\) a known targeting covariate. In longitudinal TMLE, \(H_i\) may be a clever covariate evaluated for the regression being targeted. Treating these quantities as fixed during the fluctuation makes the comparison precise; deriving the longitudinal sequence of targeting steps is a separate task.

Definition: A fluctuation submodel is a one-parameter family \(Q_\epsilon\), indexed by \(\epsilon\), that starts at the initial regression \(Q_0=Q_{\epsilon=0}\). The fitted fluctuation parameter \(\hat\epsilon\) is chosen by an estimating equation or a specified empirical loss. A targeting covariate \(H\) determines the direction in which the initial predictions can change.

The empirical score equation often has the form \(\sum_{i=1}^n H_i(Y_i-Q_{\hat\epsilon,i})=0\), or a constant multiple of it. This equation balances residuals after weighting them by \(H_i\). The fluctuation model determines how \(\epsilon\) changes the predictions and therefore whether this equation can be solved while retaining valid predictions.

Identity-Link Fluctuations

For an identity-link fluctuation, set \(Q_{\epsilon,i}=Q_{0i}+\epsilon H_i\). This is natural when the outcome is real-valued without a finite range constraint, or when it is acceptable for a working regression prediction to fall outside a physical range. A standard fitting criterion is squared error, equivalent to a Gaussian working likelihood with constant variance.

Result: If \(\sum_{i=1}^n H_i^2>0\), minimizing \(\sum_{i=1}^n\{Y_i-(Q_{0i}+\epsilon H_i)\}^2\) gives \[ \hat\epsilon=\frac{\sum_{i=1}^n H_i(Y_i-Q_{0i})}{\sum_{i=1}^n H_i^2}. \] The fitted value satisfies \(\sum_{i=1}^n H_i(Y_i-Q_{\hat\epsilon,i})=0\).

To verify this result, define \(R_i=Y_i-Q_{0i}\). The criterion is \(S(\epsilon)=\sum_i(R_i-\epsilon H_i)^2\). Differentiating gives \(S'(\epsilon)=-2\sum_i H_i(R_i-\epsilon H_i)\), and \(S''(\epsilon)=2\sum_i H_i^2>0\). Thus the unique minimizer solves \(\sum_i H_iR_i-\epsilon\sum_iH_i^2=0\), yielding the stated formula. Substitution gives the score equation. This is a finite-sample derivation; it does not require an asymptotic approximation. \(\square\)

Worked Example: Fitting an Identity Fluctuation

Suppose three observations have \(Q_{0i}=(2,4,5)\), \(Y_i=(3,5,4)\), and \(H_i=(1,2,1)\). The residuals \(Y_i-Q_{0i}\) are \((1,1,-1)\). Therefore, \[ \sum_i H_i(Y_i-Q_{0i})=1(1)+2(1)+1(-1)=2, \qquad \sum_i H_i^2=1+4+1=6. \] Hence \(\hat\epsilon=2/6=1/3\).

The updated predictions are \(2+1/3=7/3\), \(4+2/3=14/3\), and \(5+1/3=16/3\). The updated residuals are \(2/3\), \(1/3\), and \(-4/3\). Their weighted sum is \(1(2/3)+2(1/3)+1(-4/3)=0\), confirming the score equation. The predictions are permitted here because no finite support restriction was imposed.

The identity model is convenient because its fit has a closed form and directly expresses the score balance. However, if \(Y\) is known to lie in \([a,b]\), the updated value \(Q_{0i}+\hat\epsilon H_i\) can be less than \(a\) or greater than \(b\). The score equation alone does not prevent this.

Bounded Outcomes and Logistic Fluctuations

Suppose the outcome is known to lie in a finite interval \([a,b]\), with \(a<b\), and the initial predictions also lie in that interval. Rescale both to \([0,1]\): \(Y_i^*=(Y_i-a)/(b-a)\) and \(Q_{0i}^*=(Q_{0i}-a)/(b-a)\). When \(0<Q_{0i}^*<1\), a bounded-outcome fluctuation is \[ Q_{\epsilon,i}^*=\operatorname{expit}\{\operatorname{logit}(Q_{0i}^*)+\epsilon H_i\}, \qquad Q_{\epsilon,i}=a+(b-a)Q_{\epsilon,i}^*. \]

Here \(\operatorname{expit}(u)=1/(1+\exp(-u))\) and \(\operatorname{logit}(p)=\log\{p/(1-p)\}\). For a continuous bounded outcome, fitting this fluctuation by a Bernoulli log-likelihood expression is a working loss or quasi-likelihood criterion; it does not assert that the outcome is Bernoulli. The transformed outcome \(Y_i^*\) can be fractional.

Result: Use the empirical criterion \[ \ell(\epsilon)=\sum_{i=1}^n\left[Y_i^*\log(Q_{\epsilon,i}^*)+(1-Y_i^*)\log(1-Q_{\epsilon,i}^*)\right]. \] For finite \(\epsilon\), its score is \[ \ell'(\epsilon)=\sum_{i=1}^n H_i(Y_i^*-Q_{\epsilon,i}^*). \] Thus an interior maximizer solves a weighted residual-balance equation on the rescaled outcome scale.

For the derivation, write \(\eta_i(\epsilon)=\operatorname{logit}(Q_{0i}^*)+\epsilon H_i\). Since \(dQ_{\epsilon,i}^*/d\epsilon=H_iQ_{\epsilon,i}^*(1-Q_{\epsilon,i}^*)\), differentiating the \(i\)th summand gives \[ H_iQ_{\epsilon,i}^*(1-Q_{\epsilon,i}^*)\left\{\frac{Y_i^*}{Q_{\epsilon,i}^*}-\frac{1-Y_i^*}{1-Q_{\epsilon,i}^*}\right\} =H_i(Y_i^*-Q_{\epsilon,i}^*). \] Summing proves the score formula. Also, \[ \ell''(\epsilon)=-\sum_i H_i^2 Q_{\epsilon,i}^*(1-Q_{\epsilon,i}^*)\leq 0. \] If at least one \(H_i\ne0\), all initial predictions are strictly interior, and \(\epsilon\) is finite, then \(\ell''(\epsilon)<0\). The criterion is strictly concave, so any finite score root is its unique maximizer. A finite root is not guaranteed: if the score approaches zero only as \(\epsilon\) tends to infinity, the supremum can occur at an infinite coefficient. \(\square\)

For every finite \(\epsilon\) and finite \(H_i\), \(0<Q_{\epsilon,i}^*<1\), because the expit of a finite number is strictly between zero and one. Consequently, \(a<Q_{\epsilon,i}<b\). This is the support-preservation property of the bounded fluctuation. It does not put the predictions exactly at \(a\) or \(b\); exact boundary predictions require an infinite linear predictor.

Worked Example: A Bounded Update Near the Upper Boundary

Let the outcome and initial prediction be on \([0,1]\), with \(Q_0=0.90\), \(H=1\), and consider \(\epsilon=0.15\). Since \(\operatorname{logit}(0.90)=\log(9)\), \[ Q_\epsilon=\operatorname{expit}\{\log(9)+0.15\} =\frac{1}{1+\exp\{-(\log(9)+0.15)\}} \approx 0.9127. \] The updated prediction remains below 1. The change is about \(0.0127\), not \(0.022\).

This calculation illustrates how the same additive fluctuation parameter acts on the log-odds scale, not the outcome scale. A value of \(\epsilon=0.15\) is therefore not an increase of 0.15 in the predicted outcome. The actual fitted \(\hat\epsilon\) must be obtained from the chosen empirical criterion and the data.

Worked Example: Rescaling a Bounded Continuous Outcome

Suppose a laboratory measurement is known to lie in \([10,30]\). An initial prediction of 20 rescales to \(Q_0^*=(20-10)/(30-10)=0.5\). Let \(H=1\) and use \(\epsilon=\log(2)\). The updated odds on the rescaled scale are the initial odds \(0.5/(1-0.5)=1\), multiplied by \(\exp\{\log(2)\}=2\). Thus \(Q_\epsilon^*=2/(1+2)=2/3\), and transforming back gives \[ Q_\epsilon=10+20(2/3)=70/3\approx23.33. \] This prediction is inside the stated outcome range. The calculation depends on the range being valid for the measurement; rescaling does not make an incorrect support assumption true.

Support Requirements and Practical Diagnostics

The bounded update requires a defensible finite range \([a,b]\), observed outcomes in that range, and initial predictions strictly inside it. If a prediction equals a boundary, its logit is not finite and the displayed submodel cannot be evaluated as written. A common numerical remedy is to replace the rescaled initial prediction by \(\min(1-\delta,\max(\delta,Q_{0i}^*))\) for a small prespecified \(\delta>0\). This is a deliberate modification of the initial regression, not an algebraic identity, and results can depend on the chosen truncation.

The identity fluctuation has no such logit-boundary problem, but it also has no automatic support protection. When predictions must represent probabilities, proportions, or measurements with known hard limits, inspect every updated prediction. Conversely, applying a bounded logistic fluctuation to an outcome that is genuinely unbounded requires an unjustified range choice and can distort the target.

Useful diagnostics include the fitted \(\hat\epsilon\), the score at the fitted value, the range of updated predictions, and the stability of the update under reasonable numerical tolerances. A very large absolute coefficient can indicate that the score root is near infinity, that a few observations dominate the fluctuation, or that the initial predictions are near a boundary. If all \(H_i=0\), neither model can move the predictions in the targeted direction: the identity denominator is zero and the logistic score is identically zero. For the logistic criterion, a score that does not cross zero at any finite \(\epsilon\) should not be reported as a finite converged fit.

FeatureIdentity-link fluctuationBounded logistic fluctuation
Outcome supportReal-valued; does not preserve a finite rangeRequires a known finite interval and interior initial predictions
Update scaleAdds \(\epsilon H\) on the outcome scaleAdds \(\epsilon H\) on the logit scale after rescaling
FittingSquared-error fit has a closed-form solution if \(\sum_iH_i^2>0\)Concave criterion; generally solved numerically, with finite root not guaranteed
Boundary behaviorCan cross support limitsFinite updates stay strictly inside the chosen limits

The earlier material on logistic fluctuations for binary outcomes uses the same logit form, but a continuous bounded outcome is not thereby a binary variable. The rescaled fractional outcome enters the working criterion, and the support claim concerns the fitted conditional mean. In contrast to identity-link targeting, the bounded update trades a direct additive change for range preservation and a nonlinear response scale.

Both approaches are limited by the chosen one-dimensional fluctuation direction: they only alter the initial predictions through \(H\). Neither link repairs a misspecified initial regression or a poorly chosen targeting covariate. Selection should be based on the outcome’s support, the meaning of the predictions, and stable fitting—not on a preference for one link in isolation.

Check Your Understanding

Work each problem, then compare with the solutions below.

  1. For an identity fluctuation, let \(Y-Q_0=(2,-1)\) and \(H=(1,2)\). Find \(\hat\epsilon\) and verify the weighted residual equation.
  2. Why does a finite logistic fluctuation preserve predictions in \((a,b)\), but not generally attain either endpoint?
  3. A bounded outcome lies in \([0,100]\). Its initial prediction is 50, with \(H=1\), and \(\epsilon=0\). What is the updated prediction?
  4. What is the identity-link denominator when every \(H_i=0\), and what does this mean for targeting?
  5. State one reason a bounded logistic fluctuation is inappropriate for an unbounded outcome.

Solutions. (1) The numerator is \(1(2)+2(-1)=0\), and the denominator is \(1^2+2^2=5\), so \(\hat\epsilon=0\). The updated residuals remain \((2,-1)\), and their weighted sum is \(2-2=0\). (2) The expit of every finite real number lies strictly between 0 and 1; rescaling back therefore gives a value strictly between \(a\) and \(b\). (3) The rescaled initial prediction is \(0.5\), and \(\epsilon=0\) leaves it unchanged, so the answer is 50. (4) The denominator is \(\sum_iH_i^2=0\); the submodel cannot change any prediction in the targeting direction. (5) A finite interval would have to be imposed without support justification, and the update would constrain predictions to that arbitrary interval.

Clinical Biostats