Tutorials › Adaptive Clinical Trial Design › Correcting Exposure-Outcome Bias Under Adaptive Dosing

Adaptive Designs With Pharmacometric Models · Tutorial 517 of 799

Correcting Exposure-Outcome Bias Under Adaptive Dosing

Learn to identify exposure-outcome bias created by adaptive dosing and correct it using measured-history outcome models or inverse-probability weights.

Advanced 12 min read

What You'll Learn

  • Distinguish assigned dose from achieved exposure and define the causal contrast of interest.
  • Explain how evolving prognostic information can confound exposure-outcome comparisons.
  • Derive standardization and inverse-probability weighting for a simple adaptive assignment.
  • Construct sequential weights when dosing decisions depend on updated patient histories.
  • State the assumptions and diagnostics required for weighted and joint-model analyses.
  • Recognize positivity failures, model misspecification, and the limits of measured-confounder adjustment.

Why Adaptive Dosing Can Bias an Exposure-Outcome Analysis

An adaptive dosing rule uses patient information collected during the trial to choose later doses. That information may predict the outcome as well as influence dose assignment. For example, an early biomarker associated with poor prognosis may prompt a dose increase. A comparison of outcomes by achieved exposure can then mix the effect of exposure with the prognostic differences that helped determine it. The observed exposure-outcome association need not equal the causal effect of changing exposure.

The distinction between assigned dose and achieved exposure matters. Assigned dose is a treatment decision; exposure is the resulting drug concentration or another pharmacometric quantity, influenced by dose and patient characteristics such as clearance. A randomized dose comparison may support an intention-to-treat contrast, but a direct analysis of achieved exposure is not automatically randomized. This tutorial concerns adjustment for measured information that drives dosing and predicts outcomes; it does not make unmeasured confounding disappear.

Definition: Exposure-outcome bias under adaptive dosing occurs when the observed relationship between exposure and outcome is distorted because patient history affects both the exposure assigned or achieved and the outcome. In a longitudinal trial, let \(L_t\) denote measured patient information available before dose decision \(t\), \(A_t\) the assigned dose, \(X_t\) the resulting exposure, and \(Y\) the clinical outcome. If \(L_t\) predicts \(Y\) and helps determine \(A_t\) or \(X_t\), crude comparisons by exposure generally do not isolate the effect of exposure.

The target must be stated before adjustment. It might be the mean outcome under a specified exposure regimen compared with another regimen, or the change in expected outcome per unit increase in exposure under a defined model. These are not necessarily the same as the effect of assignment to a dose. For longitudinal questions, a regimen specifies the sequence or rule for doses over time, rather than just a final cumulative exposure.

A Simple Confounding Derivation

Suppose \(U\) is a measured prognostic history variable, \(X\) is exposure, and \(Y\) is a continuous outcome. Consider the linear outcome model

$$ Y=\beta_0+\beta_X X+\beta_U U+\varepsilon, \qquad \mathbb{E}(\varepsilon\mid X,U)=0. $$

The conditional-mean assumption is explicit: it justifies interpreting the specified conditional mean as \(\mathbb{E}(Y\mid X,U)\). If \(U\) is omitted and \(Y\) is regressed only on \(X\), the population slope is

$$ \frac{\operatorname{Cov}(X,Y)}{\operatorname{Var}(X)} = \beta_X+ \beta_U\frac{\operatorname{Cov}(X,U)}{\operatorname{Var}(X)}. $$

To obtain this expression, substitute the outcome model into the covariance. The intercept contributes zero covariance, and the conditional-mean assumption implies \(\operatorname{Cov}(X,\varepsilon)=0\). Thus \(\operatorname{Cov}(X,Y)=\beta_X\operatorname{Var}(X)+\beta_U\operatorname{Cov}(X,U)\). Dividing by \(\operatorname{Var}(X)\) gives the displayed slope. If history predicts both exposure and outcome, the second term is generally nonzero. Adjustment for \(U\) removes this particular omitted-variable contribution under the specified model, but only if the relevant confounders are measured and the model is adequate.

Worked Example: A Crude Comparison Reverses the Within-Stratum Pattern

Suppose a hypothetical trial has 20 patients: 10 with high-risk history and 10 with low-risk history. In the high-risk stratum, 8 receive high exposure and 6 have the event; 2 receive low exposure and both have the event. In the low-risk stratum, 2 receive high exposure and neither has the event; 8 receive low exposure and 2 have the event. These counts total 10 patients in each history stratum, with 10 patients at each exposure level.

The crude event rate is \(6/10=0.600\) under high exposure and \(4/10=0.400\) under low exposure. The crude difference, high minus low, is \(0.600-0.400=0.200\), suggesting a higher event rate with high exposure.

Within the high-risk stratum, the rates are \(6/8=0.750\) at high exposure and \(2/2=1.000\) at low exposure, a difference of \(-0.250\). Within the low-risk stratum, they are \(0/2=0\) and \(2/8=0.250\), also a difference of \(-0.250\). Standardizing both exposure groups to equal proportions of high- and low-risk patients gives rates \((0.750+0)/2=0.375\) and \((1.000+0.250)/2=0.625\). The standardized difference is \(0.375-0.625=-0.250\).

The reversal has a clear explanation: high-risk patients were more likely to receive high exposure, and they had higher event rates. The crude comparison combines exposure differences with this imbalance in prognosis. The standardized contrast adjusts for the measured risk stratum. It is an associational summary unless the causal assumptions described below also hold.

Outcome Modeling and Standardization

For measured history, one approach is to model the outcome conditional on exposure and history, then average predicted outcomes over a common target distribution of history. For a binary outcome, an outcome model might specify \(m(x,u)=P(Y=1\mid X=x,U=u)\). Standardized risk under exposure level \(x\) is then estimated by averaging \(m(x,U_i)\) over the trial participants, rather than comparing the participants who happened to receive each exposure. In the preceding example, the equal-stratum target distribution yields the two standardized rates \(0.375\) and \(0.625\).

For multiple decision times, the outcome model must account for the relevant history and the exposure sequence. A joint likelihood can represent the data-generation process through components for evolving histories, dose or exposure, and outcome, for example \(p(L_1)\prod_{t=1}^T \left\{p(A_t,X_t\mid \text{past},L_t)\,p(L_{t+1}\mid \text{past},L_t,A_t,X_t)\right\}\,p(Y\mid \text{history and exposure sequence})\), with the terminal history term adapted to the trial’s observation schedule. The outcome component estimates the outcome relation conditional on measured history; the exposure and history components describe how the observed treatment paths arose. A joint likelihood is not itself a guarantee of causal correction. The variables, conditional dependencies, and outcome model must be appropriate, and causal contrasts require the same substantive assumptions as other adjustment methods.

Worked Example: The Omitted-History Term in a Joint Model

Consider hypothetical continuous measurements in standardized exposure units and outcome points. Assume the correctly specified outcome model is \(Y=1+0.5X+2U+\varepsilon\), where \(U\) is a measured prognostic marker and \(\mathbb{E}(\varepsilon\mid X,U)=0\). Suppose \(\operatorname{Var}(X)=1.5\) and \(\operatorname{Cov}(X,U)=0.6\). The exposure coefficient conditional on \(U\) is \(0.5\) outcome points per exposure unit.

If \(U\) is omitted, the population regression slope for \(X\) is

$$ 0.5+2\frac{0.6}{1.5} =0.5+0.8 =1.3. $$

Thus the unadjusted slope is 1.3 outcome points per exposure unit, although the specified conditional slope is 0.5. The additional 0.8 arises from the association between exposure and the prognostic marker. A joint specification that models the exposure distribution given \(U\) and the outcome given \(X,U\) can estimate the conditional outcome coefficient under its model assumptions. The calculation does not establish that those assumptions hold in a real trial; it shows exactly how omission can distort the slope.

Sequential Inverse-Probability Weighting

An alternative is to reweight observed treatment histories so that, in the weighted analysis, measured history is less associated with the treatment decisions. Let \(H_t\) denote all measured information available immediately before decision \(t\), including relevant past doses, exposures, and covariates. For discrete dose decisions, the treatment probability at time \(t\) is \(P(A_t=a_t\mid H_t)\). A basic unstabilized weight for an observed sequence is the inverse of its probability under the observed decision process:

$$ W_i=\prod_{t=1}^{T} \frac{1}{P(A_{it}=a_{it}\mid H_{it})}. $$

In practice, stabilized weights often replace the numerator 1 with probabilities conditional on a smaller set of variables or past treatment, chosen to improve stability while preserving the target contrast. For continuous exposure, probabilities are replaced by exposure densities; a weight uses the density under the target exposure assignment divided by the density under the observed assignment, conditional on history. The exposure model must match the variable being analyzed: a dose-assignment probability is not automatically a valid model for achieved concentration.

The rationale is that histories that make an observed treatment path unlikely receive greater weight, compensating for their underrepresentation in that treatment path. This constructs a pseudo-population for the measured history, not a literal randomized sample. For a causal interpretation, required conditions include consistency (the observed outcome under a received regimen equals the corresponding potential outcome), sequential exchangeability (given measured history at each decision, treatment is independent of relevant future potential outcomes), positivity (each regimen being compared has nonzero probability for histories in the target population), and adequate models for the treatment probabilities or densities. Interference and outcome measurement must also be addressed as appropriate to the trial.

Worked Example: Calculating a Two-Decision Stabilized Weight

Suppose a hypothetical participant has two dose decisions, and the observed dose is high at both. At the first decision the probability of high dose under the observed adaptive rule is \(0.50\). At the second it is \(0.20\), conditional on the participant's updated history. For illustration, define the stabilized numerator probability of high dose at each decision as \(0.50\), conditional on past treatment only.

The participant's stabilized weight is the product of the two numerator-to-denominator ratios:

$$ W=\frac{0.50}{0.50}\times\frac{0.50}{0.20} =1.00\times2.50 =2.50. $$

This observed two-decision path was less likely under the adaptive rule than under the chosen numerator model, so it receives weight 2.50. In a weighted analysis, the participant contributes 2.50 times the weight of a participant with weight 1. The calculation is only an illustration: a valid analysis requires probabilities for every observed decision, correctly specified conditional models, and checks that the resulting weights are not dominated by a few patients.

Diagnostics, Alternatives, and Failure Modes

Weighting and outcome modeling target the same broad problem but rely on different statistical models. Outcome modeling predicts outcomes conditional on exposure and history and then standardizes to a target history distribution. Weighting models exposure or dose assignment and uses the resulting probabilities to construct a weighted comparison. A correctly specified outcome model can work well when exposure and history predict the outcome in a tractable way; weighting makes the treatment assignment process explicit, but can be unstable when some observed decisions are rare. Neither approach repairs unmeasured confounding merely by being called a joint model or a weighted analysis.

ApproachWhat is modeledMain vulnerability
Outcome modeling and standardizationOutcome given exposure and measured historyMisspecified outcome relation or omitted confounders
Inverse-probability weightingDose or exposure probability given measured historyNear-zero probabilities, unstable weights, or a poor assignment model
Joint likelihoodMultiple data components, such as history, exposure, and outcomeIncorrect conditional structure or distributional assumptions

Diagnostics should examine whether the assumed adjustment is plausible and whether the data support the contrast. For weighting, inspect the distribution of weights, their range, and the effective sample size; compare measured-history distributions across exposure groups before and after weighting. Extreme weights often indicate near-violations of positivity or an assignment model that predicts probabilities close to zero or one. Truncating weights can reduce variance but changes the estimator and may introduce bias, so the truncation rule and its consequences should be reported. For outcome models, inspect fit, residual patterns where applicable, and whether predictions are extrapolating beyond observed exposure-history combinations. Compare adjusted estimates from reasonable specifications, without treating agreement as proof of no bias.

A common mistake is to say, “The dose algorithm was adaptive, so dose is randomized conditional on the rule; therefore the crude exposure-outcome comparison is unbiased.” Adaptation does not ensure this. If dose depended on a prognostic biomarker, exposure groups can differ on prognosis; moreover, achieved exposure can depend on patient pharmacokinetics even when assigned dose was randomized. The correction is to define the intended causal contrast, identify the information available before each decision, and use an adjustment method whose assumptions and diagnostics are stated. If important confounders were not measured, or the data contain no relevant exposure overlap, the causal effect may not be identified from these data alone.

Key takeaway: Adaptive dosing creates a route from evolving patient history to dose or exposure and from that history to outcome. Model or weight that history explicitly, but interpret the adjusted result causally only when consistency, sequential exchangeability, positivity, and the relevant model assumptions are defensible.

Check Your Understanding

Answer each question, then compare with the solutions.

  1. A biomarker measured before a dose decision predicts the clinical outcome and is used by the algorithm to select dose. Why can a crude comparison by achieved exposure be biased?
  2. In a linear outcome model, suppose \(\beta_U=1.5\), \(\operatorname{Cov}(X,U)=0.4\), and \(\operatorname{Var}(X)=2\). By how much does omission of \(U\) shift the population exposure slope?
  3. For a decision with numerator probability \(0.4\) and observed-history treatment probability \(0.1\), calculate the stabilized weight contribution.
  4. Name two assumptions needed for a causal interpretation of sequentially weighted estimates, and state what each means.
  5. What does a very large inverse-probability weight suggest, and why is simply retaining it without inspection risky?

Solutions. (1) The biomarker influences both dose or exposure and prognosis, so exposure groups differ in outcome risk for reasons other than exposure. (2) The omitted-variable shift is \(\beta_U\operatorname{Cov}(X,U)/\operatorname{Var}(X)=1.5(0.4)/2=0.300\) outcome units per exposure unit. (3) The contribution is \(0.4/0.1=4.00\). (4) Sequential exchangeability means measured history suffices to control treatment-outcome confounding at each decision; positivity means each compared treatment has positive probability at the relevant histories. Consistency is another valid answer: the observed outcome under a received regimen equals that regimen's potential outcome. (5) It indicates that the observed treatment was rare under the modeled history, possibly reflecting weak overlap or model problems. A few such patients can dominate the estimate and make it highly variable or sensitive to model specification.

Clinical Biostats