Why Dropout Can Change the PKPD Conclusion
Longitudinal PKPD analyses use repeated measurements to describe how exposure, efficacy, or toxicity changes over time. If participants stop treatment or leave follow-up, later outcomes may be missing. The key issue is not simply how many values are missing, but why they are missing. Participants with poor response may be more likely to discontinue for lack of efficacy; participants with high toxicity may stop even when their response is good. Either process can make those still observed at later visits unrepresentative of the original cohort.
First distinguish treatment discontinuation from dropout from outcome follow-up. A participant may stop study treatment but continue to provide efficacy and safety measurements. Those measurements can be relevant to an analysis of outcomes under a treatment-policy strategy, which includes outcomes after discontinuation. If follow-up also ends, later outcomes are missing. An analysis asking what would have happened had everyone continued treatment targets a different, hypothetical estimand; observations after stopping treatment do not directly supply that counterfactual.
This tutorial focuses on a scheduled longitudinal outcome, such as a response score. The same reasoning applies to PKPD outcomes, but the target and the way the outcome is defined must be stated. For example, a concentration measured after treatment stops is not interchangeable with the concentration that would have occurred under continued treatment.
Start With the Estimand and Missingness Assumptions
A missing-data method cannot decide what scientific question to answer. State the target first: for example, the mean week-12 response score among all randomized participants under a strategy that continues outcome collection even after treatment discontinuation. If follow-up ends at treatment discontinuation, that week-12 outcome is unobserved for some participants. A complete-case mean then describes participants with observed week-12 outcomes, not automatically the original cohort.
A common working assumption is missing at random (MAR): conditional on recorded information available before the outcome goes missing, whether the outcome is observed does not additionally depend on its unobserved value. The recorded history could include baseline severity, earlier response, prior toxicity, exposure, treatment assignment, and recorded reason for stopping. MAR is a conditional independence assumption, not a claim that dropout is unrelated to outcomes. By contrast, if observation still depends on the unobserved outcome after conditioning on that history, the process is missing not at random (MNAR).
MAR cannot generally be confirmed from observed outcomes alone: values that were never measured cannot be compared with the values that were measured. Recorded reasons for discontinuation and earlier trajectories can make a proposed model more credible, but they do not establish the assumption. A dropout-adjusted analysis should therefore be accompanied by diagnostics and, when plausible, sensitivity analyses for departures from MAR.
Worked Example: How Selective Dropout Changes a Mean
Consider six hypothetical participants whose higher week-12 response scores indicate better response. Three remain in follow-up; three discontinue or leave follow-up before week 12. To illustrate selection bias, suppose the complete-data simulation values for all six are known to the instructor, although the three values after dropout would be unavailable in an actual analysis.
| Participant | Recorded history or reason | Week-12 score |
|---|---|---|
| A | Remains in follow-up | 10 |
| B | Remains in follow-up | 12 |
| C | Remains in follow-up | 14 |
| D | Discontinues for inadequate response | 4 (unobserved after dropout) |
| E | Discontinues after toxicity | 8 (unobserved after dropout) |
| F | Discontinues after toxicity | 6 (unobserved after dropout) |
The complete-data mean in this illustration is
The mean among the three observed participants is
Thus, the observed-participant mean is 3.000 points above the complete-data mean. In a real study, the missing scores 4, 8, and 6 would not be known, so this difference could not be calculated directly. The example shows why a complete-case estimate can be misleading when retention is related to response or toxicity history. It does not show that toxicity necessarily predicts a lower response; that relationship would need to be assessed in the study data.
Inverse-Probability Weighting
Inverse-probability weighting (IPW) gives more weight to observed participants who resemble people with similar recorded histories but are less likely to remain observed. At a single target visit, let \(H_i\) denote the recorded history used to model retention and let \(\pi_i=P(R_i=1\mid H_i)\) be the estimated probability that participant \(i\)'s outcome is observed, conditional on that history. A normalized, or Hájek, weighted mean is
Only participants with observed outcomes contribute to the sums. A participant with a small estimated observation probability receives a larger weight, representing similar participants who are missing. In monotone longitudinal dropout, the probability of being observed at a later visit can be modeled from the sequence of conditional retention probabilities at earlier intervals. The weight for remaining observed through visit \(t\) is the reciprocal of that cumulative probability.
Why the Weighting Formula Works
The basic justification is an inverse-probability identity. Suppose the probability of observation is \(\pi(H)=P(R=1\mid H)\), with \(\pi(H)>0\), and assume \(R\) is conditionally independent of \(Y\) given the recorded history \(H\). Conditional on \(Y\) and \(H\), the expected weighted contribution is
The equality \(E(R\mid Y,H)=\pi(H)\) uses the conditional independence assumption. Averaging over participants therefore recovers the target outcome mean in expectation when the assumptions hold. Replacing the population quantities with estimated probabilities and dividing by the sum of weights yields the normalized estimate above. This derivation explains both the appeal and the vulnerability of IPW: if the recorded history omits a factor that links dropout to the outcome, or if a retention probability is near zero, the result can be biased or unstable.
Worked Example: An Exact IPW Calculation
Suppose a hypothetical cohort has four participants with a favorable week-4 response history and four with a poor week-4 response history. At week 12, three participants in the favorable-history group are observed, with scores 8, 10, and 12 points. One participant in the poor-history group is observed, with a score of 2 points. Assume the observed fractions, three of four and one of four, are the correct retention probabilities for these histories, and assume outcomes are representative of other participants within each history group.
The estimated observation probabilities are \(3/4\) and \(1/4\), so the corresponding inverse-probability weights are \(4/3\) and \(4\). The complete-case mean is
The IPW estimate, retaining the exact fractional weights throughout the calculation, is
The adjustment lowers the estimated mean because the observed participant with a poor-response history represents a group with a low probability of retention. The change from 8.000 to 6.000 points is not proof that 6.000 is correct: its interpretation depends on the stated retention probabilities, within-history representativeness, and positivity. With only these few hypothetical participants, the probabilities would be estimated imprecisely in practice.
Likelihood Models and Sensitivity Analyses
IPW is not the only approach. A likelihood-based longitudinal model, such as a mixed-effects model fitted to the observed outcomes, can use incomplete outcome histories without first filling in every missing value. Under a correctly specified outcome model and an appropriate MAR assumption, likelihood inference can be valid. It relies on a different model specification from IPW: the outcome model describes the longitudinal outcomes, while IPW models observation. Comparing the two can reveal sensitivity to modeling choices, but agreement does not prove that either assumption is correct.
When dropout may depend on unobserved outcomes, a sensitivity analysis makes that uncertainty explicit. For example, a pattern-mixture analysis can shift the outcomes predicted for participants who drop out by a chosen amount relative to predictions under MAR. The shift is a sensitivity parameter, not a value learned from the observed outcomes alone. A joint model can instead specify a shared association between longitudinal outcomes and time to dropout, but its conclusions also depend on assumptions about the joint distributions and association structure.
Worked Example: A Toxicity-Related MNAR Sensitivity Analysis
Suppose a hypothetical study targets the mean week-12 response score for four participants under a treatment-policy strategy, and outcome follow-up is intended to continue after treatment discontinuation. Two participants remain observed, with scores of 9 and 11 points. Two others discontinue after toxicity and have no week-12 measurement. Under an MAR analysis, suppose their predicted mean scores are each 10 points, the mean of the observed outcomes.
The MAR-based mean is
Now consider a sensitivity scenario in which each missing score is 3 points lower than its MAR prediction because toxicity-related discontinuation is associated with a worse unobserved response. The shifted predictions are \(10-3=7\) points for each participant, giving
The MAR estimate is 10.00 points, while this specified MNAR scenario gives 8.500 points. The difference is a consequence of the chosen 3-point shift, not an empirically established correction. A useful analysis would examine several clinically plausible shifts and report how they affect the substantive conclusion. If outcomes were not collected after discontinuation, the treatment-policy target would require additional assumptions or a different estimand; the observed data alone cannot supply the missing measurements.
Diagnostics, Comparisons, and Failure Modes
Before interpreting a dropout-adjusted estimate, examine the observation process itself. Summarize retention by visit, treatment group, recorded response history, toxicity history, and reason for discontinuation. Compare observed earlier trajectories between participants who remain and those who later leave. Such comparisons can reveal measured predictors of dropout and help specify the retention or outcome model. They cannot rule out dependence on the unobserved outcome.
For IPW, inspect the distribution of estimated probabilities and weights. Very small observation probabilities produce large weights, so a few participants may dominate the estimate. One simple diagnostic is the effective sample size, calculated from the observed weights \(w_i=1/\hat{\pi}_i\):
This quantity is no greater than the number of observed outcomes and becomes small when a few large weights dominate. Also check whether histories associated with dropout have any observed participants at all. If a history has zero probability of observation, the positivity assumption fails; reweighting cannot recover its outcomes from the data without further modeling or external information. Weight truncation can limit the influence of extreme weights, but it changes the estimator and may introduce bias. Report the rule and compare results with and without truncation rather than treating it as a guaranteed fix.
| Approach | What it relies on | Main limitation |
|---|---|---|
| Complete-case analysis | Observed participants adequately represent the target population for the analysis. | Can be biased when retention depends on response, toxicity, or related history. |
| IPW | A well-specified retention model, MAR given recorded history, and positivity. | Estimated weights can be unstable; unmeasured or unobserved predictors remain a concern. |
| Likelihood-based longitudinal model | A suitable outcome model and an appropriate MAR assumption. | Results can depend on the outcome model; MAR is not verified by model fit alone. |
| MNAR sensitivity analysis or joint model | Explicit assumptions about how unobserved outcomes relate to dropout. | Conclusions may depend on sensitivity parameters or untestable joint-model assumptions. |
A common mistake is to say, “The complete cases are the patients who tolerated treatment, so their mean is the treatment effect.” That reasoning confuses a selected observed group with the target population, and it may also confuse outcomes under continued treatment with outcomes under a strategy that includes discontinuation. The correction is to define the estimand, describe which outcomes are missing and why, then state the assumptions that connect observed outcomes to the target. A related mistake is to regard an MAR fit or a set of finite weights as proof that dropout is ignorable. Diagnostics can expose problems, but no observed-data diagnostic can verify what unobserved outcomes would have been.
Specify the population, outcome, visit, and how outcomes after treatment discontinuation are handled.
Summarize retention over time and relate it to recorded response, exposure, toxicity, and discontinuation history.
Use an outcome model or a retention model suited to the target, and check model fit, positivity, and influential weights.
Contrast the adjusted result with complete-case results and examine plausible departures from MAR when they could change the conclusion.
Informative dropout matters because treatment discontinuation and loss of follow-up can selectively remove participants with clinically important response or toxicity histories from later analyses. A complete-case estimate remains a useful description of observed participants, but it is not automatically an estimate for everyone enrolled. A credible PKPD conclusion makes the target explicit, presents the dropout assumptions, and shows whether the conclusion is robust to reasonable alternatives.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions.
- In a study, participants stop treatment for toxicity but continue to provide week-12 response scores. Are those scores missing because of treatment discontinuation?
- For an observed outcome with estimated retention probability \(0.5\), what inverse-probability weight is used, and what does it represent?
- Why can a large IPW estimate be unstable even when the retention probabilities are positive?
- In the toxicity sensitivity example, what is the mean if the two missing outcomes are shifted 5 points below their MAR predictions of 10 points?
Solutions. (1) No. Treatment stopped, but the week-12 outcome was collected, so it remains observed for an estimand that includes post-discontinuation outcomes. (2) The weight is \(1/0.5=2\); the observed participant represents similar participants who had a one-half chance of being observed, under the weighting assumptions. (3) A few very large weights can dominate the weighted estimate and reduce its effective sample size, making it sensitive to small changes in the data or model. (4) Each missing outcome is \(10-5=5\) points, so the mean is \((9+11+5+5)/4=30/4=7.500\) score points.