Tutorials › Physiologically-Based Pharmacokinetics (PBPK) › Diagnosing Time-Structured Residuals

Calibration Versus Independent Validation · Tutorial 709 of 799

Diagnosing Time-Structured Residuals

Learn to define and interpret time-structured residuals in held-out concentration-time data without using diagnostic patterns as a substitute for independent validation.

Advanced 11 min read

What You'll Learn

  • Define raw and log residuals and choose a scale suited to the diagnostic question.
  • Recognize residual patterns that may indicate a delayed predicted peak.
  • Use log-residual trends to compare observed and predicted terminal slopes.
  • Distinguish transient distribution-phase mismatch from persistent profile error.
  • Read residuals against concentration while accounting for time and repeated measurements.
  • Identify when sparse sampling or pooled profiles make a diagnostic ambiguous.

Why Residual Patterns Matter

An observed-predicted plot can show whether predictions tend to lie above or below measurements, but it may hide when those differences occur. A model can match an overall summary while predicting the peak too early, declining too quickly at late times, or describing the early distribution phase poorly. For held-out concentration-time data, plotting residuals against time helps expose these structured discrepancies without refitting the model to the validation observations.

A residual is a signed difference between an observation and its corresponding fixed prediction. The sign convention must be stated because reversing it reverses every visual interpretation. Residual plots are diagnostic displays, not automatic identification of a unique mechanism: several model or data features can produce similar patterns.

Definition: For observation \(i\) at time \(t_i\), let \(C_{\mathrm{obs},i}\) be the observed concentration and \(C_{\mathrm{pred},i}\) the prediction made before examining the held-out observation. The raw residual is \(e_i=C_{\mathrm{obs},i}-C_{\mathrm{pred},i}\), in concentration units. When both concentrations are positive, the log residual is \(r_i=\ln(C_{\mathrm{obs},i}/C_{\mathrm{pred},i})\), which is dimensionless. Under this convention, a positive residual means the observation is above the prediction.

Raw residuals express absolute concentration differences: a residual of \(1\ \mathrm{mg/L}\) has the same vertical distance wherever it occurs. Log residuals express relative differences: \(r_i=0\) means exact agreement, \(r_i>0\) means the observation exceeds the prediction, and \(r_i<0\) means it is lower. For example, \(r_i=\ln(2)\) means the observation is twice the prediction. Log residuals require positive concentrations; they are not defined for zero or negative values.

The basic diagnostic uses residual on the vertical axis and time on the horizontal axis, retaining the recorded units and sampling times. A second useful display places residual against predicted concentration, or shows residuals across concentration ranges. That view can reveal whether discrepancy changes with concentration magnitude. Neither plot should be interpreted in isolation: time and concentration often change together over a profile.

Assumptions and Reading the Displays

These diagnostics are most interpretable when observations are correctly matched to the prediction for the same participant, dose, study, sampling time, and concentration units. Predictions must remain those generated for independent validation; adjusting them after viewing residuals turns a diagnostic exercise into calibration on the held-out data. The comparison also presumes that recorded times and concentrations are sufficiently reliable for the question being asked.

A residual plot does not require residuals to be statistically independent in order to display their pattern. But serial observations from one participant are not automatically independent replications. A run of residuals with the same sign may reflect a coherent within-profile discrepancy; counting every sample as an independent confirmation would exaggerate the evidence. Overlaying participant-specific profiles, where available, helps show whether a pattern recurs across participants or is driven by one profile.

Use time relative to a clearly defined event, such as dose administration, and examine the phases relevant to the prediction question. Sparse sampling can miss the true peak or the transition into a terminal phase. The apparent time of the largest measured concentration is therefore not necessarily the continuous-time peak. Interpret visual patterns as evidence about where and how predictions diverge, not as proof of a specific parameter error.

Worked Example: Recognizing a Delayed Predicted Peak

Suppose a hypothetical held-out profile has the following measured and predicted concentrations. All concentrations are in \(\mathrm{mg/L}\), and times are in hours after dosing.

Time (h)ObservedPredictedRaw residual \(e_i\) (\(\mathrm{mg/L}\))
0.51.22.0-0.8
13.05.0-2.0
28.07.01.0
36.04.02.0
52.02.5-0.5

At each time, subtract the prediction from the observation. For example, at \(1\ \mathrm{h}\), \(e=3.0-5.0=-2.0\ \mathrm{mg/L}\); at \(3\ \mathrm{h}\), \(e=6.0-4.0=2.0\ \mathrm{mg/L}\). The predicted sampled maximum is \(5.0\ \mathrm{mg/L}\) at \(1\ \mathrm{h}\), whereas the observed sampled maximum is \(8.0\ \mathrm{mg/L}\) at \(2\ \mathrm{h}\). Negative residuals before the observed peak and positive residuals around the later observed peak are consistent with the model predicting the peak too early and underpredicting concentrations as the observed profile rises later.

This is a diagnostic clue, not a unique explanation. A shift in absorption timing could produce such a pattern, but sparse samples, inaccurate dose timing, or another mismatch in the rising and peak phases could also contribute. The residual sequence alone does not establish which explanation is correct.

Terminal Slope and Distribution-Phase Patterns

For a terminal phase that is approximately log-linear, a change in the slope of log concentration over time appears as a systematic trend in log residuals. The connection follows directly from the definition. Since \(r(t)=\ln C_{\mathrm{obs}}(t)-\ln C_{\mathrm{pred}}(t)\), differentiating over a time interval where both profiles are positive and smooth gives:

$$ \frac{d r(t)}{dt} = \frac{d\ln C_{\mathrm{obs}}(t)}{dt} - \frac{d\ln C_{\mathrm{pred}}(t)}{dt}. $$

Thus, if the observed log concentration declines less steeply than the predicted log concentration, the observed log-slope is less negative, \(r(t)\) tends to increase with time, and late observations tend to lie progressively above predictions. The reverse pattern is consistent with predictions declining less steeply than observations. This interpretation concerns the slopes of the compared profiles; it does not by itself identify an elimination parameter or prove that the sampled interval represents a single terminal process.

Worked Example: Diagnosing a Terminal-Slope Mismatch

Consider hypothetical late-phase concentrations at 10, 20, and 30 hours. The predicted concentrations are \(4.0\), \(2.0\), and \(1.0\ \mathrm{mg/L}\); the observations are \(4.0\), \(2.8\), and \(2.0\ \mathrm{mg/L}\). Calculate the log residuals and compare the slopes across 10 to 30 hours.

The log residual is the natural log of observed divided by predicted concentration. The three values are:

$$ r_{10}=\ln(4.0/4.0)=0,\qquad r_{20}=\ln(2.8/2.0)=\ln(1.4)=0.3365,\qquad r_{30}=\ln(2.0/1.0)=\ln(2)=0.6931. $$

The residual becomes increasingly positive: the observed concentration is twice the prediction at 30 hours. The predicted log-slope from 10 to 30 hours is \(\{\ln(1.0)-\ln(4.0)\}/20=-0.06931\ \mathrm{h}^{-1}\). The observed log-slope over the same interval is \(\{\ln(2.0)-\ln(4.0)\}/20=-0.03466\ \mathrm{h}^{-1}\). The observed decline is less steep. Their difference is \(0.03466\ \mathrm{h}^{-1}\), consistent with the increase in log residual from 0 to 0.6931 over 20 hours.

This pattern flags a terminal-slope discrepancy in the displayed interval. It does not establish that the interval is a true terminal phase: if distribution or absorption is still contributing, the slope comparison may describe a transient rather than terminal disposition. More late samples or other supporting evidence may be needed to interpret the cause.

A distribution-phase mismatch often appears as a transient pattern: residuals change systematically during an early post-peak interval and then move closer to zero later. For example, predictions may be too high during an early decline but align at later times, or the reverse. Such a localized pattern differs visually from a persistent late residual trend, but its timing alone cannot separate distribution from absorption, sampling, or other sources of model-data mismatch.

Worked Example: Identifying a Transient Distribution-Phase Pattern

In another hypothetical profile, observed and predicted concentrations are as follows, in \(\mathrm{mg/L}\):

Time (h)ObservedPredictedLog residual \(r_i\)
0.56.08.0\(\ln(6/8)=-0.2877\)
14.05.0\(\ln(4/5)=-0.2231\)
22.52.6\(\ln(2.5/2.6)=-0.03922\)
41.21.2\(\ln(1.2/1.2)=0\)

For the first observation, \(r=\ln(6.0/8.0)=\ln(0.75)=-0.2877\); the observed value is below prediction. The residuals then approach zero, reaching exact agreement at 4 hours. This is consistent with a transient early-phase mismatch followed by closer agreement. It does not identify distribution as the cause: the early profile may also be affected by absorption timing or sampling density. Calling it a distribution-phase mismatch is a hypothesis to investigate, not a conclusion forced by this table.

Using Concentration Plots and Avoiding Misdiagnosis

Residuals plotted against predicted concentration can help distinguish a roughly constant absolute discrepancy from one that changes across concentration magnitudes. If raw residuals spread or shift with predicted concentration, the mismatch may depend on concentration level. Log residuals instead emphasize proportional differences. For instance, the same ratio of observed to predicted concentration produces the same log residual at low and high concentrations, even though the corresponding raw differences are different.

Concentration and time are often linked: concentrations commonly rise and then fall as time advances. A pattern against concentration may therefore be another view of a time-dependent pattern, not independent evidence of a concentration-dependent mechanism. Compare both displays and, when useful, inspect early, peak, and late portions separately. If participants have different concentration ranges or sampling schedules, a pooled display can also conceal opposing individual patterns.

Common failure modes include treating every residual as independent, interpreting a few noisy points as a smooth slope, and inferring a unique physiological cause from a visual signature. A sign change near the peak is not enough to locate peak-time error unless sampling is adequate on both sides. Likewise, an increasing late log-residual trend is informative only if the interval being examined plausibly represents the phase whose slope is being compared. Check units, time alignment, participant-level profiles, and the actual sampling schedule before assigning meaning to a pattern.

Diagnostic displayWhat it can revealImportant limitation
Residual versus timeWhen underprediction, overprediction, or a transient phase mismatch occursPatterns may be driven by sparse samples or a subset of participants
Log residual versus timeRelative discrepancy and a trend associated with differing log-slopesRequires positive concentrations; a slope pattern does not identify its cause
Residual versus predicted concentrationWhether discrepancies vary across concentration magnitudesConcentration and time are commonly confounded within a profile
Observed-predicted plotOverall direction and magnitude of agreement across observationsMay obscure the sequence of discrepancies across time

Observed-predicted plots and summary endpoints remain useful complements: they answer different questions from time-residual plots. A summary can agree while a phase-specific pattern remains, and a time plot can reveal that pattern without reducing the entire profile to one number. These diagnostics do not establish a pass-or-fail threshold, quantify predictive error, or replace the prespecified validation question. Their value is in locating and describing model-data disagreement while preserving the independence of the held-out predictions.

Key takeaway: Plot signed residuals against time to locate when predictions diverge, and use log residuals to examine proportional discrepancy and possible slope differences. Treat delayed peaks, terminal trends, and transient early-phase patterns as diagnostic signatures to investigate, not as uniquely identified mechanisms.

Check Your Understanding

Answer each question using the residual convention \(e=C_{\mathrm{obs}}-C_{\mathrm{pred}}\) and, where relevant, \(r=\ln(C_{\mathrm{obs}}/C_{\mathrm{pred}})\).

  1. At a sampling time, the observed concentration is \(3.0\ \mathrm{mg/L}\) and the prediction is \(4.0\ \mathrm{mg/L}\). Find the raw and log residuals and interpret their signs.
  2. Late log residuals increase from 0.10 to 0.50 over time. What slope relationship is consistent with this pattern, and what can the pattern not establish on its own?
  3. Observed concentrations peak later than predicted concentrations, with negative residuals before the observed peak and positive residuals near it. Name the diagnostic concern and one reason the interpretation could be uncertain.
  4. Why might residuals versus predicted concentration show a pattern that is not independent of the pattern in residuals versus time?

Solutions. (1) \(e=3.0-4.0=-1.0\ \mathrm{mg/L}\), and \(r=\ln(3.0/4.0)=\ln(0.75)=-0.2877\). Both are negative, so the observation is below prediction; the log residual expresses the proportional difference. (2) An increasing log residual is consistent with the observed log concentration declining less steeply, or increasing more steeply, than the predicted log concentration over that interval. It does not establish a unique mechanism or prove the interval is a terminal phase. (3) The pattern is consistent with a predicted peak that occurs too early. Sparse sampling, for example, may make the sampled peak times poor representations of the continuous-time peaks. (4) Concentration usually changes systematically over time within a profile, so a residual pattern associated with time may also appear when the horizontal axis is concentration. The two displays are not necessarily independent evidence.