Tutorials › Nonlinear Mixed-Effects Models (NLME) › Aligning VPCs Across Doses and Regimens

Visual and Numerical Predictive Checks · Tutorial 581 of 797

Aligning VPCs Across Doses and Regimens

Learn to align visual predictive checks with the dose events and regimen features that define the predictive question, without pooling unlike concentration profiles.

Intermediate 11 min read

What You'll Learn

  • Define time since dose and regimen phase for a VPC.
  • Decide when dose levels or schedules need separate panels or strata.
  • Calculate a simulation-based prediction interval for a binned quantile.
  • Recognize when equal time-since-dose values still represent different dose histories.
  • Identify misleading pooling and sparse-stratum problems.
  • Choose between elapsed-time, dose-relative, and regimen-specific displays.

Why Dose and Regimen Alignment Matters

A visual predictive check (VPC) compares observed data summaries with the corresponding summaries from replicate data simulated under a fitted model. For a concentration VPC, those summaries are commonly quantiles within time bins. A time axis that ignores how and when doses were given can combine observations that do not represent the same pharmacological situation. A resulting trend may then reflect a mixture of dose histories rather than a clear assessment of predictive performance.

The choice of alignment is part of defining the predictive target. Elapsed time from the start of a study may be useful when the question concerns the whole study course. Time since a dose may be more useful for a single-dose profile. For repeated or changing doses, a regimen-specific panel may be needed because the same time since the latest dose can follow different prior exposure.

Definition: For subject \(i\), let \(t_{ik}\) be the time of observation \(k\), and let \(t_{ij}\) be the times of that subject’s dose events. The time since the most recent dose at the observation is \(s_{ik}=t_{ik}-\max\{t_{ij}:t_{ij}\le t_{ik}\}\). A VPC is dose-aligned when its time axis, panels, or strata are chosen so that observations being compared have relevant dose timing and regimen features in common.

Dose alignment does not mean that every VPC should use time since the last dose. It means that the display should match the scientific question and preserve important features of the data-generating design. In particular, simulations used for the VPC should reproduce the observation times, dose amounts, dose times, and other design features relevant to that target. If they do not, discrepancies between observed and simulated summaries may be caused by a mismatch in the comparison rather than by the model.

Choosing an Axis and a Comparison

For a single dose, time since administration is usually a direct way to compare the absorption and disposition profile across subjects. If sampling times are recorded from study start and dose times differ, calculate time since dose from the event records rather than treating study time as though it were dose-relative. If doses differ in amount, separate dose panels or dose strata can show whether the model reproduces each level. A pooled display is appropriate only when the pooled population is itself the intended target and the design has been represented correctly in simulation.

For repeated dosing, the time since the most recent dose is helpful but may not be sufficient. Concentration after a dose can depend on earlier doses, the dosing interval, missed or delayed doses, and whether the subject has reached the relevant treatment phase. Thus, observations at the same \(s_{ik}\) can be aligned on the horizontal axis but still belong to different predictive conditions. Use panels or strata for regimen features that materially change the expected profile, such as dosing interval or dose level. When doses change over time, consider whether the target is the current-dose response, the entire dose history, or a particular treatment phase; these are not interchangeable.

A normalized regimen phase can sometimes help label a position within an interval. If a subject receives doses every \(\tau_i\) time units, define \(u_{ik}=s_{ik}/\tau_i\). This puts observations between dose events on a zero-to-one phase scale when the interval is regular. It does not make different intervals pharmacologically equivalent: two observations at the same \(u_{ik}\) can occur different numbers of hours after dose and after different accumulated histories. Use this scale only when relative phase is meaningful, and retain interval or regimen information in the panels or strata.

Worked Example: Reconstructing Time Since Dose

Suppose a hypothetical dataset records study time in hours. Subject A receives doses at 0, 12, and 24 hours and has a concentration measured at 26 hours. Subject B receives doses at 0 and 24 hours and is also measured at 26 hours. Find the relevant dose-relative times and decide whether the points belong in the same comparison.

For each observation, subtract the time of the most recent dose. For subject A, the most recent dose before 26 hours was at 24 hours, so \(s_A=26-24=2\) hours. For subject B, the most recent dose was also at 24 hours, so \(s_B=26-24=2\) hours.

Both observations can be placed at 2 hours on a time-since-last-dose axis. But their dose histories differ: A also received doses at 0 and 12 hours, whereas B received only the doses at 0 and 24 hours. Therefore the two observations should not automatically be treated as exchangeable. A useful display can show time since dose while separating the regimens into panels, or otherwise retaining the distinct histories in the predictive comparison.

What the VPC Summaries Compare

Before interpreting a dose-aligned VPC, specify the summary and the population to which it refers. Suppose observations are assigned to a time bin \(b\), and the target summary is the \(p\)th quantile of concentration \(Y\). The observed summary is \(q_{p,b}^{\mathrm{obs}}\), calculated from observed concentrations in that bin and stratum. For each simulated replicate \(m\), calculate the same quantile, \(q_{p,b}^{(m)}\), using the corresponding simulated records and design.

$$ q_{p,b}^{\mathrm{obs}} \quad \text{compared with} \quad \left[q_{p,b}^{(1)},q_{p,b}^{(2)},\ldots,q_{p,b}^{(M)}\right] $$

A simulation-based prediction interval for the quantile is formed from the distribution of these replicate summaries. For a central 95% interval, its endpoints are the 2.5th and 97.5th percentiles of the \(M\) simulated quantiles. This interval describes variation in the quantile summary across replicate datasets generated under the model and design; it is not a confidence interval for a fixed model parameter. The observed quantile is compared with this interval, alongside the other quantile and time-bin patterns.

The calculation is meaningful only when each replicate uses the same inclusion rules, binning rule, alignment, and stratum definition as the observed data. If subjects are assigned to dose strata using their observed dose level, the simulated records must preserve that assignment. If a stratum is too sparse to estimate its quantiles stably, a jagged or extreme observed curve may be sampling noise rather than evidence of model failure.

Worked Example: Comparing an Upper Quantile Within a Dose Stratum

In a hypothetical 10–12-hour time-since-dose bin for the 100-mg regimen, the observed 90th percentile of concentration is 9.4 mg/L. Across \(M=200\) simulated datasets, the sorted 90th-percentile summaries have a 5th order statistic of 7.8 mg/L, a 100th of 8.4 mg/L, and a 196th of 9.1 mg/L. Use the 5th and 196th order statistics as the approximate endpoints of a central 95% simulation interval.

The interval is \([7.8,9.1]\) mg/L. The observed value, 9.4 mg/L, is above the upper endpoint by \(9.4-9.1=0.3\) mg/L. Thus, this bin’s observed upper-tail summary is higher than the central 95% of simulated summaries under the fitted model and design. This is a localized indication to investigate, not by itself proof of a particular model defect. Check nearby bins, other quantiles, the stratum’s sample size, and the dose-history representation before drawing a broader conclusion.

Why Pooling Can Hide or Invent Patterns

A pooled quantile is a valid summary of a pooled population if that is the target. It can nevertheless be hard to interpret when subjects follow very different dosing conditions. The pooled median need not resemble the median profile of any actual dose or regimen group. The issue follows directly from how a quantile is computed: it depends on the combined ordering of all values, not on an average of the subgroup quantiles.

Worked Example: A Pooled Median Between Two Dose Groups

Consider a hypothetical time bin with 40 observations of 9 mg/L in a low-dose group and 40 observations of 101 mg/L in a high-dose group. Using the usual even-sample median, the pooled median is the average of the 40th and 41st ordered values.

The ordered values consist of forty 9s followed by forty 101s. Therefore the pooled median is \((9+101)/2=55\) mg/L. Neither group has a median near 55 mg/L; their medians are 9 and 101 mg/L. A pooled VPC may still be relevant if the combined population is the stated target, but it cannot replace dose-specific checks when the question is whether the model predicts both dose groups adequately.

A useful way to choose the display is to start with the predictive question, then ask what features need to match within a comparison. The following sequence makes that choice explicit.

1
Name the target.
Decide whether the check concerns a dose-specific profile, a regimen-specific profile, or the full population under its observed design.
2
Choose the time reference.
Use study time for a study-course target, time since dose for dose-response timing, or regimen phase only when relative position in an interval is relevant.
3
Preserve consequential differences.
Use panels or strata for dose levels, intervals, or histories that imply meaningfully different expected profiles. Do not assume a shared horizontal axis makes the observations equivalent.
4
Check support and simulation design.
Confirm that observed and simulated records use the same dose-event histories, time alignment, bins, and inclusion rules, and that each stratum has enough data for stable summaries.

Diagnostics, Alternatives, and Limitations

A dose-aligned display is going wrong when its construction hides a relevant mismatch or creates groups too small to interpret. Check dose and sample-time records, especially around dose changes and repeated doses. Verify that observations at a plotted time truly have the intended relationship to a dose event. Inspect the number of subjects and observations in each bin and stratum; unstable counts can produce irregular quantile curves and wide simulation intervals. Also check that simulated data preserve the observed design. A simulation that applies one nominal dose history to subjects who actually received several histories does not provide the intended comparison.

There are several legitimate alternatives, depending on the question. A pooled VPC summarizes overall predictive performance under the combined design but can conceal subgroup-specific misfit. A VPC stratified by dose or regimen is easier to interpret within each condition but may be noisy when groups are small. A study-time VPC retains the full course and can reveal calendar-time or treatment-phase patterns, but it may overlay observations at different times after dose. A time-since-dose VPC makes post-dose timing easier to compare, while requiring regimen history to be retained when accumulation or interval differences matter. These displays answer related, not identical, questions.

Do not create many narrow strata solely because dose records differ in minor ways. Excessive splitting reduces precision and can make a check unreadable. Conversely, merging markedly different schedules just to obtain smoother curves can conceal failure. Combine groups only when the combined predictive target is meaningful and the model simulations reproduce their composition. The right choice balances interpretability, data support, and relevance to the intended predictive target.

Finally, dose-normalizing concentrations is not a general substitute for alignment or stratification. Such normalization assumes a suitable dose-proportional relationship; it can be misleading when pharmacokinetics are nonlinear or when dose history differs. Likewise, a shared normalized interval phase does not erase differences in actual elapsed time or accumulated exposure. These transformations should not be used to make unlike profiles appear comparable without a defensible model and scientific rationale.

Common pitfall: “Both samples are two hours after the last dose, so they can be pooled.” This is not necessarily true: prior doses, dose amounts, and intervals may differ. The correction is to align the time axis as appropriate, then retain consequential regimen history through panels or strata and simulate that same history.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A sample is collected at study hour 19 after doses at hours 0, 8, and 16. What is its time since the most recent dose?
  2. Why can a VPC stratified by dose be more informative than one pooled across dose levels?
  3. Two subjects are sampled 3 hours after their most recent dose, but one follows a 12-hour interval and the other a 24-hour interval. Does matching time since dose guarantee that their profiles are comparable?
  4. An observed 90th percentile is 12.0 mg/L, while the simulated central 95% interval is 8.0–11.5 mg/L. State the comparison correctly.
  5. What is one drawback of creating a separate VPC panel for every small regimen subgroup?

Solutions. (1) The latest dose was at hour 16, so \(19-16=3\) hours. (2) The pooled quantile can combine unlike distributions and conceal a mismatch specific to one dose; dose strata show the predictive comparison within each level. (3) No. Their prior histories and interval lengths may differ, so use relevant regimen panels or strata even if both are plotted at 3 hours since dose. (4) The observed upper quantile is 0.5 mg/L above the simulation interval’s upper endpoint, indicating that it exceeds the central 95% of simulated summaries for that bin and target; it does not alone establish the cause. (5) Small panels have fewer observations, making quantiles unstable and the VPC difficult to interpret.