Tutorials › Population Pharmacokinetics › Robustness to Missed Visits and Timing Deviations

Rich Versus Sparse Sampling · Tutorial 16 of 599

Robustness to Missed Visits and Timing Deviations

Evaluate whether a sparse PK schedule retains useful absorption, distribution, and terminal-phase coverage when visits are missed or samples are collected off-time.

Beginner 10 min read

What You'll Learn

  • Define phase coverage in terms of samples that remain useful under plausible disruptions.
  • Calculate the chance that a phase retains at least one sample when visits may be missed.
  • Assess how timing deviations can move samples out of informative time windows.
  • Compare schedules using explicit disruption scenarios rather than nominal times alone.
  • Recognize when robustness calculations need confirmation by population-model design evaluation.

Why Robustness Matters

A sparse PK schedule can look adequate on paper yet leave a parameter weakly informed if an important visit is missed or a sample arrives well outside its planned time. A planned early sample may be intended to characterize absorption, for example, but a substantial delay could place it after the most informative part of the concentration-time profile. A terminal sample collected too early may similarly contribute little information about the terminal decline.

Robustness is the extent to which a schedule retains useful information under plausible departures from its plan. It is not a guarantee that every participant will complete every visit, nor does it mean that one schedule is best for every objective. The practical task is to compare candidate schedules under stated assumptions about missed visits and timing deviations, and to see which design features preserve coverage of the phases relevant to the study question.

Definition: A schedule has phase coverage for a PK phase when it has one or more samples that fall in a time region useful for characterizing that phase. A schedule is robust to a disruption scenario to the extent that this useful coverage remains when specified visits are missed or collection times deviate from plan. Phase coverage is a design diagnostic, not by itself a measure of parameter precision.

The earlier material on sampling windows for absorption, distribution and clearance, terminal-phase samples, and peak and trough characterization explains why different times can contribute different kinds of information. Here the focus is what happens when planned opportunities are not realized exactly. A schedule should be assessed against the phases and parameters that matter for its intended use; a count of all samples, without regard to their timing, is not enough.

A Simple Framework for Missed Visits

Divide the planned opportunities into relevant phases, such as early absorption, distribution, and terminal decline. For phase \(j\), let \(m_j\) be the number of planned opportunities that could provide useful coverage if collected. Suppose opportunity \(i\) in that phase is missed with probability \(p_{ij}\), and assume for this calculation that the miss events are independent. The phase retains at least one sample unless all \(m_j\) opportunities are missed.

$$ P(\text{phase }j\text{ retains coverage}) =1-\prod_{i=1}^{m_j}p_{ij}. $$

If each opportunity in the phase has the same miss probability \(p_j\), this becomes \(1-p_j^{m_j}\). The independence assumption matters: several visits cancelled by the same transport disruption or illness may fail together. In that case, the product formula can overstate the protection provided by repeated opportunities.

For a compact comparison across phases, assign nonnegative weights \(w_j\) to the phases, with \(\sum_j w_j=1\). The weights express the design priorities for the question at hand. One simple summary of expected retained coverage is

$$ R=\sum_j w_j\left(1-\prod_{i=1}^{m_j}p_{ij}\right). $$

This summary is useful for comparing explicit scenarios, but it is not a universal objective function. It treats each phase as either covered or not covered, and does not distinguish a barely useful observation from a highly informative one within a phase. It also cannot, by itself, account for parameter correlations or the full concentration-time model.

Worked Example: Comparing Coverage After Missed Visits

Consider two hypothetical schedules with six sampling opportunities each. For this comparison, divide opportunities among early, middle, and terminal phases, give each phase equal weight, and assume each opportunity is independently missed with probability \(p=0.20\). Schedule A allocates \((1,2,3)\) opportunities across the phases; Schedule B allocates \((2,2,2)\).

For Schedule A, the probability of retaining coverage in each phase is \(1-0.20^m\), where \(m\) is that phase's number of opportunities. The three probabilities are \(1-0.20^1=0.800\), \(1-0.20^2=0.960\), and \(1-0.20^3=0.992\). Thus, with equal phase weights, \(R_A=(0.800+0.960+0.992)/3=0.9173\).

For Schedule B, each phase has two opportunities, so each has retention probability \(1-0.20^2=0.960\). Therefore \(R_B=(0.960+0.960+0.960)/3=0.960\).

Under these assumptions and equal phase weights, Schedule B has higher expected phase coverage. This does not prove it is more precise for every parameter: if the terminal phase is the primary objective, the extra terminal opportunities in Schedule A may be desirable. The calculation makes the trade-off visible rather than deciding the scientific priorities.

Evaluating Timing Deviations

A collected sample can still fail to provide the intended phase coverage if its actual time falls outside the useful region. Start by specifying, for each phase and design objective, a time window that will count as useful. Then describe plausible deviations from the planned time. A deviation can be represented as the difference between actual and planned collection time, but the key question is whether the resulting time remains in the relevant window.

For a simple calculation, suppose the timing deviation is uniformly distributed between \(-d\) and \(+d\) hours, and a sample is useful only if its actual time lies in a specified window. The probability of useful timing is the length of the overlap between the possible actual-time interval and the useful window, divided by the length of the possible interval. This calculation assumes the stated uniform distribution; it is a scenario assumption, not a general law of clinic timing.

Worked Example: How Much Timing Tolerance Does a Window Allow?

Suppose a hypothetical absorption-focused design defines 0.50 to 1.50 hours after dose as its useful window for a particular sample. The planned time is 1.00 hour, and a plausible timing deviation is uniform from \(-0.75\) to \(+0.75\) hours.

The possible actual times range from \(1.00-0.75=0.25\) to \(1.00+0.75=1.75\) hours. This interval has length \(1.50\) hours. Its overlap with the useful window is 0.50 to 1.50 hours, of length \(1.00\) hour. Therefore the probability of useful timing under this scenario is \(1.00/1.50=0.667\), or about 66.7%.

The calculation shows that a nominally well-placed sample is not automatically robust: the allowed deviations are wide relative to the useful window. Moving the planned time may change the overlap, but should not be done mechanically. The window itself is only a simplified representation of information, and the appropriate time depends on the PK model and study question.

When multiple opportunities are available, timing and missingness can be considered together. If an opportunity is missed with probability \(p\), and, conditional on collection, it lands in the useful window with probability \(q\), its probability of providing useful coverage is \((1-p)q\). If opportunities fail independently under both mechanisms, the chance that at least one of \(m\) opportunities provides useful coverage is \(1-[1-(1-p)q]^m\). Independence should be examined rather than assumed: a shared clinic delay can shift several samples in the same direction.

Worked Example: Combining Missed Visits and Off-Time Collections

Consider a hypothetical phase with two sampling opportunities. Each is missed with probability 0.15. When collected, each has probability 0.80 of falling inside the phase's useful time window. Assume independent miss events, independent timing deviations, and independence across the two opportunities.

For one opportunity, the probability of being collected and useful is \((1-0.15)(0.80)=0.85(0.80)=0.680\). Thus, the probability that one opportunity does not provide useful coverage is \(1-0.680=0.320\). The probability that neither of the two opportunities provides useful coverage is \(0.320^2=0.1024\).

The phase therefore retains coverage with probability \(1-0.1024=0.8976\), or about 89.8%. This result depends on the independence assumptions. If both opportunities are exposed to a common scheduling delay, the chance of both being off-time may be larger than the calculation allows, and the estimated robustness would be optimistic.

A Practical Review of Candidate Schedules

A useful comparison begins with the scientific priorities and the disruptions that are plausible in the setting. It then asks which design features give useful coverage more than one route to survive. Staggering times across participants can spread opportunities across phases; repeated coverage of a phase can reduce dependence on one visit; and a planned time comfortably inside a useful window can be less sensitive to small deviations than a time near its boundary. These features have costs and trade-offs, so none is automatically preferable.

1
Specify the important phases.
Identify the phases and PK questions that the schedule is intended to support. Do not assume that equal coverage of every phase is always the goal.
2
Define disruption scenarios.
State which visits may be missed, plausible miss rates if available, and plausible ranges or distributions for timing deviations. Distinguish individual failures from shared disruptions.
3
Recount useful opportunities.
For each scenario, determine which samples would still be useful for each phase. If using probabilities, state the assumed event structure and calculate the result from those assumptions.
4
Compare the resulting weaknesses.
Ask whether one phase depends on a single fragile visit, whether planned times sit near window boundaries, and whether losses are likely to be correlated.

A scenario table can make the comparison transparent even when reliable miss probabilities are unavailable. For example, examine the schedule with one early visit missed, with all visits delayed by a common amount, and with one participant's visit times shifted in either direction. Record which phases remain covered and which design objective becomes vulnerable. Such stress tests are not claims about how often each event will happen; they reveal dependence on particular observations.

Diagnostics, Alternatives, and Limitations

Warning signs include a phase represented by only one visit, a design whose useful coverage disappears after one plausible cancellation, and planned times whose small shifts move them outside the intended window. A further warning is a robustness calculation that assumes independent disruptions even though visits share staff, transport, clinic days, or other causes of delay. Check these assumptions explicitly and, where possible, compare results under both independent and shared-disruption scenarios.

A nominal schedule comparison asks how candidate times perform if every sample is collected as planned. A disruption-based comparison asks how often, or under which scenarios, useful coverage remains. The former is simpler and may be sufficient when deviations are negligible; the latter is more informative when missed or delayed visits are credible. Neither replaces evaluation of parameter precision. In particular, a schedule can preserve at least one sample in each broad phase while still providing weak information about a parameter or producing strong parameter correlations. The earlier material on parameter precision and parameter correlations addresses those distinct diagnostics.

The simple coverage calculations also have limitations. They depend on the selected useful windows, the assumed miss and timing distributions, and the independence structure. A binary covered/not-covered summary ignores how informative a sample is within a window, how concentration variability affects the observation, and how information is shared across participants. If the decision depends on precise parameter estimates, robustness scenarios should be carried into model-based design evaluation rather than treated as a substitute for it.

Common Pitfall

Wrong reasoning: “The schedule has several samples, so a missed visit cannot matter.” The total sample count does not show whether those samples are concentrated in one phase or whether the only terminal-phase sample is vulnerable.

Correction: Evaluate coverage by phase and by plausible disruption scenario. Repeated observations help only if they provide useful, sufficiently independent opportunities for the information at risk. If all opportunities share a cause of failure, nominal redundancy may provide little protection.

Key takeaway: Robustness is about retaining useful phase coverage under specified disruptions, not simply having many planned samples. Make assumptions about missed visits and timing deviations explicit, compare schedules phase by phase, and use model-based precision assessment when parameter information is the final objective.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A phase has three independent sampling opportunities, each missed with probability 0.10. What is the probability that the phase retains at least one collected opportunity?
  2. A sample is planned at 2.0 hours. Its useful window is 1.5 to 2.5 hours, and its actual time is uniformly distributed from 1.0 to 3.0 hours. What is the probability that its timing is useful?
  3. Why can the independent-miss formula overstate robustness when clinic delays affect several visits together?
  4. Does retaining at least one useful sample in every phase establish that all PK parameters will be estimated precisely? Explain.

Solutions. (1) The phase fails only if all three opportunities are missed, so its coverage probability is \(1-0.10^3=0.999\), or 99.9%. (2) The possible actual-time interval has length \(3.0-1.0=2.0\) hours; its overlap with the useful window has length \(2.5-1.5=1.0\) hour. The probability is \(1.0/2.0=0.500\), or 50.0%. (3) Shared delays make failures correlated, so the chance that all opportunities fail can exceed the product calculated under independence. (4) No. Phase coverage is a coarse diagnostic; precision also depends on the model, the informativeness of each observation, variability, and correlations among parameter estimates.

Clinical Biostats