Tutorials › Optimal Design and Model-Informed Dosing › Common Errors in Individual PK Sampling Design

Optimal Sampling for Individual PK Models · Tutorial 65 of 497

Common Errors in Individual PK Sampling Design

Use the local Fisher information matrix and targeted diagnostics to identify when an apparently attractive individual PK sampling design is misleading.

Advanced 11 min read

What You'll Learn

  • Explain why sensitivities must be weighted by residual variance when comparing candidate sampling times.
  • Recognize how parameter units affect unscaled sensitivity summaries and interpret information after reparameterization.
  • Distinguish a large information determinant from precise estimation of every individual parameter.
  • Diagnose redundant sampling times using sensitivity directions and information-matrix rank.
  • Check model, residual-error, and local-design assumptions before trusting a design criterion.

Why Plausible Designs Can Mislead

A sampling schedule can look attractive because it includes a sharp concentration change, spans a wide time range, or produces a large numerical design score. None of these features alone guarantees useful parameter estimates. The central check is whether the observations provide appropriately weighted, distinct information about the parameters that matter.

For an individual PK model, design calculations are usually local: sensitivities are evaluated at specified nominal parameter values, and a local information matrix summarizes the information expected from the proposed sampling times. Errors in the sensitivities, residual-error model, parameter scaling, or interpretation of the matrix can make a formally optimized schedule practically poor. This tutorial focuses on recognizing those errors rather than replacing the design criteria introduced in the earlier material on D-, A-, and c-optimal sampling.

Working model and assumptions: At sampling time \(t_i\), suppose the measured concentration is \(Y_i=f(t_i,\theta)+\varepsilon_i\), where \(f\) is the individual PK model, \(\theta\) is the parameter vector, and the errors are independent, mean-zero normal variables with known variances \(\sigma_i^2\). The local sensitivity row is \(g_i=\partial f(t_i,\theta)/\partial\theta\), evaluated at a stated nominal \(\theta\). Under this model, the mean-based Fisher information is \(I(\theta)=\sum_i g_i^\mathsf{T}g_i/\sigma_i^2\). The approximation requires a differentiable model and a locally informative design; it does not itself guarantee that estimates will be unbiased or that the model is correct.

When the residual variance is constant, every observation has the same variance weight. When it differs by time or predicted concentration, the weights differ. If residual variances are estimated, depend on the mean, or errors are correlated, the likelihood and its information must reflect those features; the simple sum above is not automatically the full Fisher information. Likewise, local sensitivities depend on the nominal parameter values, so a schedule should be checked over plausible values rather than treated as universally optimal.

Error 1: Optimizing Unweighted Sensitivities

A sensitivity measures how much the predicted concentration changes for a small change in a parameter. A large absolute derivative can appear valuable, but it is only informative relative to the measurement noise. Under the model above, an observation's contribution is \(g_i^\mathsf{T}g_i/\sigma_i^2\): its sensitivity is effectively divided by the residual standard deviation before it contributes information.

Worked Example: A Steep but Noisy Sampling Time

Suppose a one-parameter model has sensitivity \(4\) concentration units per parameter unit at candidate time A, with residual standard deviation \(4\) concentration units. At time B, the sensitivity is \(2\) concentration units per parameter unit, while the residual standard deviation is \(0.5\) concentration units. Assume independent normal errors and known variances at these times.

An unweighted comparison uses squared sensitivities: A gives \(4^2=16\), while B gives \(2^2=4\). It would rank A higher. The correct information contributions are instead

$$ I_A=\frac{4^2}{4^2}=1,\qquad I_B=\frac{2^2}{0.5^2}=\frac{4}{0.25}=16. $$

Time B provides 16 times the information about this parameter under the stated model, despite its smaller raw sensitivity. For one parameter, the local variance approximation is \(1/I\), so the corresponding approximate standard errors are \(1\) parameter unit at A and \(0.25\) parameter units at B. These results depend on the variances being correctly specified and on the local model being adequate.

The diagnostic is direct: compare the residual-error model used in the design calculation with the assay and model assumptions for the proposed times. If variability increases at low or high concentrations, a calculation that assigns equal weight to all sensitivities may favor a time whose apparent signal is overwhelmed by noise. The earlier material on residual error models and weighting for assay precision covers how to construct these variance weights; the practical error here is to omit them or apply the wrong ones.

Error 2: Mixing Parameter Scales

Sensitivities have units that depend on how parameters are expressed. A derivative with respect to clearance measured in litres per hour is numerically different from a derivative with respect to clearance measured in millilitres per hour. Raw sensitivity magnitudes, matrix traces, and condition numbers can therefore change simply because a parameter's units or scale changed.

For a fixed, nonsingular reparameterization \(\theta=\theta(\phi)\), let \(G=\partial\theta/\partial\phi\). The information matrix in the new coordinates is \(I_\phi=G^\mathsf{T}I_\theta G\). Its determinant is \(\det(I_\phi)=\det(G)^2\det(I_\theta)\). Since the same transformation is applied to every candidate schedule, it multiplies every determinant by the same positive factor. Thus the ranking by D-optimality is preserved under such a fixed transformation, while unscaled summaries such as the trace need not be. Parameter-specific uncertainty must still be interpreted in the chosen parameterization and units.

Worked Example: A Trace Ranking Changes With Units

Consider two hypothetical schedules with information matrices, in the original parameter coordinates, \(I_A=\begin{pmatrix}100&0\\0&1\end{pmatrix}\) and \(I_B=\begin{pmatrix}1&0\\0&4\end{pmatrix}\). Suppose someone uses the trace as a general score. In the original coordinates, \(\operatorname{tr}(I_A)=101\) and \(\operatorname{tr}(I_B)=5\), so A appears preferable.

Now express the first parameter as \(q_1=100\theta_1\), leaving the second unchanged. Since \(\theta_1=q_1/100\), the information in the new coordinates is

$$ I_{A,q}= \begin{pmatrix}0.01&0\\0&1\end{pmatrix},\qquad I_{B,q}= \begin{pmatrix}0.0001&0\\0&4\end{pmatrix}. $$

Their traces are now \(1.01\) and \(4.0001\), respectively, so the trace ranks B above A. Nothing about the schedules or underlying data changed; only the scale of the first parameter changed. By contrast, the determinants in the original coordinates are \(100\) and \(4\). In the new coordinates they are \(0.01\) and \(0.0004\), each reduced by the same factor \(1/10{,}000\), so the determinant ranking is unchanged.

This does not make every determinant interpretation automatically useful: it shows why a design score must be matched to its intended criterion and parameterization. Before comparing unscaled sensitivities or matrix summaries, record the parameter units and consider dimensionless or scientifically meaningful scaled parameters. For log-parameters, remember that a derivative with respect to \(\log(\theta_j)\) is \(\theta_j\,\partial f/\partial\theta_j\), so it represents sensitivity to a relative rather than an absolute parameter change.

Error 3: Treating a Large Determinant as Precision for Every Parameter

For a locally regular model with information matrix \(I\), the inverse \(I^{-1}\) approximates the covariance matrix of an efficient estimator. D-optimality uses \(\det(I)\), which summarizes the inverse volume of the joint uncertainty ellipsoid. It is a joint measure, not a promise that each diagonal variance is small. One direction can be highly informative while another is poorly informed.

Worked Example: Equal Determinants, Unequal Parameter Precision

Suppose two candidate schedules have \(I_A=\begin{pmatrix}100&0\\0&0.01\end{pmatrix}\) and \(I_B=\begin{pmatrix}1&0\\0&1\end{pmatrix}\). Assume the local normal approximation is reasonable and the two parameters are expressed in the same fixed coordinates for both designs.

The determinants are equal: \(\det(I_A)=100(0.01)=1\), and \(\det(I_B)=1(1)=1\). Their approximate covariance matrices are

$$ I_A^{-1}= \begin{pmatrix}0.01&0\\0&100\end{pmatrix},\qquad I_B^{-1}= \begin{pmatrix}1&0\\0&1\end{pmatrix}. $$

Under A, the approximate standard errors are \(0.1\) parameter units for the first parameter and \(10\) for the second. Under B, they are \(1\) unit for each. A has much greater precision for parameter 1, but far less for parameter 2. Equal determinants do not make the schedules interchangeable when parameter 2 is the scientific target. For example, approximate 95% marginal intervals based on \(I^{-1}\) have half-widths \(1.96\sqrt{100}=19.6\) units for parameter 2 under A and \(1.96\) units under B.

Check the individual diagonal entries of \(I^{-1}\), relevant parameter contrasts, and parameter correlations, not only the determinant. If the design goal is precise estimation of one parameter or a specified function of parameters, the earlier material on c-optimal sampling provides a more targeted criterion. A-, D-, and c-optimal criteria answer different questions; no single scalar score substitutes for examining the uncertainty that matters.

Error 4: Accepting Redundant Sampling Times

A sample is redundant in the design sense when its sensitivity contributes little new information about parameter directions that are otherwise weakly identified. Two times can have different predicted concentrations yet have nearly parallel sensitivity vectors. Conversely, repeating a time is not automatically useless: with independent errors, a replicate can increase precision along the sensitivity direction it shares. The issue is whether the design gains needed directions of information, not whether the clock time is unique.

Worked Example: Repeated Direction Versus a New Direction

For a hypothetical two-parameter model, suppose three candidate sample times have sensitivity rows \(g_1=(1,1)\), \(g_2=(2,2)\), and \(g_3=(1,-1)\). Assume independent normal errors with variance \(1\) at each time. For the first two times, the information is

$$ I_{1,2}=g_1^\mathsf{T}g_1+g_2^\mathsf{T}g_2 =\begin{pmatrix}1&1\\1&1\end{pmatrix} +\begin{pmatrix}4&4\\4&4\end{pmatrix} =\begin{pmatrix}5&5\\5&5\end{pmatrix}. $$

Its determinant is \(5(5)-5(5)=0\): both observations point in the same parameter direction, so the matrix is rank one. Adding a replicate with sensitivity \((1,1)\) gives \(I=\begin{pmatrix}6&6\\6&6\end{pmatrix}\), which still has determinant zero. The replicate adds information along the existing direction but does not resolve the unidentifiable direction.

Instead, adding time 3 gives \(I=\begin{pmatrix}6&4\\4&6\end{pmatrix}\), with determinant \(36-16=20\). The new sensitivity direction makes the two parameters locally distinguishable. This calculation assumes the errors are independent; correlated residuals can reduce the information gained from repeated or closely spaced measurements.

In practice, inspect sensitivity directions, the rank or near-singularity of the information matrix, parameter correlations, and changes in uncertainty when each time is removed. A very small eigenvalue or a large parameter correlation can signal that several samples are contributing nearly the same direction. Also check operational constraints such as minimum spacing and clinic windows; a mathematically distinct time may not be feasible or may not be reliably measured.

A Short Justification and a Practical Review

The weighting and redundancy checks follow from the likelihood under the stated independent normal-error model. For one observation, the log-likelihood, apart from constants, is \(-[Y_i-f(t_i,\theta)]^2/(2\sigma_i^2)\). Differentiating with respect to \(\theta\) gives the score \(g_i^\mathsf{T}[Y_i-f(t_i,\theta)]/\sigma_i^2\). Taking the expected outer product of this score gives \(g_i^\mathsf{T}g_i/\sigma_i^2\), because the residual has mean zero and variance \(\sigma_i^2\). Independent observations have additive information, yielding the sum used above. If \(g_i\) is parallel to existing sensitivity rows, its information adds along those same directions; it cannot by itself raise the rank.

1
Verify the observation model.
Write down the residual variance at each proposed time and whether errors are independent. Do not use equal weights unless equal variance is justified.
2
Check parameter coordinates.
Record units, parameter scales, and any transformations. Interpret sensitivity magnitudes and uncertainty in those coordinates.
3
Inspect parameter-specific uncertainty.
Use the covariance approximation and correlations alongside a determinant or other scalar criterion; focus on the estimands needed for the PK question.
4
Test for redundant information.
Look for nearly parallel sensitivity rows, near-singularity, and little improvement when a proposed time is added or removed.
5
Challenge local assumptions.
Recalculate at plausible nominal parameter values and check residual-error assumptions, feasibility, and sensitivity to model misspecification.

These checks are diagnostics, not a proof that a design will perform well in a real study. A local information calculation can fail when the nominal values are far from an individual's values, the model is misspecified, the likelihood is strongly nonlinear over the relevant parameter range, or estimates are constrained by boundaries. Simulation-based evaluation and robust or Bayesian design approaches can address some of these concerns, but they answer broader questions than a single local calculation. In particular, population designs require accounting for between-individual variation, which is the subject of the later material on hierarchical models.

Common Mistake

Wrong reasoning: “The schedule has the largest determinant and the steepest concentration-time slopes, so it must estimate every parameter precisely.” This combines two distinct errors: steep slopes ignore residual variance, and the determinant summarizes joint uncertainty rather than each parameter's marginal precision.

Correction: Calculate information using the appropriate variance weights, confirm that parameter scales are consistent, and inspect the inverse information matrix or uncertainty for the specific parameters and functions of interest. Then check whether the proposed times contribute distinct sensitivity directions and whether the conclusions persist across plausible nominal values.

Key takeaway: A trustworthy individual PK design is not identified by a large raw sensitivity or one attractive scalar score. It must provide noise-weighted, scale-aware, nonredundant information about the parameters that the analysis is intended to estimate.

Check Your Understanding

Answer each question using the stated model and assumptions. Solutions follow.

  1. At time A, a one-parameter sensitivity is \(3\) concentration units per parameter unit and the residual standard deviation is \(3\) concentration units. At time B, the sensitivity is \(2\) and the residual standard deviation is \(1\). Which time contributes more information, and by what factor?
  2. Why can the trace of an information matrix change when a parameter is converted to different units, even though the design and observations are unchanged?
  3. Two two-parameter designs have information matrices \(\operatorname{diag}(25,0.04)\) and \(\operatorname{diag}(1,1)\). Compare their determinants and state why this does not establish equal precision for each parameter.
  4. Under independent errors, what happens to the rank of an information matrix when a sample is added whose sensitivity row is parallel to all existing sensitivity rows? What can that sample still contribute?

Solutions. (1) \(I_A=3^2/3^2=1\), while \(I_B=2^2/1^2=4\); B contributes four times the information. (2) Information transforms with the parameter-coordinate Jacobian, so individual matrix entries and their sum can change with units. The trace is not invariant to that transformation and is not a unit-free measure of general precision. (3) Both determinants are \(1\), since \(25(0.04)=1\) and \(1(1)=1\). The first design has approximate variances \(0.04\) and \(25\), whereas the second has variances \(1\) and \(1\); their parameter-specific precision differs substantially. (4) The rank cannot increase, because the new row adds no sensitivity direction. With an independent measurement and positive variance, it can still add information along the existing direction and improve precision there.

Clinical Biostats