Why Examine the Influence of an Individual Concentration?
A patient-specific fit combines measured concentrations with a population-based prior and a model of the dosing history. A concentration can fit the model reasonably well and still have substantial influence on the fitted individual parameters or a future forecast. Conversely, a large residual need not move the fit much if the observation is imprecise or redundant with other measurements. Influence analysis asks a focused question: how much would the patient’s estimate or forecast change if this observation were omitted or slightly changed?
This is a sensitivity analysis, not a test of whether a concentration is valid. It can identify measurements that deserve review, reveal that a forecast depends heavily on one sample, or show that several observations contribute similar information. It cannot, by itself, establish that an assay result is wrong or that the PK model is misspecified.
Define the Influence Quantities
Let \(y=(y_1,\ldots,y_n)\) denote the concentrations for one patient, together with their sampling times and known dosing history. Let \(\eta\) denote an individual parameter, such as a deviation in log clearance from its population-prior value. Write \(\hat{\eta}(y)\) for a chosen posterior summary, such as the posterior mean or posterior mode, and \(F(y)\) for a specified forecast summary at a specified future time.
The signs matter: a positive \(\Delta_i^{(\eta)}\) means the full-data estimate is higher than the estimate after deletion. For positive concentrations, a forecast ratio is often easier to interpret than a difference because the ratio expresses a proportional change. If forecasts are analyzed on the log scale, the log ratio is \(\log F(y)-\log F(y_{-i})\).
A perturbation analysis changes one observation by a small amount while keeping the other data fixed. For example, one can compare the fit using \(y_i\) with the fit using \(y_i+\delta\), where \(\delta\) is a prespecified concentration change or a fraction of the observation’s measurement-error scale. Unlike deletion, perturbation asks about sensitivity to a change in value rather than to removing the observation altogether.
A Conjugate Example and a Short Derivation
A simple normal model gives an exact derivation of deletion and perturbation effects. It is not a full PK model; it isolates the information-weighting mechanism that also helps interpret more complex patient fits. Suppose transformed measurements \(z_i\), such as log concentration summaries after accounting for a fixed structural prediction, satisfy
with conditionally independent measurement errors and known variances \(s_i^2\). The normal prior and likelihood give a normal posterior. Define prior precision \(P_0=1/V_0\), observation precision \(w_i=1/s_i^2\), and total precision \(P=P_0+\sum_{j=1}^n w_j\). Completing the square in the prior-times-likelihood density gives
After deleting observation \(i\), the denominator becomes \(P-w_i\) and its numerator loses \(w_i z_i\). Subtracting the two posterior means yields
This identity shows two contributors to deletion influence in this model: the observation’s precision relative to the total precision, \(w_i/P\), and its discrepancy from the estimate based on the remaining data. A precise observation that differs from the deleted-data estimate can have substantial influence. A large discrepancy paired with very low precision may have less. Also, influence depends on the prior: the prior precision is part of \(P\), so a stronger prior generally reduces the effect of any one measurement.
For a small perturbation \(\delta\) to \(z_i\), the posterior mean changes by \(w_i\delta/P\). This follows directly because \(z_i\) enters the numerator linearly and does not change the denominator. In nonlinear PK models, this exact expression generally does not apply; the patient fit must be recalculated, or a suitable local approximation used.
Worked Example: Deleting a Concentration and Recalculating a Forecast
Hypothetical data. Suppose three transformed concentration summaries are \(z_1=0.3000\), \(z_2=0.3945\), and \(z_3=1.4579\). Use the model above with prior \(\eta\sim N(0,0.25)\) and observation variances \(s_i^2=0.25\). Thus \(P_0=4\), each \(w_i=4\), and the prior and error assumptions are fixed for both fits. Consider the plug-in future concentration forecast \(F=8\exp(0.5\hat{\eta})\) mg/L. This is a forecast summary based on the posterior point estimate, not a posterior predictive mean that integrates over uncertainty in \(\eta\).
With all three observations, the posterior mean is
After deleting observation 3, the posterior mean is
The estimate changes by \(0.5381-0.2315=0.3066\) on the \(\eta\) scale. The full-data forecast is \(8\exp(0.5(0.5381))=8\exp(0.26905)\approx10.470\) mg/L. With observation 3 deleted, the forecast is \(8\exp(0.5(0.2315))=8\exp(0.11575)\approx8.982\) mg/L, using the unrounded deleted-data posterior mean.
The full-data to deleted-data forecast ratio is
Thus the full-data plug-in forecast is about \(16.57\%\) higher than the deleted-data forecast in this hypothetical calculation. This size of change flags dependence on observation 3; it does not prove that observation 3 is erroneous. The posterior variances also differ: \(1/16=0.06250\) with all data and \(1/12=0.08333\) after deletion. Deletion changes both the estimate and its uncertainty.
Perturbation and Comparison Across Observations
Case deletion is deliberately a large change: the observation is removed entirely. A perturbation can show whether an estimate responds smoothly to a smaller plausible change in a measured value. In the conjugate model, the exact change is available from the precision weight. In a PK fit, the same idea can be implemented by changing one concentration on a meaningful scale, rerunning the individual estimation, and recalculating the same forecast endpoint.
Worked Example: Perturbing One Transformed Measurement
Use the hypothetical data and model from the preceding example. Increase \(z_3\) by \(0.2000\), leaving the prior and all other values unchanged. Since \(w_3/P=4/16=0.25\), the posterior mean changes by
The perturbed estimate is \(0.5381+0.05000=0.5881\). The plug-in forecast changes by the multiplicative factor
Therefore this perturbation increases the forecast by about \(2.532\%\). In this fixed-variance normal model, the posterior variance remains \(1/16\), because changing a value does not change its precision. In a real assay or PK analysis, however, perturbations should be defined on a scale appropriate to the measurement process, and changing a concentration may also affect weights if the error model is concentration-dependent.
The following comparison uses the same hypothetical data. Each deletion fit retains the same prior and the two remaining observations.
Worked Example: Ranking Deletion Effects Rather Than Residuals Alone
With observation 1 deleted, the posterior mean is \(4(0.3945+1.4579)/12=0.6175\) (more precisely, \(0.6174667\)). The full-data estimate minus this deletion estimate is \(0.5381-0.6174667=-0.07937\). With observation 2 deleted, the posterior mean is \(4(0.3000+1.4579)/12=0.5860\) (more precisely, \(0.5859667\)), giving a full-minus-deleted change of \(-0.04787\). Deleting observation 3 gives \(0.2315\) and a full-minus-deleted change of \(0.3066\).
By absolute change in \(\eta\), observation 3 has the largest deletion effect in this example. The negative signs for deleting observations 1 and 2 mean that the estimate rises when either is removed. Forecast effects follow the same ordering here because the forecast \(8\exp(0.5\hat{\eta})\) is monotone in \(\hat{\eta}\), although the forecast differences are on a different scale. These calculations illustrate why the largest raw residual is not, by itself, a complete influence ranking: influence is the change in the fitted quantity after the data are refit.
Applying the Analysis to Individual PK Fits
For an individual Bayesian PK fit, a case-deletion calculation should hold the model, prior, dosing history, covariates, and estimation target fixed. Remove one concentration at a time, recompute the posterior summary of interest, and recalculate the same future forecast at the same time and dose. In nonlinear models, deleting a sample can alter the posterior shape as well as its center, so record which summary is being compared: posterior mean, posterior mode, median, or another prespecified quantity.
An efficient workflow is:
Specify the individual parameter summary and forecast endpoint to assess, including units and whether the forecast is a plug-in value or an uncertainty-integrated prediction.
Omit one concentration, keep the remaining analysis conditions fixed, and recompute the target. Check that the fitting procedure has converged comparably in each refit.
Report signed changes in parameter units and signed or relative forecast changes in concentration units or percent. Preserve signs so increases and decreases are not hidden.
Review sample time, dose history, assay information, and model fit. Retain the observation unless there is an independently justified data-quality or analysis reason to handle it differently.
For nonlinear or multivariate models, a useful comparison is to examine a vector of changes, for example in clearance, volume, and a forecast. A single scalar influence score can conceal that one observation increases the forecast while decreasing a parameter estimate. Reporting the target-specific changes is more transparent than treating all parameters as interchangeable.
Diagnostics, Alternatives, and Limitations
Influence results are meaningful only if the full and reduced fits are numerically reliable and comparable. Check convergence, posterior summaries, and forecast definitions in every refit. A large apparent change caused by different local optima, an unstable optimizer, or altered data-processing rules is not a trustworthy measure of observation influence. With very sparse data, deleting a sample can leave a weakly identified patient fit; a large change may then reflect dependence on limited information rather than a defective measurement.
Case deletion, perturbation, and residual review answer different questions. Case deletion asks how much the analysis depends on retaining a particular sample. Perturbation asks how sensitive it is to a specified small change. A residual measures discrepancy between an observation and a model prediction under a particular fit; it does not directly measure the impact of the observation on that fit. These approaches are complementary, not substitutes. In complex models, full case-deletion refits are usually the clearest direct assessment, while local derivative approximations are faster but can be inaccurate for large changes or strongly nonlinear posterior geometry.
Influence depends on the model and prior used. A point can be influential because it is precise, because its timing provides information unavailable elsewhere, or because the fit is weakly constrained—not only because it is extreme. Deleting it also changes the information available and may widen uncertainty. Conversely, a small change in a posterior mean does not guarantee that tail probabilities or prediction intervals are unchanged. The target and uncertainty summary should match the clinical decision being considered.
A common mistake is to reason, “Deleting this concentration changes the forecast a lot, so the concentration must be an outlier and should be removed.” The conclusion does not follow. Influence is a property of the observation in relation to the chosen model, prior, other data, and forecast target; it is not a probability that the observation is invalid. The correction is to treat a large change as a prompt to inspect the sample and the fit, document the sensitivity, and justify any data handling using information beyond influence alone.
Check Your Understanding
Answer each question, then compare with the brief solutions.
- In the conjugate model, what two factors determine the case-deletion change in the posterior mean?
- If an observation has low precision but a large discrepancy from the fit based on the remaining data, must it have a large deletion effect? Explain.
- In the hypothetical example, what is the full-data to deleted-data forecast ratio after removing observation 3, and how should it be interpreted?
- How does perturbation differ from case deletion?
- Why does a large deletion effect not establish that a concentration is erroneous?
Solutions. (1) The effect depends on the observation’s precision relative to total precision, \(w_i/P\), and its discrepancy from the deleted-data estimate, \(z_i-\hat{\eta}(y_{-i})\). (2) No. The product of the precision fraction and discrepancy determines the change in this model, so low precision can limit the effect. (3) The ratio is approximately \(1.166\); the full-data plug-in forecast is about \(16.57\%\) higher than the deleted-data forecast for this hypothetical calculation. It is a sensitivity result, not an error probability. (4) Deletion removes an observation; perturbation changes its value by a specified amount while retaining it. (5) Influence depends on the model, prior, other observations, and forecast target. It signals dependence and motivates review, but does not independently establish invalidity.