Tutorials › Optimal Design and Model-Informed Dosing › Constructing Individual Likelihoods for Nonlinear PK Data

Bayesian Forecasting and Dose Adaptation · Tutorial 307 of 497

Constructing Individual Likelihoods for Nonlinear PK Data

Learn to translate an individual PK prediction model and its residual-error assumptions into a likelihood for one or many concentration observations.

Advanced 12 min read

What You'll Learn

  • Define a concentration likelihood conditional on an individual’s PK parameters and dose history.
  • Construct likelihood contributions under additive, proportional, and lognormal residual error.
  • Combine observations collected at multiple times using an explicit conditional-independence assumption.
  • Calculate likelihoods and log likelihoods from hypothetical PK data.
  • Diagnose mismatches between the assumed error model and observed residual patterns.
  • Distinguish a likelihood for PK parameters from a probability distribution over those parameters.

From a PK Prediction to a Likelihood

A nonlinear PK model maps a patient’s parameter values and dosing history to a predicted concentration at each sampling time. A likelihood adds a second ingredient: a model for how an observed concentration differs from that prediction. The prediction model alone does not say how surprising a measured value is, and a residual-error model alone does not say what concentration to expect. An individual likelihood joins the two.

For patient \(i\), let \(\boldsymbol{\theta}_i\) denote the patient-specific PK parameter vector, \(\mathcal{D}_i\) the recorded dosing history, \(t_{ij}\) the time of concentration measurement \(j\), and \(C_{ij}\) the observed concentration. Write the model prediction as \(C_{\mathrm{pred}}(t_{ij};\boldsymbol{\theta}_i,\mathcal{D}_i)\). The prediction may come from an algebraic formula or from numerically solving PK differential equations. In either case, it must use the relevant dose amounts, dose times, sample times, and model assumptions.

Definition: An individual concentration-data likelihood is the joint density of the observed concentrations, conditional on the individual PK parameters, dosing history, sampling times, and residual-error model. Written as a function of \(\boldsymbol{\theta}_i\), it is denoted \(L_i(\boldsymbol{\theta}_i)\). It measures how well the specified model and parameter values account for the observations; it is not a probability distribution over parameter values.

The likelihood depends on assumptions. The prediction model and dose history must be specified adequately; the chosen residual-error distribution must be appropriate for the data; and the dependence structure between observations must be stated. If observations are assumed conditionally independent given the PK parameters and dosing history, the joint likelihood is a product of the individual observation densities. That product is not justified merely because the measurements were taken at different times.

Choosing a Residual-Error Model

Let \(C_j\) be the concentration observed at time \(t_j\), and abbreviate its prediction as \(m_j=C_{\mathrm{pred}}(t_j;\boldsymbol{\theta},\mathcal{D})\). Under additive normal error, the observation is modeled as \(C_j=m_j+\epsilon_j\), where \(\epsilon_j\sim N(0,\sigma^2)\). This assumes errors have constant variance on the concentration scale and can take either positive or negative values. It is most plausible when variability is roughly constant in absolute concentration units and predictions are sufficiently far from zero that negative simulated observations are not a material concern.

$$ f(C_j\mid\boldsymbol{\theta},\mathcal{D}) = \frac{1}{\sqrt{2\pi}\sigma} \exp\left[-\frac{(C_j-m_j)^2}{2\sigma^2}\right] $$

A proportional normal-error model instead sets the residual standard deviation in proportion to the prediction: \(C_j\mid\boldsymbol{\theta},\mathcal{D}\sim N(m_j,(\sigma_p m_j)^2)\), where \(\sigma_p\) is a dimensionless proportional-error coefficient. This represents variability that grows with concentration. It still assigns some probability to negative values, and its variance approaches zero as the predicted concentration approaches zero; both features should be considered when deciding whether it is appropriate.

For positive concentrations with multiplicative variability, a lognormal model is one option. If \(\log C_j=\log m_j+\epsilon_j\), with \(\epsilon_j\sim N(0,\omega^2)\), then \(m_j\) is the conditional median, not the conditional arithmetic mean. The density on the original concentration scale includes a \(1/C_j\) factor because the logarithm changes the measurement scale.

$$ f(C_j\mid\boldsymbol{\theta},\mathcal{D}) = \frac{1}{C_j\omega\sqrt{2\pi}} \exp\left[-\frac{\{\log(C_j/m_j)\}^2}{2\omega^2}\right], \qquad C_j>0 $$

A combined additive-plus-proportional model is also common: the conditional variance is \(\sigma_a^2+(\sigma_p m_j)^2\). It allows an absolute-error component to matter at low concentrations and a concentration-dependent component to matter at higher concentrations. The error structure should be selected from scientific understanding and data diagnostics, not simply because one formula is familiar.

Worked Example: One Observation With Additive Error

Suppose a hypothetical patient received a 500 mg intravenous bolus. Under a one-compartment model, the predicted concentration is \(m(t)=D/V\exp[-(CL/V)t]\). Use \(CL=5\) L/h, \(V=50\) L, and a sample time of 2 h. The measured concentration is 8.8 mg/L. Assume additive normal residual error with known \(\sigma=1.5\) mg/L.

First calculate the prediction, retaining units: \(D/V=500\text{ mg}/50\text{ L}=10\) mg/L and \(CL/V=5/50=0.1\) h\(^{-1}\). Therefore,

$$ m(2)=10\exp[-(0.1)(2)] =10\exp(-0.2) =8.187\ \text{mg/L}. $$

The residual is \(8.8-8.187=0.613\) mg/L. Substituting the observation, prediction, and residual SD into the normal density gives

$$ f(8.8\mid\boldsymbol{\theta},\mathcal{D}) = \frac{1}{\sqrt{2\pi}(1.5)} \exp\left[-\frac{(8.8-8.187)^2}{2(1.5)^2}\right] \approx 0.245\ (\text{mg/L})^{-1}. $$

This is the density at the observed value for the specified parameters and error model. Its units are inverse concentration; it is not the probability that the exact value 8.8 mg/L occurred. A probability for a concentration interval would require integrating the density over that interval.

Likelihoods for Several Sampling Times

Suppose \(J\) concentrations are observed for one patient. Under conditional independence, each with additive normal error and potentially time-specific standard deviation \(\sigma_j\), the joint likelihood is the product of the \(J\) normal densities. Taking logarithms converts the product into a sum, which is usually more stable numerically and easier to optimize. For a common \(\sigma\), the log likelihood is a constant minus a weighted sum of squared residuals. If \(\sigma\) is fixed, parameter values that produce smaller squared residuals have larger likelihood under this model.

$$ L(\boldsymbol{\theta}) = \prod_{j=1}^{J} \frac{1}{\sqrt{2\pi}\sigma_j} \exp\left[-\frac{\{C_j-C_{\mathrm{pred}}(t_j;\boldsymbol{\theta},\mathcal{D})\}^2}{2\sigma_j^2}\right] $$
$$ \log L(\boldsymbol{\theta}) = -\frac{1}{2}\sum_{j=1}^{J} \left[ \log(2\pi\sigma_j^2) + \frac{\{C_j-C_{\mathrm{pred}}(t_j;\boldsymbol{\theta},\mathcal{D})\}^2}{\sigma_j^2} \right] $$

The independence assumption concerns residuals after conditioning on the PK parameters and known design information. It may fail when samples share assay or handling effects, when there is serially correlated unexplained variability, or when an important time-varying process is omitted. In those cases, multiplying marginal densities can understate or misrepresent the information in the data; a joint error model is needed.

Worked Example: Combining Three Concentrations

For a hypothetical patient receiving the same 500 mg bolus, use the one-compartment model and parameters \(CL=5\) L/h and \(V=50\) L. Three samples are taken at 1, 2, and 4 h, with measured concentrations 9.5, 7.8, and 7.0 mg/L. Assume independent additive normal errors with common known \(\sigma=1.0\) mg/L. The dose and times are known, and the model predictions are calculated using the stated parameters.

The predictions are \(10\exp(-0.1)=9.048\) mg/L, \(10\exp(-0.2)=8.187\) mg/L, and \(10\exp(-0.4)=6.703\) mg/L. The residuals, observation minus prediction, are 0.452, -0.387, and 0.297 mg/L. Their squared sum is

$$ 0.452^2+(-0.387)^2+0.297^2 = 0.2043+0.1498+0.0882 = 0.4423\ (\text{mg/L})^2. $$

The log likelihood under the specified independent normal model is

$$ \log L = -\frac{3}{2}\log(2\pi) -\frac{0.4423}{2(1.0)^2} = -2.7568-0.2212 = -2.978. $$

Thus \(L=\exp(-2.978)\approx0.0509\ (\text{mg/L})^{-3}\). This joint density is conditional on the chosen parameter values, dose history, and error assumptions. The three observations contribute together; replacing them with their mean would discard their distinct sampling times and the model’s changing predictions.

Why the Likelihood Construction Works

The product formula follows directly from the definition of conditional independence. For two observations, conditional independence means that their joint density equals the product of their conditional densities. Applying that definition repeatedly gives the product for \(J\) observations. For normal residuals, substituting the normal density into that product yields the displayed likelihood; taking a logarithm uses \(\log\prod_j a_j=\sum_j\log a_j\). This is a mathematical consequence of the stated model, not evidence that independence or normality is true for a particular data set.

For lognormal errors, the density also follows from a change of variable. Set \(Z_j=\log C_j\); the normal density describes \(Z_j\), but a density for \(C_j\) must account for \(dZ_j/dC_j=1/C_j\). Multiplying the normal density of \(\log C_j\) by this Jacobian produces the \(1/C_j\) term. Omitting it gives a density on the log scale, not the likelihood density for an observation recorded on the concentration scale.

Worked Example: Proportional Normal Versus Lognormal Error

At one hypothetical sampling time, the PK model predicts \(m=12\) mg/L and the observed concentration is 14.4 mg/L. First assume proportional normal error with \(\sigma_p=0.20\). The residual SD is \(0.20(12)=2.4\) mg/L, so

$$ f(14.4) = \frac{1}{\sqrt{2\pi}(2.4)} \exp\left[-\frac{(14.4-12)^2}{2(2.4)^2}\right] = \frac{1}{6.016}\exp(-0.5) \approx 0.1009\ (\text{mg/L})^{-1}. $$

Now, as a distinct hypothetical error assumption, let \(\log C=\log(12)+\epsilon\), with \(\epsilon\sim N(0,0.20^2)\). The log ratio is \(\log(14.4/12)=\log(1.2)=0.1823\). Thus

$$ f(14.4) = \frac{1}{14.4(0.20)\sqrt{2\pi}} \exp\left[-\frac{0.1823^2}{2(0.20)^2}\right] \approx 0.0914\ (\text{mg/L})^{-1}. $$

The numerical densities differ because the models make different assumptions about variability and the observation scale. The predictions and the nominal coefficients alone do not make these models equivalent. In particular, the lognormal version makes 12 mg/L the median; its arithmetic mean is \(12\exp(0.20^2/2)\), approximately 12.24 mg/L.

Diagnostics, Alternatives, and Limitations

After calculating predictions, inspect residuals \(C_j-C_{\mathrm{pred},j}\) against sampling time, predicted concentration, and dose timing. A systematic trend over time can indicate a structural-model or dosing-history mismatch; residual spread that grows with prediction can indicate that constant additive variance is inadequate. A few unusually large residuals may reflect data-quality issues, an inappropriate error model, or genuine variability. Residual plots can reveal tension with assumptions, but do not by themselves identify the cause.

Before interpreting an apparent model mismatch, verify sample times, dose amounts and times, units, and whether the recorded concentration corresponds to the modeled analyte and sampling event. The earlier material on analytical uncertainty and contaminated samples is relevant when a measurement itself may be unreliable. Assumptions about dose history and interpretation also matter: an incorrect input can produce an apparently poor likelihood even if the PK equations are otherwise suitable.

ApproachUseful whenKey caution
Additive normal errorAbsolute residual spread is roughly constantCan assign probability to negative concentrations
Proportional normal errorResidual spread grows with predicted concentrationAlso allows negative values; variance depends on the prediction
Lognormal errorConcentrations are positive and multiplicative variation is plausiblePrediction is the median; include the density’s scale correction
Combined errorBoth absolute and concentration-dependent variability matterMore parameters can be difficult to estimate from sparse data

The likelihood is conditional on the model and assumptions; it does not repair misspecified PK structure, uncertain dose records, or an unsuitable residual distribution. With sparse observations, several individual parameter combinations may yield similar predictions, so a likelihood can be broad or poorly identified. A likelihood value also cannot be interpreted in isolation as a probability that the model is correct, and raw likelihood values from different data scales or different observation sets are not directly comparable without an appropriate comparison framework.

Common pitfall: Treating the residuals as independent because the samples have different timestamps, then multiplying the densities automatically. Different times do not establish conditional independence. State the residual dependence assumption, check it where possible, and use a joint error model if the observations share unexplained sources of variation.

This construction supplies the data component needed for individual PK inference. A prior distribution over parameters is a separate ingredient; the likelihood itself contains no prior information and is not a posterior distribution.

Check Your Understanding

Answer each question using the likelihood definitions above. Short solutions follow the questions.

  1. A model predicts 6 mg/L and additive residual SD is 2 mg/L. What is the standardized residual if the observed value is 9 mg/L?
  2. For independent observations at three times with densities \(f_1,f_2,f_3\), write the joint likelihood and its log likelihood.
  3. Why does a lognormal concentration density include a factor \(1/C_j\)?
  4. A proportional normal model has prediction 10 mg/L and \(\sigma_p=0.15\). What residual SD does it imply?
  5. Two consecutive samples have residuals with a clear positive association after conditioning on predictions. What assumption is questionable, and what is the relevant consequence for constructing the likelihood?

Solutions. (1) The standardized residual is \((9-6)/2=1.5\), with no units. (2) Conditional independence gives \(L=f_1f_2f_3\) and \(\log L=\log f_1+\log f_2+\log f_3\). (3) The normal density is first specified for \(\log C_j\); transforming back to concentration multiplies the density by the Jacobian magnitude \(|d\log C_j/dC_j|=1/C_j\). (4) The residual SD is \(0.15(10)=1.5\) mg/L. (5) Conditional independence of the residuals is questionable. Multiplying the marginal densities as if independent can misrepresent the joint density, so a dependence structure should be modeled.

Clinical Biostats