Tutorials › Optimal Design and Model-Informed Dosing › Updating Parameter Uncertainty at Interim Analyses

Robust and Adaptive Design · Tutorial 133 of 497

Updating Parameter Uncertainty at Interim Analyses

Use interim concentration data to update parameter distributions with a likelihood and prior, then carry the posterior uncertainty into redesign decisions.

Advanced 11 min read

What You'll Learn

  • Define the posterior distribution from a prior and the likelihood of interim concentration data.
  • Derive the multivariate normal posterior under a Gaussian likelihood.
  • Calculate posterior means, variances, credible intervals, and parameter correlations.
  • Combine sequential interim observations without counting data twice.
  • Diagnose prior-data conflict, model mismatch, and uncertainty that remains after an interim.
  • Use posterior distributions, rather than only point estimates, as inputs to redesign.

Why Update Uncertainty at an Interim?

A design is planned using assumptions about pharmacokinetic parameters, but interim concentration data can make some parameter values more plausible than others. The useful result is not merely an updated estimate of clearance or volume. It is an updated distribution describing which values remain plausible and how uncertain they are. That distribution can then inform redesign under the remaining study constraints.

For example, early concentrations may narrow uncertainty about a typical exposure level while leaving uncertainty about the terminal elimination rate largely unresolved. A single point estimate hides that distinction. An interim update should preserve both the information gained and the uncertainty that remains.

Definition: Let \(\boldsymbol{\theta}\) denote the model parameters, \(D_I\) the concentration data observed by an interim, and \(d_I\) the sampling design that generated those data. If \(\pi(\boldsymbol{\theta})\) is the prior density and \(L(D_I\mid\boldsymbol{\theta},d_I)\) is the likelihood, the posterior density is $$ \pi(\boldsymbol{\theta}\mid D_I,d_I) = \frac{L(D_I\mid\boldsymbol{\theta},d_I)\pi(\boldsymbol{\theta})} {\int L(D_I\mid\boldsymbol{u},d_I)\pi(\boldsymbol{u})\,d\boldsymbol{u}}. $$ The posterior represents parameter uncertainty after combining the prior with the interim data under the stated model.

What Must Be Specified for an Update?

The update requires a parameterization, a prior distribution, a likelihood, and a clear account of what data are included. In a pharmacokinetic model, \(\boldsymbol{\theta}\) may contain typical values, variability parameters, or parameters describing residual error. Concentrations are linked to those parameters through a structural model and an observation model. For instance, a common observation model assumes that measured concentration equals a model-predicted concentration plus residual error. The likelihood must match the scale and error distribution used for the data.

The prior must describe uncertainty before the interim data are used. It may come from earlier studies, mechanistic knowledge, or a deliberately broad distribution. Its parameterization matters: a normal prior on clearance is not the same as a normal prior on log clearance. Positive parameters are often modeled on a logarithmic scale so that implied values remain positive.

The likelihood must use the actual interim observations and the sampling times at which they were collected. It must also respect dependence among observations, such as correlation between measurements from the same participant. If measurements are below quantification limits, missing, or selected according to their observed values, the likelihood or observation process may need to account for that fact. Ignoring such features can make the posterior appear more precise or shift it in a misleading direction.

The examples below use Gaussian likelihoods. This is an exact model when the stated data summaries are normally distributed with the given variances; in other settings it can be a local approximation. A posterior computed under an approximation inherits that approximation's limitations.

Gaussian Updating and Its Derivation

Suppose a prior and a data summary have the following forms:

$$ \boldsymbol{\theta}\sim N(\boldsymbol{m}_0,\boldsymbol{V}_0), \qquad \boldsymbol{y}\mid\boldsymbol{\theta}\sim N(\boldsymbol{H}\boldsymbol{\theta},\boldsymbol{R}), $$

where \(\boldsymbol{V}_0\) is the prior covariance matrix, \(\boldsymbol{R}\) is the sampling covariance matrix of the data summary, and \(\boldsymbol{H}\) links parameters to that summary. Assume the prior covariance and sampling covariance are positive definite, and that the model and covariance matrices are treated as known. Multiplying the prior density by the likelihood gives a posterior kernel whose exponent contains

$$ (\boldsymbol{\theta}-\boldsymbol{m}_0)^\mathsf{T} \boldsymbol{V}_0^{-1}(\boldsymbol{\theta}-\boldsymbol{m}_0) + (\boldsymbol{y}-\boldsymbol{H}\boldsymbol{\theta})^\mathsf{T} \boldsymbol{R}^{-1} (\boldsymbol{y}-\boldsymbol{H}\boldsymbol{\theta}). $$

Collecting the quadratic and linear terms in \(\boldsymbol{\theta}\) gives posterior precision \(\boldsymbol{V}_0^{-1}+\boldsymbol{H}^\mathsf{T}\boldsymbol{R}^{-1}\boldsymbol{H}\) and posterior mean equal to posterior covariance times the combined precision-weighted prior mean and data.

$$ \boldsymbol{V}_I = \left(\boldsymbol{V}_0^{-1} +\boldsymbol{H}^\mathsf{T}\boldsymbol{R}^{-1}\boldsymbol{H}\right)^{-1}, \qquad \boldsymbol{m}_I = \boldsymbol{V}_I \left(\boldsymbol{V}_0^{-1}\boldsymbol{m}_0 +\boldsymbol{H}^\mathsf{T}\boldsymbol{R}^{-1}\boldsymbol{y}\right). $$

Completing the square verifies the result: the quadratic term is \((\boldsymbol{\theta}-\boldsymbol{m}_I)^\mathsf{T}\boldsymbol{V}_I^{-1}(\boldsymbol{\theta}-\boldsymbol{m}_I)\), with terms not involving \(\boldsymbol{\theta}\) absorbed into the normalizing constant. Thus the posterior is \(N(\boldsymbol{m}_I,\boldsymbol{V}_I)\). In this model, the data add information through \(\boldsymbol{H}^\mathsf{T}\boldsymbol{R}^{-1}\boldsymbol{H}\); they do not necessarily reduce uncertainty equally for every parameter direction.

Worked Example: Updating Uncertainty in a Log-Clearance Summary

Suppose an interim analysis produces a normally distributed summary \(y\) of a dimensionless log-clearance deviation \(\theta\). Under the assumed local Gaussian model, \(y\mid\theta\sim N(\theta,0.25^2)\). Before the interim, \(\theta\sim N(0,0.40^2)\). The observed summary is \(y=0.30\). Find the posterior mean, standard deviation, and approximate 95% credible interval.

For a scalar normal prior and a normal observation with mean \(\theta\), posterior precision is the sum of prior and data precisions. Therefore,

$$ V_I= \left(\frac{1}{0.40^2}+\frac{1}{0.25^2}\right)^{-1} = \left(6.25+16\right)^{-1} = 0.04494. $$

The posterior standard deviation is \(\sqrt{0.04494}=0.2120\). The posterior mean is

$$ m_I = 0.04494\left(\frac{0}{0.40^2}+\frac{0.30}{0.25^2}\right) = 0.04494(4.80) = 0.2157. $$

The posterior is approximately \(N(0.2157,0.04494)\). Its central 95% credible interval is \(0.2157\pm1.96(0.2120)\), or approximately \([-0.1998,0.6313]\). Under this prior and likelihood, the posterior probability that the dimensionless log-clearance deviation lies in that interval is about 95%. This is not a statement that there is a 95% probability that a fixed parameter lies in an interval constructed by repeated sampling.

Retain Joint Uncertainty, Not Just Marginal Estimates

With multiple parameters, the posterior covariance matrix is part of the update, not an optional extra. Correlations can matter for predictions and for design performance: different parameter combinations may produce similar concentrations. A redesign based only on separate marginal intervals can miss these combinations.

Worked Example: One Concentration Summary Informs a Parameter Combination

Let \(\theta_1\) and \(\theta_2\) be two dimensionless log-parameter deviations, with independent prior distributions \(N(0,0.50^2)\). An interim concentration summary is modeled as \(y=\theta_1+\theta_2+\epsilon\), where \(\epsilon\sim N(0,0.50^2)\), and the observed value is \(y=0.30\). Calculate the joint posterior and explain what it says about uncertainty.

Here \(\boldsymbol{H}=(1\ \ 1)\), \(\boldsymbol{V}_0=0.25\boldsymbol{I}\), and \(R=0.25\). The prior precision is \(4\boldsymbol{I}\), and the likelihood adds \((1/0.25)\boldsymbol{H}^\mathsf{T}\boldsymbol{H}\). Hence,

$$ \boldsymbol{V}_I^{-1} = \begin{pmatrix}4&0\\0&4\end{pmatrix} + 4\begin{pmatrix}1&1\\1&1\end{pmatrix} = \begin{pmatrix}8&4\\4&8\end{pmatrix}, \qquad \boldsymbol{V}_I = \begin{pmatrix}1/6&-1/12\\-1/12&1/6\end{pmatrix}. $$

The precision-weighted data term is \(\boldsymbol{H}^\mathsf{T}R^{-1}y=(1,1)^\mathsf{T}(4)(0.30)=(1.2,1.2)^\mathsf{T}\). Multiplying by the posterior covariance gives \(\boldsymbol{m}_I=(0.10,0.10)^\mathsf{T}\). Each marginal posterior standard deviation is \(\sqrt{1/6}=0.4082\), and the posterior correlation is \((-1/12)/(1/6)=-0.5\).

The observed summary informs the sum \(\theta_1+\theta_2\), but does not precisely distinguish the individual parameters. The negative posterior correlation expresses that, among parameter pairs consistent with the observed sum, a larger value of one can be offset by a smaller value of the other. Retaining that covariance is important when evaluating concentration predictions or design criteria that depend on both parameters.

Sequential Updates Without Reusing Data

When additional interim observations arrive, the previous posterior can serve as the new prior, provided the next likelihood is for new data conditional on the parameter and the information already used. This is algebraically equivalent to updating once with the likelihood for all observations. Reusing earlier observations in the new likelihood would count their evidence twice and produce overconfident uncertainty estimates.

Worked Example: Incorporating a Second Independent Interim Summary

Let \(\theta\) have initial prior \(N(0,1)\). The first summary is \(y_1=1.0\), with \(y_1\mid\theta\sim N(\theta,0.50^2)\). A later, independent summary is \(y_2=0.50\), with the same conditional variance. Find the posterior after each update.

After the first summary, posterior precision is \(1+4=5\), so the variance is \(1/5=0.20\). The mean is \(0.20(0+4(1.0))=0.80\). For the second update, use \(N(0.80,0.20)\) as the current distribution and use only \(y_2\):

$$ V_2=(5+4)^{-1}=\frac{1}{9}=0.1111, \qquad m_2=\frac{1}{9}\left(5(0.80)+4(0.50)\right) =\frac{6}{9}=0.6667. $$

The same result follows by using both summaries once: total precision is \(1+4+4=9\), and the precision-weighted mean is \((4(1.0)+4(0.50))/9=0.6667\). If \(y_1\) were incorrectly included again after starting from its posterior, the first observation's precision and contribution would each be duplicated.

Using the Posterior in Redesign

After an interim update, the posterior distribution can replace the pre-interim uncertainty distribution as the uncertainty input to a design assessment. For a candidate design \(d\) and a design performance quantity \(\Phi(d,\boldsymbol{\theta})\), a posterior-averaged assessment is

$$ E\!\left[\Phi(d,\boldsymbol{\theta})\mid D_I,d_I\right] = \int \Phi(d,\boldsymbol{\theta}) \pi(\boldsymbol{\theta}\mid D_I,d_I)\,d\boldsymbol{\theta}. $$

Alternatively, posterior draws or representative posterior scenarios can be used to examine performance across plausible parameter values. The updated distribution may be narrower than the prior, shifted, or both. Its covariance also changes how plausible parameter combinations are weighted. The redesign assessment should carry these features forward rather than substituting only the posterior mean.

This update supplies an uncertainty distribution for redesign; it does not by itself determine which future sampling time to choose. That decision depends on the design objective and constraints as well as the updated parameter distribution. A posterior mean can be useful as a summary, but it is not a substitute for evaluating uncertainty when design performance changes appreciably across parameter values.

Diagnostics, Alternatives, and Limitations

An update is only as credible as its prior, likelihood, and data handling. Check whether the observed interim concentrations are plausible under the prior predictive distribution, which is the distribution obtained by integrating the sampling model over the prior. Then check whether posterior predictions are compatible with the observed concentrations and their pattern over time. Strong prior-data conflict, systematic residual trends, or implausible parameter correlations can indicate model misspecification, an unsuitable prior, or an error in the data pipeline.

For complex nonlinear pharmacokinetic models, the posterior may be skewed, multimodal, or constrained by parameter boundaries. A Gaussian approximation can then conceal important features. Numerical methods such as Markov chain Monte Carlo or importance sampling may be needed, with convergence, effective sample size, and sensitivity to initialization or proposal choices assessed before using the result. If the likelihood is weakly informative, the posterior may remain close to the prior; that is a valid outcome, not evidence that the update failed.

A likelihood-based point estimate with a standard error summarizes data-based estimation but does not combine evidence with a prior in the same way. A scenario-based robustness analysis can instead assign performance weights to selected parameter values without specifying a full posterior distribution. Posterior updating offers a coherent probability distribution when its assumptions are defensible, but results can be sensitive to the prior and model. Sensitivity checks with reasonable alternative priors and observation models are therefore important, especially when the interim sample is small.

Common pitfall: Treating the posterior mean as if it were the complete interim result. This discards posterior spread and correlation, so a redesign can appear more reliable than it is. Carry forward the posterior distribution or a representative set of joint posterior draws, and assess design performance across that uncertainty.

Check Your Understanding

Use the stated assumptions in each question. Solutions follow so that the calculations can be checked directly.

  1. A parameter has prior \(N(2,1)\), and an independent interim summary has distribution \(Y\mid\theta\sim N(\theta,1)\) with observed value \(y=4\). What are the posterior mean and variance?
  2. In the two-parameter example, why does observing \(\theta_1+\theta_2\) create negative posterior correlation even though the prior parameters were independent?
  3. After updating with \(y_1\), why must a second update use only \(y_2\), rather than the combined data \((y_1,y_2)\), when the first posterior is used as the new prior?
  4. Name two checks that can reveal problems with an interim posterior update.

Solutions. (1) Prior and data precisions are both 1, so posterior variance is \((1+1)^{-1}=0.5\), and posterior mean is \(0.5(2+4)=3\). (2) The likelihood supports combinations with a similar sum; increasing one parameter can be offset by decreasing the other, producing negative posterior covariance. (3) The first posterior already includes the likelihood contribution from \(y_1\). Including \(y_1\) again would count its information twice and understate posterior uncertainty. (4) Examples include checking prior predictive plausibility, posterior predictive fit to the observed concentration-time pattern, residual trends, computational convergence, and sensitivity to reasonable prior choices.

Clinical Biostats