Tutorials › Optimal Design and Model-Informed Dosing › Lognormal and Correlated Random-Effects Priors

Bayesian Forecasting and Dose Adaptation · Tutorial 311 of 497

Lognormal and Correlated Random-Effects Priors

Learn to parameterize lognormal individual priors from typical values and coefficients of variation, and to construct and check correlated random-effects distributions.

Advanced 12 min read

What You'll Learn

  • Define a lognormal prior from a normal distribution on the log parameter scale.
  • Distinguish a lognormal prior’s median from its arithmetic mean.
  • Convert a coefficient of variation into log-scale variance.
  • Build a covariance matrix for correlated transformed random effects.
  • Interpret how log-scale covariance induces dependence between positive parameters.
  • Check prior parameterization, covariance validity, and simulated values.

Why the Prior Scale Matters

Individual pharmacokinetic parameters such as clearance and volume must be positive. A normal distribution on the original parameter scale can assign probability to impossible negative values, while a normal distribution on the logarithm of the parameter naturally gives a positive-valued distribution. In a population model, this construction also gives a useful interpretation to variability: individuals differ multiplicatively around a typical value.

When several parameters vary together, specifying a separate prior for each does not describe their joint distribution. A multivariate prior on transformed random effects also records whether individuals with relatively high values of one parameter tend to have relatively high or low values of another. The details of this construction matter: log-scale means are not generally arithmetic means on the parameter scale, and log-scale correlations are not identical to correlations between the original parameters.

Lognormal Priors for Positive Parameters

Definition: A positive parameter \(\theta\) is lognormally distributed if its natural logarithm is normally distributed: \(\log(\theta)\sim N(\mu,\sigma^2)\). Equivalently, \(\theta=\exp(Z)\) for \(Z\sim N(\mu,\sigma^2)\). Its median is \(\exp(\mu)\), its arithmetic mean is \(\exp(\mu+\sigma^2/2)\), and its variance is \((\exp(\sigma^2)-1)\exp(2\mu+\sigma^2)\).

In a typical population PK parameterization, an individual parameter is written \(\theta_i=\theta_{\mathrm{typ}}\exp(\eta_i)\), where \(\theta_{\mathrm{typ}}>0\) is the typical value and \(\eta_i\sim N(0,\omega^2)\). This makes \(\theta_{\mathrm{typ}}\) the population median, not the arithmetic mean: \(\operatorname{median}(\theta_i)=\theta_{\mathrm{typ}}\), whereas \(E(\theta_i)=\theta_{\mathrm{typ}}\exp(\omega^2/2)\). The distinction is important whenever a reported population summary is meant to be an arithmetic average.

A convenient way to specify the spread is the coefficient of variation (CV), defined as the standard deviation divided by the arithmetic mean. For a lognormal distribution, the relation is \(\mathrm{CV}=\sqrt{\exp(\sigma^2)-1}\); thus, \(\sigma^2=\log(1+\mathrm{CV}^2)\). This CV describes between-individual variability in the prior, not residual measurement error.

Worked Example: A Clearance Prior From a Typical Value and CV

Suppose a hypothetical population model assigns clearance a typical value of \(5.00\) L/h and a between-individual CV of \(30.0\%\). Use a lognormal random-effects model, with the typical value interpreted as the median.

First convert the CV to log-scale variance and standard deviation:

$$ \omega^2=\log(1+0.30^2)=\log(1.09)=0.08618,\qquad \omega=\sqrt{0.08618}=0.2936. $$

The prior can therefore be written \(\log(CL_i)\sim N(\log(5.00),0.08618)\), with clearance measured in L/h. Its median is \(5.00\) L/h, while its arithmetic mean is

$$ E(CL_i)=5.00\exp(0.08618/2)=5.00\exp(0.04309)=5.220\ \mathrm{L/h}. $$

An equal-tailed 95% prior interval is obtained by exponentiating the normal interval on the log scale:

$$ \left[\exp(\log(5.00)-1.96(0.2936)),\, \exp(\log(5.00)+1.96(0.2936))\right] =[2.812,\,8.89]\ \mathrm{L/h}. $$

The interval is asymmetric around the median on the original scale, as expected for a lognormal distribution. It is a central prior interval: under the specified prior model, 95% of individual clearances lie between these limits.

Choosing Whether to Center on the Median or Mean

The random-effects form \(\theta_i=\theta_{\mathrm{typ}}\exp(\eta_i)\) with \(E(\eta_i)=0\) centers the log parameter at \(\log(\theta_{\mathrm{typ}})\). That is often natural when \(\theta_{\mathrm{typ}}\) means the typical, or median, individual. If the information to encode instead specifies an arithmetic mean \(m\), the log-scale location must be shifted down to account for the positive skew.

Key result: To give a lognormal parameter arithmetic mean \(m\) and log-scale standard deviation \(\sigma\), use \(\log(\theta)\sim N(\log(m)-\sigma^2/2,\sigma^2)\). Its median is \(m\exp(-\sigma^2/2)\), not \(m\).

Worked Example: Specifying an Arithmetic Mean

Suppose a hypothetical prior for volume has arithmetic mean \(6.00\) L and CV \(25.0\%\). Determine the normal distribution for its logarithm and the implied median.

The log-scale variance and standard deviation are

$$ \sigma^2=\log(1+0.25^2)=\log(1.0625)=0.06062,\qquad \sigma=\sqrt{0.06062}=0.2462. $$

To preserve the arithmetic mean of \(6.00\) L, set the log-scale mean to

$$ \mu=\log(6.00)-\frac{0.06062}{2} =1.7918-0.03031=1.7615. $$

Thus \(\log(V_i)\sim N(1.7615,0.06062)\), where the logarithm is taken of the numerical value in L. The median is

$$ \exp(1.7615)=5.821\ \mathrm{L}. $$

As a check, the arithmetic mean is \(\exp(1.7615+0.06062/2)=6.00\) L. Using \(\log(6.00)\) as the log-scale mean instead would make \(6.00\) L the median and would imply an arithmetic mean of \(6.00\exp(0.03031)=6.185\) L.

Correlated Random Effects

For \(q\) positive individual parameters, collect their transformed random effects in \(\boldsymbol{\eta}_i=(\eta_{i1},\ldots,\eta_{iq})^\mathsf{T}\). The standard multivariate construction is \(\boldsymbol{\eta}_i\sim N(\mathbf{0},\boldsymbol{\Omega})\), with individual parameters \(\theta_{ij}=\theta_{\mathrm{typ},j}\exp(\eta_{ij})\). The diagonal entries of \(\boldsymbol{\Omega}\) are log-scale variances; off-diagonal entries are log-scale covariances. For parameters \(j\) and \(k\), the log-scale correlation is \(\rho_{jk}=\omega_{jk}/\sqrt{\omega_{jj}\omega_{kk}}\).

The covariance matrix must be symmetric and positive semidefinite; a positive-definite matrix is needed for a nonsingular multivariate normal density. In the two-parameter case, this requires nonnegative variances and \(|\rho_{12}|\leq 1\). In higher dimensions, checking each pairwise correlation alone is not sufficient: the complete matrix must be positive semidefinite.

Log-scale correlation has a precise, but scale-specific, meaning. Positive \(\rho_{jk}\) means that above-typical values of one transformed effect tend to occur with above-typical values of the other. It does not mean the raw parameter correlation has exactly the same numerical value. For the lognormal construction above, the correlation on the original scale is

$$ \operatorname{Corr}(\theta_{ij},\theta_{ik}) = \frac{\exp(\omega_{jk})-1} {\sqrt{(\exp(\omega_{jj})-1)(\exp(\omega_{kk})-1)}}. $$

This follows because multiplying by fixed typical values does not change correlation, while the moments of jointly normal variables give \(\operatorname{Cov}(\exp(\eta_{ij}),\exp(\eta_{ik}))=\exp((\omega_{jj}+\omega_{kk})/2)(\exp(\omega_{jk})-1)\). Dividing that covariance by the two marginal standard deviations yields the displayed expression. Consequently, the original-scale correlation depends on both the covariance and the marginal variances.

Worked Example: A Correlated Clearance and Volume Prior

Consider hypothetical typical values \(CL_{\mathrm{typ}}=5.00\) L/h and \(V_{\mathrm{typ}}=40.0\) L. Suppose the log-scale standard deviations are \(0.300\) for clearance and \(0.400\) for volume, and their log-scale correlation is \(0.500\). The covariance is \(0.500(0.300)(0.400)=0.0600\), so

$$ \boldsymbol{\Omega} = \begin{pmatrix} 0.0900 & 0.0600\\ 0.0600 & 0.160 \end{pmatrix}. $$

The determinant is \((0.0900)(0.160)-(0.0600)^2=0.0108>0\), and the diagonal entries are positive, so this two-dimensional covariance matrix is positive definite. It defines a valid nonsingular joint normal prior on the two random effects.

The implied correlation between the original clearance and volume parameters is

$$ \frac{\exp(0.0600)-1} {\sqrt{(\exp(0.0900)-1)(\exp(0.160)-1)}} = \frac{0.06184}{\sqrt{(0.09417)(0.1735)}}=0.484. $$

Thus the raw-parameter correlation is approximately \(0.484\), not \(0.500\), even though the log-scale correlation is \(0.500\). The corresponding multivariate prior can also be simulated: for independent \(Z_1,Z_2\sim N(0,1)\), set \(\eta_{CL}=0.300Z_1\) and \(\eta_V=0.200Z_1+0.3464Z_2\). The second expression has variance \(0.200^2+0.3464^2\approx0.160\), and its covariance with \(\eta_{CL}\) is \(0.300(0.200)=0.0600\). Exponentiating these effects and multiplying by their typical values produces positive, correlated individual parameters.

Construction Checks and Alternatives

A prior is only as interpretable as its parameterization. Before using a lognormal random-effects prior, state whether each typical value is a median or an arithmetic mean, identify whether variability is supplied as a CV or a log-scale standard deviation, and attach the original parameter’s units to summaries on its natural scale. Logarithms apply to dimensionless ratios in principle; writing a logarithm of a parameter implicitly means that the parameter has first been expressed relative to a fixed unit.

Useful checks include verifying that simulated parameters are positive, that their medians and CVs match the intended specifications, and that joint simulated values reproduce the intended direction and approximate strength of dependence. Inspect simulated quantiles as well as means: a small log-scale standard deviation can still produce a long upper tail, and extreme draws may matter for a PK model. For a multivariate prior, inspect symmetry and eigenvalues of \(\boldsymbol{\Omega}\), or use a Cholesky factorization when generating draws. A negative eigenvalue signals an invalid covariance specification; rounding a matrix can also make a near-singular specification invalid.

Independent lognormal priors are a simpler alternative when dependence is intentionally absent, but setting all off-diagonal covariances to zero is a substantive assumption. A normal prior on the original parameter scale can be reasonable for parameters whose support is not restricted to positive values, but for positive PK parameters it may permit impossible values. Other positive distributions can represent different tail behavior, but changing the family changes the implied prior summaries and dependence structure. The lognormal construction is not automatically correct simply because parameters are positive: its multiplicative spread and tail behavior must be scientifically plausible.

Covariate adjustment changes the typical value used for an individual, not the basic random-effects construction. For a covariate-specific typical value \(\theta_{\mathrm{typ},j}(x_i)\), the parameter can be written \(\theta_{ij}=\theta_{\mathrm{typ},j}(x_i)\exp(\eta_{ij})\); the random-effects covariance describes remaining between-individual variation conditional on that typical-value model. This prior specifies population-level variation to be used in individualization; it does not by itself say how concentration observations update an individual’s parameters.

Common Mistakes and Limitations

  • Treating the typical value as an arithmetic mean. A zero-mean log random effect makes the typical value the median. If the arithmetic mean is intended, subtract half the log-scale variance from the log-scale location.
  • Putting a CV directly into the covariance matrix. A CV is not a log-scale standard deviation. Convert using \(\sigma^2=\log(1+\mathrm{CV}^2)\).
  • Interpreting log-scale correlation as raw-scale correlation. The relationship is nonlinear and depends on both marginal variances; use the transformed-correlation formula when the raw-scale value is needed.
  • Assuming pairwise-valid correlations guarantee a valid joint prior. For three or more effects, validate the entire covariance matrix, not only each correlation separately.
  • Ignoring implausible tails. A mathematically valid lognormal prior can still generate clinically implausible parameter values. Examine prior simulations and revisit the variability assumptions when necessary.

These checks do not establish that a prior is scientifically appropriate; they establish that its mathematical specification matches the intended summaries and dependence assumptions. Sparse information about the population, strong covariate extrapolation, or a poorly supported correlation can leave substantial uncertainty in those assumptions.

Check Your Understanding

Work through each item, then compare with the solutions below.

  1. A positive parameter has median \(10.0\) units and CV \(20.0\%\). What are its log-scale variance and arithmetic mean?
  2. A bivariate random effect has standard deviations \(0.20\) and \(0.50\), with correlation \(-0.40\). What is its covariance?
  3. For the prior in Question 2, is the covariance matrix positive definite?
  4. If a lognormal prior has arithmetic mean \(8.00\) units and log-scale variance \(0.16\), what is its log-scale mean?

Solutions. (1) The variance is \(\log(1+0.20^2)=\log(1.04)=0.03922\). The arithmetic mean is \(10.0\exp(0.03922/2)=10.20\) units. (2) The covariance is \((-0.40)(0.20)(0.50)=-0.0400\). (3) The diagonal variances are \(0.0400\) and \(0.250\); the determinant is \((0.0400)(0.250)-(-0.0400)^2=0.00840>0\), so the matrix is positive definite. (4) The log-scale mean is \(\log(8.00)-0.16/2=2.0794-0.0800=1.9994\).

Clinical Biostats