Tutorials › Population Pharmacokinetics › Worked Random-Effect Structure For Repeated-Dose PK

Random-Effect Structure and Error Models · Tutorial 163 of 599

Worked Random-Effect Structure For Repeated-Dose PK

Build and interpret a clearance-and-volume omega structure for repeated-dose PK, including the covariance patterns it implies and the design conditions needed to estimate its terms.

Intermediate 12 min read

What You'll Learn

  • Write log-scale clearance and volume models with stable subject effects and occasion-specific effects.
  • Separate interindividual and interoccasion omega matrices and state the independence assumptions.
  • Calculate implied variances, covariances, and correlations within and across occasions.
  • Explain why covariance on the log-parameter scale is not automatically covariance on the natural scale.
  • Identify random-effect terms that repeated-dose data cannot distinguish or estimate reliably.
  • Compare full, diagonal, and reduced random-effect structures in terms of assumptions and data support.

Why repeated-dose random effects need structure

With repeated dosing, a subject can differ from the population in a way that persists across all occasions, and can also differ from their own typical value on a particular occasion. These are distinct sources of variation. A subject whose clearance is consistently low contributes to interindividual variability; a temporary change in that subject’s clearance on one occasion contributes to interoccasion variability. Combining the two without a clear structure can obscure what the model says and what the data can estimate.

This tutorial builds a compact random-effects structure for clearance and volume. The structural PK model determines how those parameters generate concentrations over time. The random-effects structure describes how the parameters vary across subjects and occasions; it does not replace the structural model or the residual-error model.

Definition: Let \(i\) index subjects and \(j\) index dosing occasions. In the model below, \(\eta_i\) is the subject-level random-effects vector, shared across occasions, and \(\kappa_{ij}\) is the occasion-level random-effects vector for subject \(i\) on occasion \(j\). Interindividual variability (IIV) is represented by variation in \(\eta_i\); interoccasion variability (IOV) is represented by variation in \(\kappa_{ij}\).

A two-parameter repeated-dose model

We model positive clearance and volume using their natural logarithms. The log scale is convenient because normally distributed random effects then give positive parameter values after exponentiation. Let \(CL_{ij}\) and \(V_{ij}\) be the clearance and volume applicable to subject \(i\) on occasion \(j\), and let \(\theta_{CL}\) and \(\theta_V\) be their population typical values. Specify

$$ \begin{aligned} \log(CL_{ij}) &= \log(\theta_{CL})+\eta_{CL,i}+\kappa_{CL,ij},\\ \log(V_{ij}) &= \log(\theta_V)+\eta_{V,i}+\kappa_{V,ij}. \end{aligned} $$

The random-effects vectors, in the order clearance then volume, are

$$ \eta_i= \begin{pmatrix} \eta_{CL,i}\\ \eta_{V,i} \end{pmatrix} \sim N(0,\Omega_{\mathrm{IIV}}), \qquad \kappa_{ij}= \begin{pmatrix} \kappa_{CL,ij}\\ \kappa_{V,ij} \end{pmatrix} \sim N(0,\Omega_{\mathrm{IOV}}). $$

Here \(N(0,\Omega)\) denotes a multivariate normal distribution with zero mean vector and covariance matrix \(\Omega\). A common starting model assumes that subject effects are independent across subjects, occasion effects are independent across subjects and occasions, and \(\eta_i\) is independent of every \(\kappa_{ij}\). These are modeling assumptions, not consequences of repeated dosing. The PK structural model must also specify how each occasion’s parameters apply to the dose history and concentration-time predictions, including any drug remaining from earlier doses.

A full two-parameter covariance structure at each level is

$$ \Omega_{\mathrm{IIV}}= \begin{pmatrix} \omega^2_{CL,\mathrm{IIV}} & \omega_{CL,V,\mathrm{IIV}}\\ \omega_{CL,V,\mathrm{IIV}} & \omega^2_{V,\mathrm{IIV}} \end{pmatrix}, \qquad \Omega_{\mathrm{IOV}}= \begin{pmatrix} \omega^2_{CL,\mathrm{IOV}} & \omega_{CL,V,\mathrm{IOV}}\\ \omega_{CL,V,\mathrm{IOV}} & \omega^2_{V,\mathrm{IOV}} \end{pmatrix}. $$

The diagonal entries are variances on the log-parameter scale. The off-diagonal entries are covariances on that same scale. Each matrix must be positive semidefinite; for a two-by-two matrix, this requires nonnegative diagonal entries and an off-diagonal entry whose magnitude does not exceed the product of the corresponding standard deviations. Correlations are often easier to compare across scales: for example, the IIV correlation is \(\rho_{\mathrm{IIV}}=\omega_{CL,V,\mathrm{IIV}}/(\omega_{CL,\mathrm{IIV}}\omega_{V,\mathrm{IIV}})\), when both standard deviations are nonzero.

Worked calculations for the omega structure

Worked Example: Building Two Omega Matrices

Hypothetical model specification. Suppose the proposed IIV standard deviations on the log scale are 0.30 for clearance and 0.20 for volume, with correlation 0.50. Suppose the IOV standard deviations are 0.15 and 0.10, respectively, with correlation \(-0.20\). Construct both covariance matrices.

A covariance is the product of the two standard deviations and their correlation. Thus the IIV covariance is \(0.30(0.20)(0.50)=0.0300\), and the IOV covariance is \(0.15(0.10)(-0.20)=-0.00300\). Squaring the standard deviations gives the diagonal variances:

$$ \Omega_{\mathrm{IIV}}= \begin{pmatrix} 0.30^2 & 0.0300\\ 0.0300 & 0.20^2 \end{pmatrix} = \begin{pmatrix} 0.0900 & 0.0300\\ 0.0300 & 0.0400 \end{pmatrix}, \qquad \Omega_{\mathrm{IOV}}= \begin{pmatrix} 0.15^2 & -0.00300\\ -0.00300 & 0.10^2 \end{pmatrix} = \begin{pmatrix} 0.0225 & -0.00300\\ -0.00300 & 0.0100 \end{pmatrix}. $$

Both matrices are valid covariance matrices: the implied correlations are 0.50 and \(-0.20\), each within the range from \(-1\) to 1. The negative IOV correlation means that, on the log scale, occasions with a positive clearance deviation tend to have a negative volume deviation, under this model. It does not establish a biological mechanism or a causal relationship.

The assumed independence of \(\eta_i\) and \(\kappa_{ij}\) makes the occasion-level covariance pattern especially clear. Adding independent random effects adds their variances. For two different occasions \(j\ne k\), the shared subject effect remains in both log parameters, but the independent occasion effects do not contribute to their cross-occasion covariance.

Result: Under the model above, the variance of log clearance on one occasion is \(\omega^2_{CL,\mathrm{IIV}}+\omega^2_{CL,\mathrm{IOV}}\). The covariance between log clearance and log volume is \(\omega_{CL,V,\mathrm{IIV}}+\omega_{CL,V,\mathrm{IOV}}\) on the same occasion, and \(\omega_{CL,V,\mathrm{IIV}}\) across different occasions for the same subject.

Worked Example: Covariances Within and Across Occasions

Hypothetical calculation. Use the matrices from the previous example. Calculate the variance of log clearance and log volume on an occasion, and the correlation between log clearance and log volume on the same and on different occasions for the same subject.

The log-clearance variance is \(0.0900+0.0225=0.1125\). The log-volume variance is \(0.0400+0.0100=0.0500\). The standard deviation product is \(\sqrt{0.1125}\sqrt{0.0500}=0.0750\).

On the same occasion, the covariance is the sum of IIV and IOV covariances: \(0.0300+(-0.00300)=0.0270\). Therefore the same-occasion correlation is \(0.0270/0.0750=0.360\). Across two different occasions, only the shared IIV covariance contributes: the covariance is \(0.0300\), and the correlation is \(0.0300/0.0750=0.400\).

The difference is meaningful: the occasion-level effects are negatively correlated here, reducing the within-occasion covariance, while the stable subject-level effects remain shared across occasions. These are correlations between log parameters. They should not be reported as correlations between natural-scale clearance and volume without a separate calculation under the transformed distribution.

Why the covariance result holds

The result follows directly from covariance rules and the independence assumptions. For example, write the log clearance and log volume for one occasion as their fixed log typical values plus subject and occasion effects. Fixed constants do not affect covariance. Expanding the covariance gives four terms:

$$ \begin{aligned} \operatorname{Cov}(\log CL_{ij},\log V_{ij}) ={}&\operatorname{Cov}(\eta_{CL,i},\eta_{V,i}) +\operatorname{Cov}(\eta_{CL,i},\kappa_{V,ij})\\ &+\operatorname{Cov}(\kappa_{CL,ij},\eta_{V,i}) +\operatorname{Cov}(\kappa_{CL,ij},\kappa_{V,ij}). \end{aligned} $$

The two mixed terms are zero because subject and occasion effects are assumed independent. The first term is the IIV covariance, and the last is the IOV covariance. Thus the same-occasion covariance is their sum. For \(j\ne k\), the last term becomes \(\operatorname{Cov}(\kappa_{CL,ij},\kappa_{V,ik})=0\) under independence across occasions. The remaining covariance is the IIV covariance. This derivation also shows why the conclusion would change if the independence assumptions changed.

Worked Example: Recognizing an Unsupported Separation

Hypothetical design. Suppose each subject contributes PK data on only one dosing occasion. Consider log clearance, and suppose its observed between-subject variance is estimated as 0.1125. Can the data separate IIV variance from IOV variance using this design alone?

With one occasion per subject, the model gives \(\log(CL_{i1})=\log(\theta_{CL})+\eta_{CL,i}+\kappa_{CL,i1}\). Under independence, its variance is only the sum \(\omega^2_{CL,\mathrm{IIV}}+\omega^2_{CL,\mathrm{IOV}}\). The observed value 0.1125 could be explained by IIV variance 0.0900 and IOV variance 0.0225, but it could also be explained by 0.1000 and 0.0125. Both sums equal 0.1125. Many decompositions produce the same marginal variance.

Therefore, this design does not identify the two variance components separately from that variance information alone. Replicate concentrations within an occasion can help distinguish residual measurement or model error from variation in the occasion’s PK parameters, but they do not create repeated occasions for a subject. By contrast, with multiple occasions per subject, the covariance of log clearance across different occasions is \(\omega^2_{CL,\mathrm{IIV}}\) under this model; the within-occasion variance is the sum. Repeated occasions can therefore provide the covariance pattern needed to distinguish the components, provided the PK data are informative about clearance on each occasion.

Choosing terms that the data can support

A full pair of two-parameter matrices contains six variance and covariance parameters: two variances and one covariance at each of the IIV and IOV levels. That may be a reasonable candidate, but it is not automatically justified. A term can be mathematically defined yet weakly informed by the sampling design, the number of subjects, or the way the structural model maps parameters to concentrations.

For example, a clearance-volume covariance at the IOV level requires information about how the two occasion-specific parameter deviations co-vary. If each occasion has sparse samples concentrated in a time region that is weakly informative for one parameter, that covariance may be poorly estimated. Similarly, estimating an IOV variance requires repeated occasions within subjects; estimating a stable IIV variance separately from it requires the repeated-occasion covariance information described above. Merely having many concentration records is not sufficient if they do not inform the relevant parameter contrasts.

Common alternatives impose more structure:

StructureAssumptionWhen it can be useful
Full covariance matricesEach level has its own variances and clearance-volume covariance.There are enough informative subjects and repeated occasions to estimate the extra terms.
Diagonal matricesClearance and volume random effects are uncorrelated at that level.The covariance is weakly supported or a simpler model is preferred.
Reduced IOV structureOnly selected parameters, such as clearance, vary by occasion.The design informs occasion variability for some parameters better than others.
No IOV termsOccasion-specific deviations are absent in the model.There is no convincing design information for IOV, or a simpler structure is being evaluated.

A diagonal matrix does not prove that the true effects are independent; it fixes their covariance to zero. Likewise, removing an IOV term is a modeling restriction, not proof that occasions are biologically identical. Candidate structures should be assessed for estimability, fit, plausibility, and stability rather than selected solely because a larger matrix is possible. The earlier material on covariance structures and information criteria provides a framework for comparing supported candidate models.

Diagnostics, limitations, and a common pitfall

Warning signs include variance estimates near zero when the model contains many terms, correlations close to \(1\) or \(-1\), large uncertainty in covariance estimates, unstable estimates under small changes to the model, or numerical difficulties in fitting. These can indicate that the data do not distinguish the terms well, that the chosen parameterization is too ambitious, or that the assumed distribution and independence structure are inadequate. They are not, by themselves, proof of a particular biological alternative. Check whether subjects truly have repeated informative occasions, whether occasions are defined consistently, and whether the structural model can distinguish clearance from volume in the observed sampling windows.

The log-scale model also has an interpretation worth keeping precise. A zero-mean normal random effect on the log scale makes the typical parameter a median under the random-effects distribution, not generally its arithmetic mean. Exponentiating a normal random effect yields a lognormal distribution; for a single normally distributed log deviation with variance \(v\), the multiplicative factor has mean \(\exp(v/2)\), not 1. This distinction matters when translating model parameters into natural-scale summaries.

  • Common mistake: “The total variance on one occasion is IIV variance, so any extra variability must be residual error.” Correction: Under this structure, occasion variance also contributes: the log-parameter variance is IIV plus IOV. Separating these components requires repeated occasions and a design that informs occasion-level PK parameters; residual error is a separate model component.
  • Common mistake: “A positive clearance-volume covariance means the parameters cause one another to increase.” Correction: It describes a modeled association between random deviations on the specified scale. It does not establish causation.
  • Common mistake: “The covariance matrix entries are the same on the log and natural scales.” Correction: The omega matrices here describe log-parameter random effects. Exponentiation changes the distribution and its covariance.

The structure is a useful working model, not a guarantee that every random effect is identifiable or that the Gaussian assumptions are correct. Its practical value is that it separates persistent subject differences from occasion-specific deviations and makes the implied dependence transparent enough to evaluate against the study design.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. If the IIV covariance between log clearance and log volume is 0.024 and the IOV covariance is \(-0.004\), what is their same-occasion covariance under the stated model?
  2. What is the covariance between log clearance on occasion 1 and log clearance on occasion 2 for the same subject, assuming independent occasion effects?
  3. Why can one occasion per subject fail to distinguish IIV variance from IOV variance?
  4. What does a diagonal IOV matrix assume about occasion effects on clearance and volume?

Solutions. (1) The same-occasion covariance is the sum, \(0.024+(-0.004)=0.020\). (2) It is the IIV clearance variance, \(\omega^2_{CL,\mathrm{IIV}}\), because the shared subject effect appears on both occasions and the independent occasion effects have zero cross-occasion covariance. (3) With one occasion, the observed log-clearance variance contains only the sum \(\omega^2_{CL,\mathrm{IIV}}+\omega^2_{CL,\mathrm{IOV}}\); different pairs of component variances can give the same sum. (4) It fixes the IOV clearance-volume covariance to zero, meaning the occasion-specific log-clearance and log-volume effects are uncorrelated under the model.

Clinical Biostats