Why repeated-dose random effects need structure
With repeated dosing, a subject can differ from the population in a way that persists across all occasions, and can also differ from their own typical value on a particular occasion. These are distinct sources of variation. A subject whose clearance is consistently low contributes to interindividual variability; a temporary change in that subject’s clearance on one occasion contributes to interoccasion variability. Combining the two without a clear structure can obscure what the model says and what the data can estimate.
This tutorial builds a compact random-effects structure for clearance and volume. The structural PK model determines how those parameters generate concentrations over time. The random-effects structure describes how the parameters vary across subjects and occasions; it does not replace the structural model or the residual-error model.
A two-parameter repeated-dose model
We model positive clearance and volume using their natural logarithms. The log scale is convenient because normally distributed random effects then give positive parameter values after exponentiation. Let \(CL_{ij}\) and \(V_{ij}\) be the clearance and volume applicable to subject \(i\) on occasion \(j\), and let \(\theta_{CL}\) and \(\theta_V\) be their population typical values. Specify
The random-effects vectors, in the order clearance then volume, are
Here \(N(0,\Omega)\) denotes a multivariate normal distribution with zero mean vector and covariance matrix \(\Omega\). A common starting model assumes that subject effects are independent across subjects, occasion effects are independent across subjects and occasions, and \(\eta_i\) is independent of every \(\kappa_{ij}\). These are modeling assumptions, not consequences of repeated dosing. The PK structural model must also specify how each occasion’s parameters apply to the dose history and concentration-time predictions, including any drug remaining from earlier doses.
A full two-parameter covariance structure at each level is
The diagonal entries are variances on the log-parameter scale. The off-diagonal entries are covariances on that same scale. Each matrix must be positive semidefinite; for a two-by-two matrix, this requires nonnegative diagonal entries and an off-diagonal entry whose magnitude does not exceed the product of the corresponding standard deviations. Correlations are often easier to compare across scales: for example, the IIV correlation is \(\rho_{\mathrm{IIV}}=\omega_{CL,V,\mathrm{IIV}}/(\omega_{CL,\mathrm{IIV}}\omega_{V,\mathrm{IIV}})\), when both standard deviations are nonzero.
Worked calculations for the omega structure
Worked Example: Building Two Omega Matrices
Hypothetical model specification. Suppose the proposed IIV standard deviations on the log scale are 0.30 for clearance and 0.20 for volume, with correlation 0.50. Suppose the IOV standard deviations are 0.15 and 0.10, respectively, with correlation \(-0.20\). Construct both covariance matrices.
A covariance is the product of the two standard deviations and their correlation. Thus the IIV covariance is \(0.30(0.20)(0.50)=0.0300\), and the IOV covariance is \(0.15(0.10)(-0.20)=-0.00300\). Squaring the standard deviations gives the diagonal variances:
Both matrices are valid covariance matrices: the implied correlations are 0.50 and \(-0.20\), each within the range from \(-1\) to 1. The negative IOV correlation means that, on the log scale, occasions with a positive clearance deviation tend to have a negative volume deviation, under this model. It does not establish a biological mechanism or a causal relationship.
The assumed independence of \(\eta_i\) and \(\kappa_{ij}\) makes the occasion-level covariance pattern especially clear. Adding independent random effects adds their variances. For two different occasions \(j\ne k\), the shared subject effect remains in both log parameters, but the independent occasion effects do not contribute to their cross-occasion covariance.
Worked Example: Covariances Within and Across Occasions
Hypothetical calculation. Use the matrices from the previous example. Calculate the variance of log clearance and log volume on an occasion, and the correlation between log clearance and log volume on the same and on different occasions for the same subject.
The log-clearance variance is \(0.0900+0.0225=0.1125\). The log-volume variance is \(0.0400+0.0100=0.0500\). The standard deviation product is \(\sqrt{0.1125}\sqrt{0.0500}=0.0750\).
On the same occasion, the covariance is the sum of IIV and IOV covariances: \(0.0300+(-0.00300)=0.0270\). Therefore the same-occasion correlation is \(0.0270/0.0750=0.360\). Across two different occasions, only the shared IIV covariance contributes: the covariance is \(0.0300\), and the correlation is \(0.0300/0.0750=0.400\).
The difference is meaningful: the occasion-level effects are negatively correlated here, reducing the within-occasion covariance, while the stable subject-level effects remain shared across occasions. These are correlations between log parameters. They should not be reported as correlations between natural-scale clearance and volume without a separate calculation under the transformed distribution.
Why the covariance result holds
The result follows directly from covariance rules and the independence assumptions. For example, write the log clearance and log volume for one occasion as their fixed log typical values plus subject and occasion effects. Fixed constants do not affect covariance. Expanding the covariance gives four terms:
The two mixed terms are zero because subject and occasion effects are assumed independent. The first term is the IIV covariance, and the last is the IOV covariance. Thus the same-occasion covariance is their sum. For \(j\ne k\), the last term becomes \(\operatorname{Cov}(\kappa_{CL,ij},\kappa_{V,ik})=0\) under independence across occasions. The remaining covariance is the IIV covariance. This derivation also shows why the conclusion would change if the independence assumptions changed.
Worked Example: Recognizing an Unsupported Separation
Hypothetical design. Suppose each subject contributes PK data on only one dosing occasion. Consider log clearance, and suppose its observed between-subject variance is estimated as 0.1125. Can the data separate IIV variance from IOV variance using this design alone?
With one occasion per subject, the model gives \(\log(CL_{i1})=\log(\theta_{CL})+\eta_{CL,i}+\kappa_{CL,i1}\). Under independence, its variance is only the sum \(\omega^2_{CL,\mathrm{IIV}}+\omega^2_{CL,\mathrm{IOV}}\). The observed value 0.1125 could be explained by IIV variance 0.0900 and IOV variance 0.0225, but it could also be explained by 0.1000 and 0.0125. Both sums equal 0.1125. Many decompositions produce the same marginal variance.
Therefore, this design does not identify the two variance components separately from that variance information alone. Replicate concentrations within an occasion can help distinguish residual measurement or model error from variation in the occasion’s PK parameters, but they do not create repeated occasions for a subject. By contrast, with multiple occasions per subject, the covariance of log clearance across different occasions is \(\omega^2_{CL,\mathrm{IIV}}\) under this model; the within-occasion variance is the sum. Repeated occasions can therefore provide the covariance pattern needed to distinguish the components, provided the PK data are informative about clearance on each occasion.
Choosing terms that the data can support
A full pair of two-parameter matrices contains six variance and covariance parameters: two variances and one covariance at each of the IIV and IOV levels. That may be a reasonable candidate, but it is not automatically justified. A term can be mathematically defined yet weakly informed by the sampling design, the number of subjects, or the way the structural model maps parameters to concentrations.
For example, a clearance-volume covariance at the IOV level requires information about how the two occasion-specific parameter deviations co-vary. If each occasion has sparse samples concentrated in a time region that is weakly informative for one parameter, that covariance may be poorly estimated. Similarly, estimating an IOV variance requires repeated occasions within subjects; estimating a stable IIV variance separately from it requires the repeated-occasion covariance information described above. Merely having many concentration records is not sufficient if they do not inform the relevant parameter contrasts.
Common alternatives impose more structure:
| Structure | Assumption | When it can be useful |
|---|---|---|
| Full covariance matrices | Each level has its own variances and clearance-volume covariance. | There are enough informative subjects and repeated occasions to estimate the extra terms. |
| Diagonal matrices | Clearance and volume random effects are uncorrelated at that level. | The covariance is weakly supported or a simpler model is preferred. |
| Reduced IOV structure | Only selected parameters, such as clearance, vary by occasion. | The design informs occasion variability for some parameters better than others. |
| No IOV terms | Occasion-specific deviations are absent in the model. | There is no convincing design information for IOV, or a simpler structure is being evaluated. |
A diagonal matrix does not prove that the true effects are independent; it fixes their covariance to zero. Likewise, removing an IOV term is a modeling restriction, not proof that occasions are biologically identical. Candidate structures should be assessed for estimability, fit, plausibility, and stability rather than selected solely because a larger matrix is possible. The earlier material on covariance structures and information criteria provides a framework for comparing supported candidate models.
Diagnostics, limitations, and a common pitfall
Warning signs include variance estimates near zero when the model contains many terms, correlations close to \(1\) or \(-1\), large uncertainty in covariance estimates, unstable estimates under small changes to the model, or numerical difficulties in fitting. These can indicate that the data do not distinguish the terms well, that the chosen parameterization is too ambitious, or that the assumed distribution and independence structure are inadequate. They are not, by themselves, proof of a particular biological alternative. Check whether subjects truly have repeated informative occasions, whether occasions are defined consistently, and whether the structural model can distinguish clearance from volume in the observed sampling windows.
The log-scale model also has an interpretation worth keeping precise. A zero-mean normal random effect on the log scale makes the typical parameter a median under the random-effects distribution, not generally its arithmetic mean. Exponentiating a normal random effect yields a lognormal distribution; for a single normally distributed log deviation with variance \(v\), the multiplicative factor has mean \(\exp(v/2)\), not 1. This distinction matters when translating model parameters into natural-scale summaries.
- Common mistake: “The total variance on one occasion is IIV variance, so any extra variability must be residual error.” Correction: Under this structure, occasion variance also contributes: the log-parameter variance is IIV plus IOV. Separating these components requires repeated occasions and a design that informs occasion-level PK parameters; residual error is a separate model component.
- Common mistake: “A positive clearance-volume covariance means the parameters cause one another to increase.” Correction: It describes a modeled association between random deviations on the specified scale. It does not establish causation.
- Common mistake: “The covariance matrix entries are the same on the log and natural scales.” Correction: The omega matrices here describe log-parameter random effects. Exponentiation changes the distribution and its covariance.
The structure is a useful working model, not a guarantee that every random effect is identifiable or that the Gaussian assumptions are correct. Its practical value is that it separates persistent subject differences from occasion-specific deviations and makes the implied dependence transparent enough to evaluate against the study design.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions.
- If the IIV covariance between log clearance and log volume is 0.024 and the IOV covariance is \(-0.004\), what is their same-occasion covariance under the stated model?
- What is the covariance between log clearance on occasion 1 and log clearance on occasion 2 for the same subject, assuming independent occasion effects?
- Why can one occasion per subject fail to distinguish IIV variance from IOV variance?
- What does a diagonal IOV matrix assume about occasion effects on clearance and volume?
Solutions. (1) The same-occasion covariance is the sum, \(0.024+(-0.004)=0.020\). (2) It is the IIV clearance variance, \(\omega^2_{CL,\mathrm{IIV}}\), because the shared subject effect appears on both occasions and the independent occasion effects have zero cross-occasion covariance. (3) With one occasion, the observed log-clearance variance contains only the sum \(\omega^2_{CL,\mathrm{IIV}}+\omega^2_{CL,\mathrm{IOV}}\); different pairs of component variances can give the same sum. (4) It fixes the IOV clearance-volume covariance to zero, meaning the occasion-specific log-clearance and log-volume effects are uncorrelated under the model.