Tutorials › Pharmacokinetic-Pharmacodynamic (PK/PD) Modeling › Population Variability in Tolerance Development

Tolerance, Rebound and Adaptation · Tutorial 199 of 598

Population Variability in Tolerance Development

Model individual differences in tolerance development and recovery, calculate subject-specific trajectories, and distinguish random-effect variability from observation noise.

Advanced 11 min read

What You'll Learn

  • Define subject-specific tolerance induction and recovery parameters.
  • Specify random effects on positive rates and bounded tolerance levels.
  • Calculate individual tolerance trajectories during treatment and washout.
  • Distinguish between-subject variability from residual error using a hierarchical observation model.
  • Interpret population summaries without confusing typical values with arithmetic means.
  • Recognize common limitations of random-effects tolerance models.

Why Population Variability Matters

Two people receiving the same drug regimen may show different time courses of response loss and recovery. One may develop tolerance quickly and recover slowly; another may adapt more gradually but recover rapidly. A population model that represents only an average trajectory can conceal these differences, even when its average prediction appears reasonable. Modeling variability matters when interpreting individual response histories and when predicting how widely responses may differ across patients.

The focus here is between-subject variability in the parameters governing tolerance. It is not the same as unexplained scatter in measured responses. A subject’s tolerance state is a latent, time-varying quantity; random effects describe persistent differences between subjects in features such as induction rate, recovery rate, or attainable tolerance. Residual error describes deviations of individual observations from the response predicted for that subject at that time.

Definition: In a population tolerance model, a subject-specific parameter is a parameter whose value can differ across subjects. A random effect is a subject-level random variable used to describe that population distribution. For subject \(i\), the tolerance trajectory \(T_i(t)\) is determined by that subject’s parameters and exposure history. The residual error is the remaining observation-level deviation after accounting for the subject’s predicted response.

A Subject-Specific Induction and Recovery Model

Let \(T_i(t)\) be the dimensionless tolerance state for subject \(i\), with \(T_i=0\) denoting no tolerance and larger values denoting more tolerance. Consider a specified, constant treatment condition under which the subject’s tolerance approaches an attainable level \(T_{\mathrm{ss},i}\). During that treatment condition, use

$$ \frac{dT_i}{dt} = k_{\mathrm{ind},i}\bigl(T_{\mathrm{ss},i}-T_i(t)\bigr). $$

Here \(k_{\mathrm{ind},i}>0\) is the induction rate, in inverse time units, and \(0\leq T_{\mathrm{ss},i}\leq 1\) is the subject’s attainable tolerance level under the specified condition. After treatment is withdrawn, suppose tolerance recovers according to

$$ \frac{dT_i}{dt} = -k_{\mathrm{rec},i}T_i(t), $$

where \(k_{\mathrm{rec},i}>0\) is the recovery rate, also in inverse time units. These equations are a simple state-variable model: the state changes continuously, and the subject’s random effects influence its trajectory. The attainable level is conditional on the treatment condition; it should not be interpreted as a universal physiological ceiling if exposure or other conditions change.

The closed-form solutions make the role of individual parameters explicit. If treatment begins at time zero with state \(T_i(0)\), then during treatment

$$ T_i(t) = T_{\mathrm{ss},i} + \bigl(T_i(0)-T_{\mathrm{ss},i}\bigr) \exp(-k_{\mathrm{ind},i}t). $$

If treatment stops at time \(t_w\), then for \(t\geq t_w\),

$$ T_i(t) = T_i(t_w)\exp\bigl(-k_{\mathrm{rec},i}(t-t_w)\bigr). $$

The induction half-time is \(\log(2)/k_{\mathrm{ind},i}\), the time for the gap between \(T_i(t)\) and \(T_{\mathrm{ss},i}\) to halve. The recovery half-time is \(\log(2)/k_{\mathrm{rec},i}\), the time for the state itself to halve after withdrawal. Both are subject-specific when the corresponding rates vary between subjects.

Representing Between-Subject Variability

A common population model assigns random effects to transformed parameters. For example, a positive induction rate can be modeled as

$$ k_{\mathrm{ind},i} = k_{\mathrm{ind,pop}}\exp(\eta_{\mathrm{ind},i}), \qquad \eta_{\mathrm{ind},i}\sim N(0,\omega_{\mathrm{ind}}^2). $$

The population parameter \(k_{\mathrm{ind,pop}}\) is the median induction rate under this parameterization, not generally the arithmetic mean. The exponential transform keeps every individual rate positive. A bounded attainable tolerance can be modeled on the logit scale:

$$ \operatorname{logit}(T_{\mathrm{ss},i}) = \operatorname{logit}(T_{\mathrm{ss,pop}}) + \eta_{\mathrm{ss},i}, \qquad \eta_{\mathrm{ss},i}\sim N(0,\omega_{\mathrm{ss}}^2), $$

where \(\operatorname{logit}(x)=\log\{x/(1-x)\}\). The inverse-logit transformation keeps \(T_{\mathrm{ss},i}\) between zero and one. A recovery rate can be modeled on the log scale in the same way as the induction rate. Random effects may be correlated: for example, subjects with larger induction rates might also have larger or smaller recovery rates. Such a correlation is a population-level association between parameters, not evidence that one rate causes the other.

These distributions are assumptions, not discoveries guaranteed by the data. A normal distribution for log-rates implies a lognormal distribution for the rates. The model also assumes that, conditional on the subject’s random effects and recorded exposure, the trajectory equations adequately describe that subject’s tolerance state. Random effects are usually treated as independent across subjects, while repeated observations from the same subject share the same subject-level effects.

Worked Example: Two Different Treatment and Recovery Trajectories

Worked Example: Two Different Treatment and Recovery Trajectories

Consider two hypothetical subjects who both start treatment at \(T_i(0)=0\). Subject A has \(T_{\mathrm{ss},A}=0.750\) and \(k_{\mathrm{ind},A}=0.400\ \text{day}^{-1}\); subject B has \(T_{\mathrm{ss},B}=1/3\) and \(k_{\mathrm{ind},B}=0.450\ \text{day}^{-1}\). Treatment lasts four days. After withdrawal, let \(k_{\mathrm{rec},A}=0.100\ \text{day}^{-1}\) and \(k_{\mathrm{rec},B}=0.300\ \text{day}^{-1}\). Calculate both states at day 4 and day 8.

For subject A, the induction solution with \(T_A(0)=0\) is \(T_A(t)=T_{\mathrm{ss},A}\{1-\exp(-k_{\mathrm{ind},A}t)\}\). Thus,

$$ T_A(4) = 0.750\{1-\exp(-0.400\times4)\} = 0.750(1-\exp(-1.60)) \approx 0.5986. $$

After four days of recovery, using the unrounded day-4 state,

$$ T_A(8) = 0.750\{1-\exp(-1.60)\}\exp(-0.100\times4) \approx 0.4012. $$

For subject B, \(T_{\mathrm{ss},B}=1/3\), so

$$ T_B(4) = \frac{1}{3}\{1-\exp(-0.450\times4)\} = \frac{1}{3}(1-\exp(-1.80)) \approx 0.2782. $$

The corresponding day-8 state is

$$ T_B(8) = \frac{1}{3}(1-\exp(-1.80))\exp(-0.300\times4) \approx 0.08380. $$

Although B has a slightly higher induction rate, B’s lower attainable level means its tolerance state is lower at day 4. Its larger recovery rate then produces a much lower state at day 8. These are model-implied individual trajectories, not residual deviations around a common trajectory.

From Individual Parameters to Population Summaries

Population parameters describe a distribution of individual trajectories, not one trajectory that every subject follows. For instance, if \(\log(k_{\mathrm{ind},i})\) is normal with mean \(\log(k_{\mathrm{ind,pop}})\) and variance \(\omega_{\mathrm{ind}}^2\), then \(k_{\mathrm{ind,pop}}\) is the median, while the arithmetic mean is \(k_{\mathrm{ind,pop}}\exp(\omega_{\mathrm{ind}}^2/2)\). This distinction matters when reporting a “typical” rate or calculating a population-average prediction.

Worked Example: Interpreting a Lognormal Induction-Rate Distribution

Suppose a hypothetical population model estimates \(k_{\mathrm{ind,pop}}=0.200\ \text{day}^{-1}\) and \(\omega_{\mathrm{ind}}=0.400\), with \(\log(k_{\mathrm{ind},i})\) normally distributed around \(\log(k_{\mathrm{ind,pop}})\). Find the arithmetic mean rate and the coefficient of variation of individual rates.

The variance on the log scale is \(\omega_{\mathrm{ind}}^2=0.160\). For a lognormal variable, the arithmetic mean is the median multiplied by \(\exp(\omega_{\mathrm{ind}}^2/2)\):

$$ E(k_{\mathrm{ind},i}) = 0.200\exp(0.160/2) = 0.200\exp(0.0800) \approx 0.2167\ \text{day}^{-1}. $$

The coefficient of variation is the standard deviation divided by the arithmetic mean. For this lognormal distribution it equals \(\sqrt{\exp(\omega_{\mathrm{ind}}^2)-1}\):

$$ \mathrm{CV} = \sqrt{\exp(0.160)-1} \approx 0.4166. $$

Thus the population median is \(0.200\ \text{day}^{-1}\), the arithmetic mean is approximately \(0.2167\ \text{day}^{-1}\), and the standard deviation is about 41.66% of the arithmetic mean. The median and mean differ because the lognormal distribution is right-skewed.

Separating Random Effects From Residual Error

Suppose the measured response for subject \(i\) at observation \(j\) is modeled as

$$ Y_{ij} = f\bigl(C_{ij},T_i(t_{ij});\theta\bigr) + \epsilon_{ij}, $$

where \(f\) is the predicted pharmacodynamic response, \(C_{ij}\) is the relevant exposure, \(\theta\) denotes population response parameters, and \(\epsilon_{ij}\) is residual error. A simple assumption is that residuals have conditional mean zero and variance \(\sigma^2\), and are independent across observations given the model and random effects. Other residual structures may be needed when variability changes with the predicted response or measurements are correlated in time.

The distinction can be stated using the law of total variance:

$$ \operatorname{Var}(Y) = \operatorname{Var}\{E(Y\mid\eta)\} + E\{\operatorname{Var}(Y\mid\eta)\}, $$

where \(\eta\) denotes the subject-level random effects. The first term represents variability in predicted responses across subjects; the second represents average residual variability after conditioning on those effects. This decomposition follows by writing \(Y-E(Y)=[Y-E(Y\mid\eta)]+[E(Y\mid\eta)-E(Y)]\). The two bracketed terms have zero covariance because the conditional expectation of the first term given \(\eta\) is zero; taking variances therefore gives the displayed sum.

Worked Example: Interpreting Between-Subject and Residual Variance

Suppose, hypothetically, a response is \(Y_i=100\{1-T_i\}+\epsilon_i\) under a fixed exposure, with \(E(T_i)=0.400\), between-subject standard deviation \(0.200\), and independent residual error with mean zero and standard deviation \(5.00\) response units. Calculate the population mean response and its variance under this model.

The mean response is

$$ E(Y_i)=100\{1-E(T_i)\}=100(1-0.400)=60.0 $$

response units. Variation in \(T_i\) gives a between-subject response standard deviation of \(100(0.200)=20.0\) response units, so its variance is \(400\) response-units squared. Residual variance is \(5.00^2=25.0\) response-units squared. By the variance decomposition, assuming the stated independent additive residual error,

$$ \operatorname{Var}(Y_i)=400+25.0=425, \qquad \operatorname{SD}(Y_i)=\sqrt{425}\approx20.62 $$

response units. The \(20.0\)-unit between-subject component comes from differences in tolerance state; the \(5.00\)-unit residual component is observation-level scatter. Treating all of the variation as residual would discard the model’s account of persistent individual differences.

Estimation, Interpretation, and Practical Checks

In a nonlinear mixed-effects analysis, the population parameters specify typical values and random-effect distributions, while each subject’s repeated data inform that subject’s latent effects and trajectory. The model’s population predictions average over the random-effect distribution; predictions conditional on an individual’s data use that individual’s information. These are different targets. A subject-specific estimate is not the same thing as a population mean, and it is generally uncertain, especially when an individual has few observations.

Useful checks begin with the design and the observed pattern. Repeated observations across treatment onset and withdrawal are informative because induction and recovery affect different portions of the time course. If only on-treatment observations are available, recovery rates may be weakly informed; if observations are sparse or occur over a narrow range of time, induction rates and attainable levels may be difficult to distinguish. This is why variability estimates require more than simply fitting a model with random effects: the data must contain information about differences between subjects.

For a fitted model, inspect individual predictions alongside observations, and check whether the model captures the spread of trajectories as well as their central trend. Large systematic within-subject patterns in residuals can indicate that the state or response model is inadequate. Conversely, apparent isolated scatter does not by itself establish between-subject variability. Estimates of random-effect variance near zero, highly uncertain correlations, or strong dependence of estimates on modeling choices call for caution. These observations are prompts to investigate, not automatic proof of a particular failure.

FeatureBetween-subject random effectResidual error
Level of variationPersists across observations from one subjectObservation-level deviation
Example in a tolerance modelSubject-specific \(k_{\mathrm{ind},i}\)Measured response differing from its prediction
What repeated measurements contributeHelp characterize a subject’s trajectory relative to othersShow scatter around that subject’s trajectory
Common modeling assumptionDistribution across subjects, often on a transformed scaleConditional mean zero with a specified variance structure

Common Pitfalls and Limitations

  • Confusing rate variability with residual scatter. The wrong reasoning is that every observation differing from a population curve reflects a different individual rate. The correction is to distinguish persistent patterns across a subject’s observations from deviations that remain after the subject-specific trajectory is accounted for.
  • Reading the population typical value as the arithmetic mean. For lognormal rates, the exponentiated mean on the log scale is the median. Use the distribution’s mean formula when an arithmetic mean is needed.
  • Assuming more random effects always improve the model. Random effects on induction, recovery, attainable level, and their correlations can be difficult to estimate together. A complex structure needs adequate information and should be justified, not added by default.
  • Interpreting an individual fitted trajectory as directly observed. Tolerance is commonly latent and inferred through the response model. Its individual estimate depends on that model, exposure information, and the subject’s measurements.

Random-effects models also have limits. The assumed distribution can be wrong; sparse observations can leave individual parameters weakly determined; and between-subject variation may be confounded with unmodeled differences in exposure, baseline response, or measurement process. A simple induction-to-plateau and exponential-recovery model may not describe every biological adaptation pattern. Population variability quantifies differences within the chosen model; it does not by itself identify their biological cause.

Key takeaway: A population tolerance model separates the latent trajectories generated by subject-specific induction and recovery parameters from residual observation error. Interpret the random-effect distribution, individual predictions, and population-average predictions as distinct quantities.

Check Your Understanding

Answer each question, then compare with the brief solutions below.

  1. For \(dT_i/dt=k_{\mathrm{ind},i}(T_{\mathrm{ss},i}-T_i)\), what does \(k_{\mathrm{ind},i}\) control, and what are its units?
  2. A subject has \(T(0)=0\), \(T_{\mathrm{ss}}=0.600\), and \(k_{\mathrm{ind}}=0.300\ \text{day}^{-1}\). What is the predicted state after two days of treatment?
  3. Why does a lognormal induction rate with population median \(0.200\ \text{day}^{-1}\) and nonzero log-scale variance have an arithmetic mean greater than \(0.200\ \text{day}^{-1}\)?
  4. Repeated responses from one subject remain consistently below the population prediction, while their scatter around that subject’s fitted trajectory is small. Which source of variation is more consistent with this pattern, and why?

Solutions. (1) It controls the speed of approach toward the attainable tolerance level; its units are inverse time, such as \(\text{day}^{-1}\). (2) \(T(2)=0.600\{1-\exp(-0.300\times2)\}=0.600(1-\exp(-0.600))\approx0.2707\), dimensionless. (3) The lognormal distribution is right-skewed, and its mean is the median multiplied by \(\exp(\omega^2/2)>1\) when log-scale variance \(\omega^2>0\). (4) A persistent subject-level difference, represented by a random effect or another subject-specific feature, is more consistent than residual error, because the subject’s observations systematically share the deviation.

Clinical Biostats