Tutorials › Nonlinear Mixed-Effects Models (NLME) › Subject Identity Creates Dependence Across Concentrations

Why Mixed-Effects Models · Tutorial 2 of 797

Subject Identity Creates Dependence Across Concentrations

Use paired pharmacokinetic concentrations to see how subject identity can create within-subject dependence and how to describe that dependence with covariance and correlation.

Beginner 10 min read

What You'll Learn

  • Distinguish within-subject association from differences in average concentration across sampling occasions.
  • Describe a simple model in which a stable subject-specific component induces dependence between paired concentrations.
  • Derive the covariance and correlation implied by that model.
  • Calculate and interpret a descriptive correlation from hypothetical paired concentrations.
  • Recognize when a shared subject component is insufficient to describe observed profiles.
  • Compare paired displays and summaries with approaches that ignore subject identity.

Why Subject Identity Matters

Repeated pharmacokinetic profiles are clustered by subject: measurements from one person share more than a sampling schedule. A subject may have persistently higher or lower concentrations than another because of stable differences in factors such as body size, physiology, or drug handling. Consequently, two concentrations measured from the same subject can move together, even when they are taken at different times. This is a statement about dependence, not a claim that one concentration causes the other.

A simple way to study this idea is to consider two sampling occasions and retain the identity of the subject for each pair. If subjects with relatively high concentrations at the first occasion also tend to have relatively high concentrations at the second, the paired observations contain a within-subject association. Looking only at the two overall averages cannot show that association.

Definition: Within-subject dependence is a statistical relationship between two or more measurements from the same subject, such that their joint distribution cannot in general be described as the product of their separate distributions. Positive within-subject dependence means that, relative to their occasion-specific averages, higher-than-average values at one occasion tend to occur with higher-than-average values at another.

A Simple Model for Paired Concentrations

Let \(C_{ij}\) denote the concentration for subject \(i\) on occasion \(j\), where \(i=1,\ldots,n\) indexes subjects and \(j=1,2\) indexes the two occasions. Concentration is measured in a common unit, such as mg/L. A useful introductory model separates an occasion average, a stable subject-specific deviation, and a measurement-level residual:

$$ C_{ij}=\mu_j+b_i+\epsilon_{ij}. $$

Here, \(\mu_j\) is the average concentration at occasion \(j\), \(b_i\) is subject \(i\)'s stable deviation from the population average, and \(\epsilon_{ij}\) is the remaining occasion-specific deviation. The \(b_i\) term is shared by both measurements from the same subject. That shared term is the basic mechanism by which subject identity can create dependence.

Assumptions for the simple covariance result: The subject deviations have mean zero and variance \(\tau^2\); the residuals have mean zero and variance \(\sigma^2\). Subject deviations are independent across subjects. Residuals are independent across subjects and occasions, and are independent of all subject deviations. The occasion means are fixed constants. These assumptions describe a simple illustrative model, not a universal law for pharmacokinetic data.

Under these assumptions, concentrations from the same subject have a covariance contribution from \(b_i\). The occasion-specific means do not contribute to covariance because they are constants, and the residuals contribute none across occasions because they are independent. Thus:

$$ \operatorname{Cov}(C_{i1},C_{i2}) =\operatorname{Cov}(b_i+\epsilon_{i1},b_i+\epsilon_{i2}) =\operatorname{Var}(b_i) =\tau^2. $$

The variance of either measurement is \(\tau^2+\sigma^2\). If the variances are the same at both occasions, the correlation is therefore:

$$ \operatorname{Corr}(C_{i1},C_{i2}) =\frac{\tau^2}{\tau^2+\sigma^2}. $$

This correlation is between 0 and 1 under the stated model. When stable differences between subjects are large relative to occasion-specific variation, the paired measurements tend to be strongly associated. When occasion-specific variation is large relative to stable differences, the association is weaker. A positive correlation does not mean the concentrations are equal; the means \(\mu_1\) and \(\mu_2\) may differ substantially.

Worked Examples

Worked Example: Calculating Model-Based Dependence

Suppose a hypothetical concentration model has a subject-level variance \(\tau^2=16\;(\mathrm{mg/L})^2\) and an occasion-specific residual variance \(\sigma^2=9\;(\mathrm{mg/L})^2\), with the assumptions above. Find the covariance and correlation between the two concentrations from the same subject.

The covariance is the shared subject variance:

$$ \operatorname{Cov}(C_{i1},C_{i2})=\tau^2=16\;(\mathrm{mg/L})^2. $$

The variance of each measurement is \(16+9=25\;(\mathrm{mg/L})^2\), so its standard deviation is \(5\;\mathrm{mg/L}\). The correlation is:

$$ \operatorname{Corr}(C_{i1},C_{i2}) =\frac{16}{16+9} =\frac{16}{25} =0.640. $$

Under this hypothetical model, paired concentrations have a positive correlation of 0.640. The covariance carries squared concentration units; the correlation is unitless. For two different subjects, \(i\ne k\), the model gives \(\operatorname{Cov}(C_{i1},C_{k2})=0\), because their subject deviations and residuals are independent under the assumptions.

Worked Example: Describing Association in Paired Data

Six hypothetical subjects have concentrations recorded at two occasions. The values below are in mg/L; each row preserves the pairing by subject.

SubjectOccasion 1Occasion 2
A83
B127
C159
D94
E1611
F106

The occasion means are \(\bar{C}_1=70/6=11.667\;\mathrm{mg/L}\) and \(\bar{C}_2=40/6=6.667\;\mathrm{mg/L}\). To summarize the linear association, use the sample correlation: the sum of cross-products of deviations is \(48.333\;(\mathrm{mg/L})^2\); the sums of squared deviations are \(53.333\;(\mathrm{mg/L})^2\) and \(45.333\;(\mathrm{mg/L})^2\). Therefore:

$$ r=\frac{48.333}{\sqrt{53.333\times45.333}} \approx 0.983. $$

These six hypothetical pairs show a strong positive descriptive association: subjects with higher concentrations at the first occasion also tend to have higher concentrations at the second. This calculation does not establish that the population correlation is 0.983, and it does not establish the simple model's assumptions. With only six subjects, the observed pattern is also sensitive to individual observations. The paired scatterplot and the data context should be examined alongside the summary.

Worked Example: A Shared Subject Deviation Can Persist Across Occasions

Consider two hypothetical occasions with \(\mu_1=8\;\mathrm{mg/L}\) and \(\mu_2=5\;\mathrm{mg/L}\). For one subject, let the stable deviation be \(b_i=2\;\mathrm{mg/L}\), and let the residuals be \(\epsilon_{i1}=-1\;\mathrm{mg/L}\) and \(\epsilon_{i2}=1\;\mathrm{mg/L}\). The two concentrations are:

$$ C_{i1}=8+2-1=9\;\mathrm{mg/L}, \qquad C_{i2}=5+2+1=8\;\mathrm{mg/L}. $$

The subject's shared deviation raises both concentrations by \(2\;\mathrm{mg/L}\) relative to their occasion means. The residuals differ, so the two observed values are not identical. Their within-subject difference is:

$$ C_{i1}-C_{i2} =(\mu_1-\mu_2)+(\epsilon_{i1}-\epsilon_{i2}) =3-2 =1\;\mathrm{mg/L}. $$

The stable subject term cancels in the difference because it is the same at both occasions. This illustrates why paired measurements can convey both a shared subject level and occasion-specific change. In real concentration-time profiles, the subject's deviation need not be constant over time, so this cancellation is an assumption of this simplified example, not a general guarantee.

How to See and Describe Dependence

For two occasions, a scatterplot with one point per subject is a direct first check: plot occasion 1 against occasion 2, retaining each pair. A positive trend indicates that high values on one occasion tend to accompany high values on the other. A display of paired points connected by subject can also make it easier to see whether subjects maintain their relative ordering, while showing the direction and size of occasion changes.

A descriptive correlation is useful because it summarizes linear association on a unitless scale. It does not capture every possible dependence pattern. For instance, a curved relationship can be strong even when the linear correlation is near zero. Also, two occasion-specific means can differ while the paired correlation remains high: the means describe average levels, whereas correlation describes how paired deviations vary together.

A short derivation clarifies why the shared subject term is sufficient to create covariance in the simple model. Expand the covariance after subtracting the occasion means:

$$ \begin{aligned} \operatorname{Cov}(C_{i1},C_{i2}) &=\operatorname{Cov}(b_i+\epsilon_{i1},b_i+\epsilon_{i2})\\ &=\operatorname{Var}(b_i) +\operatorname{Cov}(b_i,\epsilon_{i2}) +\operatorname{Cov}(\epsilon_{i1},b_i) +\operatorname{Cov}(\epsilon_{i1},\epsilon_{i2})\\ &=\tau^2+0+0+0=\tau^2. \end{aligned} $$

The three zero terms follow from the stated independence assumptions. If residuals at the two occasions are themselves correlated, the final term need not be zero. The covariance would then include that residual covariance in addition to the shared subject variance. This is one reason the simple formula is an explanatory starting point rather than a complete description of every profile.

Diagnostics, Alternatives, and Limits

Signs that the simple account may be inadequate include a paired scatterplot with curvature, markedly different spreads at the two occasions, or subject trajectories whose changes vary systematically rather than appearing as a shared level shift plus independent residual variation. A concentration assay may also have time-dependent measurement error, and subject differences may evolve across the profile. With more than two occasions, inspect the pattern at each occasion and how association changes with the time separation; one constant correlation need not fit every pair.

The main descriptive alternative is to analyze each occasion separately. That can summarize the average concentration at each occasion, but it discards which two values belong to the same subject and therefore cannot describe within-subject association. A paired summary instead keeps subject identity and can describe both the distribution of within-subject changes and the relationship between paired levels. These summaries answer different questions. Neither a scatterplot nor a correlation by itself explains the pharmacokinetic mechanism that produced the pattern.

The model also has limitations. It assumes one stable subject deviation shared equally across the two occasions, equal residual variances, and independent residuals. Actual concentrations may have subject-specific time trends, unequal variability, nonlinear time courses, or dependence that changes with the interval between samples. Correlation can also be affected by the range of subjects and occasions included; it is not an intrinsic constant of a drug independent of the data and design. The introductory material on repeated pharmacokinetic profiles as clustered data establishes why observations should be kept linked to subjects; the paired formulation here makes one specific consequence explicit.

Common pitfall: “The two occasion means are different, so concentrations from the same subject must be negatively associated.” This does not follow. Mean difference concerns the average level at each occasion; dependence concerns how paired deviations vary together. In the simple model, the means can differ by any amount while the covariance remains \(\tau^2\), determined by the shared subject component.

Check Your Understanding

Answer each question, then compare your reasoning with the brief solutions.

  1. In \(C_{ij}=\mu_j+b_i+\epsilon_{ij}\), which component is shared by the two occasions for subject \(i\)?
  2. If \(\tau^2=4\;(\mathrm{mg/L})^2\) and \(\sigma^2=6\;(\mathrm{mg/L})^2\), what are the model-based covariance and correlation between a subject's two measurements?
  3. Can occasion means differ when the paired correlation is positive? Explain.
  4. What feature of a paired scatterplot would be consistent with positive within-subject association?

Solutions. 1. The stable subject deviation \(b_i\) is shared. 2. Covariance is \(4\;(\mathrm{mg/L})^2\), and correlation is \(4/(4+6)=0.400\). 3. Yes. Occasion means describe average levels; positive correlation means paired deviations tend to move together, so the two means can still differ. 4. Points tending to rise from lower left to upper right are consistent with positive association, though the plot alone does not establish the model assumptions.