Tutorials › Nonlinear Mixed-Effects Models (NLME) › Why More Samples per Patient Cannot Fully Replace More Patients

Why Mixed-Effects Models · Tutorial 11 of 797

Why More Samples per Patient Cannot Fully Replace More Patients

See how to balance repeated measurements and patient numbers when the goal is to describe both individual profiles and variation across a population.

Beginner 10 min read

What You'll Learn

  • Distinguish information about a patient’s profile from information about differences between patients.
  • Use a simple random-intercept model to separate between-patient and within-patient variation.
  • Calculate how the number of patients and samples per patient affect uncertainty in a population mean.
  • Recognize why dense sampling cannot reliably characterize population heterogeneity when few patients are enrolled.
  • Identify assumptions and design features that limit simple comparisons of sampling strategies.

Two Different Kinds of Information

A repeated concentration profile can contain many measurements, but those measurements do not represent as many independent patients. Adding samples to the same patient can show more clearly how that patient’s concentration changes over time. Adding patients gives more independent examples of how profiles differ across the population. These are related but distinct design goals.

The distinction matters when choosing a study design. A dense schedule in a handful of patients may describe their observed profiles well, while providing little basis for assessing how much patients differ from one another. Conversely, a larger group measured at fewer times may better represent population diversity but give less detail about each individual profile. The design should reflect which information is needed; a large count of concentration measurements alone does not settle that question.

Definition: Within-patient information concerns how measurements vary across times within the same patient, including the shape and coverage of that patient’s observed profile. Between-patient information concerns how patient-level features or profiles differ across independent patients. Repeated measurements can improve the first without providing the same amount of information about the second.

A Simple Variance Decomposition

A basic model makes the distinction precise. Suppose each of \(n\) independent patients is measured \(m\) times at a common setting, and let \(Y_{ij}\) be the measurement for patient \(i\) on occasion \(j\). For this illustration, use a random-intercept model:

$$ Y_{ij}=\mu+b_i+e_{ij}, \qquad i=1,\ldots,n,\quad j=1,\ldots,m. $$

Here \(\mu\) is the population mean at the setting being considered, \(b_i\) is patient \(i\)’s deviation from that mean, and \(e_{ij}\) is measurement-level variation. Assume \(E(b_i)=0\), \(\operatorname{Var}(b_i)=\tau^2\), \(E(e_{ij})=0\), and \(\operatorname{Var}(e_{ij})=\sigma^2\). Assume the patient effects are independent across patients, the measurement errors are independent across occasions and patients, and the two sources of variation are independent. This is a deliberately simple illustration: real profiles can change with time, and measurements within a patient may remain correlated after accounting for a patient effect.

The average across all measurements is \(\bar{Y}_{..}=(1/n)\sum_{i=1}^n\bar{Y}_i\), where \(\bar{Y}_i=(1/m)\sum_{j=1}^mY_{ij}\). The patient average is \(\bar{Y}_i=\mu+b_i+\bar{e}_i\). Thus, its variance is \(\tau^2+\sigma^2/m\): repeated observations reduce the measurement-level contribution to the uncertainty in that patient’s average, but they do not reduce the patient’s deviation \(b_i\). Averaging the \(n\) independent patient averages gives the result below.

Result: Under the stated balanced, independent random-intercept assumptions, the variance of the overall mean is
$$ \operatorname{Var}(\bar{Y}_{..}) =\frac{\tau^2}{n}+\frac{\sigma^2}{nm}. $$

The first term, \(\tau^2/n\), reflects uncertainty from sampling patients who differ from the population mean. The second, \(\sigma^2/(nm)\), reflects measurement-level variation averaged over all observations. More occasions per patient reduce the second term. They do not create additional independent patient effects, so they do not replace a larger \(n\) for learning about between-patient variation.

Worked Examples

Worked Example: Comparing Equal Measurement Budgets

Suppose a hypothetical study can collect 24 measurements at a common setting. Compare 12 patients measured twice each with 4 patients measured six times each. For illustration, take the between-patient variance as \(\tau^2=16\) concentration-units squared and the measurement-level variance as \(\sigma^2=9\) concentration-units squared. Assume the model assumptions above hold for both designs.

With 12 patients and 2 measurements per patient, the estimated variance formula gives

$$ \operatorname{Var}(\bar{Y}_{..}) =\frac{16}{12}+\frac{9}{12(2)} =1.333+0.375 =1.708. $$

The corresponding standard error is \(\sqrt{1.708}=1.307\) concentration units. With 4 patients and 6 measurements per patient,

$$ \operatorname{Var}(\bar{Y}_{..}) =\frac{16}{4}+\frac{9}{4(6)} =4+0.375 =4.375, $$

so the standard error is \(\sqrt{4.375}=2.092\) concentration units. Both designs have the same total number of measurements, and both have the same measurement-level contribution, \(0.375\). But the second design has only one-third as many independent patients, so its between-patient contribution is three times as large. Under these assumptions, the broader design gives a more precise estimate of the population mean.

Worked Example: What Dense Sampling Adds to an Individual Profile

Consider hypothetical concentrations in mg/L from three patients measured at 1, 4, 8, and 12 hours after a dose. The observations are A: 8, 5, 2, 1; B: 12, 7, 3, 1.5; and C: 5, 4, 3, 2. The repeated observations give four points on each observed profile, allowing the within-patient changes over those sampled times to be seen.

For example, patient A’s observed range is \(8-1=7\) mg/L, patient B’s is \(12-1.5=10.5\) mg/L, and patient C’s is \(5-2=3\) mg/L. Their arithmetic averages across these four scheduled measurements are, respectively,

$$ \bar{Y}_A=\frac{8+5+2+1}{4}=4,\qquad \bar{Y}_B=\frac{12+7+3+1.5}{4}=5.875,\qquad \bar{Y}_C=\frac{5+4+3+2}{4}=3.5\ \text{mg/L}. $$

These observations show why several times per patient can be useful for describing individual profiles. They also show the limit: the design contains only three independent patients. There are twelve measurements, but not twelve independent examples of patient-to-patient variation. The averages above are descriptive averages at the scheduled times; they are not, by themselves, estimates of a time-integrated exposure measure.

Worked Example: More Patients for a Patient-Level Summary

Suppose the study goal is to learn how a patient-level summary varies across patients. In a hypothetical group of three patients, the summaries are 8, 10, and 12 units. Their mean is \((8+10+12)/3=10\) units, and their sample variance is

$$ s^2=\frac{(8-10)^2+(10-10)^2+(12-10)^2}{3-1} =\frac{4+0+4}{2}=4\ \text{units}^2. $$

Now consider eight independent patients with summaries 6, 8, 9, 9, 10, 11, 13, and 14 units. Their mean is \(80/8=10\) units, and their sample variance is

$$ s^2=\frac{16+4+1+1+0+1+9+16}{8-1} =\frac{48}{7}=6.857\ \text{units}^2. $$

The two observed variances are different; that alone does not establish that the underlying populations differ. The point is that the second design supplies eight independent patient summaries for assessing their distribution, rather than three. Taking more measurements within the original three patients might improve the precision of each patient’s summary, but would not add five new independent patients.

Why the Patient Count Sets a Limit

The variance formula also gives a short justification for the limit of dense sampling. If \(n\) is fixed and the number of measurements per patient increases, then the measurement contribution \(\sigma^2/(nm)\) approaches zero. The remaining variance approaches \(\tau^2/n\):

$$ \lim_{m\to\infty}\operatorname{Var}(\bar{Y}_{..}) =\frac{\tau^2}{n}. $$

If patients truly vary, so that \(\tau^2>0\), the uncertainty does not disappear merely by taking more measurements from the same finite group. This is not a universal formula for every repeated-measures design; it follows from the assumptions stated for the random-intercept example. But the underlying design principle is broader: repeated observations from a patient share that patient’s characteristics, so they cannot fully stand in for independent patients when the target is population diversity.

Choosing and Checking a Design

A design should allocate sampling effort according to the question. If the priority is to trace the time course within an individual, more measurement times can improve coverage. If the priority is to characterize between-patient differences, recruit more independent patients. Many studies need both, so a practical compromise is to sample enough patients to represent the target population and collect enough observations per patient to address the profile questions.

The simple calculation is useful only when its assumptions are plausible. Check whether measurements at the same nominal setting are comparable, whether patients are sampled independently from the population of interest, and whether occasions within a patient have additional dependence. If within-patient errors are correlated, the \(\sigma^2/m\) reduction does not apply as written. Unequal schedules, dropout, or sampling patterns related to patient characteristics can also change what the pooled measurements represent; the earlier material on informative sampling and dropout addresses those concerns.

A common mistake is to count every concentration as a new independent patient when judging how much evidence a study has about population variability. That reasoning confuses the measurement count with the number of independent units. The correction is to identify the target first: repeated samples inform a patient’s observed trajectory, while independent patients supply evidence about how patients differ. A mixed-effects analysis can represent both sources of variation, but it cannot manufacture patient diversity that the study did not sample.

Another mistake is to conclude that more patients always dominate more samples. That is also too broad. For example, when the main goal is to describe a single patient’s profile, one sample per patient may be insufficient regardless of the number enrolled. The trade-off depends on the estimand and on the sources of variation; the variance decomposition is a guide to the distinction, not a substitute for specifying the study objective.

1
State the target.
Decide whether the study is chiefly about individual profiles, a population mean, or variation among patients.
2
Match sampling to the target.
Use repeated times for within-patient coverage and independent patients for between-patient information.
3
Check the assumptions.
Consider within-patient dependence, uneven sampling, and whether the observed patients represent the intended population.
Key takeaway: Many measurements from a few patients can describe those patients in detail, but they do not replace independent patients when the goal is to understand population diversity. Design decisions should be based on both the number of patients and the sampling within each patient.

Check Your Understanding

Answer each question, then compare your reasoning with the brief solutions.

  1. Under the random-intercept assumptions, which term in \(\operatorname{Var}(\bar{Y}_{..})=\tau^2/n+\sigma^2/(nm)\) is reduced by increasing measurements per patient while holding \(n\) fixed?
  2. A study measures 5 patients 8 times each. How many independent patients contribute information about between-patient variation?
  3. In the variance formula, let \(\tau^2=9\), \(\sigma^2=4\), \(n=6\), and \(m=2\). Calculate the variance and standard error of the overall mean.
  4. Why can dense sampling be appropriate even when it does not replace recruiting more patients?

Solutions. (1) The measurement-level term \(\sigma^2/(nm)\) decreases; the between-patient term \(\tau^2/n\) is unchanged. (2) Five independent patients. The 40 measurements are repeated observations within those five patients, not 40 independent patients. (3) The variance is \(9/6+4/(6\cdot2)=1.5+0.3333=1.833\) concentration-units squared, and the standard error is \(\sqrt{1.833}=1.354\) concentration units. (4) Dense sampling can provide better within-patient coverage and a clearer description of each observed profile, even though independent patients are needed to learn about population diversity.