Tutorials › Pharmacokinetic-Pharmacodynamic (PK/PD) Modeling › Stable Natural-History Models for No-Drug Response

Baseline, Placebo and Disease-Progression Components · Tutorial 52 of 598

Stable Natural-History Models for No-Drug Response

Build and interpret stable natural-history models, separate within-subject fluctuation from between-subject differences, and use repeated measurements to check whether a fixed mean is plausible.

Intermediate 9 min read

What You'll Learn

  • Define a stable no-drug response as having no systematic time trend in its expected value.
  • Separate within-subject measurement fluctuation from stable differences among subjects.
  • Interpret a repeated-measures random-intercept model and its variance components.
  • Calculate a subject’s mean and residual variation from repeated observations.
  • Explain why repeated measurements from one subject are not independent observations.
  • Use time patterns and residuals to identify evidence against a stable-response assumption.

What “Stable” Means in a No-Drug Model

A no-drug response is the outcome expected in the absence of active drug, given the background conditions represented in the model. A stable natural-history model is the simplest case: the expected response does not systematically change over the observation period. Individual measurements can still vary. The key distinction is between a changing expected response and fluctuations around an expected response that remains fixed.

For example, repeated symptom scores may move up and down even if the underlying average symptom level is unchanged. Treating every movement as disease progression mistakes variability for a trend. Conversely, averaging across time can hide a real trend if the expected response is changing. Earlier material on baseline, placebo, and natural-history response distinguishes these components; here the focus is the fixed-mean natural-history case and what repeated observations can tell us about it.

Definition: A stable no-drug response has a constant expected outcome over the observation period in the absence of active drug. For subject \(i\) at time \(t_{ij}\), a simple model is \(Y_{ij}=\mu+\epsilon_{ij}\), where \(Y_{ij}\) is the observed response, \(\mu\) is the fixed population mean, and \(\epsilon_{ij}\) is a zero-mean deviation. A model with stable subject-to-subject differences is \(Y_{ij}=\mu+b_i+\epsilon_{ij}\), where \(b_i\) is subject \(i\)’s deviation from the population mean.

In the second model, the conditional mean for subject \(i\), given that subject’s stable deviation, is

$$ E(Y_{ij}\mid b_i,t_{ij})=\mu+b_i. $$

It does not depend on \(t_{ij}\). The subject may have a persistently higher or lower response than the population average, but the model does not assign that difference a systematic time trend. The observed response can nevertheless vary at each measurement occasion through \(\epsilon_{ij}\).

Assumptions and Interpretation

The fixed-mean model makes a claim about the expected response, not about identical observations. A common version of the repeated-measures model assumes \(E(b_i)=0\), \(E(\epsilon_{ij})=0\), and that the subject effects and measurement deviations are independent. It also commonly assumes that the deviations have a common variance, written \(\operatorname{Var}(b_i)=\sigma_b^2\) and \(\operatorname{Var}(\epsilon_{ij})=\sigma_w^2\). The term “within-subject” variance refers to \(\sigma_w^2\); \(\sigma_b^2\) describes stable between-subject variation.

For the simplest calculations, assume the \(\epsilon_{ij}\) are independent across occasions within a subject, and that different subjects are independent. These assumptions are stronger than the constant-mean assumption itself. If successive deviations are correlated, the expected response may still be stable, but standard errors and variance estimates based on independence can be wrong. Normal distributions for \(b_i\) and \(\epsilon_{ij}\) are sometimes assumed for likelihood-based estimation or exact small-sample inference; the mean-and-variance interpretation does not require normality.

A no-drug model also depends on what “no drug” means in the study. If participants receive placebo, the observed control response may include a placebo component. The stable natural-history term is not automatically the entire observed control-arm mean. The interpretation must match the model components and the conditions under which observations were collected.

Why Repeated Measurements Have Two Sources of Variation

The random-intercept model separates a subject’s stable level from occasion-specific fluctuation. For two distinct occasions \(j\) and \(k\) for the same subject, under the independence assumptions above,

$$ \operatorname{Var}(Y_{ij})=\sigma_b^2+\sigma_w^2,\qquad \operatorname{Cov}(Y_{ij},Y_{ik})=\sigma_b^2. $$

The covariance is positive because both measurements contain the same \(b_i\). Thus repeated observations from one subject are not independent when subjects differ in their stable levels. The correlation between two occasions is \(\sigma_b^2/(\sigma_b^2+\sigma_w^2)\) under this model. This correlation is not evidence of progression: it can arise simply because some subjects tend to remain above the population mean and others below it.

For \(N\) subjects with \(m\) measurements each, the grand mean averages both sources of variation. Under the stated independence assumptions, its variance is

$$ \operatorname{Var}(\bar{Y})=\frac{\sigma_b^2}{N}+\frac{\sigma_w^2}{Nm}. $$

More measurements per subject reduce the contribution of within-subject fluctuation to the grand mean, but they do not provide as much independent information about the population mean as the same number of measurements from new subjects. Each additional subject contributes a new draw of the stable subject effect; another visit to an existing subject does not.

Worked Example: Summarizing One Subject’s Repeated Scores

Suppose, hypothetically, one untreated participant has symptom scores of 101, 98, 103, and 100 points at four scheduled visits. Under a fixed-mean description, calculate the participant’s average and the sample standard deviation of the four observations.

The observed average is

$$ \bar{Y}_i=\frac{101+98+103+100}{4}=\frac{402}{4}=100.5\text{ points}. $$

The deviations from 100.5 are \(0.5\), \(-2.5\), \(2.5\), and \(-0.5\) points. Their squared sum is \(0.25+6.25+6.25+0.25=13\) points squared, so the sample standard deviation is

$$ s_i=\sqrt{\frac{13}{4-1}}=\sqrt{4.333}=2.082\text{ points}. $$

The average is a possible estimate of this participant’s stable level, and the standard deviation summarizes the observed spread around that average. Neither calculation proves that the expected score is constant. Four visits provide limited evidence about time pattern, and the standard deviation combines measurement fluctuation with any unmodeled changes during the visits.

Estimating Stable Differences from a Small Repeated-Measures Set

When repeated measurements are available for several subjects, compare variability within subjects with variability between their averages. The following balanced data set illustrates the distinction. The values are hypothetical symptom scores in points.

SubjectVisit 1Visit 2Visit 3Subject mean
A9101110
B13141514
C11121312

Worked Example: Separating Within- and Between-Subject Variation

Assume these three subjects each have three measurements, and use the random-intercept model with independent, equal-variance within-subject deviations. Calculate the overall mean and the within-subject variance estimate.

The overall mean is the mean of the nine values, equivalently the mean of the three subject means because each subject has the same number of visits:

$$ \bar{Y}=\frac{10+14+12}{3}=12\text{ points}. $$

Within each subject, deviations from that subject’s mean are \(-1,0,1\) points. Their squared sum is \(2\) for each subject, or \(2+2+2=6\) across all subjects. There are \(9-3=6\) within-subject degrees of freedom, since three subject means have been estimated. Therefore the pooled within-subject variance estimate is

$$ \hat{\sigma}_w^2=\frac{6}{6}=1\text{ point}^2, \qquad \hat{\sigma}_w=1\text{ point}. $$

The subject means are 10, 14, and 12 points. Their differences from the overall mean are \(-2,2,0\), so their sample variance is \((4+4+0)/(3-1)=4\text{ points}^2\). This is the variance of observed subject means, not directly the variance of the stable subject effects: each subject mean also contains averaged measurement fluctuation.

With three balanced visits, the variance of a subject mean includes \(\sigma_w^2/3\). A method-of-moments estimate of the between-subject variance is consequently \(4-1/3=3.667\text{ points}^2\). This estimate is approximate and can be unstable with only three subjects; a negative estimate can occur in small or low-variation data, in which case variance-component estimation requires an appropriate constrained method rather than interpreting a negative variance literally.

Checking Whether Stability Is Plausible

A stable model should be checked against the ordering of observations in time, not just against their overall spread. Plot individual observations or subject means against time. Under the model, residuals after accounting for stable subject levels should fluctuate around zero without a consistent temporal pattern. Runs of increasing residuals, a shared upward or downward shift across subjects, or a change concentrated at later visits can indicate that the fixed-mean assumption is inadequate.

Worked Example: A Possible Time Pattern in Repeated Scores

A hypothetical participant has scores of 20, 21, 20, and 23 points at weeks 0, 1, 2, and 3. First fit a constant mean by averaging:

$$ \bar{Y}=\frac{20+21+20+23}{4}=21\text{ points}. $$

The residuals from this constant mean are \(-1,0,-1,2\) points. To summarize the pattern, calculate the least-squares slope using centered week values \(-1.5,-0.5,0.5,1.5\). The centered score values are \(-1,0,-1,2\), giving

$$ \hat{\beta}= \frac{(-1.5)(-1)+(-0.5)(0)+(0.5)(-1)+(1.5)(2)} {(-1.5)^2+(-0.5)^2+(0.5)^2+(1.5)^2} =\frac{4}{5}=0.8\text{ points per week}. $$

The positive slope and the late high score are reasons to inspect whether a fixed mean is plausible. They are not, by themselves, proof of systematic progression: there are only four observations, and a single fluctuating value can have substantial influence. A longer series, repeated patterns across subjects, and study context help distinguish a persistent time pattern from chance variation. Modeling the trajectory itself requires a time-dependent natural-history model rather than treating this slope as part of the stable model.

Other diagnostics matter too. Check whether residual spread is similar across subjects and visits, whether subjects have markedly different patterns, and whether measurements are missing in a way related to worsening or improvement. Assay drift, seasonal changes, changes in assessment procedures, or concurrent care can create time patterns that a fixed natural-history mean does not explain. Serial correlation can also make successive deviations move together even when there is no systematic change in their expected value.

Alternatives, Limitations, and a Common Pitfall

The simplest alternative to a random-intercept stable model is a single fixed mean with independent residuals. It may be adequate when between-subject differences are negligible or when the analysis concerns one subject. A random-intercept model is more appropriate when subjects have stable differences and repeated observations. A time-dependent model is needed when the expected response changes systematically with time; a time-varying placebo component may also be relevant when the observed response includes placebo response. These alternatives answer different questions: adding a stable subject effect does not represent progression, while adding a time trend changes the expected-response assumption.

A fixed-mean model is a useful reference, not a guarantee that untreated response is truly constant. It can miss slow changes over a short observation window, abrupt changes between visits, or distinct subgroups with different time patterns. Sparse visits may make a temporal pattern hard to detect. Likewise, an apparently flat group average can conceal subjects changing in opposite directions. Diagnostics and study design are therefore part of interpreting the model, not optional decoration.

  • Pitfall: treating every fluctuation as progression. A sequence of different measurements does not itself establish that the expected response changed. Under a stable model, observations vary around a fixed expected value.
  • Pitfall: treating repeated observations as independent subjects. Measurements on the same subject share the stable subject effect. Ignoring this dependence can understate uncertainty.
  • Pitfall: calling every no-active-drug observation “natural history.” A control response may also reflect placebo or other study components. Interpret the model term according to what participants actually received and what components are included.
Key takeaway: In a stable no-drug model, the expected response is fixed over time, while observed values may fluctuate and subjects may differ in their stable levels. Repeated measurements help characterize both sources of variation, but time-ordered patterns must be checked before stability is assumed.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. In \(Y_{ij}=\mu+b_i+\epsilon_{ij}\), which term represents a stable subject difference, and which term represents occasion-specific fluctuation?
  2. Why can two measurements from the same subject be correlated even if the expected response is constant over time?
  3. Four hypothetical measurements for one subject are 7, 9, 8, and 8 points. Calculate the subject average.
  4. What feature of a plot of residuals against time would make the stable-mean assumption questionable?

Solutions. (1) \(b_i\) is the stable subject-specific deviation; \(\epsilon_{ij}\) is the occasion-specific deviation. (2) Both measurements contain the same \(b_i\), so their covariance is \(\sigma_b^2\) under the stated model, even though their conditional expected response does not change with time. (3) The average is \((7+9+8+8)/4=32/4=8\) points. (4) A sustained upward or downward pattern, rather than residuals fluctuating around zero without an ordered pattern, is evidence that a fixed expected response may not adequately describe the observations.

Clinical Biostats