From Placebo-Arm Records to a Progression Model
Longitudinal placebo-arm data contain more than a natural-history trajectory. A measured outcome may start at a nonzero baseline, change over time in response to trial participation and other placebo-associated influences, and also progress because of the underlying disease. A useful analysis makes these components explicit rather than attributing every observed change to disease progression.
The example here uses a continuous clinical score measured at baseline and at several follow-up times in a hypothetical placebo-controlled trial. The analysis below fits the placebo arm. It estimates the mean baseline, a saturating placebo time course, and linear progression. It also accounts for repeated observations from the same participant and assesses both parameter uncertainty and predictive performance. It does not estimate a drug effect from placebo-arm records.
To define the likelihood used in the worked analysis, assume \(b_i\sim N(0,\tau^2)\), \(\epsilon_{ij}\sim N(0,\sigma^2)\), and that all participant random intercepts and measurement errors are mutually independent. The follow-up times are treated as fixed, and the same \(\tau^2\) and \(\sigma^2\) apply across participants and occasions. These assumptions give the model a full probability distribution, not merely a mean and variance. If the score has a different clinical direction, the signs and interpretations of \(P\) and \(g\) must be adjusted accordingly.
At \(t=0\), the two time-dependent terms are zero, so the expected score is \(B\). This makes the baseline interpretation explicit. The term \(P(1-e^{-kt})\) is zero at baseline and approaches \(P\) as time increases; \(k\) has units of inverse years. The progression term \(gt\) changes linearly with time, and \(g\) has units of score points per year. The components are additive, so \(P\) and \(gt\) describe distinct contributions to the modeled mean, not necessarily distinct biological causes.
Why Repeated Measurements Require a Mixed-Effects Likelihood
Repeated outcomes from one person are not independent under this model: they share \(b_i\). For participant \(i\), collect the observations into a vector \(Y_i\), and let \(\mu_i\) be the vector of model means without \(b_i\). Integrating over the normally distributed random intercept gives a multivariate normal distribution:
Here \(\mathbf{1}\) is a vector of ones and \(I\) is an identity matrix of the appropriate size. Thus two different measurements from the same participant have covariance \(\tau^2\), while each observation has variance \(\tau^2+\sigma^2\). Different participants are independent. The marginal log-likelihood, summed over participants, is
where \(m_i\) is the number of observations for participant \(i\). Maximum likelihood fitting chooses \(B,P,k,g,\tau^2,\sigma^2\) to maximize this expression, subject to sensible constraints such as \(k>0\), \(\tau^2\geq0\), and \(\sigma^2>0\). Because the mean depends nonlinearly on \(k\), numerical optimization is generally needed.
The likelihood derivation also explains why fitting a straight line to every record as if observations were independent is inappropriate: it assigns too much independent information to clusters of measurements from the same participant. Fitting only the visit means can also lose information about within-participant variability and the covariance structure. A valid analysis checks that the model has converged, that variance estimates are plausible, and that the fitted parameters are identifiable from the observation times and data.
Worked Example: Calculating the Fitted Placebo-Arm Mean
Suppose a hypothetical placebo-arm analysis estimates \(B=50.1\) score points, \(P=7.80\) points, \(k=0.238\) per year, and \(g=0.360\) points per year. Calculate the population mean at year 6.
Substitute the estimates into the model:
Since \(e^{-1.428}\approx0.2398\), the placebo contribution is \(7.80(1-0.2398)=5.930\) points (rounded to three decimals). Therefore the fitted mean is approximately \(50.1+5.930+2.160=58.190\) points. The value is a population mean prediction under the fitted model, not a claim that every participant's score will be 58.190.
Worked Analysis of Hypothetical Trial Data
Consider a hypothetical study with 24 participants assigned to placebo and measured at baseline and years 2, 4, and 6. For illustration, the table shows visit means and the corresponding fitted population means from a Gaussian mixed-effects maximum-likelihood fit. The fitting uses the participant-level records, not only the visit means. The visit summaries are provided to make the predictions and residuals transparent.
| Time (years) | Observed mean score (points) | Fitted mean score (points) | Observed minus fitted (points) |
|---|---|---|---|
| 0 | 50.1 | 50.100 | 0.000 |
| 2 | 54.7 | 53.774 | 0.926 |
| 4 | 56.4 | 56.329 | 0.071 |
| 6 | 57.9 | 58.190 | -0.290 |
The fitted values follow directly from the estimates. At year 2, for example, \(e^{-0.476}\approx0.6213\), so the fitted mean is \(50.1+7.80(1-0.6213)+0.720\approx53.774\) points. At year 4, \(e^{-0.952}\approx0.3859683\), giving \(50.1+7.80(1-0.3859683)+1.440\approx56.329\) points. At year 6, using the unrounded exponential in the calculation gives approximately 58.18965, which rounds to 58.190; the residual is \(57.9-58.18965\approx-0.2897\) points, or \(-0.290\) to three decimals. Rounding intermediate values can change the last displayed digit, so retain precision until the final result.
Worked Example: Interpreting Parameter Uncertainty
Suppose the hypothetical likelihood fit reports standard errors \(SE(\hat P)=1.90\) points, \(SE(\hat k)=0.080\) per year, and \(SE(\hat g)=0.110\) points per year. For an approximate 95% Wald confidence interval, use estimate \(\pm1.96\times SE\). This approximation relies on the estimates being sufficiently close to normally distributed; it can be unreliable for weakly identified parameters or estimates near parameter boundaries.
For the placebo magnitude, the calculation is \(7.80\pm1.96(1.90)=7.80\pm3.724\), giving an interval of approximately 4.076 to 11.524 points. For the rate constant, it is \(0.238\pm1.96(0.080)=0.238\pm0.1568\), or 0.0812 to 0.3948 per year. For the progression rate, \(0.360\pm1.96(0.110)=0.360\pm0.2156\), or 0.1444 to 0.5756 points per year.
These are separate marginal intervals for individual parameters, not a joint 95% region for all parameters. In repeated-sampling terms, the Wald procedure would cover the corresponding true parameter in about 95% of repetitions if its approximation and model assumptions hold. It does not mean there is a 95% probability that a fixed parameter lies in this particular interval. The positive interval for \(g\) is compatible with increasing scores under the assumed score direction, but uncertainty and model fit still matter for clinical interpretation.
Predictive Checks and Failure Modes
A fitted mean can be plausible while the model fails to describe individual trajectories. A first check is to plot observed-minus-fitted residuals against time and against fitted values. A systematic curve over time may indicate that the assumed progression shape or placebo time course is inadequate. A widening residual spread suggests nonconstant measurement variability. Residuals within participants can also reveal patterns that a random intercept alone does not capture, such as serial correlation or participant-specific slopes.
For the Gaussian mixed-effects model, the marginal variance of one observation is \(\tau^2+\sigma^2\). A marginal standardized residual divides the observation's deviation from its fitted population mean by \(\sqrt{\tau^2+\sigma^2}\). This is a screening diagnostic, not an independent standard-normal test: residuals from the same participant are correlated, and parameters were estimated from the data. More complete predictive checks simulate replicate datasets from the fitted model, retaining the visit schedule and participant structure, then compare features such as visit means, within-person changes, and the spread of individual trajectories with those observed.
Worked Example: Checking an Individual-Level Prediction
Suppose the fitted random-intercept and residual standard deviations are \(\hat\tau=2.4\) points and \(\hat\sigma=1.6\) points. The year-6 observed visit mean is 57.9 points and the fitted population mean is 58.190 points. The marginal standard deviation of a single observation is
The standardized deviation is \((57.9-58.190)/2.884\approx-0.10\). This visit mean is not far from the fitted population mean relative to the model's single-observation variability. However, a visit mean averages across participants and is not itself a single participant observation; this calculation is only a simple scale check. A participant-level predictive check should use the individual observations and account for the repeated-measure structure.
An important limitation is that a random intercept allows participants to differ in their baseline level but assumes they share the same placebo and progression parameters. If participants show genuinely different rates of progression, residual patterns may persist even when the population mean curve looks adequate. Adding random slopes or further complexity may help, but requires enough information to estimate the additional variation reliably. Likewise, if baseline is measured with substantial error, treating it as a perfectly known covariate or intercept can distort interpretation; the measurement model must reflect the study design.
The model is also not the only reasonable approach. A linear-only trajectory omits the saturating placebo term; it may be a useful simpler comparison if the observed time window cannot distinguish the components. A nonlinear disease trajectory instead of linear \(gt\) may be appropriate when the data support curvature, but should not be added solely to improve a few residuals. Generalized estimating equations offer a population-averaged approach with a working covariance structure and robust standard errors, while the Gaussian mixed-effects likelihood explicitly models participant-level heterogeneity and supports individual predictions under its assumptions. These approaches answer related but not identical questions. Model comparison should consider fit, diagnostics, parameter identifiability, and the scientific meaning of the terms, not just a single fit statistic.
Common Mistake: Treating the Components as Automatically Identifiable
A common error is to assume that a good numerical fit proves the baseline, placebo magnitude, placebo rate, and progression rate are each separately determined by the data. The model's components can trade off: over a short follow-up window, a slowly saturating placebo term may resemble a linear trend, making \(P\), \(k\), and \(g\) difficult to distinguish. Baseline is informed by baseline observations, while separation of the time-dependent terms depends on follow-up duration, visit timing, and signal relative to noise.
The correction is to inspect uncertainty and parameter dependence, examine whether different starting values lead to similar solutions, and assess predictions over the observed time range. Wide intervals, unstable estimates, or strongly correlated estimates indicate weak identification even if the optimizer reports convergence. If the purpose is to predict within the observed time window, predictions may be more stable than individual parameters; extrapolating beyond that window is especially uncertain.
Check Your Understanding
Try each question, then compare your reasoning with the solutions below.
- In the stated model, what is the expected population score at baseline, and why?
- If the fitted \(g\) is 0.25 points per year, what progression contribution does the model assign at year 4?
- Why are observations from one participant correlated under the random-intercept model?
- Give one pattern in residuals over time that could indicate model misspecification.
- Does a 95% Wald interval mean there is a 95% probability that the fixed parameter lies in the calculated interval?
Solutions. (1) It is \(B\), because \(1-e^{-k(0)}=0\) and \(g(0)=0\). (2) The contribution is \(0.25(4)=1.00\) point. (3) The measurements share the same random intercept \(b_i\), giving covariance \(\tau^2\) between distinct observations from that participant. (4) A systematic curved or steadily increasing residual pattern suggests the mean trajectory may be wrong. (5) No. Under the procedure's repeated-sampling assumptions, about 95% of intervals constructed this way would cover the fixed parameter; the interval does not assign a probability to that parameter.)