Tutorials › Model-Informed Drug Development (MIDD) › Baseline and Natural-History Models for Precision Planning

Model-Based Endpoint and Sample Size Planning · Tutorial 311 of 596

Baseline and Natural-History Models for Precision Planning

Use baseline relationships and control-group trajectories to estimate endpoint variability, assess model adequacy, and quantify implications for planned treatment-contrast precision.

Advanced 10 min read

What You'll Learn

  • Estimate endpoint residual variability from the baseline-endpoint correlation.
  • Distinguish a fitted natural-history mean trajectory from endpoint variability.
  • Check linearity, residual patterns, variance assumptions, and transportability.
  • Compare unadjusted and baseline-informed treatment-contrast standard errors.
  • Recognize when historical or placebo data are too uncertain to support planning.

Why Baseline and Natural History Matter for Precision

A planned treatment contrast depends not only on the expected treatment effect, but also on how variable the endpoint is in the population under study. Baseline measurements and placebo or natural-history data can help characterize that variability and the expected course without active treatment. Used carefully, they can improve planning; used uncritically, they can make a design look more precise than the evidence supports.

The central distinction is between the expected trajectory and variability around that trajectory. A placebo group may show a mean decline over time, for example, but that mean decline alone does not tell us how dispersed individual endpoint values are. Conversely, a baseline-endpoint relationship can help predict endpoint variability, but does not establish what the untreated mean trajectory will be in a new trial.

Definition: Let \(Y_B\) be a participant’s baseline endpoint and \(Y_T\) the endpoint measured at a planned follow-up time \(T\). A baseline-outcome model describes how \(Y_T\) varies with \(Y_B\). A natural-history or placebo trajectory describes the expected outcome over time in the absence of the active treatment being evaluated. The endpoint residual standard deviation is the standard deviation of \(Y_T\) remaining after accounting for the specified baseline-outcome relationship.

For planning, the most useful baseline relationship is often a linear regression of the endpoint on baseline. A simple model is

$$ Y_{T,i}=\alpha+\beta(Y_{B,i}-\mu_B)+\varepsilon_i,\qquad E(\varepsilon_i\mid Y_{B,i})=0,\qquad \operatorname{Var}(\varepsilon_i\mid Y_{B,i})=\sigma_e^2. $$

Here \(i\) indexes participants, \(\mu_B\) is the target-population mean at baseline, \(\beta\) is the baseline-outcome slope, and \(\sigma_e\) is the residual standard deviation. Centering baseline makes \(\alpha\) the expected follow-up endpoint at the population mean baseline. The model assumes a linear conditional mean, a common slope, constant residual variance, and independent participants. Normal residuals are additionally needed for exact small-sample normal-theory calculations, but not for the variance identity below.

From Baseline Association to Endpoint Variability

If the linear model is appropriate, the residual variance can be estimated from the endpoint variance and the baseline-endpoint correlation. Let \(\sigma_T\) and \(\sigma_B\) denote the population standard deviations of \(Y_T\) and \(Y_B\), and let \(\rho\) be their correlation. The linear regression slope is \(\beta=\rho\sigma_T/\sigma_B\). The variance of the linear prediction is \(\beta^2\sigma_B^2=\rho^2\sigma_T^2\). Because total endpoint variance is the sum of explained and residual variance under the model,

$$ \sigma_e^2=\sigma_T^2(1-\rho^2). $$

This calculation uses the population linear projection. In practice, sample estimates of the endpoint standard deviation and correlation provide planning estimates, not known population values. The relation is useful when the baseline and endpoint are measured in a comparable population and at the intended assessment time.

Worked Example: Estimating Residual Variability From Baseline

Suppose a hypothetical historical dataset has a baseline standard deviation of 12 points, a follow-up endpoint standard deviation of 10 points, and baseline-endpoint correlation \(r=0.70\). Estimate the linear slope and residual standard deviation.

The slope in endpoint points per baseline point is

$$ \hat{\beta}=r\frac{s_T}{s_B} =0.70\frac{10}{12}=0.5833. $$

The estimated residual variance and standard deviation are

$$ \hat{\sigma}_e^2\approx s_T^2(1-r^2) =10^2(1-0.70^2)=100(0.51)=51.00\ \text{points}^2, $$
$$ \hat{\sigma}_e=\sqrt{51.00}=7.141\ \text{points}. $$

Under the fitted linear relationship, participants with the same baseline value are expected to vary at follow-up with a residual standard deviation of about 7.14 points. This is not the total endpoint standard deviation, which is 10 points. The estimate is credible only to the extent that the historical data represent the planned trial population and the linear, constant-variance model fits adequately.

The calculation also shows how the baseline association can inform a planned treatment contrast. If both randomized groups have \(n\) participants, share a common baseline slope and residual variance, and the contrast is estimated with baseline adjustment, a large-sample planning approximation is

$$ SE(\hat{\Delta})\approx\sqrt{\frac{2\sigma_e^2}{n}}. $$

For an unadjusted comparison of endpoint means under equal group sizes and a common endpoint variance, the corresponding standard error is approximately \(\sqrt{2\sigma_T^2/n}\). These expressions isolate the variability contribution to precision; they do not determine the treatment effect, and they are not a substitute for a complete analysis plan. The baseline-informed approximation relies on the stated regression assumptions and on estimating the treatment contrast consistently with that model.

Using Placebo and Natural-History Trajectories

Placebo or natural-history data provide evidence about the expected outcome course at specified times. A simple starting point is a mean trajectory, such as a linear model for the expected endpoint over time. The trajectory can support selection of a plausible control mean at the planned endpoint and can reveal whether a constant rate of change is a reasonable approximation over the observed interval.

A fitted mean curve does not by itself estimate endpoint variability. Variability must be assessed from participant-level deviations around the relevant model or from an appropriate endpoint standard deviation. In repeated measurements, those deviations may be correlated within a participant; treating measurements as independent would overstate the information. For the present planning task, the key is to use the control trajectory for its mean-course information and a suitable participant-level estimate for endpoint dispersion.

Worked Example: Checking a Natural-History Mean Trajectory

In a hypothetical untreated cohort, mean endpoint values (in points) at weeks 0, 2, 4, 6, and 8 are 50, 48, 45, 43, and 42. Fit a straight line to these five mean values by least squares and assess the fitted mean pattern.

The mean time is \(\bar{t}=4\) weeks and the mean outcome is \(\bar{y}=45.6\) points. The least-squares slope is

$$ \hat{b}= \frac{\sum (t_j-\bar{t})(y_j-\bar{y})} {\sum (t_j-\bar{t})^2} =\frac{-42}{40}=-1.05\ \text{points per week}. $$

The fitted outcome at week 4 is 45.6 points, so the fitted line is \(\hat{y}=45.6-1.05(t-4)\). Its predictions at weeks 0, 2, 4, 6, and 8 are 49.8, 47.7, 45.6, 43.5, and 41.4 points. The residuals (observed mean minus fitted mean) are 0.2, 0.3, −0.6, −0.5, and 0.6 points. Their squared sum is

$$ 0.2^2+0.3^2+(-0.6)^2+(-0.5)^2+0.6^2 =1.10\ \text{points}^2. $$

These small deviations suggest that a straight line describes these five means reasonably closely over the observed period. They do not establish that individual outcomes are linear, that the mean trend will continue beyond week 8, or that endpoint variability is small. Model assessment should also examine participant-level residuals, the uncertainty of each mean, and whether residuals show systematic curvature or changing spread.

Quantifying the Contribution to Planned Precision

The difference between total and residual endpoint variability can be consequential for planning. The next example compares standard errors under an unadjusted endpoint calculation and a baseline-informed calculation. It illustrates the variability contribution only; the assumed treatment contrast and all other design choices remain separate inputs.

Worked Example: Comparing Treatment-Contrast Standard Errors

Consider a hypothetical two-arm trial with 64 participants per arm. Assume the endpoint standard deviation is 9.5 points and a relevant baseline-endpoint correlation is 0.65. For illustration, suppose the planned treatment contrast is 4 points.

Without baseline information in the variance calculation, the standard error is

$$ SE_{\text{unadjusted}} =\sqrt{\frac{2(9.5^2)}{64}} =\sqrt{\frac{180.5}{64}} =1.679\ \text{points}. $$

The baseline-informed residual variance estimate is

$$ \hat{\sigma}_e^2=9.5^2(1-0.65^2) =90.25(0.5775)=52.12\ \text{points}^2. $$

Thus the corresponding standard error approximation is

$$ SE_{\text{baseline-informed}} =\sqrt{\frac{2(52.12)}{64}} =1.276\ \text{points}. $$

The reduction in standard error is approximately \(1-1.276/1.679=0.240\), or 24.0%. For the assumed 4-point contrast, the contrast-to-standard-error ratios are \(4/1.679=2.382\) and \(4/1.276=3.135\), respectively. These ratios are descriptive precision comparisons, not by themselves power calculations or guarantees of a significant result. The gain depends on the correlation being reproducible in the trial population and on the common-slope model being suitable.

Model Fit, Diagnostics, and Limits

A planning model should be challenged before its estimates are used. For the baseline-outcome model, inspect a plot of follow-up endpoint against baseline and residuals against fitted values and baseline. Curvature suggests that a straight-line conditional mean may be inadequate; a fan-shaped residual pattern suggests nonconstant variance. Large influential observations can materially change the estimated slope, correlation, or residual standard deviation. A strong association in one subgroup but a different association in another may invalidate a common-slope assumption.

For a natural-history trajectory, inspect the observed means and their uncertainty across time, along with participant-level residual patterns where available. Systematic curvature warns against assuming a linear trend; an apparent change in trend may also reflect changes in who remains observed. A small residual sum of squares for a few aggregate means is not enough to validate an individual-level model. Extrapolating past the observed follow-up period requires additional scientific justification.

Historical and natural-history evidence also requires transportability: the population, endpoint definition, assessment schedule, background care, and data collection should be sufficiently comparable to the planned trial. Differences in these features can shift the expected control course or alter endpoint dispersion. A placebo trajectory is an estimate for the population and trial conditions in which it was observed; it does not guarantee the same course in a future trial. Uncertainty in the estimated standard deviation, correlation, slope, and trajectory should therefore be considered in planning, rather than treating estimates from a finite dataset as exact.

Common pitfall: “The placebo mean changes by only a few points, so endpoint variability must be small.” This confuses the group mean trajectory with variation among participants. The correction is to estimate the mean course and endpoint dispersion separately, using participant-level variability information appropriate to the planned population and assessment time.

The main alternatives answer different planning questions. An unadjusted endpoint standard deviation is straightforward and avoids relying on a baseline model, but does not use the predictive information in baseline. A baseline-informed residual variance can give a more relevant precision estimate when its relationship is stable and well fitted, but is sensitive to model misspecification and transportability. A placebo trajectory gives direct evidence about the expected control course, while a natural-history cohort may be more vulnerable to differences in care, selection, and measurement. These sources can inform one another, but a mean trajectory cannot substitute for a variability estimate, and a baseline correlation cannot substitute for evidence about the control mean over time.

In practice, report the source and assessment time for each planning input, the model used, its assumptions, and the diagnostics that support it. When evidence is limited, compare plausible values rather than presenting a single estimated precision as certain. The introductory material on model-based endpoint planning motivates matching the endpoint to the scientific question; here, the additional task is to make the variability and control-course assumptions explicit enough to scrutinize.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. If the endpoint standard deviation is 8 points and the baseline-endpoint correlation is 0.50, what residual standard deviation follows from the linear model?
  2. Why can a well-fitting placebo mean trajectory not, by itself, provide the endpoint standard deviation?
  3. With 50 participants per arm and an endpoint standard deviation of 10 points, calculate the unadjusted standard error of an equal-allocation treatment contrast.
  4. Name two findings that would make a linear baseline-outcome model questionable for planning.

Solutions. (1) The residual standard deviation is \(8\sqrt{1-0.50^2}=8\sqrt{0.75}=6.928\) points. (2) The trajectory describes expected group means over time; it does not describe the spread of participant-level outcomes around those means. (3) \(SE=\sqrt{2(10^2)/50}=\sqrt{4}=2.000\) points. (4) Examples include systematic curvature in residuals versus baseline, a funnel-shaped residual pattern indicating changing variance, influential observations, or materially different slopes across relevant groups.