Tutorials › Model-Informed Drug Development (MIDD) › Separating Disease Progression From Developmental Change

Pediatric Development · Tutorial 482 of 596

Separating Disease Progression From Developmental Change

Learn to model pediatric outcomes over time so that expected growth and disease progression are not mistaken for treatment benefit.

Advanced 12 min read

What You'll Learn

  • Separate normal age-related development from change caused by the disease
  • Define treatment effects as contrasts against an appropriate untreated trajectory
  • Use placebo-controlled longitudinal data to estimate treatment effects
  • Assess when external natural-history data can support an untreated trajectory
  • Recognize confounding between age, follow-up time, and disease duration
  • Diagnose model fit and interpret age-dependent treatment effects

Why Separating Trajectories Matters

A pediatric outcome can change over time even if treatment has no effect. A developmental score may increase as a child matures, while a disease process simultaneously slows that increase or causes decline. The observed trajectory is therefore not, by itself, evidence of either disease progression or treatment benefit. A useful analysis distinguishes normal developmental change, disease-related change, and the effect of treatment.

This distinction is especially important when the outcome scale is age-sensitive. For example, a raw score may rise with age in healthy children, while the same score in affected children rises more slowly. A treated child’s score might still rise, yet less than it would have under untreated disease. Conversely, a stable score could represent benefit if untreated children of the same age and disease duration typically decline.

The earlier material on developmental PK-PD models of pediatric response considers how response relates to drug exposure and developmental characteristics. Here the focus is the longitudinal outcome trajectory and its counterfactual: what would be expected at the same ages and follow-up times without treatment?

Representing Development, Disease, and Treatment

Definition: Normal developmental change is the age-related change expected in the outcome apart from the disease and treatment. Disease progression is the change attributable to the disease under the specified untreated condition. A treatment effect is the difference between the outcome under treatment and the outcome that would have occurred without treatment, for a defined population, time, and outcome scale.

Let \(Y_{ij}\) denote the outcome for child \(i\) at visit \(j\), \(a_{ij}\) the child’s age, \(t_{ij}\) time since the study baseline, and \(d_{ij}\) disease duration. Let \(A_i=1\) indicate assignment to treatment and \(A_i=0\) indicate assignment to placebo or no treatment. A conceptual model is:

$$ Y_{ij} = b_i + \left\{M(a_{ij})-M(a_{i0})\right\} + \left\{G(d_{ij})-G(d_{i0})\right\} + A_i\,\tau(t_{ij},a_{i0}) + \varepsilon_{ij}. $$

Here \(b_i\) is the child’s expected baseline level, \(M(a)\) describes normal development on the chosen outcome scale, \(G(d)\) describes disease-related change in the untreated state, and \(\tau\) is the treatment effect relative to that untreated state. The residual \(\varepsilon_{ij}\) captures remaining measurement and model error; repeated measurements within a child generally require an appropriate within-child covariance model. The functions may be nonlinear, and the treatment effect may depend on follow-up time or age at treatment initiation.

This decomposition is a modeling framework, not a guarantee that each component can be uniquely estimated. Its interpretation depends on the data and assumptions. In particular, \(M\) and \(G\) may be difficult to distinguish if age and disease duration move together, or if there is no suitable reference information about normal development. A model can fit observed data well and still fail to identify the components of scientific interest.

What a Placebo-Controlled Study Identifies

In a randomized placebo-controlled study, the placebo group provides an estimate of the untreated disease trajectory under the study’s background care and measurement schedule. It does not necessarily represent healthy development: placebo participants have the disease, so their observed change can include both normal maturation and disease progression. Randomization makes the treatment and placebo groups comparable on average at baseline, including on measured and unmeasured prognostic factors, subject to chance imbalance and trial conduct.

For a simple illustration, suppose the expected change in each arm is the sum of a shared developmental component and a shared untreated disease component, plus a treatment effect in the active arm. The difference in mean changes then removes the shared components. This is the basis of a treatment-versus-placebo contrast; the components need not be estimated separately to estimate that contrast.

Key result: With random assignment, comparable outcome measurement, and no systematic arm-specific changes other than treatment, the expected treatment-minus-placebo difference in change estimates the mean treatment effect over the specified follow-up period. It estimates the effect of assignment to the treatment strategy, not necessarily the biological effect among only those who adhered.

A longitudinal model can use all available visits rather than only baseline and endpoint. It may include a flexible visit-time function, treatment-by-time terms, baseline outcome, and prespecified age terms. The treatment-by-time component represents how the treatment-placebo contrast evolves. If treatment is expected to alter the rate of progression, the contrast can grow with time; if onset is delayed, a model with an immediate constant effect may be unsuitable.

Worked Example: Removing Shared Growth With a Placebo Contrast

In a hypothetical randomized study, the outcome is a developmental scale in points, with higher values indicating better function. At baseline, the treatment and placebo groups both have a mean of 40 points. At week 24, the treatment mean is 51 points and the placebo mean is 46 points. Assume the groups have comparable baseline distributions and are measured in the same way.

The treatment group’s mean change is \(51-40=11\) points. The placebo group’s mean change is \(46-40=6\) points. The estimated difference in change is:

$$ (51-40)-(46-40)=11-6=5\text{ points}. $$

The estimated treatment effect at week 24 is 5 points relative to placebo. The 6-point placebo improvement may reflect normal development, disease-related change, background care, or a combination; this contrast does not claim to separate those parts. It estimates the treatment advantage over the observed untreated trajectory. The calculation alone does not provide a standard error or confidence interval, so it does not establish the statistical precision of the estimate.

Using Natural-History Information

When a concurrent placebo group is unavailable or too small, an untreated natural-history model may be used to predict the outcome trajectory expected without treatment. Such information can come from an untreated cohort with the disease, a prior study, or a suitable registry. A healthy reference trajectory can help characterize normal development, but it is not a substitute for affected untreated natural history: healthy children do not supply the disease component.

An external natural-history comparison requires assumptions beyond those needed for a randomized concurrent control. The external and treated populations must be sufficiently comparable in age, disease duration, baseline severity, outcome definition, measurement schedule, supportive care, and factors influencing prognosis. Differences in enrollment, assessment, or care can create apparent treatment effects. Modeling measured covariates can reduce some differences but cannot ensure comparability on unmeasured factors.

If healthy reference data support an age-specific expected outcome \(M(a)\), one may express an affected child’s observed outcome relative to that reference. For example, an age-standardized score can remove the average age trend represented by the reference. But it does not remove disease progression, and it does not automatically make an external disease cohort comparable to a trial population. The reference’s population, scale, and measurement procedures must be appropriate to the children being analyzed.

Worked Example: Comparing With Affected Natural History

Suppose a hypothetical raw score typically increases by 4 points over six months in the relevant age range. In an untreated affected cohort matched to the trial population, the mean score increases by only 1 point over the same interval. The difference between these changes is consistent with a 3-point disease-related shortfall relative to the healthy developmental reference, under the assumption that the reference is applicable.

Now suppose treated children in a separate study increase by 4 points. Their estimated difference from affected natural history is:

$$ 4-1=3\text{ points}. $$

The treated group improved by 4 points in absolute terms, but the estimated treatment advantage over affected natural history is 3 points. It would be incorrect to call the full 4-point increase a treatment effect, because the untreated affected group also improved. This comparison is causal only if the external cohort provides a valid counterfactual for the treated children; matching the mean age alone is not enough to establish that assumption.

Age, Follow-Up, and Disease Duration Can Be Confounded

For each child, age at a visit equals baseline age plus time since baseline: \(a_{ij}=a_{i0}+t_{ij}\). Thus, within a child, age and follow-up time are not independent variables. If every child has the same disease duration at enrollment and disease duration increases one-for-one with follow-up, duration and follow-up are also closely linked. A model that assigns separate flexible effects to these quantities may not be able to distinguish them from the observed data alone.

Identification can improve when there is meaningful variation in baseline age or disease duration, repeated observations across a suitable age range, and reliable information on untreated development. Even then, age and disease effects may remain correlated. Scientific knowledge can motivate a parsimonious shape for \(M(a)\) or \(G(d)\), but imposing a shape is an assumption and should be checked against the available observations.

A practical way to expose the issue is to ask what comparisons the design actually supplies. Does it observe affected children of similar ages but different disease durations? Does it include untreated observations over the ages represented in the treated cohort? Are there observations before and after a developmental transition? If the answer is no, the separate developmental and disease components may be weakly identified even if the overall predicted trajectory is precise.

Worked Example: Detecting an Age-Related Treatment Difference

Consider a hypothetical randomized trial with equal numbers of younger and older children. At week 24, the mean improvement in the younger subgroup is 6 points on placebo and 9 points on treatment. In the older subgroup, it is 2 points on placebo and 4 points on treatment. The subgroup treatment contrasts are:

$$ \begin{aligned} \text{Younger contrast} &= 9-6=3\text{ points},\\ \text{Older contrast} &= 4-2=2\text{ points}. \end{aligned} $$

With equal subgroup sizes, the overall mean contrast is \((3+2)/2=2.5\) points. The raw treatment improvements, 9 and 4 points, should not be compared as though they were treatment effects: the placebo improvements differ substantially by age. The contrasts suggest a 1-point difference in estimated treatment effect between the subgroups, but that difference may be due to sampling variability. A treatment-by-age term can estimate age-related effect modification, with uncertainty reported; subgroup estimates alone do not establish that treatment truly works differently by age.

Model Checks, Alternatives, and Limitations

Diagnostics should examine both the overall fit and whether the model captures the distinctions it is intended to make. Plot observed outcomes over time by treatment and age group, and compare them with model-predicted trajectories. For natural-history analyses, also display the external untreated observations and the region over which predictions are being used. Look for systematic residual patterns by age, disease duration, baseline severity, visit, or treatment arm; such patterns may signal an inadequate trajectory shape, missing effect modification, or a measurement issue.

Check whether predictions outside the observed age or disease-duration range are driving the treatment contrast. Examine sensitivity to reasonable alternative developmental and progression functions, baseline adjustment, and assumptions about external comparability. For longitudinal data, assess whether dropout or missed visits are related to health status: a model based on observed measurements can be biased if worsening children are more likely to leave and the analysis does not adequately address that process. Diagnostics cannot prove assumptions such as exchangeability with an external cohort, but they can reveal incompatibilities and dependence on modeling choices.

ApproachWhat it can estimateMain concern
Randomized placebo-controlled longitudinal modelTreatment contrast over time against concurrent untreated disease trajectoryChance imbalance, missing data, or an unsuitable time-course model
External affected natural-history comparisonTreatment contrast against a modeled untreated disease trajectoryConfounding from differences between external and treated populations
Age-standardized outcomeDeviation from an age-specific reference expectationDoes not by itself remove disease progression or establish a treatment effect
Within-treated pre-post changeObserved change after treatment startsCannot separate treatment from maturation, disease progression, or other time effects

The strongest option is usually the one that supplies the most credible untreated counterfactual for the intended population. A concurrent randomized control often supports the clearest causal comparison. Natural-history models can be valuable when a concurrent control is infeasible, but their conclusions are more dependent on transportability and model assumptions. A pre-post analysis alone is generally insufficient to attribute change to treatment.

Common Pitfall

Common mistake: “The treated children’s score increased, so treatment improved the outcome by that amount.” This treats all observed change as a treatment effect. Correction: Compare the treated trajectory with the expected untreated trajectory at the same ages and follow-up times. Shared maturation and disease-related change are not treatment effects.

A related error is to assume that age adjustment automatically separates development from disease progression. Age standardization can account for a specified reference trend, but disease-related change remains, and the result depends on how well the reference applies. The treatment contrast must still be defined against an appropriate untreated outcome.

1
Define the target contrast.
Specify the outcome scale, population, treatment strategy, comparator, and follow-up time at which the treatment effect is to be interpreted.
2
Identify the untreated information.
Determine whether a concurrent placebo group or external affected natural history supplies the counterfactual trajectory. Treat healthy developmental references as information about age trends, not as affected controls.
3
Assess separability.
Examine overlap and variation in age, follow-up, disease duration, and severity. State which trajectory components are estimated from data and which rely on assumptions.
4
Fit and challenge the trajectory model.
Allow plausible nonlinear change, check age- and time-specific fit, and test sensitivity to reasonable alternatives and missing-data assumptions.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A treated group improves by 7 points while placebo improves by 4 points. What is the estimated difference in change, and what does it represent?
  2. Why is a healthy age-reference curve not, by itself, an untreated disease trajectory?
  3. In an external natural-history analysis, name two features besides age that should be considered when assessing comparability.
  4. Why can age and follow-up time be difficult to estimate as independent effects within a child?
  5. A child’s outcome is stable during treatment. Does that establish benefit? State what comparison is needed.

Solutions. (1) The difference is \(7-4=3\) points, an estimated treatment advantage over placebo, not the full 7-point improvement. (2) A healthy reference describes expected normal development but does not include the disease-related trajectory in affected children. (3) Examples include disease duration, baseline severity, outcome measurement, supportive care, or prognostic factors. (4) At each visit, age equals baseline age plus follow-up time, so the two variables change together within the child. (5) No. Stability may represent benefit if a comparable untreated group would decline; the treated outcome must be compared with an appropriate untreated trajectory at the same time and age.