Tutorials › Model-Informed Drug Development (MIDD) › Identifiability of Size and Maturation Effects

Pediatric Development · Tutorial 474 of 596

Identifiability of Size and Maturation Effects

Learn to recognize when pediatric data cannot reliably separate size and maturation effects, and how to assess that limitation with parameter correlations, profile likelihoods, and simulation.

Advanced 12 min read

What You'll Learn

  • Distinguish structural from practical identifiability of size and maturation parameters.
  • Interpret parameter correlations in a pediatric clearance model.
  • Construct and read a profile likelihood for the maturation half-time.
  • Design simulation-based parameter-recovery checks.
  • Recognize when more data, fixed assumptions, or external information are needed.

Why Size and Maturation Can Be Hard to Separate

Pediatric clearance often changes with both body size and developmental age. The challenge is that size and age usually change together: older children tend to weigh more, and clearance tends to increase with both weight and maturation. If the observed data cover only a narrow age range or provide little variation in weight among children of similar ages, different combinations of size and maturation parameters may explain the observations almost equally well. The fitted model can look adequate while its individual parameter estimates remain uncertain.

This is an identifiability problem. It matters because a model may be used to predict clearance at ages or weights that were not well represented in the data. If size and maturation effects are not separately supported, those predictions can depend strongly on which parameter combination the fitting procedure selected.

Definition: A parameter is structurally identifiable if distinct values of that parameter cannot produce the same distribution of observable data under the specified model and design. It is practically identifiable if the available finite, noisy data contain enough information to estimate it with useful precision. A parameter can be structurally identifiable but practically weakly identifiable.

A Model and Its Information

Consider a clearance model with body weight \(WT_i\), postmenstrual age \(PMA_i\), a fixed allometric size exponent of 0.75, and a sigmoidal maturation function. Here \(CL_{\mathrm{mat}}\) is the reference clearance scale, \(TM_{50}\) is the age at which the maturation function is one-half, and \(h\) controls its steepness:

$$ CL_i = CL_{\mathrm{mat}} \left(\frac{WT_i}{70\ \mathrm{kg}}\right)^{0.75} \frac{PMA_i^h}{PMA_i^h+TM_{50}^h} \exp(\eta_i) $$

For this tutorial, assume clearance is positive, the weight and age measurements are adequate, the model form is appropriate over the modeled range, and the random effect \(\eta_i\) has mean zero on the log scale. For the examples, residual errors in log clearance are independent, normally distributed, and have a common variance. The weight exponent and \(h\) are treated as fixed where stated; estimating additional parameters would generally require more information.

The central issue can be seen by taking logs and examining how the expected log clearance changes as parameters change. Write \(F_i\) for the maturation fraction. The sensitivities of the log-clearance prediction to the main parameters are:

$$ \log(CL_i) = \log(CL_{\mathrm{mat}}) +0.75\log\left(\frac{WT_i}{70\ \mathrm{kg}}\right) +\log(F_i)+\eta_i $$
$$ \frac{\partial \log(CL_i)}{\partial \log(CL_{\mathrm{mat}})}=1, \qquad \frac{\partial \log(CL_i)}{\partial \log(TM_{50})} =-h(1-F_i), \qquad \frac{\partial \log(CL_i)}{\partial 0.75} =\log\left(\frac{WT_i}{70\ \mathrm{kg}}\right) $$

For the second derivative, \(F_i=PMA_i^h/(PMA_i^h+TM_{50}^h)\). Differentiating its logarithm with respect to \(\log(TM_{50})\) gives \(-hTM_{50}^h/(PMA_i^h+TM_{50}^h)\), which equals \(-h(1-F_i)\). Thus, if maturation fractions are similar across the observations, changes in \(TM_{50}\) shift predictions in a similar way across those observations. A compensating change in \(CL_{\mathrm{mat}}\) can then preserve much of the fit. If weight is also strongly associated with age, the size contribution may be difficult to distinguish from the age-related contribution.

This is a local explanation of weak information, not a claim that size and maturation are always confounded. Data spanning different ages at comparable weights, or different weights at comparable ages, can help distinguish their contributions. The earlier material on body-size scaling and maturation functions supplies the model components; the task here is to assess whether the data can estimate them separately.

Worked Example: Checking the Combined Effect at One Age and Weight

Suppose a hypothetical model uses \(TM_{50}=30\) weeks and \(h=3\). At \(PMA=30\) weeks, a child weighs 1 kg, and the observed clearance is 0.275 L/h. Calculate the model multipliers and the value of \(CL_{\mathrm{mat}}\) that reproduces this observation, using the fixed size exponent 0.75.

The size multiplier is:

$$ \left(\frac{1}{70}\right)^{0.75} =\exp\left(0.75\log(1/70)\right) \approx 0.0413 $$

Since age equals \(TM_{50}\), the maturation fraction is one-half:

$$ F(30;30,3)=\frac{30^3}{30^3+30^3}=0.500 $$

The combined multiplier on \(CL_{\mathrm{mat}}\) is \(0.0413\times0.500=0.02065\). Matching the hypothetical observed clearance therefore gives:

$$ CL_{\mathrm{mat}}=\frac{0.275\ \mathrm{L/h}}{0.02065} \approx 13.32\ \mathrm{L/h} $$

This calculation checks the model at one age-weight combination; it does not show that the data identify \(CL_{\mathrm{mat}}\) and \(TM_{50}\) separately. As the next example demonstrates, one observation at that combination can be matched by multiple parameter pairs.

Parameter Correlations and Profile Likelihoods

A parameter-correlation matrix is a useful first diagnostic. For the model above, a high positive estimated correlation between \(CL_{\mathrm{mat}}\) and \(TM_{50}\) is plausible: increasing \(TM_{50}\) reduces the maturation fraction at a given age, and increasing \(CL_{\mathrm{mat}}\) can partly offset that reduction. A correlation close to either \(+1\) or \(-1\) indicates that the estimates move together strongly in the fitted uncertainty approximation. It is a warning of weak separation, not proof of structural non-identifiability. Correlations can depend on parameter scaling, the estimation method, and the local shape of the likelihood.

A profile likelihood gives a more direct view of the trade-off. To profile \(TM_{50}\), fix it at a sequence of values, re-estimate the other free parameters at each value, and record the resulting maximized likelihood. A broad, shallow profile means many values of \(TM_{50}\) fit nearly as well; a narrow, sharply curved profile around its minimum indicates greater information. A profile can reveal asymmetry or a long tail that a correlation matrix alone may hide.

Worked Example: A Flat Profile From One Age-Weight Combination

Use the hypothetical observation and fixed model values from the previous example: clearance 0.275 L/h, weight 1 kg, \(PMA=30\) weeks, exponent 0.75, and \(h=3\). Now fix \(TM_{50}\) in turn at 20, 30, and 45 weeks, and adjust \(CL_{\mathrm{mat}}\) to reproduce the same observed clearance.

For \(TM_{50}=20\) weeks, \(F=30^3/(30^3+20^3)=0.7714\). The fitted scale is \(0.275/(0.0413\times0.7714)\approx8.63\) L/h.

For \(TM_{50}=30\) weeks, \(F=30^3/(30^3+30^3)=0.5000\). The fitted scale is \(0.275/(0.0413\times0.5000)\approx13.32\) L/h.

For \(TM_{50}=45\) weeks, \(F=30^3/(30^3+45^3)=0.2286\). The fitted scale is \(0.275/(0.0413\times0.2286)\approx29.13\) L/h.

Each pair predicts the same clearance at this single age and weight. Under a log-normal observation model, if the prediction equals the observation in each case, each pair also has the same residual contribution to the likelihood. The profile is therefore flat for this one observation: these data alone cannot distinguish the three parameter pairs. Additional observations at informative ages and weights, or justified external information, are needed for separation.

In a real analysis, a profile is usually summarized using the increase in \(-2\log L\) relative to its minimum, where \(L\) is the likelihood. Under regular large-sample conditions, an increase of about 3.84 is a conventional approximate 95% likelihood-based cutoff for one profiled parameter. These conditions can fail, especially with weak identification, boundaries, or small samples; the cutoff should not be treated as an automatic guarantee of accurate coverage. Inspect the profile itself, the parameter bounds, and whether the fitted nuisance parameters remain plausible along it.

Simulation-Based Recovery Checks

Simulation-based recovery asks whether the planned design and fitting procedure can recover known parameter values when data are generated from the assumed model. Specify the parameter values, covariate distribution, sampling pattern, residual and between-subject variability, and fitting procedure. Generate repeated datasets, fit each one, and examine convergence, bias, uncertainty, parameter correlations, and interval coverage. Recovery is conditional on the simulation model: it assesses whether the design can identify parameters under those assumptions, not whether the assumptions are true.

Worked Example: Comparing Two Hypothetical Pediatric Designs

Suppose a model is simulated with true \(CL_{\mathrm{mat}}=12.0\) L/h, \(TM_{50}=30\) weeks, fixed exponent 0.75, fixed \(h=3\), and normally distributed log-scale residual error with standard deviation 0.15. Consider two hypothetical designs with 120 children each. Design A has a narrow age range and weight rises closely with age. Design B spans a wider age range and includes children of differing weights at comparable ages. In each design, 500 datasets are generated and fitted with the same model, estimating \(CL_{\mathrm{mat}}\) and \(TM_{50}\).

The following values are illustrative hypothetical simulation output, not results from an actual study:

Diagnostic across 500 fitsDesign ADesign B
Median estimated correlation, \(CL_{\mathrm{mat}}\) and \(TM_{50}\)0.960.54
Mean estimated \(TM_{50}\)36.0 weeks30.8 weeks
Bias in \(TM_{50}\) (mean estimate minus truth)36.0 - 30.0 = 6.0 weeks30.8 - 30.0 = 0.8 weeks
Coverage of nominal 95% intervals for \(TM_{50}\)72%93%

Design A shows strong parameter association, upward bias, and poor interval coverage in this illustration. Design B performs better on these diagnostics, consistent with its broader and less collinear age-weight information. The comparison does not prove that Design B will work in practice: its conclusions depend on the assumed data-generating model, and the fitted model may be misspecified. The purpose is to expose weak recovery before relying on the model for predictions.

1
Specify the question.
Identify which size and maturation parameters need to be estimated and which are fixed using justified prior knowledge.
2
Generate data under plausible conditions.
Represent the intended age and weight distribution, sampling, variability, and analysis procedure. Include scenarios that challenge the assumptions.
3
Check recovery, not just convergence.
Summarize bias, interval coverage, correlations, profile shapes, boundary estimates, and failed fits across replicates.

Diagnostics, Alternatives, and Limitations

Evidence of weak identifiability can include a nearly singular parameter covariance matrix, very high parameter correlations, large standard errors, estimates that change markedly with starting values or bounds, and profile likelihoods that remain nearly flat over a wide range. Simulation recovery can reveal the same problem through biased estimates, poor coverage, frequent boundary estimates, or unstable fits. A small residual error or an apparently good prediction within the observed data does not by itself show that the parameters are separately identified.

The appropriate response depends on the scientific question. Options include collecting data that better separate age from weight, fixing a parameter only when external scientific evidence supports the value, or using a justified prior distribution and reporting how much the result depends on it. A prior can regularize an estimate, but it does not create information in the observed data. When separate estimation is not supported, report the uncertainty and consider whether a combined prediction or parameter combination is more defensible than precise-looking individual estimates.

These approaches answer different questions. Parameter correlations are quick local diagnostics; profile likelihoods explore how fit changes when one parameter is constrained; simulation-based recovery evaluates the whole design-and-analysis procedure under specified assumptions. None can establish that the chosen model is biologically correct. Likewise, fixing the allometric exponent or maturation steepness can improve estimation of remaining parameters while shifting uncertainty into the fixed assumptions. Such choices should be justified and sensitivity-tested rather than made solely to obtain convergence.

Common pitfall: “The optimizer converged and the fitted curve follows the data, so size and maturation are identified.” Convergence and fit quality do not establish separate parameter information. Check parameter correlations and profiles, then test recovery under plausible simulated designs. If several parameter combinations fit almost equally well, report that limitation instead of treating one estimate as uniquely established.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. Why might \(CL_{\mathrm{mat}}\) and \(TM_{50}\) be positively correlated in a pediatric clearance fit?
  2. At \(PMA=TM_{50}\), what is the maturation fraction, regardless of the value of \(h\)?
  3. What does a broad, shallow profile likelihood for \(TM_{50}\) indicate?
  4. Why does successful parameter recovery in a simulation not prove that a model is correct?

Solutions. (1) Increasing \(TM_{50}\) lowers the maturation fraction at a given age; increasing \(CL_{\mathrm{mat}}\) can compensate by raising the clearance scale, producing a positive association. (2) The fraction is \(PMA^h/(PMA^h+TM_{50}^h)=1/2\) when the two ages are equal. (3) A wide range of \(TM_{50}\) values gives nearly the same fitted likelihood after other parameters are re-estimated, indicating weak information about that parameter. (4) Recovery evaluates estimation under the simulated data-generating assumptions. A misspecified model may still recover its own simulated parameters well, so recovery does not validate the model against reality.