Why parameter estimates need a support check
A dissolution-precipitation model can reproduce a concentration-time curve while leaving several parameter combinations plausible. For example, a faster dissolution rate may be offset by faster precipitation, or a particle-size assumption may compensate for an adjusted dissolution coefficient. A fitted value is therefore not, by itself, evidence that the data have determined that parameter.
This tutorial uses two complementary diagnostics. Local sensitivity measures how predictions change near one chosen parameter vector. Profile-based diagnostics ask how well the model can fit when one parameter is set to different values and the other parameters are re-optimized. Neither diagnostic replaces scientific judgment: both depend on the model, measured outputs, sampling times, and assumed observation-error model.
Local sensitivity on a meaningful scale
Let \(y_i\) be the measured concentration at time \(t_i\), and let \(f_i(\boldsymbol{\theta})\) be the model-predicted concentration at that time. The parameter vector \(\boldsymbol{\theta}\) may include particle radius, a dissolution-rate parameter, nucleation and crystal-growth parameters, and micellar parameters. Assume for this diagnostic that the model is evaluated at a specified parameter vector and that each observation has a known additive-error standard deviation \(\sigma_i\). A useful sensitivity for a positive parameter \(\theta_j\) is
This derivative describes the change in prediction, measured in observation-error standard deviations, for a small proportional change in the parameter. It is dimensionless and does not change merely because a parameter is expressed in different units. The formula applies to positive parameters; parameters that can be zero or negative need a suitable alternative transformation or a derivative on their natural scale.
A large absolute value of \(S_{ij}\) means observation \(i\) is locally responsive to parameter \(j\). But a column with large entries does not guarantee that the parameter can be estimated separately. If two sensitivity columns have nearly the same pattern across observation times, changing either parameter has nearly the same effect on the data. The data may then constrain a combination of the parameters well while leaving their individual values uncertain.
Worked Example: Detecting Confounded Dissolution Effects
Suppose three hypothetical concentration measurements have additive-error standard deviations of \(0.20\) mg/L. At a fitted parameter vector, the noise-scaled log sensitivities are as follows. The first column is for a dissolution-rate parameter, and the second is for a particle-size parameter.
The cosine between the columns is
Both parameters affect the predictions strongly: the first sensitivity-column norm is \(\sqrt{5.25}\approx2.291\), and the second is \(\sqrt{4.915}\approx2.217\). However, their sensitivity patterns are almost parallel. The three measurements therefore show local responsiveness to both parameters but provide little information for separating their individual effects. A fitted particle-size value should not be reported as precisely determined solely because the optimizer returned a precise-looking number.
From local sensitivities to local information
For independent Gaussian errors with known standard deviations, define the weighted residual objective
Near a candidate value \(\boldsymbol{\theta}_0\), use a first-order Taylor approximation to the prediction:
After dividing each prediction change by \(\sigma_i\), the local change in the fitted curve is approximately \(\mathbf{S}\Delta\boldsymbol{\eta}\), where \(\mathbf{S}\) is the sensitivity matrix. Consequently, the local curvature of the weighted residual objective is related to \(\mathbf{S}^{\mathsf T}\mathbf{S}\). If columns of \(\mathbf{S}\) are nearly dependent, this matrix has a small eigenvalue: there is a direction in parameter space along which the predictions change little. This explains why high individual sensitivities can coexist with poor separation of parameters.
The approximation is local. It assumes the model predictions are sufficiently smooth near \(\boldsymbol{\theta}_0\), and it can be misleading when the model is strongly nonlinear over the plausible parameter range, when parameters are at bounds, or when a parameter changes which kinetic regime dominates. Sensitivities can be calculated analytically, by differentiating the model equations, or numerically, by perturbing one parameter slightly and checking that the result is stable to the perturbation size.
Profiles test support beyond one local point
A profile diagnostic fixes one parameter at a sequence of values and minimizes the objective over the remaining parameters. For parameter \(\theta_j\), define
where \(\boldsymbol{\theta}_{-j}\) denotes all parameters other than \(\theta_j\). Re-optimizing those parameters is essential: the profile asks whether a proposed value can fit the data after allowing compensation by other parameters. A curve that rises sharply away from its minimum indicates that the data constrain the parameter over that range. A broad, flat profile indicates weak support; a profile that remains essentially flat over its allowed range indicates that the data do not meaningfully constrain it under the model and error assumptions.
With independent Gaussian errors of known \(\sigma_i\), and under regularity conditions including an interior optimum and a locally adequate model, an approximate 95% likelihood-based interval for one parameter uses profile values satisfying \(Q_{\mathrm{prof}}-Q_{\min}\leq3.84\). This threshold is the 95th percentile of a chi-square distribution with one degree of freedom. It is an approximation, not a universal rule: boundaries, severe nonlinearity, sparse data, or uncertain error assumptions may make it unreliable. A profile is often more revealing than a local standard error because it can show asymmetry, flat regions, multiple minima, and bounds.
Worked Example: Reading a Nucleation-Parameter Profile
Consider a hypothetical fit with known additive-error standard deviations. The parameter \(k_n\) is a nucleation-rate coefficient, in min\(^{-1}\). At each fixed value of \(k_n\), the other parameters have been re-optimized. The minimum profile objective is \(Q_{\min}=6.20\), attained at \(k_n=0.08\) min\(^{-1}\).
| \(k_n\) (min\(^{-1}\)) | \(Q_{\mathrm{prof}}\) | \(Q_{\mathrm{prof}}-Q_{\min}\) |
|---|---|---|
| 0.04 | 12.0 | 5.80 |
| 0.06 | 8.30 | 2.10 |
| 0.08 | 6.20 | 0.00 |
| 0.12 | 7.50 | 1.30 |
| 0.20 | 11.0 | 4.80 |
Using the approximate one-parameter cutoff of 3.84, the lower crossing is between 0.04 and 0.06 min\(^{-1}\), and the upper crossing is between 0.12 and 0.20 min\(^{-1}\). Linear interpolation in the tabulated profile differences gives
and
Thus the coarse profile suggests an approximate interval of 0.0506 to 0.178 min\(^{-1}\), subject to the stated likelihood assumptions and the limited grid resolution. The interval is broad relative to the optimum: the data support a range of nucleation rates, not a sharply determined single value. A finer grid and checks for other minima would be needed before treating these interpolated endpoints as stable.
What concentration-time data can distinguish
Sensitivity and profile patterns should be interpreted in terms of the model and the observation design. Early measurements may be especially responsive to dissolution and particle-size assumptions, while later measurements may contain more information about precipitation onset and subsequent growth. These are tendencies, not guarantees: the precise pattern depends on the coupled equations, dose, medium, and sampling schedule.
A particle-size parameter and a dissolution coefficient may be confounded if both mainly change the rate at which dissolved drug appears. Nucleation parameters can be weakly supported when the sampling schedule misses the induction period or when precipitation is absent in the observed time window. Nucleation and crystal-growth parameters may trade off when the data show only the overall loss of dissolved drug, without enough temporal resolution to distinguish onset from the speed of subsequent removal. Micellar-capacity or exchange parameters may be weakly supported when only total drug is measured and the model predicts little change in that total as drug partitions between free and micelle-bound forms.
Worked Example: Total Concentration Does Not Necessarily Identify Micellar Partitioning
Suppose a hypothetical equilibrium description has total concentration \(C_{\mathrm{tot}}=10\) mg/L, micelle concentration \(M=2\) mM, and micellar partition parameter \(K=0.50\) mM\(^{-1}\). Under the specified relation \(C_{\mathrm{free}}=C_{\mathrm{tot}}/(1+KM)\), the free concentration is
The local derivative of free concentration with respect to \(\log K\), holding total concentration and micelle concentration fixed, is
If the free-concentration assay has an error standard deviation of 0.50 mg/L, its noise-scaled sensitivity is \(-2.50/0.50=-5.00\). That assay is locally responsive to \(K\) under these conditions. By contrast, an assay that reports only the fixed total concentration of 10 mg/L has zero sensitivity to \(K\) in this simplified setup: changing partitioning does not change the reported total. A precise estimate of \(K\) from total-concentration data alone would therefore require information beyond this observation relation, such as a different measurement or informative model assumptions.
Diagnostics, alternatives, and limitations
A useful diagnostic sequence is to scale sensitivities consistently, inspect both their magnitudes and their similarity, and then compute profiles for parameters that appear weak or confounded. Profiles should be evaluated over scientifically plausible ranges, with nuisance parameters re-optimized at every fixed value. Check that the optimizer converges from multiple starting values and that the profile is not an artifact of a parameter bound or a failed optimization. If finite differences are used, repeat them at more than one perturbation size; a derivative that changes substantially with step size is not a reliable local diagnostic.
One-at-a-time perturbations are simpler than the sensitivity matrix, but they can miss parameter compensation because all other parameters remain fixed. Local curvature summarizes nearby behavior efficiently, but relies on a local approximation. Profiling is more computationally demanding and can reveal nonlinear trade-offs, although it still depends on the selected model, objective, parameter bounds, and successful optimization. Collecting measurements at additional times or under conditions that produce different sensitivity patterns can provide more separation than merely increasing precision at already redundant time points.
These tools diagnose support within the chosen model; they do not prove that the model is correct. A parameter may appear precisely estimated because a mechanistic process was omitted, a fixed input was treated as known, or the observation-error model was too restrictive. Nor does weak support mean that the physical process is unimportant. It means the particular data and model combination do not determine that parameter reliably. When support is weak, report the limitation, examine scientifically justified parameter combinations, and avoid interpreting an optimizer’s point estimate as direct evidence.
Check Your Understanding
Answer each question using the definitions and assumptions in this tutorial. Brief solutions follow.
- Why is a sensitivity scaled by observation error and by a proportional parameter change more interpretable than an unscaled derivative?
- Two sensitivity columns have norms of 3.0 and 2.8, but their cosine is 0.999. What does this suggest?
- In a profile calculation, why must the other parameters be re-optimized at each fixed value?
- A profile has a broad flat region, but the optimizer reports a very small standard error. Name a possible diagnostic concern.
- Why might total-concentration observations provide little information about a micellar partition parameter?
Solutions. (1) The scaling expresses prediction change in observation-error units for a proportional parameter change, avoiding dependence on measurement and parameter units. (2) Both parameters affect predictions, but their nearly parallel patterns make their individual effects difficult to distinguish. (3) Re-optimization allows parameter compensation and tests whether the fixed value can still fit the data; holding other parameters fixed answers a different question. (4) The local standard error may rely on an inadequate local approximation, a numerical or optimization issue, or assumptions inconsistent with the broad profile; inspect the profile and optimization diagnostics. (5) If partitioning changes free and bound amounts without changing the measured total, the total has little or no sensitivity to that parameter.