Tutorials › Quantitative Systems Pharmacology (QSP) › Diagnosing Identifiability with Spatial Data

Spatial and Agent-Based Approaches · Tutorial 235 of 799

Diagnosing Identifiability with Spatial Data

Use sensitivities across space and time to diagnose which transport, reaction, and binding parameters spatial data can distinguish.

Advanced 12 min read

What You'll Learn

  • Define local parameter identifiability using a sensitivity matrix for spatial observations.
  • Explain why a steady spatial profile may confound transport and reaction rates.
  • Assess whether time points and locations add distinct information about binding.
  • Distinguish structural rank deficiency from practical near-confounding.
  • Use scaled sensitivities and measurement uncertainty to interpret information.
  • Choose spatial, temporal, and bound-fraction measurements to improve separation.

Why spatial identifiability needs more than a good fit

A spatial model can reproduce measured profiles while leaving its parameters uncertain. For example, a shallow concentration gradient might arise from rapid transport combined with rapid loss, or from slower transport combined with slower loss. A fitted curve alone does not show whether the data distinguish those explanations. Identifiability analysis asks whether plausible changes in individual parameters produce distinguishable changes in the observations.

Here the focus is on comparing parameter sensitivities across locations and sampling times. The aim is not to establish that a model is correct, but to find out which parameter combinations the planned spatial measurements can inform. This is especially important when transport, reaction, and binding all affect a measured concentration profile.

A model and a local sensitivity diagnostic

Consider a one-dimensional tissue segment with free signal concentration \(c(x,t)\). Suppose binding is rapid, reversible, unsaturated, and spatially uniform, so that bound signal acts as a buffer that slows changes in free concentration. A simple reduced model is

$$ R\frac{\partial c}{\partial t} = D\frac{\partial^2 c}{\partial x^2}-kc. $$

Here \(D\) is an effective diffusion coefficient with units of length squared per time, \(k\) is a first-order loss rate with units of inverse time, and \(R\) is a dimensionless retardation factor representing equilibrium binding capacity. This reduced representation assumes that binding equilibrates faster than the resolved changes in concentration. It does not represent saturation, spatially varying binding sites, or binding kinetics that are slow relative to transport and sampling.

Definition: For observation \(i\), let \(h_i(\boldsymbol{\theta})\) be the model-predicted measurement at a specified location and time, where \(\boldsymbol{\theta}\) is the parameter vector. The local sensitivity to parameter \(\theta_j\), on a relative parameter scale, is $$ S_{ij}=\frac{\partial h_i}{\partial \log \theta_j}. $$ If the measurement is positive and analyzed on a log scale, use \(h_i=\log c(x_i,t_i)\). Sensitivities show how predicted observations change for small percentage changes in parameters. Parameters are locally distinguishable only if their sensitivity patterns across observations are sufficiently different.

For observations with different scales or measurement errors, it is useful to weight sensitivities. If observation \(i\) has standard deviation \(\sigma_i\) on the scale being fitted, define \(J_{ij}=S_{ij}/\sigma_i\). Under independent, approximately Gaussian measurement errors with known variances, \(J^\mathsf{T}J\) is the local Fisher information matrix. Correlated errors require a covariance-based weighting instead. A small eigenvalue of the information matrix signals a parameter combination that produces little change relative to the observation noise.

These are local diagnostics: derivatives are evaluated at a particular parameter estimate. Full column rank is evidence that small changes in each parameter can be distinguished locally, under regularity conditions. It does not prove that there is only one parameter set giving the observations globally. Conversely, an exact rank deficiency means that at least one local parameter direction cannot be resolved by those observations.

Why steady spatial profiles can confound parameters

For a steady profile with fixed boundary concentration \(c_0\), the reduced model gives \(D c_{xx}-kc=0\). On a semi-infinite domain, the decaying solution is \(c(x)=c_0\exp[-x\sqrt{k/D}]\). Defining \(z=x\sqrt{k/D}\), the log-concentration sensitivities are

$$ \frac{\partial \log c}{\partial \log D}=\frac{z}{2}, \qquad \frac{\partial \log c}{\partial \log k}=-\frac{z}{2}, \qquad \frac{\partial \log c}{\partial \log R}=0. $$

Thus every steady spatial measurement has the same sensitivity direction for \(D\) and \(k\): increasing both by the same percentage leaves their ratio, and therefore this profile, unchanged. The steady data also contain no information about \(R\) in this model, because the time-derivative term vanishes. Adding locations can improve precision on the gradient, but cannot by itself separate parameters whose sensitivity columns remain proportional.

Worked Example: A Steady Profile Does Not Separate Transport and Loss

Suppose a hypothetical experiment measures free concentration at two positions. At the fitted parameter values, the positions correspond to \(z=1\) and \(z=2\). Use the steady-profile sensitivities to form the matrix for parameters \((\log D,\log k,\log R)\).

At \(z=1\), the row is \((0.5,-0.5,0)\). At \(z=2\), it is \((1,-1,0)\). Therefore

$$ S= \begin{pmatrix} 0.5 & -0.5 & 0\\ 1 & -1 & 0 \end{pmatrix}. $$

The second row is twice the first, so the matrix has rank one, not three. For a small 10% increase in both \(D\) and \(k\), the approximate change in either log concentration is \(0.5(0.10)-0.5(0.10)=0\) at the first position and \(1(0.10)-1(0.10)=0\) at the second. Neither more precision at these same steady conditions nor extra steady locations resolves the ratio confounding. The data can inform \(k/D\), but cannot separately identify \(D\), \(k\), and \(R\) from these measurements.

Use locations and times that change the sensitivity pattern

Transient observations can carry information that steady observations lack. In the model, \(R\) multiplies the time derivative, so the approach to steady state depends on binding retardation. Measurements at different times may therefore respond differently to \(R\), \(D\), and \(k\). Spatial locations also matter: a measurement near a source may be sensitive to delivery or boundary conditions, while a measurement farther away may be more sensitive to the shape and propagation of the profile. Which effect dominates depends on the model and experimental conditions; it should be checked using the fitted model rather than assumed.

A practical local analysis proceeds by calculating sensitivities at the proposed sampling locations and times, scaling parameters on a relative scale, and accounting for measurement error. Sensitivities can be computed by differentiating the model equations or by finite differences. For example, a centered finite-difference estimate for a log-parameter sensitivity is

$$ S_{ij}\approx \frac{h_i(\theta_j e^\delta)-h_i(\theta_j e^{-\delta})}{2\delta}, $$

with other parameters held fixed. The perturbation \(\delta\) should be small enough to approximate a derivative but large enough to avoid numerical round-off. Check that the result is stable to reasonable changes in \(\delta\), and verify that it is not a mesh or solver artifact. Earlier material on mesh convergence and spatial boundary artifacts is relevant because numerical errors can masquerade as sensitivity.

Worked Example: Adding Transient Measurements Restores Local Rank

Suppose hypothetical finite-difference calculations at a fitted parameter set give the following log-concentration sensitivities. The first row is a steady observation at \(z=1\); the other rows are transient observations at different location-time combinations. These illustrative values are not universal model properties.

$$ S= \begin{pmatrix} 0.5 & -0.5 & 0\\ 0.4 & -0.2 & -0.3\\ 0.2 & -0.1 & -0.6 \end{pmatrix}. $$

The determinant is

$$ \det(S) =0.5[(-0.2)(-0.6)-(-0.3)(-0.1)] +0.5[(0.4)(-0.6)-(-0.3)(0.2)] =0.045-0.090=-0.045. $$

Because the determinant is nonzero, this three-by-three matrix has full rank. In this local example, the three observation patterns can distinguish small changes in \(D\), \(k\), and \(R\). This is not yet evidence that the estimates will be precise: if the measurements are noisy, or if the matrix is poorly conditioned, uncertainty can still be large. It does show why adding appropriately timed observations can contribute a new sensitivity direction that steady profiles do not provide.

Rank is not the same as practical identifiability

With finite precision, nearly proportional sensitivity columns can be almost as problematic as exactly proportional ones. Rank reports whether a direction is mathematically absent; conditioning and uncertainty report whether it is useful in practice. Examine singular values of the error-weighted matrix \(J\), parameter correlations from the local covariance approximation when its assumptions are reasonable, and changes in predictions over plausible parameter ranges. Do not rely on rank alone.

Worked Example: Near-Confounding Despite Full Rank

Consider three hypothetical relative sensitivities at three sampled locations and times:

$$ S= \begin{pmatrix} 0.50 & -0.49 & -0.02\\ 0.80 & -0.78 & -0.05\\ 1.00 & -0.98 & -0.03 \end{pmatrix}. $$

The \(D\) and \(k\) columns are nearly opposite. A simultaneous 10% increase in \(D\) and \(k\) gives the first-order changes \(0.10(0.50-0.49)=0.001\), \(0.10(0.80-0.78)=0.002\), and \(0.10(1.00-0.98)=0.002\) in the three log predictions. These correspond to roughly 0.1%, 0.2%, and 0.2% changes, respectively, far below a hypothetical 2% measurement error. Although small numerical differences may make the matrix formally full rank, the data would not practically distinguish that paired parameter change.

Suppose an additional measurement of bound fraction has relative sensitivities \((0.05,0.02,0.90)\). A 10% increase in \(R\) alone then changes its prediction by approximately \(0.90(0.10)=0.09\), or 9% on the log scale to first order. If that measurement is sufficiently precise and the model represents binding appropriately, it supplies direct information about binding that the nearly confounded free-concentration profiles lacked.

Diagnostics, alternatives, and limitations

A sensitivity analysis is only as credible as its observation model, parameterization, and numerical implementation. Check that parameters are scaled sensibly: derivatives with respect to raw parameters can make parameters with different units appear incomparable. Check the finite-difference step, solver tolerances, spatial mesh, boundary conditions, and whether measurement errors vary by location or time. A sensitivity pattern that changes markedly with mesh refinement or small numerical settings should not be interpreted biologically.

Compare candidate designs by stacking their weighted sensitivity rows and inspecting the resulting information matrix or singular values. Adding nearby locations is useful when it changes the sensitivity pattern or reduces measurement uncertainty; it is not automatically useful if the new rows repeat existing patterns. Likewise, early-time samples, later-time samples, and bound-fraction assays are alternatives to consider, not guaranteed solutions. Their value depends on the model, assay precision, and feasible sampling schedule.

Sensitivity matrices are a local, derivative-based approximation. They may miss nonlinear or distant alternative parameter sets, and uncertainty approximations based on \(J^\mathsf{T}J\) can be unreliable when the model is strongly nonlinear, parameters are near bounds, or errors are non-Gaussian or correlated but untreated. Profile likelihoods or simulation-based parameter recovery can complement the local diagnosis when these issues matter. They answer related but not identical questions: sensitivities reveal local directions of change, while broader analyses examine behavior beyond that local neighborhood.

A common mistake is to conclude that a parameter is identified because a model fits many spatial points. The number of observations alone does not determine identifiability. If all those points respond to two parameters in almost the same way, the data mainly constrain a combination of them. The correction is to compare sensitivity columns across the actual locations and times, include measurement uncertainty, and seek measurements or perturbations that produce distinct responses.

Key takeaway: Spatial identifiability depends on the diversity and precision of the sensitivity patterns, not just the density of the sampling grid. Steady profiles can confound transport and loss, while transient or binding-specific measurements may add the directions needed to separate them.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. In the reduced model, why does a steady free-concentration profile contain no sensitivity to \(R\)?
  2. If two sensitivity columns are exact multiples, what does that imply about locally distinguishing the corresponding parameters?
  3. Why can a full-rank sensitivity matrix still indicate poor practical identifiability?
  4. Name two numerical checks to make before interpreting finite-difference sensitivities.
  5. Would adding many more steady locations necessarily separate \(D\) from \(k\) in the stated semi-infinite model? Explain.

Solutions. (1) At steady state \(\partial c/\partial t=0\), so the term multiplied by \(R\) vanishes. (2) The columns describe proportional effects across observations, so at least one local parameter combination cannot be separated. (3) A small singular value can indicate that some parameter combination changes predictions by less than the measurement noise, despite formal full rank. (4) Vary the finite-difference step and check solver tolerances or mesh convergence; also verify boundary handling. (5) No. Each steady sensitivity row has the same \(D\)-versus-\(k\) direction, so additional locations can refine the gradient estimate without breaking the confounding.

Clinical Biostats