Tutorials › Physiologically-Based Pharmacokinetics (PBPK) › Presenting Sensitivity and Uncertainty for Regulatory Review

PBPK in Regulatory Submissions · Tutorial 793 of 799

Presenting Sensitivity and Uncertainty for Regulatory Review

Present sensitivity and uncertainty results in ways that make assumptions, influential inputs, and the scope of prediction intervals transparent to regulatory reviewers.

Intermediate 11 min read

What You'll Learn

  • Define and report local parameter sensitivity using a normalized finite-difference measure.
  • Explain when local sensitivity rankings may be inadequate and how global analyses complement them.
  • Describe uncertainty distributions, dependencies, and their propagation to model predictions.
  • Distinguish uncertainty in model inputs from variability among individuals.
  • Present prediction intervals with their conditioning assumptions and limitations.
  • Choose tables and plots that let reviewers trace results to assumptions.

Why Sensitivity and Uncertainty Need Separate Reporting

A PBPK prediction is conditional on a model structure, parameter values, scenario assumptions, and a defined population or individual. A reviewer therefore needs more than a single predicted value. They need to see which inputs matter for the reported outcome, how uncertain inputs were represented, and how that uncertainty affects the prediction. The presentation should also make clear what the analysis does not represent: uncertainty in selected inputs is not the same as differences among people, and neither automatically captures limitations in model structure.

This reporting supports interpretation of the analysis for its stated context of use. It is not a substitute for reporting verification or validation evidence, and it should not imply that a prediction is more certain simply because it is displayed with a precise number of decimal places.

Definition: Sensitivity describes how a specified model output changes when one or more inputs change under a defined analysis. Input uncertainty describes incomplete knowledge about values or distributions used in the model. Variability describes real differences across individuals, occasions, or other units represented by the model. A prediction interval summarizes a specified range of predicted values under stated sources of uncertainty or variability; its interpretation depends on which sources were included.

Before presenting any sensitivity ranking or interval, identify the output, units, population, dosing or exposure scenario, and calculation method. For example, “the predicted maximum plasma concentration in adults after the specified dose” is interpretable; “the model output” is not. State whether results are conditional on a fixed set of parameters, propagated over uncertain parameter values, simulated over individuals, or generated by combining these sources.

Reporting Parameter Influence

A simple local sensitivity analysis changes one input around a reference value while holding other inputs fixed. For a positive parameter \(\theta_j\) and positive output \(Y\), a normalized local sensitivity, also called an elasticity, can be approximated by a central finite difference:

$$ S_j \approx \frac{\left[Y(\theta_j(1+\delta))-Y(\theta_j(1-\delta))\right]/Y_0}{2\delta} $$

Here \(Y_0\) is the output at the reference parameter set, and \(\delta\) is the fractional perturbation. This quantity is dimensionless. Near the reference value, it estimates the percentage change in \(Y\) associated with a 1% change in \(\theta_j\). A positive value indicates that increasing the parameter tends to increase the output locally; a negative value indicates the reverse. The magnitude indicates local responsiveness, not the parameter’s uncertainty or its overall contribution to prediction uncertainty.

This interpretation relies on a sufficiently small perturbation and a locally smooth response. The selected perturbation should be reported: a ranking can change with perturbation size, especially near thresholds or nonlinear regions. For parameters with meaningful bounds, the perturbations must remain within those bounds. A one-at-a-time analysis also holds all other inputs fixed, so it cannot reveal interactions between inputs.

Worked Example: Calculating and Ranking Local Sensitivities

In a hypothetical analysis, the reference predicted \(C_{\max}\) is 4.00 mg/L. Two parameters are perturbed by 10% in each direction, with all other inputs fixed. For clearance \(CL\), the predictions are 4.35 mg/L at 10% below reference and 3.70 mg/L at 10% above reference. For an absorption-rate parameter \(k_a\), the corresponding predictions are 3.82 mg/L and 4.18 mg/L.

For \(CL\), the central sensitivity is:

$$ S_{CL} \approx \frac{(3.70-4.35)/4.00}{0.20} = \frac{-0.1625}{0.20} = -0.8125 $$

The values are ordered as \(Y(\theta(1+\delta))\) minus \(Y(\theta(1-\delta))\). Thus, near the reference value, a 1% increase in \(CL\) corresponds to an estimated 0.813% decrease in \(C_{\max}\).

For \(k_a\):

$$ S_{k_a} \approx \frac{(4.18-3.82)/4.00}{0.20} = \frac{0.0900}{0.20} = 0.450 $$

By absolute local sensitivity, \(CL\) is more influential than \(k_a\) for this output at this reference point: \(0.8125 > 0.450\). This does not establish that uncertainty in \(CL\) contributes more to prediction uncertainty. That conclusion also depends on the plausible ranges and distributions of both parameters.

A useful regulatory table reports the parameter name, physiological or model role, unit, reference value, perturbation range, resulting output values, sensitivity measure, and evidence or rationale for the range. Include the output definition and reference scenario in the table caption or accompanying text. Report the direction as well as the magnitude; a list of absolute sensitivities alone hides whether an increase in an input raises or lowers the prediction.

Local one-at-a-time analysis is useful for transparent screening. If the model is nonlinear over plausible ranges, parameters interact, or the input distribution is broad, supplement it with a global analysis that varies multiple inputs over their stated distributions or ranges. A global ranking answers a different question: how much an input contributes to output variation across the chosen input space, under the specified sampling and dependence assumptions. State the method and assumptions rather than presenting a ranking as universal. A ranking is specific to the output, scenario, input ranges, and method used.

Propagating Input Uncertainty

Uncertainty propagation carries specified uncertainty in model inputs through the PBPK model to produce a distribution of predictions. A distribution should have a traceable basis: data, literature, expert elicitation, or an explicit assumption. Report its form and parameters, units, bounds, and any dependence with other inputs. If an input is fixed because no distribution was available, say so; a fixed value does not mean that the value is known without uncertainty.

The following linear calculation illustrates why uncertainty in an output depends both on sensitivity and on input uncertainty. Suppose a model output is \(Y=2\theta_1+\theta_2\), where \(Y\) is in mg/L and the two normalized inputs are dimensionless. Assume independent normal inputs, \(\theta_1\sim N(10,1^2)\) and \(\theta_2\sim N(4,2^2)\). Under these assumptions, the mean and variance follow from linearity and independence:

$$ E(Y)=2E(\theta_1)+E(\theta_2)=2(10)+4=24\ \text{mg/L} $$
$$ \operatorname{Var}(Y)=2^2\operatorname{Var}(\theta_1)+\operatorname{Var}(\theta_2) =4(1^2)+2^2=8\ (\text{mg/L})^2 $$

The variance formula follows because the variance of a linear combination includes covariance terms; independence makes the covariance zero. If the inputs were correlated, the additional term \(2(2)(1)\operatorname{Cov}(\theta_1,\theta_2)\) would be required. For the stated normal, linear, independent-input example, the output is normal with standard deviation \(\sqrt{8}=2.828\) mg/L. Its central 90% interval is:

$$ 24 \pm 1.645(2.828) = [19.35,\ 28.65]\ \text{mg/L} $$

Worked Example: Interpreting an Input-Uncertainty Interval

Consider the hypothetical calculation above. The inputs represent uncertain parameter values, not a sample of different individuals. The 90% interval from 19.35 to 28.65 mg/L is therefore a range for the model output induced by those parameter distributions, conditional on the specified model and linear relationship.

The assumptions are explicit: the inputs have the stated normal distributions, are independent, and enter the output linearly. Under those assumptions the calculation is exact. A nonlinear PBPK output may not have a normal distribution, and a first-order approximation may be inadequate. In that case, propagate draws from the specified joint input distribution through the model and report the resulting output quantiles, along with the number of simulations and relevant numerical checks.

The interval is not a 90% confidence interval for a parameter, and it does not say that there is a 90% probability that a fixed true value lies in this particular interval. It summarizes the modeled output distribution resulting from the stated input uncertainty.

Separate Uncertainty, Variability, and Model Limitations

In a PBPK analysis, input uncertainty might concern an uncertain enzyme abundance or a tissue partition parameter. Variability might concern differences in body weight or enzyme activity among individuals in the target population. A simulation that draws an uncertain population-level parameter once per simulation is not equivalent to a simulation that draws an individual-specific value for each simulated person. The sampling level and interpretation should be stated.

If both sources are relevant, show them separately where feasible: for example, a distribution of population predictions from parameter uncertainty, and a distribution across simulated individuals conditional on a given parameter set. A combined distribution can be useful, but label the included sources and explain how they were combined. Do not call the combined range an “uncertainty interval” if it also contains between-individual variability without qualification.

A model limitation is different again. It may include a biological process that is absent, a weakly supported mechanism, or a population outside the model’s well-supported scope. Unless a limitation is represented through explicit alternative model structures or other quantified scenarios, it is not captured by a parameter uncertainty interval. Describe such limitations alongside the numerical results, including the potential direction or consequence when it can be reasoned through. Do not imply that a wide interval automatically accounts for every model limitation.

Worked Example: Reporting Scenario Results and Population Variability

A hypothetical PBPK analysis predicts an exposure ratio for two explicitly defined physiological scenarios. In Scenario A, 1,000 simulations propagate uncertainty in selected parameter inputs. The simulated ratio has a 5th percentile of 1.20, a median of 1.60, and a 95th percentile of 2.20. In Scenario B, the same procedure gives 1.50, 2.00, and 2.80. These are scenario-specific prediction summaries from input uncertainty; the stated percentiles define the reported central 90% ranges.

The interval widths are \(2.20-1.20=1.00\) for Scenario A and \(2.80-1.50=1.30\) for Scenario B. Scenario B has both a higher median and a wider reported range. The difference should be attributed to the scenario assumptions only if the analysis changed those assumptions as specified and held the other analysis choices consistent; the scenario definitions and any other changed inputs must be documented.

Separately, suppose a simulation across individuals under fixed population-level parameters gives a 5th, 50th, and 95th percentile of 0.90, 1.50, and 2.40. This describes simulated population variability under that fixed parameter set, not uncertainty in the scenario-specific parameter values. It should be reported separately unless a combined distribution is deliberately constructed. A reviewer should not be asked to infer that distinction from the percentiles alone.

Tables, Plots, and Diagnostics for Review

A compact table can make assumptions auditable. For each uncertain input, report its role, unit, reference or central value, distribution or range, evidence basis, dependencies, and whether it represents uncertainty or individual variability. A second table can summarize outputs by scenario, including units, median or mean as appropriate, interval definition, and the sources propagated. Keep scenario labels explicit and define abbreviations.

A tornado plot is useful for a local one-at-a-time analysis when it shows the reference prediction and the low- and high-input predictions, not only a ranked bar length. Label the perturbation and the output units. For propagated uncertainty, a distribution plot or quantile plot can show shape, skewness, multiple modes, and tail behavior that a mean and standard deviation would conceal. A scenario comparison plot should use a common scale and show the scenario-specific prediction summaries without visually conflating input uncertainty and population variability.

Diagnostics should check whether the reported summaries describe the simulation output adequately. Inspect distributions and tails, confirm that sampled inputs remain within intended bounds, examine parameter dependence, and verify that simulations converged or that Monte Carlo precision is adequate for the reported quantiles. For local sensitivity, repeat calculations at a smaller and larger perturbation when practical; substantial ranking changes signal nonlinearity or scale dependence. Check whether the result is driven by a small number of extreme draws. If it is, report that feature and investigate its source rather than silently truncating the distribution.

1
Define the prediction.
Name the endpoint, units, population, and scenario before presenting a sensitivity or interval.
2
Classify each input.
Identify fixed assumptions, uncertain parameters, and sources of individual variability, including their evidence and dependence structure.
3
Choose and document the analysis.
State local or global sensitivity methods, perturbations or distributions, simulation details, and interval definition.
4
Show results with limitations.
Present interpretable tables or plots, diagnostics, scenario differences, and model limitations not quantified by the analysis.

No single display is sufficient for every purpose. Local sensitivity is relatively easy to explain and trace, but it is tied to a reference point and may miss interactions. Global sensitivity can reflect broad ranges and interactions but depends on the selected joint input distribution and attribution method. Deterministic scenario analysis is transparent for discrete assumptions but does not, by itself, assign probabilities to scenarios. Choose the approach that answers the stated question and explain what it leaves unresolved.

Common Reporting Pitfalls

  • Equating influence with uncertainty contribution. A parameter can have high sensitivity but a narrow plausible range. Report sensitivity and input uncertainty separately.
  • Calling every range a prediction interval. State whether it comes from parameter uncertainty, individual variability, both, or a deterministic scenario range.
  • Hiding assumptions behind a distribution. A probability distribution is not self-justifying. Give its evidence basis, bounds, and dependence assumptions.
  • Overinterpreting precision. Many reported digits do not remove uncertainty in inputs, model structure, or simulation estimates.
  • Treating model limitations as quantified uncertainty. State limitations that were not represented in the propagated inputs or alternative scenarios.
Key takeaway: A review-ready sensitivity and uncertainty presentation links every result to a defined output and scenario, shows how inputs were varied or sampled, separates uncertainty from variability, and makes unquantified model limitations visible.

Check Your Understanding

Answer each question, then compare your reasoning with the solution immediately following it.

  1. A parameter has a local normalized sensitivity of \(-0.6\). What does this mean near the reference value, and what does it not establish?
    Solution: Near the reference value, a 1% increase in the parameter corresponds approximately to a 0.6% decrease in the specified output. It does not establish the parameter’s uncertainty or its contribution to total prediction uncertainty.
  2. Why should a report state whether an interval includes population variability?
    Solution: An interval from uncertainty in parameter values and an interval across individuals answer different questions. Without stating included sources, readers cannot interpret the range as either uncertainty in the model prediction or variation among individuals.
  3. A parameter is highly influential in a local sensitivity analysis but is known within a narrow range. Can it be assumed to dominate output uncertainty?
    Solution: No. Influence measures response to a change, while uncertainty contribution also depends on the plausible range or distribution of the input and its dependence on other inputs.
  4. A simulation uses a fixed value for a poorly supported process because no distribution was available. What should the report say about the resulting interval?
    Solution: It should state that uncertainty in that process was not propagated and identify the fixed assumption as a limitation. The interval cannot be described as covering that unrepresented uncertainty.
  5. In a local sensitivity report, what information helps a reviewer reproduce and interpret the ranking?
    Solution: Report the output and scenario, reference parameter values, perturbation size and direction, resulting predictions, sensitivity formula, parameter units, and any relevant bounds or diagnostics.