Why a Cross-Species Prediction Needs an Uncertainty Budget
A translational prediction is not just a central estimate. It is an estimate tied to a target, such as a population geometric mean exposure at a specified dose or the exposure of a future individual. Different sources of uncertainty affect those targets in different ways. Combining them without distinction can produce an interval that is too wide, too narrow, or simply about the wrong quantity.
Here, consider a hypothetical prediction of human AUC from preclinical information and a translational model. AUC is measured in mg·h/L. The numerical examples use log AUC, which is useful when errors are approximately multiplicative: a fixed log-scale difference corresponds to a fixed ratio on the original scale. The target is always stated explicitly, because uncertainty in a human population mean is not the same as variation in AUC among individual people.
What the Components Mean
The labels in an uncertainty budget are useful only when their meanings are operationally clear. In particular, sources that arise from the same data must not be counted twice.
- Parameter uncertainty is uncertainty in the values of fitted model parameters, conditional on the chosen model structure and the data and analysis used to estimate them. It propagates into the prediction because different plausible parameter values can imply different predictions.
- Sampling uncertainty is uncertainty arising because the observed source-species sample is finite and could have differed under another sample from the same sampling process. For a practical budget, this must be defined separately from parameter uncertainty—for example, as uncertainty in a source-species sample summary not already included in the fitted-parameter covariance.
- Measurement uncertainty arises from imperfect measurement of inputs, such as assay error in observed concentrations or uncertainty in a recorded covariate. It affects the prediction through the model’s dependence on those inputs.
- Interindividual variability is real variation among people in the target population, such as differences in clearance. It is variability, not uncertainty about the population mean. It belongs in a prediction for a future individual, not automatically in an interval for the population mean.
- Structural uncertainty reflects uncertainty about the form of the model—for example, whether a plausible relationship is linear or curved on the chosen scale. It concerns alternative model structures, not just alternative parameter values within one structure.
- Model discrepancy is the difference between the selected model’s predictions and the underlying system, even if the model parameters were known exactly. It represents inadequacy not captured by the chosen model, and should be informed by relevant data or a defensible calibration rather than added as an arbitrary safety margin.
The boundary between components depends on the analysis. For example, if the uncertainty in a sample summary has already been propagated into parameter uncertainty, adding it again as a separate sampling term double-counts it. A defensible budget states what each term includes and excludes.
Worked Example: Assigning Uncertainty to the Right Component
Suppose a hypothetical cross-species analysis uses a fitted translation model to predict human AUC. The model’s parameter covariance gives a log-scale prediction standard deviation of 0.12. A source-species summary has an additional standard error of 0.08, explicitly excluded from that covariance. Replicate assay data imply a log-scale measurement contribution of 0.06. Across a target human population, the log-scale standard deviation of individual AUC is estimated as 0.30. Two plausible model forms also produce different predictions, while validation suggests residual model inadequacy of about 0.10 on the log scale.
The fitted-model contribution of 0.12 is parameter uncertainty. The separate 0.08 is sampling uncertainty only because the analysis specifies that it is not already included in the parameter covariance. The 0.06 measurement contribution is distinct if it represents error in inputs not already corrected for or propagated elsewhere. The 0.30 is interindividual variability; it is relevant for a future person, but not for the uncertainty of the population geometric mean by itself. Differences between plausible equations represent structural uncertainty, while the validation-based 0.10 represents model discrepancy conditional on the chosen equation.
These labels do not establish that the values can safely be combined. That also requires a common scale, a clear target, and a justified account of dependence. The next example makes those assumptions explicit.
Combining Contributions on a Common Scale
Let \(Z\) be the log of an exposure divided by one stated exposure unit, so the logarithm is dimensionless. A local approximation to a prediction can be written as a central log prediction plus contributions from uncertainty sources. If those contributions have mean zero, are independent, and have standard deviations \(s_1,\ldots,s_k\), their variances add. The result is an approximate standard deviation for the prediction on the log scale.
The variance rule follows by expanding the variance of a sum. For two contributions \(U\) and \(V\), \(\operatorname{Var}(U+V)=\operatorname{Var}(U)+\operatorname{Var}(V)+2\operatorname{Cov}(U,V)\). Repeating this for \(k\) contributions gives a variance sum plus all pairwise covariance terms. Independence makes each covariance zero, yielding the displayed rule. Thus, independence is an assumption to assess, not a consequence of putting terms in separate rows.
A normal approximation on the log scale gives a range of the form \(\hat{z}\pm1.96\,SE_{\text{total}}\) for a central 95% interval under the stated model and assumptions. Exponentiating the endpoints gives an interval on the original scale. Its interpretation depends on the target: an interval for a population geometric mean reflects uncertainty in that mean; a predictive interval for a future individual must also include interindividual variability. These are model-based intervals, not guarantees that the model is correct.
Worked Example: Budget for a Human Population Geometric Mean
For a hypothetical drug, suppose the predicted human population geometric mean AUC is 100 mg·h/L. On the log scale, the estimated contributions for uncertainty in this mean are: parameter 0.12, sampling 0.08, measurement 0.06, structural 0.15, and model discrepancy 0.10. Assume these terms are approximately normal, independent, and defined so that none duplicates another. Do not include interindividual variability, because the target is the population geometric mean rather than an individual patient’s AUC.
The central log prediction is \(\hat{z}=\ln(100)=4.6052\), where the numerical value is expressed relative to 1 mg·h/L. The total variance is
Therefore, the total log-scale standard error is \(\sqrt{0.0569}=0.2385\). The approximate 95% interval on the log scale is
Exponentiating gives \([\exp(4.1377),\exp(5.0727)]\), or approximately \([62.7,\ 159.6]\) mg·h/L. Under the assumed uncertainty model, this interval describes uncertainty about the predicted human population geometric mean AUC. It does not say that 95% of individual patients’ AUC values lie within those limits.
From a Mean Prediction to an Individual Prediction
A future individual’s exposure differs from the population geometric mean partly because people vary, even if the population mean were known. If log-scale interindividual variability is approximately normal with standard deviation \(\sigma_{\mathrm{IIV}}\), and it is independent of the other contributions, then its variance is added for an individual prediction. If it is correlated with other terms, the covariance must also be considered.
Worked Example: Adding Interindividual Variability for a Future Person
Continue the hypothetical example. Suppose the log-scale interindividual standard deviation is 0.30, and assume it is independent of the five contributions in the population-mean budget. For a future individual, the total variance becomes \(0.0569+0.30^2=0.1469\), so the total standard deviation is \(\sqrt{0.1469}=0.3833\).
Using the same central prediction, the approximate log-scale predictive interval is
Exponentiating gives approximately \([47.2,\ 212.0]\) mg·h/L. This range is wider than the interval for the population geometric mean because it includes real between-person variation as well as uncertainty in the prediction. It is a model-based predictive interval for an individual drawn from the stated target population, conditional on the assumptions and the specified dose and setting.
Dependence, Diagnostics, and Alternative Summaries
The independence calculation can be misleading when contributions share data or mechanisms. For example, uncertainty in a source-species summary and uncertainty in fitted parameters may move together. If two log-scale contributions have standard deviations \(s_1\) and \(s_2\) and correlation \(\rho\), their combined variance is \(s_1^2+s_2^2+2\rho s_1s_2\). Positive dependence increases the combined variance relative to an independence calculation; negative dependence decreases it.
Worked Example: Correcting an Independence Assumption
Suppose the parameter contribution of 0.12 and the sampling contribution of 0.08 in the population-mean example are positively correlated with \(\rho=0.50\). All other contributions remain independent of these two and of one another. The covariance contribution to the total variance is
The revised total variance is \(0.0569+0.0096=0.0665\), and its square root is \(0.2579\). The approximate log interval is \(4.6052\pm1.96(0.2579)=[4.0997,\ 5.1107]\). Exponentiating gives approximately \([60.3,\ 165.8]\) mg·h/L. The positive covariance widens the interval compared with the independent-components result of approximately \([62.7,\ 159.6]\) mg·h/L.
Useful diagnostics focus on whether the budget’s pieces are credible and appropriately separated:
- Check that every term refers to the same prediction target, scale, dose, and time horizon.
- Trace each component back to data, model comparisons, or an explicit elicitation. A number with no supporting rationale is not made reliable by appearing in a variance sum.
- Check for double counting, especially when parameter uncertainty already includes finite-sample uncertainty or measurement error.
- Assess dependence when components use shared data or represent linked mechanisms. If dependence is unknown, report sensitivity to plausible covariance assumptions rather than silently setting every covariance to zero.
- Compare the resulting interval with observed prediction errors or external validation where available. Poor coverage or systematic residual patterns can indicate that model discrepancy is underestimated or that the assumed model is inadequate.
A variance budget is not the only approach. A local, analytic budget is transparent and efficient when contributions are approximately additive on the chosen scale and covariance can be specified. Simulation can instead draw jointly from uncertain inputs and models, preserving nonlinear transformations and specified dependence; its output is only as credible as those distributions and model alternatives. A scenario analysis reports predictions under several plausible structures without forcing them into a single normal variance. It can be easier to interpret when there are only a few meaningful alternatives, but it does not by itself assign probabilities to them. These approaches can complement one another.
| Approach | Useful when | Main limitation |
|---|---|---|
| Analytic uncertainty budget | Contributions can be represented on a common scale and combined with known covariance | Can conceal poor assumptions about independence or normality |
| Joint simulation | Transformations are nonlinear or dependencies and distributions are explicitly specified | Cannot repair unsupported input distributions or an inadequate model |
| Structural scenarios | A small number of plausible model forms are of direct interest | Results depend on which scenarios are included; a single interval may not be justified |
Common Mistakes and Practical Limits
A frequent error is to add standard deviations directly. For independent contributions, variances—not standard deviations—add: \(0.12\) and \(0.08\) combine to \(\sqrt{0.12^2+0.08^2}=0.1442\), not \(0.20\). Another is to include interindividual variability in an interval for a population mean, or to omit it when the target is an individual prediction. Both errors change the question the interval answers.
A further limitation is that a compact budget can make uncertain judgments look precise. Structural uncertainty and model discrepancy are especially difficult to estimate from sparse preclinical data. Nor does a wide interval necessarily protect against an omitted mechanism: uncertainty quantification describes sources that have been represented, and cannot automatically reveal ones that were overlooked. The budget should therefore be accompanied by a clear target, assumptions, component definitions, and sensitivity checks. It supports translational reasoning; it does not establish that animal-to-human translation is valid.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions below.
- A prediction targets the human population geometric mean. Should interindividual variability automatically be included in its uncertainty interval? Explain.
- Two independent log-scale contributions have standard deviations 0.10 and 0.20. What is their combined standard deviation?
- A sampling contribution has standard deviation 0.08 and a parameter contribution has standard deviation 0.12, with correlation 0.50. Calculate their combined standard deviation.
- Why can adding assay measurement uncertainty as a separate term be wrong if parameter uncertainty already propagated the assay error?
Solutions. (1) No. Interindividual variability describes differences among people and belongs in an individual predictive interval; it is not automatically uncertainty in the population geometric mean. (2) The combined standard deviation is \(\sqrt{0.10^2+0.20^2}=\sqrt{0.05}=0.2236\) on the log scale. (3) The variance is \(0.08^2+0.12^2+2(0.50)(0.08)(0.12)=0.0064+0.0144+0.0096=0.0304\), so the combined standard deviation is \(\sqrt{0.0304}=0.1744\). (4) The same measurement error would be counted twice: once through the parameter uncertainty and again through the separate measurement term. Define component boundaries before combining them.