Tutorials › Physiologically-Based Pharmacokinetics (PBPK) › Diagnosing IVIVE Bias with Scaled Clearance Comparisons

In Vitro to In Vivo Extrapolation of Metabolism · Tutorial 362 of 799

Diagnosing IVIVE Bias with Scaled Clearance Comparisons

Use fold errors and residual patterns to evaluate IVIVE predictions, identify plausible sources of bias, and decide what evidence is needed before changing a scaling factor.

Advanced 12 min read

What You'll Learn

  • Define fold error and signed log residual for a scaled clearance prediction.
  • Compare clearances only after matching the prediction and reference endpoints.
  • Distinguish a shared multiplicative bias from compound-specific or trend-related residual patterns.
  • Use residual patterns to prioritize checks without treating them as proof of a particular cause.
  • Recognize why an arbitrary tuning factor can conceal rather than resolve an IVIVE problem.
  • Summarize a comparison with log residuals and a geometric mean fold ratio.

Why Compare Predictions With Reference Clearances?

A scaled in vitro clearance is a model-based prediction, not a direct measurement of a patient's clearance. Comparing it with a suitable in vivo reference helps show whether predictions are systematically too high or too low, whether errors differ across compounds, and which assumptions deserve investigation. The comparison is informative only when the two quantities describe the same clearance process, use compatible units, and refer to the same concentration basis.

A common mismatch is comparing an estimated intrinsic clearance with total systemic clearance as if they were the same quantity. Intrinsic clearance describes the liver's metabolic capacity under specified conditions; systemic clearance can also reflect hepatic blood flow, binding, renal elimination, and other routes. Where a prediction is hepatic intrinsic clearance, convert it to the hepatic clearance endpoint using the stated physiological model before comparing it with an in vivo hepatic reference. If the reference is total systemic clearance, account for other relevant routes or state that the comparison is not direct. A numerical difference alone does not identify an IVIVE bias.

Definition: Let \(CL_{\mathrm{pred}}\) be a scaled in vitro prediction and \(CL_{\mathrm{ref}}\) a compatible in vivo reference clearance, both expressed in the same units and for the same endpoint. The ratio is \(R=CL_{\mathrm{pred}}/CL_{\mathrm{ref}}\). The fold error is \(F=\max(R,1/R)\), so \(F\geq 1\) and reports the multiplicative distance from agreement. The signed log residual is \(e=\ln(R)\): positive values indicate overprediction, negative values underprediction, and zero exact agreement.

For example, \(R=2\) means the prediction is twice the reference, while \(R=0.5\) means it is half the reference. Both have a fold error of 2, but their signed log residuals have opposite signs. The ratio and residual are dimensionless, even though the two clearances used to calculate them have units.

Why Log Residuals Help

Clearance comparisons often involve proportional rather than additive errors. An estimate twice the reference and one half the reference are equally far from agreement on a multiplicative scale. Signed log residuals express that symmetry and make a collection of comparisons easier to summarize.

$$ e=\ln\left(\frac{CL_{\mathrm{pred}}}{CL_{\mathrm{ref}}}\right),\qquad \ln\left(\frac{CL_{\mathrm{ref}}}{CL_{\mathrm{pred}}}\right)=-e $$

The second equality follows because \(\ln(1/R)=-\ln(R)\). Thus reciprocal ratios, such as 2 and 0.5, produce residuals of equal magnitude and opposite sign. For \(m\) compounds, the mean log residual is \(\bar{e}=(1/m)\sum_{i=1}^{m}e_i\). Exponentiating it gives the geometric mean ratio, \(\exp(\bar{e})\), a summary of the shared multiplicative tendency. This summary does not erase individual errors; inspect the individual residuals as well.

Worked Example: Calculating a Fold Error and Signed Residual

Suppose a hypothetical compound has a scaled prediction of \(23.6\ \mathrm{L/h}\) and a compatible in vivo reference clearance of \(20.0\ \mathrm{L/h}\). Calculate the ratio, fold error, and signed log residual.

Ratio. \(R=23.6/20.0=1.180\). The predicted clearance is 1.180 times the reference.

Fold error. \(F=\max(1.180,1/1.180)=\max(1.180,0.8475)=1.180\). Thus the prediction is 1.180-fold from the reference, or 18.0% higher.

Signed log residual. \(e=\ln(1.180)=0.165514\ldots\), which is 0.1655 to four significant figures. The positive sign indicates overprediction. It does not indicate an 0.1655-unit clearance difference: the residual is dimensionless and on the natural-log scale.

Reading Patterns Across Compounds

A single compound can show disagreement, but a set of compounds can reveal whether the disagreement is shared or structured. First calculate each ratio and signed log residual using the same endpoint and the same conventions. Then examine signs, magnitudes, and whether residuals change with a scientifically relevant feature, such as assay type, compound class, or clearance range. Patterns prioritize explanations for investigation; they do not prove a mechanism.

1
Harmonize the comparison.
Confirm that predicted and reference clearances are for the same species, route, endpoint, concentration basis, and units. Make clear whether the prediction is intrinsic, hepatic, or systemic clearance.
2
Calculate residuals consistently.
For every compound, calculate \(R\), \(F\), and \(e=\ln(R)\). Keep the signed residual: a fold error alone cannot distinguish overprediction from underprediction.
3
Look for structure.
Check for a common direction across compounds, clustering by assay or compound characteristics, and trends with clearance magnitude. Flag influential or uncertain reference values rather than letting them silently drive a summary.
4
Investigate before adjusting.
Review the measured input data, binding corrections, scaling quantities, assay conditions, and physiological conversion. Change a factor only when independent evidence supports the change.

Worked Example: Recognizing a Shared Multiplicative Bias

Four hypothetical compounds have predicted and reference hepatic clearances as follows. All quantities are in \(\mathrm{L/h}\).

CompoundPredictedReferenceRatio \(R\)Log residual \(e\)
A20102.000.6931
B40202.000.6931
C60302.000.6931
D80402.000.6931

For compound A, \(R=20/10=2.00\), \(F=2.00\), and \(e=\ln(2.00)=0.6931\). The same calculation applies to B, C, and D. The mean log residual is \(\bar{e}=0.6931\), so the geometric mean ratio is \(\exp(0.6931)=2.00\). All four predictions are twice their references, despite the differences in absolute clearance.

This pattern is consistent with a shared multiplicative issue, such as a common scaling input, unit conversion, or common assay-related factor. It does not establish which explanation is correct. Check the underlying quantities and calculations before applying any correction; four compounds with a shared pattern are evidence to investigate, not permission to halve every prediction.

Patterns That Suggest Where to Investigate

Residuals that group by assay format or batch can motivate checks of assay-specific conditions, enzyme stability, or the inputs used in scaling. A trend with measured binding or a binding-correction input can motivate checking whether the appropriate unbound fraction was measured and applied consistently. A trend with clearance magnitude may indicate that a single proportional adjustment is inadequate, that measurement uncertainty differs across the range, or that a physiological conversion or endpoint mismatch matters. These are candidate explanations, not diagnoses by themselves.

A practical comparison distinguishes three questions: Is there an overall tendency to overpredict or underpredict? Is the magnitude of disagreement similar across compounds? Does the residual vary with a feature that could plausibly affect measurement or scaling? A positive mean residual does not imply every compound is overpredicted, and an overall mean near zero can hide large positive and negative errors that cancel. Displaying individual ratios or residuals is therefore essential.

Worked Example: Interpreting a Clearance-Related Pattern

Consider six hypothetical compounds with compatible reference clearances. The first three have lower reference clearances and the last three higher ones. The table gives each prediction, reference, ratio, and log residual; all clearances are in \(\mathrm{L/h}\).

CompoundReferencePredictionRatioLog residual
A1050.50-0.6931
B20120.60-0.5108
C30150.50-0.6931
D30541.800.5878
E40802.000.6931
F50851.700.5306

For A, \(R=5/10=0.50\) and \(e=\ln(0.50)=-0.6931\), an underprediction by a factor of 2. For E, \(R=80/40=2.00\) and \(e=\ln(2.00)=0.6931\), an overprediction by a factor of 2. In this small illustration, the three lower-clearance compounds have negative residuals and the three higher-clearance compounds positive residuals.

This directional change is a reason to examine the relevant measurements, assay range, and conversion assumptions across the clearance range. It is not evidence that clearance magnitude itself causes the bias, nor enough to identify a specific mechanism. With only six compounds, individual values and uncertainty require particular attention; do not replace the observed pattern with a single adjustment factor.

Alternatives, Diagnostics, and Limitations

Absolute differences, \(CL_{\mathrm{pred}}-CL_{\mathrm{ref}}\), retain clearance units and may be useful when the practical question concerns an absolute amount of clearance. However, the same difference can be small for one compound and large relative to another. Ratios and log residuals are more suitable when proportional discrepancies matter. Fold error summarizes distance from agreement without direction, so it should be reported alongside signed residuals, not instead of them.

A graph of log residual against a relevant covariate can help reveal trends; a table of compound-level ratios can expose outliers and clusters. Neither a visual pattern nor a small average residual validates the prediction. Reference clearances may themselves be uncertain, and comparisons across mismatched endpoints can produce apparent bias even when the in vitro scaling calculation is internally consistent. A modest set of compounds also limits how confidently patterns can be generalized.

When the predictions differ from references, return to traceable inputs: intrinsic clearance estimates, incubation and plasma binding corrections, scaling quantities, units, and the transformation from intrinsic to the reference clearance endpoint. Check that the calculation uses the intended measurements and assumptions. Avoid changing multiple factors at once, because doing so makes it difficult to learn which change addressed the discrepancy.

Common pitfall: “Every prediction is about twofold high, so I will divide the scaling factor by two.” The correction is to treat the pattern as a diagnostic signal, not as proof. First rule out unit and endpoint mismatches, inspect the inputs and assumptions, and seek independent evidence for a particular factor. A tuned value that matches the current compounds can conceal a wrong mechanism and perform poorly for new compounds.
Key takeaway: Compare like with like, retain the direction of each residual, and look for systematic structure across compounds. Fold errors and log residuals describe the discrepancy; they do not, on their own, identify its cause or justify tuning a scaling factor.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A prediction is \(12\ \mathrm{L/h}\) and a compatible reference is \(24\ \mathrm{L/h}\). Find the ratio, fold error, and signed log residual. What is the direction of error?
  2. Why is a comparison between intrinsic clearance and total systemic clearance not automatically an interpretable measure of IVIVE bias?
  3. Across several compounds, all ratios are close to 1.5. What does this suggest, and what does it not establish?
  4. Why should compound-level signed residuals be inspected even when the mean log residual is near zero?
  5. Predictions are low for one assay batch and high for another. Give one appropriate next step and explain why changing a scaling factor immediately is not justified.

Solutions. 1. \(R=12/24=0.50\), \(F=\max(0.50,2.00)=2.00\), and \(e=\ln(0.50)=-0.6931\). The prediction is twofold low. 2. Intrinsic and systemic clearance are different endpoints; systemic clearance can include physiological limits and nonhepatic routes. The prediction must be converted to a compatible endpoint, or the mismatch stated. 3. A shared ratio near 1.5 suggests a common multiplicative overprediction pattern. It does not identify which measurement, assumption, or scaling input is responsible. 4. Positive and negative residuals can cancel in the mean while individual errors remain substantial or patterned. 5. Check batch-specific assay conditions, inputs, and scaling calculations, then assess whether the batch pattern is supported by the data. A factor change without evidence could hide the batch issue and need not generalize to other compounds.