Tutorials › Quantitative Systems Pharmacology (QSP) › Resolving Conflicting Preclinical and Clinical Evidence

Calibrating to Multiple Data Sources · Tutorial 602 of 799

Resolving Conflicting Preclinical and Clinical Evidence

Learn to separate unit or measurement mismatches from a genuine cross-scale potency difference, and to quantify the predictive consequences of plausible reconciliations.

Advanced 13 min read

What You'll Learn

  • Audit concentration units and distinguish nominal, total, and unbound exposure.
  • State assumptions needed to compare preclinical and clinical response measurements.
  • Calculate the clinical predictions implied by alternative exposure and potency reconciliations.
  • Recognize when calibration data identify only a parameter ratio, not its separate components.
  • Use residual patterns and targeted measurements to assess whether a reconciliation is credible.

Why Conflicting Evidence Needs an Audit Before a Reconciliation

Preclinical and clinical dose–response data can appear inconsistent even when each source is internally coherent. One source may report nominal concentration while another reports total plasma concentration; the sources may differ in unbound fraction, endpoint definition, sampling time, or assay scale. A fitted curve can absorb such differences into a potency parameter, but that does not establish that the biological potency actually changed.

The practical task is to make the comparison explicit: identify what concentration and response each observation represents, state the assumptions that connect sources, and calculate what each plausible reconciliation predicts. The aim is not to force agreement. If unit conversion and measurement checks do not account for the discrepancy, the remaining difference is evidence that the assumed cross-scale relationship may be inadequate.

Definition: A reconciliation is an explicit set of unit conversions, measurement mappings, or cross-scale parameter assumptions used to place evidence from different sources on a comparable basis. It is a modeling assumption to be checked against data, not a correction that is automatically true because it improves fit.

Set Up the Comparison on a Common Scale

Consider a hypothetical preclinical assay and clinical biomarker analysis for the same drug. Both report inhibition as a percentage of a common reference response, with larger values meaning greater inhibition. For illustration, suppose the response follows a simple saturating concentration–response relationship:

$$ R(C)=E_{\max}\frac{C}{EC_{50}+C}. $$

Here \(R(C)\) is inhibition in percentage points at the concentration \(C\), \(E_{\max}\) is the maximum inhibition in percentage points, and \(EC_{50}\) is the concentration producing half of \(E_{\max}\). This is a descriptive model for the examples, not a claim that every QSP response follows this curve.

A direct comparison requires more than matching the printed concentration units. It assumes the concentration has the same meaning in both sources, the response is on a comparable scale and direction, and the concentration is relevant to the response measurement at the stated time. It also assumes the chosen response model is adequate over the compared range. If any of these assumptions is doubtful, test it before attributing the discrepancy to a potency shift.

For the examples below, assume the clinical endpoint has been mapped to the same percentage-inhibition scale as the assay, and that its observations are paired with the relevant concentration measurements. These are hypothetical data constructed to illustrate the calculations; they are not results from a real study.

Worked Example: Converting Nominal Assay Concentration to Unbound Concentration

Suppose a preclinical assay reports concentrations of 25, 100, and 400 nM, with inhibitions of 16, 40, and 64 percentage points. The fitted assay curve has \(E_{\max}=80\) percentage points and a nominal \(EC_{50}=100\) nM. An assay measurement indicates that the unbound fraction is \(f_{u,\mathrm{assay}}=0.20\). Calculate the corresponding unbound concentrations and the unbound-scale \(EC_{50}\).

Under the assumption that the measured unbound fraction applies across this concentration range, unbound concentration is \(C_u=f_{u,\mathrm{assay}}C_{\mathrm{nominal}}\). Thus the three unbound concentrations are \(0.20(25)=5\) nM, \(0.20(100)=20\) nM, and \(0.20(400)=80\) nM. The corresponding curve predictions are:

$$ 80\frac{5}{20+5}=16,\qquad 80\frac{20}{20+20}=40,\qquad 80\frac{80}{20+80}=64 \quad\text{percentage points}. $$

The data therefore agree with \(E_{\max}=80\) and \(EC_{50,u}=20\) nM on the unbound scale. This conversion does not change the observations; it changes the concentration scale used to express the potency. It is valid only if the unbound fraction is measured appropriately for the assay conditions and is applicable to the observations.

Compare the Clinical Evidence and Candidate Explanations

Suppose the clinical data report total plasma concentrations of 20, 50, and 100 nM, with inhibition of 40, 57.1, and 66.7 percentage points. To compare these with the preclinical unbound-scale potency, suppose the clinical unbound fraction is estimated as \(f_{u,\mathrm{clinical}}=0.50\). If that estimate is correct and potency transfers unchanged, clinical unbound concentrations are 10, 25, and 50 nM. Applying the preclinical \(EC_{50,u}=20\) nM gives predictions of 26.7, 44.4, and 57.1 percentage points, respectively.

Those predictions are below the clinical observations at all three concentrations. This is a systematic discrepancy, not a unit conversion by itself. Several explanations remain possible: the clinical concentration is not represented by the assumed total-to-unbound mapping; clinical potency differs from preclinical potency; or the response measurements are not actually on the same scale. Each explanation implies different evidence to check.

One useful way to write the concentration mapping is \(C_u=qC_{\mathrm{total}}\), where \(q\) is the effective fraction of the reported clinical total concentration represented as relevant unbound concentration. Under the unchanged-response model,

$$ R(C_{\mathrm{total}}) =E_{\max}\frac{qC_{\mathrm{total}}}{EC_{50,u}+qC_{\mathrm{total}}} =E_{\max}\frac{C_{\mathrm{total}}}{EC_{50,u}/q+C_{\mathrm{total}}}. $$

Consequently, a curve observed against total concentration identifies the ratio \(EC_{50,u}/q\), not \(EC_{50,u}\) and \(q\) separately. A better curve fit cannot, on its own, decide whether exposure mapping or potency is responsible.

Worked Example: Quantifying the Unreconciled Difference

Use the clinical observations above and assume, for this descriptive calculation, that \(q=0.50\), \(E_{\max}=80\), and \(EC_{50,u}=20\) nM. Calculate predictions and residuals, defining residual as observed minus predicted.

At 20 nM total, the mapped concentration is \(0.50(20)=10\) nM. The predicted response is \(80(10)/(20+10)=26.67\) percentage points, giving residual \(40.0-26.67=13.33\) percentage points. At 50 nM total, the mapped concentration is 25 nM, so the prediction is \(80(25)/(20+25)=44.44\); the residual is \(57.1-44.44=12.66\) percentage points. At 100 nM total, the mapped concentration is 50 nM, so the prediction is \(80(50)/(20+50)=57.14\); the residual is \(66.7-57.14=9.56\) percentage points.

All three residuals are positive, which is consistent with the clinical observations lying above the unchanged-potency predictions across this range. As a rough scale check only, if each observation had an independent measurement standard deviation of 5 percentage points, the residuals divided by 5 would be approximately 2.67, 2.53, and 1.91 standard deviations. This calculation is not a formal hypothesis test: it omits parameter uncertainty and relies on the stated illustrative error assumptions. Its purpose is to quantify the discrepancy, not to assign it a cause.

Two Reconciliations Can Fit but Mean Different Things

The observed clinical curve has an apparent \(EC_{50}\) of 20 nM when plotted against total plasma concentration: at 20 nM, the response is 40 percentage points, half of the assumed \(E_{\max}=80\). There are at least two ways to reproduce that curve while retaining the same saturating response form.

  • Exposure-mapping reconciliation: set \(q=1.00\), with \(EC_{50,u}=20\) nM. This treats each reported total concentration as the relevant concentration scale.
  • Potency-shift reconciliation: retain \(q=0.50\), but set the clinical \(EC_{50,u}=10\) nM. This retains the assumed unbound fraction while allowing a twofold lower clinical unbound \(EC_{50}\).

Both choices give the same total-concentration \(EC_{50}\): the first gives \(20/1=20\) nM, and the second gives \(10/0.50=20\) nM. They therefore make identical predictions at every clinical total concentration under this model. The first changes the exposure mapping; the second changes the potency parameter. This exact equivalence means these clinical concentration–response observations alone cannot distinguish the explanations.

Worked Example: Comparing Predictions at a Higher Concentration

Calculate the predicted clinical inhibition at a total concentration of 200 nM under three assumptions: (1) the original unbound fraction and unchanged preclinical potency, (2) exposure-mapping reconciliation, and (3) potency-shift reconciliation.

Under assumption (1), \(C_u=0.50(200)=100\) nM and \(EC_{50,u}=20\) nM, so \(R=80(100)/(20+100)=66.67\) percentage points. Under assumption (2), \(q=1.00\) and \(EC_{50,u}=20\) nM, so \(R=80(200)/(20+200)=72.73\) percentage points. Under assumption (3), \(q=0.50\) and \(EC_{50,u}=10\) nM, so \(R=80(100)/(10+100)=72.73\) percentage points.

The two reconciled explanations agree with one another, but predict 6.06 percentage points more inhibition than unchanged preclinical potency with \(q=0.50\). The reconciliations do not establish which prediction is biologically correct; they quantify the consequence of the different assumptions. Predictions outside the observed concentration range also depend more strongly on the assumed curve shape and maximum response.

Check the Measurements That Could Break the Tie

When alternatives fit equally well, the next step is not to choose the more appealing explanation. It is to look for measurements that inform the assumptions on which they differ. In this example, a direct assessment of the clinical unbound fraction under relevant conditions bears on \(q\). An independent preclinical or clinical potency measurement on a matched unbound scale bears on \(EC_{50,u}\). Repeated or orthogonal assessment of the response mapping can reveal whether a shared percentage-inhibition scale is defensible.

Audit the data and model for practical failure modes before interpreting either reconciliation:

  • Unit errors: confirm concentration units and prefixes. For example, \(0.050\) µM is 50 nM; treating it as 0.050 nM creates a thousandfold error.
  • Different concentration meanings: record whether each value is nominal, total, or unbound, and which matrix or assay conditions inform the conversion. A fraction measured in one matrix is not automatically valid in another.
  • Response-scale mismatch: check baseline, direction, denominator, and whether the endpoint is a percentage, a change from baseline, or a transformed measure. Matching labels do not guarantee matching scales.
  • Timing mismatch: establish whether the concentration measurement represents the exposure relevant to the response. A single concentration may not summarize a response driven by a preceding time course.
  • Systematic residual patterns: inspect whether discrepancies change with concentration, time, study, or protocol. A constant direction may signal a scale offset; a concentration-dependent pattern may indicate that the chosen curve or conversion is inadequate.

These checks help distinguish a measurement conflict from model misfit, but they cannot guarantee that the assumed Emax form or cross-scale mapping is correct. A good fit to the available points is not proof of a unique biological explanation. Calibration conclusions should remain conditional on the data, endpoint mapping, and exposure assumptions used.

Comparison and Limitations

ApproachWhat it assumesWhat it can establish here
Unit and measurement auditConversions and endpoint mappings can be checked against source information or measurements.Whether an apparent conflict could arise from inconsistent units or definitions.
Exposure-mapping reconciliationThe discrepancy is explained by the relation between reported concentration and relevant concentration.Predictions conditional on a chosen mapping; it does not prove that mapping is correct.
Potency-shift reconciliationThe exposure mapping is retained, while clinical potency differs from preclinical potency.Predictions conditional on a potency change; it does not identify why potency differs.
Unchanged-potency comparisonPreclinical potency transfers and the specified exposure mapping is correct.The size and pattern of disagreement under those assumptions.

A limitation of this comparison is structural: because \(EC_{50,u}\) and \(q\) enter through their ratio on the total-concentration scale, these data cannot estimate both independently without additional information or constraints. More flexible reconciliation choices may improve apparent agreement while adding assumptions that the observations do not identify. The appropriate conclusion is therefore a set of conditional predictions and the evidence needed to discriminate among them, not an unqualified declaration that one source is correct.

Key takeaway: Align the meaning and units of concentration and response before interpreting cross-source disagreement. Then quantify each defensible reconciliation, state what it assumes, and identify what additional measurement could distinguish alternatives that fit the same observations.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. An assay reports a nominal \(EC_{50}\) of 60 nM and an applicable unbound fraction of 0.25. What is the unbound-scale \(EC_{50}\)?
  2. For \(E_{\max}=80\), \(EC_{50,u}=20\) nM, and \(q=0.50\), what response is predicted at 60 nM total concentration?
  3. Why can clinical total-concentration data fail to distinguish a change in \(q\) from a change in \(EC_{50,u}\)?
  4. Name one measurement that could help distinguish exposure-mapping reconciliation from potency-shift reconciliation.

Solutions. (1) \(0.25(60)=15\) nM. (2) The relevant concentration is \(0.50(60)=30\) nM, so \(R=80(30)/(20+30)=48.0\) percentage points. (3) The curve against total concentration depends on the ratio \(EC_{50,u}/q\); different pairs with the same ratio produce the same predictions. (4) A direct measurement of the relevant clinical unbound fraction could inform \(q\); an independent potency measurement on a matched unbound scale could inform \(EC_{50,u}\).

Clinical Biostats