Why Biomarkers Can Disagree
A Phase I biomarker panel may show a clear change in one measurement and little change—or a change in the opposite direction—in another. That pattern is not automatically evidence that the drug has no effect, nor is it proof that one assay is wrong. Biomarkers can represent different places in a biological pathway, respond on different timescales, and have different measurement quality. Several markers may also reflect much of the same underlying biology, so counting results as independent votes can exaggerate the strength of evidence.
The task is to identify what each measurement can support. A target-engagement biomarker, a downstream pharmacodynamic biomarker, and a surrogate biomarker answer different questions. A change in one does not by itself establish a change in the others. The earlier material on biomarker roles, assay performance, sampling windows, baseline and time-course controls, and exposure-response interpretation provides the relevant definitions; here, the emphasis is on reconciling results across a panel.
A Structured Interpretation
Before comparing directions, specify the claim being assessed. For example: “Does the drug engage its intended target?”, “Does target engagement alter a proximal pathway readout?”, or “Is there evidence of a downstream pharmacodynamic response?” A marker can be informative for one question and uninformative for another. A downstream measurement that does not change cannot, by itself, negate a well-measured proximal target-engagement result.
For each marker, establish its pathway position and expected response. A proximal marker is close to the drug target; a downstream marker reflects later biological steps that may involve feedback, compensation, or other influences. Record the expected direction, plausible lag, and whether the marker is expected to change at the dose and exposure observed. These expectations should be based on the intended mechanism and available prior evidence, not chosen after seeing which results look favorable.
Then assess data quality and timing. Confirm that the assay is fit for the observed concentration range, the samples were handled as intended, and baseline and control measurements are available. Compare the sampling times with the expected response course: a sample collected before a delayed response is expected cannot test that delayed response well. Finally, consider whether measurements are correlated and whether the same participants, time points, or sample-processing conditions could produce shared variation.
Separate target engagement, proximal pharmacodynamic change, downstream response, and any claim about clinical benefit.
Write down its biological role, expected direction, and plausible response lag. Do not assume all markers should change together.
Review assay performance, sample handling, baseline, controls, exposure, and uncertainty. A raw before-and-after change alone may include time effects or measurement error.
Decide whether the pattern is biologically coherent, unresolved, or inconsistent with the proposed mechanism. State what is supported and what remains unestablished.
Worked Interpretation
Worked Example: Proximal and Delayed Downstream Responses
Hypothetical data. A drug is expected to inhibit a receptor. Investigators measure receptor occupancy and a proximal phosphorylation marker at 2 hours, then measure a downstream protein at 2 and 24 hours. At the active dose, mean receptor occupancy is 70% at 2 hours. The phosphorylation marker falls by 35% from baseline at 2 hours. The downstream protein changes by 1% at 2 hours and falls by 20% at 24 hours. In placebo participants, the corresponding changes are 2%, 1%, 0%, and 2% in the same order.
For the phosphorylation marker, the placebo-adjusted change is \(-35\%-1\%=-36\) percentage points. For the downstream protein at 24 hours, it is \(-20\%-2\%=-22\) percentage points. At 2 hours, the downstream difference is \(1\%-0\%=1\) percentage point.
The pattern supports target engagement and an early proximal pharmacodynamic response, assuming the assays and sample handling are adequate and exposure is consistent with the intended dose. The near-zero 2-hour downstream difference does not contradict those findings: the sampling time may precede the expected downstream response. The 24-hour difference is consistent with a delayed downstream effect, though its precision and reproducibility still matter. None of these results alone establishes clinical benefit or validates the downstream protein as a surrogate.
Worked Example: A Small Change and an Assay-Limited Result
Hypothetical data. At a scheduled post-dose visit, active-group mean concentration of marker A changes from 50 to 42 ng/L; placebo changes from 50 to 49 ng/L. Marker B changes from 200 to 194 ng/L in the active group and from 200 to 198 ng/L in placebo. Assay validation indicates a coefficient of variation (CV) of 3% for marker A and 9% for marker B over the relevant range. Here, CV is the standard deviation divided by the mean, expressed as a percentage.
For marker A, the active-group change is \((42-50)/50\times100=-16\%\), and the placebo change is \((49-50)/50\times100=-2\%\). The difference in percentage changes is \(-16\%-(-2\%)=-14\) percentage points. For marker B, the corresponding changes are \((194-200)/200\times100=-3\%\) and \((198-200)/200\times100=-1\%\), giving \(-3\%-(-1\%)=-2\) percentage points.
Marker A shows a larger placebo-adjusted change relative to its stated assay CV than marker B does relative to its CV. That contrast makes marker A the clearer measurement signal in this example; it does not prove that marker B is biologically unaffected. An assay CV is not a universal cutoff for deciding whether an effect is real. Group-level uncertainty also depends on sample size and between-participant variability, which are not supplied here. A careful conclusion is that marker A shows a substantial descriptive difference, whereas the small marker B difference is difficult to interpret without its uncertainty and further assay or sampling evidence.
Worked Example: Correlated Biomarkers Are Not Independent Votes
Hypothetical data. Two biomarkers measure closely related inflammatory signals. Their estimated treatment effects, each scaled so that its standard error under the model is 1, are \(-1.8\) and \(-2.0\). The estimated correlation between the two effect estimates is \(0.80\). A third marker from a different pathway branch increases, rather than decreases, after treatment.
The average of the two related estimates is \((-1.8-2.0)/2=-1.9\). If they were independent and each had variance 1, the variance of their average would be \((1+1)/4=0.50\), with standard error \(\sqrt{0.50}=0.707\). But the covariance is \(0.80\), so the actual variance is
The corresponding standard error is \(\sqrt{0.90}=0.949\), not 0.707. Treating the two correlated signals as independent would therefore overstate the precision of their average. The third marker’s opposite direction should be investigated in relation to its pathway role, assay, timing, and uncertainty; it should not simply be outvoted by the two related measurements. The supported conclusion is that the two correlated markers show a consistent pattern, while the broader pathway interpretation remains unresolved until the third result is explained.
Justifying the Correlation Adjustment
The variance calculation above follows from the rule \(\operatorname{Var}(aX+bY)=a^2\operatorname{Var}(X)+b^2\operatorname{Var}(Y)+2ab\operatorname{Cov}(X,Y)\). For an average of two estimates with equal variance 1 and correlation \(\rho\), their covariance is \(\rho\), so
When \(\rho=0\), this is \(0.50\), as for independent estimates. When \(\rho=0.80\), it is \(0.90\): the two measurements contain less independent information than two uncorrelated measurements. This calculation does not say that correlated biomarkers should never be analyzed together. It shows why an analysis that combines them must account for their covariance rather than treating each as a separate, independent confirmation.
Diagnostics, Alternatives, and Limits
Useful diagnostics follow the possible causes of discordance. Inspect assay precision and performance at the observed concentrations, sample handling records, baseline balance, and control-group time trends. Plot individual trajectories as well as group summaries: a mean can conceal participants moving in opposite directions, and repeated observations from one participant are not independent. Check the sampling schedule against the anticipated response lag and compare biomarker changes with exposure where that relationship is relevant. Earlier work on repeated biomarker measures, delayed responses, and model diagnostics supplies methods for these checks; the key here is to apply them to the particular disagreement rather than to treat the panel as a single outcome.
There are several reasonable approaches, each answering a different question. A pathway-based interpretation explains why markers may differ biologically, but depends on a credible mechanism and prior expectations. Marker-by-marker analysis preserves each outcome’s meaning, but can produce a fragmented picture. A composite score can summarize a pre-specified group of related measurements, but may hide opposite effects and must account for scale and correlation. A joint model can represent relationships among biomarkers, but requires enough data and a defensible model structure. None of these approaches makes an uncertain assay or mistimed sample informative by itself.
Common warning signs include a conclusion based on whichever marker is most favorable, treating “not statistically distinguishable from zero” as proof of no effect, and interpreting any opposite-direction result as biological failure. A small estimate may be imprecise; a null-looking value is not necessarily evidence of no meaningful response. Conversely, an apparently strong result can reflect assay artifacts, uncontrolled time trends, or selective interpretation. Results should be described with their units, uncertainty, and comparison group, not just as “positive” or “negative.”
Phase I biomarker panels are generally exploratory and may be small, sparse, or collected at only a few times. Thus, discordance may remain unresolved even after careful review. A defensible report separates the conclusion supported now—such as evidence of target engagement—from the open question, such as whether a downstream pathway response is reproducible. It also avoids inferring clinical benefit from a biomarker change unless that relationship is established for the intended use.
Check Your Understanding
For each question, state the reasoning that supports your conclusion. Concise solutions follow the questions.
- A proximal marker changes at 1 hour, but a downstream marker does not change until 1 hour. What information is needed before treating this as contradictory evidence?
- An active-group marker falls by 12% and a placebo-group marker falls by 4%. What is the placebo-adjusted difference in percentage changes?
- Two standardized biomarker estimates have variance 1 and correlation 0.50. What is the variance of their average?
- Why does a result that is not statistically distinguishable from zero not establish that the biomarker has no response?
- A target-engagement marker changes in the expected direction, but no clinical outcome is measured. What is the strongest conclusion this result alone supports?
Solutions. (1) Establish the downstream marker’s expected lag, its pathway position, assay quality, exposure, and whether later samples were collected. A 1-hour measurement may be too early to assess a delayed response. (2) The difference is \(-12\%-(-4\%)=-8\) percentage points. (3) Using \((1+\rho)/2\), the variance is \((1+0.50)/2=0.75\). (4) The estimate may be imprecise; failure to distinguish it from zero does not show that all meaningful effects are absent. Its uncertainty and the range of effects compatible with the data matter. (5) It supports evidence of target engagement, if the measurement and comparison are credible. It does not by itself establish downstream pharmacodynamic benefit or clinical benefit.