Tutorials › Pharmacokinetic-Pharmacodynamic (PK/PD) Modeling › Evaluating a Biomarker as a Surrogate in a Treatment Case

Worked Case Studies · Tutorial 597 of 598

Evaluating a Biomarker as a Surrogate in a Treatment Case

Learn how to compare biomarker and clinical treatment effects across randomized treatment conditions, quantify the relationship, and judge what the evidence can—and cannot—support about surrogate use.

Advanced 12 min read

What You'll Learn

  • Define paired biomarker and clinical treatment effects with a consistent benefit direction.
  • Distinguish a treatment-effect relationship from an individual-level biomarker–outcome association.
  • Fit and test a regression of clinical effects on biomarker effects across treatment conditions.
  • Calculate a prediction interval and interpret its uncertainty in context.
  • Identify measurement-error, exposure, design, and model limitations that weaken surrogate claims.

What Does It Mean for a Biomarker to Be a Surrogate?

A biomarker can change with treatment and correlate with clinical outcomes without being a reliable substitute for measuring those outcomes. A useful evaluation therefore asks a more demanding question: across randomized treatment conditions, do treatments that produce larger biomarker effects also produce larger clinical benefits? The distinction matters because patients with favorable biomarker values may have better outcomes for reasons unrelated to the treatment effect on the biomarker.

The analysis below uses paired treatment-effect estimates from multiple doses, regimens, or independent studies. Exposure data can help characterize how treatment produces biomarker changes, but observed exposure is not automatically randomized: it can reflect adherence, disease severity, or other patient characteristics. The primary comparison is between treatment effects, not between patients selected for high versus low exposure.

Definition: For treatment condition \(j\), let \(x_j\) be the estimated treatment effect on the biomarker and \(y_j\) the estimated treatment effect on the clinical outcome, each relative to its randomized control. Choose signs so that a positive value represents benefit for both measures. A treatment-effect surrogate analysis asks whether variation in \(x_j\) predicts variation in \(y_j\) across treatment conditions. Prediction is evidence relevant to surrogate use, but by itself does not establish that the biomarker mediates the treatment effect or captures every clinically important pathway.

Pairing is essential: \(x_j\) and \(y_j\) must refer to the same treatment contrast, population, follow-up period, and relevant estimand. For example, a biomarker effect at week 4 should not be paired casually with a clinical effect accumulated over a substantially different period. When exposure-response models are used to estimate treatment effects at particular exposures, the exposure range and the assumptions used to obtain those estimates should also be reported.

Building Comparable Treatment-Effect Pairs

Use a consistent benefit scale before comparing effects. Suppose a biomarker falls when treatment is beneficial and a clinical score rises when patients improve. The biomarker effect can be defined as the control mean minus the treated mean, while the clinical effect is treated minus control. Both are then positive for benefit. Reversing one sign without noticing can make a genuinely concordant pattern look negative.

Worked Example: Constructing Paired Effects From a Dose-Ranging Study

Consider a hypothetical randomized study with placebo, low-dose, and high-dose groups. The biomarker is a concentration for which a reduction is favorable; the clinical measure is an improvement score for which an increase is favorable. The table gives hypothetical group means and mean exposure.

GroupMean exposure (mg·h/L)Mean biomarker change (units)Mean clinical improvement (points)
Placebo002
Low dose2-55
High dose5-86

Define biomarker benefit as the placebo change minus the treated change, and clinical benefit as the treated mean minus the placebo mean. For low dose, \(x_{\mathrm{low}}=0-(-5)=5\) biomarker units and \(y_{\mathrm{low}}=5-2=3\) clinical points. For high dose, \(x_{\mathrm{high}}=0-(-8)=8\) biomarker units and \(y_{\mathrm{high}}=6-2=4\) clinical points. Both treatment contrasts point in the beneficial direction.

The corresponding exposure levels, 2 and 5 mg·h/L, help describe how dose and exposure align with the paired effects. They do not create additional independent treatment-effect pairs. With only two active contrasts, a straight line can pass through both points exactly, leaving no residual degrees of freedom to assess the strength or uncertainty of a relationship. The pattern is compatible with concordance, but it cannot validate the biomarker as a surrogate.

This example also shows why patient-level exposure analyses and treatment-effect analyses answer different questions. A model relating individual exposure to individual outcome may be informative about exposure-response, but high-exposure patients are not necessarily exchangeable with low-exposure patients. For surrogate evaluation, retain the randomized treatment contrasts and make the source of each estimated effect explicit.

Regression Across Treatment Conditions

A simple exploratory model relates the clinical treatment effect to the biomarker treatment effect across \(J\) independent treatment conditions:

$$ y_j=\alpha+\beta x_j+\varepsilon_j,\qquad j=1,\ldots,J. $$

Here \(\alpha\) is the expected clinical treatment effect when the biomarker treatment effect is zero, and \(\beta\) is the expected change in clinical benefit per one-unit increase in biomarker benefit. A positive \(\beta\) indicates that conditions with larger biomarker effects tend to have larger clinical effects. Ordinary least squares estimates \(\alpha\) and \(\beta\) by minimizing the sum of squared residuals.

Model assumptions: For the usual small-sample \(t\) inference, the treatment conditions are independent; the mean relationship is linear over the observed range; errors have mean zero and a common variance; and errors are approximately normally distributed. The basic calculation also treats \(x_j\) as measured without material error. These assumptions are particularly demanding when \(J\) is small or the treatment effects are estimated imprecisely.

A conventional test of association uses \(H_0:\beta=0\). For a prespecified directional question, one may use \(H_a:\beta>0\); otherwise, a two-sided alternative is appropriate. Under the stated model, the slope standard error is \(SE(\hat{\beta})=s/\sqrt{S_{xx}}\), where \(s=\sqrt{\mathrm{SSE}/(J-2)}\), \(\mathrm{SSE}=\sum_j(y_j-\hat y_j)^2\), and \(S_{xx}=\sum_j(x_j-\bar{x})^2\). The test statistic is \(t=\hat{\beta}/SE(\hat{\beta})\), with \(df=J-2\) under \(H_0\).

The standard error follows from the least-squares slope formula. If the \(x_j\) values are treated as fixed and the errors are independent with variance \(\sigma^2\), then

$$ \hat{\beta}=\beta+\frac{\sum_j(x_j-\bar{x})\varepsilon_j}{S_{xx}}, \qquad \operatorname{Var}(\hat{\beta}\mid x)= \frac{\sigma^2\sum_j(x_j-\bar{x})^2}{S_{xx}^2} =\frac{\sigma^2}{S_{xx}}. $$

Replacing \(\sigma\) with the residual standard deviation \(s\) gives the estimated standard error above. This derivation also shows a limitation: little spread in biomarker effects makes \(S_{xx}\) small and the slope imprecise, even if the fitted line appears visually steep.

Worked Example: Testing the Cross-Condition Relationship

Suppose six hypothetical independent randomized treatment conditions yield the following paired effects. Biomarker benefit is in biomarker units; clinical benefit is in clinical-outcome percentage points. Values are displayed to four decimal places.

ConditionBiomarker benefit \(x_j\) (units)Clinical benefit \(y_j\) (percentage points)
121.1693
241.5927
363.1693
484.1693
5104.5927
6126.1693

For these hypothetical data, the fitted line is \(\hat y=-0.0229+0.5000x\). The biomarker effects have mean \(\bar{x}=7\), and \(S_{xx}=(-5)^2+(-3)^2+(-1)^2+1^2+3^2+5^2=70\). The residual sum of squares is approximately \(0.4436\), so \(df=6-2=4\) and

$$ s=\sqrt{\frac{0.4436}{4}}=0.3330,\qquad SE(\hat{\beta})=\frac{0.3330}{\sqrt{70}}=0.03980. $$

Testing \(H_0:\beta=0\) gives \(t=0.5000/0.03980=12.56\) with 4 degrees of freedom. The two-sided \(p\)-value is less than 0.001. A 95% confidence interval for the slope is approximately \(0.5000\pm2.776(0.03980)\), or \((0.3895,0.6105)\) clinical percentage points per biomarker unit. Under the model, these results provide strong evidence of a positive linear association among these six treatment-effect pairs. They do not establish that changing the biomarker causes the clinical benefit.

Prediction and Its Uncertainty

The fitted mean clinical effect at a specified biomarker effect is not the same as the clinical effect expected for a new treatment condition. The latter includes both uncertainty in the estimated regression line and the residual variation of a new condition around that line. For a new condition with biomarker effect \(x_0\), a \(100(1-\alpha)\%\) prediction interval under the regression assumptions is

$$ \hat{y}_0\ \pm\ t_{1-\alpha/2,\ J-2}\, s\sqrt{1+\frac{1}{J}+\frac{(x_0-\bar{x})^2}{S_{xx}}}. $$

The leading 1 inside the square root is the new condition's residual variation. Omitting it produces an interval for the mean response at \(x_0\), which is narrower and answers a different question. A prediction interval applies only to a new condition comparable to those used to fit the model and within a range supported by the observed biomarker effects.

Worked Example: Predicting a Clinical Effect at a Biomarker Effect of 8 Units

Use the six-condition regression above to predict the clinical benefit for a new comparable treatment condition with biomarker benefit \(x_0=8\) units. The fitted value is \(\hat y_0=-0.0229+0.5000(8)=3.9771\) percentage points. With \(J=6\), \(\bar{x}=7\), \(S_{xx}=70\), \(s=0.3330\), and \(t_{0.975,4}=2.776\), the prediction standard error is

$$ 0.3330\sqrt{1+\frac{1}{6}+\frac{(8-7)^2}{70}} =0.3330\sqrt{1+\frac{1}{6}+\frac{1}{70}} =0.3330\sqrt{\frac{124}{105}} \approx 0.3619. $$

Thus the 95% prediction interval is \(3.9771\pm2.776(0.3619)\), which is approximately \((2.972,4.982)\) clinical percentage points. Under the regression assumptions, this procedure has 95% coverage for the clinical effect of a new comparable condition at that biomarker effect. It is not a 95% probability statement about the fixed, unknown effect for this particular condition. The interval is also broad relative to the fitted effect, reflecting the small number of conditions and residual variation.

Diagnostics, Alternatives, and Limits

A positive slope and small \(p\)-value are not sufficient grounds for surrogate use. Inspect a scatterplot of the paired effects and residuals. Curvature can indicate that a linear relationship is inappropriate; a single influential condition can dominate a slope when there are few pairs; and changing residual spread can invalidate the usual standard errors and intervals. Compare the estimated slope with and without influential conditions as a sensitivity analysis, while reporting the full set of conditions rather than deleting points solely to improve the result.

Uncertainty in both axes is an especially important diagnostic concern. Each \(x_j\) and \(y_j\) is usually an estimate, not a known value. Ordinary least squares ignores that uncertainty. Substantial error in \(x_j\) can attenuate the estimated slope toward zero, while differing precision across conditions can make an unweighted fit inefficient or misleading. When available, use the estimated variances and covariance of paired effects in a suitable errors-in-variables or hierarchical analysis. With only a few conditions, however, more elaborate models can be weakly identified; transparent sensitivity analyses may be more informative than a falsely precise result.

The main alternatives answer related but distinct questions. Patient-level mediation analyses examine whether individual biomarker changes relate to individual clinical outcomes, often conditional on treatment and covariates; such associations alone do not establish treatment-level surrogacy. A meta-regression across randomized trials or dose arms targets the treatment-effect relationship directly, but needs enough independent conditions and careful handling of effect-estimate uncertainty. Mechanistic PK/PD models can describe exposure, biomarker response, and clinical response jointly, but model-based predictions still require validation against clinical outcomes and do not turn an association into proof of mediation.

A common mistake is to conclude, “Patients with larger biomarker changes did better, so the biomarker is a valid surrogate.” This confuses an individual-level association with the question of whether treatment effects on the biomarker predict treatment effects on the clinical outcome. Another mistake is to treat a significant cross-condition slope as proof that the treatment acts only through the biomarker. A treatment may affect clinical outcomes through pathways the biomarker does not capture, or a biomarker may track treatment effects in the studied range and fail for a different mechanism or population. A single case can support a provisional prediction claim; stronger surrogate claims require evidence across relevant treatments, settings, and clinical outcomes.

Key takeaway: Evaluate surrogacy using matched, comparable treatment-effect pairs and quantify both the fitted relationship and its prediction uncertainty. Report the scope of the evidence honestly: a predictive association is not, by itself, causal mediation or proof that the biomarker can replace the clinical outcome.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. A biomarker decreases by 4 units under treatment relative to control, and lower values are beneficial. What sign should its biomarker-benefit effect have?
  2. Why can two paired treatment-effect points not provide a residual-based test of a linear relationship?
  3. In the six-condition example, what is the slope standard error, and what does its unit mean?
  4. Why is the prediction interval wider than an interval for the mean clinical effect at the same biomarker value?
  5. Does a significant positive treatment-effect slope prove that the biomarker mediates treatment benefit? Explain.

Solutions. (1) Define benefit as control minus treated, giving a positive effect of 4 units. (2) A line through two distinct points has zero residual sum of squares and leaves \(J-2=0\) residual degrees of freedom, so the residual variance and usual \(t\) test cannot be estimated. (3) \(SE(\hat{\beta})=0.3330/\sqrt{70}=0.03980\) clinical percentage points per biomarker unit; it measures sampling uncertainty in the estimated change in clinical benefit per one-unit increase in biomarker benefit. (4) Prediction uncertainty includes the residual variation of a new treatment condition, represented by the leading 1 under the square root, in addition to uncertainty in the fitted mean. (5) No. The slope supports an association between treatment effects across the observed conditions, but it does not show that the biomarker causally mediates benefit or captures every treatment pathway.

Clinical Biostats