Tutorials › Biostatistics › Biomarker-Stratified Trial Designs

Biomarker & Precision Medicine

Biomarker-Stratified Trial Designs

A practical guide to designing and analyzing clinical trials that incorporate biomarker-defined populations, including stratified randomization, enrichment designs, predictive versus prognostic biomarkers, treatment-by-biomarker interaction, subgroup treatment effects, sample-size considerations, multiplicity, missing biomarker status, and regulatory interpretation.

Intermediate 22 min read

What You'll Learn

  • What a biomarker-stratified clinical trial is
  • How prognostic and predictive biomarkers differ
  • How stratified randomization differs from biomarker enrichment
  • How treatment-by-biomarker interaction is evaluated
  • How sample size and multiplicity change with biomarker subgroups
  • How to implement biomarker analyses in R

Introduction

Modern clinical development increasingly asks not only whether a treatment works, but which patients are most likely to benefit. Biomarkers can help identify biologically defined populations and can therefore play an important role in clinical-trial design.

A biomarker may be a genomic alteration, protein expression measurement, pathway marker, immune marker, imaging characteristic, or another measurable biological characteristic.

When biomarker information is incorporated prospectively into trial design, the resulting study can be described as a biomarker-stratified trial.

The term encompasses several different designs, however. A trial may enroll patients regardless of biomarker status but stratify randomization by biomarker subgroup. Another trial may restrict enrollment to biomarker-positive patients. A more complex design may evaluate several biomarker-defined subgroups simultaneously and formally test whether treatment effects differ between them.

Key idea: A biomarker can play several distinct statistical roles. It can be used for randomization stratification, population selection, subgroup description, or as a candidate predictive treatment-effect modifier. These roles should not be confused.

What Is a Biomarker-Stratified Trial?

Suppose a trial evaluates an experimental treatment versus control and patients are classified according to a binary biomarker:

$$ B= \begin{cases} 1,&\text{biomarker-positive}\\ 0,&\text{biomarker-negative} \end{cases} $$

The study therefore contains two biomarker-defined populations:

  • Biomarker-positive: \(B=1\)
  • Biomarker-negative: \(B=0\)

Treatment can then be represented by:

$$ T= \begin{cases} 1,&\text{experimental treatment}\\ 0,&\text{control} \end{cases} $$

A biomarker-stratified design asks whether the treatment effect is consistent across these groups and, when scientifically justified, whether it differs according to biomarker status.

Why Use Biomarkers?

A biomarker can contribute to trial design for several reasons.

Purpose Example
Prognostic information Identifies patients with different expected outcomes regardless of treatment
Predictive information Identifies patients who may have different relative treatment effects
Eligibility criterion Only biomarker-positive patients are enrolled
Randomization stratification Treatment assignment is balanced within biomarker strata
Subgroup analysis Treatment effects are estimated separately by biomarker status
Companion diagnostic strategy A validated assay identifies patients eligible for a targeted therapy

Prognostic vs. Predictive Biomarkers

One of the most important distinctions in biomarker research is between prognostic and predictive effects.

Prognostic Biomarker

A prognostic biomarker is associated with the clinical outcome independently of the treatment being evaluated.

For example, suppose biomarker-positive patients have longer progression-free survival than biomarker-negative patients in both treatment groups.

The biomarker may be prognostic.

Predictive Biomarker

A predictive biomarker modifies the relative effect of treatment.

For example, suppose the experimental treatment substantially improves outcome among biomarker-positive patients but provides little or no benefit among biomarker-negative patients.

That pattern suggests a potential treatment-by-biomarker interaction.

Critical distinction: A biomarker being associated with better prognosis does not establish that it predicts treatment benefit. Predictive utility concerns whether the relative treatment effect differs according to biomarker status.

An Example of Prognostic and Predictive Effects

Figure 1. Biomarker-Stratified Treatment Effects
Illustrative hazard-ratio estimates for biomarker-positive and biomarker-negative populations. The example demonstrates a treatment effect that is substantially stronger in the biomarker-positive subgroup.
Estimated treatment effect
95% confidence interval

Illustrative data only. A hazard ratio below 1 favors the experimental treatment for a time-to-event endpoint.

The Interaction Is the Key Question

Suppose the treatment effect among biomarker-positive patients is:

$$ HR_{+}=0.55 $$

and among biomarker-negative patients:

$$ HR_{-}=1.00 $$

The important scientific question is not simply whether:

$$ HR_{+}<1 $$

or whether:

$$ HR_{-}\geq1 $$

The central question is whether the treatment effect differs between the two biomarker groups.

That is an interaction question.

Formal Treatment-by-Biomarker Interaction

For a continuous outcome, a simple model might be:

$$ Y= \beta_0+ \beta_1T+ \beta_2B+ \beta_3(T\times B)+\epsilon $$

Here:

  • \(\beta_1\) represents the treatment effect when \(B=0\).
  • \(\beta_2\) represents the biomarker-group difference under \(T=0\).
  • \(\beta_3\) represents the treatment-by-biomarker interaction.

If:

$$ \beta_3\neq0 $$

there is evidence that the treatment effect differs according to biomarker status.

For Binary Endpoints

For a binary endpoint, logistic regression can be used:

logit{
  P(Y = 1)
}
=
β0 +
β1*T +
β2*Biomarker +
β3*T*Biomarker

The interaction coefficient \(\beta_3\) assesses whether the treatment effect on the log-odds scale differs between biomarker groups.

For Time-to-Event Endpoints

For survival endpoints, a Cox proportional-hazards model may include:

h(t) =
h0(t) *
exp(
  β1*T +
  β2*Biomarker +
  β3*T*Biomarker
)

The interaction coefficient provides a formal assessment of whether the treatment hazard ratio differs by biomarker subgroup under the model.

Important: A statistically significant treatment effect in one subgroup and a non-significant treatment effect in another subgroup does not by itself establish treatment-effect heterogeneity. The appropriate comparison is the treatment-by-biomarker interaction.

Why "Significant in One Group, Not Significant in the Other" Is Not Enough

Consider:

$$ p_{+}=0.01 \qquad p_{-}=0.20 $$

It is tempting to conclude that treatment works only in the biomarker-positive group.

That conclusion can be incorrect.

The two p-values answer different questions:

  • Is treatment effective within the positive group?
  • Is treatment effective within the negative group?

Neither directly answers:

$$ H_0: \text{Treatment effect}_{+} = \text{Treatment effect}_{-} $$

That requires an interaction or another appropriate heterogeneity analysis.

Three Major Biomarker Trial Strategies

Biomarker-driven trials can be broadly organized into several designs.

1
All-comers design: enroll patients regardless of biomarker status and analyze biomarker-defined subgroups.
2
Biomarker-stratified design: enroll multiple biomarker groups and incorporate biomarker status into randomization and/or analysis.
3
Enrichment design: restrict enrollment to patients with a prespecified biomarker characteristic.

All-Comers Design

In an all-comers design, both biomarker-positive and biomarker-negative patients are eligible.

The biomarker may be measured at baseline and used for subgroup analysis.

The primary analysis can target the entire population:

$$ H_0: \theta_T=\theta_C $$

while biomarker-defined effects may be secondary or supportive analyses.

This design can be useful when the treatment is expected to benefit a broad population or when evidence for biomarker restriction is not sufficiently established.

Biomarker-Stratified Randomization

Suppose biomarker-positive patients are expected to have different baseline risk from biomarker-negative patients.

Simple randomization could, by chance, produce an imbalance in biomarker composition between treatment arms.

Stratified randomization reduces this risk by randomizing separately within biomarker strata.

For example:

Biomarker stratum Experimental Control
Positive Approximately balanced Approximately balanced
Negative Approximately balanced Approximately balanced

The result is better treatment balance within each important biomarker stratum.

Stratified Randomization Does Not Prove Predictive Value

This distinction is easy to overlook.

If a trial stratifies randomization by biomarker status, that means investigators considered biomarker status important for treatment assignment balance.

It does not mean the biomarker has been established as predictive.

Design principle: A stratification factor is a design variable. A predictive biomarker is a scientific hypothesis about treatment-effect heterogeneity. They are related, but they are not interchangeable concepts.

Enrichment Designs

An enrichment design limits enrollment to a selected biomarker population.

For example:

$$ B=1 $$

may be required for eligibility.

The trial therefore estimates the treatment effect in the biomarker-positive population directly.

Potential advantages include:

  • Greater biological homogeneity
  • Potentially larger treatment effect
  • Smaller required sample size for a targeted effect
  • Direct evaluation of a biomarker-defined treatment strategy

Potential disadvantages include:

  • Reduced generalizability
  • Difficulty establishing benefit outside the selected group
  • Dependence on assay performance
  • Potentially slower recruitment if the biomarker-positive population is uncommon

Biomarker Prevalence Matters

Suppose a biomarker is positive in only 20% of the target population.

If the trial requires 300 biomarker-positive participants, approximately:

$$ \frac{300}{0.20}=1500 $$

patients may need to be screened, assuming the prevalence estimate applies to the screened population and there are no additional screening failures.

The actual number can be substantially higher because assay failures, ineligibility, inadequate tissue, and other screening factors may occur.

Screening Failure Is a Design Consideration

A biomarker-driven program therefore needs to consider:

  • Biomarker prevalence
  • Assay failure rate
  • Turnaround time
  • Insufficient tissue
  • Indeterminate biomarker results
  • Screening dropout
  • Changes in testing platform

These operational issues can directly affect enrollment duration and study feasibility.

Biomarker Assay Performance

The statistical design cannot be separated completely from the assay.

Important assay characteristics include:

Characteristic Why it matters
Analytical sensitivity Can low biomarker levels be reliably detected?
Analytical specificity Can positive results be distinguished from negatives?
Reproducibility Would repeated testing classify the patient consistently?
Cutoff definition Where is positive versus negative defined?
Sample adequacy Can the biomarker be measured reliably in available specimens?
Central vs local testing Could testing location introduce classification differences?

Continuous Biomarkers

Not all biomarkers should necessarily be converted into a binary positive or negative variable.

Suppose:

$$ B=0,1,2,\ldots,100 $$

represents a continuous biomarker score.

Dichotomizing the biomarker at an arbitrary cutoff can discard information.

For example:

$$ B\geq50 $$

might be labeled positive, while:

$$ B<50 $$

is labeled negative.

Patients with values of 49 and 1 are then treated as members of the same category despite potentially very different biology.

Best practice: If a continuous biomarker is scientifically plausible, consider whether its continuous form should be retained for modeling. If a categorical cutoff is used, the cutoff should generally be prespecified or supported by a well-controlled development strategy rather than selected after examining the treatment results.

Biomarker Cutoffs

Cutoffs can be based on:

  • Established clinical thresholds
  • Analytical validation
  • Biological rationale
  • Previously validated evidence
  • Prespecified development criteria

Data-driven cutoff selection within the pivotal trial can inflate the apparent strength of evidence if not appropriately accounted for.

Binary Biomarker Example

Suppose a biomarker score is:

Patient Biomarker score Classification
001 82 Positive
002 67 Positive
003 41 Negative
004 25 Negative

If the prespecified cutoff is 50, the classification is:

$$ B= I(Biomarker\ Score\geq50) $$

Stratified Randomization With More Than One Factor

Trials frequently stratify randomization using multiple factors.

For example:

  • Biomarker status
  • Disease stage
  • Prior therapy
  • Geographic region

If every combination is used as a separate stratum, the number of strata can increase rapidly.

For example, four binary factors generate:

$$ 2^4=16 $$

possible combinations.

With five binary factors:

$$ 2^5=32 $$

possible combinations arise.

If some strata contain very few patients, treatment balance within each individual stratum may become difficult to maintain.

Centralized Randomization and Minimization

For complex trials, centralized allocation procedures or minimization methods may be considered to achieve balance across several prognostic factors.

The appropriate randomization strategy depends on the trial design, operational platform, number of stratification factors, and statistical considerations.

Primary Analysis in an All-Comers Trial

Suppose the primary endpoint is overall survival.

The primary treatment comparison might be estimated in the full randomized population:

$$ HR_{overall} = \frac{\text{Hazard under treatment}} {\text{Hazard under control}} $$

Biomarker-defined analyses can then estimate:

$$ HR_{+} \qquad\text{and}\qquad HR_{-} $$

The interpretation depends on the role of the biomarker in the prespecified analysis plan.

Interaction Testing

A treatment-by-biomarker interaction test evaluates:

$$ H_0:\beta_{TB}=0 $$

against:

$$ H_A:\beta_{TB}\neq0 $$

where \(\beta_{TB}\) is the treatment-by-biomarker interaction coefficient.

A small interaction p-value provides evidence that the treatment effect differs between biomarker groups.

A non-significant interaction test does not prove identical treatment effects, particularly when subgroup sample sizes are small.

Why Interaction Tests Can Have Low Power

Detecting treatment-effect heterogeneity generally requires more information than detecting an overall treatment effect.

Suppose the overall treatment effect is substantial:

$$ HR=0.70 $$

but the difference between biomarker groups is modest.

The study may have adequate power for the overall treatment comparison but insufficient power to demonstrate an interaction.

Important: "Not statistically significant for interaction" should not automatically be interpreted as "the treatment effect is identical in all biomarker groups." The width of the confidence interval and the amount of information in each subgroup are essential to interpretation.

Sample Size for Biomarker-Stratified Designs

Sample-size planning must reflect the actual inferential objective.

Different objectives produce different requirements:

Objective Sample-size driver
Overall treatment effect Overall event rate/effect size and target power
Effect in biomarker-positive group Positive-group prevalence, effect size, and required information
Effect in both biomarker groups Information required separately in each group
Interaction Magnitude of treatment-effect difference and information in both groups
Enrichment design Number of eligible biomarker-positive patients required

A Simple Event-Count Illustration

For a two-arm time-to-event comparison, the required number of events depends primarily on the targeted hazard ratio, significance level, and power. A commonly used approximation is:

$$ D \approx \frac{ (z_{1-\alpha/2}+z_{1-\beta})^2 }{ [\log(HR)]^2 \times p(1-p) } $$

where:

  • \(D\) = required number of events
  • \(p\) = allocation proportion to treatment
  • \(\alpha\) = type I error
  • \(\beta\) = type II error
  • \(HR\) = target hazard ratio

This expression is illustrative; practical sample-size calculations also need to account for accrual, follow-up, censoring, stratification, and other design features.

Biomarker Prevalence and Total Sample Size

Suppose the biomarker-positive prevalence is \(q\).

If an enriched trial requires \(N_+\) biomarker-positive patients, the approximate number screened is:

$$ N_{screen} \approx \frac{N_+}{q} $$

If \(q=0.25\) and 400 eligible positive patients are needed:

$$ N_{screen} \approx \frac{400}{0.25} = 1600 $$

before accounting for additional screening failures.

Unequal Biomarker Prevalence Creates Unequal Information

Suppose:

$$ P(B=1)=0.20 $$

and:

$$ P(B=0)=0.80 $$

An all-comers trial may therefore contain four times as many biomarker-negative as biomarker-positive patients.

The biomarker-positive treatment effect can consequently have substantially wider confidence intervals unless the design deliberately addresses the imbalance.

Figure 2: Biomarker Prevalence and Information

Figure 2. Illustrative Biomarker Composition of an All-Comers Trial
A low-prevalence biomarker can result in substantially less information for the biomarker-positive treatment-effect estimate.

Illustrative prevalence values are used only to demonstrate the effect of biomarker frequency on subgroup information.

Biomarker-by-Treatment Interaction and Clinical Relevance

Statistical interaction and clinical usefulness are not identical.

A statistically significant interaction can occur because of a small but clinically unimportant difference in treatment effects.

Conversely, a clinically important difference may fail to achieve conventional statistical significance if the biomarker subgroups are small.

Therefore, interpretation should consider:

  • Effect estimates
  • Confidence intervals
  • Interaction evidence
  • Clinical magnitude
  • Biological plausibility
  • Consistency across endpoints
  • Consistency across studies

Confidence Intervals Are Essential

Suppose:

$$ HR_+=0.55 \quad 95\%\,CI=(0.40,0.76) $$

and:

$$ HR_-=0.92 \quad 95\%\,CI=(0.70,1.21) $$

The point estimates appear different.

But the uncertainty around each estimate must be considered.

A formal interaction analysis can help determine whether the observed difference is greater than would reasonably be expected from sampling variation.

Multiplicity in Biomarker Trials

Biomarker-stratified trials can generate many potential hypotheses.

For example:

  • Overall treatment effect
  • Biomarker-positive effect
  • Biomarker-negative effect
  • Treatment-by-biomarker interaction
  • Multiple biomarker thresholds
  • Multiple endpoints
  • Multiple treatment comparisons

If several hypotheses are intended to support a confirmatory claim, the multiplicity strategy should be defined prospectively.

Subgroup Analysis Is Not Automatically Confirmatory

A biomarker subgroup can be scientifically important without automatically being a formal confirmatory population.

The statistical analysis plan should distinguish:

Analysis Typical role
Primary population Main confirmatory treatment comparison
Key biomarker subgroup Potential prespecified confirmatory or supportive analysis
Other exploratory biomarkers Hypothesis generation
Post hoc biomarker cutoff Exploratory unless appropriately validated

Hierarchical Testing

If the development strategy prioritizes a biomarker-positive population, hypotheses may be tested hierarchically.

For example:

1
Test the primary treatment hypothesis in the biomarker-positive population.
2
If successful, test the broader all-comers population.
3
If prespecified, evaluate additional populations or endpoints.

The exact hierarchy and error-control procedure must be established before unblinding the confirmatory analysis.

Adaptive Biomarker Designs

Some trials incorporate biomarker information adaptively.

Examples include:

  • Adaptive enrollment of biomarker-defined populations
  • Dropping an ineffective biomarker subgroup
  • Sample-size reassessment
  • Adaptive randomization
  • Multiple biomarker cohort evaluation

Adaptive methods require careful prespecification and appropriate control of operating characteristics.

Umbrella, Basket, and Platform Concepts

Biomarker-stratified development can occur within broader precision-medicine frameworks.

Design Basic idea
Umbrella trial One disease studied across multiple biomarker-defined treatment strategies
Basket trial One biomarker-defined biology evaluated across multiple diseases or tumor types
Platform trial Multiple treatments and/or biomarker-defined hypotheses evaluated within a common infrastructure
Enrichment trial Enrollment restricted to a selected biomarker population

Biomarker Status Should Be Defined Before Analysis

The analysis dataset should contain a clearly defined biomarker variable.

For example:

USUBJID
TRT01P
BIOMARK
BIOMARKN
BIOMARKGR
AVAL
PARAMCD
ADT
CNSR

The exact variable names depend on the study and standards implementation.

The important principle is that biomarker classification should be traceable from the source assay result through the analysis dataset.

Missing Biomarker Status

Not every screened patient will have a definitive biomarker result.

Possible categories include:

  • Positive
  • Negative
  • Indeterminate
  • Missing
  • Assay failure
  • Insufficient specimen

These categories should not automatically be collapsed into "negative."

Important: An unknown biomarker result is not equivalent to a negative biomarker result. Treating assay failure or missing tissue as biomarker-negative can introduce classification and selection problems.

Intent-to-Treat and Biomarker Populations

Randomized treatment comparisons generally rely on the randomized analysis population defined in the protocol and SAP.

When biomarker status is used to define a subgroup, the subgroup analysis should have a clear population definition.

For example:

  • All randomized patients
  • All randomized patients with valid biomarker status
  • All treated patients with valid biomarker status
  • Biomarker-positive randomized patients

These populations can produce different estimates and should not be mixed without explanation.

Biomarker Status and Randomization

If biomarker status is known before randomization, it can be used as a stratification factor.

If the biomarker is measured after randomization or only becomes available later, the operational and statistical implications are different.

The timing of biomarker measurement should therefore be explicitly defined.

Baseline Covariate Adjustment

Biomarker status may also be included as a covariate in the primary model.

For example, a Cox model might contain:

coxph(
  Surv(time, event) ~
    treatment +
    biomarker +
    treatment:biomarker +
    age +
    stage,
  data = analysis
)

Whether covariate adjustment is appropriate depends on the prespecified analysis strategy and the endpoint.

Stratified Cox Models

If the randomization procedure uses stratification factors, the primary Cox analysis may also incorporate those factors according to the prespecified statistical analysis plan.

A stratified Cox model can allow the baseline hazard to differ across strata without estimating a separate coefficient for each stratum.

coxph(
  Surv(time, event) ~ treatment +
    strata(biomarker),
  data = analysis
)

This estimates a common treatment effect across biomarker strata rather than a separate treatment effect for each stratum.

Do not confuse these models. A stratified Cox model using biomarker as a stratum is not the same as a model containing a treatment-by-biomarker interaction. The former allows baseline hazards to differ; the latter directly models treatment-effect heterogeneity.

Testing the Interaction in R

For a binary endpoint:

fit <- glm(
  response ~ treatment * biomarker,
  family = binomial(),
  data = analysis
)

summary(fit)

The term:

treatment:biomarker

represents the interaction.

Testing Interaction With a Cox Model

library(survival)

fit <- coxph(
  Surv(time, event) ~
    treatment * biomarker,
  data = analysis
)

summary(fit)

The interaction term can be examined using the estimated coefficient, standard error, confidence interval, and corresponding hypothesis test.

Estimating Subgroup-Specific Effects

The interaction model can be used to derive subgroup-specific treatment effects.

Suppose:

$$ \log(HR) = \beta_1T+ \beta_2B+ \beta_3TB $$

When \(B=0\):

$$ \log(HR_-)=\beta_1 $$

so:

$$ HR_-=e^{\beta_1} $$

When \(B=1\):

$$ \log(HR_+)=\beta_1+\beta_3 $$

and therefore:

$$ HR_+=e^{\beta_1+\beta_3} $$

Ratio of Hazard Ratios

The relative difference between the subgroup-specific hazard ratios can be represented as:

$$ \frac{HR_+}{HR_-} = e^{\beta_3} $$

Thus, the interaction coefficient has a direct interpretation in terms of the ratio of subgroup-specific hazard ratios.

Figure 3: Interaction Concept

Figure 3. Treatment Effect as a Function of Biomarker Status
The illustrative treatment effects diverge across biomarker groups. The difference between the two treatment effects is the quantity addressed by the interaction analysis.

Illustrative effect estimates only. Separation between point estimates should be interpreted using confidence intervals and the prespecified interaction analysis.

Biomarker-Stratified Kaplan-Meier Curves

For time-to-event endpoints, Kaplan-Meier curves can be displayed separately by treatment and biomarker group.

A common arrangement is:

  • Panel A: biomarker-positive
  • Panel B: biomarker-negative

The same time and survival scales should generally be used across panels when direct visual comparison is intended.

Do Not Overinterpret Kaplan-Meier Curve Separation

Visual separation between curves can be useful, but formal inference should come from the prespecified model and hypothesis tests.

Similarly, crossing Kaplan-Meier curves may indicate that a simple proportional hazards interpretation requires caution.

Biomarker Subgroup Forest Plots

Forest plots are particularly useful for displaying subgroup-specific treatment effects.

A typical display includes:

  • Biomarker-positive estimate
  • Biomarker-negative estimate
  • Overall estimate
  • 95% confidence intervals
  • Interaction p-value where appropriate

Forest Plot Interpretation

A forest plot should emphasize the estimates and their uncertainty rather than simply whether each confidence interval crosses the null value.

For a hazard ratio:

$$ HR=1 $$

is the usual null value.

Values below 1 favor the experimental treatment when lower hazard is beneficial.

Biomarker-Positive Enrichment vs. Stratification

Feature Stratified All-Comers Enrichment
Biomarker-positive patients Enrolled Enrolled
Biomarker-negative patients Enrolled Usually excluded
Generalizability Broader Restricted
Direct evidence in negative group Yes No
Recruitment burden Depends on prevalence Can be high for rare biomarkers
Potential targeted effect May be diluted by negative group Can be more concentrated

When Enrichment Can Be Attractive

An enrichment strategy can be compelling when strong prior evidence suggests that treatment benefit is concentrated in a clearly defined biomarker population.

For example, if the treatment mechanism directly targets a molecular alteration, restricting enrollment to patients carrying that alteration may provide a scientifically coherent development strategy.

However, the strength of the biomarker-treatment hypothesis should be considered carefully before excluding a large portion of the intended population.

When an All-Comers Design Can Be Preferable

An all-comers design may be preferred when:

  • The treatment may benefit patients regardless of biomarker status.
  • Evidence for biomarker prediction is uncertain.
  • The biomarker assay is still developing.
  • Generalizability is particularly important.
  • The biomarker prevalence is low.

Multiple Biomarkers

Some trials evaluate several candidate biomarkers.

Suppose:

$$ B_1,\ B_2,\ B_3,\ldots,B_k $$

are evaluated.

The number of possible subgroups can increase rapidly, particularly if biomarkers are combined.

For two binary biomarkers, there are:

$$ 2^2=4 $$

combinations.

For five binary biomarkers:

$$ 2^5=32 $$

possible combinations exist.

Multiplicity warning: Searching many biomarkers, cutoffs, endpoints, and treatment-effect definitions can produce apparently impressive findings by chance. Exploratory biomarker discoveries should generally be distinguished clearly from prespecified confirmatory claims.

Composite Biomarker Definitions

A biomarker strategy may define eligibility using several biological criteria.

For example:

$$ B= I(B_1=1\ \text{AND}\ B_2=1) $$

or:

$$ B= I(B_1=1\ \text{OR}\ B_2=1) $$

The logical definition must be explicit because changing the definition changes the analysis population.

Biomarker Misclassification

Suppose the true biological status is \(B^*\), but the observed assay result is \(B\).

If the assay has imperfect sensitivity and specificity, some patients may be misclassified.

For example:

$$ Sensitivity = P(B=1\mid B^*=1) $$

and:

$$ Specificity = P(B=0\mid B^*=0) $$

Misclassification can dilute observed differences between biomarker-defined treatment effects.

Biomarker Measurement Error

Measurement error becomes especially important when the biomarker is continuous.

Suppose:

$$ B_{observed}=B_{true}+\epsilon $$

where \(\epsilon\) represents measurement error.

This can make the observed biomarker-treatment relationship weaker than the underlying biological relationship.

Baseline Biomarker vs. On-Treatment Biomarker

Biomarkers measured before treatment and biomarkers measured after treatment have different roles.

Biomarker timing Typical interpretation
Baseline Candidate predictor of treatment benefit or prognosis
Early on-treatment Potential pharmacodynamic or response marker
Post-progression Potential resistance or evolutionary marker

A post-treatment biomarker should not automatically be interpreted as a baseline predictive biomarker because treatment itself may affect the marker.

Biomarker and Treatment Interaction: A Simple Numerical Example

Suppose the estimated treatment effects are:

Biomarker Experimental event rate Control event rate
Positive 20% 40%
Negative 38% 40%

The risk ratio in the positive subgroup is:

$$ RR_+ = \frac{0.20}{0.40} = 0.50 $$

while in the negative subgroup:

$$ RR_- = \frac{0.38}{0.40} = 0.95 $$

The point estimates suggest substantially greater benefit in the biomarker positive group.

Whether that difference is statistically and clinically convincing requires uncertainty estimates and an appropriate interaction analysis.

Relative vs. Absolute Treatment Effects

Biomarker heterogeneity can look different depending on the effect measure.

For example, two groups may have similar relative risk reductions but very different absolute risk reductions because their baseline risks differ.

Therefore, biomarker analyses should consider both:

  • Relative treatment effects
  • Absolute treatment effects

Prognostic Biomarker Example

Suppose survival is worse among biomarker-negative patients in both treatment groups:

$$ S_{+,T}>S_{-,T} $$

and:

$$ S_{+,C}>S_{-,C} $$

where \(S\) denotes survival.

The biomarker may therefore be prognostic.

But if the treatment effect is similar:

$$ HR_+\approx HR_- $$

there may be little evidence that the biomarker is predictive.

Predictive Biomarker Example

Now suppose:

$$ HR_+=0.50 $$

and:

$$ HR_-=1.00 $$

The treatment appears beneficial in the positive group but not the negative group.

This pattern raises the predictive biomarker hypothesis.

The interaction test and confidence intervals determine how strongly that hypothesis is supported.

Figure 4: Prognostic vs. Predictive Patterns

Figure 4. Illustrative Prognostic and Predictive Biomarker Patterns
The first pattern represents a biomarker associated with outcome in both arms. The second represents a biomarker associated with a differential treatment effect.

Illustrative values only. Prognostic and predictive effects should be evaluated using the appropriate model and prespecified hypotheses.

Subgroup Sample Size

Suppose a trial enrolls \(N\) patients and the biomarker-positive prevalence is \(q\).

The expected positive subgroup size is approximately:

$$ N_+\approx qN $$

and the negative subgroup:

$$ N_-\approx(1-q)N $$

If \(q\) is small, the positive subgroup may be underpowered for a treatment effect or interaction analysis.

Powering for Interaction

If the primary objective is to establish biomarker-dependent treatment effect, the sample-size calculation should target the expected difference in treatment effects.

For a simplified continuous endpoint, the interaction effect may be represented by:

$$ \Delta_{interaction} = \Delta_+-\Delta_- $$

where \(\Delta_+\) and \(\Delta_-\) are treatment effects in the two biomarker groups.

The smaller this difference, the more information may be required to detect it.

What Happens When Biomarker Prevalence Is Uncertain?

The biomarker prevalence used in sample-size planning is often estimated from previous studies or screening data.

If the actual prevalence is lower than expected, recruitment can take longer.

If the actual prevalence is higher, the trial may accrue biomarker-positive patients faster than expected.

Sensitivity analyses around prevalence assumptions can therefore be useful during operational planning.

Biomarker Cutoff Selection and Overfitting

Suppose investigators test many possible cutoffs:

$$ 20,\ 30,\ 40,\ 50,\ 60,\ 70 $$

and select the cutoff producing the largest apparent treatment effect.

The resulting estimate can be optimistically biased because the same data were used to discover and evaluate the subgroup.

This is a form of model-selection or subgroup-selection bias.

Validation of Biomarker Findings

A promising biomarker finding is stronger when it is supported by:

  • Biological plausibility
  • Prespecified hypotheses
  • Validated assay methodology
  • Consistent treatment-effect patterns
  • Independent replication
  • Appropriate statistical control

Biomarker Strategy in the Protocol

The protocol should describe the role of the biomarker clearly.

Important elements include:

  • Biomarker definition
  • Assay platform
  • Sample collection requirements
  • Testing timing
  • Positive/negative cutoff
  • Eligibility implications
  • Randomization implications
  • Primary and secondary analyses
  • Handling of unknown results

Biomarker Strategy in the Statistical Analysis Plan

The SAP should define the statistical implementation.

1
Define the biomarker analysis population.
2
Define the biomarker derivation algorithm.
3
Define primary and subgroup treatment comparisons.
4
Define interaction testing, if applicable.
5
Define multiplicity control.
6
Define handling of missing and indeterminate biomarker results.
7
Define sensitivity analyses.
8
Define graphical displays and listings.

Missing Biomarker Sensitivity Analyses

If biomarker status is missing for some randomized patients, sensitivity analyses may be useful.

Possible analyses include:

  • Valid biomarker results only
  • Alternative assumptions for missing classification
  • Comparison of known versus unknown populations
  • Assessment of assay-failure patterns

The appropriate strategy depends on why biomarker information is missing and how the biomarker is used in the trial.

Interaction Test vs. Separate Subgroup Tests

Question Appropriate analysis
Does treatment work in biomarker-positive patients? Positive-group treatment effect
Does treatment work in biomarker-negative patients? Negative-group treatment effect
Does treatment effect differ by biomarker? Treatment-by-biomarker interaction
Is biomarker associated with prognosis? Biomarker main effect / prognostic analysis

Common Interpretation Error

Consider:

$$ HR_+=0.60,\qquad HR_-=0.85 $$

Even if the confidence intervals overlap substantially, the point estimates may still suggest a clinically interesting difference.

Conversely, if:

$$ HR_+=0.60,\qquad HR_-=0.85 $$

with large uncertainty, the evidence may be insufficient to establish predictive biomarker utility.

The conclusion should reflect the precision of the estimates rather than only the point estimates.

Forest Plot With Interaction P-Value

A useful confirmatory or supportive display might contain:

Population HR 95% CI
Overall 0.72 0.60–0.86
Biomarker-positive 0.52 0.39–0.69
Biomarker-negative 0.94 0.74–1.20

A corresponding interaction test might evaluate:

$$ H_0:HR_+=HR_- $$

The interaction p-value should be interpreted together with the subgroup estimates and confidence intervals.

Biomarker-Stratified Randomization and Analysis Alignment

If biomarker status is used for randomization, the analysis plan should explain how that stratification is reflected in the primary analysis.

The exact model depends on the endpoint and the study's prespecified analysis strategy.

For example, a continuous endpoint may use:

outcome ~ treatment + biomarker + baseline_covariates

while a predictive biomarker analysis may add:

outcome ~ treatment * biomarker + baseline_covariates

Biomarker-Stratified Binary Endpoint Analysis

For a binary endpoint, treatment effects can be summarized using:

  • Risk difference
  • Risk ratio
  • Odds ratio

For example:

$$ RD=P(Y=1\mid T=1)-P(Y=1\mid T=0) $$

or:

$$ RR= \frac{P(Y=1\mid T=1)} {P(Y=1\mid T=0)} $$

Absolute Treatment Benefit May Depend on Biomarker Risk

Suppose two biomarker groups have different control risks.

Biomarker Control risk Treatment risk Risk difference
Positive 50% 30% −20 percentage points
Negative 20% 12% −8 percentage points

Both groups may have a similar relative treatment effect while having different absolute benefits.

This distinction can be important for clinical decision-making.

Biomarker and Number Needed to Treat

For a binary endpoint, the number needed to treat can be calculated from the absolute risk difference:

$$ NNT= \frac{1}{|p_T-p_C|} $$

For a risk reduction from 50% to 30%:

$$ NNT= \frac{1}{0.50-0.30} = 5 $$

For a reduction from 20% to 12%:

$$ NNT= \frac{1}{0.20-0.12} = 12.5 $$

Thus, a biomarker can potentially identify populations with different absolute clinical benefit even when relative effects appear similar.

Post-Hoc Biomarker Analysis

Many clinical trials evaluate biomarkers after the primary analysis.

These analyses can be valuable for hypothesis generation.

However, post-hoc findings should generally be interpreted cautiously because:

  • The subgroup may not have been prespecified.
  • The cutoff may have been data-driven.
  • Many candidate biomarkers may have been examined.
  • Multiplicity may not have been controlled.
  • Replication may be absent.

Prespecified vs. Post-Hoc Biomarker Analysis

Characteristic Prespecified Post-hoc
Hypothesis defined before unblinding Yes Not necessarily
Cutoff predetermined Usually May be selected from data
Multiplicity strategy Can be prospectively defined Often exploratory
Confirmatory potential Potentially stronger Usually requires caution/validation
Hypothesis generation Yes Yes

Biomarker Analysis and Regulatory Interpretation

Regulatory evaluation of a biomarker-supported treatment strategy generally requires consideration of the totality of evidence.

Important elements can include:

  • Biological rationale
  • Analytical validity of the biomarker assay
  • Clinical validity
  • Clinical utility
  • Prespecified statistical hypotheses
  • Magnitude and precision of treatment effects
  • Interaction evidence
  • Consistency across studies
  • Population representativeness
Key principle: A statistically interesting subgroup does not automatically establish a clinically validated biomarker strategy. The assay, biological rationale, clinical evidence, and statistical design all contribute to the strength of the conclusion.

Biomarker Analysis in Clinical Study Reports

A CSR may include biomarker analyses in several locations.

CSR component Potential content
Patient disposition Biomarker testing and evaluability
Baseline characteristics Biomarker prevalence
Efficacy Biomarker-specific treatment effects
Forest plots Subgroup effect estimates and confidence intervals
Safety Safety by biomarker subgroup where relevant
Exploratory analyses Additional biomarker relationships

Safety Can Also Be Biomarker-Stratified

Biomarker subgroup analyses are not limited to efficacy.

Investigators may evaluate:

  • Treatment-emergent adverse events
  • Serious adverse events
  • Dose interruptions
  • Discontinuations due to adverse events
  • Laboratory abnormalities

However, safety subgroup analyses are often descriptive unless specifically powered for comparison.

Biomarker Subgroups and Small Numbers

Small biomarker-positive populations can create unstable estimates.

For example, if only 20 patients are biomarker-positive, a difference of a few events can substantially change the estimated treatment effect.

Therefore, sparse subgroup results should be accompanied by:

  • Exact event counts where appropriate
  • Confidence intervals
  • Clear denominators
  • Cautious interpretation

Do Not Hide the Denominator

A statement such as:

"Treatment response was 60% in biomarker-positive patients."

is incomplete without knowing how many patients were evaluated.

For example:

$$ 12/20=60\% $$

has a very different level of information from:

$$ 120/200=60\% $$

even though the percentages are identical.

Biomarker Subgroup Tables

A useful efficacy table might contain:

Biomarker Treatment Responders / N Response Rate
Positive Experimental 48 / 100 48%
Positive Control 22 / 100 22%
Negative Experimental 35 / 150 23%
Negative Control 30 / 150 20%

The table suggests a larger treatment difference in the biomarker-positive population.

Formal inference should still use the prespecified model.

Common Biomarker Design Mistakes

  1. Confusing prognostic and predictive biomarkers. An association with outcome does not establish treatment-effect modification.
  2. Comparing subgroup p-values instead of testing interaction. A significant result in one group and a non-significant result in another do not establish heterogeneity.
  3. Ignoring biomarker prevalence. Rare biomarkers can create major recruitment and power challenges.
  4. Dichotomizing a continuous biomarker without justification. Arbitrary cutoffs can discard information and introduce bias.
  5. Choosing a cutoff after examining treatment results. This can substantially inflate apparent evidence.
  6. Treating unknown biomarker status as negative. Assay failure and missingness require explicit handling.
  7. Ignoring assay performance. Biomarker misclassification can dilute or distort treatment-effect heterogeneity.
  8. Underpowering the interaction analysis. The trial may be powered for the overall effect but not for biomarker heterogeneity.
  9. Ignoring multiplicity. Many biomarkers and cutoffs can create false-positive findings.
  10. Overinterpreting small subgroup estimates. Sparse biomarker populations can produce wide and unstable confidence intervals.

Practical Biomarker Trial Design Workflow

1
Define the biological hypothesis.
2
Determine whether the biomarker is intended to be prognostic, predictive, or both.
3
Define the assay and biomarker classification.
4
Estimate biomarker prevalence and screening feasibility.
5
Choose an all-comers, stratified, or enrichment strategy.
6
Define the randomization strategy.
7
Specify the primary estimand and analysis population.
8
Specify subgroup treatment effects and interaction analyses.
9
Address sample size, power, and multiplicity.
10
Validate the biomarker strategy and communicate uncertainty clearly.

R Example: Preparing Biomarker Data

analysis$biomarker <-
  ifelse(
    analysis$biomarker_score >= 50,
    "Positive",
    "Negative"
  )

analysis$biomarker <-
  factor(
    analysis$biomarker,
    levels = c("Negative", "Positive")
  )

The cutoff should be replaced by the prespecified assay threshold rather than selected from the treatment outcome.

R Example: Biomarker-Stratified Summary

library(dplyr)

analysis %>%
  group_by(
    treatment,
    biomarker
  ) %>%
  summarise(
    N = n(),
    responders = sum(response == 1, na.rm = TRUE),
    response_rate =
      responders / N
  )

R Example: Logistic Interaction Model

fit_logistic <- glm(
  response ~ treatment * biomarker,
  data = analysis,
  family = binomial()
)

summary(fit_logistic)

The interaction term is represented by:

treatment:biomarker

R Example: Cox Interaction Model

library(survival)

fit_cox <- coxph(
  Surv(time, event) ~
    treatment * biomarker,
  data = analysis
)

summary(fit_cox)

R Example: Forest Plot Preparation

forest_data <- data.frame(
  subgroup = c(
    "Overall",
    "Biomarker Positive",
    "Biomarker Negative"
  ),
  estimate = c(
    0.72,
    0.52,
    0.94
  ),
  lower = c(
    0.60,
    0.39,
    0.74
  ),
  upper = c(
    0.86,
    0.69,
    1.20
  )
)

This data can then be passed to a forest-plot package or custom plotting routine.

R Example: Interaction Variable

analysis$treatment_biomarker <-
  interaction(
    analysis$treatment,
    analysis$biomarker
  )

Although explicit interaction terms in a model formula are usually preferable, this illustrates the underlying concept.

Model Diagnostics

Biomarker interaction models should be checked just like other clinical-trial models.

For example, for a Cox model consider:

  • Proportional-hazards assumptions
  • Influential observations
  • Sparse events
  • Model convergence
  • Separation for binary outcomes
  • Consistency of subgroup estimates

Continuous Biomarker Interaction

If the biomarker remains continuous, the interaction model can be written:

$$ Y= \beta_0+ \beta_1T+ \beta_2B+ \beta_3(T\times B)+\epsilon $$

Here the treatment effect changes linearly with the biomarker value.

The treatment effect at biomarker level \(b\) is:

$$ \Delta(b)=\beta_1+\beta_3b $$

This can be useful when a biological gradient is expected.

Nonlinear Biomarker Effects

A linear interaction may be inappropriate if the treatment effect changes nonlinearly with biomarker level.

Flexible approaches can include:

  • Restricted cubic splines
  • Fractional polynomials
  • Prespecified categories
  • Other scientifically justified nonlinear models

More flexible models require additional attention to sample size, overfitting, and interpretation.

Biomarker Analysis and Estimands

The biomarker analysis should also be connected to the trial's estimand.

For example, the question might be:

$$ \text{What is the treatment effect in biomarker-positive patients under the specified treatment policy?} $$

or:

$$ \text{Does treatment effect differ between biomarker-positive and biomarker-negative populations?} $$

These are related but distinct questions.

Biomarker-Defined Estimand

A well-defined biomarker estimand should specify:

  • Population
  • Treatment conditions
  • Endpoint
  • Summary measure
  • Relevant intercurrent-event strategy

The biomarker subgroup itself should also be clearly defined.

Biomarker Subgroups and Intercurrent Events

Treatment discontinuation, rescue therapy, crossover, and other intercurrent events can affect biomarker subgroup estimates just as they affect the overall analysis.

The handling strategy should therefore be consistent with the prespecified estimand.

Biomarker Results Should Be Traceable

A regulatory-quality biomarker analysis should allow the analyst to trace:

A
Biological specimen
B
Assay result
C
Biomarker classification
D
Analysis dataset
E
Statistical model
F
CSR/table/figure result

This traceability is especially important when biomarker classification affects eligibility or a potentially label-defining treatment population.

Biomarker Quality-Control Checklist

1
Confirm every biomarker result is linked to the correct patient.
2
Confirm the assay result and classification are consistent.
3
Confirm the cutoff is the prespecified cutoff.
4
Confirm missing and indeterminate results are handled correctly.
5
Confirm biomarker status is correctly linked to treatment assignment.
6
Confirm subgroup denominators.
7
Confirm event counts and treatment-effect estimates.
8
Confirm confidence intervals.
9
Confirm interaction calculations.
10
Confirm all biomarker analyses match the SAP.

What Should Be Shown in a Biomarker Forest Plot?

A high-quality forest plot should generally show:

  • Subgroup label
  • Number of patients
  • Number of events, when applicable
  • Treatment-effect estimate
  • Confidence interval
  • Reference/null line
  • Interaction information where relevant

The figure should make clear whether subgroup results are confirmatory or exploratory.

How to Read a Biomarker Forest Plot

Start with the overall treatment effect.

Then examine the biomarker-positive and biomarker-negative estimates.

Next, compare the confidence intervals.

Finally, evaluate the formal interaction result.

Do not begin by simply counting how many confidence intervals cross the null.

A Useful Interpretation Framework

1
Magnitude: How large are the subgroup-specific effects?
2
Precision: How wide are the confidence intervals?
3
Heterogeneity: Is there evidence that effects differ?
4
Biology: Is the pattern biologically plausible?
5
Consistency: Does the pattern appear across endpoints and studies?

What a Biomarker-Stratified Trial Can Reveal

A well-designed biomarker trial can help answer several important questions:

  • Does the treatment work overall?
  • Is the biomarker prognostic?
  • Does treatment benefit differ by biomarker status?
  • Is benefit concentrated in one biomarker population?
  • Is benefit present in both populations?
  • How large is the absolute benefit?
  • How reproducible is the biomarker-treatment relationship?

What It Cannot Establish by Itself

A single biomarker subgroup analysis cannot automatically establish:

  • Causality of the biomarker-treatment relationship
  • Clinical utility of every assay implementation
  • Generalizability to unstudied populations
  • Validity of an unvalidated cutoff
  • Reproducibility of an exploratory finding

Best Practices for Confirmatory Biomarker Trials

  • Define the biomarker hypothesis prospectively.
  • Use a clinically justified assay.
  • Prespecify the biomarker cutoff.
  • Estimate prevalence realistically.
  • Plan recruitment around biomarker prevalence.
  • Distinguish prognostic from predictive hypotheses.
  • Power the study for the intended claim.
  • Use an appropriate interaction analysis when heterogeneity is the question.
  • Control multiplicity for confirmatory biomarker claims.
  • Report confidence intervals, not only p-values.
  • Clearly identify exploratory analyses.
  • Validate promising biomarker findings independently.

Biomarker Trial Design Specification

Specification Example
Population Patients with advanced disease meeting protocol eligibility criteria
Biomarker Prespecified binary assay result
Cutoff Validated assay threshold
Randomization 1:1 within biomarker strata
Primary endpoint Overall survival
Primary population All randomized patients
Biomarker analysis Prespecified subgroup treatment effects
Interaction Treatment × biomarker
Missing biomarker Handled according to prespecified rules
Multiplicity Defined in the SAP

Example Statistical Analysis Plan Language

Illustrative wording: Treatment effects will be summarized by prespecified biomarker subgroup. Biomarker status will be derived according to the validated assay algorithm and prespecified cutoff. Treatment-by-biomarker interaction will be evaluated using an appropriate model for the primary endpoint. Subgroup-specific estimates will be presented with two-sided 95% confidence intervals. Biomarker analyses not identified as confirmatory will be interpreted as supportive or exploratory.

Clinical Interpretation Example

Suppose the final study produces:

Population HR 95% CI
Overall 0.72 0.61–0.85
Biomarker-positive 0.50 0.38–0.66
Biomarker-negative 0.92 0.73–1.16

A reasonable interpretation would be that the experimental treatment is associated with improved outcome overall, with a larger estimated treatment effect in the biomarker-positive subgroup.

However, whether the biomarker is truly predictive depends on the interaction analysis, prespecification, assay validity, multiplicity, and consistency of the evidence.

One of the Most Important Lessons

Biomarker analysis is not simply:

$$ \text{Positive group} \quad vs. \quad \text{Negative group} $$

The central question for a predictive biomarker is:

$$ \text{Does the treatment effect change as biomarker status changes?} $$

That is fundamentally an interaction question.

Bottom line: A biomarker-stratified trial should be designed around the scientific role of the biomarker. Stratification can improve treatment balance, enrichment can target a biologically selected population, and subgroup analyses can describe treatment effects. But a predictive biomarker claim requires evidence that the relative treatment effect differs according to biomarker status, supported by appropriate interaction analysis, precision, biological rationale, assay validity, and—when necessary—independent validation.

Summary Checklist

1
Is the biomarker prognostic, predictive, or both?
2
Is the biomarker measured using a validated and reproducible assay?
3
Is the cutoff prespecified and scientifically justified?
4
Should the trial enroll all-comers or use enrichment?
5
Should biomarker status be used for randomization stratification?
6
Is the sample size adequate for the intended biomarker claim?
7
Is the treatment-by-biomarker interaction prespecified?
8
Are multiplicity issues addressed?
9
Are missing and indeterminate biomarker results handled appropriately?
10
Are subgroup findings interpreted using effect estimates, confidence intervals, interaction evidence, and biological context?

References

U.S. Food and Drug Administration. Enrichment Strategies for Clinical Trials to Support Approval of Human Drugs and Biological Products. Guidance for Industry.

U.S. Food and Drug Administration. In Vitro Companion Diagnostic Devices. Guidance for Industry and Food and Drug Administration Staff.

U.S. Food and Drug Administration. Principles for Codevelopment of an In Vitro Companion Diagnostic Device with a Therapeutic Product. Guidance for Industry and Food and Drug Administration Staff.

U.S. Food and Drug Administration. Adaptive Designs for Clinical Trials of Drugs and Biologics. Guidance for Industry.

European Medicines Agency. Guideline on clinical trials in small populations.

European Medicines Agency. Guideline on good pharmacogenomic practice.

Simon, R. and Maitournam, A. Evaluating the efficiency of targeted designs for randomized clinical trials. Clinical Cancer Research.

Simon, R. Clinical trials for evaluating predictive biomarkers. Journal of the National Cancer Institute.

Freidlin, B. and Korn, E.L. Biomarker enrichment strategies: strengths and limitations. Journal of Clinical Oncology.