Introduction
Modern clinical development increasingly asks not only whether a treatment works, but which patients are most likely to benefit. Biomarkers can help identify biologically defined populations and can therefore play an important role in clinical-trial design.
A biomarker may be a genomic alteration, protein expression measurement, pathway marker, immune marker, imaging characteristic, or another measurable biological characteristic.
When biomarker information is incorporated prospectively into trial design, the resulting study can be described as a biomarker-stratified trial.
The term encompasses several different designs, however. A trial may enroll patients regardless of biomarker status but stratify randomization by biomarker subgroup. Another trial may restrict enrollment to biomarker-positive patients. A more complex design may evaluate several biomarker-defined subgroups simultaneously and formally test whether treatment effects differ between them.
What Is a Biomarker-Stratified Trial?
Suppose a trial evaluates an experimental treatment versus control and patients are classified according to a binary biomarker:
The study therefore contains two biomarker-defined populations:
- Biomarker-positive: \(B=1\)
- Biomarker-negative: \(B=0\)
Treatment can then be represented by:
A biomarker-stratified design asks whether the treatment effect is consistent across these groups and, when scientifically justified, whether it differs according to biomarker status.
Why Use Biomarkers?
A biomarker can contribute to trial design for several reasons.
| Purpose | Example |
|---|---|
| Prognostic information | Identifies patients with different expected outcomes regardless of treatment |
| Predictive information | Identifies patients who may have different relative treatment effects |
| Eligibility criterion | Only biomarker-positive patients are enrolled |
| Randomization stratification | Treatment assignment is balanced within biomarker strata |
| Subgroup analysis | Treatment effects are estimated separately by biomarker status |
| Companion diagnostic strategy | A validated assay identifies patients eligible for a targeted therapy |
Prognostic vs. Predictive Biomarkers
One of the most important distinctions in biomarker research is between prognostic and predictive effects.
Prognostic Biomarker
A prognostic biomarker is associated with the clinical outcome independently of the treatment being evaluated.
For example, suppose biomarker-positive patients have longer progression-free survival than biomarker-negative patients in both treatment groups.
The biomarker may be prognostic.
Predictive Biomarker
A predictive biomarker modifies the relative effect of treatment.
For example, suppose the experimental treatment substantially improves outcome among biomarker-positive patients but provides little or no benefit among biomarker-negative patients.
That pattern suggests a potential treatment-by-biomarker interaction.
An Example of Prognostic and Predictive Effects
Illustrative data only. A hazard ratio below 1 favors the experimental treatment for a time-to-event endpoint.
The Interaction Is the Key Question
Suppose the treatment effect among biomarker-positive patients is:
and among biomarker-negative patients:
The important scientific question is not simply whether:
or whether:
The central question is whether the treatment effect differs between the two biomarker groups.
That is an interaction question.
Formal Treatment-by-Biomarker Interaction
For a continuous outcome, a simple model might be:
Here:
- \(\beta_1\) represents the treatment effect when \(B=0\).
- \(\beta_2\) represents the biomarker-group difference under \(T=0\).
- \(\beta_3\) represents the treatment-by-biomarker interaction.
If:
there is evidence that the treatment effect differs according to biomarker status.
For Binary Endpoints
For a binary endpoint, logistic regression can be used:
logit{
P(Y = 1)
}
=
β0 +
β1*T +
β2*Biomarker +
β3*T*Biomarker
The interaction coefficient \(\beta_3\) assesses whether the treatment effect on the log-odds scale differs between biomarker groups.
For Time-to-Event Endpoints
For survival endpoints, a Cox proportional-hazards model may include:
h(t) = h0(t) * exp( β1*T + β2*Biomarker + β3*T*Biomarker )
The interaction coefficient provides a formal assessment of whether the treatment hazard ratio differs by biomarker subgroup under the model.
Why "Significant in One Group, Not Significant in the Other" Is Not Enough
Consider:
It is tempting to conclude that treatment works only in the biomarker-positive group.
That conclusion can be incorrect.
The two p-values answer different questions:
- Is treatment effective within the positive group?
- Is treatment effective within the negative group?
Neither directly answers:
That requires an interaction or another appropriate heterogeneity analysis.
Three Major Biomarker Trial Strategies
Biomarker-driven trials can be broadly organized into several designs.
All-Comers Design
In an all-comers design, both biomarker-positive and biomarker-negative patients are eligible.
The biomarker may be measured at baseline and used for subgroup analysis.
The primary analysis can target the entire population:
while biomarker-defined effects may be secondary or supportive analyses.
This design can be useful when the treatment is expected to benefit a broad population or when evidence for biomarker restriction is not sufficiently established.
Biomarker-Stratified Randomization
Suppose biomarker-positive patients are expected to have different baseline risk from biomarker-negative patients.
Simple randomization could, by chance, produce an imbalance in biomarker composition between treatment arms.
Stratified randomization reduces this risk by randomizing separately within biomarker strata.
For example:
| Biomarker stratum | Experimental | Control |
|---|---|---|
| Positive | Approximately balanced | Approximately balanced |
| Negative | Approximately balanced | Approximately balanced |
The result is better treatment balance within each important biomarker stratum.
Stratified Randomization Does Not Prove Predictive Value
This distinction is easy to overlook.
If a trial stratifies randomization by biomarker status, that means investigators considered biomarker status important for treatment assignment balance.
It does not mean the biomarker has been established as predictive.
Enrichment Designs
An enrichment design limits enrollment to a selected biomarker population.
For example:
may be required for eligibility.
The trial therefore estimates the treatment effect in the biomarker-positive population directly.
Potential advantages include:
- Greater biological homogeneity
- Potentially larger treatment effect
- Smaller required sample size for a targeted effect
- Direct evaluation of a biomarker-defined treatment strategy
Potential disadvantages include:
- Reduced generalizability
- Difficulty establishing benefit outside the selected group
- Dependence on assay performance
- Potentially slower recruitment if the biomarker-positive population is uncommon
Biomarker Prevalence Matters
Suppose a biomarker is positive in only 20% of the target population.
If the trial requires 300 biomarker-positive participants, approximately:
patients may need to be screened, assuming the prevalence estimate applies to the screened population and there are no additional screening failures.
The actual number can be substantially higher because assay failures, ineligibility, inadequate tissue, and other screening factors may occur.
Screening Failure Is a Design Consideration
A biomarker-driven program therefore needs to consider:
- Biomarker prevalence
- Assay failure rate
- Turnaround time
- Insufficient tissue
- Indeterminate biomarker results
- Screening dropout
- Changes in testing platform
These operational issues can directly affect enrollment duration and study feasibility.
Biomarker Assay Performance
The statistical design cannot be separated completely from the assay.
Important assay characteristics include:
| Characteristic | Why it matters |
|---|---|
| Analytical sensitivity | Can low biomarker levels be reliably detected? |
| Analytical specificity | Can positive results be distinguished from negatives? |
| Reproducibility | Would repeated testing classify the patient consistently? |
| Cutoff definition | Where is positive versus negative defined? |
| Sample adequacy | Can the biomarker be measured reliably in available specimens? |
| Central vs local testing | Could testing location introduce classification differences? |
Continuous Biomarkers
Not all biomarkers should necessarily be converted into a binary positive or negative variable.
Suppose:
represents a continuous biomarker score.
Dichotomizing the biomarker at an arbitrary cutoff can discard information.
For example:
might be labeled positive, while:
is labeled negative.
Patients with values of 49 and 1 are then treated as members of the same category despite potentially very different biology.
Biomarker Cutoffs
Cutoffs can be based on:
- Established clinical thresholds
- Analytical validation
- Biological rationale
- Previously validated evidence
- Prespecified development criteria
Data-driven cutoff selection within the pivotal trial can inflate the apparent strength of evidence if not appropriately accounted for.
Binary Biomarker Example
Suppose a biomarker score is:
| Patient | Biomarker score | Classification |
|---|---|---|
| 001 | 82 | Positive |
| 002 | 67 | Positive |
| 003 | 41 | Negative |
| 004 | 25 | Negative |
If the prespecified cutoff is 50, the classification is:
Stratified Randomization With More Than One Factor
Trials frequently stratify randomization using multiple factors.
For example:
- Biomarker status
- Disease stage
- Prior therapy
- Geographic region
If every combination is used as a separate stratum, the number of strata can increase rapidly.
For example, four binary factors generate:
possible combinations.
With five binary factors:
possible combinations arise.
If some strata contain very few patients, treatment balance within each individual stratum may become difficult to maintain.
Centralized Randomization and Minimization
For complex trials, centralized allocation procedures or minimization methods may be considered to achieve balance across several prognostic factors.
The appropriate randomization strategy depends on the trial design, operational platform, number of stratification factors, and statistical considerations.
Primary Analysis in an All-Comers Trial
Suppose the primary endpoint is overall survival.
The primary treatment comparison might be estimated in the full randomized population:
Biomarker-defined analyses can then estimate:
The interpretation depends on the role of the biomarker in the prespecified analysis plan.
Interaction Testing
A treatment-by-biomarker interaction test evaluates:
against:
where \(\beta_{TB}\) is the treatment-by-biomarker interaction coefficient.
A small interaction p-value provides evidence that the treatment effect differs between biomarker groups.
A non-significant interaction test does not prove identical treatment effects, particularly when subgroup sample sizes are small.
Why Interaction Tests Can Have Low Power
Detecting treatment-effect heterogeneity generally requires more information than detecting an overall treatment effect.
Suppose the overall treatment effect is substantial:
but the difference between biomarker groups is modest.
The study may have adequate power for the overall treatment comparison but insufficient power to demonstrate an interaction.
Sample Size for Biomarker-Stratified Designs
Sample-size planning must reflect the actual inferential objective.
Different objectives produce different requirements:
| Objective | Sample-size driver |
|---|---|
| Overall treatment effect | Overall event rate/effect size and target power |
| Effect in biomarker-positive group | Positive-group prevalence, effect size, and required information |
| Effect in both biomarker groups | Information required separately in each group |
| Interaction | Magnitude of treatment-effect difference and information in both groups |
| Enrichment design | Number of eligible biomarker-positive patients required |
A Simple Event-Count Illustration
For a two-arm time-to-event comparison, the required number of events depends primarily on the targeted hazard ratio, significance level, and power. A commonly used approximation is:
where:
- \(D\) = required number of events
- \(p\) = allocation proportion to treatment
- \(\alpha\) = type I error
- \(\beta\) = type II error
- \(HR\) = target hazard ratio
This expression is illustrative; practical sample-size calculations also need to account for accrual, follow-up, censoring, stratification, and other design features.
Biomarker Prevalence and Total Sample Size
Suppose the biomarker-positive prevalence is \(q\).
If an enriched trial requires \(N_+\) biomarker-positive patients, the approximate number screened is:
If \(q=0.25\) and 400 eligible positive patients are needed:
before accounting for additional screening failures.
Unequal Biomarker Prevalence Creates Unequal Information
Suppose:
and:
An all-comers trial may therefore contain four times as many biomarker-negative as biomarker-positive patients.
The biomarker-positive treatment effect can consequently have substantially wider confidence intervals unless the design deliberately addresses the imbalance.
Figure 2: Biomarker Prevalence and Information
Illustrative prevalence values are used only to demonstrate the effect of biomarker frequency on subgroup information.
Biomarker-by-Treatment Interaction and Clinical Relevance
Statistical interaction and clinical usefulness are not identical.
A statistically significant interaction can occur because of a small but clinically unimportant difference in treatment effects.
Conversely, a clinically important difference may fail to achieve conventional statistical significance if the biomarker subgroups are small.
Therefore, interpretation should consider:
- Effect estimates
- Confidence intervals
- Interaction evidence
- Clinical magnitude
- Biological plausibility
- Consistency across endpoints
- Consistency across studies
Confidence Intervals Are Essential
Suppose:
and:
The point estimates appear different.
But the uncertainty around each estimate must be considered.
A formal interaction analysis can help determine whether the observed difference is greater than would reasonably be expected from sampling variation.
Multiplicity in Biomarker Trials
Biomarker-stratified trials can generate many potential hypotheses.
For example:
- Overall treatment effect
- Biomarker-positive effect
- Biomarker-negative effect
- Treatment-by-biomarker interaction
- Multiple biomarker thresholds
- Multiple endpoints
- Multiple treatment comparisons
If several hypotheses are intended to support a confirmatory claim, the multiplicity strategy should be defined prospectively.
Subgroup Analysis Is Not Automatically Confirmatory
A biomarker subgroup can be scientifically important without automatically being a formal confirmatory population.
The statistical analysis plan should distinguish:
| Analysis | Typical role |
|---|---|
| Primary population | Main confirmatory treatment comparison |
| Key biomarker subgroup | Potential prespecified confirmatory or supportive analysis |
| Other exploratory biomarkers | Hypothesis generation |
| Post hoc biomarker cutoff | Exploratory unless appropriately validated |
Hierarchical Testing
If the development strategy prioritizes a biomarker-positive population, hypotheses may be tested hierarchically.
For example:
The exact hierarchy and error-control procedure must be established before unblinding the confirmatory analysis.
Adaptive Biomarker Designs
Some trials incorporate biomarker information adaptively.
Examples include:
- Adaptive enrollment of biomarker-defined populations
- Dropping an ineffective biomarker subgroup
- Sample-size reassessment
- Adaptive randomization
- Multiple biomarker cohort evaluation
Adaptive methods require careful prespecification and appropriate control of operating characteristics.
Umbrella, Basket, and Platform Concepts
Biomarker-stratified development can occur within broader precision-medicine frameworks.
| Design | Basic idea |
|---|---|
| Umbrella trial | One disease studied across multiple biomarker-defined treatment strategies |
| Basket trial | One biomarker-defined biology evaluated across multiple diseases or tumor types |
| Platform trial | Multiple treatments and/or biomarker-defined hypotheses evaluated within a common infrastructure |
| Enrichment trial | Enrollment restricted to a selected biomarker population |
Biomarker Status Should Be Defined Before Analysis
The analysis dataset should contain a clearly defined biomarker variable.
For example:
USUBJID TRT01P BIOMARK BIOMARKN BIOMARKGR AVAL PARAMCD ADT CNSR
The exact variable names depend on the study and standards implementation.
The important principle is that biomarker classification should be traceable from the source assay result through the analysis dataset.
Missing Biomarker Status
Not every screened patient will have a definitive biomarker result.
Possible categories include:
- Positive
- Negative
- Indeterminate
- Missing
- Assay failure
- Insufficient specimen
These categories should not automatically be collapsed into "negative."
Intent-to-Treat and Biomarker Populations
Randomized treatment comparisons generally rely on the randomized analysis population defined in the protocol and SAP.
When biomarker status is used to define a subgroup, the subgroup analysis should have a clear population definition.
For example:
- All randomized patients
- All randomized patients with valid biomarker status
- All treated patients with valid biomarker status
- Biomarker-positive randomized patients
These populations can produce different estimates and should not be mixed without explanation.
Biomarker Status and Randomization
If biomarker status is known before randomization, it can be used as a stratification factor.
If the biomarker is measured after randomization or only becomes available later, the operational and statistical implications are different.
The timing of biomarker measurement should therefore be explicitly defined.
Baseline Covariate Adjustment
Biomarker status may also be included as a covariate in the primary model.
For example, a Cox model might contain:
coxph(
Surv(time, event) ~
treatment +
biomarker +
treatment:biomarker +
age +
stage,
data = analysis
)
Whether covariate adjustment is appropriate depends on the prespecified analysis strategy and the endpoint.
Stratified Cox Models
If the randomization procedure uses stratification factors, the primary Cox analysis may also incorporate those factors according to the prespecified statistical analysis plan.
A stratified Cox model can allow the baseline hazard to differ across strata without estimating a separate coefficient for each stratum.
coxph(
Surv(time, event) ~ treatment +
strata(biomarker),
data = analysis
)
This estimates a common treatment effect across biomarker strata rather than a separate treatment effect for each stratum.
Testing the Interaction in R
For a binary endpoint:
fit <- glm( response ~ treatment * biomarker, family = binomial(), data = analysis ) summary(fit)
The term:
treatment:biomarker
represents the interaction.
Testing Interaction With a Cox Model
library(survival)
fit <- coxph(
Surv(time, event) ~
treatment * biomarker,
data = analysis
)
summary(fit)
The interaction term can be examined using the estimated coefficient, standard error, confidence interval, and corresponding hypothesis test.
Estimating Subgroup-Specific Effects
The interaction model can be used to derive subgroup-specific treatment effects.
Suppose:
When \(B=0\):
so:
When \(B=1\):
and therefore:
Ratio of Hazard Ratios
The relative difference between the subgroup-specific hazard ratios can be represented as:
Thus, the interaction coefficient has a direct interpretation in terms of the ratio of subgroup-specific hazard ratios.
Figure 3: Interaction Concept
Illustrative effect estimates only. Separation between point estimates should be interpreted using confidence intervals and the prespecified interaction analysis.
Biomarker-Stratified Kaplan-Meier Curves
For time-to-event endpoints, Kaplan-Meier curves can be displayed separately by treatment and biomarker group.
A common arrangement is:
- Panel A: biomarker-positive
- Panel B: biomarker-negative
The same time and survival scales should generally be used across panels when direct visual comparison is intended.
Do Not Overinterpret Kaplan-Meier Curve Separation
Visual separation between curves can be useful, but formal inference should come from the prespecified model and hypothesis tests.
Similarly, crossing Kaplan-Meier curves may indicate that a simple proportional hazards interpretation requires caution.
Biomarker Subgroup Forest Plots
Forest plots are particularly useful for displaying subgroup-specific treatment effects.
A typical display includes:
- Biomarker-positive estimate
- Biomarker-negative estimate
- Overall estimate
- 95% confidence intervals
- Interaction p-value where appropriate
Forest Plot Interpretation
A forest plot should emphasize the estimates and their uncertainty rather than simply whether each confidence interval crosses the null value.
For a hazard ratio:
is the usual null value.
Values below 1 favor the experimental treatment when lower hazard is beneficial.
Biomarker-Positive Enrichment vs. Stratification
| Feature | Stratified All-Comers | Enrichment |
|---|---|---|
| Biomarker-positive patients | Enrolled | Enrolled |
| Biomarker-negative patients | Enrolled | Usually excluded |
| Generalizability | Broader | Restricted |
| Direct evidence in negative group | Yes | No |
| Recruitment burden | Depends on prevalence | Can be high for rare biomarkers |
| Potential targeted effect | May be diluted by negative group | Can be more concentrated |
When Enrichment Can Be Attractive
An enrichment strategy can be compelling when strong prior evidence suggests that treatment benefit is concentrated in a clearly defined biomarker population.
For example, if the treatment mechanism directly targets a molecular alteration, restricting enrollment to patients carrying that alteration may provide a scientifically coherent development strategy.
However, the strength of the biomarker-treatment hypothesis should be considered carefully before excluding a large portion of the intended population.
When an All-Comers Design Can Be Preferable
An all-comers design may be preferred when:
- The treatment may benefit patients regardless of biomarker status.
- Evidence for biomarker prediction is uncertain.
- The biomarker assay is still developing.
- Generalizability is particularly important.
- The biomarker prevalence is low.
Multiple Biomarkers
Some trials evaluate several candidate biomarkers.
Suppose:
are evaluated.
The number of possible subgroups can increase rapidly, particularly if biomarkers are combined.
For two binary biomarkers, there are:
combinations.
For five binary biomarkers:
possible combinations exist.
Composite Biomarker Definitions
A biomarker strategy may define eligibility using several biological criteria.
For example:
or:
The logical definition must be explicit because changing the definition changes the analysis population.
Biomarker Misclassification
Suppose the true biological status is \(B^*\), but the observed assay result is \(B\).
If the assay has imperfect sensitivity and specificity, some patients may be misclassified.
For example:
and:
Misclassification can dilute observed differences between biomarker-defined treatment effects.
Biomarker Measurement Error
Measurement error becomes especially important when the biomarker is continuous.
Suppose:
where \(\epsilon\) represents measurement error.
This can make the observed biomarker-treatment relationship weaker than the underlying biological relationship.
Baseline Biomarker vs. On-Treatment Biomarker
Biomarkers measured before treatment and biomarkers measured after treatment have different roles.
| Biomarker timing | Typical interpretation |
|---|---|
| Baseline | Candidate predictor of treatment benefit or prognosis |
| Early on-treatment | Potential pharmacodynamic or response marker |
| Post-progression | Potential resistance or evolutionary marker |
A post-treatment biomarker should not automatically be interpreted as a baseline predictive biomarker because treatment itself may affect the marker.
Biomarker and Treatment Interaction: A Simple Numerical Example
Suppose the estimated treatment effects are:
| Biomarker | Experimental event rate | Control event rate |
|---|---|---|
| Positive | 20% | 40% |
| Negative | 38% | 40% |
The risk ratio in the positive subgroup is:
while in the negative subgroup:
The point estimates suggest substantially greater benefit in the biomarker positive group.
Whether that difference is statistically and clinically convincing requires uncertainty estimates and an appropriate interaction analysis.
Relative vs. Absolute Treatment Effects
Biomarker heterogeneity can look different depending on the effect measure.
For example, two groups may have similar relative risk reductions but very different absolute risk reductions because their baseline risks differ.
Therefore, biomarker analyses should consider both:
- Relative treatment effects
- Absolute treatment effects
Prognostic Biomarker Example
Suppose survival is worse among biomarker-negative patients in both treatment groups:
and:
where \(S\) denotes survival.
The biomarker may therefore be prognostic.
But if the treatment effect is similar:
there may be little evidence that the biomarker is predictive.
Predictive Biomarker Example
Now suppose:
and:
The treatment appears beneficial in the positive group but not the negative group.
This pattern raises the predictive biomarker hypothesis.
The interaction test and confidence intervals determine how strongly that hypothesis is supported.
Figure 4: Prognostic vs. Predictive Patterns
Illustrative values only. Prognostic and predictive effects should be evaluated using the appropriate model and prespecified hypotheses.
Subgroup Sample Size
Suppose a trial enrolls \(N\) patients and the biomarker-positive prevalence is \(q\).
The expected positive subgroup size is approximately:
and the negative subgroup:
If \(q\) is small, the positive subgroup may be underpowered for a treatment effect or interaction analysis.
Powering for Interaction
If the primary objective is to establish biomarker-dependent treatment effect, the sample-size calculation should target the expected difference in treatment effects.
For a simplified continuous endpoint, the interaction effect may be represented by:
where \(\Delta_+\) and \(\Delta_-\) are treatment effects in the two biomarker groups.
The smaller this difference, the more information may be required to detect it.
What Happens When Biomarker Prevalence Is Uncertain?
The biomarker prevalence used in sample-size planning is often estimated from previous studies or screening data.
If the actual prevalence is lower than expected, recruitment can take longer.
If the actual prevalence is higher, the trial may accrue biomarker-positive patients faster than expected.
Sensitivity analyses around prevalence assumptions can therefore be useful during operational planning.
Biomarker Cutoff Selection and Overfitting
Suppose investigators test many possible cutoffs:
and select the cutoff producing the largest apparent treatment effect.
The resulting estimate can be optimistically biased because the same data were used to discover and evaluate the subgroup.
This is a form of model-selection or subgroup-selection bias.
Validation of Biomarker Findings
A promising biomarker finding is stronger when it is supported by:
- Biological plausibility
- Prespecified hypotheses
- Validated assay methodology
- Consistent treatment-effect patterns
- Independent replication
- Appropriate statistical control
Biomarker Strategy in the Protocol
The protocol should describe the role of the biomarker clearly.
Important elements include:
- Biomarker definition
- Assay platform
- Sample collection requirements
- Testing timing
- Positive/negative cutoff
- Eligibility implications
- Randomization implications
- Primary and secondary analyses
- Handling of unknown results
Biomarker Strategy in the Statistical Analysis Plan
The SAP should define the statistical implementation.
Missing Biomarker Sensitivity Analyses
If biomarker status is missing for some randomized patients, sensitivity analyses may be useful.
Possible analyses include:
- Valid biomarker results only
- Alternative assumptions for missing classification
- Comparison of known versus unknown populations
- Assessment of assay-failure patterns
The appropriate strategy depends on why biomarker information is missing and how the biomarker is used in the trial.
Interaction Test vs. Separate Subgroup Tests
| Question | Appropriate analysis |
|---|---|
| Does treatment work in biomarker-positive patients? | Positive-group treatment effect |
| Does treatment work in biomarker-negative patients? | Negative-group treatment effect |
| Does treatment effect differ by biomarker? | Treatment-by-biomarker interaction |
| Is biomarker associated with prognosis? | Biomarker main effect / prognostic analysis |
Common Interpretation Error
Consider:
Even if the confidence intervals overlap substantially, the point estimates may still suggest a clinically interesting difference.
Conversely, if:
with large uncertainty, the evidence may be insufficient to establish predictive biomarker utility.
The conclusion should reflect the precision of the estimates rather than only the point estimates.
Forest Plot With Interaction P-Value
A useful confirmatory or supportive display might contain:
| Population | HR | 95% CI |
|---|---|---|
| Overall | 0.72 | 0.60–0.86 |
| Biomarker-positive | 0.52 | 0.39–0.69 |
| Biomarker-negative | 0.94 | 0.74–1.20 |
A corresponding interaction test might evaluate:
The interaction p-value should be interpreted together with the subgroup estimates and confidence intervals.
Biomarker-Stratified Randomization and Analysis Alignment
If biomarker status is used for randomization, the analysis plan should explain how that stratification is reflected in the primary analysis.
The exact model depends on the endpoint and the study's prespecified analysis strategy.
For example, a continuous endpoint may use:
outcome ~ treatment + biomarker + baseline_covariates
while a predictive biomarker analysis may add:
outcome ~ treatment * biomarker + baseline_covariates
Biomarker-Stratified Binary Endpoint Analysis
For a binary endpoint, treatment effects can be summarized using:
- Risk difference
- Risk ratio
- Odds ratio
For example:
or:
Absolute Treatment Benefit May Depend on Biomarker Risk
Suppose two biomarker groups have different control risks.
| Biomarker | Control risk | Treatment risk | Risk difference |
|---|---|---|---|
| Positive | 50% | 30% | −20 percentage points |
| Negative | 20% | 12% | −8 percentage points |
Both groups may have a similar relative treatment effect while having different absolute benefits.
This distinction can be important for clinical decision-making.
Biomarker and Number Needed to Treat
For a binary endpoint, the number needed to treat can be calculated from the absolute risk difference:
For a risk reduction from 50% to 30%:
For a reduction from 20% to 12%:
Thus, a biomarker can potentially identify populations with different absolute clinical benefit even when relative effects appear similar.
Post-Hoc Biomarker Analysis
Many clinical trials evaluate biomarkers after the primary analysis.
These analyses can be valuable for hypothesis generation.
However, post-hoc findings should generally be interpreted cautiously because:
- The subgroup may not have been prespecified.
- The cutoff may have been data-driven.
- Many candidate biomarkers may have been examined.
- Multiplicity may not have been controlled.
- Replication may be absent.
Prespecified vs. Post-Hoc Biomarker Analysis
| Characteristic | Prespecified | Post-hoc |
|---|---|---|
| Hypothesis defined before unblinding | Yes | Not necessarily |
| Cutoff predetermined | Usually | May be selected from data |
| Multiplicity strategy | Can be prospectively defined | Often exploratory |
| Confirmatory potential | Potentially stronger | Usually requires caution/validation |
| Hypothesis generation | Yes | Yes |
Biomarker Analysis and Regulatory Interpretation
Regulatory evaluation of a biomarker-supported treatment strategy generally requires consideration of the totality of evidence.
Important elements can include:
- Biological rationale
- Analytical validity of the biomarker assay
- Clinical validity
- Clinical utility
- Prespecified statistical hypotheses
- Magnitude and precision of treatment effects
- Interaction evidence
- Consistency across studies
- Population representativeness
Biomarker Analysis in Clinical Study Reports
A CSR may include biomarker analyses in several locations.
| CSR component | Potential content |
|---|---|
| Patient disposition | Biomarker testing and evaluability |
| Baseline characteristics | Biomarker prevalence |
| Efficacy | Biomarker-specific treatment effects |
| Forest plots | Subgroup effect estimates and confidence intervals |
| Safety | Safety by biomarker subgroup where relevant |
| Exploratory analyses | Additional biomarker relationships |
Safety Can Also Be Biomarker-Stratified
Biomarker subgroup analyses are not limited to efficacy.
Investigators may evaluate:
- Treatment-emergent adverse events
- Serious adverse events
- Dose interruptions
- Discontinuations due to adverse events
- Laboratory abnormalities
However, safety subgroup analyses are often descriptive unless specifically powered for comparison.
Biomarker Subgroups and Small Numbers
Small biomarker-positive populations can create unstable estimates.
For example, if only 20 patients are biomarker-positive, a difference of a few events can substantially change the estimated treatment effect.
Therefore, sparse subgroup results should be accompanied by:
- Exact event counts where appropriate
- Confidence intervals
- Clear denominators
- Cautious interpretation
Do Not Hide the Denominator
A statement such as:
is incomplete without knowing how many patients were evaluated.
For example:
has a very different level of information from:
even though the percentages are identical.
Biomarker Subgroup Tables
A useful efficacy table might contain:
| Biomarker | Treatment | Responders / N | Response Rate |
|---|---|---|---|
| Positive | Experimental | 48 / 100 | 48% |
| Positive | Control | 22 / 100 | 22% |
| Negative | Experimental | 35 / 150 | 23% |
| Negative | Control | 30 / 150 | 20% |
The table suggests a larger treatment difference in the biomarker-positive population.
Formal inference should still use the prespecified model.
Common Biomarker Design Mistakes
- Confusing prognostic and predictive biomarkers. An association with outcome does not establish treatment-effect modification.
- Comparing subgroup p-values instead of testing interaction. A significant result in one group and a non-significant result in another do not establish heterogeneity.
- Ignoring biomarker prevalence. Rare biomarkers can create major recruitment and power challenges.
- Dichotomizing a continuous biomarker without justification. Arbitrary cutoffs can discard information and introduce bias.
- Choosing a cutoff after examining treatment results. This can substantially inflate apparent evidence.
- Treating unknown biomarker status as negative. Assay failure and missingness require explicit handling.
- Ignoring assay performance. Biomarker misclassification can dilute or distort treatment-effect heterogeneity.
- Underpowering the interaction analysis. The trial may be powered for the overall effect but not for biomarker heterogeneity.
- Ignoring multiplicity. Many biomarkers and cutoffs can create false-positive findings.
- Overinterpreting small subgroup estimates. Sparse biomarker populations can produce wide and unstable confidence intervals.
Practical Biomarker Trial Design Workflow
R Example: Preparing Biomarker Data
analysis$biomarker <-
ifelse(
analysis$biomarker_score >= 50,
"Positive",
"Negative"
)
analysis$biomarker <-
factor(
analysis$biomarker,
levels = c("Negative", "Positive")
)
The cutoff should be replaced by the prespecified assay threshold rather than selected from the treatment outcome.
R Example: Biomarker-Stratified Summary
library(dplyr)
analysis %>%
group_by(
treatment,
biomarker
) %>%
summarise(
N = n(),
responders = sum(response == 1, na.rm = TRUE),
response_rate =
responders / N
)
R Example: Logistic Interaction Model
fit_logistic <- glm( response ~ treatment * biomarker, data = analysis, family = binomial() ) summary(fit_logistic)
The interaction term is represented by:
treatment:biomarker
R Example: Cox Interaction Model
library(survival)
fit_cox <- coxph(
Surv(time, event) ~
treatment * biomarker,
data = analysis
)
summary(fit_cox)
R Example: Forest Plot Preparation
forest_data <- data.frame(
subgroup = c(
"Overall",
"Biomarker Positive",
"Biomarker Negative"
),
estimate = c(
0.72,
0.52,
0.94
),
lower = c(
0.60,
0.39,
0.74
),
upper = c(
0.86,
0.69,
1.20
)
)
This data can then be passed to a forest-plot package or custom plotting routine.
R Example: Interaction Variable
analysis$treatment_biomarker <-
interaction(
analysis$treatment,
analysis$biomarker
)
Although explicit interaction terms in a model formula are usually preferable, this illustrates the underlying concept.
Model Diagnostics
Biomarker interaction models should be checked just like other clinical-trial models.
For example, for a Cox model consider:
- Proportional-hazards assumptions
- Influential observations
- Sparse events
- Model convergence
- Separation for binary outcomes
- Consistency of subgroup estimates
Continuous Biomarker Interaction
If the biomarker remains continuous, the interaction model can be written:
Here the treatment effect changes linearly with the biomarker value.
The treatment effect at biomarker level \(b\) is:
This can be useful when a biological gradient is expected.
Nonlinear Biomarker Effects
A linear interaction may be inappropriate if the treatment effect changes nonlinearly with biomarker level.
Flexible approaches can include:
- Restricted cubic splines
- Fractional polynomials
- Prespecified categories
- Other scientifically justified nonlinear models
More flexible models require additional attention to sample size, overfitting, and interpretation.
Biomarker Analysis and Estimands
The biomarker analysis should also be connected to the trial's estimand.
For example, the question might be:
or:
These are related but distinct questions.
Biomarker-Defined Estimand
A well-defined biomarker estimand should specify:
- Population
- Treatment conditions
- Endpoint
- Summary measure
- Relevant intercurrent-event strategy
The biomarker subgroup itself should also be clearly defined.
Biomarker Subgroups and Intercurrent Events
Treatment discontinuation, rescue therapy, crossover, and other intercurrent events can affect biomarker subgroup estimates just as they affect the overall analysis.
The handling strategy should therefore be consistent with the prespecified estimand.
Biomarker Results Should Be Traceable
A regulatory-quality biomarker analysis should allow the analyst to trace:
This traceability is especially important when biomarker classification affects eligibility or a potentially label-defining treatment population.
Biomarker Quality-Control Checklist
What Should Be Shown in a Biomarker Forest Plot?
A high-quality forest plot should generally show:
- Subgroup label
- Number of patients
- Number of events, when applicable
- Treatment-effect estimate
- Confidence interval
- Reference/null line
- Interaction information where relevant
The figure should make clear whether subgroup results are confirmatory or exploratory.
How to Read a Biomarker Forest Plot
Start with the overall treatment effect.
Then examine the biomarker-positive and biomarker-negative estimates.
Next, compare the confidence intervals.
Finally, evaluate the formal interaction result.
Do not begin by simply counting how many confidence intervals cross the null.
A Useful Interpretation Framework
What a Biomarker-Stratified Trial Can Reveal
A well-designed biomarker trial can help answer several important questions:
- Does the treatment work overall?
- Is the biomarker prognostic?
- Does treatment benefit differ by biomarker status?
- Is benefit concentrated in one biomarker population?
- Is benefit present in both populations?
- How large is the absolute benefit?
- How reproducible is the biomarker-treatment relationship?
What It Cannot Establish by Itself
A single biomarker subgroup analysis cannot automatically establish:
- Causality of the biomarker-treatment relationship
- Clinical utility of every assay implementation
- Generalizability to unstudied populations
- Validity of an unvalidated cutoff
- Reproducibility of an exploratory finding
Best Practices for Confirmatory Biomarker Trials
- Define the biomarker hypothesis prospectively.
- Use a clinically justified assay.
- Prespecify the biomarker cutoff.
- Estimate prevalence realistically.
- Plan recruitment around biomarker prevalence.
- Distinguish prognostic from predictive hypotheses.
- Power the study for the intended claim.
- Use an appropriate interaction analysis when heterogeneity is the question.
- Control multiplicity for confirmatory biomarker claims.
- Report confidence intervals, not only p-values.
- Clearly identify exploratory analyses.
- Validate promising biomarker findings independently.
Biomarker Trial Design Specification
| Specification | Example |
|---|---|
| Population | Patients with advanced disease meeting protocol eligibility criteria |
| Biomarker | Prespecified binary assay result |
| Cutoff | Validated assay threshold |
| Randomization | 1:1 within biomarker strata |
| Primary endpoint | Overall survival |
| Primary population | All randomized patients |
| Biomarker analysis | Prespecified subgroup treatment effects |
| Interaction | Treatment × biomarker |
| Missing biomarker | Handled according to prespecified rules |
| Multiplicity | Defined in the SAP |
Example Statistical Analysis Plan Language
Clinical Interpretation Example
Suppose the final study produces:
| Population | HR | 95% CI |
|---|---|---|
| Overall | 0.72 | 0.61–0.85 |
| Biomarker-positive | 0.50 | 0.38–0.66 |
| Biomarker-negative | 0.92 | 0.73–1.16 |
A reasonable interpretation would be that the experimental treatment is associated with improved outcome overall, with a larger estimated treatment effect in the biomarker-positive subgroup.
However, whether the biomarker is truly predictive depends on the interaction analysis, prespecification, assay validity, multiplicity, and consistency of the evidence.
One of the Most Important Lessons
Biomarker analysis is not simply:
The central question for a predictive biomarker is:
That is fundamentally an interaction question.
Summary Checklist
References
U.S. Food and Drug Administration. Enrichment Strategies for Clinical Trials to Support Approval of Human
Drugs and Biological Products.
Guidance for Industry.
U.S. Food and Drug Administration. In Vitro Companion Diagnostic Devices.
Guidance for Industry and Food and Drug Administration Staff.
U.S. Food and Drug Administration. Principles for Codevelopment of an In Vitro Companion Diagnostic
Device with a Therapeutic Product.
Guidance for Industry and Food and Drug Administration Staff.
U.S. Food and Drug Administration. Adaptive Designs for Clinical Trials of Drugs and Biologics.
Guidance for Industry.
European Medicines Agency. Guideline on clinical trials in small populations.
European Medicines Agency. Guideline on good pharmacogenomic practice.
Simon, R. and Maitournam, A. Evaluating the efficiency of targeted designs for randomized clinical
trials. Clinical Cancer Research.
Simon, R. Clinical trials for evaluating predictive biomarkers. Journal of the National Cancer Institute.
Freidlin, B. and Korn, E.L. Biomarker enrichment strategies: strengths and limitations. Journal of Clinical Oncology.