Tutorials › Adaptive Clinical Trial Design › Worked Example Of Binary-Marker Enrichment

Population Enrichment and Subgroup Selection · Tutorial 455 of 799

Worked Example Of Binary-Marker Enrichment

Work through how prevalence, treatment effects, recruitment, interim selection, and independent confirmation fit together in a binary-marker enrichment design.

Advanced 12 min read

What You'll Learn

  • Translate marker prevalence into expected eligible and screened counts.
  • Calculate a two-arm sample size for a continuous endpoint in the marker-positive subgroup.
  • Specify a practical, prespecified interim rule for continuing with marker-positive recruitment.
  • Explain how independent confirmatory data can support a marker-positive treatment claim after selection.
  • Distinguish evidence of benefit in a subgroup from evidence that the marker predicts differential benefit.

From a Marker Assumption to an Enrichment Design

A binary predictive marker divides patients into two prespecified groups, such as marker-positive and marker-negative. An enrichment design uses that classification to direct recruitment toward a group expected to benefit more. The design problem is not only whether the marker-positive treatment effect is large enough. It also requires a defensible eligibility definition, enough marker-positive patients, a rule for deciding whether to enrich, and a final analysis whose claim matches the population actually studied.

The worked design below uses a continuous endpoint measured in units, with higher values defined as better. Every number is hypothetical. Assume the marker assay and cutoff have already been externally validated, the marker is measured before randomization, and treatment is randomized within marker-positive patients. The design uses a separate confirmatory stage so that the interim selection data do not also supply the efficacy test for the final marker-positive claim.

Definition: Let \(M=1\) denote marker-positive status and \(M=0\) marker-negative status, determined by a prespecified assay and cutoff. Marker prevalence is \(\pi=P(M=1)\) in the target recruitment population. Let \(\Delta_1\) and \(\Delta_0\) denote the treatment-minus-control mean differences in the marker-positive and marker-negative groups, respectively. A marker-positive enrichment design recruits or retains patients with \(M=1\) for the relevant treatment comparison. Its direct efficacy claim concerns \(\Delta_1\), not automatically the treatment effect in all patients.

Specify the Population and Recruitment Before Calculating

Suppose the target population has marker prevalence \(\pi=0.40\). A trial first enrolls 200 patients as an all-comer stage, randomized equally between treatment and control. The expected marker-positive count is \(200(0.40)=80\), or about 40 per arm. These are expectations, not guaranteed counts: actual marker prevalence and arm-specific counts vary by chance. The assay is performed before randomization so that marker status can define eligibility and subgroup analyses without being affected by treatment.

If the trial proceeds to marker-positive-only recruitment, it must screen enough people to obtain the required number of eligible patients. With prevalence 0.40, obtaining 108 marker-positive patients would require an expected \(108/0.40=270\) people screened. The expected count is a planning quantity, not a promise; screening targets should allow for variation in prevalence, assay failures, and other exclusions. Recruitment projections should also use the prevalence expected at the actual sites and during the actual recruitment period.

Worked Example: Translating Prevalence Into Screening

A confirmatory stage needs 48 evaluable marker-positive patients in each randomized arm. Assume 10% of randomized patients will not provide an evaluable endpoint, and use prevalence \(\pi=0.40\). How many patients should be randomized and screened, approximately?

To retain 48 evaluable patients per arm after 10% non-evaluability, the required randomized count per arm is \(48/(1-0.10)=53.33\). Rounding up gives 54 per arm, or 108 marker-positive patients randomized in total.

At prevalence 0.40, the expected number screened to identify 108 eligible patients is \(108/0.40=270\). Thus the planning target is 108 marker-positive patients randomized, with about 270 people screened on average. Screening more or fewer may be needed because prevalence and non-evaluability are uncertain. The randomized sample remains balanced at 54 per arm; the screen count is not an additional randomized sample.

Size the Confirmatory Comparison in the Target Subgroup

For a transparent calculation, assume the endpoint in each treatment arm is normally distributed within marker-positive patients, with the same known standard deviation \(\sigma=12\) units. Assume independent outcomes, independent randomization, no interference between patients, and a treatment effect expressed as a difference in means. Plan a two-sided test of \(H_0:\Delta_1=0\) at \(\alpha=0.05\), with 90% power to detect \(\Delta_1=8\) units. The known-\(\sigma\) normal calculation is an illustrative planning model; a real protocol would justify its variance assumption and use an analysis appropriate to the endpoint and missing-data plan.

With \(n\) evaluable marker-positive patients per arm, the estimated treatment-minus-control difference has standard error \(\sigma\sqrt{2/n}\). Under the alternative \(\Delta_1=8\), its standardized mean is \(8/(\sigma\sqrt{2/n})\). For a two-sided test, the usual normal-approximation sample-size formula is:

$$ n=\frac{2\sigma^2(z_{1-\alpha/2}+z_{1-\beta})^2}{\Delta_1^2} $$

Here \(z_{1-\alpha/2}=1.960\), and 90% power means \(\beta=0.10\), so \(z_{1-\beta}=1.282\). The calculation is:

$$ n=\frac{2(12^2)(1.960+1.282)^2}{8^2} =\frac{288(3.242)^2}{64} =\frac{288(10.510564)}{64} =\frac{3027.042432}{64} =47.2975 $$

The result is rounded up to 48 evaluable patients per arm. Rounding down would not meet the planned sample size. At \(n=48\), the standard error under the assumed model is \(12\sqrt{2/48}=2.449\) units. The standardized mean under the target effect is \(8/2.449=3.266\); the probability of exceeding the upper two-sided critical value is approximately \(\Phi(3.266-1.960)=\Phi(1.306)=0.904\), with a negligible lower-tail contribution. Thus 48 per arm provides approximately 90.4% power under these assumptions.

Worked Example: Checking the Sample-Size Result

Suppose the design team proposes 40 evaluable marker-positive patients per arm instead of 48. Under the same assumptions, does that retain 90% power to detect an 8-unit difference?

At \(n=40\), the standard error is \(12\sqrt{2/40}=2.683\) units. The standardized mean under the target effect is \(8/2.683=2.982\). For a two-sided 5% test, the approximate power is \(\Phi(2.982-1.960)+\Phi(-2.982-1.960)\), or approximately \(\Phi(1.022)+\Phi(-4.942)=0.847\). The lower-tail term is negligible, so power is about 84.7%, below 90%. Forty per arm does not meet the stated design target.

Prespecify the Interim Selection Rule

In the hypothetical design, the all-comer stage enrolls 200 patients, with treatment randomized 1:1. An independent review occurs after this stage has complete endpoint data. The prespecified rule is to continue into marker-positive-only recruitment if (1) at least 35 marker-positive patients are evaluable in each arm, (2) the observed marker-positive treatment-minus-control difference is at least 4 units, and (3) no prespecified safety stopping condition is met. Otherwise, the trial does not proceed to the enriched confirmatory stage.

The 4-unit threshold is a decision threshold for this hypothetical design, not a proof of efficacy or predictive value. It balances the possibility of an encouraging but noisy stage-one estimate against the cost of continuing. The minimum subgroup count guards against making the decision from an extremely sparse comparison. The rule must be fixed before examining the interim outcomes, with the endpoint definition, analysis set, missing-data handling, timing, and safety review also specified in the protocol.

Worked Example: Applying the Interim Rule

In a hypothetical interim review, 41 treatment and 39 control patients are evaluable in the marker-positive group. Their mean endpoint values are 5.6 and 0.4 units, respectively. Assume no safety stopping condition is present. Apply the rule.

The observed marker-positive difference is \(5.6-0.4=5.2\) units. The group counts, 41 and 39, both meet the minimum of 35. The estimated difference, 5.2 units, exceeds the 4-unit threshold, and no safety condition is triggered. All three conditions are satisfied, so the prespecified decision is to continue with marker-positive-only recruitment.

This decision does not establish that the true marker-positive effect is 5.2 units, that treatment is effective, or that marker status predicts differential benefit. The estimate is used to select a population for further study. Because the confirmatory efficacy test will use new patients, the interim estimate is not pooled into that test in this design.

Confirmatory Analysis and the Scope of the Claim

After selection, the trial randomizes new marker-positive patients, independently of the stage-one participants, to treatment or control. The confirmatory target is 48 evaluable patients per arm. Under the planned model, a stage-two comparison uses the difference in means and its standard error. For this simple design, a two-sided test is conducted at \(\alpha=0.05\). The final confirmatory claim is restricted to marker-positive patients represented by the assay-defined eligibility rule and trial setting.

Worked Example: Interpreting a Confirmatory Result

Suppose the independent confirmatory stage has 48 evaluable marker-positive patients in each arm. The treatment mean is 5.0 units and the control mean is \(-3.1\) units. For illustration, assume the prespecified analysis uses the known common standard deviation of 12 units. Test \(H_0:\Delta_1=0\) against a two-sided alternative and give an interval estimate.

The estimated difference is \(5.0-(-3.1)=8.1\) units. The standard error is \(12\sqrt{1/48+1/48}=2.449\) units, so the test statistic is \(z=8.1/2.449=3.307\). The two-sided p-value is approximately 0.00094, below 0.05.

A 95% confidence interval is \(8.1\pm1.960(2.449)=8.1\pm4.801\), or approximately 3.30 to 12.90 units. Under the stated model, the data are inconsistent with a zero marker-positive mean difference at the 5% level, and the estimated treatment benefit is 8.1 units. The interval procedure has 95% coverage over repeated samples under its assumptions; it does not mean there is a 95% probability that this fixed effect lies in this particular interval. The supported efficacy claim is for marker-positive patients, not for marker-negative patients or for the overall population.

The separation of selection and confirmation has a useful error-rate justification. Let \(S\) denote the stage-one data and the decision to continue, and let \(Z_2\) be the stage-two confirmatory statistic. Under the null hypothesis for the marker-positive effect, suppose the stage-two data are independent of \(S\) and the prespecified stage-two test has size \(\alpha\). Then, for every selection outcome \(S\) that leads to continuation, \(P(\text{reject }H_0\mid S)\leq\alpha\). Averaging over the possible selection outcomes gives:

$$ P(\text{reject }H_0\text{ and continue}) =E\left[P(\text{reject }H_0\mid S)I(\text{continue})\right] \leq \alpha P(\text{continue}) \leq \alpha $$

Thus the stage-two test retains its type I error bound despite selection based on stage one, provided the confirmatory observations and test are genuinely independent of the selection data and the analysis is prespecified. This justification does not license unplanned pooling of stage-one and stage-two observations or reuse of a stage-one p-value as if it were independent confirmation.

Predictive Evidence, Population Effects, and Limitations

A statistically significant treatment effect among marker-positive patients is evidence about \(\Delta_1\). It is not, by itself, evidence that the marker is predictive. A predictive claim concerns whether treatment effects differ by marker status, represented by the interaction contrast \(\Delta_1-\Delta_0\). Finding a significant result in the positive group and a nonsignificant result in the negative group does not establish that contrast: the two subgroup estimates may differ only because their precision differs. The earlier material on interaction tests and within-subgroup tests distinguishes these questions.

Likewise, a marker-positive efficacy result does not establish benefit in the full target population. If both subgroup effects and prevalence were known and the target population were represented by those assumptions, the population-average treatment difference would be \(\pi\Delta_1+(1-\pi)\Delta_0\). For example, with \(\pi=0.40\), \(\Delta_1=8\) units, and \(\Delta_0=1\) unit, the weighted difference is \(0.40(8)+0.60(1)=3.8\) units. A positive-only confirmatory stage does not estimate \(\Delta_0\), so it cannot alone support that all-patient average-effect calculation.

The design also depends on the assay correctly classifying patients at the validated cutoff, the prevalence being sufficiently close to its planning value for recruitment, the assumed endpoint variance being credible, and the treatment effect target being clinically meaningful. Prevalence affects how many people must be screened, but does not change the definition of the marker-positive treatment effect. If the clinical setting, assay performance, or patient mix differs materially from the validation setting, transport of the result requires separate justification.

A common mistake is to call the marker predictive because the marker-positive subgroup has a small p-value while the marker-negative subgroup does not. That reasoning compares two significance labels, not the subgroup effects themselves. The correction is to distinguish a positive-subgroup efficacy claim from a predictive claim: the former tests \(\Delta_1\), while the latter requires direct evidence about \(\Delta_1-\Delta_0\) under a design and analysis that support that comparison.

Other warning signs include fewer evaluable marker-positive patients than planned, screening yield far below the prevalence assumption, major imbalance in subgroup counts, incomplete interim endpoint data, or an assay/cutoff change after outcomes are seen. These can undermine power, the selection decision, or the scope of generalization. The stated normal model is also an approximation: skewness, heavy tails, unequal variances, site effects, or informative missingness may require a different analysis and sample-size calculation. A design should state its assumptions, monitor recruitment and data quality, and not reinterpret a failed or altered design as if the original confirmatory claim were unchanged.

1
Define the target.
Fix the assay, cutoff, endpoint, marker-positive estimand, and clinical effect worth detecting.
2
Plan recruitment.
Use prevalence to project screening, then inflate randomized counts for expected non-evaluability where justified.
3
Set the interim rule in advance.
Specify subgroup minimums, the selection threshold, timing, and safety criteria before examining interim effects.
4
Keep the claim aligned with the evidence.
Use independent confirmatory data for the selected population and distinguish subgroup benefit from predictive interaction.

Check Your Understanding

Answer each question, then compare with the solutions below.

  1. If marker prevalence is 0.25, how many people must be screened on average to identify 60 marker-positive patients?
  2. With 48 evaluable patients per arm and a common known standard deviation of 12 units, what is the standard error of the difference in means?
  3. In the worked interim example, why does a 5.2-unit observed marker-positive difference not itself establish efficacy?
  4. If the marker-positive test is significant and the marker-negative test is not, what additional issue must be examined before claiming the marker predicts treatment benefit?

Solutions. (1) The expected screening count is \(60/0.25=240\) people; actual yield varies. (2) \(SE=12\sqrt{1/48+1/48}=2.449\) units. (3) It is a noisy stage-one estimate used by a prespecified selection rule; confirmatory efficacy is assessed on independent stage-two data. (4) The treatment-effect contrast \(\Delta_1-\Delta_0\) must be assessed directly; separate significance labels do not test whether the subgroup effects differ.

Clinical Biostats