Tutorials › Adaptive Clinical Trial Design › Changing the Target Population

Why and How Trials Adapt · Tutorial 8 of 799

Changing the Target Population

Understand when narrowing eligibility may be useful, how to plan and assess the change, and why a result in an enriched group may not apply to the broader patient population.

Beginner 10 min read

What You'll Learn

  • Distinguish changing eligibility from enriching a trial for a defined patient subgroup.
  • Explain why a biomarker associated with outcome is not necessarily predictive of treatment benefit.
  • Identify design and analysis risks when eligibility changes during recruitment.
  • Calculate how subgroup effects and subgroup prevalence relate to an overall average effect.
  • Assess recruitment consequences and the limits on applying an enriched-trial result.

Why Change Who Can Enter a Trial?

A trial’s eligibility criteria define which patients can participate. Sometimes evidence or practical experience suggests that the treatment may work differently across patient groups. A planned adaptation may then narrow eligibility to a group considered more likely to benefit, or otherwise change the characteristics required for entry. This can make the trial more focused, but it also changes who the trial can provide evidence about.

Changing eligibility is not simply a way to improve a result. It involves a trade-off: a narrower group may have a stronger treatment effect or a more feasible study, while the findings may be less applicable to patients who no longer qualify. The rationale, timing, decision rule, and consequences for recruitment and analysis therefore need to be considered before the change is made.

Definition: A target population is the group of patients to whom a trial’s intended treatment comparison is meant to apply. A change in eligibility modifies which patients may enter. Population enrichment is a planned restriction or selection of eligibility intended to increase the representation of patients with a characteristic that may be associated with greater treatment benefit or a more informative treatment comparison.

Enrichment may use a baseline characteristic measured before randomization, such as a laboratory marker, disease stage, or prior treatment history. The characteristic should be measured consistently, and the rule determining eligibility should be operationally clear. For example, “marker-positive” must correspond to a defined assay and threshold, rather than a judgment made differently across sites.

What Evidence Supports Enrichment?

A characteristic can be associated with a better outcome without identifying patients who benefit more from the experimental treatment. For instance, marker-positive patients might have better outcomes in both randomized groups. That pattern is prognostic: the marker is associated with outcome. A marker is predictive of differential treatment benefit when the treatment contrast differs across marker groups.

Randomized comparisons within marker groups can help assess whether treatment effects differ. A favorable outcome among marker-positive patients receiving the experimental treatment alone is not enough: their outcomes must be compared with those of similar marker-positive patients assigned to control. Nor does observing a promising result in one group automatically establish that the treatment effect truly differs between groups. Differences can arise from random variation, particularly when many subgroups are considered.

A population adaptation should therefore be supported by a prespecified rationale and a clear rule. The rule may rely on external evidence, blinded information about the distribution of a baseline characteristic, or interim treatment comparisons. These sources raise different statistical concerns. In particular, using unblinded outcomes to select a subgroup and then treating the selected subgroup’s result as if it had been chosen in advance can overstate evidence. If treatment outcomes influence the adaptation, the design and analysis must account for that selection and preserve appropriate error control.

Worked Example: A Prognostic Marker Is Not Automatically Predictive

Suppose a hypothetical randomized trial reports the proportion of patients who improve by 12 weeks. In the marker-positive group, 60 of 100 patients improve on the experimental treatment and 48 of 100 improve on control. In the marker-negative group, 36 of 100 improve on the experimental treatment and 24 of 100 improve on control. Calculate the treatment differences and explain what they suggest.

The treatment difference in the marker-positive group is

$$ \hat{p}_{E,+}-\hat{p}_{C,+}=\frac{60}{100}-\frac{48}{100}=0.60-0.48=0.12. $$

That is a 12-percentage-point higher observed improvement proportion on the experimental treatment. In the marker-negative group, the difference is

$$ \hat{p}_{E,-}-\hat{p}_{C,-}=\frac{36}{100}-\frac{24}{100}=0.36-0.24=0.12. $$

The marker-positive group has higher improvement proportions in both treatment groups, but the observed treatment differences are the same: 12 percentage points in each group. These hypothetical data therefore illustrate a prognostic pattern, not a larger observed treatment benefit in marker-positive patients. They do not prove the true treatment effects are identical; sampling uncertainty would also need consideration. Enrichment based only on the higher outcome rate in marker-positive patients would not be justified as a way to target greater treatment benefit.

Changing Eligibility During Recruitment

When eligibility changes after a trial begins, the adaptation must specify how the new rule will be applied. A basic plan states the criteria before and after the change, the date or information that triggers it, how existing participants are handled, and which analyses will address the resulting groups. These details help prevent an informal shift in eligibility based on individual cases or emerging results.

After the change, patients who were eligible earlier may differ from those eligible later. They may have different disease severity, access to care, background treatment, or likelihood of enrolling. Calendar time may also coincide with changes in clinical practice or recruitment sites. If treatment effects vary across these characteristics, combining all participants without accounting for the change can obscure what comparison is being made.

Randomization should continue to support a fair treatment comparison among patients eligible under the rule in force at their enrollment. Concurrent randomized controls are especially important: comparing experimental-treatment patients enrolled after a change with control patients enrolled only before it can confound treatment with calendar time. When the adaptation uses outcomes observed during the trial, the analysis must also consider how that data-dependent selection affects statistical error rates. Randomization alone does not make every post-selection analysis valid.

Worked Example: Interpreting an Overall Effect After Enrichment

Consider a hypothetical population with two baseline groups. Assume 40% of patients are marker-positive and 60% are marker-negative. Suppose the true treatment benefit, expressed as an absolute increase in the probability of improvement, is 12 percentage points for marker-positive patients and 4 percentage points for marker-negative patients. Under the simplifying assumptions that these proportions describe the population and that the group-specific effects apply to all patients in each group, calculate the population-average benefit.

The overall benefit is the group-specific benefit weighted by each group’s prevalence:

$$ (0.40)(0.12)+(0.60)(0.04)=0.048+0.024=0.072. $$

The population-average benefit is 0.072, or 7.2 percentage points. A trial restricted to marker-positive patients would instead directly study the 12-percentage-point benefit in that group. It would not, by itself, estimate the 7.2-percentage-point average for the full population. That broader average requires information about the other group and its prevalence, as well as the stated assumptions. In real studies, estimates are uncertain; these calculations illustrate the distinction rather than establish a treatment effect.

The calculation shows why “the treatment worked in the enriched trial” and “the treatment benefits the general patient population” are not interchangeable conclusions. The first concerns the enrolled, enriched group. The second needs evidence supporting extension beyond that group, including evidence about patients excluded by the adaptation.

Recruitment and Applicability

Narrower criteria commonly reduce the pool of eligible patients. The reduction can be substantial if the characteristic is uncommon, requires a specialized test, or is difficult to measure at participating sites. Screening may take longer, testing may add expense or delay, and some patients may become ineligible after initial assessment. Recruitment projections should be recalculated using the new criteria rather than carried forward from the original plan.

Worked Example: A Narrower Criterion and Recruitment Time

A hypothetical trial site expects to identify 20 potentially eligible patients each month under its original criteria. A new biomarker requirement is expected to be met by 30% of them. Assume the site can screen all 20 each month, the 30% rate remains stable, and every biomarker-positive patient is willing and able to enroll. Estimate the new monthly enrollment and the time to enroll 48 patients at one site.

Expected monthly enrollment is

$$ 20 \text{ patients/month}\times 0.30=6 \text{ patients/month}. $$

At that rate, the expected time for 48 enrollments is

$$ \frac{48 \text{ patients}}{6 \text{ patients/month}}=8 \text{ months}. $$

This is a planning calculation, not a guarantee. It assumes a stable flow of patients and ignores refusals, screen failures, and variation across months. If only 80% of biomarker-positive patients enroll, the expected rate would instead be \(6(0.80)=4.8\) patients per month, and 48 enrollments would take \(48/4.8=10\) months on average. The recruitment plan should examine such realistic losses and site-to-site variation.

Applicability is also affected by how patients differ from those who were eligible. If the adaptation excludes groups that are common in clinical practice, the trial’s direct evidence will be limited for those groups. The direction and size of any resulting difference cannot be inferred merely from the fact that the criteria narrowed. It depends on whether treatment effects and relevant patient characteristics differ.

A Practical Assessment and Common Pitfalls

A useful assessment asks what the trial gains and what evidence it gives up. The following steps make that trade-off explicit.

1
Define the intended group.
State the clinical reason for the proposed criteria and identify which patients will become eligible or ineligible.
2
Specify the rule.
Set the measurement method, threshold, timing, and decision process in advance. Clarify whether the rule uses external, blinded, or unblinded information.
3
Check recruitment feasibility.
Estimate how many patients meet the new criteria, how many will consent, and whether screening and follow-up remain practical.
4
Protect a valid comparison.
Maintain appropriate randomization and concurrent controls, and plan analyses that reflect the adaptation and any outcome-based selection.
5
State the scope of the conclusion.
Describe which patients the resulting evidence directly concerns and avoid assuming it applies equally to excluded groups.

A common mistake is to reason, “The subgroup had a better outcome, so the trial should enroll only that subgroup.” This fails if the subgroup’s outcome was better in both randomized groups, because that is not evidence of a larger treatment effect. It also fails if the subgroup was selected after looking at noisy treatment comparisons and the analysis ignores that selection. The correction is to compare randomized treatments within groups, assess whether their treatment contrasts differ, and use a prespecified, statistically appropriate adaptation and analysis plan.

Another mistake is to regard a more homogeneous or enriched sample as automatically superior. It may improve focus, but can slow recruitment, reduce representation, and leave uncertainty about patients outside the criteria. Enrichment is most defensible when there is a strong rationale for the group, a reliable identification method, a feasible recruitment plan, and a clear account of the limits on applying results more broadly.

Unlike changing a treatment arm, changing eligibility alters which patients enter the comparison. Both kinds of adaptation need a prespecified rule and careful interpretation, but population changes raise a particular question: whether the evidence remains relevant to the patients clinicians will later consider treating. No single enrichment strategy resolves that question for every trial.

Key takeaway: A planned eligibility change can focus a trial on patients plausibly more likely to benefit, but it does not by itself establish that benefit or preserve broad applicability. Distinguish prognostic from predictive evidence, plan recruitment and analysis around the new criteria, and make the population to which conclusions apply explicit.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. In a hypothetical trial, a marker-positive group has better outcomes than a marker-negative group in both randomized arms. What additional comparison is needed before claiming the marker identifies greater treatment benefit?
  2. A trial enrolls 50% marker-positive and 50% marker-negative patients. The treatment benefit is 10 percentage points in the positive group and 2 percentage points in the negative group. Under these assumed proportions and effects, what is the overall average benefit?
  3. A revised eligibility rule is expected to reduce eligible patient flow from 16 to 5 patients per month. Approximately how long would enrollment of 30 patients take at that rate, assuming stable flow and no other losses?
  4. Why can comparing patients assigned to experimental treatment after an eligibility change with control patients enrolled before the change be misleading?

Solutions. (1) Compare the randomized treatment contrasts within the marker-positive and marker-negative groups, and assess whether those contrasts differ. Higher outcomes in the positive group in both arms alone show a prognostic association, not necessarily greater treatment benefit. (2) Weight the group effects by prevalence: \((0.50)(0.10)+(0.50)(0.02)=0.05+0.01=0.06\), or 6 percentage points. This relies on the stated group proportions and effects. (3) \(30 \text{ patients}/(5 \text{ patients/month})=6\) months, as an approximate planning expectation under the assumptions. (4) Treatment assignment would be entangled with calendar time and potentially with the different eligibility rules; changes in patients, sites, or care over time could contribute to the observed difference. Concurrent randomized controls and an analysis that reflects the adaptation are needed for a defensible comparison.

Clinical Biostats