Tutorials › Adaptive Clinical Trial Design › Preserving the Target During Biomarker Enrichment

Estimand Preservation Under Adaptation · Tutorial 33 of 799

Preserving the Target During Biomarker Enrichment

Learn how biomarker-based eligibility changes alter the target population, and how fixed population weights can preserve an all-comer estimand when enrichment narrows enrollment.

Advanced 12 min read

What You'll Learn

  • Define all-comer and biomarker-positive treatment-effect targets using a baseline biomarker.
  • Decompose an all-comer mean treatment effect into biomarker-stratum effects and population weights.
  • Identify which target a positive-only enrollment stage directly represents.
  • Distinguish target-population weights from the changing proportions enrolled in each stage.
  • Check whether the data support estimating a fixed all-comer target after enrichment.

Why the Target Can Change When Eligibility Narrows

Biomarker enrichment can make a trial more focused: after an interim decision, eligibility may narrow to patients who test positive for a baseline biomarker. But narrowing eligibility also changes the population represented by new enrollees. A treatment effect estimated from the positive-only stage is not automatically an effect for all eligible patients. The central question is therefore not only who is randomized after adaptation, but which population the treatment-effect estimand is intended to describe.

The distinction matters even when the treatment conditions, outcome, and analysis method remain unchanged. If treatment effects differ between biomarker-positive and biomarker-negative patients, a change in the proportion enrolled from each group can change the overall effect. The target population and its weights must therefore be specified separately from the trial’s evolving eligibility rules.

Definition: Let \(B=1\) denote biomarker-positive status at baseline and \(B=0\) denote biomarker-negative status. Let \(Y(1)\) and \(Y(0)\) be the outcomes that a member of the target population would have under the treatment and control strategies, respectively. For a mean-difference outcome summary, define \(\Delta_+=E[Y(1)-Y(0)\mid B=1]\) and \(\Delta_-=E[Y(1)-Y(0)\mid B=0]\). The all-comer estimand is \(\Delta_{\mathrm{all}}=E[Y(1)-Y(0)]\) in the specified all-comer target population. The biomarker-positive estimand is \(\Delta_+\) in the specified positive subgroup. A weighted population estimand is \(\Delta_w=w\Delta_+ +(1-w)\Delta_-\), where \(w\) is the prespecified proportion of biomarker-positive patients in the target population represented by the weights.

The word “target” is essential in these definitions. The value of \(w\) is not necessarily the proportion positive among patients enrolled after the adaptation, nor the proportion positive in the final trial sample. For an all-comer target population, \(w\) should represent the positive proportion in that target population. If the intended target is a different population, its stratum proportions may define different weights. Earlier material on fixed baseline subgroup estimands and weighted population estimands establishes why these choices should be tied to the population of interest rather than selected after seeing the results.

How the Three Targets Relate

For a mean-difference estimand, the all-comer effect has an exact decomposition into the two biomarker-stratum effects. Write \(q=P(B=1)\) for the positive proportion in the all-comer target population. By the law of total expectation, the mean outcome under each treatment strategy is the weighted average of its stratum-specific means. Subtracting those two averages gives:

$$ \begin{aligned} \Delta_{\mathrm{all}} &=E[Y(1)]-E[Y(0)]\\ &=qE[Y(1)\mid B=1]+(1-q)E[Y(1)\mid B=0]\\ &\quad-\left\{qE[Y(0)\mid B=1]+(1-q)E[Y(0)\mid B=0]\right\}\\ &=q\Delta_+ +(1-q)\Delta_-. \end{aligned} $$

Thus, the all-comer target is retained by a weighted estimand with \(w=q\), provided the stratum effects refer to the same target population and treatment strategies. The biomarker-positive estimand is a different target unless the all-comer target itself consists entirely of positive patients or the stratum effects happen to coincide. Equality of effects would make the numerical estimates equal, but it would not make their target populations identical.

This decomposition is specific to a mean difference, because differences of weighted means decompose linearly. For another outcome summary, such as a ratio of odds, one should define the desired population-level summary first and standardize the relevant outcome distributions or means accordingly; simply averaging subgroup-specific ratios need not produce the marginal ratio for the target population.

Worked Example: Converting Subgroup Effects to an All-Comer Target

Suppose a hypothetical trial’s intended all-comer population is 40% biomarker-positive. The treatment effect on a continuous outcome is a mean improvement of 8 points in the positive subgroup and 2 points in the negative subgroup. Calculate the all-comer mean treatment effect and compare it with the positive-subgroup effect.

Here \(q=0.40\), \(\Delta_+=8\) points, and \(\Delta_-=2\) points. By the decomposition:

$$ \Delta_{\mathrm{all}} =q\Delta_+ +(1-q)\Delta_- =(0.40)(8)+(0.60)(2) =3.2+1.2 =4.4\text{ points}. $$

The biomarker-positive estimand is 8 points; the all-comer estimand is 4.4 points. Reporting 8 points as the all-comer effect would overstate the specified population-average improvement by 3.6 points. That difference arises because the target population includes biomarker-negative patients, whose treatment effect is smaller in this hypothetical example.

What a Narrowed Eligibility Rule Directly Targets

Once eligibility is restricted to \(B=1\), newly enrolled participants directly represent the biomarker-positive population, subject to the trial’s recruitment and sampling limitations. A treatment contrast estimated solely from this stage is therefore naturally interpreted as evidence about \(\Delta_+\), not \(\Delta_{\mathrm{all}}\). Randomization within the positive subgroup supports a treatment comparison for that subgroup; it does not by itself supply the missing negative-subgroup effect or determine the all-comer weights.

An all-comer target can still be estimated after enrichment if the trial has sufficient relevant information for both strata. For example, the initial stage may have randomized positive and negative participants, with biomarker status recorded before treatment, while the later stage enrolls only positive participants. The negative-stratum data then come from the initial stage. Using them for an all-comer estimate requires that the treatment conditions and outcome definition remain compatible across stages and that the available data identify the required stratum-specific contrast. If treatment effects or outcome distributions vary by stage, a simple pooled stratum contrast may not represent the intended target without an appropriate stage-specific model and standardization.

The enrollment proportions themselves can be especially misleading. After enrichment, the final sample may contain many more positive patients than the all-comer target does. A raw average over all trial participants gives more influence to whichever stratum contributed more participants; it is not automatically a standardized estimate for the original population.

Worked Example: A Changing Trial Mix Does Not Set the Target Weights

In a hypothetical trial, the all-comer target population is 30% biomarker-positive. The initial stage enrolls 40 positive and 60 negative patients. After an interim decision, the next stage enrolls 100 positive patients and no negative patients. Suppose the treatment-effect estimates are 6 points in the positive subgroup and 1 point in the negative subgroup. Calculate the all-comer target estimate and the estimate obtained by weighting the strata according to the final trial’s observed enrollment counts.

For the target population, \(q=0.30\), so:

$$ \widehat{\Delta}_{\mathrm{all}} =(0.30)(6)+(0.70)(1) =1.8+0.7 =2.5\text{ points}. $$

Across both stages, the trial has 140 positive and 60 negative participants, for 200 in total. The observed positive fraction is \(140/200=0.70\). Weighting the subgroup estimates by that trial fraction gives:

$$ (0.70)(6)+(0.30)(1)=4.2+0.3=4.5\text{ points}. $$

The 4.5-point value reflects the final sample’s 70% positive composition, not the 30% positive all-comer target. The target-standardized estimate is 2.5 points. This arithmetic assumes the stratum estimates are valid for their corresponding target strata; the weights alone cannot repair biased or incompatible stratum estimates.

Conditions for Preserving the Original Target

The target is preserved by defining and estimating the relevant population contrast, not simply by retaining the label “all-comer.” For the mean-difference decomposition to support an all-comer interpretation, the following conditions must be addressed:

  • Baseline classification: Biomarker status is defined before randomization or treatment, and is available for the patients needed to estimate the target-stratum effects. A post-treatment marker can introduce selection problems and does not serve as the same baseline subgroup definition.
  • Target weights are specified: The all-comer target’s positive proportion \(q\), or the external information used to determine it, is defined independently of the post-adaptation enrollment mix.
  • Both stratum effects are identified: There are randomized treatment and control observations in each target stratum, or justified information from another source. If the negative subgroup has no treatment comparison, its effect cannot be recovered from the positive-only stage by changing weights.
  • Strategies and outcome summary are compatible: The treatment and control strategies and outcome are defined consistently across stages, as required by the estimand. Differences in treatment versions, follow-up, or outcome measurement can make stage-specific contrasts refer to different quantities.
  • Transport and sampling are appropriate: The observed participants’ stratum-specific effects apply to the target strata, or any relevant differences are handled by suitable standardization. Randomization identifies comparisons within the randomized trial population; it does not alone establish representativeness of a broader target population.

These are identification and interpretation conditions, not a guarantee that an estimator will be precise. In particular, if the initial stage includes few negative patients, the all-comer estimate may be noisy because much of the target weight is attached to a poorly estimated \(\Delta_-\). The estimand can remain well-defined while the available data provide weak information about it.

Worked Example: When Positive-Only Data Cannot Recover the All-Comer Effect

Suppose the target is an all-comer population with \(q=0.25\). After adaptation, only biomarker-positive patients are randomized. Their treatment effect is estimated as 5 points. No negative patients were randomized in any stage, and no external estimate of \(\Delta_-\) is available. Can the all-comer effect be calculated?

The required expression is:

$$ \Delta_{\mathrm{all}}=(0.25)(5)+(0.75)\Delta_- =1.25+0.75\Delta_-. $$

Because \(\Delta_-\) is unknown, the all-comer effect is not identified from these data alone. For instance, if \(\Delta_-=0\), the all-comer effect would be 1.25 points; if \(\Delta_-=4\), it would be 4.25 points. Both values agree with the observed positive-subgroup effect. The positive-only data directly support the positive-subgroup target, but cannot distinguish among these possible all-comer effects.

If the protocol instead specifies the biomarker-positive population as the target, the 5-point contrast addresses that target. That is a legitimate change in scientific question, but it is not preservation of the original all-comer target.

Diagnostics, Alternatives, and Limitations

A practical diagnostic is to place three items side by side: the target population and its stratum weights, the enrolled population in each stage, and the source of each estimated stratum effect. If the target has positive weight for a stratum with no randomized comparison, the data do not directly identify the all-comer effect. If the final sample’s stratum proportions differ from the target weights, a raw pooled contrast generally targets the sample mixture rather than the intended population mixture.

Compare the principal choices as follows:

Target or approachPopulation representedKey requirement or limitation
All-comer estimandThe prespecified eligible population across biomarker strataRequires information about each stratum with positive target weight, plus target weights.
Biomarker-positive estimandPatients who meet the positive biomarker definitionDirectly aligns with positive-only enrollment but answers a narrower question.
Weighted population estimandA population with the specified positive and negative weightsPreserves the all-comer target when weights match its composition and the stratum effects are identified and applicable.
Raw pooled trial contrastThe observed trial mixture, as shaped by enrollment and allocationMay not represent either prespecified target when enrichment changes sample composition.

The weighted approach is not a device for manufacturing information. It combines stratum-specific information according to the target population; it cannot infer an unobserved stratum effect without additional assumptions or data. Nor does matching the weights alone ensure that earlier and later stages are comparable. Trial-stage differences, biomarker measurement error, missing biomarker values, or changes in the outcome process can compromise the applicability of the stratum effects. These issues should be investigated and described rather than hidden by a single pooled number.

A further limitation is that “all-comer” must be operationally precise. It should identify which patients the target includes and the population distribution to which results are standardized. If the intended population changes, the weights may change as well, and so may the weighted estimand. Conversely, an all-comer target can be retained even when later enrollment is restricted, but only if the target definition remains fixed and the evidence still supports its component effects.

Common Mistake

Wrong reasoning: “The trial began with all-comer enrollment, so the final treatment-effect estimate is automatically an all-comer effect.” This is not necessarily true. Later positive-only enrollment can substantially change the final trial mix, and an unweighted pooled contrast can reflect that changed mix. Earlier all-comer enrollment does not by itself establish that the final analysis uses the original target weights.

Correction: State the target population and its weights explicitly, then determine whether the available randomized data support the required effects in each stratum. A positive-only contrast targets the positive subgroup. An all-comer contrast requires the all-comer weights and information about every stratum receiving positive target weight, or clearly stated and defensible assumptions that supply the missing information.

Key takeaway: Eligibility narrowing changes who contributes new data; it does not automatically redefine a prespecified estimand. But an all-comer target is only empirically supportable when the data and assumptions cover its biomarker strata and its population weights are kept distinct from the changing enrollment mix.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A target population is 20% biomarker-positive. The estimated mean treatment effects are 7 points in positive patients and 2 points in negative patients. What is the all-comer mean effect?
  2. A trial enrolls only biomarker-positive patients after an adaptation. What population does a treatment contrast based only on that stage directly address?
  3. Why is the observed proportion positive in the final trial sample not automatically the correct weight for an all-comer estimand?
  4. The positive-subgroup effect is known, but the target has a nonzero negative-subgroup proportion and no data identify the negative-subgroup effect. Can weighting recover the all-comer effect? Explain.

Solutions. (1) The target weights are \(q=0.20\) and \(1-q=0.80\), so \((0.20)(7)+(0.80)(2)=1.4+1.6=3.0\) points. (2) It directly addresses the biomarker-positive subgroup, assuming the contrast is valid for that subgroup. (3) Enrichment changes who is enrolled, so the final sample proportion can differ from the proportion in the specified target population; using it would generally standardize to the sample mix, not the all-comer target. (4) No. The all-comer effect depends on the unknown negative-subgroup effect multiplied by its positive target weight. Reweighting an observed positive effect cannot supply that missing component.

Clinical Biostats