Tutorials › Adaptive Clinical Trial Design › Dose Selection and the Treatment Condition

Estimand Preservation Under Adaptation · Tutorial 35 of 799

Dose Selection and the Treatment Condition

Define treatment conditions for dose-selection trials and determine whether the scientific target is a fixed-dose effect or the effect of an adaptive dose-selection strategy.

Advanced 12 min read

What You'll Learn

  • Specify a dose treatment condition, including the dose and features that must remain consistent.
  • Define a fixed-dose effect using potential outcomes in a stated target population.
  • Define a dose-selection strategy as a rule mapping interim information to a dose.
  • Distinguish a strategy effect from an effect conditional on the dose selected in one trial.
  • Calculate a strategy-level contrast when selection data and outcome data come from independent cohorts.
  • Recognize when selection, treatment versions, or population changes make an estimand unclear.

Why Dose Selection Changes the Treatment Condition

A trial may randomize participants to several doses, examine interim data, and use a prespecified rule to choose one dose for continued study. The dose administered after that decision is not necessarily a fixed treatment condition: it can depend on the random interim results. The scientific question must therefore distinguish two targets: the effect of a particular dose, and the effect of following a strategy that selects a dose.

This distinction matters even if the same dose is ultimately selected in a particular trial. A fixed-dose effect refers to a specified dose in the target population. A strategy effect refers to a rule, including how interim information determines which dose is administered. They answer different questions and need not have the same value.

Definition: A fixed-dose treatment condition specifies a particular dose, together with the treatment features needed to define it consistently, such as formulation, route, schedule, and duration. A dose-selection strategy specifies a rule that uses stated interim information to select a dose, as well as the treatment conditions that apply before and after selection.

A dose number alone may not define a treatment condition completely. For example, “20 mg” is ambiguous if formulation, frequency, titration, or treatment duration differs between trial stages. The treatment versions and stage-to-stage consistency matter: if the intended condition is “20 mg once daily for 12 weeks,” a later stage using a different schedule is not automatically the same condition.

The outcome and its handling must also be held clear. Let \(Y(d)\) denote the outcome that a member of the target population would have under the specified fixed-dose condition \(d\), and let \(Y(0)\) denote the outcome under the specified comparator condition. The outcome should be defined at a stated time and with an intercurrent-event strategy appropriate to the question. Earlier material on estimands and intercurrent events provides the vocabulary for specifying those features; they cannot be left implicit when comparing doses.

Fixed-Dose Effects and Strategy Effects

Definition: For a higher-is-better outcome, the mean fixed-dose effect of dose \(d\) versus comparator \(0\) in a target population is \(\Delta(d)=E[Y(d)]-E[Y(0)]\). A dose-selection strategy \(g\) maps interim information \(S\) to a dose \(g(S)\). Its mean effect is the mean outcome under following that strategy minus the mean outcome under the specified comparator condition. The target must say whether it averages over the distribution of interim information and dose selection, or instead conditions on a particular selection event.

The fixed-dose estimand holds \(d\) constant. The strategy estimand does not: the dose is determined by the rule \(g\). As a result, a strategy effect depends on the selection rule, the interim data available to it, the timing of selection, and the treatment conditions before and after selection. Changing any of these may change the strategy even when the list of candidate doses stays the same.

A useful way to define the strategy effect is to consider a future target patient whose outcome is measured after the strategy has selected a dose using interim data. If those interim data \(S\) are independent of the future patient’s potential outcomes, then the strategy’s mean outcome is \(E[Y(g(S))]\). By conditioning on the selected dose, this becomes a mixture of fixed-dose means:

$$ E[Y(g(S))] = \sum_{d\in\mathcal{D}} P(g(S)=d)E[Y(d)] $$

Here \(\mathcal{D}\) is the set of candidate doses. This identity follows by partitioning outcomes according to which dose the rule selects. Independence is important: it allows the future patient’s mean potential outcome under dose \(d\) to remain \(E[Y(d)]\) within each selection event. If the same participants both contribute to dose selection and supply the outcomes used to estimate the effect, this simple mixture need not describe the estimand or the estimator. The joint relationship between selection and outcomes must then be considered.

Worked Example: Calculating a Fixed-Dose Effect

Suppose a hypothetical randomized trial compares a specified 20 mg daily regimen with placebo in the target population. The outcome is mean improvement on a symptom scale after 8 weeks, measured in points; higher improvement is better. Assume the regimen, follow-up, outcome definition, and intercurrent-event strategy are the same for both groups, and random assignment is implemented as planned. The observed mean improvement is 6.2 points for 20 mg and 4.7 points for placebo.

The estimated fixed-dose contrast is

$$ \widehat{\Delta}(20) = \bar{Y}_{20}-\bar{Y}_{0} = 6.2-4.7 = 1.5\text{ points}. $$

This estimates the mean effect of the specified 20 mg condition versus the specified placebo condition in the trial’s target population, subject to the design and outcome assumptions. It does not estimate the effect of selecting among several doses at an interim analysis: no selection rule appears in this contrast.

What Is Included in a Dose-Selection Strategy?

A strategy should be specific enough that two teams applying it to the same interim information would make the same treatment decision. Its definition ordinarily includes:

  • the candidate doses and comparator;
  • the interim data and analysis time used for selection;
  • the rule mapping those data to a selected dose, including how ties or inconclusive results are handled;
  • which participants receive each dose before selection and which treatment condition applies afterwards; and
  • the target population, outcome, assessment time, and intercurrent-event strategy used to define the effect.

Not every strategy has to use a complicated algorithm. A rule such as “select the dose with the largest estimated mean improvement among 10, 20, and 40 mg” is a strategy, provided the analysis population and tie rule are specified. A rule such as “select the best dose” is not yet operational: “best” needs a defined criterion.

Worked Example: A Strategy-Level Effect From Selection Probabilities

Consider a hypothetical setting in which an interim cohort selects one dose from 10, 20, and 40 mg. A separate future cohort receives the selected dose, so its outcomes are independent of the interim data used for selection. Suppose the rule selects 10 mg with probability 0.20, 20 mg with probability 0.50, and 40 mg with probability 0.30. In the future target population, suppose the fixed-dose mean improvements are 1.0, 2.0, and 3.0 points, respectively, while the mean under comparator is 0 points. These values and probabilities are hypothetical and assumed known for this calculation.

The strategy mean improvement is the probability-weighted mean across the doses the rule may select:

$$ E[Y(g(S))] = (0.20)(1.0)+(0.50)(2.0)+(0.30)(3.0) = 0.20+1.00+0.90 = 2.10\text{ points}. $$

The strategy-level contrast versus comparator is therefore \(2.10-0=2.10\) points. This is not the fixed-dose effect of 20 mg, which is 2.0 points, nor the fixed-dose effect of 40 mg, which is 3.0 points. It is the mean effect of following the stated selection rule across repetitions in which its selected dose can vary.

The calculation relies on the independence of selection data and future-patient outcomes, and on the stated selection probabilities and dose-specific means applying to the same target population and outcome definition. If interim participants also contribute to the outcome summary, the probabilities alone do not justify this calculation.

Conditional Effects Are Not Automatically Strategy Effects

A trial may select 20 mg in one realization. Reporting the effect of 20 mg after that decision can be useful, but the interpretation depends on the target. It may be a fixed-dose effect in a future cohort, an effect conditional on the event that 20 mg was selected, or an estimate using participants whose data also drove selection. These are not interchangeable.

In particular, selection tends to favor doses with unusually favorable interim estimates. Random error can contribute to that favorable ranking, so the selected estimate can overstate the selected dose’s true mean effect. This is a selection effect, not evidence that the treatment caused a larger effect. If a later cohort is independent of the selection data and is randomized to the selected fixed dose and comparator, its contrast addresses that selected dose in that cohort; it still does not by itself describe what would happen on average across repetitions of the dose-selection strategy.

Worked Example: A Selected Estimate Versus a Strategy Target

Suppose, hypothetically, the true mean improvements for doses 10, 20, and 40 mg are 1.0, 1.5, and 1.2 points, respectively. In one interim sample, the observed dose-arm means are 1.4, 2.1, and 1.8 points. A rule selects the dose with the largest observed mean, so it selects 20 mg.

The selected interim mean is 2.1 points, while the stipulated true mean for 20 mg is 1.5 points. In this realization, the selected estimate is \(2.1-1.5=0.6\) points above that stipulated mean. This numerical difference illustrates how favorable noise can help a dose win selection; it is not a general estimate of the amount of bias in every trial.

Now suppose a separate future cohort is randomized after selection, and its observed mean improvements are 1.7 points under the selected 20 mg condition and 0.2 points under comparator. The future-cohort contrast is

$$ 1.7-0.2=1.5\text{ points}. $$

Provided the cohort and treatment conditions are comparable to the target, this contrast estimates the fixed 20 mg effect for that cohort without reusing the interim outcome noise. It is conditional on the event that 20 mg was selected in this trial. It is not, on its own, the average effect of the selection rule across possible interim samples; that strategy target must also account for the doses the rule might select and their probabilities.

Assumptions, Diagnostics, and Failure Modes

The potential-outcome definitions require well-defined treatment conditions: a participant receiving dose \(d\) must receive the version specified by that condition. For a randomized comparison to identify a fixed-dose contrast, assignment must be randomized as intended, outcome measurement and follow-up must correspond to the specified estimand, and the analysis must address missing outcomes and intercurrent events according to the chosen strategy. The treatment conditions must also be available to the relevant participants under the design.

For a strategy effect, the rule must be fully defined and the target must specify how randomness in interim data is handled. If the target is an average across repeated applications, the selection probabilities are part of its meaning. If the target is conditional on selection of a particular dose, say so explicitly. When selection and outcome data overlap, avoid assuming independence or using the probability-weighted formula without justification.

Practical checks include comparing protocol versions and case-report forms across stages, verifying that dose, schedule, formulation, and outcome timing did not drift, and confirming that the implemented decision rule matches the prespecified one. Review how many candidate doses were considered and whether the reported estimate came from the same data used to select the dose. A large difference between interim and later estimates can be a warning sign of selection noise or changing treatment conditions; it is not, by itself, proof of either explanation.

The main alternatives answer different questions:

TargetQuestion answeredKey qualification
Fixed-dose effectWhat is the effect of this specified dose versus comparator?The dose and treatment version are held fixed.
Conditional selected-dose effectWhat is the effect when this dose was selected?The selection event is part of the target; it is not an average over all possible selections.
Selection-strategy effectWhat is the effect of following this dose-selection rule?The rule and how selection randomness enters the target must be specified.

A strategy effect may be more relevant when evaluating the whole adaptive policy, while a fixed-dose effect may be more relevant when deciding whether a specific regimen benefits the target population. Neither is universally preferable. The limitation is that a strategy effect can be harder to interpret and estimate if the rule is underspecified, if the design rarely assigns some doses, or if treatment conditions vary across stages. A fixed-dose effect, in turn, cannot summarize the consequences of a policy that may choose different doses.

Common Mistake: Naming the Realized Dose as the Strategy

Incorrect reasoning: “The interim analysis selected 20 mg, so the trial’s treatment condition was fixed 20 mg, and the reported estimate is the effect of the selection strategy.” This treats one realized decision as if it were the rule that generated it. It also ignores any different dose the same rule might have selected under another interim sample.

Correction: Report the fixed-dose contrast as an effect of the specified 20 mg condition when that is the target. Report a strategy effect only when the treatment policy—including candidate doses, interim information, decision rule, and target averaging or conditioning—is defined. Keep the two interpretations separate, even when they coincide numerically in one trial.

Key takeaway: A fixed dose is a treatment condition; a rule that chooses among doses is a different treatment condition. State whether the target is a fixed-dose effect, a conditional effect after a particular selection, or an effect averaged over the dose-selection strategy.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A trial compares a specified 10 mg regimen with placebo and does not select a dose. What treatment effect is being targeted?
  2. A rule selects 10 or 20 mg based on an interim cohort, and independent future participants receive the selected dose. Why can the strategy mean be written as a probability-weighted average of fixed-dose means?
  3. A trial reports the highest interim mean among four doses as the effect of its adaptive strategy. Identify the main interpretive problem.
  4. Name two treatment features, other than the dose amount, that may need to be specified to define a dose treatment condition.

Solutions. (1) The target is a fixed-dose contrast: the mean outcome under the specified 10 mg condition minus the mean under the specified placebo condition in the stated population, outcome, and intercurrent-event framework. (2) The future participants’ potential outcomes are independent of the interim selection data. Partitioning by the selected dose gives \(E[Y(g(S))]=\sum_d P(g(S)=d)E[Y(d)]\). The selection probabilities and fixed-dose means must refer to the same target conditions. (3) The reported value is the largest estimate chosen from the same interim data used for selection. It is a selected estimate, not automatically the strategy effect; it may be favorably affected by random error and does not average over possible doses selected by the rule. (4) Examples include formulation, route, frequency, duration, or titration schedule. Treatment conditions must specify features that could make apparently identical doses different versions of treatment.

Clinical Biostats