From a Design Description to an Operational Rule
A rule-based escalation design is not protocol-ready merely because its general logic is familiar. Terms such as “complete the cohort,” “evaluate toxicity,” or “escalate if acceptable” can conceal choices about timing, denominators, pending outcomes, and authority to act. If those choices are left unstated, two teams can follow the same nominal design and make different decisions from the same participant outcomes.
The task here is to express a proposed rule as a sequence of observable states and actions. The examples use a hypothetical three-participant cohort design: escalate after 0 of 3 dose-limiting toxicities (DLTs); expand to 6 after 1 of 3; escalate after no more than 1 of 6; and stop escalation at a dose after at least 2 of 3 or 2 of 6. These numbers illustrate how to write rules, not a recommendation for a particular trial. The protocol must define its own DLT criteria, review process, dose levels, and intended dose-selection statement.
The details should be fixed before enrollment, not improvised after an inconvenient outcome. In particular, the protocol should identify the dose levels and starting dose; cohort size; DLT observation window; evaluability and replacement rules; decision thresholds; handling of pending participants; pause triggers and restart authority; and stopping and dose-selection language. Earlier material on handling unevaluable participants and safety pauses provides the relevant design concepts; the focus here is making their operational consequences explicit in one coherent rule set.
Write the Decision Sequence in Order
A useful rule set follows the actual order of operations. First determine whether enrollment may proceed. Then enroll the specified cohort at the authorized dose, collect outcomes for the stated evaluation period, decide which participants are evaluable, and calculate the DLT count using the stated denominator. Only after the required outcomes are available may the escalation table be applied. This ordering prevents a recommendation based on a partly observed cohort.
For a hypothetical design with an evaluation window of 28 days from first administration, suppose a participant is evaluable if they either complete day 28 with adequate toxicity assessment or experience a DLT before day 28. A participant who withdraws early for a reason unrelated to toxicity and has no DLT is not evaluable and is replaced. A participant who has a DLT and then withdraws remains evaluable and contributes that DLT. These definitions specify both the window and how early events affect the denominator; another protocol could choose different definitions, but it must state them.
A decision table can expose missing cases. For the illustrative rules, the relevant states are the first cohort of 3 evaluable participants and, only if exactly 1 of those 3 has a DLT, the expanded total of 6 evaluable participants. The table uses “stop escalation at this dose” for a dose that crosses the specified DLT boundary. The protocol must separately define what stopping means for the study and how a dose for further study is selected.
| Decision state | Observed DLT count | Required action |
|---|---|---|
| 3 evaluable participants at the dose | 0 of 3 | Escalate one dose level, if one remains and no pause applies |
| 3 evaluable participants at the dose | 1 of 3 | Enroll 3 more evaluable participants at the same dose |
| 3 evaluable participants at the dose | 2 or 3 of 3 | Stop escalation at this dose |
| 6 evaluable participants total at the dose | 0 or 1 of 6 | Escalate one dose level, if one remains and no pause applies |
| 6 evaluable participants total at the dose | 2 to 6 of 6 | Stop escalation at this dose |
Check That the Rules Are Complete and Consistent
The decision table must cover every reachable state, and its conditions must not overlap. Here, after 3 evaluable participants, the possible integer DLT counts are 0, 1, 2, and 3. The conditions “0,” “1,” and “2 or 3” partition those possibilities: each count has exactly one action. After expansion, counts range from 0 to 6; “0 or 1” and “2 to 6” likewise cover all possible counts without overlap. The expansion state is reachable only after 1 of the initial 3, so it cannot be confused with a separate state at the same dose.
This is a simple but important justification: if every reachable state maps to one and only one action, the rule is executable without an undocumented judgment about which branch applies. The table alone is not sufficient if a state can be delayed by incomplete follow-up, a safety pause, or a replacement. Those transitions also need rules.
Worked Example: Turning an Initial Cohort Outcome Into an Instruction
Suppose 3 evaluable participants at a dose have completed the 28-day DLT window. One has a protocol-defined DLT and two do not. Apply the illustrative rule set.
The DLT count is \(1\), and the denominator is \(3\), so the observed cohort fraction is \(1/3 = 0.3333\), or 33.3%. The rule for 1 of 3 is not immediate escalation and not stopping; it is expansion to 6 evaluable participants at the same dose.
The protocol-ready instruction is therefore: “After confirmation that exactly 1 of the first 3 evaluable participants has a DLT, enroll 3 additional evaluable participants at this dose. Do not open the next dose level until DLT evaluation is complete for all 6 evaluable participants and the resulting count has been reviewed.” This states the trigger, action, dose, and condition for the next decision.
Evaluability, Replacement, and Pending Outcomes
Replacement rules should not erase safety information or permit a decision from an inconsistent denominator. A protocol should say when a participant is unevaluable, whether replacement is allowed, whether replacement occurs at the same dose, and whether the participant’s observed toxicities still enter safety review. It should also specify whether enrollment continues while another participant’s window is pending.
For the illustrative cohort design, a conservative operational rule is to pause enrollment at a dose until each participant in the active cohort has either completed the DLT window or experienced a DLT. A participant with a DLT counts as evaluable immediately under the stated definition. A participant without a DLT who stops treatment early for a non-DLT reason is replaced; the replacement receives the same dose, and the cohort decision waits until the target number of evaluable participants is reached. The protocol should define whether other interruptions or missing assessments make a participant unevaluable rather than leaving that judgment implicit.
Worked Example: Applying a Replacement Rule
At a dose, the first 3 enrolled participants have these outcomes: participant A completes 28 days without a DLT; participant B has a DLT on day 12; participant C withdraws on day 10 for a non-toxicity reason, with no DLT and insufficient assessment to complete the window. Apply the stated hypothetical evaluability rule.
A is evaluable with 0 DLTs. B is evaluable because a DLT occurred during the window, contributing 1 DLT. C is not evaluable and contributes neither to the evaluable denominator nor to the DLT count; C is replaced at the same dose. At this point the evaluable count is \(2\), and the DLT count is \(1\), so the interim count is \(1/2\). That fraction is not a decision state in the illustrative table, which requires 3 evaluable participants. Enroll a replacement and wait for that participant’s outcome before applying the 3-participant rule.
If the replacement completes the window without a DLT, the decision count becomes \(1/3\), and the dose is expanded to 6 evaluable participants. The withdrawal does not make the earlier DLT disappear; it simply does not fill an evaluable slot under this particular rule.
Pauses, De-escalation, and Stopping
Escalation rules describe what to do when no override applies. A pause rule must therefore state which actions are suspended, who reviews the event, and what authorizes resumption. For example, a protocol might require an immediate hold on new enrollment and dose administration after any suspected treatment-related death. It should identify who is notified, what information is reviewed, the decision-maker authorized to restart, and whether written restart authorization is required. A pause is not itself a decision to escalate, de-escalate, or stop; those outcomes follow only after the specified review.
“De-escalate” also needs a defined destination and trigger. If the rule is that an unacceptable DLT count at a dose stops escalation there, the protocol should state whether enrollment at that dose stops, whether a lower dose may be evaluated, and who makes that determination. At the lowest dose, there may be no lower level to use. The protocol should say what happens then, rather than implying that a lower dose exists. It should also distinguish stopping escalation from stopping all trial treatment or terminating the study.
Worked Example: Separating a Safety Pause From a Dose Decision
Suppose a participant experiences a suspected treatment-related fatal event before the other members of the cohort have completed follow-up. The protocol’s hypothetical pause rule requires a hold on new enrollment and dosing, immediate notification of the safety review group, and written authorization before restart. What action follows?
First apply the pause rule: no new participant is enrolled and no further dose is administered while the event is reviewed. The event is also assessed under the protocol’s DLT definition; suppose for this example it is confirmed to meet that definition. It contributes one DLT for that participant, but the incomplete outcomes of other participants are not treated as complete.
The safety review group then determines whether restart is authorized under the stated process. If it authorizes restart, the trial resumes only as specified in that authorization and the protocol; the cohort decision still waits for the required evaluable outcomes. If restart is not authorized, escalation does not resume. The pause trigger alone does not supply an unstated dose recommendation or automatically identify the dose for further study.
Diagnostics and Common Failure Modes
Before finalizing a rule set, test it against a decision table and hypothetical edge cases. A useful audit asks whether every reachable DLT count has exactly one action; whether a dose decision can occur with pending outcomes; whether replacement changes the denominator; whether a pause overrides ordinary enrollment instructions; and whether stopping at the first or highest dose has a stated consequence. Earlier material on auditing escalation decisions is useful for checking whether actions follow the rules; this drafting step checks whether the rules themselves are complete enough to audit.
- Ambiguous denominator. “Two toxicities in the cohort” is unclear if participants have been replaced. State whether the denominator is enrolled participants or evaluable participants, and how replacements count.
- Premature decision. “Escalate after three patients” may be read as three enrolled, even when one has pending follow-up. State that the required evaluations must be complete.
- Unbounded replacement. “Replace unevaluable participants” can leave accrual open-ended. State who determines unevaluability, whether replacement is permitted, and whether enrollment is held pending a decision.
- Conflicting authorities. A general escalation rule and a safety hold may appear to require incompatible actions. State explicitly that the pause takes precedence until the designated review permits resumption.
- Unclear stopping endpoint. “Stop at this dose” might mean close that dose, stop escalation, or end the trial. Name each intended consequence separately.
These issues are not fixed by adding more complicated statistical calculations. They are fixed by defining states, precedence, and actions precisely. Compared with a fixed 3+3 rule set, the rolling six design described in earlier material allows staggered enrollment and therefore requires especially explicit rules about pending DLT windows and when a decision may be made. Different designs can use different operational rules; the writing principle is the same.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions below.
- Under the illustrative rule set, 3 evaluable participants have 2 DLTs. What action is specified, and why is the denominator clear?
- One of 3 participants has a DLT and the other two have pending DLT assessments. May the protocol escalate immediately under the stated example rules?
- A protocol says “replace participants who do not complete evaluation.” Name two additional details needed to make this instruction operational.
- Why should a safety pause rule state who authorizes restart, rather than merely saying “pause for review”?
Solutions. (1) Stop escalation at that dose: 2 of 3 is in the “2 or 3 of 3” branch, and the count is among 3 evaluable participants. (2) No. The initial decision requires all 3 participants to have completed DLT assessment or experienced a DLT; the two pending assessments do not yet establish a completed cohort decision. (3) The protocol should, for example, define the criteria for being unevaluable and whether the replacement is enrolled at the same dose; it should also state how the unevaluable participant’s observed safety information is handled. (4) Without a named authority and a restart condition, teams may disagree about whether the hold has ended and resume enrollment at different times.