Tutorials › Adaptive Clinical Trial Design › Stopping CRM When No Dose Is Near Target

Model-Based Dose Finding: CRM and Extensions · Tutorial 571 of 799

Stopping CRM When No Dose Is Near Target

Learn to define and apply point-estimate and posterior-probability stopping rules for a CRM dose grid, and to distinguish stopping from recommending its nearest or boundary dose.

Advanced 9 min read

What You'll Learn

  • Define “sufficiently near” the target with an absolute risk-difference tolerance.
  • Apply a stopping rule to posterior toxicity estimates across a discrete dose grid.
  • Explain why selecting the closest dose is not the same as deciding that a dose is acceptable.
  • Use posterior probability to assess whether any candidate dose is near target.
  • Identify assumptions, diagnostics, and limitations of these stopping rules.

When a Dose Recommendation Is Not Enough

A CRM can rank candidate doses by how close their estimated toxicity probabilities are to the target. But ranking always produces a closest candidate, even when every candidate is far from the target. If a trial must not recommend an inadequately matched dose, the design needs a separate stopping rule: a prespecified condition under which it stops without selecting a dose.

The distinction matters especially at the ends of a discrete dose grid. If estimated toxicity rises across the grid but remains below target, the highest dose is still the closest. If all estimates exceed target, the lowest dose may be closest. Either boundary can win a ranking without being sufficiently close to the target.

Definition: Let \(\phi\) be the target toxicity probability and let \(p_j(\alpha)\) be the CRM toxicity probability at dose \(j\), for model parameter \(\alpha\). Given trial data \(D\), define \(m_j=E[p_j(\alpha)\mid D]\), the posterior mean toxicity probability at dose \(j\). A point-estimate stopping rule with tolerance \(\delta>0\) stops without recommending a dose when \(\min_j |m_j-\phi|>\delta\). If at least one dose satisfies \(|m_j-\phi|\le\delta\), the rule does not stop on this criterion; it may recommend the dose with the smallest absolute difference.

The tolerance \(\delta\) is measured in absolute probability, not as a percentage change relative to \(\phi\). For instance, \(\delta=0.05\) means that an estimated toxicity probability within five percentage points of the target is considered near enough for this rule. The tolerance is a design choice, not a quantity inferred automatically from the CRM.

Assumptions and the Point-Estimate Rule

The rule is applied after updating the CRM with the available dose and toxicity outcomes. It assumes that the target \(\phi\), dose grid, tolerance \(\delta\), model, prior, and rule for calculating \(m_j\) have been specified before the decision. The dose-toxicity model and data must also be meaningful for the decision: for example, the relevant binary toxicity outcome should have been assessed over its defined observation window for the participants whose outcomes are used. An unresolved outcome is not equivalent to an observed absence of toxicity.

The point-estimate rule compares posterior means, not the observed toxicity proportions at each dose. In a small trial, observed proportions can be highly variable, and a dose may have only a few participants. The CRM uses the likelihood and prior under its model to produce posterior toxicity estimates across the dose grid. The posterior means are useful summaries, but they do not describe all posterior uncertainty; a probability-based rule can address uncertainty more directly.

Write \(d_j=|m_j-\phi|\) for the absolute distance from the target at dose \(j\), and let \(d_{\min}=\min_j d_j\). The decision follows directly:

$$ \begin{aligned} d_{\min} &> \delta &&\Longrightarrow \text{stop without recommending a dose},\\ d_{\min} &\le \delta &&\Longrightarrow \text{at least one dose is near target under this rule}. \end{aligned} $$

If the rule continues, a common recommendation is the dose minimizing \(d_j\), with a prespecified way to resolve ties. Passing the stopping criterion does not imply that every other trial condition is satisfied; it only says that this particular “no dose near target” rule has not triggered.

Worked Example: No Interior Dose Is Close Enough

Suppose a hypothetical CRM analysis has target \(\phi=0.25\), tolerance \(\delta=0.05\), and posterior mean toxicity probabilities \(m_j=0.08, 0.19, 0.34,\) and \(0.52\) at four ordered doses. Apply the point-estimate stopping rule.

Calculate each dose’s absolute distance from target:

$$ |m_j-\phi|=(|0.08-0.25|,\ |0.19-0.25|,\ |0.34-0.25|,\ |0.52-0.25|) =(0.17,\ 0.06,\ 0.09,\ 0.27). $$

Thus \(d_{\min}=0.06\), at the second dose. Because \(0.06>0.05\), no dose is within the prespecified five-percentage-point tolerance. The rule stops without recommending a dose. The second dose is the closest, but “closest” is not the same as “close enough.”

Why a Boundary Recommendation Can Be Misleading

Without a stopping condition, a nearest-target rule selects \(\arg\min_j |m_j-\phi|\) from the available grid. This always returns a dose when the grid is nonempty. A stopping rule adds a separate acceptability check: even the minimum distance must be no larger than \(\delta\). The check is therefore not a different way to rank doses; it decides whether to make a recommendation at all.

The following comparison makes the distinction explicit. Both examples use the same target and tolerance, but the second has no candidate close enough.

Worked Example: Nearest Dose Versus Stopping at the Boundary

In a hypothetical trial, let \(\phi=0.25\), \(\delta=0.05\), and suppose three ordered doses have posterior mean toxicity probabilities \(0.03,\ 0.09,\) and \(0.15\).

The distances from target are \(0.22,\ 0.16,\) and \(0.10\), respectively. A forced nearest-dose rule selects dose 3 because \(0.10\) is the smallest distance. But \(d_{\min}=0.10>0.05\), so the stopping rule stops without recommending dose 3.

This conclusion does not mean dose 3 has the greatest toxicity risk by itself; it does have the largest estimate in this example. The relevant point is that even the largest estimate remains ten percentage points below target, twice the allowed distance. Selecting it merely because it is the nearest grid point would erase the prespecified acceptability condition.

A dose grid can also have all estimates above target. In that case, a forced nearest-dose rule may select its lowest dose, while a stopping rule may still decline to recommend it if its distance exceeds \(\delta\). “Boundary” describes the dose’s position on the grid; it does not establish that the dose is acceptable. Likewise, stopping for lack of a near-target dose is not the same as choosing a boundary dose.

A Posterior-Probability Version

A point-estimate criterion can hide posterior uncertainty. A probability-based version asks how likely it is, under the fitted CRM posterior, that at least one candidate dose is near target. Define the event that the dose grid contains a near-target dose as \(A=\{\text{there exists a }j\text{ such that }|p_j(\alpha)-\phi|\le\delta\}\), and let \(r=P(A\mid D)\). For a prespecified threshold \(\gamma\), a possible rule is to stop when \(r<\gamma\). The threshold \(\gamma\) expresses how much posterior support the design requires for the existence of a near-target candidate.

This rule and the posterior-mean rule answer different questions. The first asks whether any posterior mean is near target. The second asks whether the posterior probability is sufficiently high that some dose on the grid is near target. A dose may have a posterior mean close to target even when the posterior distribution is broad; conversely, posterior draws may often put some dose near target even if no single posterior mean is within the tolerance. These rules should not be treated as interchangeable.

Worked Example: Applying a Posterior-Probability Threshold

Suppose a hypothetical trial specifies \(\phi=0.25\), \(\delta=0.05\), and \(\gamma=0.80\). For illustration, consider 1,000 draws from the fitted posterior. In 630 draws, at least one dose has a toxicity probability within \(0.05\) of \(0.25\); in the other 370 draws, no dose does.

Estimate the posterior probability by the fraction of draws in the event:

$$ r \approx \frac{630}{1000}=0.630. $$

Because \(0.630<0.80\), the specified probability rule stops without recommending a dose. This says that the posterior probability of at least one near-target candidate is below the design’s required threshold. It does not say there is a 63% probability that the CRM model is true, or that the target itself has a 63% chance of being attained.

Derivation, Calibration, and Diagnostics

The point-estimate rule can be understood as adding a threshold to the nearest-dose calculation. First, the nearest-dose calculation gives \(d_{\min}=\min_j |m_j-\phi|\). The acceptable set is \(S=\{j:|m_j-\phi|\le\delta\}\). If \(S\) is empty, then every distance exceeds \(\delta\), so their minimum exceeds \(\delta\). Conversely, if \(d_{\min}\le\delta\), at least one dose attains that minimum and belongs to \(S\). Thus:

$$ S=\varnothing \quad\Longleftrightarrow\quad \min_j |m_j-\phi|>\delta. $$

This equivalence justifies the stopping condition; it does not justify any particular value of \(\delta\). Investigators should select and document the tolerance in relation to the clinical meaning of a difference in toxicity probability and the available dose grid. They should also specify whether a dose exactly at the tolerance boundary is acceptable: the rule above treats \(|m_j-\phi|=\delta\) as near enough. Posterior-probability rules likewise require a prespecified \(\gamma\), with the boundary convention stated.

At each planned decision, useful checks include verifying the dose labels and target, confirming the posterior calculations use the intended observed outcomes, and inspecting all dose-specific estimates rather than only the selected dose. For the probability rule, verify that posterior draws were generated and counted consistently and that the event is “at least one dose” on the stated grid. Recompute the decision from the displayed values; a reported recommendation inconsistent with the threshold may indicate an implementation or transcription error.

A stopping decision can be sensitive to modest changes in \(\delta\) or \(\gamma\), particularly when the nearest dose lies near the threshold. Report the rule and the distances or posterior probability that triggered it. Such sensitivity is a diagnostic of how borderline the decision is; it is not a reason to change the prespecified threshold after seeing the results. If a stopping decision appears implausible, investigate the data, model fit, and grid rather than silently substituting a different criterion.

Alternatives and Limitations

ApproachDecisionMain limitation
Nearest-dose rule aloneSelect the dose minimizing distance from target.Always selects a dose, even if all candidates are far away.
Point-estimate stopping ruleStop if every posterior mean is farther than \(\delta\) from target.Does not directly quantify posterior uncertainty about closeness.
Posterior-probability stopping ruleStop if the posterior probability that any dose is near target is below \(\gamma\).Requires a probability threshold and depends on the fitted posterior and chosen grid.

These are alternative decision rules, not guarantees that the target toxicity rate will be achieved. A CRM model may be an imperfect description of the dose-toxicity relationship, and a finite grid may not contain a dose close to the target even if a suitable dose exists outside that grid. A rule that stops because no candidate is near target answers a limited question about the specified grid and criterion. It does not, by itself, establish why the grid failed to contain a near-target dose.

A common mistake is to reason, “The highest dose is closest to target, so the trial should recommend it.” That conclusion follows only from a forced nearest-dose rule. Under a stopping rule, the correct next step is to compare the minimum distance with the tolerance—or, for the probability version, compare \(r\) with \(\gamma\). If the stopping threshold is crossed, the decision is to stop without a dose recommendation, not to relabel the closest boundary dose as acceptable.

Key takeaway: Ranking identifies the closest dose; stopping determines whether any dose is close enough under a prespecified criterion. Always report which criterion was used and whether it triggered.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. With \(\phi=0.30\), \(\delta=0.04\), and posterior means \(0.22,\ 0.27,\ 0.36\), does the point-estimate rule stop?
  2. If every dose estimate is below target, why can a nearest-dose rule and a stopping rule reach different decisions?
  3. A posterior-probability rule requires \(r\ge0.75\) to continue. If 680 of 1,000 posterior draws contain at least one dose within tolerance, what does the rule decide?
  4. Why should an unassessed toxicity outcome not be treated automatically as an observed non-toxicity outcome?
  5. What does stopping under this rule establish, and what does it not establish?

Solutions. 1. The distances are \(0.08,\ 0.03,\ 0.06\); the minimum is \(0.03\le0.04\), so the rule does not stop and the second dose is nearest. 2. The nearest-dose rule always ranks a candidate, whereas stopping also requires the minimum distance to be within \(\delta\); the closest dose can still be too far away. 3. The estimated posterior probability is \(680/1000=0.680\), which is below \(0.75\), so the rule stops. 4. The outcome has not yet been observed over the relevant assessment window, so treating it as no toxicity would misrepresent the available data. 5. It establishes that no dose meets the specified near-target criterion on the specified grid, under the chosen CRM estimates or posterior rule. It does not prove the model is correct, that no suitable dose exists outside the grid, or that the target toxicity rate will or will not occur in future patients.

Clinical Biostats