Tutorials › Optimal Design and Model-Informed Dosing › Worked CRM Recommendations With Sparse DLT Data

Model-Based Dose Escalation · Tutorial 186 of 497

Worked CRM Recommendations With Sparse DLT Data

Work through posterior updates after cohorts with few DLTs and see how the CRM’s dose recommendation can change as evidence accumulates.

Advanced 10 min read

What You'll Learn

  • Specify a power-CRM model and a discrete prior for its parameter.
  • Update posterior weights from complete cohort DLT outcomes.
  • Calculate posterior mean toxicity risks and rank doses by distance from a target.
  • Track recommendations across three small hypothetical cohorts.
  • Recognize prior sensitivity, sparse-data uncertainty, and model-based extrapolation.
  • Distinguish a target-based CRM recommendation from other dose-selection rules.

Why Sparse DLT Data Need a Model-Based Reading

In early dose-finding trials, a cohort may contribute no dose-limiting toxicities (DLTs), or only one. The observed fraction at a dose is then a noisy summary: zero DLTs among three patients does not establish that the dose has zero toxicity risk. The continual reassessment method (CRM) instead combines each cohort’s outcomes with a prespecified dose-toxicity model and prior distribution, producing updated toxicity estimates across the candidate doses.

This tutorial follows a small hypothetical trial in which the first cohort has no DLTs, the second also has none, and the third has one. The aim is to calculate how posterior dose rankings and a target-based recommendation change after each cohort. The recommendation rule used here is specific: select the dose whose posterior mean DLT probability is closest to the target. Other rules can produce different choices.

Model and assumptions: There are ordered candidate doses \(d_1<d_2<\cdots<d_J\), with fixed skeleton values \(0<s_1<s_2<\cdots<s_J<1\). Under the one-parameter power CRM, a patient treated at \(d_j\) has DLT probability \(p_j(\beta)=s_j^\beta\), where \(\beta>0\). Conditional on \(\beta\), patient DLT outcomes are independent Bernoulli observations. The prior distribution for \(\beta\) is specified before observing trial outcomes. The calculations below assume that every patient’s DLT status is fully observed over the assessment window and that the model and skeleton remain fixed.

Posterior Updating and the Recommendation Rule

Let \(y_j\) be the number of DLTs among \(n_j\) fully assessed patients treated at dose \(d_j\). Conditional on \(\beta\), the likelihood contribution from that dose is proportional to \(p_j(\beta)^{y_j}\{1-p_j(\beta)\}^{n_j-y_j}\). Contributions from different doses multiply. For a discrete prior grid \(\beta_1,\ldots,\beta_K\), the posterior weight of grid point \(k\) is therefore

$$ w_k^{\mathrm{post}} = \frac{ w_k^{\mathrm{prior}} \displaystyle\prod_{j=1}^{J} p_j(\beta_k)^{y_j}\{1-p_j(\beta_k)\}^{n_j-y_j} }{ \displaystyle\sum_{\ell=1}^{K} w_\ell^{\mathrm{prior}} \prod_{j=1}^{J} p_j(\beta_\ell)^{y_j}\{1-p_j(\beta_\ell)\}^{n_j-y_j} }. $$

The posterior mean DLT probability at dose \(d_j\) is the weighted average of the model probabilities over the posterior distribution of \(\beta\). Given target toxicity probability \(\phi\), this tutorial’s CRM recommendation is the dose minimizing the absolute difference between that posterior mean and \(\phi\).

$$ \bar p_j^{\mathrm{post}} = \sum_{k=1}^{K}w_k^{\mathrm{post}}p_j(\beta_k), \qquad j^*=\underset{j}{\operatorname{arg\,min}}\, \left|\bar p_j^{\mathrm{post}}-\phi\right|. $$

This is a recommendation based on posterior mean risk, not a guarantee that the selected dose has risk exactly equal to the target. Because every grid value of \(\beta\) is positive and the skeleton is increasing, \(p_1(\beta)<\cdots<p_J(\beta)\) at every grid point. Averaging over the posterior preserves this ordering, although which dose is closest to the target can change as the posterior weights change.

Worked Trial: Three Cohorts and One DLT

Use three candidate doses with skeleton \((0.10,0.20,0.35)\), target \(\phi=0.25\), and a prior assigning probability \(1/3\) to each of \(\beta=0.5,1,1.5\). The skeleton values are model probabilities when \(\beta=1\); they are not observed DLT rates. The resulting probabilities at the three grid values are:

\(\beta\)\(p_1(\beta)\)\(p_2(\beta)\)\(p_3(\beta)\)
0.50.31620.44720.5916
1.00.10000.20000.3500
1.50.031620.089440.2071

For example, at \(\beta=0.5\), the first-dose probability is \(0.10^{0.5}=0.3162\). The power is \(\beta\), not \(\exp(\beta)\). Each cohort below has three patients, and all outcomes are treated as fully observed.

Worked Example: First Cohort, Zero DLTs at the Lowest Dose

Suppose three patients receive \(d_1\) and none experiences a DLT. With equal prior weights, the likelihood at each grid value is \(\{1-p_1(\beta)\}^3\). The unnormalized posterior weights are therefore

$$ \frac{1}{3}(1-0.3162)^3=0.1066,\quad \frac{1}{3}(1-0.1000)^3=0.2430,\quad \frac{1}{3}(1-0.03162)^3=0.3027. $$

Their sum is approximately \(0.6523\). Dividing each value by that sum gives posterior weights approximately \(0.1634, 0.3725, 0.4641\), respectively. The zero-DLT cohort shifts weight toward larger \(\beta\), which implies lower DLT probabilities under this power model.

At \(d_1\), the posterior mean risk is \(0.1634(0.3162)+0.3725(0.1000)+0.4641(0.03162)=0.1036\), approximately. Repeating the weighted average at the other doses gives:

DosePosterior mean DLT probabilityAbsolute distance from 0.25
\(d_1\)0.10360.1464
\(d_2\)0.18910.0609
\(d_3\)0.32320.0732

For instance, the \(d_3\) calculation is \(0.1634(0.5916)+0.3725(0.3500)+0.4641(0.2071)=0.3232\), to four decimal places. The posterior mean risks rank the doses \(d_1<d_2<d_3\), while their distances from the target make \(d_2\) the recommendation. This rule selects \(d_2\), the dose with the smallest distance, not the dose with the lowest toxicity risk.

Worked Example: Second Cohort, Zero DLTs at the Recommended Dose

Suppose the next cohort of three receives \(d_2\), the first cohort’s recommendation, and again has zero DLTs. Multiply the previous posterior weights by the likelihood \(\{1-p_2(\beta)\}^3\). The unnormalized weights are approximately

$$ 0.1634(1-0.4472)^3=0.0276,\quad 0.3725(1-0.2000)^3=0.1907,\quad 0.4641(1-0.08944)^3=0.3504. $$

The sum is approximately \(0.5687\), so the normalized weights are \(0.0485, 0.3353, 0.6162\). The posterior mean risks are then approximately \(0.0684\) at \(d_1\), \(0.1439\) at \(d_2\), and \(0.2737\) at \(d_3\). For example, at \(d_3\): \(0.0485(0.5916)+0.3353(0.3500)+0.6162(0.2071)=0.2737\).

The corresponding distances from \(0.25\) are \(0.1816, 0.1061,\) and \(0.0237\). Thus \(d_3\) is now the target-closest dose and the recommendation changes from \(d_2\) to \(d_3\). The dose-risk ordering remains increasing. What changes is the posterior estimate of how close each risk is to the target.

Worked Example: Third Cohort, One DLT at the Highest Dose

Suppose three patients receive \(d_3\), and one has a DLT. For each grid value, the cohort likelihood is \(3p_3(\beta)\{1-p_3(\beta)\}^2\). The factor 3 is the same for every grid value and cancels when the weights are normalized, so multiply the current weights by \(p_3(\beta)\{1-p_3(\beta)\}^2\). The unnormalized weights are approximately

$$ 0.0485(0.5916)(0.4084)^2=0.0048,\quad 0.3353(0.3500)(0.6500)^2=0.0496,\quad 0.6162(0.2071)(0.7929)^2=0.0802. $$

The total is approximately \(0.1346\), giving posterior weights \(0.0356, 0.3685, 0.5959\). The updated posterior mean risks are approximately \(0.0669\), \(0.1429\), and \(0.2734\) at \(d_1,d_2,d_3\), respectively. At \(d_3\), the weighted calculation is \(0.0356(0.5916)+0.3685(0.3500)+0.5959(0.2071)=0.2734\).

The distances from the target are now approximately \(0.1831, 0.1071,\) and \(0.0234\). The recommendation remains \(d_3\). One DLT among three at that dose does not force the model-based estimate to equal the observed fraction \(1/3\): the posterior combines that cohort with earlier evidence and the model’s shared dose-response structure.

What the Calculations Do—and Do Not—Establish

A short justification explains why one cohort affects estimates at every dose. The likelihood updates the distribution of the shared parameter \(\beta\), rather than fitting a separate toxicity probability for each dose. Since \(p_j(\beta)=s_j^\beta\), a change in posterior weight on \(\beta\) changes every \(p_j(\beta)\). The posterior mean at dose \(d_j\) is consequently a sum over the same updated weights, with dose-specific probabilities inside the sum. This borrowing of information across doses is useful when data are sparse, but it also makes the estimates dependent on the model and skeleton.

1
Record completed outcomes.
For each dose, count fully assessed patients and DLTs. A patient whose assessment window is incomplete cannot simply be treated as having no DLT.
2
Evaluate the likelihood.
At each prior grid value, calculate the probability of the observed cohort outcomes under the stated CRM model.
3
Normalize and summarize.
Normalize the weighted likelihoods to obtain posterior weights, then calculate posterior mean risks and distances from the target.
4
Check before acting.
Inspect posterior uncertainty and model sensitivity, and apply the trial’s protocol rules before translating a statistical recommendation into an assignment.

Several checks help reveal when a sparse-data recommendation may be fragile. Confirm that the skeleton is strictly ordered and between zero and one, that all likelihood factors match the recorded outcomes, and that posterior weights sum to one (up to rounding). Examine whether nearly all posterior weight has accumulated at one end of the chosen grid; if so, the grid or prior may inadequately represent the supported parameter values. Compare recommendations under reasonable prior or skeleton alternatives, and inspect posterior risk distributions rather than relying on posterior means alone. A mean close to the target can conceal substantial uncertainty.

The calculations have important limitations. The power CRM imposes a particular monotone curve, so apparent precision at unobserved doses comes from model assumptions as well as observed data. A discrete grid approximates a continuous prior and can affect results if it is too coarse or too narrow. The target-closest posterior-mean rule is only one decision rule: posterior overdose control, expected utility, and other criteria answer different questions. Practical escalation protocols may also restrict assignments or require stopping; the statistical dose recommendation alone does not specify those actions.

Common Pitfall: Treating Sparse Fractions as the Dose Risks

A tempting but incorrect argument is: “There were zero DLTs among three patients at \(d_2\), so its toxicity risk is zero; therefore the next dose is clearly safe.” The observed fraction is zero, but the cohort likelihood is \(\{1-p_2(\beta)\}^3\), which is positive for a range of nonzero risks. The posterior mean risk at \(d_2\) after that cohort in this example is about \(0.1439\), not zero. The correction is to distinguish observed outcomes from estimated probabilities and to report the model, prior, and uncertainty underlying the estimate.

Another error is to calculate the posterior mean using the prior weights after a new cohort. Posterior weights must be updated with that cohort’s likelihood before averaging the dose-specific probabilities. Finally, do not confuse ranking by toxicity risk with ranking by target proximity: the highest-risk dose is not automatically the best dose, and the lowest-risk dose is not automatically the target dose.

Check Your Understanding

Use the model and target from the worked trial. Give each answer in the context of CRM recommendations.

  1. Why does a cohort with zero DLTs at a dose not imply that the dose’s DLT probability is zero?
  2. After the second cohort, the posterior mean risks are \(0.0684, 0.1439,\) and \(0.2737\). Which dose is recommended, and why?
  3. If a cohort of three at \(d_3\) has one DLT, which likelihood factor, apart from its common binomial coefficient, updates each posterior weight?
  4. Why can evidence from patients at one dose alter the estimated DLT risk at another dose in this CRM?
  5. Name one diagnostic or limitation that matters especially when only a few DLT outcomes have been observed.

Solutions. (1) Zero observed DLTs is an outcome with nonzero likelihood across a range of nonzero risks; it does not identify the true probability as zero. (2) \(d_3\), because its distance from the \(0.25\) target is \(0.0237\), smaller than the distances for \(d_1\) and \(d_2\). (3) \(p_3(\beta)\{1-p_3(\beta)\}^2\). (4) The doses share \(\beta\), so outcomes update its posterior distribution, which changes \(p_j(\beta)\) at every dose. (5) Examples include checking sensitivity to the prior or skeleton, examining posterior uncertainty, and checking whether posterior weight is concentrated at the edge of the parameter grid.

Clinical Biostats