Tutorials › Optimal Design and Model-Informed Dosing › Replacing Patients With Incomplete DLT Follow-Up

Model-Based Dose Escalation · Tutorial 200 of 497

Replacing Patients With Incomplete DLT Follow-Up

Learn to decide when incomplete follow-up warrants replacement without discarding the information that the original patient contributed to the dose-toxicity model.

Advanced 12 min read

What You'll Learn

  • Distinguish replacement eligibility from toxicity-model contribution.
  • Define prospective criteria for a DLT-evaluable patient and a replacement.
  • Apply replacement rules to early withdrawal, observed DLT, and near-complete follow-up.
  • Interpret partial follow-up using a stated time-to-event likelihood.
  • Identify operational and statistical failure modes in replacement procedures.

Why Replacement Rules Need Two Separate Decisions

In a dose-escalation trial, a patient may stop treatment or leave observation before the dose-limiting-toxicity (DLT) assessment window is complete. The trial team then faces two related but distinct questions: does this patient count toward the protocol’s planned number of evaluable patients, and how should the available follow-up enter the model? Treating those as one question can either leave a dose level with too few assessable patients or discard useful information.

The first decision is operational. It determines whether another patient may be enrolled to meet a planned evaluable-patient target. The second is statistical. It determines how the original patient’s observed DLT status and time at risk contribute to the dose-toxicity analysis. A patient can be eligible for replacement while still contributing partial follow-up to the model. Replacement does not erase the original patient or convert their incomplete record into a completed non-DLT outcome.

The exact rule must be specified in the protocol. There is no universal minimum follow-up duration that makes a patient evaluable, and a model that can use partial follow-up does not by itself define who is eligible for replacement.

Definition: A DLT-evaluable patient is a patient whose outcome meets the protocol’s prespecified criteria for inclusion in the planned evaluable-patient count. A replacement is an additional enrolled patient used to meet that planned count when an earlier patient does not meet those criteria. Partial follow-up is observed time and outcome information before the end of the assessment window; it may inform the model even when the patient is not counted as DLT-evaluable.

Specify the Rule Before Enrollment

A workable replacement policy needs to state the assessment window \(W\), the event that qualifies as a DLT, what makes an outcome evaluable, and which incomplete outcomes permit replacement. It should also say whether the replacement is assigned to the same dose or to a dose selected under the trial’s current escalation rules. Replacement is not an exception to dose-assignment or safety constraints.

A simple policy might count a patient as evaluable if they experience a protocol-defined DLT during the window or complete the window without a DLT. Under that policy, a patient who stops follow-up early without a DLT is not evaluable and may be replaced. But the protocol might instead define a minimum adequate follow-up duration, or specify how particular events such as progression, death, or withdrawal affect evaluability. Those decisions depend on the trial’s endpoint and must be settled prospectively.

The reason for incomplete follow-up matters for classification, but it should not invite ad hoc decisions. For example, an early stop due to suspected treatment-related toxicity requires review under the protocol’s DLT definition; it must not automatically be treated as a non-DLT dropout. Conversely, an unrelated event is not automatically a DLT merely because it prevents further assessment. Apply the endpoint and attribution rules consistently.

1
Classify the observed outcome.
Determine whether a protocol-defined DLT occurred. If a DLT occurred, record it and apply the protocol’s evaluability rule; do not call the patient a non-DLT dropout simply because the event ended follow-up early.
2
Check the evaluability criterion.
If no DLT was observed, determine whether the patient completed the assessment window or met another prespecified criterion for adequate follow-up.
3
Apply replacement eligibility.
If the patient does not meet the evaluability rule, determine whether the protocol permits a replacement and where that replacement may be assigned.
4
Retain the original record in the model.
Pass the observed event status and follow-up time to the model using its specified treatment of incomplete follow-up. Do not recode missing window time as observed DLT-free time.

Partial Follow-Up Is Not the Same as a Completed Non-DLT Outcome

Let \(p_d\) denote the probability of a DLT by the end of window \(W\) at dose \(d\). A patient with no DLT observed through time \(t<W\) has not necessarily completed a DLT-free window. The model should therefore use the information actually observed, according to its specified likelihood or partial-follow-up method.

For a compact illustration, suppose the model assumes that, conditional on a DLT occurring by \(W\), its time is uniform over the window. This is a simplifying time-to-event assumption, not a general property of DLTs. For a patient with no DLT observed by time \(t\), the probability of remaining DLT-free through \(t\) is the probability of no DLT in the full window plus the probability of a DLT whose event time is after \(t\):

$$ P(T>t\mid d) =(1-p_d)+p_d\left(1-\frac{t}{W}\right) =1-p_d\frac{t}{W}, \qquad 0\leq t\leq W. $$

At \(t=0\), this likelihood contribution is 1: no DLT-free follow-up has been observed. At \(t=W\), it is \(1-p_d\): the patient has completed the window without a DLT. For intermediate \(t\), the observation provides evidence, but less than a completed DLT-free window. Other time-to-event models use their own event-time distribution and likelihood. TITE-CRM methods likewise use the model’s specified partial-follow-up treatment; the expression above should not be substituted for a different model’s likelihood.

Worked Example: Early Withdrawal With No Observed DLT

Suppose a hypothetical protocol sets \(W=28\) days and plans to obtain six evaluable patients at a dose. It defines a patient as evaluable if a DLT occurs during the window or the patient completes 28 days without one. A patient withdraws on day 14 for a reason adjudicated as unrelated to toxicity, with no DLT observed. The protocol permits replacement of patients who do not meet the evaluability rule.

Replacement decision. The patient had no observed DLT and did not complete the 28-day window. Under the stated rule, the patient is not evaluable and may be replaced. If the six-patient target is still to be met, one additional patient is needed, subject to current dose-assignment and safety rules.

Model contribution. For illustration, use the uniform conditional event-time assumption above and suppose \(p_d=0.30\). With \(t=14\) days:

$$ P(T>14\mid d)=1-0.30\left(\frac{14}{28}\right) =1-0.15=0.85. $$

The observed 14 DLT-free days contribute likelihood 0.85 under this hypothetical value of \(p_d\). A completed 28-day DLT-free window would contribute \(1-0.30=0.70\). The patient may therefore be replaced operationally while their partial observation remains in the model; the record is not equivalent to either a completed non-DLT or no information.

Worked Decisions at the Boundary

Worked Example: DLT Occurs Before the Window Ends

A hypothetical trial has a 28-day window. A patient at dose \(d\) develops a protocol-defined DLT on day 9. The planned evaluability rule counts a patient with a DLT during the window as evaluable, even if follow-up ends early because of that event.

Replacement decision. The patient is evaluable because the endpoint of interest—a DLT within the window—has been observed. Under this stated policy, this patient does not qualify for replacement merely because they did not reach day 28. The observed DLT is recorded at dose \(d\) and enters the model as an event.

Why this differs from early withdrawal. In the prior example, no event had been observed and the patient had not completed the window. Here, the event defining the outcome has occurred. Ending follow-up after an observed DLT does not make that outcome incomplete for a binary “DLT by day 28” endpoint. Any additional evaluability requirements in an actual protocol would still govern.

Worked Example: Near-Complete Follow-Up Still Fails the Stated Rule

Consider a second hypothetical protocol with the same 28-day window and the same rule: a patient is evaluable only after a DLT during the window or completion of the full window without a DLT. A patient has no observed DLT through day 26, then becomes unavailable for follow-up because of an unrelated event. The protocol allows replacement when this rule is not met.

Replacement decision. The patient has not experienced a DLT and has not completed 28 days. Even though 26 days is close to the full window, this patient does not satisfy the stated evaluability criterion and may be replaced. A different protocol could specify an adequate-follow-up threshold, but it must do so in advance; the trial team should not create a threshold after seeing the patient’s outcome.

Model contribution. Under the same illustrative model with \(p_d=0.30\), the observed DLT-free follow-up contributes:

$$ P(T>26\mid d)=1-0.30\left(\frac{26}{28}\right) =1-0.2786\approx 0.7214. $$

This is more informative about a DLT-free window than the 14-day observation in the previous example, but it is not the completed-window contribution \(0.70\). Replacement eligibility follows the protocol’s categorical rule; the model contribution reflects the amount and pattern of observed follow-up.

Justification: Why Keep Both Decisions Separate?

The separation follows from the different purposes of the two rules. The evaluability rule controls whether the planned count of assessable outcomes has been met. The likelihood describes how compatible the observed data are with possible dose-toxicity risks. A patient can fail the first criterion yet provide data for the second.

In the illustrative model, the likelihood of remaining event-free through \(t\) is \(L(p_d;t)=1-p_dt/W\). For \(0<t<W\), this lies between the likelihood at enrollment and the likelihood after a completed DLT-free window:

$$ 1=L(p_d;0) \geq L(p_d;t) \geq L(p_d;W)=1-p_d. $$

The inequalities hold because \(0\leq t/W\leq 1\) and \(p_d\geq 0\). Thus partial follow-up is not empty, but it is not the same observation as a completed window. This reasoning depends on the stated model assumptions; a different time-to-event model may produce a different partial-follow-up likelihood. In all cases, replacement must not be used as a reason to remove observed data from the analysis.

Diagnostics, Alternatives, and Common Pitfalls

Operational review should compare replacement counts with the reasons and timing of incomplete follow-up. Unexpectedly frequent replacement at one dose, repeated early exits, or inconsistencies in DLT adjudication can signal a protocol, data-collection, or safety issue. Monitor pending follow-up explicitly: a patient who is still within the window is not the same as a patient whose follow-up has ended prematurely. Track each patient’s dose, window start, last observed day, DLT status and date, reason observation ended, evaluability classification, replacement status, and model-data status.

The main alternative to replacing incomplete patients is to enroll without a fixed evaluable-patient target and let the model use all available follow-up. That can avoid replacement enrollment, but may leave less mature information at a decision point and requires a model appropriate for pending outcomes. A hybrid policy can specify a target number of evaluable patients while also retaining partial observations in the model. Neither approach removes the need for a clear follow-up and dose-assignment policy.

  • Mistake: “The model can use partial follow-up, so no replacement is needed.” Correction: model contribution and the protocol’s planned evaluable-patient count answer different questions. A trial may permit partial information in the model and still require replacement to meet its target.
  • Mistake: “The patient was replaced, so their data should be dropped.” Correction: replacement adds a patient; it does not undo the original observation. Retain the original event and follow-up information using the specified model.
  • Mistake: “No DLT was observed, therefore this was a non-DLT.” Correction: that conclusion is justified for the window only when the endpoint and follow-up rule support it. No event observed during incomplete follow-up is not automatically a completed-window non-DLT.
  • Mistake: “A DLT caused early discontinuation, so the patient is not evaluable.” Correction: if the protocol-defined DLT occurred, the relevant endpoint may already be observed. Apply the protocol’s evaluability and adjudication rules rather than using window completion as a blanket requirement.

Replacement can also increase the number of patients exposed and affect how quickly dose recommendations are made. The policy should therefore be reviewed alongside accrual, safety monitoring, and the model’s handling of pending outcomes. It is not a statistical correction for selection bias if patients are classified differently based on whether their outcomes are convenient or informative.

Key takeaway: Decide replacement eligibility from prespecified protocol criteria, and decide model contribution from the observed follow-up under the specified likelihood. An incomplete patient can be replaced and still remain informative.

Check Your Understanding

Answer each question using the stated protocol rules. Full solutions follow the questions.

  1. A 21-day protocol counts patients with a DLT during the window or with 21 DLT-free days as evaluable. A patient has no DLT through day 10 and withdraws. Is the patient evaluable under this rule, and may they be replaced if replacement is permitted for non-evaluable patients?
  2. Under the illustrative uniform conditional event-time model, let \(W=20\) days, \(t=5\) days, and \(p_d=0.40\). What is the likelihood contribution for no DLT observed through day 5?
  3. A patient experiences a protocol-defined DLT on day 4 of a 21-day window. Does the short follow-up alone make the patient non-evaluable under the rule used in question 1?
  4. Why is it incorrect to delete a patient’s partial follow-up from the model just because a replacement was enrolled?

Solutions. (1) The patient is not evaluable: they had no observed DLT and completed only 10 of 21 days. If the protocol permits replacement for non-evaluable patients, they may be replaced, while their 10 days remain available to the model. (2) \(1-p_dt/W=1-0.40(5/20)=1-0.10=0.90\). The likelihood contribution is 0.90 under the stated assumptions. (3) No. The observed DLT meets the event-based evaluability criterion, so the short follow-up alone does not make the patient non-evaluable. (4) Replacement addresses the planned evaluable-patient count; it does not change what was observed. The original patient’s event status and follow-up time must be retained and handled by the specified model.

Clinical Biostats