Tutorials › Adaptive Clinical Trial Design › Delayed Outcomes In Joint Dose-Finding

Phase 1/2 Designs With Efficacy and Toxicity · Tutorial 621 of 799

Delayed Outcomes In Joint Dose-Finding

Use the follow-up accrued so far, rather than treating pending outcomes as absent, to update dose-specific efficacy and toxicity estimates.

Advanced 12 min read

What You'll Learn

  • Construct likelihood contributions for events and event-free follow-up at an interim analysis.
  • Account for different efficacy and toxicity assessment windows and unequal participant follow-up.
  • Derive the exponential time-to-event likelihood and its conjugate Bayesian update.
  • Translate updated event-time estimates into window-specific outcome probabilities.
  • Identify assumptions, diagnostics, and failure modes when using pending data for dose assignment.
  • Compare survival-likelihood methods with complete-case and simple binary approaches.

Why Pending Outcomes Matter

In dose-finding trials, participants may be assigned a dose before their efficacy and toxicity outcomes can be fully assessed. At an interim analysis, one participant may have completed both assessment windows, another may have completed only the toxicity window, and a recently enrolled participant may have had neither outcome yet. Treating every pending outcome as if it were absent discards information; treating it as a completed event-free assessment overstates the evidence for safety or lack of efficacy.

The relevant information is the time each participant has been observed without an event, as well as any event time already observed. A time-to-event likelihood uses both. It allows a dose assignment decision to use partial follow-up while distinguishing a participant who has had no event after one week from one who remained event-free through a full assessment window.

Definition: For outcome \(k\) (efficacy or toxicity), let \(T_{ik}\) be participant \(i\)'s time from dose assignment to the event of interest. Let \(W_k\) be the prespecified assessment window for that outcome, and let \(R_i\) be the participant's available follow-up at the interim analysis. The observed time is \(Y_{ik}=\min(T_{ik},R_i,W_k)\). Set \(\Delta_{ik}=1\) if the event is observed by \(Y_{ik}\), and \(\Delta_{ik}=0\) if follow-up ends at \(Y_{ik}\) without an observed event. A pending outcome with \(\Delta_{ik}=0\) contributes event-free follow-up up to \(Y_{ik}\); it is not classified as a completed no-event outcome unless the full window \(W_k\) has been observed.

Likelihood Contributions With Unequal Follow-Up

Suppose participants assigned to dose \(d\) have an outcome time with density \(f_d(t)\) and survival function \(S_d(t)=P(T>t\mid d)\). If an event is observed at time \(y\), that observation contributes the event-time density \(f_d(y)\). If no event has been observed by time \(y\), the contribution is the probability of remaining event-free through \(y\), namely \(S_d(y)\). Thus, for one outcome, the likelihood contribution is

$$ L_{ik}(d)=f_d(Y_{ik})^{\Delta_{ik}}S_d(Y_{ik})^{1-\Delta_{ik}}. $$

This expression also covers completed windows: if a participant is event-free at the end of the window, \(Y_{ik}=W_k\) and the contribution is \(S_d(W_k)\). A participant whose follow-up ends earlier contributes survival only through that shorter time. If efficacy and toxicity times are conditionally independent given dose and model parameters, their contributions multiply. If the model allows dependence, the appropriate joint time-to-event likelihood must be used instead; multiplying marginal likelihoods would then generally be incorrect.

For a transparent working model, suppose each outcome has a dose-specific exponential time distribution. Write \(\lambda_{dk}\) for its event rate per unit time. The model assumes a constant event hazard over the relevant window, so \(f_d(t)=\lambda_{dk}\exp(-\lambda_{dk}t)\) and \(S_d(t)=\exp(-\lambda_{dk}t)\). Substitution gives

$$ L_{ik}(d)=\lambda_{dk}^{\Delta_{ik}}\exp(-\lambda_{dk}Y_{ik}). $$

For multiple participants at dose \(d\), define \(D_{dk}=\sum_i\Delta_{ik}\), the number of observed events, and \(A_{dk}=\sum_iY_{ik}\), the total observed time at risk, capped at the outcome-specific window. The likelihood becomes

$$ L_{dk}(\lambda_{dk})\propto \lambda_{dk}^{D_{dk}}\exp(-\lambda_{dk}A_{dk}). $$

The unequal follow-up times enter through \(A_{dk}\): someone observed event-free for one week contributes one week, not a full assessment window. Efficacy and toxicity have separate \(Y_{ik}\), \(W_k\), event counts, and exposure totals when their assessment schedules differ.

Worked Example: Two Pending Outcomes With Different Windows

Consider a hypothetical participant at a dose with an efficacy event rate of \(0.10\) per week and a toxicity event rate of \(0.08\) per week. The efficacy window is 8 weeks and the toxicity window is 4 weeks. At the interim analysis, the participant has been followed for 2 weeks with neither event observed. Assume independent exponential event times for this calculation.

The efficacy contribution is survival through 2 weeks, \(\exp(-0.10\times2)=\exp(-0.20)\). The toxicity contribution is \(\exp(-0.08\times2)=\exp(-0.16)\). Their joint contribution under the stated independence assumption is

$$ \exp(-0.20)\exp(-0.16)=\exp(-0.36)\approx0.6977. $$

This is not the likelihood contribution of a participant known to be event-free through both full windows. That completed observation would contribute \(\exp(-0.10\times8)\exp(-0.08\times4)=\exp(-1.12)\approx0.3263\). The pending participant has supplied evidence of two event-free weeks for each outcome, not evidence of eight and four weeks, respectively.

Updating Dose Estimates With Partial Follow-Up

A dose-finding procedure can use these likelihood contributions to update its dose-specific event-time estimates at each interim analysis. One convenient illustration is a Bayesian exponential model. For a particular dose and outcome, place a Gamma prior on the event rate, using a shape \(a\) and rate \(b\): \(\lambda\sim\mathrm{Gamma}(a,b)\). Here \(b\) is expressed in the same time units as the follow-up. Combining this prior with the likelihood above gives a Gamma posterior. The derivation follows directly by multiplying the prior density by the likelihood:

$$ \begin{aligned} \pi(\lambda\mid\text{data}) &\propto \lambda^{a-1}\exp(-b\lambda)\, \lambda^{D}\exp(-A\lambda)\\ &\propto \lambda^{a+D-1}\exp\{-(b+A)\lambda\}. \end{aligned} $$

This is the kernel of \(\mathrm{Gamma}(a+D,b+A)\). Observed events increase the shape, while all observed follow-up, including time from participants whose outcomes are pending, increases the rate parameter. Under this model the posterior mean event rate is \((a+D)/(b+A)\). The formula is useful only under the exponential model and the stated prior; another time-to-event model would require its own likelihood and update.

Worked Example: Updating an Efficacy Rate With Pending Participants

Suppose a hypothetical dose has an efficacy event rate \(\lambda\) per week with prior \(\mathrm{Gamma}(1,10)\), using the rate parameterization. At the interim analysis, one participant has an efficacy event at week 3, while two others have no observed efficacy event after 2 and 5 weeks of follow-up. Assume exponential event times and noninformative censoring.

There is \(D=1\) observed event and \(A=3+2+5=10\) participant-weeks of follow-up. The posterior is

$$ \lambda\mid\text{data}\sim\mathrm{Gamma}(1+1,10+10) =\mathrm{Gamma}(2,20). $$

Its posterior mean is \(2/20=0.1000\) events per week. For an efficacy window of 6 weeks, the posterior predictive probability of at least one efficacy event is \(1-E[\exp(-6\lambda)\mid\text{data}]\). For a Gamma distribution with shape \(a\) and rate \(b\), \(E[\exp(-t\lambda)]=(b/(b+t))^a\), so here

$$ P(T\le6\mid\text{data}) =1-\left(\frac{20}{20+6}\right)^2 =1-\frac{400}{676} \approx0.4083. $$

The two pending participants have contributed 7 weeks of event-free follow-up. Their outcomes have not been declared negative; their follow-up helps update the rate while retaining uncertainty about what may happen later.

From Updated Event Times to an Interim Dose Assignment

An event rate is not itself a dose decision. A design must connect the updated model to the trial's prespecified clinical priorities, such as the importance of efficacy relative to toxicity and the time windows in which those outcomes matter. Under an exponential model, a rate \(\lambda\) implies a probability \(1-\exp(-\lambda W)\) of observing the event by window \(W\). For efficacy, a higher event probability may be desirable; for toxicity, it may be harmful. Different windows matter: comparing rates alone can conceal the probability of events during the actual clinical assessment periods.

The following calculation illustrates the translation. It uses fixed rates to make the arithmetic transparent; in a Bayesian design, uncertainty in those rates should also be incorporated into the decision quantity.

Worked Example: Comparing Doses Using Their Own Assessment Windows

Suppose an interim model gives the following illustrative efficacy and toxicity rates per week: dose A has \(\lambda_E=0.08\) and \(\lambda_T=0.04\); dose B has \(\lambda_E=0.14\) and \(\lambda_T=0.09\). The efficacy window is 6 weeks, the toxicity window is 4 weeks, and the prespecified illustrative utility is \(U=P(E\text{ by }6)-2P(T\text{ by }4)\). This additive utility assigns benefit 1 to an efficacy event and harm 2 to a toxicity event.

At dose A, the efficacy probability is \(1-\exp(-0.08\times6)=1-\exp(-0.48)\approx0.3812\), and the toxicity probability is \(1-\exp(-0.04\times4)=1-\exp(-0.16)\approx0.1479\). Therefore,

$$ U_A=0.3812-2(0.1479)\approx0.0855. $$

At dose B, the efficacy probability is \(1-\exp(-0.14\times6)=1-\exp(-0.84)\approx0.5683\), and the toxicity probability is \(1-\exp(-0.09\times4)=1-\exp(-0.36)\approx0.3023\). Thus,

$$ U_B=0.5683-2(0.3023)\approx-0.0364. $$

Under this particular utility and these illustrative rates, dose A has the larger value. This is not a universal allocation rule: different clinical priorities, constraints, uncertainty, or dose-response models can change the comparison. The calculation shows why the windows must be applied outcome by outcome before the dose-level decision is made.

1
Record status and follow-up separately for each outcome.
At the interim look, determine whether efficacy or toxicity has occurred, the time of any event, and the duration observed without an event. Cap event-free follow-up at the relevant prespecified window.
2
Update the joint dose model.
Use event-time and survival contributions for all enrolled participants, including those with pending outcomes. Preserve modeled dependence if the design uses a dependent joint outcome model.
3
Apply the prespecified assignment rule.
Translate the updated dose-specific outcomes into the trial's decision quantity and apply its safety and allocation requirements. Do not substitute a completed binary classification for a still-pending outcome.

Assumptions, Diagnostics, and Alternatives

The likelihood approach depends on a clear event definition, reliable event times, and prespecified assessment windows. Censoring must be noninformative for the event-time model: conditional on variables included in the model, the reason follow-up ends must not convey additional information about the unobserved event time. Administrative censoring at an interim cutoff is often compatible with this assumption when enrollment timing is unrelated to participants' outcomes. Loss to follow-up related to prognosis may not be. The exponential version adds a constant hazard assumption within each modeled dose and outcome. It should not be adopted merely for computational convenience if risk is expected to change substantially over time.

At interim looks, useful checks include tabulating event counts and accumulated follow-up separately by dose and outcome; checking that each participant's time is capped at the correct window; comparing enrollment and dropout patterns across doses; and examining whether observed event timing is consistent with the chosen time-to-event model. A dose with little follow-up can have a highly uncertain event rate even if no events have yet occurred. That uncertainty should be visible in the decision calculation, not hidden by a point estimate. If event hazards vary over time, alternative survival models can represent that pattern. If censoring is plausibly informative, sensitivity analyses or an explicit model for the dropout process may be needed.

Complete-case analysis waits for full assessment and avoids using partial follow-up, but can delay decisions and exclude much of the available information. A simple binary analysis that labels pending participants as event-free is faster but biased toward underestimating event risk when follow-up is incomplete. Some time-to-event dose-finding procedures use a weighting approximation for partially observed participants; a full survival likelihood instead uses the observed event time or survival time under its specified model. The likelihood approach is more explicit about exposure duration and windows, but its validity depends more directly on correct event-time and censoring assumptions.

A frequent mistake is to say, “No toxicity has been reported, so this participant is a toxicity-free observation.” If the participant has been followed for only one of a four-week toxicity window, the correct contribution is survival through one week, not survival through four weeks. Another mistake is to multiply efficacy and toxicity marginal contributions when the fitted model allows dependence. The correction is to use the joint likelihood implied by that model. These distinctions matter because early assignment decisions can otherwise look more reassuring than the available follow-up warrants.

Key takeaway: Pending outcomes still provide information through observed event-free time. Use the correct follow-up duration and outcome-specific window in the likelihood, preserve any modeled dependence, and make dose assignments under assumptions that have been checked and stated.

Check Your Understanding

Answer each question, then compare with the solutions below.

  1. Under an exponential model with rate \(0.05\) per day, what is the contribution from a participant observed event-free for 10 days?
  2. A participant has no efficacy event after 3 weeks of follow-up, with a 6-week window. Is this a completed no-event outcome? What does the likelihood use?
  3. For a dose with 2 observed events and 18 total participant-weeks at risk, write the exponential likelihood kernel for its event rate.
  4. Name one assumption needed for interpreting administrative censoring as noninformative, and one warning sign that it may fail.

Solutions. (1) The contribution is \(S(10)=\exp(-0.05\times10)=\exp(-0.5)\approx0.6065\). (2) No. The observation is pending; the survival contribution is through 3 weeks, \(S(3)\), rather than through the full 6-week window. (3) With \(D=2\) and \(A=18\), the likelihood kernel is \(\lambda^2\exp(-18\lambda)\). (4) Administrative censoring is noninformative when, conditional on modeled information, the interim cutoff or enrollment timing does not depend on the participant's unobserved event time. A warning sign is dropout related to worsening health or another predictor of the event time that the model does not account for.

Clinical Biostats