Tutorials › Response-Adaptive Randomization › Delayed Binary Endpoints With Fixed Follow-Up

Delayed Outcomes · Tutorial 361 of 501

Delayed Binary Endpoints With Fixed Follow-Up

Learn how to define and update allocation probabilities for a fixed-window binary endpoint without treating patients who have not completed follow-up as failures.

Advanced 10 min read

What You'll Learn

  • Define when a fixed-follow-up binary endpoint is mature and available for an allocation update.
  • Specify an allocation rule using only information available at each assignment.
  • Calculate arm-specific response estimates and allocation probabilities from mature outcomes.
  • Distinguish structurally pending outcomes from overdue or informatively missing outcomes.
  • Identify assumptions, diagnostics, and limitations of mature-outcome adaptation.

Why Fixed Follow-Up Changes the Update

A binary endpoint may be defined as whether a patient has experienced a specified outcome by a fixed time after assignment: for example, response by day 28. The endpoint is binary, but it is not known at enrollment. Until the patient reaches the end of the window and the assessment is available, the response is pending, not a success or a failure. A response-adaptive design must therefore define both the endpoint and the information available when each new allocation is made.

The fixed window gives a clear endpoint definition, but it creates a predictable delay: patients enrolled recently have had less time to complete follow-up. An allocation rule based only on outcomes already observed can be implemented without guessing those patients' responses. Its cost is that the current estimate may use only older patients. The method is credible when its outcome and observation assumptions fit the trial and when that limitation is recognized.

Endpoint, Maturity, and Allocation Information

Suppose there are \(K\) treatment arms. Patient \(j\) is assigned to arm \(A_j\) at enrollment time \(e_j\). Let \(W\) be the prespecified follow-up window, and define \(Y_j=1\) if the patient meets the binary response definition by \(e_j+W\), and \(Y_j=0\) otherwise. The endpoint definition must specify what counts as response, the assessment time or window, and how an assessment not obtained at the required time is handled. The response is not defined by whether it has already been reported.

Let \(C_j\) denote the time the required endpoint information is available to the allocation system. At decision time \(t\), patient \(j\)'s response is mature and observed if \(e_j+W\leq t\), \(C_j\leq t\), and the endpoint is recorded. Patients whose windows have not ended are structurally pending. A patient whose window has ended but whose endpoint remains unrecorded is overdue or incomplete; that is a different status and should be monitored separately.

Definition: The mature-outcome set at time \(t\) is the set of enrolled patients for whom the fixed follow-up window has ended and the endpoint is available by \(t\). A pending response is an unobserved \(Y_j\) for a patient who has not yet completed the window. It is neither \(Y_j=0\) nor \(Y_j=1\).

Let \(\mathcal{F}_{j-1}\) denote the information available immediately before assigning patient \(j\). It can include previous assignments, mature endpoint values, enrollment times, and the status of pending follow-up. A mature-only allocation rule chooses probabilities \(\pi_{j,k}=P(A_j=k\mid\mathcal{F}_{j-1})\), for \(k=1,\ldots,K\), using the mature responses rather than unobserved responses. It must be implementable: the rule cannot depend on \(Y_i\) if \(Y_i\) is still unknown at that decision. A common protection against excluding an arm is to require \(\pi_{j,k}\geq\epsilon/K\) for every arm, where \(0<\epsilon<1\).

For a basic response model, assume that, conditional on assignment to arm \(k\) and any prespecified covariates used in the model, responses have a stable probability \(p_k\) of being 1 over the trial. For the simple calculation below, suppose \(Y_j\mid A_j=k\sim\operatorname{Bernoulli}(p_k)\), with conditionally independent patient responses. This working model excludes unaccounted changes in response over calendar time and dependence between patients. Random assignment probabilities are chosen from the recorded history; they do not make the unknown response of a pending patient observable.

Estimating Response and Turning Estimates Into Probabilities

For arm \(k\), let \(n_k(t)\) be the number of mature, observed endpoints and \(s_k(t)\) the number of responses among them. When \(n_k(t)>0\), the empirical estimate is \(\hat p_k(t)=s_k(t)/n_k(t)\). If an arm has no mature observations, its empirical rate is undefined; a rule must specify what to do rather than silently assign it a rate of zero.

One possible allocation illustration uses a \(\operatorname{Beta}(1,1)\) prior for each arm's response probability. Its posterior mean based on the mature outcomes is \(q_k=(s_k+1)/(n_k+2)\). For a power \(\gamma>0\), define \(r_k=q_k^\gamma/\sum_{\ell=1}^{K}q_\ell^\gamma\). A probability-floor version of the rule is \(\pi_{j,k}=(1-\epsilon)r_k+\epsilon/K\). This is one transparent example of a rule, not a uniquely required choice. Its use presumes that the response estimates are relevant to the population currently enrolling, that the endpoint data are correctly recorded, and that the allocation system uses only data available at that time.

Worked Example: Updating With Mature Responses

In a hypothetical two-arm trial, the fixed endpoint is response by day 28. At an allocation update, arm A has 8 mature patients, 5 of whom responded; arm B has 6 mature patients, 3 of whom responded. Two additional patients on A and three on B are still within their 28-day windows. Use the illustrative rule above with \(\gamma=2\) and \(\epsilon=0.10\).

The pending patients are not included in either denominator. Thus the mature response estimates are \(5/8=0.625\) for A and \(3/6=0.500\) for B. With the stated Beta prior, the smoothed values are \(q_A=(5+1)/(8+2)=0.600\) and \(q_B=(3+1)/(6+2)=0.500\).

The squared weights are \(q_A^2=0.3600\) and \(q_B^2=0.2500\), so \(r_A=0.3600/(0.3600+0.2500)=0.5902\) and \(r_B=0.2500/0.6100=0.4098\). Applying the probability floor gives \(\pi_{j,A}=0.90(0.5902)+0.10/2=0.5812\) and \(\pi_{j,B}=0.90(0.4098)+0.10/2=0.4188\).

The probabilities sum to 1, and each exceeds the minimum \(0.05\). These values follow from the mature data and the specified rule; they are not evidence that the pending patients on either arm will respond.

Why Pending Outcomes Must Not Be Coded as Failures

The timing distinction can be seen directly from a fixed-window example. Suppose an update occurs at the end of calendar day 60, the window is 28 days, and assessments are available as soon as the window ends. A patient enrolled on day 30 has completed the window by day 58 and may contribute an observed endpoint. A patient enrolled on day 40 cannot complete the window before day 68. On day 60 that patient's endpoint is unknown, even if the patient has not yet shown a response. Coding the latter patient as a failure changes the response definition from “response by day 28” to a mixture of that endpoint and “response observed so far.”

A short justification clarifies how pending patients enter a response-data calculation. Under the independent Bernoulli working model, if the observed pattern is fixed or ignorable with respect to the unobserved response, the response likelihood for mature observations on arm \(k\) is

$$ L_k(p_k)=p_k^{s_k}(1-p_k)^{n_k-s_k}. $$

A pending patient's response has not been observed. If pending status is determined by enrollment time and the fixed window, independently of that patient's eventual \(Y_j\), summing over the two possible responses contributes \(\sum_{y=0}^{1}P(Y_j=y\mid A_j=k)=p_k+(1-p_k)=1\). It contributes no observed response to the mature-outcome likelihood. This argument does not establish that every observed-only likelihood is valid: it depends on the stated independence and observation assumptions.

In particular, a Bernoulli response model alone does not justify ignoring outcome-dependent observation. If a response is more likely to be recorded when \(Y=1\), then the response distribution among recorded cases differs from the population response distribution. For example, let \(p=P(Y=1)=0.60\), with observation probabilities \(P(R=1\mid Y=1)=0.90\) and \(P(R=1\mid Y=0)=0.50\). Then

$$ P(Y=1\mid R=1) =\frac{P(R=1\mid Y=1)P(Y=1)} {P(R=1\mid Y=1)P(Y=1)+P(R=1\mid Y=0)P(Y=0)} =\frac{0.90(0.60)}{0.90(0.60)+0.50(0.40)} =0.7297. $$

Thus the observed cases would have a response proportion of about 0.730 under this selection mechanism, not 0.600. If observation can depend on the unobserved outcome, a valid analysis needs a model for observation and the unobserved responses, or another justified method for handling the missing data. The simple mature-outcome calculation should not be presented as the joint observed-data likelihood in that setting.

Worked Example: Distinguishing Pending From Overdue

In a hypothetical trial with a day-28 endpoint, a patient enrolled 20 days ago has no recorded response yet. A second patient enrolled 35 days ago also has no endpoint recorded. Assume their enrollment dates and the assessment system's records are accurate.

The first patient's window has 8 days remaining, so that response is structurally pending. It is excluded from the mature-response count and is not a failure. The second patient's window ended 7 days ago. Since the endpoint is still absent, this patient is overdue or incomplete, not merely pending. The trial team should check the assessment and data-capture process and apply the prespecified missing-data procedure.

For example, if the mature counts used by the allocation algorithm are 5 responses among 8 mature patients on A, this overdue patient's absent record does not justify changing the count to 5 among 9. Doing so would implicitly define every unrecorded endpoint as a failure. Whether the overdue patient's eventual response can be used requires an explicit missing-data rule; it cannot be resolved by relabeling the status.

Implementation Checks and Alternatives

A protocol should specify the response definition, the window \(W\), the time at which an endpoint becomes usable, and how records arriving after that time are handled. It should also state which patients enter each update, how zero mature counts are handled, what allocation probabilities are calculated, and how minimum probabilities are enforced. Operationally, the allocation system should retain enrollment dates and distinguish “window not complete” from “window complete but endpoint unavailable.”

Useful checks include verifying that no endpoint enters an update before its window ends, that each mature response matches the endpoint definition, and that the allocation probabilities are nonnegative and sum to 1. Review mature sample sizes by arm and the number and age of overdue records. If recent enrollment has a different case mix or response probability from older enrollment, an older mature sample may poorly represent current patients. Check for calendar-time changes, arm-specific follow-up completion, and patterns of missing assessments; do not assume these are harmless just because the endpoint window is fixed.

Mature-only adaptation is one option among several. Waiting for a cohort or a specified number of endpoints reduces the frequency of updates but can delay enrollment or produce periods with no new information. Predictive imputation can use pending patients in an allocation calculation, but it adds model assumptions and must distinguish a prediction from an observed response. Mature-only updating avoids imputing pending responses, at the cost of slower feedback. These alternatives do not change the endpoint's definition, and none makes an informative observation process ignorable.

ApproachWhat informs the updateMain trade-off
Mature outcomes onlyObserved endpoints after the fixed windowSimple to implement, but feedback uses a smaller and older sample
Wait for a cohort or thresholdOutcomes after a prespecified wait or maturity conditionClear update timing, but enrollment or updates may be delayed
Predict pending responsesObserved data plus a predictive model for unobserved endpointsEarlier feedback, but predictions rely on additional assumptions

The fixed-window setup also has limits. It does not by itself guarantee stable response probabilities, equal outcome ascertainment across arms, or absence of calendar trends. Nor does a response-adaptive allocation probability determine the final treatment-effect analysis: the trial's analysis must account for its design and the endpoint's observation process. The main practical safeguard is to keep the response definition, maturity rule, and allocation information set aligned.

Common mistake: “There is no recorded response yet, so count the patient as a nonresponder.” This is wrong for a patient who has not completed the fixed follow-up window. The endpoint is not yet observed; record the patient as pending and exclude the response from a mature-only update. If the window has ended and the endpoint is still absent, treat the record as overdue or incomplete and follow the prespecified missing-data procedure.

Worked Example: A Simple Two-Arm Update Without Smoothing

In a hypothetical trial, an update uses only mature outcomes and assigns in proportion to the empirical response estimates, with equal allocation if both estimates are zero. Arm A has 12 mature patients and 7 responses; arm B has 10 mature patients and 4 responses. Two further patients on B have not completed follow-up. Calculate the empirical allocation probabilities, before any probability floor.

The mature estimates are \(\hat p_A=7/12=0.5833\) and \(\hat p_B=4/10=0.4000\). The pending patients on B are excluded. The proportional allocation rule gives \(\pi_A=0.5833/(0.5833+0.4000)=0.5932\) and \(\pi_B=0.4000/(0.5833+0.4000)=0.4068\).

These probabilities sum to 1 and favor A under this rule. They do not mean A has a 59.3% response probability; they are probabilities of assigning the next patient. With few mature observations, empirical estimates can be unstable, and this unsmoothed rule may need a prespecified safeguard such as a probability floor or smoothing.

Check Your Understanding

Answer each question before reading the solutions.

  1. A patient has 10 days remaining in a prespecified 28-day follow-up window and has no recorded response. How should the patient be classified for a mature-only update?
  2. Arm A has 9 mature endpoints, including 6 responses; arm B has 5 mature endpoints, including 2 responses. One more patient on B is still within the follow-up window. What are the two empirical response estimates?
  3. Why is a patient whose window ended but whose endpoint is unrecorded not automatically equivalent to a patient whose window is still in progress?
  4. State the assumptions needed for the simple product Bernoulli response likelihood among observed mature endpoints to be appropriate.

Solutions. (1) The patient is pending because the fixed window is not complete. Do not code the patient as a failure or include an unobserved response in the mature count. (2) The estimates are \(6/9=0.6667\) for A and \(2/5=0.4000\) for B; the pending patient on B is excluded. (3) The first status is explained by the prespecified endpoint timing, whereas the second indicates a missing or delayed record after the endpoint was due. The latter requires monitoring and the prespecified missing-data procedure. (4) The model requires conditionally independent Bernoulli responses with the stated arm-specific probabilities and an observation pattern that is fixed or ignorable with respect to unobserved responses. If observation is informative, a missingness model and appropriate accounting for unobserved outcomes are needed.

Clinical Biostats