Tutorials › Response-Adaptive Randomization › Distinguishing Pending Outcomes From Dropout

Delayed Outcomes · Tutorial 380 of 501

Distinguishing Pending Outcomes From Dropout

Learn to classify unresolved records consistently and update future allocation probabilities without treating pending or missing outcomes as observed failures.

Advanced 12 min read

What You'll Learn

  • Distinguish an outcome that is not yet due from one that cannot be ascertained.
  • Separate withdrawal from treatment discontinuation and loss to follow-up.
  • Specify which outcome records can contribute to an allocation update.
  • Calculate a response-adaptive update while excluding pending and missing outcomes.
  • Identify status checks that help detect misclassification and stale data.

Why Status Classification Matters

At an allocation update, an assigned participant may have a known outcome, an outcome that is still pending, or an outcome that will not be obtained. These situations are not interchangeable. Coding every unresolved record as a nonresponse can distort arm-specific response estimates; coding every unresolved record as pending can conceal loss to follow-up. A reliable update therefore begins with an explicit status rule, not with an assumption about what an unknown outcome would have been.

The key distinction is between the outcome’s ascertainment and the participant’s participation status. Someone may stop taking assigned treatment but still provide outcome data. Someone may withdraw from some study procedures but permit follow-up. Conversely, a participant may remain willing to participate while a record is temporarily delayed. Allocation updates must use the outcome information actually eligible under the protocol, not infer it from a label such as “withdrawn.”

Operational Definitions and Assumptions

Definition: At a specified allocation-update time, an outcome is resolved if the prespecified endpoint has been ascertained and its value is available and valid for analysis. It is pending if the endpoint’s ascertainment period is still open, or if the result is being processed within the protocol’s allowed reporting period. It is unresolved and overdue if the applicable ascertainment deadline has passed but the endpoint is not yet classified as resolved or unavailable. An outcome is unavailable when the protocol’s criteria establish that it cannot be ascertained for that participant.

“Pending” is a time-specific status: the same record may be pending today and resolved later. “Overdue” describes a missed expected date, not necessarily a final outcome status. It should trigger follow-up or adjudication under prespecified rules. It does not, by itself, establish that the participant has dropped out.

Definition: Withdrawal is a participant’s decision to stop one or more aspects of study participation, recorded with the scope of that decision. Loss to follow-up is an operational determination that the study cannot obtain further relevant information after the protocol’s specified contact and ascertainment procedures. Treatment discontinuation means stopping assigned treatment; it does not automatically mean withdrawal from follow-up or loss to follow-up.

These definitions assume that the endpoint, its ascertainment window, the reporting deadline, permitted data sources, and follow-up procedures are specified before the update. The protocol must also state what data may still be collected or used after a participant withdraws. Applicable consent and data-use requirements take precedence: a previously recorded outcome must not be used if its use is prohibited.

For arm \(j\), let \(m_j\) be the number of participants with an eligible, resolved outcome at the update, and let \(r_j\) be the number of those outcomes classified as responses. The observed response proportion is \(r_j/m_j\), when \(m_j>0\). Pending records and unavailable outcomes are not included in either count. This calculation describes the available outcomes; it does not, by itself, guarantee an unbiased estimate of the response probability.

How Status Enters an Allocation Update

The following small allocation rule is used only to make the examples concrete. Suppose a prespecified two-arm procedure smooths each arm’s observed response proportion as

$$ \tilde p_j=\frac{r_j+1}{m_j+2}, \qquad q_A=\frac{\tilde p_A}{\tilde p_A+\tilde p_B}, \qquad q_B=1-q_A. $$

Here \(q_j\) is the probability assigned to the next eligible participant for arm \(j\). The added constants are part of this illustrative rule; they are not a universal correction. A real trial must use its prespecified allocation algorithm, including any probability bounds or other safeguards. The status rules below apply regardless of the particular algorithm.

A resolved response contributes one to \(r_j\) and one to \(m_j\). A resolved nonresponse contributes one to \(m_j\), but not to \(r_j\). A pending or unavailable outcome contributes to neither. Assignment history remains recorded for every randomized participant, including those without resolved outcomes; it is the outcome summary for the update, not the historical assignment record, that excludes unresolved outcomes.

Worked Example: Excluding Pending Outcomes From the Update

Suppose a hypothetical update has 10 resolved outcomes in arm A, of which 8 are responses, and 8 resolved outcomes in arm B, of which 6 are responses. In addition, 5 arm A outcomes and 2 arm B outcomes are still within their ascertainment windows.

For arm A, \(r_A=8\) and \(m_A=10\), so \(\tilde p_A=(8+1)/(10+2)=9/12=0.7500\). For arm B, \(\tilde p_B=(6+1)/(8+2)=7/10=0.7000\). Therefore \(q_A=0.7500/(0.7500+0.7000)=0.5172\), and \(q_B=0.4828\).

The 5 and 2 pending outcomes do not enter these calculations. If they were incorrectly counted as nonresponses, the estimates would instead be \(9/17=0.5294\) for A and \(7/12=0.5833\) for B, giving \(q_A=0.4758\). That change is driven by an unsupported assumption that every pending participant failed to respond.

This calculation is not a claim that the available-outcome estimates are unbiased. If response and resolution are related, the resolved outcomes may not represent all assigned participants. The calculation applies the stated allocation rule to outcomes currently eligible for use.

A Short Justification: Why “Unknown” Is Not “No”

Let \(Y_i\) equal 1 for a response and 0 for a nonresponse, and let \(R_i=1\) when participant \(i\)’s outcome is resolved at the update and 0 otherwise. If every unresolved record is coded as a nonresponse, the resulting proportion is \(\sum_i R_iY_i/n\), where \(n\) is the number assigned. Under the simplifying conditions that participants share response probability \(p\) and resolution is independent of response, with resolution probability \(c\), its expectation is

$$ E\left(\frac{\sum_i R_iY_i}{n}\right) =\frac{1}{n}\sum_i E(R_iY_i) =cp. $$

Unless all outcomes are resolved (\(c=1\)), this expectation is below \(p\). If resolution depends on response, the distortion need not take this simple form or even have the same direction. In contrast, excluding unresolved records avoids assigning them invented outcome values, but the observed proportion \( \sum_i R_iY_i/\sum_i R_i \) can still be biased when the resolution process is informative. Status classification prevents a coding error; it does not solve every missing-data problem.

Withdrawal, Treatment Discontinuation, and Follow-Up

A withdrawal record should say what stopped, when it stopped, and what data collection remains permitted. A participant who discontinues treatment but completes the endpoint assessment has a resolved outcome for the allocation summary. A participant who withdraws from treatment and further contact before the endpoint may have an unavailable outcome. A participant who declines additional visits but permits a prespecified record-based outcome source may still have an ascertainable endpoint, if use of that source is allowed.

Do not infer a binary response from the reason for withdrawal. For example, treatment intolerance is not automatically a nonresponse unless the endpoint definition explicitly classifies it that way. Likewise, withdrawal is not automatically a nonresponse or an exclusion: the endpoint definition and the permitted data determine whether a valid outcome exists.

Worked Example: A Withdrawal Does Not Always Remove an Outcome

In a hypothetical two-arm trial, the current resolved counts are \(r_A=5\) responses among \(m_A=8\) outcomes and \(r_B=7\) among \(m_B=10\). Three additional arm A participants have status changes. Participant 1 stops assigned treatment but completes the endpoint assessment and does not meet the response definition. Participant 2 withdraws from visits but permits a protocol-authorized record-based assessment, which confirms a response. Participant 3 withdraws from all further contact before the endpoint is ascertained; no permitted source can establish the endpoint.

Participants 1 and 2 each contribute a resolved outcome: the first adds one nonresponse, and the second adds one response. Participant 3 has an unavailable outcome and contributes neither a response nor a resolved outcome. The updated arm A counts are therefore \(r_A=6\) and \(m_A=10\), not 6 and 11.

The smoothed estimates are \(\tilde p_A=(6+1)/(10+2)=7/12=0.5833\) and \(\tilde p_B=(7+1)/(10+2)=8/12=0.6667\). Thus \(q_A=0.5833/(0.5833+0.6667)=0.4667\), and \(q_B=0.5333\). The calculation follows endpoint availability, not the count of participants who stopped treatment or visits.

Overdue Records, Diagnostics, and Failure Modes

An overdue record requires a status decision under the protocol, not an automatic value assignment. The study may still be resolving a laboratory result, contacting a participant, or checking an allowed data source. If specified attempts and deadlines establish that no outcome can be obtained, the record can be classified as unavailable or lost to follow-up according to the study’s terminology. If information later becomes available and its use is permitted, the status history should show the change and the next update can use the resolved outcome.

Worked Example: An Overdue Outcome Is Not Yet Loss to Follow-Up

At a hypothetical data cutoff, arm A has 4 responses among 6 resolved outcomes; arm B has 5 responses among 7. One additional arm A participant has an endpoint due in five days, so that outcome is pending. Another arm A participant’s endpoint deadline passed yesterday, but the protocol allows contact attempts through 14 days after the deadline. No attempt has yet failed the protocol’s criteria for loss to follow-up.

The first record is pending and the second is overdue but still under follow-up. Neither contributes to the current outcome counts. Thus \(\tilde p_A=(4+1)/(6+2)=5/8=0.6250\) and \(\tilde p_B=(5+1)/(7+2)=6/9=0.6667\). The allocation probability is \(q_A=0.6250/(0.6250+0.6667)=0.4839\), with \(q_B=0.5161\).

If the second participant later meets the protocol’s loss-to-follow-up criteria, that changes the status to unavailable; it does not convert the record into a nonresponse. If a valid endpoint is obtained before or after that decision and may be used, it can be incorporated at a subsequent scheduled update. It does not change the randomization probabilities already used for earlier assignments.

Useful diagnostics focus on whether statuses are applied consistently and whether unresolved records are accumulating selectively. At each update, reconcile assigned participants against counts of resolved responses, resolved nonresponses, pending, overdue, withdrawn, and unavailable outcomes. These categories should be mutually interpretable under the data system’s rules, and every status change should have a date and reason.

  • Review the age of pending and overdue records, including how many have passed the endpoint deadline.
  • Compare resolution and loss-to-follow-up rates by arm; marked differences may signal a data-quality issue or informative resolution.
  • Check whether withdrawal reasons are being incorrectly translated into response values.
  • Audit whether outcome sources and post-withdrawal data use match the consent and protocol rules.
  • Verify that each update uses a defined data cutoff and does not silently mix records from different reporting periods.

The practical alternative is not simply “include” versus “exclude.” One option is to update from resolved outcomes only, as in the examples. Another is to delay an update until more outcomes resolve, which may reduce reliance on a sparse or unrepresentative set but slows adaptation. A model-based procedure may use information about unresolved outcomes, but it requires explicit assumptions and validation; it must not be introduced by quietly treating predictions as observed responses. The choice belongs in the prespecified design, not in ad hoc decisions made after seeing the data.

Common Mistakes and Limits

  • Wrong: “The participant has not responded yet, so count a nonresponse.” Correction: If the ascertainment window remains open, the outcome is pending. Count a nonresponse only when the endpoint is resolved and meets the protocol’s nonresponse definition.
  • Wrong: “Anyone who stops treatment has dropped out.” Correction: Treatment discontinuation, withdrawal from visits, and inability to ascertain an outcome are distinct statuses.
  • Wrong: “An overdue outcome is automatically loss to follow-up.” Correction: Apply the specified contact and deadline criteria; overdue is a warning status until adjudicated.
  • Wrong: “Excluding missing outcomes guarantees valid response estimates.” Correction: Exclusion avoids fabricating outcomes, but the resolved cases can still be selected. Inspect resolution patterns and acknowledge the limitation.

Status rules improve the integrity and reproducibility of allocation updates, but they cannot recover an outcome that was never observed or ensure that observed outcomes represent all randomized participants. When unresolved outcomes are common or their resolution differs by arm or likely outcome, the allocation rule may respond to an unrepresentative subset. That limitation should be considered when interpreting the resulting assignments and when planning the trial’s data-collection procedures.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. An endpoint is scheduled for day 30, and an update occurs on day 24. The participant is still in contact. What is the status, and does the outcome enter the response estimate?
  2. A participant stops assigned treatment but completes the endpoint assessment, which confirms a nonresponse. How should this record contribute?
  3. An endpoint deadline passed, but the protocol’s follow-up period is still open. Is loss to follow-up established?
  4. In a two-arm update, arm A has 3 responses among 5 resolved outcomes and arm B has 4 among 6. Using \(\tilde p_j=(r_j+1)/(m_j+2)\) and \(q_A=\tilde p_A/(\tilde p_A+\tilde p_B)\), calculate \(q_A\). Two further outcomes are pending in A. Should they enter the calculation?
  5. Why does excluding unavailable outcomes not, by itself, guarantee an unbiased response estimate?

Solutions. (1) The outcome is pending because its ascertainment window is still open; it does not enter the estimate. (2) It contributes one resolved outcome to the denominator \(m_j\), but nothing to the response count \(r_j\). (3) No. The record is overdue, but follow-up remains open under the stated rules; loss to follow-up has not been established. (4) \(\tilde p_A=(3+1)/(5+2)=4/7=0.5714\), and \(\tilde p_B=(4+1)/(6+2)=5/8=0.6250\). Therefore \(q_A=0.5714/(0.5714+0.6250)=0.4776\), approximately. The pending outcomes are excluded. (5) If outcome resolution is related to response, the observed resolved cases may differ systematically from all assigned participants, so their response proportion may remain biased.

Clinical Biostats