Tutorials › Bayesian Clinical Trials › Predictive Monitoring With Pending Binary Outcomes

Phase 2 Single-Arm Monitoring · Tutorial 607 of 696

Predictive Monitoring With Pending Binary Outcomes

Model pending and future binary outcomes explicitly, then calculate and interpret the predictive probability of meeting a prespecified terminal success criterion.

Intermediate 11 min read

What You'll Learn

  • Distinguish enrolled patients with unresolved outcomes from patients who have not yet enrolled.
  • State the exchangeable Bernoulli response model and the assumptions needed to use it.
  • Update a beta prior using resolved outcomes without counting pending patients as failures.
  • Derive the predictive distribution for outcomes still unresolved or unobserved at the interim.
  • Calculate terminal-success probabilities and assess when the calculation may be unreliable.

Why Pending Outcomes Need Their Own Accounting

At an interim look, some enrolled patients may not yet have a resolved binary response. They are not the same as patients who have not yet enrolled: pending patients have entered the trial and may have different follow-up, exposure, or response-assessment histories. Yet neither group has a known outcome to add to the terminal success count. A predictive calculation must represent both groups without silently turning an unresolved outcome into a failure or omitting a patient from the planned sample.

The calculation below assumes a fixed target of \(N\) evaluable patients and a binary response assessed under a common model. It predicts the number of terminal successes by the planned analysis, combining outcomes pending among enrolled patients with outcomes from patients who have not yet enrolled. This is a model-based probability, not a claim that pending patients have already responded.

Definition: Let \(m\) be the number of enrolled patients with resolved binary outcomes, with \(r\) successes and \(m-r\) failures. Let \(q\) be the number enrolled but still pending an outcome, and let \(u\) be the number not yet enrolled. For a fixed target \(N\), \(N=m+q+u\). The number of outcomes still unknown at the interim is \(L=q+u=N-m\).

Response Model and Posterior Updating

Use the following exchangeable response model: conditional on a common response probability \(p\), each patient's terminal outcome is an independent Bernoulli variable with probability \(p\) of success. Assign \(p\) a beta prior, \(p\sim\operatorname{Beta}(a,b)\), where \(a>0\) and \(b>0\). The resolved outcomes then give the posterior \(p\mid\text{resolved data}\sim\operatorname{Beta}(A,B)\), with \(A=a+r\) and \(B=b+m-r\).

This update uses only resolved outcomes. A pending patient contributes neither a success nor a failure to the likelihood. In this model, pending status is assumed not to provide additional information about that patient's eventual binary outcome after conditioning on \(p\) and the resolved data. That is an assumption about the outcome and follow-up process, not an automatic consequence of calling an outcome “pending.”

Model assumptions: (1) The terminal outcome is defined consistently for all patients. (2) Conditional on \(p\), outcomes are independent Bernoulli variables with the same success probability. (3) The prior is \(\operatorname{Beta}(a,b)\), and resolved outcomes are correctly classified. (4) Pending outcomes will eventually be ascertained, and their pending status is ignorable for predicting the outcome under this model. (5) The planned target \(N\) is fixed and all \(N\) patients are assumed to contribute a terminal outcome.

Under these assumptions, pending patients and not-yet-enrolled patients have the same conditional outcome model, but different trial statuses. The pending patients are already among the \(N\); the not-yet-enrolled patients still have to enter the trial. If the target is not fixed, enrollment may stop short, or outcomes are only counted if observed by a deadline, the calculation needs additional models for enrollment, follow-up, or missingness.

Predicting Terminal Success

Suppose terminal success is defined as at least \(c\) successes among the \(N\) patients. Let \(K\) be the number of successes among the \(L=N-m\) outcomes still unknown at the interim. The terminal number of successes is \(r+K\), so terminal success occurs when \(K\ge c-r\). Conditional on \(p\), the \(q\) pending outcomes and \(u\) future outcomes are independent binomial counts. Their sum is binomial with size \(L=q+u\) and probability \(p\). Integrating over the posterior uncertainty in \(p\) gives a beta-binomial predictive distribution.

$$ P(\text{terminal success}\mid\text{interim data}) = \sum_{k=\max(0,c-r)}^{L} {L\choose k}\frac{B(A+k,B+L-k)}{B(A,B)}. $$

Here \(B(\cdot,\cdot)\) is the beta function. A sum with lower limit greater than \(L\) is zero, and if \(c-r\le 0\), terminal success is already secured under the stated criterion. The beta-binomial probability for one value \(k\) follows by averaging the conditional binomial probability over the posterior:

$$ P(K=k\mid\text{data}) = \int_0^1 {L\choose k}p^k(1-p)^{L-k} \frac{p^{A-1}(1-p)^{B-1}}{B(A,B)}\,dp = {L\choose k}\frac{B(A+k,B+L-k)}{B(A,B)}. $$

The pending and not-yet-enrolled parts can also be displayed separately. If \(J\) is the number of pending successes and \(F\) is the number of successes among not-yet-enrolled patients, then conditional on \(p\), \(J\sim\operatorname{Binomial}(q,p)\) and \(F\sim\operatorname{Binomial}(u,p)\), independently. Marginally, however, \(J\) and \(F\) are generally dependent because they share the uncertain \(p\). Thus one should not multiply two beta-binomial probabilities as though the groups had independent response probabilities. The total \(K=J+F\) has the beta-binomial distribution above.

1
Separate the statuses.
Record resolved outcomes, pending enrolled patients, and patients not yet enrolled; check that \(N=m+q+u\).
2
Update from resolved outcomes.
Set \(A=a+r\) and \(B=b+m-r\); do not classify pending outcomes as failures.
3
Count the unknown outcomes.
Set \(L=q+u=N-m\), then find the additional successes needed, \(c-r\).
4
Sum the predictive tail.
Add the beta-binomial probabilities for \(k\ge c-r\), and interpret the result under the stated response and follow-up assumptions.

Worked Example: Pending and Future Patients in One Predictive Tail

Consider a hypothetical single-arm trial with a target of \(N=10\) patients. At the interim, \(m=6\) outcomes are resolved: \(r=3\) successes and 3 failures. Two more enrolled patients are pending (\(q=2\)), and two patients are not yet enrolled (\(u=2\)). Use a \(\operatorname{Beta}(1,1)\) prior and define terminal success as at least \(c=6\) responses.

The status counts agree with the target: \(6+2+2=10\). The posterior is \(\operatorname{Beta}(4,4)\), because \(A=1+3=4\) and \(B=1+3=4\). There are \(L=2+2=4\) unknown outcomes. Since three additional successes are needed, calculate \(P(K\ge3\mid\text{data})\):

$$ P(K\ge3\mid\text{data}) = {4\choose3}\frac{B(7,5)}{B(4,4)} + {4\choose4}\frac{B(8,4)}{B(4,4)} = \frac{1920}{7920}+\frac{840}{7920} = 0.3485. $$

Under this model and these data, the probability of reaching at least six responses among the ten planned patients is about 34.85%. The calculation includes both pending outcomes and outcomes from patients yet to enroll. It does not say that either pending patient has a 34.85% individual chance of response; the reported probability concerns the trial's terminal criterion.

Worked Calculations and Checks

Worked Example: A Higher Current Response Count

In a hypothetical trial, the target is \(N=8\). Four patients have resolved outcomes: three responses and one nonresponse. Two additional enrolled patients are pending, and two have not yet enrolled. With a \(\operatorname{Beta}(1,1)\) prior, find the predictive probability of at least five responses at the end.

The posterior is \(\operatorname{Beta}(4,2)\), since \(A=1+3=4\) and \(B=1+1=2\). Four outcomes are unknown, and two additional responses are required: \(L=4\), \(c-r=5-3=2\). For this beta-binomial distribution, the denominator for the probabilities is \((A+B)_4=(6)(7)(8)(9)=3024\), where \((x)_j=x(x+1)\cdots(x+j-1)\). The probabilities of zero and one additional response are

$$ P(K=0)=\frac{(2)_4}{(6)_4}=\frac{120}{3024}, \qquad P(K=1)=\frac{{4\choose1}(4)_1(2)_3}{(6)_4} =\frac{384}{3024}. $$

Therefore \(P(K\ge2)=1-(120+384)/3024=2520/3024=0.8333\). The predictive probability of at least five total responses is about 83.33%. The calculation assumes all four unknown outcomes will be obtained under the common response model.

Worked Example: Splitting the Pending and Not-Yet-Enrolled Groups

Suppose a hypothetical trial has \(N=6\), with one resolved response and two resolved nonresponses. One additional enrolled patient is pending, and two patients are not yet enrolled. Use a \(\operatorname{Beta}(1,1)\) prior and ask for the probability of at least three responses among all six.

The posterior is \(\operatorname{Beta}(2,3)\). There are three unknown outcomes, one pending and two from future enrollment; two additional responses are needed. The predictive probability is

$$ P(K\ge2) = {3\choose2}\frac{B(4,4)}{B(2,3)} + {3\choose3}\frac{B(5,3)}{B(2,3)} = \frac{54}{210}+\frac{24}{210} = 0.3714. $$

The same result can be checked by separating the possible pending outcome. If the pending patient responds, at least one of the two future patients must respond; if the pending patient does not respond, both future patients must respond. Averaging these cases over \(p\sim\operatorname{Beta}(2,3)\) gives

$$ E[2p^2-p^3]+E[p^2-p^3] = 3E[p^2]-2E[p^3] = 3\left(\frac{6}{30}\right)-2\left(\frac{24}{210}\right) = 0.3714. $$

The split confirms that the pending patient is included exactly once, while also showing why the two groups should be combined conditional on the shared \(p\), rather than treated as independent after averaging over \(p\).

Diagnostics, Alternatives, and Limitations

Before using a result, check the bookkeeping and the model. The counts should satisfy \(0\le r\le m\) and \(m+q+u=N\). The threshold must match the stated terminal definition, and the predictive tail must include all values from the required number of additional successes through \(L\). A quick check is that the answer lies between zero and one; if \(c-r>L\), the probability must be zero. Also verify that the analysis target really is all \(N\) patients, rather than only patients with outcomes observed by a particular interim or final cutoff.

The common-response assumption can be questionable if pending patients differ from future patients in prognosis, treatment exposure, assessment time, or eligibility. Pending status may itself be informative—for example, if early progression makes a response assessment impossible, or if patients with early improvement are assessed sooner. In those settings, the unresolved status is not safely ignored. A model may need to condition on baseline covariates, time to response, dropout, or a competing event; alternatively, a prespecified sensitivity analysis can show how predictions change under plausible response probabilities for pending and future patients. Do not adjust the beta posterior merely by pretending pending patients have a particular outcome.

A rule based only on resolved outcomes is a different approach: it can summarize current evidence, but it does not predict what the remaining patients may contribute. A pessimistic analysis that treats pending outcomes as failures is a possible sensitivity scenario, not the neutral calculation under the exchangeable Bernoulli model. The earlier material on predictive monitoring for a continuous normal endpoint uses a different endpoint model; here the discrete beta-binomial tail is appropriate for the stated binary-response model. The calculation also does not account for uncertain enrollment, variable follow-up, or informative missingness unless those processes are added explicitly.

Common mistake: “The patient is enrolled, so the pending response should be counted as a failure until it is observed.” This substitutes an unobserved outcome with a known failure and changes the evidence. Under the model here, pending patients contribute to the number of outcomes yet to be predicted, not to the resolved failure count. If a conservative failure scenario is desired, label and analyze it as a sensitivity assumption.

Check Your Understanding

Answer each question using the fixed-target, common-response model unless the question says otherwise.

  1. A trial has target \(N=12\), with \(m=7\) resolved outcomes and \(q=3\) pending enrolled patients. How many patients are not yet enrolled, and how many outcomes remain unknown?
  2. With a \(\operatorname{Beta}(1,1)\) prior, four resolved responses, and three resolved nonresponses, what is the posterior distribution for \(p\)?
  3. In Question 1, suppose there are currently \(r=4\) responses and terminal success requires at least 7. How many additional responses are needed, and what is the range of \(k\) values included in the predictive tail?
  4. Why is it generally incorrect to multiply the marginal beta-binomial probabilities for the pending and not-yet-enrolled groups?
  5. Name one situation in which pending status may be informative about eventual response, making the simple model questionable.

Solutions. (1) There are \(u=12-7-3=2\) not-yet-enrolled patients, and \(L=q+u=5\) outcomes are unknown. (2) The posterior is \(\operatorname{Beta}(1+4,1+3)=\operatorname{Beta}(5,4)\). (3) Three additional responses are needed, so sum the predictive probabilities for \(k=3,4,5\). (4) The groups share the uncertain response probability \(p\), which induces marginal dependence after integrating over \(p\); their counts are independent only conditional on \(p\). (5) For example, if patients with early progression are less likely to have an assessable response, pending or unresolved status may convey information about the eventual endpoint.

Clinical Biostats