Why Inpatient Futility Requires Careful Interpretation
An interim futility decision asks whether continuing a trial is likely to produce a sufficiently informative result—not whether the treatment has been proved ineffective. That distinction matters especially for antiviral monoclonal antibodies. Their intended action is to bind a viral target, so the opportunity for benefit may depend on when treatment is given and what stage of illness a participant has reached. Hospitalization alone does not identify a single biological stage.
ACTIV-3/TICO evaluated investigational treatments in hospitalized patients with COVID-19 using a platform-trial framework. Its first monoclonal-antibody evaluation compared bamlanivimab (LY-CoV555) plus remdesivir with placebo plus remdesivir. The trial used an interim assessment of clinical status; enrollment to the bamlanivimab comparison was halted after the prespecified futility criterion was met. The interim evidence did not show a persuasive improvement in clinical status, but the decision should not be translated into “the antibody has no effect in every patient or at every disease stage.”
What the TICO Decision Can—and Cannot—Say
In ACTIV-3/TICO, hospitalized adults were randomized to bamlanivimab with remdesivir or placebo with remdesivir. The comparison therefore estimated the additional effect of bamlanivimab on the remdesivir background, in the enrolled inpatient population and under the care conditions of the trial. The primary interim clinical-status assessment used an ordinal scale at day 5. An ordinal outcome ranks clinical states, so its analysis concerns the distribution of status across ordered categories rather than simply comparing two average measurements.
The independent monitoring decision to stop the bamlanivimab evaluation for futility followed the trial’s planned interim process. It was a governance decision informed by accumulating randomized evidence and the prespecified rule, not a discretionary response to an isolated result. The decision indicated that continuing that evaluation was not considered worthwhile under that rule. It did not establish that all monoclonal antibodies are ineffective, that outpatient results must match inpatient results, or that treatment timing cannot matter.
The introductory material on adaptive trials establishes why interim decisions need prespecified rules and independent oversight. Here the central interpretation issue is the connection between the rule and the estimand: an inpatient comparison of one antibody, on a particular background treatment, in a particular disease stage distribution. Evidence from outpatient evaluation, such as the earlier material on ACTIV-2, concerns a different enrolled population and treatment context. A favorable finding in one setting does not automatically predict benefit in the other.
Conditional Power: A Decision Quantity, Not a Treatment Effect
One common way to describe futility is conditional power: the probability of meeting the final success criterion, conditional on the interim data, if the trial continues and a specified effect is assumed for the future data. Its value depends on the effect assumption. A conditional-power calculation under the null can be very small even when the treatment might have a meaningful effect; a calculation under the design alternative asks a different question.
For a simple fixed-design illustration, let \(t\) be the fraction of total statistical information accrued at interim, let \(Z_I\) be the interim standardized statistic, and let \(z_{1-\alpha/2}\) be the two-sided final critical value. Suppose the assumed treatment effect corresponds to a final noncentrality parameter \(\lambda^*\). With independent future information and a fixed final analysis, the final standardized statistic has the conditional distribution below.
The mean combines the interim evidence and the assumed contribution from future information. The variance \(1-t\) represents uncertainty remaining in the future increment, on the standardized scale. For a two-sided success rule, conditional power is the probability that this final statistic exceeds the upper critical value or falls below the lower critical value.
This formula assumes the information fraction is correctly specified, future increments are independent of the interim data under the model, and the final test and success boundary are as stated. Actual platform-trial rules can use more complex outcomes and predictive models; this simplified calculation illustrates the logic and should not be mistaken for the exact ACTIV-3/TICO decision rule.
Worked Example: Conditional Power Under a Design Alternative
Hypothetical illustration: Suppose a two-sided trial has \(\alpha=0.05\), has accrued half its planned information (\(t=0.50\)), and has interim statistic \(Z_I=0.20\). The design alternative corresponds to \(\lambda^*=2.80\) at the final analysis. Calculate the conditional power under that alternative.
The critical value is \(z_{1-\alpha/2}=1.96\). The conditional mean and variance are
Thus the conditional standard deviation is \(\sqrt{0.50}=0.7071\), and
Under this assumed design alternative, the chance of crossing either final boundary is about 27.7%. This is not the probability that the treatment works; it is a conditional probability calculated under the specified model and effect assumption.
Worked Example: Why the Assumed Effect Changes the Futility Calculation
Use the same hypothetical interim statistic and information fraction, but now assume the true effect is the null, so \(\lambda^*=0\). Then
The standardized upper and lower boundaries are \((1.96-0.1414)/0.7071=2.572\) and \((-1.96-0.1414)/0.7071=-2.972\), respectively, giving \(CP(0)\approx 0.0065\), or 0.65%. That is much smaller than the 27.7% calculated under the design alternative. The two results do not conflict: they answer different questions. A futility policy might use a design alternative, a predictive distribution over plausible effects, or another prespecified quantity. The assumed effect and threshold must be reported to make the decision interpretable.
A Short Justification for the Conditional-Power Formula
The information-scaled statistic can be represented as the sum of an interim contribution and an independent future contribution. If \(Z_R\) is the standardized future increment, then under the assumed alternative \(Z_R\sim N(\sqrt{1-t}\lambda^*,1)\), and
After conditioning on the observed \(Z_I\), the first term is fixed. The second term has mean \(\sqrt{1-t}\lambda^*\) and variance \(1-t\), because multiplying a normal variable by \(\sqrt{1-t}\) multiplies its variance by \(1-t\). Therefore \(Z_F\) has the conditional normal distribution stated above. For a two-sided rule, standardizing \(Z_F\) and adding \(P(Z_F<-z_{1-\alpha/2}\mid Z_I,\lambda^*)\) to \(P(Z_F>z_{1-\alpha/2}\mid Z_I,\lambda^*)\) gives the conditional-power expression. This justification depends on the fixed information structure; it does not automatically apply unchanged if the adaptation alters the final design or success boundary.
Disease Stage and the Meaning of an Inpatient Result
A monoclonal antibody designed to neutralize virus has a plausible mechanism that depends on accessible viral target and timing. In early infection, viral replication may be a more prominent treatment target. Later in illness, clinical deterioration may involve substantial host inflammatory injury as well as viral effects. This biological rationale motivates stage-specific questions; it does not itself establish that a treatment works at one stage or fails at another.
Hospitalized participants can differ in duration of symptoms, respiratory support, immune response, and viral status. Randomization supports an unbiased average comparison for the population enrolled, subject to the trial’s design and analysis assumptions. It does not guarantee that the average effect applies equally to every subgroup. Conversely, a pattern in one subgroup is not reliable proof of effect modification unless it is supported by an appropriate interaction analysis, adequate information, and careful attention to multiplicity and prespecification.
Worked Example: A Hypothetical Stage Pattern Is Not an Interaction Finding
Hypothetical data, not ACTIV-3/TICO results: Consider a randomized study with 200 participants per arm in each of two symptom-duration strata. The outcome is recovery by day 28. In the earlier-duration stratum, 140 of 200 antibody recipients and 120 of 200 controls recover. In the later-duration stratum, the corresponding counts are 104 of 200 and 100 of 200.
The recovery proportions and risk differences (antibody minus control) are:
The estimated difference between the stratum-specific risk differences is \(0.10-0.02=0.08\), or 8 percentage points. For independent randomized groups, estimated standard errors for the two risk differences are
The estimated standard error for the difference of risk differences is \(\sqrt{SE_E^2+SE_L^2}=\sqrt{0.00225+0.002498}=0.06891\). A rough 95% confidence interval for the interaction contrast is therefore
Because this interval includes zero and is wide, these hypothetical data do not provide clear evidence that treatment effect differs by symptom-duration stratum. The larger point estimate in the earlier stratum may motivate further study, but it does not establish a stage-specific benefit. The calculation also illustrates why comparing whether one stratum’s result is “significant” and another’s is “not significant” is not a valid interaction test.
Diagnostics, Alternatives, and Common Pitfalls
Before interpreting a futility analysis, check what was specified and whether its assumptions remain credible. Relevant checks include whether the interim information fraction matches the analysis plan; whether the endpoint is measured consistently; whether missing outcomes or delayed ascertainment could distort the interim estimate; whether treatment adherence and background care have changed; and whether the population enrolled still matches the intended target. In platform trials, also verify which treatment comparison, control, and eligibility period the interim decision concerns.
Conditional power is not the only approach. A predictive-probability approach averages over uncertainty about the treatment effect rather than fixing it at one assumed value. A nonbinding futility boundary may allow a trial to continue despite crossing the boundary, particularly if external evidence or operational considerations change. A binding rule requires stopping when its criterion is met. These approaches answer related but distinct decision questions; none converts interim uncertainty into proof of no treatment effect.
A common mistake is: “The interim result was not statistically significant, so the treatment is futile.” That reasoning is wrong. A nonsignificant interim test can arise because information is limited, and its p-value alone does not state the probability of eventual success. The correction is to identify the prespecified futility quantity, its assumed treatment effect or predictive model, and its threshold. Another mistake is to generalize an inpatient futility decision to outpatient treatment. The correction is to keep the population, disease stage, comparator, and endpoint attached to the conclusion.
Check Your Understanding
Answer each question, then compare your reasoning with the short solutions below.
- What comparison did the ACTIV-3/TICO bamlanivimab evaluation make, and what does stopping for futility mean?
- In the conditional-power example, why did the values under \(\lambda^*=2.80\) and \(\lambda^*=0\) differ?
- Why does a nonsignificant interim result alone not establish futility?
- In the hypothetical stage example, what does the interaction confidence interval say about evidence of treatment-effect modification?
- Name two assumptions or operational features to check when interpreting an interim futility calculation.
Solutions. (1) It compared bamlanivimab plus remdesivir with placebo plus remdesivir in hospitalized patients; futility meant continuing was not judged worthwhile under the specified monitoring rule, not that zero effect was proved. (2) Conditional power depends on the assumed effect: the design alternative contributes a positive expected future signal, whereas the null contributes none. (3) Nonsignificance is not a probability of eventual success; futility requires the trial’s defined decision quantity and threshold. (4) The interval \((-0.0551, 0.2151)\) includes zero and is wide, so the hypothetical data do not establish an interaction. (5) Examples include correct information fraction, independent future increments under the model, consistent outcome ascertainment, and appropriate control/comparison definition.