Tutorials › Adaptive Clinical Trial Design › RECOVERY-RS And Respiratory Support Comparisons

Case Studies · Tutorial 795 of 799

RECOVERY-RS And Respiratory Support Comparisons

Learn how RECOVERY-RS used a randomized platform to compare respiratory-support strategies and how to interpret its results in clinical context.

Advanced 11 min read

What You'll Learn

  • Describe RECOVERY-RS’s population, treatment arms, and 30-day primary outcome.
  • Distinguish the platform’s operational adaptability from response-adaptive randomization.
  • Interpret the reported comparisons of CPAP and high-flow nasal oxygen with conventional oxygen.
  • Calculate absolute risk differences and odds ratios for hypothetical respiratory-support data.
  • Identify how an open-label design and a composite outcome affect interpretation.
  • Explain why separate comparisons against conventional oxygen do not establish a direct CPAP-versus-high-flow contrast.

Why RECOVERY-RS Matters

For hospitalized patients with COVID-19 and acute hypoxemic respiratory failure, the choice of respiratory support can affect both how care is delivered and whether invasive ventilation is needed. A trial comparing these strategies must therefore answer a practical question: what happens when eligible patients are assigned to one support strategy rather than another, under the conditions of hospital care?

RECOVERY-RS addressed that question by comparing continuous positive airway pressure (CPAP), high-flow nasal oxygen (HFNO), and conventional oxygen in a randomized clinical platform. Its results are useful not only for the treatment comparisons, but also for understanding what an adaptive platform can contribute to an urgent, changing clinical setting. “Adaptive” should not be taken to mean that treatment allocation automatically shifted toward whichever arm looked best: the key point here is that the platform framework could accommodate multiple treatment comparisons and changes to the set of arms.

Definition: An adaptive platform trial evaluates one or more interventions against a defined clinical question within a protocol framework that can accommodate changes, such as adding or discontinuing treatment arms. These changes must be governed by the protocol and prespecified decision rules. The term alone does not imply response-adaptive randomization, in which the probability of assigning a participant to an arm changes in response to accumulating outcomes.

Design and Primary Outcome

RECOVERY-RS enrolled adults hospitalized with COVID-19 who had acute hypoxemic respiratory failure and required respiratory support. Participants were randomly assigned to CPAP, HFNO, or conventional oxygen, alongside other appropriate care. CPAP provides positive airway pressure through a mask; HFNO delivers warmed, humidified oxygen at high flow through nasal prongs; conventional oxygen provides oxygen using standard devices such as a mask or nasal cannula.

The primary outcome was whether a participant experienced tracheal intubation or death within 30 days of randomization. This is a binary composite outcome: a participant counts as having the outcome if either component occurs. Combining components can capture clinically important deterioration, but it means the overall effect does not, by itself, say how much each component contributed.

The trial reported two principal comparisons: CPAP versus conventional oxygen, and HFNO versus conventional oxygen. It was open-label, so participants and clinicians knew the assigned treatment. Random assignment supports a causal interpretation of the effect of assignment to the treatment strategies, provided follow-up and outcome ascertainment are adequate. But in this setting the decision to intubate can be influenced by clinical judgment, which may be affected by knowledge of treatment assignment. Death is less discretionary, though the composite remains partly dependent on a clinical decision.

The platform structure supported pragmatic decision-making because it could evaluate more than one form of respiratory support within a coordinated trial. HFNO was incorporated as an additional treatment arm after the trial had begun. That operational flexibility should be distinguished from the trial’s statistical comparisons: the reported results do not establish that all possible pairwise contrasts were equally powered or that one support method was directly superior to another.

Worked Example: Calculating an Absolute Risk Difference

Hypothetical data. Suppose 100 patients are randomized to a respiratory-support strategy and 100 to conventional oxygen. By day 30, 34 patients in the first group and 43 in the conventional-oxygen group have experienced intubation or death. Calculate and interpret the risk difference.

The observed risks are \(34/100=0.34\) and \(43/100=0.43\). Define the risk difference as treatment-group risk minus control-group risk:

$$ \widehat{RD}=0.34-0.43=-0.09. $$

The estimated risk difference is \(-0.09\), or \(-9\) percentage points. In this hypothetical sample, assignment to the first strategy was associated with 9 fewer primary-outcome events per 100 patients than assignment to conventional oxygen. This is an absolute comparison, not a 9% relative reduction. A confidence interval would be needed to quantify sampling uncertainty; the difference alone does not show how precise the estimate is.

What the Trial Found

In the published trial, the primary outcome occurred in 36.3% of participants assigned to CPAP and 44.4% assigned to conventional oxygen in that comparison. The reported odds ratio was 0.72 (95% confidence interval 0.53 to 0.96; \(p=0.03\)). The observed risk difference was approximately \(-8.1\) percentage points. Thus, the trial found evidence that assignment to CPAP reduced the odds of the composite outcome relative to conventional oxygen in the studied population.

For HFNO versus conventional oxygen, the primary outcome occurred in 44.3% and 45.1%, respectively. The reported odds ratio was 0.97 (95% confidence interval 0.73 to 1.29; \(p=0.83\)); the observed risk difference was about \(-0.8\) percentage points. This result did not provide evidence of a difference between those assigned to HFNO and conventional oxygen. It does not prove that their effects are identical: the interval includes effects in either direction.

These are comparisons of odds, not direct statements about how many times more or fewer patients had the outcome. In particular, an odds ratio of 0.72 does not mean a 28-percentage-point reduction, nor does it mean that the risk was reduced by exactly 28%. Absolute risks and risk differences are often easier to translate into clinical terms, while the odds ratio is the scale used for the reported model-based comparison.

Interpretation: The reported CPAP-versus-conventional-oxygen estimate supports lower odds of intubation or death by day 30 for assignment to CPAP in the trial population. The HFNO-versus-conventional-oxygen estimate was compatible with no difference, as well as with potentially meaningful effects in either direction. Neither result alone establishes a direct CPAP-versus-HFNO effect.

From Risks to Odds: A Short Derivation

For an event risk \(p\), the odds of the event are \(p/(1-p)\). If the treatment risk is \(p_1\) and the control risk is \(p_0\), their odds ratio is:

$$ OR=\frac{p_1/(1-p_1)}{p_0/(1-p_0)}. $$

Rearranging gives a useful relation between an odds ratio and a risk when the control risk is known. Multiply both sides by \(p_0/(1-p_0)\), then solve for \(p_1\):

$$ \frac{p_1}{1-p_1}=OR\frac{p_0}{1-p_0} \quad\Longrightarrow\quad p_1=\frac{OR\,p_0}{1-p_0+OR\,p_0}. $$

This equation shows why an odds ratio cannot be read as a risk difference or risk ratio. The risk corresponding to a given odds ratio depends on the baseline risk \(p_0\). When outcomes are common, odds and risks can differ substantially.

Worked Example: Converting an Odds Ratio to a Risk

Hypothetical calculation. Suppose the control risk of intubation or death is \(p_0=0.40\), and an estimated odds ratio is \(OR=0.75\). What treatment risk corresponds to these values under the odds-ratio relationship?

Substitute into the formula:

$$ p_1=\frac{0.75(0.40)}{1-0.40+0.75(0.40)} =\frac{0.30}{0.60+0.30} =\frac{0.30}{0.90} =0.333. $$

The corresponding treatment risk is about 33.3%, giving a risk difference of \(0.333-0.400=-0.067\), or approximately \(-6.7\) percentage points. The odds ratio of 0.75 means 25% lower odds, not 25% lower risk. This conversion is illustrative; an actual trial estimate also has uncertainty and may come from an adjusted model.

Reading the Comparisons Carefully

The trial’s reported estimates were obtained using logistic regression adjusted for baseline age, sex, and site. In a simple two-group formulation, a logistic model relates the probability \(p_i\) of the primary outcome for participant \(i\) to treatment assignment \(T_i\) and adjustment variables:

$$ \log\left(\frac{p_i}{1-p_i}\right) =\beta_0+\beta_1T_i+\boldsymbol{\gamma}^{\mathsf T}\mathbf{Z}_i. $$

Here, \(\mathbf{Z}_i\) represents the adjustment variables. The estimated odds ratio for treatment relative to control is \(\exp(\hat{\beta}_1)\). This model assumes that the log odds are represented adequately by the specified terms and that observations are handled appropriately as independent participant outcomes. The adjustment does not replace randomization; it accounts for specified baseline factors in the analysis.

The interpretation also depends on how the outcome and population are defined. The primary result concerns the assigned support strategy and the composite outcome by 30 days for eligible hospitalized patients. It is not a claim about every respiratory-support setting, every stage of COVID-19, or current care under all later standards of treatment. Nor does a reduction in the composite necessarily imply a reduction in mortality alone: the result can reflect the intubation component, the death component, or both.

Worked Example: Why Separate Comparisons Do Not Rank Two Treatments

Hypothetical data. Imagine a trial reports an odds ratio of 0.80 for CPAP versus conventional oxygen and 0.95 for HFNO versus conventional oxygen. Explain what can and cannot be concluded from these estimates.

The first estimate compares CPAP with conventional oxygen; the second compares HFNO with conventional oxygen. Both are treatment-versus-control contrasts. The fact that 0.80 is numerically smaller than 0.95 does not, by itself, establish a statistically supported CPAP-versus-HFNO difference.

A direct comparison requires an estimate and uncertainty measure for that contrast, obtained through an appropriate analysis of randomized assignments and relevant participants. Even subtracting the two log odds ratios would require their covariance to calculate uncertainty, because the estimates may share control information. Without a direct contrast and its uncertainty, the defensible conclusion is limited to the two reported comparisons with conventional oxygen.

Pragmatic Adaptation, Diagnostics, and Limitations

A pragmatic trial aims to inform decisions under conditions resembling routine care. That goal is relevant for respiratory support: equipment, staff expertise, patient tolerance, and clinician judgment all matter. The platform structure made it possible to evaluate different support strategies within an evolving care environment. At the same time, flexibility does not remove the need to examine how the trial was conducted.

Useful checks include whether eligibility and treatment availability were applied consistently, whether baseline characteristics were reasonably balanced by randomization, whether outcome follow-up was complete, and whether treatment switching or non-adherence could have affected interpretation. In an open-label trial, also ask whether decision-sensitive outcomes such as intubation might be influenced by knowledge of assignment. A composite outcome should prompt inspection of its components, not just its overall estimate.

The results have limitations. Open-label treatment can affect care decisions, especially intubation. The primary endpoint combines events with different clinical meanings. Estimates have sampling uncertainty, and a nonsignificant result is not proof of equivalence. Finally, the trial was conducted in a particular patient population and period of the pandemic; shifts in clinical practice, patient characteristics, and available therapies can limit how directly its estimates transport to other settings.

Adaptive platform conduct is most useful when it preserves interpretable randomized comparisons while allowing the trial to respond operationally to a changing question. The relevant evidence is not the word “adaptive” alone, but the protocol, timing and rationale for changes, randomization procedures, and analysis for each comparison. This is consistent with the earlier material on platform trials and adaptation across pandemic phases.

Worked Example: Checking a Hypothetical Platform Change

Hypothetical scenario. A trial begins with CPAP and conventional oxygen. Later, it adds HFNO because clinicians and investigators consider it an important strategy to evaluate. What information would help determine whether the added comparison remains interpretable?

First, establish that HFNO was added through a documented protocol change, with eligibility, allocation, and outcome definitions specified. Next, check that eligible participants were randomized among the treatments available to them, rather than assigned by clinician preference. Then establish which participants and comparison groups contributed to each analysis and whether the relevant control observations were collected during a comparable period.

Finally, inspect baseline balance, follow-up, treatment switching, and any differences in care over calendar time. These checks do not guarantee that every estimate is unbiased, but they identify potential sources of non-comparability. In particular, if standard care changes substantially over time, a treatment group recruited later may not be fairly compared with controls recruited only earlier.

Common Pitfalls

  • Calling a nonsignificant result proof of no effect. The HFNO comparison had \(p=0.83\), but its confidence interval still allows effects in either direction. The result is absence of clear evidence for a difference, not proof of equivalence.
  • Comparing p-values to rank treatments. A significant CPAP comparison and a nonsignificant HFNO comparison do not establish that CPAP is superior to HFNO. A direct contrast is needed.
  • Reading the odds ratio as a risk reduction. An odds ratio is a ratio of odds. Translate it to absolute risks only with a baseline risk and the appropriate relationship.
  • Treating “adaptive” as “response-adaptive.” A platform may adapt its set of arms without changing randomization probabilities according to accumulating outcomes. Describe the actual design features, not assumptions suggested by the label.
  • Ignoring the endpoint components. A composite event result does not alone show which component drove the difference. Interpret the outcome as defined and examine component results separately when available.
Key takeaway: RECOVERY-RS found lower odds of 30-day intubation or death for assignment to CPAP than conventional oxygen, while the HFNO comparison showed no clear difference from conventional oxygen. These findings are specific to the randomized comparisons, the composite endpoint, and the trial setting; they do not directly rank CPAP against HFNO.

Check Your Understanding

Answer each question, then compare with the solutions.

  1. What event counted for RECOVERY-RS’s primary outcome, and by when was it assessed?
  2. In hypothetical data, 28 of 80 patients assigned to a support strategy and 36 of 90 assigned to conventional oxygen experience the primary outcome. Calculate the risk difference, treatment minus control.
  3. Why does a nonsignificant HFNO-versus-conventional-oxygen result not prove that the treatments are equivalent?
  4. Why can separate CPAP-versus-control and HFNO-versus-control estimates not, by themselves, establish a CPAP-versus-HFNO difference?
  5. Name one way the open-label design could affect interpretation of the primary outcome.

Solutions. (1) The outcome was tracheal intubation or death within 30 days of randomization. (2) The risks are \(28/80=0.35\) and \(36/90=0.40\), so the risk difference is \(0.35-0.40=-0.05\), or \(-5\) percentage points. (3) A nonsignificant result may reflect uncertainty; equivalence requires a prespecified margin and an analysis showing the uncertainty is sufficiently narrow within that margin. (4) The estimates address different treatment-versus-control contrasts; a direct contrast with its own uncertainty is needed to compare the two active treatments. (5) Clinicians who know the assigned treatment may use different thresholds for intubation, a component of the primary outcome.

Clinical Biostats