Why Evaluate Treatment After Hospital Discharge?
A patient’s discharge after COVID-19 hospitalization is not necessarily the end of the illness or of clinical need. Some patients die or return to hospital; others experience ongoing symptoms and limitations that may not be captured by an outcome measured only during the initial admission. A treatment that has little effect on acute deterioration could still plausibly affect later recovery, complications, or healthcare use. Conversely, an intervention that appears promising during hospitalization may offer no benefit after discharge, when the clinical risks and treatment goals differ.
HEAL-COVID—HEaling lungs after COVID-19—was a UK randomized platform trial designed to evaluate treatments in people leaving hospital after COVID-19. It used usual care as a comparator and evaluated more than one treatment option over time. Its case-study value is not just the question of whether a particular drug “worked.” It also illustrates how trial design must specify a population at a transition point in care, select outcomes that matter over a longer horizon, and make arm decisions without turning an interim finding into a claim about all post-acute illness.
The treatment questions were distinct. The apixaban evaluation tested a short course of anticoagulation after discharge; the atorvastatin evaluation considered a longer course of treatment. The treatment duration, plausible mechanism, safety profile, and relevant time course are not interchangeable. A platform can organize these evaluations under a common operational structure, but each treatment still requires an appropriate comparison and a clearly defined estimand.
What the Long-Term Outcome Captures
HEAL-COVID used outcomes focused on subsequent clinical course, including time to first hospital readmission or death over follow-up of up to 12 months. A composite of readmission or death can be useful because both outcomes indicate serious consequences after discharge and a composite may capture more events than death alone. But a composite does not make its components equivalent. A treatment could affect readmission without affecting death, or affect one component in a direction different from the other.
When the endpoint is time to first event, a participant contributes the time until the first qualifying readmission or death. A death before a readmission prevents a later readmission from becoming that participant’s first event. This is not the same as analyzing every readmission, nor does it mean that death can simply be treated as ordinary loss to follow-up. The endpoint and analysis need to match the clinical question and the event process.
A risk difference at a fixed time answers a different, simpler question: how much do the proportions experiencing an event by that time differ between randomized groups? For example, a 12-month risk difference does not use the exact timing of events. A time-to-event analysis uses event times and can incorporate participants with incomplete follow-up under appropriate censoring assumptions. These summaries are related, but they are not interchangeable.
Worked Example: A Fixed-Time Composite Risk Difference
Consider hypothetical 12-month data from a randomized post-discharge comparison. In the treatment group, 60 of 200 participants experience readmission or death; in usual care, 66 of 200 do. Assume every participant’s 12-month event status is known, the groups are independently randomized, and each participant contributes one binary outcome.
The estimated event risks are \(\hat{p}_T=60/200=0.300\) and \(\hat{p}_C=66/200=0.330\). Define the risk difference as treatment minus usual care:
The observed risk is therefore 3.00 percentage points lower in the treatment group. For independent binomial samples, an approximate standard error is:
The variance terms are \(0.210/200=0.001050\) and \(0.2211/200=0.0011055\). Thus \(SE(\widehat{RD})=\sqrt{0.0021555}=0.04643\). An approximate 95% confidence interval is:
The interval includes no difference and includes both a potentially meaningful reduction and an increase in event risk. These hypothetical data do not establish a treatment benefit, but they also do not demonstrate that all clinically important benefit is absent. The interval is for the risk difference in 12-month event proportions, in percentage-point terms when multiplied by 100; it is not an interval for a hazard ratio or for every possible post-acute outcome.
Why the Platform Context Matters
A platform trial provides an organized way to evaluate multiple treatment questions within a continuing trial structure. In HEAL-COVID, the treatment arms addressed the post-discharge phase rather than acute respiratory support in hospital. Participants were randomized among the options available for the particular evaluation, and the treatment groups were compared with usual care. The platform structure can support efficient evaluation, but it does not erase differences between treatment questions or guarantee that every estimate has the same population, exposure duration, or interpretation.
For a treatment-arm decision, the relevant evidence includes the prespecified outcome and follow-up, the estimated treatment effect and its uncertainty, safety information, and the monitoring rules set for the trial. The apixaban evaluation did not show a convincing improvement in the principal post-discharge outcome, and recruitment to that arm was stopped following review. That decision concerns the evidence for that treatment strategy under that protocol. It is not evidence that anticoagulation is never appropriate, nor does it establish that another treatment in the platform has the same effect.
A short derivation helps explain why a fixed-time risk-difference interval is uncertain. For a binary outcome in a group of \(n\) independently sampled participants with event probability \(p\), the sample proportion has variance \(p(1-p)/n\). With independent randomized groups, variances of the two sample proportions add when they are subtracted. Replacing the unknown probabilities with their sample estimates gives the standard error used above:
The approximation supports a large-sample interval, not an exact guarantee. It relies on independent participants and adequate numbers of events and non-events in both groups. In a platform trial, repeated looks at accumulating data and decisions based on interim results can also affect the operating characteristics of ordinary confidence intervals and tests. A nominal interval calculated after an adaptive decision should not automatically be treated as if it came from one fixed, single-look analysis; interpretation must follow the analysis plan and monitoring design.
Worked Example: Reading an Interim Estimate Without Inventing a Rule
Suppose, hypothetically, an interim review has complete 12-month status for 250 participants assigned to treatment and 250 assigned to usual care. There are 72 treatment-group events and 75 usual-care events. Assume independent randomized groups and use a normal approximation only to describe the estimate.
The risks are \(72/250=0.288\) and \(75/250=0.300\), so \(\widehat{RD}=0.288-0.300=-0.012\), a 1.20 percentage-point lower observed risk with treatment. The standard error is:
The approximate 95% interval is \(-0.012\pm1.96(0.04075)\), or \((-0.0919,\ 0.0679)\). The observed difference is small relative to its uncertainty. But this calculation alone does not determine whether to continue or stop the arm. That requires the trial’s prespecified interim boundaries, the timing and maturity of follow-up, safety evidence, and any adjustment for repeated monitoring. A post hoc rule such as “stop whenever the p-value exceeds 0.05” would not be a valid substitute for the planned decision procedure.
Challenges Particular to Post-Acute Illness
Post-discharge outcomes are shaped by more than the assigned drug. Patients may have different baseline severity, comorbidities, discharge arrangements, access to outpatient care, and evolving symptoms. Randomization helps balance prognostic factors on average within a comparison, but the estimated effect still applies most directly to people eligible for that trial, treated in its setting and time period.
Readmission is clinically important but partly depends on care-seeking, clinician judgment, bed availability, and local admission practice. In an open-label trial, knowledge of assignment could affect symptom reporting or decisions to seek or provide care. Death is generally less vulnerable to such judgment, but is less frequent and may therefore yield less precise estimates. Reporting the composite alone can conceal whether the observed difference came mainly from readmission or from death; reporting component counts and estimates, with appropriate caution about their precision, helps readers understand what drove the result.
Long follow-up also creates a practical challenge: participants may miss contacts, withdraw, or have incomplete outcome ascertainment. Censoring a participant at last known contact is reasonable for time-to-event methods only under assumptions about the relationship between censoring and future event risk, possibly conditional on measured information. If participants with worsening health are more likely to be lost, treating their missing outcomes as though they were unrelated to prognosis can bias the estimated effect. Follow-up completeness and sensitivity analyses therefore matter, especially when the endpoint extends well beyond discharge.
Worked Example: Why Follow-Up Completeness Changes Interpretation
Suppose, hypothetically, 100 participants are assigned to each group. At 12 months, 20 treatment participants and 24 usual-care participants are known to have had the composite event. However, status is missing for 10 participants in each group. Among participants with known status, the observed risks are \(20/90=0.2222\) and \(24/90=0.2667\), giving a complete-case difference of \(-0.0444\), or 4.44 percentage points lower with treatment.
That calculation describes participants with known status, not automatically all randomized participants. To see the uncertainty, consider extreme bounds for the full randomized groups. If none of the 10 missing treatment participants had an event and all 10 missing usual-care participants did, the risks would be \(20/100=0.200\) and \(34/100=0.340\), a difference of \(-0.140\). Under the opposite assignment, the risks would be \(30/100=0.300\) and \(24/100=0.240\), a difference of \(0.060\). The bounds span opposite conclusions. They are deliberately extreme, not a realistic estimate, but they show why missing outcomes cannot be ignored merely because the observed-data comparison favors treatment.
Comparisons, Diagnostics, and Limits
A fixed-time risk difference is easy to express in absolute terms and is useful when outcome status is complete at a specified horizon. A time-to-event analysis uses timing and can include censored observations, but requires defensible censoring assumptions and careful interpretation of the chosen effect measure. Neither approach is universally preferable. The choice should reflect the question, the follow-up pattern, and how the protocol defines the endpoint.
A conventional two-arm fixed trial may be simpler to describe because its treatment, comparator, and analysis are specified once. A platform can evaluate several options within a shared operational framework and may allow arms to enter or leave over time. That flexibility brings extra demands: the investigator must understand which participants were eligible for each comparison, when each arm was active, what monitoring rules governed its decisions, and whether changes in usual care or clinical context affect interpretation. The detailed statistical handling of shared controls is a separate issue; the essential point here is that platform membership alone does not make treatment estimates automatically comparable.
Useful diagnostics include checking the completeness and timing of follow-up, examining the number and pattern of readmissions and deaths separately, and verifying that the reported analysis matches the prespecified endpoint. For time-to-event analyses, inspect whether censoring is substantial or differs by group, and whether the chosen model’s assumptions are reasonable. Also ask whether the conclusion is driven by a component that is less objective, whether estimates are precise enough to rule out clinically important effects, and whether any interim decision follows the stated monitoring plan.
The findings of a post-hospitalization evaluation should not be generalized to all patients with persistent symptoms, all hospitalized patients, or all stages of COVID-19 without evidence. HEAL-COVID addressed treatment strategies for a defined population after hospitalization. Its results cannot on their own establish the cause of post-acute symptoms, determine the best treatment for every symptom pattern, or show that an intervention has no role in a different clinical population or treatment context.
Common Mistakes
- Treating a composite as one uniform outcome. Readmission and death are both serious, but they differ in frequency, ascertainment, and clinical meaning. Examine the components as well as the composite.
- Calling an uncertain estimate proof of no effect. A confidence interval that includes zero can also include effects that matter clinically. State what values remain compatible with the data.
- Concluding that a platform’s treatments share one result. Each arm concerns its own treatment strategy, population, comparator, and evidence. A decision about one arm does not decide another.
- Using a simple p-value as an interim stopping rule. Interim decisions require the prespecified monitoring procedure; repeated looks change how evidence should be interpreted.
- Assuming missing follow-up is harmless. If outcome status is related to prognosis, complete-case results may not represent the randomized groups.
Check Your Understanding
Answer each question, then compare your reasoning with the brief solutions below.
- In a hypothetical trial, 45 of 150 treatment participants and 54 of 150 usual-care participants have readmission or death by 12 months. What is the treatment-minus-usual-care risk difference?
- Why can a composite of readmission or death conceal clinically relevant information?
- Why is it not valid to stop an arm simply because an interim p-value exceeds 0.05?
- What does randomization allow an investigator to claim, and what does it not establish about generalizability?
- If substantial outcome data are missing, why might a complete-case risk difference be misleading?
Solutions. (1) The risks are \(45/150=0.300\) and \(54/150=0.360\), so the difference is \(0.300-0.360=-0.060\), or 6.00 percentage points lower in the treatment group. (2) The composite combines events with different clinical meaning and ascertainment; an overall difference may be driven by readmission while death is unchanged, for example. (3) Repeated interim monitoring and stopping boundaries must be incorporated into a prespecified decision procedure; an unplanned p-value rule does not control the intended error rates or decision properties. (4) Randomization supports a causal comparison of assignment in the eligible trial population under the trial’s conduct and analysis assumptions. It does not establish the same effect in populations, settings, or treatment contexts not represented by that comparison. (5) Complete cases may differ from those with missing outcomes. If missingness is related to future event risk, the observed participants’ event proportion need not estimate the randomized group’s full risk.