← Clinical Trials
Covid19 NA Event-Rate Endpoint NCT04499391

COVID-19 Project ECHO in Nursing Homes: Complete Statistical Analysis

This analysis describes the randomized comparison of Project ECHO approaches in nursing homes, focusing on the registry’s infection-rate endpoint and the information available for interpreting it. Numerical outcome estimates and inferential analyses are not reported in the registry record.

Trial start: 2020-12-04  ·  Enrollment: 136  ·  Sponsor: Milton S. Hershey Medical Center
Scope of this record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.

1. Trial at a Glance

This page covers the registry results for COVID-19 Project ECHO in Nursing Homes (NCT04499391), a randomized na study. The primary outcome is Infection Rate.

136
Enrollment
NA
n/a
Arms
In the primary outcome
n/a
Effect
No re-analysis shown
n/a
95% CI
See limitations
FeatureRegistry value
ClinicalTrials.gov identifierNCT04499391
PhaseNA
ConditionCovid19
AllocationRandomized
Design modelParallel
MaskingNone (open label)
Enrollment136
Arms in the primary outcomen/a
Lead sponsorMilton S. Hershey Medical Center
Results postedYes

2. Clinical Question

Population

The study concerns nursing homes and their residents during the COVID-19 pandemic. The registry describes nursing homes as the units assigned to study arms and states that participant-level data are not available. The enrollment field lists 136, but the record does not clarify how that total maps to individual nursing homes or residents.

Intervention

The intervention is Project ECHO, a telehealth approach intended to connect university experts with nursing-home staff and administrators to support implementation of evidence-based infection-control guidance. The registry describes real-time, interactive videoconferencing using Zoom, with weekly sessions over 6 months and 25 sessions total. It identifies an ECHO Plus arm, but does not fully describe the distinction between the two arms.

Comparator

The registry identifies ECHO Plus and ECHO as the two arms. Both descriptions include Project ECHO sessions. The available arm descriptions do not give enough information to characterize the additional component implied by ECHO Plus or to determine precisely how the two approaches differed in delivery or content.

Primary question

The primary question is how the infection rate in nursing homes assigned to the two Project ECHO approaches compares over the study’s recorded assessment points. The endpoint is the cumulative incidence of confirmed COVID-19 cases per 1,000 residents over a four-week period. The registry lists assessments at baseline and 4, 6, 12, and 18 months. Outcome estimates for those assessments and an inferential comparison are not reported in the registry record, so the direction, size, and precision of any difference cannot be described.

3. Trial Design

This was a completed, randomized, parallel-group trial of Project ECHO for nursing homes. The registry lists the study as having no masking. Nursing homes, rather than individual residents, were assigned to the arms; the record explicitly notes that participant-level data are not available. The enrollment field lists 136, but the number of nursing homes assigned to each arm is not reported in the registry record.

The two named arms are ECHO Plus and ECHO. The available descriptions say that nursing homes in both arms received the intervention through real-time, interactive videoconferencing using Zoom. Sessions were described as 90 minutes, held weekly for 6 months, with 25 sessions total. The ECHO description refers to a case-based, collaborative approach. The ECHO Plus description ends before its distinguishing content is fully specified, so the registry record does not support a more detailed account of the contrast between arms.

The study’s listed start date is 2020-12-04, and its primary completion date is 2022-09-27. Its status is completed. The primary endpoint was infection rate, measured at baseline and 4, 6, 12, and 18 months. The listed secondary outcomes are hospitalization, death, and flu-like illness. The record includes four outcome measures, but it does not provide numerical estimates or analysis results for the primary comparison. Details such as the number of nursing homes in each arm, the process used to generate the random allocation, and any stratification are not reported in the registry record.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Overall Study

StageECHO PlusECHO
STARTEDNANA
COMPLETEDNANA
NOT COMPLETEDNANA

Analysis population for the primary outcome, as defined in the registry: Nursing homes were assigned to Arms/Groups, participant level data is not available

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

Population: Participants were not assigned to Arm/Groups and participant-level data were not collected. Participant age, gender and race/ethnicity data was not collected.

CharacteristicUnitECHO PlusECHOTotal
Participants analysedNANANA
Age, Categorical: <=18 yearsNursing homeNANANA
Age, Categorical: Between 18 and 65 yearsNursing homeNANANA
Age, Categorical: >=65 yearsNursing homeNANANA
Sex: Female, Male: FemaleNursing homeNANANA
Sex: Female, Male: MaleNursing homeNANANA
Race (NIH/OMB): American Indian or Alaska NativeNursing homeNANANA
Race (NIH/OMB): AsianNursing homeNANANA
Race (NIH/OMB): Native Hawaiian or Other Pacific IslanderNursing homeNANANA
Race (NIH/OMB): Black or African AmericanNursing homeNANANA
Race (NIH/OMB): WhiteNursing homeNANANA
Race (NIH/OMB): More than one raceNursing homeNANANA
Race (NIH/OMB): Unknown or Not ReportedNursing homeNANANA
Location: RuralNursing home262753
Location: UrbanNursing home383573
Facility Size: <60 BedsNursing home171936
Facility Size: >=60 bedsNursing home474390
Facility Payment Model: For-profitNursing home413374
Facility Payment Model: Not-for-profitNursing home232952
Facility Type: IndependentNursing home273259
Facility Type: NetworkedNursing home373067
Memory Care Status: YesNursing home171027
Memory Care Status: NoNursing home475299
Baseline Infection Rate: SomeNursing home5355108
Baseline Infection Rate: NoneNursing home11718

6. Primary Endpoint

The registry lists the primary outcome as Infection Rate, measured over Baseline, 4, 6, 12, 18 months.

ElementRegistry entry
Result typeMean
Measure of spreadStandard Deviation
Unitinfections per 1,000 residents in 4 week
Endpoint classificationEvent-Rate Endpoint

The primary endpoint is the rate of confirmed COVID-19 infections in enrolled nursing homes, expressed as the cumulative incidence per 1,000 residents over a four-week period. The registry lists the outcome as a mean with standard deviation and identifies assessment points at baseline and 4, 6, 12, and 18 months. It describes the rate as a measure of infections at each study point.

A rate expresses event occurrence relative to a defined exposure or population denominator. In this case, the stated denominator is residents, and the period of interest is four weeks. This makes the measure interpretable in relation to the size of the nursing-home resident population rather than as a raw count alone. General statistical context: rates can help compare settings or groups of different sizes, provided that the numerator and denominator are defined consistently and measured comparably.

The endpoint is relevant to the study’s stated focus on implementing infection-control practices in long-term care. However, the registry record does not provide the actual infection-rate values, their standard deviations, or the details of how resident counts and confirmed cases were assembled at each assessment. Those details, as well as the method used to compare arms over time, are not reported in the registry record. Without outcome estimates, the endpoint definition alone cannot indicate the observed direction or magnitude of the arm comparison.

7. Why No Re-analysis Is Shown

Reported as posted, not recalculated. Primary outcome has several categories or time points; not reduced to one comparison. A result is recalculated only when the posted data support a clean two-arm comparison, so no result is shown beyond what the sponsor posted.

8. Statistical Interpretation

Clinical Biostats interpretation

The registry record establishes the trial’s question and design but does not report numerical results for the primary infection-rate endpoint. It also lists zero analyses. Consequently, there is no reported arm-specific mean, standard deviation, estimated contrast, confidence interval, or p-value with which to assess the infection-rate comparison. The record therefore does not support a conclusion about whether the two arms had different infection rates or how large or precise any difference might have been.

The endpoint was assessed at baseline and 4, 6, 12, and 18 months. Repeated assessments can describe how outcomes change over time and can support comparisons that account for both arm assignment and assessment time. General statistical context: repeated measurements on the same nursing homes are usually related rather than independent. Analyses may need to account for that correlation, and the appropriate method depends on the data structure and the prespecified analysis plan. The statistical model and the handling of repeated measurements are not reported in the registry record.

Because nursing homes were assigned to arms, the assignment unit differs from the resident-level outcome denominator. General statistical context: residents within the same nursing home may share conditions that make their outcomes more alike than outcomes from residents in different homes. This clustering can affect standard errors and confidence intervals if it is not addressed. The number of homes in each arm and the method used to account for clustering are not reported in the registry record. The enrollment total alone cannot establish how many independent units contributed to the comparison.

The registry’s listed secondary outcomes are hospitalization, death, and flu-like illness. Numerical results and analysis estimates for those outcomes are not reported in the registry record either. The record’s zero counts in the adverse-event fields are registry entries, not a substitute for outcome analyses; the context and completeness of adverse-event reporting are not reported in the registry record.

The record describes outcome measures at several assessment points, but does not report how results across time points or outcomes were interpreted together. General statistical context: examining multiple outcomes or time points can increase the chance of finding an apparently notable result by chance if multiplicity is not addressed. The registry record does not report a multiplicity strategy. In the absence of effect estimates and uncertainty measures, the trial’s precision and evidential strength cannot be evaluated from the registry entry.

9. Statistical Methods Explained

The methods information in the registry record is limited. It identifies a randomized, parallel-group design, no masking, nursing-home assignment, and an infection-rate endpoint expressed per 1,000 residents over a four-week period. It does not report the statistical analysis plan or the methods used to produce outcome estimates. The explanations below describe general statistical considerations, not methods confirmed as having been used in this trial.

What does random assignment contribute?

Random assignment is intended to make treatment-group membership independent of measured and unmeasured baseline characteristics on average. It supports a causal comparison when allocation is preserved and outcome collection and analysis are appropriate. Randomization does not guarantee that groups will be identical, especially when the assignment unit is a nursing home and the number of homes is not reported. The registry identifies the allocation as randomized, but the sequence-generation process, concealment procedures, and any stratification are not reported in the registry record.

Why does the assignment unit matter?

The registry says nursing homes were assigned to arms, while the primary outcome refers to residents. This creates a clustered data structure: residents in one home share an environment and may have correlated outcomes. General statistical context: treating all residents as statistically independent when their outcomes are correlated can make uncertainty appear smaller than it is. Methods for clustered data account for the nursing-home level, for example through cluster-level summaries or models that represent within-home correlation. The registry record does not identify which approach, if any, was used, nor does it report the number of homes contributing data.

The distinction between assignment and measurement also matters for interpretation. The intervention is assigned at the nursing-home level, while infections are counted in relation to residents. A valid analysis needs a clear account of which homes and residents contribute at each assessment, how the denominator is defined, and how changes in the resident population are handled. These operational details are not reported in the registry record.

How should an infection rate be understood?

A rate places events in relation to an exposure or population denominator. Here, the registry defines the outcome as cumulative four-week incidence of confirmed COVID-19 cases per 1,000 residents. It records the outcome parameter as a mean and the dispersion measure as standard deviation. General statistical context: a mean describes the average of observed values, while a standard deviation describes how spread out those values are around the mean. Neither one alone provides the uncertainty of an estimated difference between arms. A confidence interval would describe a range of values compatible with the data and analysis assumptions; a p-value would summarize how incompatible the data are with a specified null hypothesis under those assumptions.

The registry does not report arm-specific values, the standard deviations, confidence intervals, p-values, or the method used to construct them. It also does not explain whether the four-week denominator is based on a fixed resident census, the resident population present at each assessment, or another definition. Those distinctions can matter when populations change over time.

What does assessment over time require?

The endpoint is listed at baseline and 4, 6, 12, and 18 months. General statistical context: outcomes measured repeatedly can be analyzed with methods that model time and account for correlation among observations from the same unit. A comparison may focus on differences at particular assessments, changes from baseline, or an overall pattern across time. These are not interchangeable questions; each depends on an explicitly defined estimand and analysis model. The registry record does not report which question or model was used.

Rate data may also show more variability than a simple model assumes. General statistical context: over-dispersion occurs when observed variability exceeds what a chosen probability model expects. If present, it can lead to overly narrow uncertainty estimates unless the model accommodates it. Whether over-dispersion was assessed or how it was handled is not reported in the registry record.

What can a planning illustration establish?

Any planning illustration based on an observed effect should be distinguished from the trial’s original design justification. The described illustration assumptions are a two-sided significance level of 0.05, equal allocation, and a normal approximation, with the effect to detect expressed as a stated fraction of the observed effect. The registry record does not report a sample-size justification for the trial, and those illustration assumptions should not be read as the protocol’s planned analysis or as evidence of observed power. Sample-size calculations are planning aids; they do not measure the probability that a completed study’s result is true.

For a nursing-home-allocated study, planning also depends on the number of homes, the average contribution of residents per home, and within-home similarity, among other assumptions. Those design details are not reported in the registry record. No numerical planning result is reported in the registry record.

10. Multiplicity, Missing Data and Analysis Populations

The registry lists the primary infection-rate endpoint at baseline and 4, 6, 12, and 18 months, as well as secondary outcomes of hospitalization, death, and flu-like illness. Considering several outcomes and assessment points raises a general multiplicity issue: the more comparisons examined, the greater the possibility of an apparently unusual result arising by chance. A prespecified testing hierarchy, adjustment procedure, or clearly defined primary time point can help clarify how evidence should be interpreted. A multiplicity strategy is not reported in the registry record.

Missing-data methods are also not reported in the registry record. This matters because residents may enter or leave a nursing home, homes may have incomplete assessments, and infection ascertainment may vary. These are general considerations for longitudinal nursing-home research, not claims about what happened in this trial. The record does not describe the amount or pattern of missing outcome data, how missingness was handled, or whether sensitivity analyses were performed.

The registry states that nursing homes were assigned to arms and that participant-level data are not available. It does not report the analysis population, whether analyses followed assigned groups, or how exclusions and changes in participation were handled. Interim analyses and any stopping rules are not reported in the registry record. With zero analyses listed, the record does not provide results that would allow readers to assess how multiplicity, missingness, or analysis populations affected the reported comparison.

11. What the Result Does, and Does Not, Mean

The registry record describes a randomized evaluation of Project ECHO approaches in nursing homes and defines infection rate as its primary outcome. It does not report numerical results for that endpoint or inferential analyses. As a result, the record cannot establish the observed direction or size of a difference between ECHO Plus and ECHO, or how precisely any difference was estimated.

This absence of reported estimates is not evidence that the two approaches had identical outcomes. It also is not evidence that one approach was better. Those conclusions require outcome data and an analysis that reflects the nursing-home assignment, the repeated assessments, and the endpoint definition. The registry record does not report those analysis results.

General statistical context: an estimate and its confidence interval address different but related questions. The estimate describes the observed contrast, while the interval indicates the range of values compatible with the data and model assumptions. A p-value alone would not describe the size or practical importance of a difference. None of these quantities is reported for the primary comparison in the registry record.

The study’s stated rationale concerns supporting infection-control guideline implementation in nursing homes, but the primary endpoint measures confirmed infections rather than implementation itself. The registry lists hospitalization, death, and flu-like illness as secondary outcomes, but does not report their results. The record therefore does not permit conclusions about those outcomes or about implementation processes. Its enrollment entry and design description are not substitutes for observed outcome data.

The most defensible interpretation is limited to the study question, design, and endpoint as registered. Any conclusion about comparative outcomes, precision, or broader implications would require results and methodological details that are not reported in the registry record.

12. Why This Trial Matters Statistically

This trial is statistically notable for assigning nursing homes while defining its primary outcome in terms of residents. That structure makes the distinction between the unit of randomization and the unit used to express the outcome central to analysis. General statistical context: outcomes within a nursing home may be correlated, so an analysis should account for the grouping when estimating uncertainty. The registry identifies the assignment level but does not report how this issue was handled.

The endpoint is also longitudinal. The registry names several assessment points spanning baseline and later follow-up, so interpretation depends on whether the question concerns a particular time point, change over time, or an overall arm contrast. These approaches can produce different estimands and require different assumptions. The analysis plan is not reported in the registry record.

The trial’s subject—supporting infection-control implementation in nursing homes—makes clear outcome definitions important. The registry defines the primary measure as cumulative four-week incidence per 1,000 residents, but does not describe the denominator construction or provide numerical outcome values. Such details are needed to understand the rate and judge comparability across assessments.

Finally, the record illustrates the difference between registration information and results reporting. It documents a randomized study and identifies outcomes, but lists zero analyses and reports no numerical estimates for the primary comparison. Statistical interpretation requires more than a design and an endpoint: readers need estimates, measures of uncertainty, and enough methodological detail to understand how the data were analyzed.

13. Limitations

The main limitation for interpreting this trial from its registry record is the lack of reported outcome estimates and inferential analyses. The record lists zero analyses, and it does not provide arm-specific infection rates, standard deviations, estimated contrasts, confidence intervals, or p-values. This prevents assessment of the direction, magnitude, and precision of the primary comparison.

The number of nursing homes assigned to each arm is not reported in the registry record. Although the enrollment field lists 136, the record says participant-level data are unavailable and does not clarify how enrollment relates to the number of homes or residents contributing to each assessment. The allocation procedure and any methods for accounting for clustering are also not reported.

The arm descriptions do not fully specify how ECHO Plus differed from ECHO. The description of ECHO Plus is incomplete, and the record does not provide enough detail to characterize the contrast beyond the shared description of Project ECHO videoconferencing sessions. This limits interpretation of what exposure the arm comparison represents.

Further details not reported in the registry record include the statistical analysis plan, missing-data handling, analysis population, multiplicity strategy, and the operational definition of the resident denominator at each assessment. The listed adverse-event fields contain zero counts, but the context and completeness of those entries are not reported. These limitations concern the available registry information and do not establish what was or was not done outside the record.

14. Related Tutorials

15. Related Statistical Calculators

16. Sources

Continue through the Clinical Biostats statistical pathway

Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.

17. Record Summary

NCT04499391, titled COVID-19 Project ECHO in Nursing Homes, is listed as a completed, randomized, parallel-group trial with no masking. It compared nursing homes assigned to ECHO Plus or ECHO. Enrollment is listed as 136. The study start date is 2020-12-04, and primary completion is listed as 2022-09-27.

The primary endpoint is the mean rate of confirmed COVID-19 infections per 1,000 residents over a four-week period, assessed at baseline and 4, 6, 12, and 18 months. Secondary outcomes are hospitalization, death, and flu-like illness. The registry record lists zero analyses and does not report numerical outcome estimates or inferential results for the primary comparison.

The record describes weekly Project ECHO videoconferencing sessions over 6 months, with 25 sessions total, but does not fully specify the distinction between arms. Details of the analysis plan, clustering methods, missing-data handling, and multiplicity procedures are not reported in the registry record.

Clinical Biostats