Protecting Our Community: COVID-19 Testing: Complete Statistical Analysis

1. Trial at a Glance

This page covers the registry results for Protecting Our Community: COVID-19 Testing (NCT04866303), a randomized na study. The primary outcome is SARS-CoV-2 Home-testing Kit Completion Active vs. Passive Arms.

2. Clinical Question

3. Trial Design

This was a randomized, double-masked, parallel-group trial of active versus passive delivery of home-based SARS-CoV-2 test kits. The study is titled Protecting Our Community: COVID-19 Testing, and the registry record lists Montana State University as sponsor. The record lists the study phase as NA. Enrollment was 273.

The study focused on Native American and Latino communities in the northwestern United States. The partner communities named in the record were the Flathead Indian Reservation of the Confederated Salish and Kootenai Tribes in Montana and the Yakima Valley of Washington. The study summary describes health care access disparities and aims to assess home-testing approaches in rural communities. These descriptions provide context for the trial, but do not establish whether either delivery approach improved testing completion.

In the active-delivery arm, bilingual community health workers registered kits on participants’ behalf. In the passive-delivery arm, participants were asked to register their kits online themselves and could contact Everlywell for assistance. Both approaches used home-based kits with accompanying instructions or study materials.

The study began on 2021-04-26, reached primary completion on 2022-02-25, and is listed as completed. The registry record identifies a randomized parallel design, but does not report the randomization procedure, allocation concealment, masking procedures, or which groups of people were masked. It also does not report whether assignment was balanced between arms. Those details should not be inferred from the design labels alone.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Before assignment: While 273 participants were randomized, 268 were included in the analysis due to early withdraw or lost to follow-up

Overall Study

Analysis population for the primary outcome, as defined in the registry: 273 participants were both consented and randomized. 5 participants were lost to follow-up and excluded from analysis. An additional measure was added to make this more clear

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

Population: Participants who provided consent and were randomized (both events happening on day 0). Baseline data not collected for 4 participants in the Passive Delivery Arm. Baseline data not collected for 1 participants in the Active Delivery Arm

6. Primary Endpoint

The registry lists the primary outcome as SARS-CoV-2 Home-testing Kit Completion Active vs. Passive Arms, measured over 14 days from randomization for both completed and successfully-completed measurements.

The primary outcome concerns the count of participants whose home-based SARS-CoV-2 test kits were completed, with an additional measure for kits that were successfully completed. The registry description frames the comparison as completion by randomized study arm: active delivery by community health workers versus passive delivery without that active registration support.

Completion is a practical measure for a home-testing intervention. A kit must be registered and used for the approach to result in a completed test; successful completion can distinguish that milestone from completion that does not meet the study’s success definition. The registry record does not define the exact criteria for successful completion, so the meaning of that distinction cannot be specified more narrowly.

The assessment timeframe was 14 days from randomization for both completed and successfully completed measurements. The record says an additional measure was added to make the outcome clearer. It does not give arm-specific counts, the exact analysis population for each measure beyond noting exclusions, or a single combined result. The outcome has more than one category or time point, and the registry record does not reduce it to one comparison. Consequently, no single primary effect estimate can be interpreted from the record alone.

7. Why No Re-analysis Is Shown

8. Statistical Interpretation

9. Statistical Methods Explained

The registry record identifies a randomized, parallel-group comparison and describes the primary outcome as a count of participants. It does not report the statistical model, the precise comparison measure, or an inferential analysis for the primary outcome. The explanations below describe general statistical considerations, not methods confirmed as having been used in this trial.

What does a participant count measure?

A count records how many participants meet a stated outcome definition. For this trial, the definitions concern completed and successfully completed home-test kits. A count by itself does not describe the comparative size or precision of an effect: interpretation requires the corresponding group information and a stated method for comparing groups. The registry record does not provide the primary outcome counts for either arm or a comparative estimate.

For a binary outcome, each participant is classified according to whether the event occurred under the definition used. A model may compare the chance of the event between groups, or report another contrast. The chosen contrast matters because different measures answer related but not identical questions. The registry record does not say which contrast, if any, was used for these completion outcomes, so none should be attributed to the trial.

How should uncertainty be read?

In general, a confidence interval expresses uncertainty around an estimated effect under the assumptions of the analysis. A narrower interval indicates greater precision, while a wider interval indicates less precision. The interval’s position relative to a null value can help readers assess which effect sizes are compatible with the data, but it does not by itself establish practical importance. No primary-outcome confidence interval is reported in the registry record.

In general, a p value measures how compatible the observed data are with a specified null hypothesis under a particular statistical model. It is not the probability that the null hypothesis is true, nor does it measure the size or importance of an effect. The registry record does not report a p value for the primary comparison. It is therefore not possible to characterize the result as statistically significant or not statistically significant.

Why do outcome definitions matter?

The record distinguishes completed test kits from successfully completed test kits and indicates that an additional measure was added to improve clarity. Clear definitions matter because the same participant could potentially meet one outcome definition but not another, depending on the study’s criteria. The record does not provide those criteria or identify a hierarchy between the two measures. Readers should therefore avoid collapsing them into a single outcome or interpreting one as a substitute for the other.

In general, an outcome measured over a specified timeframe is interpreted in relation to that timeframe. The registry specifies 14 days from randomization for both completion measures. This describes the assessment window; it does not establish what happened outside that period or whether later testing was assessed.

What do the planning assumptions mean?

The registry describes planning illustrations based on an observed effect, with a two-sided significance level of 0.05, equal allocation between arms, and a normal approximation. It also describes planning for stated fractions of that observed effect. These are assumptions for planning illustrations, not evidence that the trial was designed using those assumptions. The registry record does not report the trial’s own sample-size justification or statistical plan.

In general, a planning calculation estimates the sample size that might be needed to detect an effect under specified assumptions. Such an illustration depends on the assumed effect and analysis conditions. It is not observed power, and it cannot establish whether the trial’s result was precise. The registry record does not report the primary outcome effect on which the illustrations are said to be based, so the planning calculations cannot be evaluated against the trial’s posted primary results.

Over-dispersion is a general concern for some count outcomes: observed variation may exceed what a simple model assumes. When that happens, model-based uncertainty can be understated if the extra variation is ignored. The primary endpoint is described as counts of participants with an event, rather than a rate of repeated events. The registry does not report a model or a dispersion assessment, so it is not possible to say whether over-dispersion was relevant to the actual analysis.

Randomization supports a comparative design by assigning participants to study arms, but the registry’s design label does not disclose how assignment was generated or concealed. Likewise, double masking is recorded, but the registry does not identify who was masked or how masking was maintained. These details affect the assessment of potential bias and cannot be reconstructed from the labels alone.

10. Multiplicity, Missing Data and Analysis Populations

The primary outcome includes both completed and successfully completed test-kit measures. The registry record says an additional measure was added to make the outcome clearer, and its outcome description includes more than one category or time point. It does not identify a hierarchy among the measures, state which was the primary basis for inference, or report whether multiplicity was addressed. The record lists 2 analyses but does not describe their relationship to the outcome measures or provide their results.

In general, testing multiple outcomes or comparisons can increase the chance of finding an apparently unusual result by chance. Statistical plans may address this by defining a primary comparison in advance, adjusting inference, or treating additional analyses as exploratory. The registry record does not report which, if any, of these approaches was used. No conclusion about multiplicity control can be drawn.

The population description states that 273 participants were consented and randomized and that 5 participants were lost to follow-up and excluded from analysis. It does not give the number analyzed in each arm, explain whether the exclusions occurred in one or both arms, or describe how missing outcome information was handled. It also does not state whether the analysis followed intention-to-treat principles or another population definition. The analyzed sample size should not be reconstructed from the enrollment and loss figures alone.

In general, excluding participants with missing follow-up can affect a comparison if missingness is related to delivery assignment or the outcome. Appropriate interpretation depends on knowing how missing data arose, what outcome data were available, and what assumptions were used in analysis. Those details are not reported in the registry record. The record therefore permits description of the stated exclusions, but not an assessment of their impact on the primary result.

11. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

Deaths

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 0% reporting threshold.

Most frequent non-serious adverse event terms

The registry record reports no serious adverse events in either delivery group. The passive-delivery group lists 0 serious events among 136 at risk, and the active-delivery group lists 0 serious events among 137 at risk. Deaths are listed as 0 in both groups.

For other adverse events, the passive-delivery group lists 0 affected among 132 at risk, while the active-delivery group lists 1 affected among 136 at risk. These counts use different at-risk denominators from the serious-event counts, so the figures should be read within their respective categories rather than treated as if they share one denominator. The registry record does not provide adverse-event terms in the serious-event listing.

These are reported event counts, not a complete measure of safety. The registry record does not specify the safety follow-up timeframe or describe how events were collected and assessed. A zero count means no events were recorded in that category in the posted results; it does not establish that no event could occur or that the delivery approaches have identical safety profiles.

12. What the Result Does, and Does Not, Mean

The posted record documents a pragmatic randomized comparison of active and passive delivery of home-based COVID-19 test kits in Native American and Latino communities. It clarifies the central practical question: whether registration and support from trusted community health workers compared with self-registration was associated with kit completion and successful completion within 14 days from randomization.

It does not provide the primary outcome counts for either arm or a comparative effect estimate. Therefore, the record does not establish whether completion differed between approaches, how large any difference was, or how precise an estimate would be. It also does not support a claim that either delivery strategy was effective or ineffective. The absence of a posted primary comparison is not evidence of no difference.

The adverse-event counts describe what was recorded in the registry: no serious adverse events or deaths in either group, and one other adverse event in the active-delivery group compared with none in the passive-delivery group. The available information does not describe the safety observation period or all event-collection procedures, so these counts should not be interpreted as a comprehensive safety assessment.

The trial’s community setting and delivery contrast are relevant to implementation questions, but the registry record does not report whether the materials were acceptable, whether barriers to testing changed, or whether results differed across communities. Those questions should remain distinct from the primary completion outcome unless the corresponding findings are reported. The record supports understanding the study’s question, design, and selected safety counts; it does not support broader conclusions about testing behavior or health outcomes.

13. Why This Trial Matters Statistically

This trial poses a practical statistical question: whether the way a home-based test kit is delivered and registered is associated with participant completion. Its randomized comparison focuses on a component of implementation rather than only on the test kit itself. Active delivery included registration by bilingual community health workers, whereas passive delivery asked participants to register online and seek assistance from Everlywell if needed.

The outcome definition is important to interpreting such a comparison. The registry distinguishes completed kits from successfully completed kits, uses a 14-day assessment window, and notes that an additional measure was added for clarity. These features make clear why a reader needs the definitions and separate arm-level results before drawing conclusions. The registry record does not report those results or define success in detail.

The study also illustrates the difference between a trial design and an evaluable statistical result. Randomization and a parallel-group structure describe how the comparison was organized, while the effect estimate and its uncertainty would show what the data say about the outcome. Here, the record gives the design and some population and safety information, but not the primary comparative result. Planning assumptions cannot fill that gap: planning illustrations are not observed evidence and are not observed power.

Finally, the community context matters for interpreting what question was asked, but it does not replace outcome evidence. Results about test-kit completion would speak to the measured completion definitions and timeframe. They would not, by themselves, establish effects on infection, health outcomes, or broader access to care.

14. Limitations

• The posted summary statistics are the only data these results rest on; patient-level data, full protocols and statistical analysis plans are not available.
• Recalculated results are simple, unadjusted calculations from posted summaries. They do not replace the sponsor's prespecified analysis.

A central limitation of the registry record is that it does not report arm-specific primary outcome counts or a comparative estimate for completed or successfully completed kits. The record therefore does not permit direct assessment of the main randomized comparison. It also does not provide confidence intervals or p values for that outcome.

The outcome description includes both completion and successful completion, but does not define the criteria for success or identify a hierarchy between the measures. The record states that an additional measure was added for clarity, yet does not explain how this affected the analysis. The outcome is not reduced to one comparison in the registry record.

The record reports 273 consented and randomized participants and says 5 lost to follow-up were excluded from analysis. It does not report arm-specific exclusions, the handling of missing outcomes, or the analysis population in sufficient detail to assess potential bias. The randomization procedure and concealment methods are not reported. Although double masking is listed, the identity of those masked and the procedures used are not reported.

The record lists 2 analyses but does not give their methods or results, and it does not report whether or how multiplicity was addressed. It does not provide a sample-size justification for the trial, an interim-analysis plan, or a full statistical analysis plan. Safety counts are reported, but the safety follow-up timeframe and event-collection procedures are not. These limits constrain interpretation of both efficacy-related outcomes and adverse events.

15. Related Tutorials

16. Related Statistical Calculators

17. Sources

• ClinicalTrials.gov: Protecting Our Community: COVID-19 Testing — NCT04866303.
• Registry record last updated 2023-12-07; status last verified 2023-12.
• Results first posted 2023-08-30.
• Data retrieved from ClinicalTrials.gov on 2026-11-09.
• Group sizes, means, event counts and sponsor-reported p-values are reproduced as posted. Effect estimates, confidence intervals and p-values not attributed to the sponsor are independently calculated from the posted summary statistics.

18. Record Summary

Protecting Our Community: COVID-19 Testing was a randomized, double-masked, parallel-group trial sponsored by Montana State University. It compared active and passive delivery of home-based SARS-CoV-2 test kits in Native American and Latino communities, including partner communities in Montana and Washington. Enrollment was 273, and the study is listed as completed.

The primary outcome concerned completed and successfully completed kits, assessed 14 days from randomization. The registry record states that 5 participants lost to follow-up were excluded from analysis, but does not report arm-specific primary outcome results or a comparative estimate. It lists no serious adverse events or deaths in either group, and 1 other adverse event in the active-delivery group and 0 in the passive-delivery group.

The registry record provides the trial question and design but not enough primary-outcome results or analysis detail to assess the comparative effect or its precision.