← Clinical Trials
SARS-CoV-2 NA Binary Endpoint NCT04901624

Use of Behavioral Economics in Repeat SARS-CoV-2 (COVID-19) Antibody Testing in Disadvantaged Communities: Complete Statistical Analysis

This analysis examines repeat SARS-CoV-2 antibody-test attendance under combinations of risk messages and incentives. It compares the posted arm counts with the registry’s mixed-model analyses and considers the uncertainty, planning illustrations, and reporting limitations.

Trial start: 2021-06-29  ·  Enrollment: 2164  ·  Sponsor: University of Southern California
Scope of this record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.

1. Trial at a Glance

This page covers the registry results for Use of Behavioral Economics in Repeat SARS-CoV-2 (COVID-19) Antibody Testing in Disadvantaged Communities (NCT04901624), a randomized na study. The primary outcome is Attendance Rate at Time 2 SARS-CoV-2 Antibody Test.

2164
Enrollment
NA
4
Arms
In the primary outcome
-10.5 pts
Risk difference
Personal Risk + Lottery Incentive
-18.1 to -2.8 pts
95% CI
Two-sided
FeatureRegistry value
ClinicalTrials.gov identifierNCT04901624
PhaseNA
ConditionSARS-CoV-2
AllocationRandomized
Design modelFactorial
MaskingNone (open label)
Enrollment2164
Arms in the primary outcome4
Lead sponsorUniversity of Southern California
Results postedYes

2. Clinical Question

Population

The primary question concerns participants who attended Time 1 antibody testing. The study focused on repeat testing in disadvantaged communities. The registry record does not report further eligibility details or describe the communities in more detail.

Intervention

The behavioral approaches combined personal-risk or family-risk messaging with loss protection or a lottery incentive. These combinations were intended to encourage attendance for a later SARS-CoV-2 antibody test. The registry record does not report the exact wording, delivery, or timing of the messages and incentives.

Comparator

The posted arm counts use Personal Risk + Loss Protection as the reference for the unadjusted recalculations. The other listed combinations are Personal Risk + Lottery Incentive, Family Risk + Loss Protection, and Family Risk + Lottery Incentive. These are active combinations, not a separately described no-message or no-incentive group.

Primary question

The primary endpoint is attendance at Time 2 SARS-CoV-2 antibody testing, with a timeframe of 6 months. The question is whether attendance differed across the combinations of message framing and incentive. The registry describes the aim as evaluating risk-based messaging and incentives for encouraging repeat testing; it also identifies social and behavioral determinants as an area of interest.

This is a question about participation in repeat testing, not a direct comparison of antibody status, infection, protection, or health outcomes. The registry record does not report a separate intervention-free comparator, nor does it specify whether the central scientific question was a main effect of message type, a main effect of incentive type, or an interaction between them. The posted arm-by-arm comparisons therefore describe differences between the listed combinations, while the broader factorial question cannot be fully reconstructed from the record.

3. Trial Design

The trial is registered as randomized, with a factorial model and no masking. Its official title is Use of Behavioral Economics in Repeat SARS-CoV-2 (COVID-19) Antibody Testing in Disadvantaged Communities. The sponsor is the University of Southern California. The registry lists phase as NA, enrollment as 2164, status as completed, a start date of 2021-06-29, and primary completion on 2023-06-03.

The four listed behavioral components were Family Risk Messaging, Personal Risk Messaging, Loss Protection, and Lottery Incentive. The posted arm descriptions pair one messaging approach with one incentive approach: Personal Risk + Loss Protection, Personal Risk + Lottery Incentive, Family Risk + Loss Protection, and Family Risk + Lottery Incentive. Randomization and factorial labeling describe the registered design, but the registry record does not report the allocation ratio, the randomization procedure, or the factorial analysis plan.

The primary endpoint concerns Time 2 test attendance among participants who attended Time 1 testing, over a timeframe of 6 months. Posted arm sizes for the endpoint are 308.0 for Personal Risk + Loss Protection, 285.0 for Personal Risk + Lottery Incentive, 286.0 for Family Risk + Loss Protection, and 203.0 for Family Risk + Lottery Incentive. These are the denominators associated with the posted attendance counts; they should not be read as a full participant-flow account. The registry record does not report reasons for nonattendance or explain the relationship between these endpoint denominators and the enrollment figure.

The record lists 2 outcome measures and 12 analyses. It identifies Social and Behavioral Determinants of Antibody Testing as a secondary outcome. It does not report masking details beyond none, implementation fidelity, or a fuller account of follow-up procedures.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Before assignment: We drew a simple random sample of patient households without replacement from AltaMed registry. Each household sampled was contacted to identify eligibility and interest. Households met inclusion criteria if at least one member was a patient at AltaMed and the household contained at least one adult and at least one member 5 to 17 years of age.

Overall Study

StagePersonal Risk + Loss ProtectionPersonal Risk + Lottery IncentiveFamily Risk + Loss ProtectionFamily Risk + Lottery Incentive
STARTED626550539449
Wave 1 Attendance308285286203
Wave 2 Attendance1238412978
COMPLETED1238412978
NOT COMPLETED503466410371

Analysis population for the primary outcome, as defined in the registry: Participants who attended Time 1 antibody testing.

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

Population: Households who completed baseline survey and agreed to Time 1 antibody testing.

CharacteristicUnitPersonal Risk + Loss ProtectionPersonal Risk + Lottery IncentiveFamily Risk + Loss ProtectionFamily Risk + Lottery IncentiveTotal
Participants analysed6265505394492164
Age, Continuousyears25.71 (SD 16.92)24.44 (SD 15.64)25.58 (SD 16.78)26.42 (SD 16.61)25.5 (SD 16.51)
Sex/Gender, Customized: FemaleParticipants3733193072661265
Sex/Gender, Customized: MaleParticipants249231231179890
Sex/Gender, Customized: Non binaryParticipants00101
Sex/Gender, Customized: Unknown or Not reportedParticipants40048
Ethnicity (NIH/OMB): Hispanic or LatinoParticipants5785014814081968
Ethnicity (NIH/OMB): Not Hispanic or LatinoParticipants38465838180
Ethnicity (NIH/OMB): Unknown or Not ReportedParticipants1030316
Race (NIH/OMB): American Indian or Alaska NativeParticipants40116
Race (NIH/OMB): AsianParticipants16148745
Race (NIH/OMB): Native Hawaiian or Other Pacific IslanderParticipants00011
Race (NIH/OMB): Black or African AmericanParticipants512251860
Race (NIH/OMB): WhiteParticipants41383924142
Race (NIH/OMB): More than one raceParticipants32162829105
Race (NIH/OMB): Unknown or Not ReportedParticipants5284704383691805
Region of Enrollment: United Statesparticipants6265505394492164

6. Primary Endpoint

The registry lists the primary outcome as Attendance Rate at Time 2 SARS-CoV-2 Antibody Test, measured over 6 months.

ElementRegistry entry
Result typeCount Of Participants
Measure of spreadnot applicable
UnitParticipants
Endpoint classificationBinary Endpoint

The primary endpoint is attendance at the Time 2 SARS-CoV-2 antibody test, measured over 6 months among participants who attended Time 1 antibody testing. It is recorded as a count of participants with an event, where the event is attendance. The posted counts are 123.0 of 308.0 in Personal Risk + Loss Protection, 84.0 of 285.0 in Personal Risk + Lottery Incentive, 129.0 of 286.0 in Family Risk + Loss Protection, and 78.0 of 203.0 in Family Risk + Lottery Incentive.

Attendance is relevant to a study designed to assess whether messaging and incentives encourage people to return for repeat testing. It measures participation in testing rather than the antibody result, whether a participant had an infection, or whether antibodies conferred protection. The registry’s stated population is participants who attended Time 1 testing, so the primary endpoint does not by itself describe testing uptake among people who did not attend the initial test.

For a binary outcome such as attendance, a group’s event count can be considered alongside the number at risk in that group. A risk difference expresses the contrast between the groups’ event proportions on an additive scale. General: this scale directly describes the difference in event probability, while uncertainty around the estimate remains important for judging how precisely the contrast is known. The registry record does not report additional endpoint details such as how attendance was verified or how missing Time 2 attendance information was classified.

7. Results Posted in the Registry

Risk difference: Personal Risk + Lottery Incentive

-10.5

95% CI: -18.1 to -2.8 percentage points

Recalculated from the posted summary statistics

Primary outcome by arm, with 95% confidence intervals
Primary outcome by arm with 95% confidence intervals21.828.234.540.947.253.5Personal Risk + Loss Protecti… (n=308)Personal Risk + Lottery Incen… (n=285)Family Risk + Loss Protection (n=286)Family Risk + Lottery Incenti… (n=203)% of participants (95% CI)
Treatment effect versus the control arm
Forest plot of risk difference (percentage points) vs control (95% CI)Personal Risk + Lottery Incen…Family Risk + Loss ProtectionFamily Risk + Lottery Incenti…-21-13-6.101.148.3816risk difference (percentage points) vs control (95% CI)

8. Statistical Interpretation

Clinical Biostats interpretation

In the unadjusted recalculation, attendance was 0.399 in the Personal Risk + Loss Protection reference arm and 0.295 in Personal Risk + Lottery Incentive. The risk difference for Personal Risk + Lottery Incentive versus the reference was -0.105, with a confidence interval from -0.181 to -0.029 and an unadjusted p-value of 0.008. The interval lies below zero, indicating that this recalculated contrast is compatible with a lower attendance proportion in the lottery-incentive combination than in the reference combination, under this unadjusted comparison.

Attendance was 0.451 in Family Risk + Loss Protection. Its recalculated risk difference versus the reference was 0.052, with a confidence interval from -0.028 to 0.131 and an unadjusted p-value of 0.203. The interval includes zero, so the recalculation does not distinguish this contrast from no difference at the confidence level represented by the interval. Attendance was 0.384 in Family Risk + Lottery Incentive; its risk difference versus the reference was -0.015, with a confidence interval from -0.102 to 0.071 and an unadjusted p-value of 0.732. That interval also includes zero and allows differences in either direction.

These comparisons are simple, unadjusted recalculations from the posted arm counts. They are not a replacement for the sponsor’s own analysis. Because the registry record contains a discrepancy between these calculations and the sponsor analysis, the sponsor’s own analysis takes precedence when describing the trial’s reported inferential results. The recalculated estimates are useful as a transparent description of the posted counts, but they may not represent the same model, estimand, or adjustment strategy as the registry analyses.

The registry reports three Mixed Models Analysis results, each described as a superiority analysis and expressed as a slope. For Personal Risk + Loss Protection compared with Personal Risk + Lottery Incentive, the reported slope was 1.19, with a 95% confidence interval from 0.42 to 1.97 and p = 0.003. For Personal Risk + Lottery Incentive compared with Family Risk + Loss Protection, the reported slope was 1.46, with a 95% confidence interval from 0.68 to 2.24 and p < 0.001. For Personal Risk + Lottery Incentive compared with Family Risk + Lottery Incentive, the reported slope was 1.11, with a 95% confidence interval from 0.26 to 1.96 and p = 0.01.

The registry record does not explain the scale or direction of the reported slope, or provide enough model detail to translate those estimates into attendance-proportion differences. They should therefore be reported as the registry presents them rather than interpreted as risk differences. The recalculated risk differences and the mixed-model slopes are distinct summaries and should not be conflated. Neither the posted attendance comparisons nor the reported model results establish effects on infection, antibody protection, or other clinical outcomes.

9. Statistical Methods Explained

The posted recalculations compare each of three listed combinations with Personal Risk + Loss Protection. For a binary endpoint, the event is attendance at Time 2 testing. The arm-level event count and denominator describe how many participants attended among those represented in the relevant endpoint group. General: a risk difference is the first group’s event proportion minus the reference group’s event proportion. A negative value means the first proportion is lower in that comparison; a positive value means it is higher. This gives an absolute contrast on the event-proportion scale.

For Personal Risk + Lottery Incentive, the recalculated risk difference was -0.105, with a confidence interval from -0.181 to -0.029. For Family Risk + Loss Protection, it was 0.052, with a confidence interval from -0.028 to 0.131. For Family Risk + Lottery Incentive, it was -0.015, with a confidence interval from -0.102 to 0.071. These estimates are identified as unadjusted recalculations from the posted summary counts. They do not incorporate covariates or a mixed-effects model unless those features are explicitly part of the calculation; the registry record does not report such adjustments for these recalculations.

A confidence interval represents a range of values reasonably compatible with the estimate under the calculation’s assumptions and sampling model. It communicates uncertainty as well as the direction and size of the estimated contrast. For a risk difference, zero represents equal event proportions. An interval that includes zero does not rule out no difference at the confidence level used; an interval wholly on one side of zero is less compatible with a zero difference under that same calculation. General: this interpretation is about statistical uncertainty, not the practical importance of a difference or whether an intervention should be used.

The registry separately reports Mixed Models Analysis results with a slope parameter, 95% confidence intervals, p-values, and a superiority classification. A mixed model is a general approach that can account for structure in observations, such as repeated measurements or grouping, when the model and data support that structure. The registry record does not report the model specification, the outcome scale for the slope, covariates, covariance structure, or the exact contrast coding. It is therefore not possible to identify which features the sponsor’s model incorporated or to translate its slope into an attendance probability from the registry record alone.

The reported mixed-model comparisons are not the same set of reference contrasts as the unadjusted recalculations. The registry lists Personal Risk + Loss Protection with Personal Risk + Lottery Incentive; Personal Risk + Lottery Incentive with Family Risk + Loss Protection; and Personal Risk + Lottery Incentive with Family Risk + Lottery Incentive. The corresponding reported slopes are 1.19, 1.46, and 1.11, with the confidence intervals and p-values described in the statistical interpretation. The record labels these as superiority analyses, but the meaning of the slope and the direction implied by the group ordering are not reported in the registry record. Caution is warranted in attaching a substantive direction to the slope without that information.

General: a p-value assesses how incompatible the observed data are with a specified null model, assuming the analysis model and its assumptions. It does not measure the probability that the null hypothesis is true, and it does not tell readers whether an effect is important. Here, the recalculated p-values are explicitly unadjusted. The record does not report whether or how the sponsor adjusted for multiple comparisons, so the reported p-values should not be assumed to control the chance of false-positive findings across all analyses.

Why can over-dispersion matter?

General: over-dispersion occurs when variability in the observed data exceeds what a statistical model expects. If a model underestimates that variability, its standard errors can be too small and its confidence intervals too narrow. Whether over-dispersion is relevant depends on the data and model. The registry record does not report an over-dispersion assessment, and the endpoint summaries do not establish whether it was present.

What can be concluded from the posted methods?

The record supports a transparent unadjusted comparison of attendance counts and separately gives the sponsor’s mixed-model results. It does not provide a complete statistical analysis plan, detailed model assumptions, missing-data handling, analysis-population definitions beyond the primary endpoint population, or multiplicity procedures. Those omissions limit independent reproduction and make it important to distinguish the recalculated contrasts from the sponsor’s reported model estimates.

10. Confidence Intervals and Precision

Precision is indicated by the confidence interval around an estimate: narrower intervals represent more precise estimates, while wider intervals leave more uncertainty about the contrast. Precision depends in part on the number of observations and the amount of variability, as well as on the analysis model. A point estimate alone cannot show how much uncertainty surrounds it.

The recalculated risk difference for Personal Risk + Lottery Incentive versus Personal Risk + Loss Protection was -0.105, with a confidence interval from -0.181 to -0.029. This interval is on the negative side of zero. For Family Risk + Loss Protection versus the reference, the estimate was 0.052 and the interval ranged from -0.028 to 0.131. For Family Risk + Lottery Incentive versus the reference, the estimate was -0.015 and the interval ranged from -0.102 to 0.071. The latter intervals include both zero and values in either direction, reflecting uncertainty about the contrast.

The posted arm denominators are 308.0, 285.0, 286.0, and 203.0, and the corresponding attendance counts are 123.0, 84.0, 129.0, and 78.0. These values provide context for the precision of the arm comparisons, but the registry record does not provide a full account of missing outcome information or participant flow. No confidence interval for an arm’s attendance proportion is listed separately in the record.

The sponsor’s mixed-model confidence intervals are reported for slopes, not for the recalculated risk differences. They are 0.42 to 1.97, 0.68 to 2.24, and 0.26 to 1.96 for the three listed analyses. Because the slope scale and model details are not reported in the registry record, these intervals cannot be directly compared with the risk-difference intervals as though they measured the same quantity. Their interpretation depends on the sponsor’s model and parameter definition.

Confidence intervals do not account automatically for every possible source of uncertainty. In particular, the registry record does not report adjustment for multiple comparisons, sensitivity analyses, or how missing data were handled. Statistical precision within a model should not be mistaken for certainty about the model’s assumptions or the result’s broader meaning.

11. Planning a Similar Trial: Sample Size

This is a planning illustration, not a re-evaluation of the original trial. It asks: if a new study wanted to detect a difference like the one observed, or a smaller one, how large would it need to be? It is deliberately not “observed power” of the finished trial, which is not a meaningful quantity.

Effect to detectParticipants per arm, 80% powerParticipants per arm, 90% power
100% of the observed effect324434
75% of the observed effect587785
50% of the observed effect1,3411,795
Sample size needed versus the size of the effect to detect
Sample size needed versus size of effect to detect2005001,0002,0005,00040%60%80%100%80% power90% powersize of effect to detect, as % of the effect observed (log vertical scale: participants per arm)
Method and assumptions. Two-sided α = 0.05, 1:1 allocation, pooled-variance normal approximation for two proportions (control proportion held at the observed value). Calculated for the comparison: Personal Risk + Lottery Incentive.

The sample-size figures are planning illustrations based on the observed effect, not the trial’s own original design assumptions. The calculations use a two-sided significance level of 0.05, equal allocation between the two arms, and a normal approximation. The effect to detect is set to the stated fraction of the observed effect. For these binary attendance comparisons, the figures are participants per arm, not total events.

The 80% power column gives the number of participants per arm used in the planning calculation to provide an 80% chance of detecting the specified effect under the stated assumptions, if that effect and the model assumptions hold. The 90% power column gives the corresponding per-arm planning figure for a 90% chance. These are design-planning quantities, not guarantees about what a future study will find.

For example, planning for 100% of the observed effect in the Personal Risk + Lottery Incentive comparison gives 324 participants per arm for 80% power and 434 participants per arm for 90% power. Planning for 75% of that observed effect gives 587 and 785 participants per arm, respectively. The other comparisons have their own figures because the observed effects differ. The registry record’s original sample-size justification and design assumptions are not reported in the registry record.

Smaller effects are harder to distinguish from random variation, so the planning figures increase when the calculation targets a smaller fraction of the observed effect. This pattern is visible across the rows for 100%, 75%, and 50% of the observed effect. The figures are illustrations conditional on the calculation assumptions, rather than a claim about the adequacy of the completed trial or an estimate of its chance of success. This is not observed power.

12. How the Sample Size Is Derived

Power is the probability that a study of a given size rejects the null hypothesis when a specific true effect exists. It depends on four things: the effect to detect, the variability of the outcome, the significance level (here a two-sided α of 0.05, so z1−α/2 = 1.960) and the desired power (z1−β = 0.842 for 80% and 1.282 for 90%).

Formula

n = [ z1−α/2 √(2p̄(1−p̄)) + z1−β √(p0(1−p0) + p1(1−p1)) ]2 / (p1 − p0)2

n is the number of participants in each arm, p0 and p1 are the control and treatment proportions, and p̄ is their average.

Worked calculation for this trial

  1. Control proportion p0 = 0.399; treatment proportion p1 = 0.295; average p̄ = 0.347.
  2. First term: z1−α/2 × √[2p̄(1−p̄)] = 1.96 × 0.6732 = 1.3195.
  3. Second term: z1−β × √[p0(1−p0) + p1(1−p1)] = 0.842 × 0.6691 = 0.5632.
  4. n = (1.3195 + 0.5632)2 / (-0.1046)2 = 323.9, rounded up to 324 participants per arm for 80% power.

The smaller-effect rows in the table above repeat the same calculation with the effect multiplied by 0.75 and 0.5 (for ratios, applied to the logarithm of the ratio).

R code

alpha <- 0.05
z_a   <- qnorm(1 - alpha / 2)          # two-sided
p0 <- 0.399350649350649                          # control proportion
p1 <- 0.294736842105263                          # treatment proportion
n_per_arm <- function(power, frac = 1) {
  q1 <- p0 + (p1 - p0) * frac               # smaller effect = fraction of the observed difference
  pbar <- (p0 + q1) / 2
  z_b <- qnorm(power)
  ceiling(round((z_a * sqrt(2 * pbar * (1 - pbar)) + z_b * sqrt(p0 * (1 - p0) + q1 * (1 - q1)))^2 / (q1 - p0)^2, 6))
}
for (f in c(1, 0.75, 0.5))
  cat(sprintf("%3.0f%% of observed effect: n per arm = %s (80%% power), %s (90%% power)\n", 100 * f,
              format(n_per_arm(0.80, f), big.mark = ","), format(n_per_arm(0.90, f), big.mark = ",")))

# Check against R's built-in function (unrounded n per arm)
cat("power.prop.test:", round(power.prop.test(p1 = p0, p2 = p1, power = 0.80)$n, 1), "\n")

# Simulation: how often does the z-test reject at the 80%-power sample size?
set.seed(4901624)
n    <- n_per_arm(0.80)
reps <- 20000
x0 <- rbinom(reps, n, p0); x1 <- rbinom(reps, n, p1)
ph <- (x0 + x1) / (2 * n)
z  <- ((x1 - x0) / n) / sqrt(ph * (1 - ph) * 2 / n)
cat(sprintf("Simulated power at n = %s per arm: %.3f (%d replicates)\n", format(n, big.mark = ","), mean(abs(z) > z_a, na.rm = TRUE), reps))

Output from running the code

100% of observed effect: n per arm = 324 (80% power), 434 (90% power)
 75% of observed effect: n per arm = 587 (80% power), 785 (90% power)
 50% of observed effect: n per arm = 1,341 (80% power), 1,795 (90% power)
power.prop.test: 323.9 
Simulated power at n = 324 per arm: 0.808 (20000 replicates)

The simulation draws many pairs of event counts at the planned sample size and counts how often the two-proportion z-test rejects the null. It should land close to the target power; at very small required sample sizes it can fall below it, because the normal approximation is rough there.

13. Analyses Reported by the Sponsor

MethodEstimate95% CIP-value
Mixed Models AnalysisSlope 1.190.42 to 1.970.003
Mixed Models AnalysisSlope 1.460.68 to 2.24< 0.001
Mixed Models AnalysisSlope 1.110.26 to 1.960.010
Where the two analyses differ, rely on the sponsor's. The simple re-calculation above reaches a different conclusion from the sponsor's analysis, usually because the sponsor adjusts for covariates, stratification or repeated measures, or (for event rates) uses a negative binomial model that allows for over-dispersion and so gives wider intervals.

The registry includes sponsor-reported Mixed Models Analysis results as slopes, with 95% confidence intervals and p-values. The listed results are 1.19 (0.42 to 1.97), p = 0.003, for Personal Risk + Loss Protection and Personal Risk + Lottery Incentive; 1.46 (0.68 to 2.24), p < 0.001, for Personal Risk + Lottery Incentive and Family Risk + Loss Protection; and 1.11 (0.26 to 1.96), p = 0.01, for Personal Risk + Lottery Incentive and Family Risk + Lottery Incentive. Each is labeled a superiority analysis.

The simple recalculations use the posted event counts and denominators to estimate unadjusted risk differences against Personal Risk + Loss Protection. They are not necessarily the same estimand or model as the sponsor’s mixed-model contrasts. The registry record does not explain the slope scale or give the model specification needed to reconcile the estimates.

Because the record flags a discrepancy, the sponsor’s own analysis takes precedence as the trial’s reported analysis. The recalculations remain useful for describing the arm counts and showing what an unadjusted risk-difference comparison yields, but they should not be presented as a correction to or replacement for the sponsor’s analysis. The registry record does not report enough detail to determine the source of the discrepancy.

14. Multiplicity, Missing Data and Analysis Populations

The registry lists 12 analyses and 2 outcome measures, and identifies Social and Behavioral Determinants of Antibody Testing as a secondary outcome. It also reports three mixed-model comparisons and three unadjusted recalculations against the reference arm. Multiple outcomes and comparisons create a multiplicity issue: when many hypotheses are examined, the chance of finding at least one apparently notable result can increase even if no underlying differences exist. General: adjustment methods can address this issue, but they may alter the interpretation of individual p-values and confidence intervals.

The registry record does not report whether the sponsor prespecified a hierarchy of comparisons, adjusted for multiplicity, or treated the analyses as exploratory. It does not report a statistical analysis plan or explain how the 12 analyses relate to the 2 outcome measures. The unadjusted recalculated p-values should therefore be understood as unadjusted; no family-wise or false-discovery control can be inferred. The mixed-model p-values should likewise not be assumed to have multiplicity control when none is described.

Missing-data handling is also not reported in the registry record. The endpoint population is described as participants who attended Time 1 antibody testing, but the record does not describe how missing Time 2 attendance was classified, whether any participants were excluded from the endpoint analysis, or how incomplete follow-up was addressed. The listed arm denominators do not by themselves explain losses between testing occasions or the disposition of all enrolled participants.

The record does not report the analysis populations for each of the sponsor’s mixed-model comparisons, whether analyses followed intention-to-treat principles, or whether participants were analyzed according to assigned combinations regardless of intervention exposure. It also does not report prespecified subgroup analyses, the factorial main-effect and interaction analyses, or handling of protocol deviations. These omissions limit assessment of selective reporting and reproducibility. The registry’s completion status and posted outcome numbers do not substitute for a detailed account of analysis decisions.

15. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

ArmParticipants with serious adverse eventsParticipants at riskPercentage
Personal Risk + Loss Protection06260.0%
Personal Risk + Lottery Incentive05500.0%
Family Risk + Loss Protection05390.0%
Family Risk + Lottery Incentive04490.0%

Deaths

ArmDeaths (participants affected of at risk)
Personal Risk + Loss Protection0 of 626
Personal Risk + Lottery Incentive0 of 550
Family Risk + Loss Protection0 of 539
Family Risk + Lottery Incentive0 of 449

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 0% reporting threshold.

ArmParticipants affected of at risk
Personal Risk + Loss Protection0 of 626
Personal Risk + Lottery Incentive0 of 550
Family Risk + Loss Protection0 of 539
Family Risk + Lottery Incentive0 of 449
Do not overextend the safety comparison. Serious-adverse-event counts are safety observations, not efficacy outcomes, and should not be combined with the primary result into a single benefit-risk number.

The registry reports serious adverse events and other adverse events by group. For Personal Risk + Loss Protection, 626 were at risk and 0 were affected by serious adverse events; 626 were at risk and 0 were affected by other adverse events; deaths were 0. For Personal Risk + Lottery Incentive, the corresponding figures were 550 at risk, 0 serious, 550 at risk, 0 other, and 0 deaths. For Family Risk + Loss Protection, they were 539 at risk, 0 serious, 539 at risk, 0 other, and 0 deaths. For Family Risk + Lottery Incentive, they were 449 at risk, 0 serious, 449 at risk, 0 other, and 0 deaths.

These are the adverse-event figures reported in the registry record. They describe the listed risk denominators and reported affected counts; they do not establish that no events occurred outside the categories or observation periods captured by the record. The registry does not list serious adverse event terms and does not provide further detail about event collection, follow-up duration, or ascertainment. The record reports 0 deaths in each group. These figures should be read as safety reporting, not as evidence about the primary attendance endpoint or a general conclusion about safety.

16. What the Result Does, and Does Not, Mean

The primary outcome addresses whether participants who attended Time 1 testing returned for a Time 2 SARS-CoV-2 antibody test. The posted arm counts show that attendance varied across the four message-and-incentive combinations. The unadjusted recalculation found a negative risk difference for Personal Risk + Lottery Incentive relative to Personal Risk + Loss Protection, while the confidence intervals for Family Risk + Loss Protection and Family Risk + Lottery Incentive relative to that reference include zero. These are descriptions of the posted attendance data and their uncertainty, not conclusions about antibody status or infection.

The registry also reports mixed-model slopes for three comparisons, each labeled as a superiority analysis. Because the record does not explain what the slope represents or specify the model, those results cannot be translated confidently into absolute attendance differences. The flagged discrepancy means the sponsor’s own analysis takes precedence over the simple recalculations as the trial’s reported analysis. The two kinds of estimates should remain distinct rather than being blended into a single interpretation.

The study is about behavioral approaches to repeat testing in disadvantaged communities. Its endpoint is participation in testing, not the accuracy of antibody tests, the presence of antibodies, immunity, infection risk, or health outcomes. The registry’s brief summary describes potential reasons why repeated testing may be of interest, but the posted primary endpoint does not measure those broader consequences.

Statistical uncertainty and reporting gaps matter. The registry record does not report the full analysis plan, multiplicity handling, missing-data methods, or sufficient detail to interpret the mixed-model slope. Those omissions make it difficult to assess the robustness of the inferential results independently. The record does not support a general claim that a particular behavioral component will reliably increase repeat testing in other settings. It describes the registered trial’s attendance endpoint and reported analyses, with the limits noted above.

17. Why This Trial Matters Statistically

This trial raises a useful statistical question about how behaviorally framed messages and incentives can be evaluated when the outcome is participation rather than a biological measurement. Repeat-test attendance is a binary event that can be described with counts, proportions, and absolute differences. Showing those quantities alongside uncertainty helps distinguish the observed pattern from the precision with which it is estimated.

The factorial label also highlights the importance of separating comparisons between combinations from estimates of component effects. Comparing Personal Risk + Loss Protection with Family Risk + Lottery Incentive changes both message framing and incentive type at once. A difference between such combinations cannot by itself isolate the contribution of either component. The registry record does not report the factorial main-effect or interaction analysis, so the component-level question remains unresolved in the posted information.

The record also illustrates why the analysis scale and model description matter. The recalculated risk differences are readily interpretable as absolute contrasts in attendance proportions, while the sponsor’s mixed-model slopes are not interpretable on that scale without a parameter definition. The discrepancy between the recalculations and sponsor analysis makes transparent reporting especially important: readers need enough information to understand the outcome, contrast, model, and analysis population.

Finally, planning illustrations based on an observed effect should be read cautiously. They show how required per-arm enrollment changes under stated assumptions and target effects; they do not recover the original trial’s design rationale. The registry record’s missing details about multiplicity, missing data, and the statistical plan reinforce the value of complete methods reporting for behavioral trials.

18. Limitations

Several limitations specific to this trial follow from the registry record. First, the primary endpoint is attendance among participants who attended Time 1 testing. It therefore does not describe uptake among people who did not attend the initial test, and it cannot establish whether the interventions affected antibody results or health outcomes. The record does not explain how Time 2 nonattendance or missing attendance information was handled.

Second, the registered factorial structure includes combinations of messaging and incentives, but the registry record does not report analyses that separate the component effects or assess interaction. Contrasts between combinations may change both components at once. Without a reported factorial analysis, it is not possible to attribute any observed contrast to one component alone.

Third, the study was unmasked, and the interventions were behavioral. The registry record does not describe how messages and incentives were delivered, whether delivery was consistent, or whether intervention exposure was measured. These details would help readers understand how closely the tested approaches corresponded to the registered intervention labels.

Fourth, the record does not provide a full statistical analysis plan, the mixed-model specification, the meaning of the slope parameter, multiplicity procedures, or the handling of missing data. It also does not report subgroup methods or a complete participant-flow account. The discrepancy between the recalculated count-based contrasts and sponsor analysis cannot be resolved from the registry record.

Finally, the title identifies disadvantaged communities, but the registry record does not give enough population detail to evaluate how broadly the findings may apply. The available results concern attendance for repeat antibody testing in the registered study, rather than testing behavior in every community or setting.

19. Related Tutorials

20. Related Statistical Calculators

21. Sources

Continue through the Clinical Biostats statistical pathway

Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.

22. Record Summary

NCT04901624 is a completed randomized factorial study sponsored by the University of Southern California, with no masking. It lists enrollment of 2164 and investigates behavioral approaches to repeat SARS-CoV-2 antibody testing in disadvantaged communities. The primary endpoint is attendance at Time 2 testing over 6 months among participants who attended Time 1 testing.

The four listed combinations pair Personal Risk or Family Risk messaging with Loss Protection or a Lottery Incentive. The posted arm counts support unadjusted risk-difference recalculations, while the registry separately reports three mixed-model slope analyses. The record flags a discrepancy, so the sponsor’s own analysis takes precedence as the trial’s reported analysis. The slope scale and model details are not reported in the registry record.

The record also lists Social and Behavioral Determinants of Antibody Testing as a secondary outcome. Details about multiplicity, missing data, the original sample-size assumptions, and the full analysis plan are not reported in the registry record.

Clinical Biostats