← Clinical Trials
Influenza NA Binary Endpoint NCT02154061

Systems Biology of Flu Vaccine in Healthy Adults With and Without the Use of Antibiotics: Complete Statistical Analysis

This analysis examines a randomized study of inactivated influenza vaccine with or without broad-spectrum antibiotics in healthy adults. It focuses on the day-30 HAI antibody endpoint, its reported comparison, and the limits of the registry record.

Trial start: 2015-04  ·  Enrollment: 33  ·  Sponsor: Emory University
Scope of this record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.

1. Trial at a Glance

This page covers the registry results for Systems Biology of Flu Vaccine in Healthy Adults With and Without the Use of Antibiotics (NCT02154061), a randomized na study. The primary outcome is Number of Participants With Four Fold Rise in HAI Titers or HAI 1:40 and Above in Each Group at D30.

33
Enrollment
NA
2
Arms
In the primary outcome
+0.0 pts
Risk difference
IIV Flu Vaccine
0.0 to 0.0 pts
95% CI
Two-sided
FeatureRegistry value
ClinicalTrials.gov identifierNCT02154061
PhaseNA
ConditionInfluenza
AllocationRandomized
Design modelParallel
MaskingNone (open label)
Enrollment33
Arms in the primary outcome2
Lead sponsorEmory University
Results postedYes

2. Clinical Question

Population

Healthy adults in a randomized study at Emory University. The registry record lists enrollment of 33. The primary-outcome description says the antibiotic arm’s immunologic analysis included 15 participants; one participant received antibiotics but did not receive vaccine because blood could not be drawn on vaccination day. The record describes that participant as part of the safety population, not the immunologic population.

Intervention

Inactivated influenza vaccine (IIV) alongside a broad-spectrum antibiotic regimen. The registry lists metronidazole, neomycin and vancomycin as interventions. Its summary says the antibiotic group began oral antibiotics before vaccination and continued through the day after vaccination. Dose details and how the listed antibiotics were used are not reported in the registry record.

Comparator

IIV without antibiotics. The comparator arm received the seasonal flu vaccine and did not take antibiotics in conjunction with it. The registry lists 17 participants in this arm’s primary-outcome results.

Primary question

At day 30, how many participants in each group had either a fourfold rise in HAI titers or an HAI titer of 1:40 and above? The recorded counts are 15 in the antibiotic-plus-vaccine group and 17 in the vaccine-only group. The registry comparison reports a risk difference of 0.0 and a p-value of 1.0. These are results for the posted endpoint and analyzed groups; they do not by themselves establish how the treatments affect immune response in other populations or settings.

3. Trial Design

The registry describes a randomized, parallel-group study with no masking. It compares IIV given with antibiotics against IIV given without antibiotics. The study is listed as completed, with Emory University as sponsor. The phase is recorded as NA. The registry lists Influenza as the condition.

The brief summary describes the scientific motivation as understanding whether antibiotics change intestinal microorganisms and whether those changes may alter the body’s response to seasonal flu vaccination. The investigators planned to examine blood markers after vaccination. The intervention arm was to receive antibiotics before and after IIV administration; the other arm was to receive IIV without antibiotics. Metronidazole, neomycin and vancomycin appear in the intervention list, but doses, exact drug combinations and treatment assignments are not reported in the registry record.

The registry gives a start date of 2015-04 and a primary completion date of 2017-05-26. It records enrollment of 33; the brief summary says investigators hoped to enroll 50 subjects at Emory. The day-30 primary-outcome results include 15 participants in the antibiotic group and 17 in the vaccine-only group. For the antibiotic group, the outcome description explains that one participant received antibiotics but not vaccine and lacked a blood draw on vaccination day, so she was included in the safety population but not the immunologic population.

Randomization helps create a basis for comparing assigned groups, but the registry does not report sequence generation, allocation concealment, adherence, or other implementation details. With no masking, participants and study personnel were not masked according to the recorded design. The statistical analysis plan and the methods used to analyze the endpoint are not reported in the registry record.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Overall Study

StageIIV Flu Vaccine With AntibioticsIIV Flu Vaccine
STARTED1617
COMPLETED1417
NOT COMPLETED20

Reasons for not completing this period:

ReasonIIV Flu Vaccine With AntibioticsIIV Flu Vaccine
Pregnancy10
enrolled but not vaccinated10

Analysis population for the primary outcome, as defined in the registry: The Overall Number of Participants analyzed for "IIV Flu Vaccine with Antibiotics" is 15, as one participant received antibiotics and did not receive vaccine. The study personnel were unable to draw blood on her at the vaccination day- therefore she was part of the safety population and not the immunogenicity population.

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

CharacteristicUnitIIV Flu Vaccine With AntibioticsIIV Flu VaccineTotal
Participants analysed161733
Age, Categorical: <=18 yearsParticipants000
Age, Categorical: Between 18 and 65 yearsParticipants161733
Age, Categorical: >=65 yearsParticipants000
Sex: Female, Male: FemaleParticipants7916
Sex: Female, Male: MaleParticipants9817
Race (NIH/OMB): American Indian or Alaska NativeParticipants101
Race (NIH/OMB): AsianParticipants011
Race (NIH/OMB): Native Hawaiian or Other Pacific IslanderParticipants000
Race (NIH/OMB): Black or African AmericanParticipants6814
Race (NIH/OMB): WhiteParticipants8816
Race (NIH/OMB): More than one raceParticipants101
Race (NIH/OMB): Unknown or Not ReportedParticipants000
Region of Enrollment: United StatesParticipants161733

6. Primary Endpoint

The registry lists the primary outcome as Number of Participants With Four Fold Rise in HAI Titers or HAI 1:40 and Above in Each Group at D30, measured over At day 30.

ElementRegistry entry
Result typeCount Of Participants
Measure of spreadnot applicable
UnitParticipants
Endpoint classificationBinary Endpoint

The primary endpoint is the number of participants in each group who, at day 30, met either of two HAI antibody criteria: a fourfold rise in HAI titers or an HAI titer of 1:40 and above. HAI refers to the hemagglutination-inhibition antibody test; the registry describes the endpoint as based on immunologic testing of blood samples.

The endpoint combines the two criteria using “or.” A participant meeting either criterion is counted as meeting the endpoint. The results therefore concern a participant count, not the size of each person’s titer change, a continuous antibody measurement, or a clinical influenza outcome. The registry record does not report separate counts for the two component criteria, so it is not possible to tell how many participants qualified by a fourfold rise, by reaching the stated titer threshold, or by both.

Using a blood-based immune marker allows investigators to assess a biological response following vaccination. In general, a prespecified binary endpoint can make a group comparison easier to interpret as the number meeting a defined criterion. However, the registry does not explain why this particular combined endpoint was selected, whether it was prespecified in a protocol, or how it relates to clinical protection. The posted result should therefore be read as an immunologic endpoint result, not as a count of influenza cases prevented or a direct measure of vaccine effectiveness.

7. Results Posted in the Registry

Risk difference: IIV Flu Vaccine

+0.0

95% CI: 0.0 to 0.0 percentage points

Recalculated from the posted summary statistics

Primary outcome by arm, with 95% confidence intervals
Primary outcome by arm with 95% confidence intervals77.682.587.492.397.1102IIV Flu Vaccine With Antibiot… (n=15)IIV Flu Vaccine (n=17)% of participants (95% CI)
Treatment effect versus the control arm
Forest plot of risk difference (percentage points) vs control (95% CI)IIV Flu Vaccine-0.50-0.30-0.100.100.300.50risk difference (percentage points) vs control (95% CI)

8. Statistical Interpretation

Clinical Biostats interpretation

The registry reports 15 participants meeting the primary endpoint in the IIV-with-antibiotics group and 17 in the IIV-only group. Those counts match the respective group sizes listed for the primary outcome. In other words, the posted endpoint count includes every participant in each listed immunologic analysis group. This is a description of the registry result, not evidence that the same pattern would occur in a larger or different population.

The registry comparison reports a risk difference of 0.0, with an interval from 0.0 to 0.0, and a p-value of 1.0. It also reports a risk ratio of 1.0, with an interval from 1.0 to 1.0. In these posted summaries, the two groups have the same reported proportion meeting the endpoint, and the reported comparison does not indicate a difference. The p-value is not the probability that the null hypothesis is true, nor does it show that the groups are biologically identical.

The endpoint is a binary composite: meeting either a fourfold HAI titer rise or an HAI titer of 1:40 and above by day 30. Because the registry does not provide the component counts, the equal overall endpoint counts cannot reveal whether the two groups had similar distributions across the component criteria. Nor do the counts describe the magnitude or timing of antibody responses beyond the stated assessment.

The interval reported for the risk difference has identical lower and upper bounds. The registry does not report the method used to derive that interval or explain why it is collapsed to a single value. It should not be interpreted as proof that there is no uncertainty in the underlying group difference. The same caution applies to the reported risk-ratio interval.

There are no detailed analysis records listed, although a comparison summary is present. The model, handling of missing outcome data, and any adjustment for baseline variables are not reported in the registry record. The study is randomized, but the registry summary alone does not establish the details needed to assess all possible sources of bias. The result is best understood as the posted day-30 comparison in the recorded immunologic groups, with limited information about analysis methods and precision.

9. Statistical Methods Explained

What does a risk difference describe?

In general, a risk difference compares the proportion of participants meeting an outcome in one group with the proportion in another. A value of 0.0 means the posted group proportions are equal according to that summary. Here, the registry reports a risk difference of 0.0 for the day-30 HAI endpoint. The underlying outcome is binary because each participant either meets the combined criterion or does not.

What does the risk ratio describe?

In general, a risk ratio expresses one group’s event proportion relative to the other group’s event proportion. A value of 1.0 indicates equal proportions in the comparison as reported. The registry reports a risk ratio of 1.0, with an interval from 1.0 to 1.0. This is a relative summary of the same endpoint, not a separate clinical outcome. Neither a risk difference nor a risk ratio conveys the antibody-titer values of individual participants.

How should the p-value be read?

In general, a p-value describes how compatible data are with a specified null model, given the assumptions of the test. It is not the probability that a treatment has no effect, and it does not measure the size or clinical importance of an effect. The registry reports p = 1.0 for the comparison. The statistical test, its assumptions, and whether the p-value is adjusted are not reported in the registry record. Therefore, the p-value cannot be fully evaluated from the posted summary alone.

Why do confidence intervals matter?

In general, a confidence interval communicates the range of estimates compatible with a method and the observed data, under its assumptions. It can help readers judge precision and distinguish a narrow estimate from one that leaves substantial uncertainty. The registry’s risk-difference interval is 0.0 to 0.0, and the risk-ratio interval is 1.0 to 1.0. Because the analysis method is not reported and each interval has equal endpoints, these entries do not allow a conventional assessment of sampling uncertainty. They should be described as the values recorded rather than treated as proof of certainty.

What does randomization contribute?

In general, random assignment is intended to make groups comparable with respect to both measured and unmeasured baseline characteristics, on average. This supports causal interpretation when implementation, follow-up, outcome measurement and analysis are also appropriate. The registry labels this study randomized, but does not report the randomization procedure or allocation concealment. It also records no masking. Randomization is a design feature, not a guarantee that every source of bias has been removed.

What can be inferred from a count endpoint?

For a binary endpoint, a count is meaningful only alongside the group denominator and a clear definition of who was analyzed. The registry gives the primary-outcome group sizes and counts, and describes the combined HAI criteria. It does not report separate results for each criterion. The outcome is assessed at day 30; the registry does not describe additional time points for this primary measure or provide individual-level data. The summaries cannot show the spread of antibody responses or identify whether a participant met one criterion or both.

How should planning illustrations be understood?

In general, sample-size calculations depend on assumptions about the effect to detect, the significance level, allocation, and statistical method. The registry’s planning assumptions describe an illustration based on the observed effect, with a two-sided significance level of 0.05, equal allocation, and a normal approximation; the target effect is described as a fraction of the observed effect. Such calculations are planning illustrations, not observed power and not evidence that the study was designed around a specified clinical difference. No particular planning result or protocol-based sample-size justification is reported in the registry record.

What is missing from the analysis description?

The registry lists no detailed analysis records. It does not report the statistical test, model specification, covariate adjustment, missing-data method, handling of protocol deviations, or prespecified analysis plan. Those omissions limit reproducibility and make it difficult to determine whether the comparison was planned in advance or how robust it is to alternative reasonable analytic choices. The posted summaries remain interpretable as registry results, but they do not supply the methodological detail needed for a complete statistical audit.

10. Confidence Intervals and Precision

The group counts are 15 participants meeting the endpoint in the antibiotic-plus-IIV arm and 17 in the IIV-only arm. The corresponding primary-outcome group sizes are 15 and 17. The registry’s comparison summaries report a risk difference of 0.0 and a risk ratio of 1.0, with p = 1.0. These values describe equality in the posted group proportions for this endpoint.

Precision is usually assessed by looking at how much plausible effect estimates vary around the observed estimate. In general, a confidence interval gives a range of values compatible with the data and the procedure used to calculate it. The posted risk-difference interval runs from 0.0 to 0.0; the risk-ratio interval runs from 1.0 to 1.0. Both are collapsed to their point estimates. The method used to construct them is not reported in the registry record, so their statistical behavior cannot be assessed from the record. They should not be read as demonstrating that the true effect is known without uncertainty.

The registry lists an enrollment of 33, while the primary-outcome results give the analyzed group sizes and describe an antibiotic-treated participant who did not receive vaccine and had no blood draw on vaccination day. The record says she was in the safety population but not the immunologic population. Details about any other missing outcome data, reasons for missingness, or sensitivity analyses are not reported. That limits assessment of whether the analysis groups fully represent the randomized participants.

With the available summary, readers can describe the recorded endpoint counts and comparison estimates but cannot determine the range of effects that might be compatible with the study under a fully specified analysis. The absence of reported interval methodology and analysis details is especially important when interpreting the unusually collapsed intervals.

11. Multiplicity, Missing Data and Analysis Populations

The registry lists one primary outcome measure and no secondary outcomes. It also lists no detailed analysis records. The statistical plan for handling multiple comparisons is not reported in the registry record. Although the registry lists one primary outcome, it does not establish whether additional outcomes or analyses were planned outside the posted record. The reported p-value should therefore be interpreted as the registry’s comparison summary, without assuming whether multiplicity was considered.

The primary-outcome description identifies an immunologic analysis group of 15 in the antibiotic arm and 17 in the vaccine-only arm. It states that one participant received antibiotics but did not receive vaccine and had no blood draw on vaccination day; she was included in the safety population and not the immunologic population. The registry record does not report a complete participant flow, the number randomized to each group, or a full account of exclusions from each analysis population.

Methods for handling missing primary-outcome data are not reported. The record does not describe imputation, sensitivity analyses, or how any other missing blood samples would have been handled. It also does not state whether analyses followed randomized assignment or another analysis-population definition. Consequently, readers cannot assess from the record whether missingness could affect the endpoint comparison.

Safety denominators differ from the immunologic group sizes: the adverse-event record lists 16 participants at risk in the antibiotic group and 17 in the vaccine-only group. The outcome description explains the safety inclusion of the participant who lacked the vaccination-day blood draw. Other details about safety-population definitions are not reported. These distinct analysis populations should not be conflated when interpreting efficacy-related and safety counts.

12. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

ArmParticipants with serious adverse eventsParticipants at riskPercentage
IIV Flu Vaccine With Antibiotics0160.0%
IIV Flu Vaccine0170.0%

Deaths

ArmDeaths (participants affected of at risk)
IIV Flu Vaccine With Antibiotics0 of 16
IIV Flu Vaccine0 of 17

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 0% reporting threshold.

ArmParticipants affected of at risk
IIV Flu Vaccine With Antibiotics6 of 16
IIV Flu Vaccine3 of 17

Most frequent non-serious adverse event terms

Event termOrgan systemIIV Flu Vaccine With AntibioticsIIV Flu Vaccine
anemiaBlood and lymphatic system disorders3 of 161 of 17
abdominal painGeneral disorders3 of 160 of 17
thrombocytopeniaBlood and lymphatic system disorders2 of 160 of 17
leukopeniaBlood and lymphatic system disorders1 of 161 of 17
diarrheaGastrointestinal disorders2 of 160 of 17
nauseaGastrointestinal disorders1 of 160 of 17
neutropeniaBlood and lymphatic system disorders1 of 160 of 17
anal itchingSkin and subcutaneous tissue disorders1 of 160 of 17
URIRespiratory, thoracic and mediastinal disorders0 of 161 of 17
Do not overextend the safety comparison. Serious-adverse-event counts are safety observations, not efficacy outcomes, and should not be combined with the primary result into a single benefit-risk number.

The registry reports zero serious adverse events in each group and zero deaths in each group. The serious-event risk sets are 16 participants for IIV with antibiotics and 17 for IIV alone. These are safety figures, not the immunologic analysis denominators. The registry also lists six participants affected by other adverse events in the antibiotic group and three in the vaccine-only group, with risk sets of 16 and 17, respectively.

These counts describe what the registry records; they do not establish that the interventions caused the events or that there were no unrecorded events. The registry does not provide serious adverse-event terms, and the list of top serious terms is empty. It does not report event definitions, severity grading, timing, relationship to treatment, or the method used to collect adverse events. Zero reported serious events should therefore be read as a finding in the posted safety record, not as proof that serious harms are impossible.

Other adverse events are reported separately from serious adverse events. The numbers affected are counts, not percentages, and should be read with their stated risk sets. No statistical comparison or causal analysis of these safety counts is reported in the registry record.

13. What the Result Does, and Does Not, Mean

The posted result answers a narrow question: how many participants in each recorded immunologic group met the combined HAI criterion at day 30? The registry reports 15 of 15 in the antibiotic-plus-vaccine group and 17 of 17 in the vaccine-only group, with a risk difference of 0.0, risk ratio of 1.0 and p = 1.0. This is a description of the primary endpoint as recorded, not a broad conclusion about immune function.

The result does not show whether the antibiotic regimen changed intestinal microorganisms, because no microbiome result is included in the registry record for this endpoint. It does not establish whether antibody titers differed in their actual magnitude, since only the binary combined criterion is reported. Nor does it provide separate counts for a fourfold rise and reaching an HAI titer of 1:40 and above.

The endpoint is an immunologic measure, not a clinical influenza outcome. The posted result does not report influenza infections, vaccine effectiveness, duration of protection, or clinical consequences. It cannot establish that antibiotics do or do not alter protection against influenza. The statistical summary also does not prove the groups are equivalent: the registry does not report a prespecified equivalence margin or a noninferiority framework, and its intervals are collapsed with no stated method.

The study concerns healthy adults and was conducted at Emory University, so the record does not establish applicability to other populations or settings. The study is listed as randomized, but the lack of detail on allocation procedures, analysis methods and missing data constrains interpretation. The accurate conclusion is limited to the recorded endpoint counts and comparison; broader biological or clinical claims are not supported by the posted results alone.

14. Why This Trial Matters Statistically

This study illustrates why endpoint definitions and analysis populations matter in clinical biostatistics. The primary outcome is a combined binary criterion: a fourfold rise in HAI titers or an HAI titer of 1:40 and above at day 30. The combined count makes the result compact, but without component-specific counts it conceals which criterion participants met. That distinction can matter when interpreting the biological response.

The record also makes clear that the population used for immunologic results need not be the same as the safety population. One participant in the antibiotic arm received antibiotics but not vaccine and could not provide a vaccination-day blood sample; the outcome description excludes her from the immunologic population but includes her in safety. Readers need these population details to interpret counts and denominators correctly.

The comparison summaries demonstrate the importance of uncertainty reporting. The registry lists a risk difference of 0.0 and an interval from 0.0 to 0.0, but does not report the interval method. An interval that collapses to the point estimate cannot, without methodological context, be treated as a complete account of uncertainty. Detailed analysis records are also absent, making transparent statistical interpretation harder.

Finally, the registry’s planning assumptions are illustrations based on the observed effect rather than a reported study-design justification. Planning calculations and observed results answer different questions. Clear protocol-level assumptions, analysis methods, missing-data handling and endpoint-component reporting would make the findings easier to evaluate and reproduce.

15. Limitations

The registry record does not report the statistical analysis plan, the test used for the primary comparison, any covariate adjustment, or the method used to calculate the reported intervals. The interval endpoints are identical for both the risk difference and risk ratio, and the record does not explain this. This prevents a complete assessment of uncertainty and the statistical procedure.

The primary outcome combines two HAI criteria, but results for each criterion separately are not reported. The registry also does not provide individual titers, change scores, or information about the distribution of antibody responses. The endpoint is limited to day 30, and no clinical influenza outcome is included in the posted results.

The outcome description notes one participant in the antibiotic arm who received antibiotics but did not receive vaccine and lacked a blood draw on vaccination day. The participant was excluded from the immunologic population and included in safety. A full flow of participants, details for other missing data, and sensitivity analyses are not reported. Allocation concealment, adherence, antibiotic dosing and the specific use of the listed drugs are also not reported.

The study is recorded as randomized and unmasked. The record does not give enough detail to assess randomization implementation or the potential effect of unmasked treatment on other study procedures. Enrollment is listed as 33, while the summary states that investigators hoped to enroll 50 subjects at Emory; no sample-size justification is reported. Together, these limitations mean that the posted comparison is informative as a registry result but does not support detailed judgments about robustness, generalizability, or clinical effect.

16. Related Tutorials

17. Related Statistical Calculators

18. Sources

Continue through the Clinical Biostats statistical pathway

Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.

19. Record Summary

NCT02154061 is a completed randomized, parallel-group, unmasked study sponsored by Emory University. It compared inactivated influenza vaccine with antibiotics against vaccine without antibiotics in healthy adults. The registry lists enrollment of 33 and a primary completion date of 2017-05-26.

The primary endpoint was the number meeting either a fourfold rise in HAI titers or an HAI titer of 1:40 and above at day 30. The registry reports counts of 15 in the antibiotic-plus-vaccine arm and 17 in the vaccine-only arm. The comparison summary reports a risk difference of 0.0, risk ratio of 1.0 and p = 1.0. The stated intervals have identical endpoints; the method is not reported.

The safety record lists zero serious adverse events and zero deaths in each group, and reports other adverse events affecting six participants in the antibiotic group and three in the vaccine-only group. Detailed analysis methods, missing-data procedures and protocol-level statistical plans are not reported in the registry record.

Clinical Biostats