← Clinical Trials
Mosquito-Borne Disease Phase 1 Continuous Endpoint NCT03055000

Safety and Immunogenicity of a First-in-Human Mosquito Saliva Peptide Vaccine: Complete Statistical Analysis

A Phase 1 randomized, double-blind, placebo-controlled study evaluated AGS-v, with and without adjuvant, in healthy volunteers. The posted results include a mean count of grade 3 or higher adverse events and selected cytokine outcomes.

Trial start: 2017-02-15  ·  Enrollment: 49  ·  Sponsor: National Institute of Allergy and Infectious Diseases (NIAID)
Scope of this record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.

1. Trial at a Glance

This page covers the registry results for Safety and Immunogenicity of a First-in-Human Mosquito Saliva Peptide Vaccine (NCT03055000), a randomized phase 1 study. The primary outcome is AEs Grade 3 or Higher.

49
Enrollment
Phase 1
3
Arms
In the primary outcome
n/a
Effect
No re-analysis shown
n/a
95% CI
See limitations
FeatureRegistry value
ClinicalTrials.gov identifierNCT03055000
PhasePhase 1
ConditionMosquito-Borne Disease
AllocationRandomized
Design modelParallel
MaskingQuadruple
Enrollment49
Arms in the primary outcome3
Lead sponsorNational Institute of Allergy and Infectious Diseases (NIAID)
Results postedYes

2. Clinical Question

Population

The study enrolled healthy volunteers. The registry summary describes eligible adults as ages 18-50, and the primary endpoint population is all subjects who received vaccination. Enrollment was 49. The posted results give separate arm-level summaries, but the registry record does not report additional details about the characteristics of participants included in each outcome analysis.

Intervention

One study arm received unadjuvanted AGS-v, and another received AGS-v with the ISA-51 adjuvant. The arm descriptions specify vaccination on Day 0 and Day 21. The vaccine targets proteins in mosquito saliva; the registry summary describes evaluation of safety and immune response, not a clinical disease-prevention outcome.

Comparator

The comparator arm received placebo, described as WFI. The study was randomized and placebo-controlled. The registry record does not report the allocation ratio or further details about how the random sequence was generated or concealed.

Primary question

The primary endpoint was the mean number of grade 3 or higher adverse events identified within 1 year after the two vaccinations. The central descriptive question is how this outcome was reported in each arm among vaccinated subjects. The record also posts cytokine outcomes and other safety information. It does not report a primary statistical comparison between the vaccine arms and placebo, so the arm summaries should not be read as a formal estimate of treatment effect.

3. Trial Design

This was a randomized, double-blind, placebo-controlled, Phase 1 study with a parallel-group model and quadruple masking recorded in the registry. The study is titled as a first-in-human evaluation of AGS-v in healthy volunteers. Its stated focus was safety and immunogenicity, meaning the safety profile and the immune response following vaccination. Enrollment was 49, and the study status is completed. The recorded start date is 2017-02-15 and the primary completion date is 2018-12-28.

Participants were assigned to receive unadjuvanted AGS-v, AGS-v with adjuvant, or placebo. Each arm description specifies two administrations, on Day 0 and Day 21. The registry summary describes monitoring after vaccination, follow-up visits, blood and urine testing, and a later mosquito-feeding visit. It also describes symptom diaries after vaccination. These planned activities provide context for the safety and immune measurements, but the registry record does not report the full visit schedule as an analysis plan or identify which specific visits contributed to every posted outcome.

The primary endpoint timeframe is 1 year after vaccination, with the endpoint described as grade 3 or higher adverse events within 1 year after 2 vaccinations 21 days apart. The listed primary population is all subjects who received vaccination. The record posts results for three arms, but it does not report an allocation ratio, the number randomized to each arm before exclusions, or a detailed account of missing observations and analysis-set construction. Arm-specific counts attached to individual outcomes can differ, so they should be interpreted as the denominators for those posted results rather than treated as a single universal analysis population.

Although randomization and masking can reduce some sources of bias, those design features do not substitute for a reported statistical analysis plan. The registry record does not report the randomization method, masking procedures, or prespecified inferential comparisons. No reported analyses are listed. The posted results are therefore best read as registry-reported arm summaries and exploratory outcome information, not as a complete account of the trial's planned statistical tests.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Overall Study

StageAGS-vAGS-v With AdjuvantPlacebo
STARTED161716
COMPLETED161716
NOT COMPLETED000

Analysis population for the primary outcome, as defined in the registry: All subjects who received vaccination

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

CharacteristicUnitAGS-vAGS-v With AdjuvantPlaceboTotal
Participants analysed16171649
Age, Categorical: <=18 yearsParticipants0000
Age, Categorical: Between 18 and 65 yearsParticipants16171649
Age, Categorical: >=65 yearsParticipants0000
Sex: Female, Male: FemaleParticipants981330
Sex: Female, Male: MaleParticipants79319
Ethnicity (NIH/OMB): Hispanic or LatinoParticipants35210
Ethnicity (NIH/OMB): Not Hispanic or LatinoParticipants13121439
Ethnicity (NIH/OMB): Unknown or Not ReportedParticipants0000
Race (NIH/OMB): American Indian or Alaska NativeParticipants0000
Race (NIH/OMB): AsianParticipants0000
Race (NIH/OMB): Native Hawaiian or Other Pacific IslanderParticipants0000
Race (NIH/OMB): Black or African AmericanParticipants64818
Race (NIH/OMB): WhiteParticipants98623
Race (NIH/OMB): More than one raceParticipants1326
Race (NIH/OMB): Unknown or Not ReportedParticipants0202

6. Primary Endpoint

The registry lists the primary outcome as AEs Grade 3 or Higher, measured over 1 year after vaccination (study duration).

ElementRegistry entry
Result typeMean
Measure of spread95% Confidence Interval
Unitadverse events
Endpoint classificationContinuous Endpoint

The primary endpoint is the mean number of adverse events graded 3 or higher, identified within 1 year after the two vaccinations. Grade 3 or higher describes the event-severity threshold chosen for this endpoint; the registry record does not provide further grading definitions in the result entry. A mean event count summarizes the average number of qualifying events per person in the stated population. It is not the same quantity as the proportion of participants who experienced at least one event: a participant may contribute more than one event to a count, whereas a participant-level proportion classifies each person according to whether an event occurred.

Safety is an important focus in a first-in-human Phase 1 study. Reporting more severe events over a stated follow-up period can describe the observed safety experience while participants receive and are followed after vaccination. However, the endpoint alone does not establish whether an event was caused by vaccination, nor does a group mean reveal the range or timing of individual experiences. The registry record does not report event-level details or a formal comparison for this primary outcome.

The posted arm summaries are means with 95% confidence intervals. A confidence interval conveys uncertainty around an estimated mean under the method used to construct it; it is not a range containing every participant's event count. Because this endpoint is presented as an arm-level mean and not as a reported contrast, the result supports descriptive reading of each arm. It does not by itself supply a precise estimate of how the vaccine compares with placebo.

7. Why No Re-analysis Is Shown

Reported as posted, not recalculated. Values missing or not estimable for a two-arm comparison (continuous endpoint). A result is recalculated only when the posted data support a clean two-arm comparison, so no result is shown beyond what the sponsor posted.

8. Statistical Interpretation

Clinical Biostats interpretation

The primary results report mean counts of grade 3 or higher adverse events of 0.44 for AGS-v, 0.65 for AGS-v With Adjuvant, and 0.63 for Placebo. Their respective 95% confidence intervals are 0.16 to 0.63, 0.23 to 0.93, and 0.22 to 0.89. These values describe the posted arm-level endpoint among subjects who received vaccination. They are not participant-level risks and should not be restated as percentages of people affected.

The confidence intervals overlap across the three arm summaries. This means the displayed estimates are not sharply separated by their reported uncertainty intervals; it is not a substitute for a prespecified statistical comparison. The registry record does not report a primary between-arm estimate, confidence interval for an arm difference, or p-value. Consequently, the posted primary results do not establish a formal comparative effect. A small difference between displayed means should not be treated as evidence of a reliable difference, and the record does not support a conclusion about causation.

For the cytokine outcomes, the registry posts arm means and standard deviations at the stated follow-up point, along with recalculated unadjusted contrasts against placebo. Those contrasts are simple comparisons based on posted summary statistics, rather than analyses reported by the trial investigators. Their confidence intervals are broad in relation to their point estimates, and each crosses zero. The unadjusted p-values are not evidence that a treatment effect has been established, particularly because multiple secondary outcomes and comparisons are present and no multiplicity adjustment is reported. These results are better treated as exploratory signals that could help motivate further study than as confirmatory findings.

The posted cytokine summaries also show that variability differs across arms and outcomes. A mean alone can obscure that variation, while a standard deviation describes dispersion among measurements rather than uncertainty in the mean. This distinction matters when interpreting a small study: imprecise or variable outcomes can yield wide intervals even when arm means differ. The registry record does not provide a reported model or analysis description that would justify a stronger interpretation.

Safety information is also presented separately as serious and other adverse events. No serious adverse events are listed as affecting participants in any arm, while other adverse events are reported for nearly all participants represented in those safety groups. These counts should not be conflated with the primary mean count of grade 3 or higher events: the measures use different summaries and event categories. Nor does the absence of listed serious events establish that serious events cannot occur; the study's size and registry reporting limit what can be inferred.

9. Statistical Methods Explained

The registry reports arm-level means and 95% confidence intervals for the primary endpoint. A mean is the arithmetic average of the measured event counts in the stated analysis population. It summarizes the center of the data, but can conceal differences between participants and does not reveal whether events were concentrated in a few people or distributed across the group. The registry record does not report a distribution of individual counts, a median, or the statistical method used to calculate these confidence intervals.

What does a confidence interval describe?

A confidence interval expresses uncertainty around an estimate. In general, narrower intervals indicate greater precision and wider intervals indicate less precision, conditional on the method's assumptions. A 95% confidence interval is not a guarantee that the true value lies within the displayed limits, and it does not describe the spread of individual observations. For the primary endpoint, the interval is attached to each arm's mean, not to a contrast between arms. A formal comparison would ordinarily require an estimated difference or another defined contrast with its own uncertainty measure; the registry record does not report such a primary comparison.

The secondary cytokine outcomes are continuous measurements reported as means with standard deviations. The standard deviation describes how dispersed individual measurements are around the mean. It is not the standard error, which concerns the precision of an estimated mean, and it is not a confidence interval. Greater variability can make an estimate less precise, particularly when the outcome analysis includes relatively few observations. This is a general statistical principle; it does not establish why a particular cytokine value varied in this study.

How should the recalculated comparisons be read?

For selected secondary outcomes, the posted contrast is a recalculated, unadjusted mean difference between an active arm and placebo. The calculation uses the arm-level summary statistics posted in the registry. It is not identified as an analysis reported by the investigators, and no reported analyses are listed. The contrast's confidence interval indicates uncertainty around that difference under the recalculation; an interval spanning zero is compatible with values on either side of no difference. This does not prove that the groups are identical. It indicates that the posted summaries do not provide a precise distinction from zero at the interval level.

The associated p-values are unadjusted. A p-value measures how incompatible the data are with a specified null model under the assumptions of the analysis; it is not the probability that the null hypothesis is true, nor a measure of clinical importance. The registry record does not report the investigators' model, test, or prespecified threshold for the secondary contrasts. The recalculated values therefore provide a limited descriptive comparison, not a replacement for a full trial analysis. Because several outcomes and arm comparisons are posted, interpreting any one unadjusted p-value without the wider testing context risks overstating chance patterns.

What do the planning illustrations mean?

The planning illustrations use the observed contrast as a starting point and show participant counts per arm for 80% power and 90% power under stated assumptions: a two-sided significance level of 0.05, equal allocation between two arms, and a normal approximation. Rows describe planning for 100%, 75%, or 50% of the observed effect. These are hypothetical design illustrations, not observed results and not evidence that the completed trial had a particular power. Their values depend on the observed effect, which may be unstable in a small study. The registry record does not report that these assumptions were used to design the trial, or that the sample-size illustrations reflect the trial's own design.

More generally, a planning calculation asks how much information a future study might need to detect a chosen effect under assumed conditions. It does not correct limitations in the existing data, and it should not be interpreted as a recommendation for a particular study. If the observed effect is noisy, calculations based on it can be especially uncertain. The sample-size assumptions also specify equal allocation for the two-arm illustrations, while this trial has three arms; the planning exercise is therefore not a reconstruction of the original design.

Why does outcome type matter?

Event counts and continuous cytokine measurements have different data structures. A count may be skewed or contain many low values, and its variability may not follow the assumptions of a simple normal model. Continuous measurements may also be skewed or have unequal variance across groups. In general, over-dispersion occurs when count data vary more than a chosen model expects; accounting for it can affect uncertainty estimates. The registry record does not describe a count model, a transformation, or other distributional checks for the primary endpoint. The posted means and intervals can still be read descriptively, but the missing method details restrict assessment of how well the interval construction reflects the data.

All interpretation should keep the distinction between descriptive summaries, recalculated contrasts, and investigator-reported analyses in view. The record contains arm-level outcome values and selected recalculations, but no reported analyses. It does not report adjustment for baseline values, covariates, repeated measurements, or multiplicity. Those methods should not be assumed. The results are most defensible as a description of what was posted, with inferential conclusions kept cautious where the analysis procedure is not documented.

10. Multiplicity, Missing Data and Analysis Populations

The registry lists multiple secondary outcomes, including cytokine levels and the number of adults developed from 100 eggs. The record does not report a multiplicity adjustment, a prespecified order for testing outcomes, or a distinction between confirmatory and exploratory secondary hypotheses. When many outcomes are examined, the chance of at least one apparently notable result can rise even if the underlying effects are absent. This is a general statistical concern, not a claim that a particular posted finding is false. It is why unadjusted secondary p-values should be interpreted cautiously and in the context of the full set of outcomes.

The registry record does not report a statistical analysis plan, interim analyses, a sample-size justification, or details of any outcome-specific analysis populations beyond the primary population description. It also does not report how missing data were handled, whether any participants were excluded from particular outcome analyses, or whether the analysis followed randomized assignment or vaccination received for each endpoint. The stated primary population is all subjects who received vaccination, while the posted arm denominators vary by outcome. These differences make it important not to assume one common set of participants or one uniform missing-data rule across the results.

Without a reported missing-data approach, it is not possible to judge whether missing measurements could have affected an arm summary or contrast. In general, results may be sensitive to why measurements are absent; methods that rely on different assumptions can produce different estimates. The registry record does not report reasons for missingness or sensitivity analyses. Nor does it report details about the handling of repeated measurements, if applicable to the underlying data. These are limitations in assessing robustness, not grounds to impute a particular result.

The record lists no reported analyses. Therefore, the posted summaries do not establish which tests were prespecified, how the investigators intended to control false-positive findings, or whether the displayed comparisons were part of the original analysis plan. The recalculated unadjusted contrasts can help orient a reader to the arm summaries, but they cannot fill those documentation gaps. Confirmatory interpretation would require a clearly described analysis strategy and complete outcome reporting.

11. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

ArmParticipants with serious adverse eventsParticipants at riskPercentage
AGS-v0160.0%
AGS-v With Adjuvant0170.0%
Placebo0160.0%

Deaths

ArmDeaths (participants affected of at risk)
AGS-v0 of 16
AGS-v With Adjuvant0 of 17
Placebo0 of 16

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 0% reporting threshold.

ArmParticipants affected of at risk
AGS-v16 of 16
AGS-v With Adjuvant17 of 17
Placebo15 of 16

Most frequent non-serious adverse event terms

Event termOrgan systemAGS-vAGS-v With AdjuvantPlacebo
SwellingGeneral disorders15 of 1616 of 1715 of 16
ErythemaSkin and subcutaneous tissue disorders15 of 1615 of 1715 of 16
Injection site painGeneral disorders6 of 169 of 174 of 16
Haemoglobin decreasedInvestigations8 of 166 of 175 of 16
HeadacheNervous system disorders7 of 168 of 174 of 16
FatigueGeneral disorders5 of 168 of 174 of 16
Blood creatine phosphokinase increasedInvestigations3 of 165 of 177 of 16
MyalgiaMusculoskeletal and connective tissue disorders3 of 167 of 175 of 16
Injection site erythemaGeneral disorders3 of 168 of 172 of 16
Injection site swellingGeneral disorders2 of 169 of 171 of 16
Do not overextend the safety comparison. Serious-adverse-event counts are safety observations, not efficacy outcomes, and should not be combined with the primary result into a single benefit-risk number.

The registry's separate safety summary reports zero serious adverse events affecting participants in each arm, with zero deaths recorded in each arm. It also reports other adverse events affecting 16 in the AGS-v group, 17 in the AGS-v With Adjuvant group, and 15 in the Placebo group. These are event-group counts, not the primary endpoint's mean count of grade 3 or higher adverse events. The categories and summaries should not be substituted for one another.

No serious events listed in these groups is a descriptive finding for this study, not proof that serious events are impossible or that the arms have equivalent safety. A small Phase 1 study can describe events observed during its follow-up but has limited ability to characterize uncommon harms. The registry record does not list top serious-event terms, provide individual event narratives, or report a comparative statistical analysis of these safety counts. It also does not establish causality for other adverse events. Interpretation should remain limited to the posted counts and their stated populations.

12. What the Result Does, and Does Not, Mean

The results describe what was recorded in a randomized Phase 1 study of AGS-v, with and without adjuvant, compared with placebo in healthy volunteers. The primary outcome is an arm-level mean count of grade 3 or higher adverse events over the stated follow-up. The posted values and confidence intervals offer a descriptive account of that endpoint, while the separate safety summary reports serious and other adverse events using participant counts.

These entries do not establish whether AGS-v prevents mosquito-borne disease. The study's stated purpose was to assess safety and immune response, and the listed primary endpoint is not a clinical disease outcome. The registry summary describes a possible broader rationale for targeting mosquito saliva proteins, but a rationale is not evidence of clinical benefit. The posted results also do not establish that observed adverse events were caused by vaccination or that any arm is safer than another.

The secondary cytokine outcomes provide immune measurements, but their recalculated comparisons are unadjusted and are not reported investigator analyses. They should not be treated as confirmatory evidence. The absence of a reported primary comparison, multiplicity plan, and missing-data approach limits the strength of inferential conclusions. Likewise, confidence intervals that overlap or contrasts whose intervals cross zero do not demonstrate equivalence; they indicate uncertainty in the available estimates.

In general, a small early-phase study can supply useful descriptive information and help identify questions for further research, but precision and generalizability depend on the data and analysis. The registry record concerns healthy adults in the stated age range and does not provide evidence for other populations. The findings should therefore be understood as registry-reported safety and immunogenicity information from this study, not as a definitive assessment of clinical effectiveness or a basis for individual medical decisions.

13. Why This Trial Matters Statistically

This trial is statistically notable because it places several types of evidence side by side: a mean count for a safety endpoint, participant counts for serious and other adverse events, and continuous cytokine measurements. Those summaries answer different questions. Separating them prevents the common mistake of treating an average event count as a risk percentage, or of using an immune marker as a substitute for a clinical outcome.

The posted primary results also illustrate the difference between an estimate and its precision. Arm means can look distinct while their confidence intervals remain broad and overlapping. Without a reported comparison, the mean values alone cannot establish a between-group effect. The secondary comparisons further illustrate why unadjusted analyses in a collection of outcomes should be regarded as exploratory, especially when no analysis plan or multiplicity strategy is reported.

Planning illustrations can help show how a future study's required size depends on the effect chosen for detection and on assumptions about design and analysis. They do not describe the power of this completed study, and they do not recover a missing sample-size justification. Treating planning estimates as conditional scenarios, rather than as evidence about observed performance, is essential to a sound reading.

Finally, the registry record makes visible an important reporting issue: design labels and outcome values do not replace details of the statistical plan. Information about analysis populations, missing data, prespecified comparisons, and multiplicity is needed to judge how robust an inferential claim would be. This study is useful for learning how early-phase registry findings can be described carefully without overstating what they establish.

14. Limitations

The registry record leaves several trial-specific uncertainties. It does not report the statistical analysis plan, the sample-size justification, randomization procedures, or the detailed masking procedures. Although the study is described as randomized and quadruple-masked, those labels alone do not show how allocation and masking were implemented or maintained.

The primary endpoint is a mean count, but the record does not explain the distribution of individual event counts, the interval calculation method, or any model used. It gives no event-level breakdown for the primary outcome. The separate adverse-event entry does not list serious-event terms, and the registry record does not report a detailed account of event timing, severity grading, or attribution. This limits assessment of the clinical context behind the summaries.

Outcome denominators vary, and the record does not explain the reasons for those differences or how missing observations were handled. It does not identify whether analyses were based on randomized assignment, vaccination received, or another rule for each endpoint. For the secondary outcomes, no investigator-reported analyses are listed, and the recalculated contrasts are unadjusted. The record also does not report a strategy for multiplicity or identify which secondary outcomes were intended to be confirmatory.

Finally, this was a Phase 1 study in healthy volunteers, and the posted results do not include a clinical disease-prevention endpoint. The summaries therefore have limited scope for conclusions about other populations or clinical outcomes. The study's status as completed does not resolve the uncertainty created by missing analysis details. These limitations do not negate the descriptive results; they define how cautiously those results should be interpreted.

15. Related Tutorials

16. Related Statistical Calculators

17. Sources

Continue through the Clinical Biostats statistical pathway

Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.

18. Record Summary

NCT03055000 is a completed randomized, double-blind, placebo-controlled, Phase 1 study of AGS-v in healthy volunteers. It compared unadjuvanted AGS-v, AGS-v with adjuvant, and placebo, with the arm descriptions specifying vaccinations on Day 0 and Day 21. The primary endpoint was the mean number of grade 3 or higher adverse events within 1 year after vaccination, among all subjects who received vaccination.

The registry posts arm-level primary summaries, separate adverse-event counts, and selected secondary outcomes, including cytokine measurements. It does not list investigator-reported analyses or provide a primary between-arm comparison. Recalculated secondary contrasts are unadjusted and exploratory. Missing-data handling, multiplicity procedures, and the statistical analysis plan are not reported in the registry record. The findings are therefore most appropriately read as descriptive safety and immunogenicity information, with substantial limits on confirmatory interpretation.

Clinical Biostats