Effect of Dose, Safety, Tolerability of a New Smallpox Vaccine in Adults Without Previous Smallpox Vaccination: Complete Statistical Analysis

1. Trial at a Glance

This page covers the registry results for Effect of Dose, Safety, Tolerability of a New Smallpox Vaccine in Adults Without Previous Smallpox Vaccination (NCT00053495), a randomized phase 2 study. The primary outcome is Number of Participants Reporting Adverse Events of Severe Intensity Post-vaccination With ACAM2000 or Dryvax® Smallpox Vaccine.

2. Clinical Question

3. Trial Design

This was a phase 2, randomized, parallel-group trial with quadruple masking. It enrolled 353 participants and is recorded as completed. The trial concerned adults without previous smallpox vaccination and compared four ACAM2000 dose groups with a Dryvax group. Each arm description specifies a single dose on Day 0. The record gives the vaccine concentrations for the groups but does not report the allocation ratio or the roles included in quadruple masking.

The primary outcome was the number of participants reporting adverse events of severe intensity during Days 0 to 30 post-vaccination. The primary outcome population is described as the safety, intent-to-treat population. The registry record also lists eight outcome measures, but the primary outcome is the safety measure. The registry record does not report a statistical analysis for the primary outcome, and the posted results contain no analyses.

The trial began in 2003-01, with primary completion in 2003-06. Its stated purpose was to examine safety and effectiveness of a vaccine for smallpox prevention; however, the primary endpoint details concern adverse-event severity. The registry record does not report a sample-size justification, a detailed statistical analysis plan, or interim analyses. It also does not specify the sequence-generation or concealment procedures used for randomization. These omissions limit how fully the design can be reconstructed from the registry information alone.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Before assignment: A total of 353 participants who met the inclusion and exclusion criteria were enrolled and vaccinated.

Overall Study

Analysis population for the primary outcome, as defined in the registry: Adverse events were assessed in the safety, intent-to-treat population

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

6. Primary Endpoint

The registry lists the primary outcome as Number of Participants Reporting Adverse Events of Severe Intensity Post-vaccination With ACAM2000 or Dryvax® Smallpox Vaccine, measured over Days 0 to 30 post-vaccination.

The primary endpoint is the number of participants who reported an adverse event classified as severe in intensity during Days 0 to 30 post-vaccination. It is a participant count, rather than a count of every event: a participant reporting more than one event would still be counted as a participant with an event for this outcome. The registry description says adverse events were assessed in the safety, intent-to-treat population.

The classification concerns the impact of symptoms. “Severe” means incapacitating, with inability to work or perform usual activity. By contrast, “moderate” means discomfort that interferes with usual activity, while “mild” means awareness of signs or symptoms that are easily tolerated. “None” means no symptom. These definitions distinguish severity of experience from whether an event meets a separate seriousness criterion.

Counting participants with severe events gives a straightforward way to describe a safety outcome across the randomized groups. It focuses on the occurrence of events reaching the most disruptive severity category during the stated follow-up period. It does not, by itself, describe the full range of adverse events, their duration, their causal relationship to vaccination, or the balance of benefits and harms. The registry record does not report a formal comparison or uncertainty interval for this endpoint.

7. Why No Re-analysis Is Shown

8. Statistical Interpretation

9. Statistical Methods Explained

General explanation: a participant count is a direct summary of how many people met an outcome definition. For a safety endpoint, the denominator is important because the same count can have a different meaning in groups of different sizes. The registry results give the number at risk and the number affected for each arm, allowing the severe-event counts to be read alongside their group sizes. The counts remain descriptive unless accompanied by a stated comparison method and an uncertainty estimate.

What does a confidence interval add?

General explanation: a confidence interval expresses the statistical uncertainty around an estimated quantity, such as a difference in event frequency between groups. A narrow interval indicates greater precision than a wide interval, while an interval spanning values compatible with different conclusions may leave the comparison uncertain. The registry record does not report confidence intervals for the primary outcome, so the precision of any between-group contrast cannot be assessed from the posted results.

Why is a formal comparison needed?

General explanation: observed counts can differ between randomized groups even when the underlying event tendencies are similar, because participant outcomes vary by chance. A formal comparison defines which groups are being contrasted and estimates the size and uncertainty of that contrast. The registry record does not report such a primary-outcome analysis. It also does not report an adjustment strategy or a statistical model for comparing the five groups. The listed counts therefore should not be converted into a claim that a dose or vaccine differs from another.

What does the planning illustration represent?

General explanation: sample-size planning estimates how many participants might be needed to detect a specified effect under stated assumptions. The planning illustration associated with these results uses a two-sided significance level of 0.05, equal allocation between two arms, and a normal approximation. Its target effect is a stated fraction of the observed effect. For non-time-to-event outcomes, the reported planning quantity is participants per arm; time-to-event planning quantities refer to the total number of events.

Such an illustration is not the trial’s observed power and should not be confused with the design actually used. It is calculated from an observed effect and selected assumptions, whereas a prospective design justification would document the effect targeted before the trial and the rationale for that choice. The registry record does not report the trial’s own sample-size justification. In addition, the primary outcome is not reduced to one comparison, so a single observed contrast is not specified in the registry information as the basis for interpreting this endpoint.

Why can over-dispersion matter?

General explanation: for outcomes recorded as counts, some statistical models assume that variation follows a particular pattern. Over-dispersion occurs when the observed variation exceeds what a model assumes. If it is ignored, standard errors can be too small and confidence intervals too narrow. This concept is relevant to some count-based analyses, but the primary endpoint in this trial is a count of participants with an event, and the registry record does not report a model that would allow an assessment of over-dispersion. It would be inappropriate to infer a model choice from the endpoint alone.

For this endpoint, additional analytic details would help clarify how participants with incomplete follow-up were handled, whether the comparison used risk differences, relative measures, or another estimand, and whether dose groups were compared separately or in a prespecified trend. Those details are not reported in the registry record. General statistical principles explain what these choices mean, but they do not establish which choices the investigators made.

10. Multiplicity, Missing Data and Analysis Populations

The registry record lists eight outcome measures and no posted analyses. It does not report how multiplicity was addressed. Multiplicity arises when several outcomes, time points, treatment groups, or statistical comparisons are examined: the chance of at least one apparently notable result can increase as the number of analyses grows. Methods such as prespecifying a limited set of comparisons or adjusting inference can address that issue, but the record does not identify whether any such approach was planned or used.

The primary outcome is recorded as severe-intensity adverse events during Days 0 to 30. The registry information indicates that it has several categories or time points and was not reduced to one comparison. No single inferential result is posted. The record does not report a hierarchy of outcomes, a family of comparisons, or an adjustment procedure. A reader therefore cannot determine the intended multiplicity framework from the posted information.

Missing-data handling is also not reported in the registry record. The record identifies the primary outcome population as the safety, intent-to-treat population, but does not say how that population was defined in relation to randomized participants, how incomplete adverse-event reporting was treated, or whether any imputation or sensitivity analyses were used. It is not appropriate to assume that every participant had complete outcome ascertainment simply because group counts are listed.

The registry record does not report whether analyses were adjusted for baseline characteristics, whether any interim analyses were conducted, or whether the statistical plan changed. These omissions mean that the reported counts can be described, but not fully audited as the result of a prespecified inferential procedure.

11. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 5% reporting threshold.

Most frequent serious adverse event terms

Most frequent non-serious adverse event terms

Serious events with the highest arm-level rate: pregnancy not otherwise specified (2.0%).

The severe-intensity adverse-event counts and serious adverse-event information describe different classifications. In the endpoint definition, severe intensity means an event was incapacitating and prevented work or usual activity. Seriousness is a separate safety concept, and a serious event need not be classified as severe in intensity, or vice versa. The registry record lists 1 severe-intensity participant in ACAM2000 Dose 1, 1 in Dose 2, 0 in Dose 3, 1 in Dose 4, and 0 in the Dryvax group.

The serious-event summary lists “Pregnancy Not Otherwise Specified” as a top serious term at 2.0%. The registry information summarized for this analysis does not give the denominator or an arm-specific breakdown for that term. It does not report death counts for the groups. These details should not be inferred from the severe-event counts or from the “other adverse events” counts.

Safety counts are descriptive of what was recorded and do not, by themselves, determine causation. The registry record does not state in the primary outcome description that every event was judged related to vaccination. The number of participants with an event is also not the number of events, since a participant may have reported more than one event. Interpretation should remain tied to the stated definitions and follow-up period.

12. What the Result Does, and Does Not, Mean

The posted results establish that severe-intensity adverse events were recorded in some ACAM2000 groups and were not recorded in the listed Dryvax group or ACAM2000 Dose 3 group during the specified outcome period. Specifically, the counts were 1 participant in Dose 1, 1 in Dose 2, 0 in Dose 3, 1 in Dose 4, and 0 in Dryvax. The counts are accompanied by the numbers at risk in each group. They describe observed participants, not a quantified treatment effect.

They do not establish that one vaccine or dose is safer than another. The registry record does not report a between-group estimate, a confidence interval, or a p-value for the primary endpoint. A zero count in a group does not show that the underlying event risk is zero; it means no participant in that group was recorded with the defined outcome in the posted data. The precision of that observation is not quantified in the registry record.

The data also do not establish vaccine effectiveness against smallpox. Although the study purpose mentions safety and effectiveness, the primary endpoint is adverse-event severity, not prevention of smallpox disease. The registry information does not provide a primary efficacy comparison in the record summarized for this analysis. No treatment recommendation follows from these safety counts.

Finally, the findings apply to the enrolled trial population and the recorded follow-up period. The title identifies adults without previous smallpox vaccination, and the primary outcome window is Days 0 to 30 post-vaccination. The registry record does not provide enough detail to extend the interpretation to other populations, later follow-up, or outcomes not included in the posted results. The main statistical message is therefore limited: counts are available, but comparative uncertainty and broader implications are not established.

13. Why This Trial Matters Statistically

This trial illustrates an important distinction in clinical safety reporting: outcome definitions determine what a count means. Here, the primary endpoint is a participant count for adverse events classified as severe in intensity, not a count of all events and not the separate serious-event classification. Reading these categories as interchangeable would misstate the endpoint.

It also shows why denominators and analysis populations matter. The counts are reported alongside the number at risk in each vaccine group, and the endpoint population is identified as safety, intent-to-treat. Those details give context to the observations. However, without a reported comparison and uncertainty interval, the counts alone cannot support a precise statement about differences among the groups.

The trial has several randomized arms: four ACAM2000 doses and a Dryvax comparator. A multi-group design can address questions about dose as well as a vaccine comparator, but it also creates choices about which contrasts are primary and how multiple comparisons are handled. The registry record does not report those choices or an analysis. That absence is statistically important: a randomized design does not make an unreported comparison prespecified, nor does it remove the need to quantify uncertainty.

The case also demonstrates the difference between design planning and post hoc planning illustrations. An illustration based on an observed effect and stated assumptions does not show that the trial was designed with that target, and it is not observed power. The registry record does not report the trial’s own sample-size justification. Keeping these concepts separate helps readers interpret planning calculations without treating them as trial results.

14. Limitations

• The posted summary statistics are the only data these results rest on; patient-level data, full protocols and statistical analysis plans are not available.
• Recalculated results are simple, unadjusted calculations from posted summaries. They do not replace the sponsor's prespecified analysis.

The registry record gives limited detail for evaluating the trial’s statistical conduct. It identifies randomization, quadruple masking, and a parallel-group model, but does not report the allocation ratio, randomization procedures, or which roles were masked. It also does not report a detailed statistical analysis plan, sample-size justification, interim analyses, or methods for handling missing outcomes.

The primary outcome is specified as a participant count over Days 0 to 30, but no inferential analysis is posted. There are no reported confidence intervals or p-values for the endpoint, and no single comparison is identified for interpretation. The record also does not explain whether or how multiplicity was addressed across the listed outcome measures, groups, or categories. As a result, observed differences cannot be judged for precision or interpreted as formal evidence of a group effect.

The adverse-event data do not include event-level descriptions, attribution to vaccination, duration, or an arm-specific breakdown of the serious-event term. The serious-event summary lists “Pregnancy Not Otherwise Specified” at 2.0%, but its denominator is not reported in the registry record. Death counts are not reported. The “other adverse events” counts are available, but their precise definition is not included in the record information.

Finally, the primary outcome is safety-focused. The study purpose refers to effectiveness, but the primary endpoint details and posted results do not give a comparative smallpox-prevention result. Conclusions should remain within the reported endpoint and follow-up rather than extending to efficacy or outcomes not reported in the registry record.

15. Related Tutorials

16. Related Statistical Calculators

17. Sources

• ClinicalTrials.gov: Effect of Dose, Safety, Tolerability of a New Smallpox Vaccine in Adults Without Previous Smallpox Vaccination — NCT00053495.
• Registry record last updated 2024-03-18; status last verified 2024-03.
• Results first posted 2011-02-11.
• Data retrieved from ClinicalTrials.gov on 2026-11-09.
• Group sizes, means, event counts and sponsor-reported p-values are reproduced as posted. Effect estimates, confidence intervals and p-values not attributed to the sponsor are independently calculated from the posted summary statistics.

18. Record Summary

NCT00053495 is a completed phase 2 randomized, quadruple-masked, parallel-group trial sponsored by Emergent BioSolutions. It enrolled 353 adults without previous smallpox vaccination and compared four single-dose ACAM2000 groups with a single-dose Dryvax group. The trial began in 2003-01, and primary completion was recorded in 2003-06.

The primary endpoint counted participants reporting severe-intensity adverse events during Days 0 to 30 post-vaccination in the safety, intent-to-treat population. The posted group counts were 1 of 51, 1 of 101, 0 of 101, 1 of 51, and 0 of 49, respectively, for ACAM2000 Dose 1, Dose 2, Dose 3, Dose 4, and Dryvax. The registry record does not report an inferential comparison, confidence intervals, p-values, or missing-data methods. It lists eight outcome measures and no posted analyses.