← Clinical Trials
High-Risk Melanoma Phase 2 Binary Endpoint NCT00273910

Evaluation of the Impact of Adjuvants Accompanying Peptide Immunization in High-Risk Melanoma: Complete Statistical Analysis

This randomized phase 2 trial compared six preparations of the gp100 melanoma peptide vaccine, varying the injection vehicle, route, and use of imiquimod. The posted primary results count immunologic responses, but response data are not available for all patients and the reported comparisons are imprecise.

Trial start: 2006-01  ·  Enrollment: 104  ·  Sponsor: National Cancer Institute (NCI)
Scope of this record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.

1. Trial at a Glance

This page covers the registry results for Evaluation of the Impact of Adjuvants Accompanying Peptide Immunization in High-Risk Melanoma (NCT00273910), a randomized phase 2 study. The primary outcome is Immunologic Response Rate.

104
Enrollment
Phase 2
6
Arms
In the primary outcome
-14.3 pts
Risk difference
Adj-3 A2 gp209(2M) in IFA SQ + Imiquimod
-32.6 to 4.0 pts
95% CI
Two-sided
FeatureRegistry value
ClinicalTrials.gov identifierNCT00273910
PhasePhase 2
ConditionHigh-Risk Melanoma
AllocationRandomized
Design modelParallel
MaskingNone (open label)
Enrollment104
Arms in the primary outcome6
Lead sponsorNational Cancer Institute (NCI)
Results postedYes

2. Clinical Question

Population

The study concerned people at risk of melanoma recurrence after confirmed melanoma had been surgically removed. Eligibility described in the registry included age 16 and older and the HLA-A2 tissue type. The condition is listed as high-risk melanoma; further eligibility details are not reported in the registry record.

Intervention

The study evaluated gp100:209-217 (210M), a melanoma antigen peptide, in different preparations. Some regimens used Montanide ISA-51 by subcutaneous injection, while others used saline by intradermal injection. Imiquimod was added in some arms and applied at the injection site.

Comparator

The posted comparative estimates use gp100 in Montanide ISA-51 by subcutaneous injection, identified as the vortex preparation, as the reference arm. The other preparations vary the vehicle, route, imiquimod use, or syringe preparation. Allocation proportions are not reported in the registry record.

Primary question

The primary outcome asks how many participants in each preparation had evidence of immunization, defined as at least 10 Elispots/100,000 cells above background. An injection site reaction did not count as an immune response. The registry aimed to compare preparations as candidates for future immunization research, not to measure melanoma recurrence.

3. Trial Design

This was a randomized, phase 2, parallel-group study with no masking. The registry lists an enrollment of 104 and a completed status. The brief summary described enrollment of up to 132 participants; the registry does not explain the distinction between that planned figure and the recorded enrollment.

The study compared six preparations of gp100:209-217 (210M). Montanide-containing regimens used subcutaneous injection; saline-containing regimens used intradermal injection. Imiquimod was applied to the skin at the injection site in some regimens. The arm descriptions specify injection on day one every three weeks, for twelve cycles over 33 weeks. Where included, imiquimod was applied daily for 5 days following injection. The registry lists vortex and two-syringe versions of some Montanide regimens.

The primary outcome timeframe is 48 months. The stated endpoint is the number of participants meeting an immunologic response threshold, not a time-to-event measure. The posted arm counts are 14 participants with 2 responses for the vortex Montanide comparator; 10 with 0 for vortex Montanide plus imiquimod; 12 with 0 for saline; 15 with 3 for saline plus imiquimod; 5 with 1 for the two-syringe Montanide preparation; and 5 with 0 for the two-syringe Montanide preparation plus imiquimod.

The sponsor is the National Cancer Institute (NCI). The registry records a start of 2006-01 and primary completion in 2010-05. Further details about randomization procedures, allocation concealment, or protocol amendments are not reported in the registry record.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Overall Study

StageAdj-3 A2 gp209(2M) in IFA SQ (Vortex)Adj-3 A2 gp209(2M) in IFA SQ + Imiquimod (Vortex)Adj-3 A2 gp209(2M) in Saline IDAdj-3 A2 gp209(2M) in Saline ID + ImiquimodAdj-3 A2 gp209(2M) in IFA SQ (2 Syringe)Adj-3 A2 gp209(2M) in IFA SQ + Imiquimod (2 Syringe)
STARTED191918191514
COMPLETED191918191514
NOT COMPLETED000000

Analysis population for the primary outcome, as defined in the registry: The number of participants analyzed and results are correct. We do not have the immunologic response rate data for all patients.

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

Only the first 6 of 7 groups are shown.

CharacteristicUnitAdj-3 A2 gp209(2M) in IFA SQ (Vortex)Adj-3 A2 gp209(2M) in IFA SQ + Imiquimod (Vortex)Adj-3 A2 gp209(2M) in Saline IDAdj-3 A2 gp209(2M) in Saline ID + ImiquimodAdj-3 A2 gp209(2M) in IFA SQ (2 Syringe)Adj-3 A2 gp209(2M) in IFA SQ + Imiquimod (2 Syringe)
Participants analysed191918191514
Age, Categorical: <=18 yearsParticipants000000
Age, Categorical: Between 18 and 65 yearsParticipants191918191314
Age, Categorical: >=65 yearsParticipants000020
Age Continuousyears46.9 (SD 9.1)42.8 (SD 10.4)48.8 (SD 12.7)48.1 (SD 10.2)51.7 (SD 13.2)47.7 (SD 8.3)
Sex: Female, Male: FemaleParticipants699634
Sex: Female, Male: MaleParticipants13109131210
Race/Ethnicity, Customized: American Indian or Alaskan NativesParticipants000000
Race/Ethnicity, Customized: Asian or Pacific IslanderParticipants100000
Race/Ethnicity, Customized: Native HawaiianParticipants000000
Race/Ethnicity, Customized: Black of non-Hispanic OriginParticipants000000
Race/Ethnicity, Customized: HispanicParticipants000000
Race/Ethnicity, Customized: White of non-Hispanic OriginParticipants181918191514
Race/Ethnicity, Customized: Other or UnknownParticipants000000
Region of Enrollment: United Statesparticipants191918191514

6. Primary Endpoint

The registry lists the primary outcome as Immunologic Response Rate, measured over 48 months.

ElementRegistry entry
Result typeNumber
Measure of spreadnot applicable
UnitParticipants
Endpoint classificationBinary Endpoint

The primary endpoint is the number of participants with an immunologic response to the assigned gp100 preparation. The registry defines evidence of immunization as at least 10 Elispots/100,000 cells above background. An injection site reaction is specifically excluded from the definition, so a local reaction alone does not satisfy the endpoint.

This endpoint is used to compare whether the different vaccine preparations prompt a measurable immune response. The registry states that the preparation with the greater number of immunologic responses would be the one most likely to be selected for future study on the basis of immunization alone. That makes the outcome an immune-response measure, rather than a direct measure of melanoma recurrence, survival, or clinical benefit.

The outcome timeframe is 48 months. Arm-level counts are posted, but the registry also says immunologic response-rate data are not available for all patients. The endpoint description says the number analyzed and results are correct; eligibility for analysis, the handling of unavailable results, and the timing of response assessments are not reported in the registry record.

7. Results Posted in the Registry

Risk difference: Adj-3 A2 gp209(2M) in IFA SQ + Imiquimod (Vortex)

-14.3

95% CI: -32.6 to 4.0 percentage points

Recalculated from the posted summary statistics

Primary outcome by arm, with 95% confidence intervals
Primary outcome by arm with 95% confidence intervals0.013.727.541.255.068.7Adj-3 A2 gp209(2M) in IFA SQ … (n=14)Adj-3 A2 gp209(2M) in IFA SQ … (n=10)Adj-3 A2 gp209(2M) in Saline … (n=12)Adj-3 A2 gp209(2M) in Saline … (n=15)Adj-3 A2 gp209(2M) in IFA SQ … (n=5)Adj-3 A2 gp209(2M) in IFA SQ … (n=5)% of participants (95% CI)
Treatment effect versus the control arm
Forest plot of risk difference (percentage points) vs control (95% CI)Adj-3 A2 gp209(2M) in IFA SQ …Adj-3 A2 gp209(2M) in Saline …Adj-3 A2 gp209(2M) in Saline …-38-23-7.417.822338risk difference (percentage points) vs control (95% CI)

8. Statistical Interpretation

Clinical Biostats interpretation

The comparator arm recorded 2 immunologic responses among 14 participants. The three posted comparisons against that arm report risk differences of -0.143 for vortex Montanide plus imiquimod, -0.143 for saline, and 0.057 for saline plus imiquimod. The corresponding confidence intervals are -0.326 to 0.040, -0.326 to 0.040, and -0.216 to 0.330. Each interval includes zero, so the posted estimates are compatible with no difference as well as with differences in either direction.

The unadjusted p-values for those comparisons are 0.212, 0.173, and 0.684, respectively. These values do not establish that the preparations are equivalent or that one preparation is better. Rather, the observed response counts are sparse and the estimates have considerable uncertainty. The posted comparison for saline plus imiquimod also reports a risk ratio of 1.4 with a confidence interval from 0.273 to 7.176, and an odds ratio of 1.5 with a confidence interval from 0.211 to 10.65. Both ranges are broad and include values consistent with no relative difference.

Across the six listed preparations, the observed response counts range from 0 to 3, and the arm sizes range from 5 to 15. Those small arm-level counts limit how precisely the response pattern can be characterized. The posted comparative estimates cover only three arms against the vortex Montanide comparator; comparative estimates are not reported for the two-syringe preparations.

Interpretation is further limited because response data are not available for all patients. The posted counts describe the analyzed participants, but the registry does not explain how unavailable response results were handled or whether missingness differed across preparations. The primary outcome is immunologic, not recurrence. These results therefore describe the recorded immune-response counts and their uncertainty, rather than establishing an effect on melanoma outcomes.

9. Statistical Methods Explained

What does a risk difference describe?

General statistical explanation: A risk difference compares the proportion with an event in one arm with the proportion in a reference arm. A value below zero indicates fewer observed events in the comparison arm; a value above zero indicates more. In this study, the event is meeting the immunologic response definition. Risk differences are reported for three comparisons with the vortex Montanide preparation. Their estimates are -0.143, -0.143, and 0.057. These are unadjusted comparisons based on the posted arm summaries, not evidence that the treatment preparations are interchangeable.

How should confidence intervals be read?

General statistical explanation: A confidence interval represents uncertainty around an estimate under the statistical method used. A wide interval means the estimate is not precise; an interval spanning the no-difference value leaves a range of possibilities that includes no difference. Here, all three risk-difference intervals include zero. The intervals are wide relative to their point estimates, consistent with limited precision in these small arm-level samples. The registry does not report the method used to construct the comparative confidence intervals.

What do the p-values add?

General statistical explanation: A p-value measures how incompatible the observed data are with a specified null model, under assumptions of the analysis. It is not the probability that the null hypothesis is true, and it does not measure the size or clinical importance of a difference. The unadjusted p-values are 0.212, 0.173, and 0.684. The analysis plan, test used, and any prespecified threshold for interpreting these comparisons are not reported in the registry record. The 0.05 significance level appears in the planning illustration, not as a reported analysis-plan threshold.

What do the relative measures mean?

General statistical explanation: A risk ratio compares event proportions as a ratio; an odds ratio compares the odds of the event. These measures express the contrast differently from an absolute risk difference and can be especially unstable when event counts are sparse. For saline plus imiquimod versus the reference arm, the posted risk ratio is 1.4, with an interval from 0.273 to 7.176; the odds ratio is 1.5, with an interval from 0.211 to 10.65. Their breadth reflects substantial uncertainty. No relative estimates are posted for the other comparisons.

How do the planning figures differ from trial results?

The planning illustration applies assumptions to the observed effect for the saline-plus-imiquimod comparison. It specifies a two-sided significance level of 0.05, equal allocation between the two arms, and a normal approximation. For planning at 100% of the observed effect, it gives 682 participants per arm for 80% power and 913 participants per arm for 90% power. At 75% of the observed effect, the corresponding figures are 1,173 and 1,569 participants per arm. At 50% of the observed effect, they are 2,546 and 3,408 participants per arm. These are planning illustrations, not observed power, trial enrollment targets, or observed outcomes. They are not a reconstruction of the trial's original design; the registry does not report the original sample-size justification.

In general, over-dispersion means that outcome variability exceeds what a chosen statistical model expects. Accounting for it can affect uncertainty estimates and required sample sizes. The registry record does not identify an over-dispersion model or report an analysis method that would require interpreting one. More broadly, the statistical test, confidence-interval construction, covariate adjustment, and analysis population definitions are not reported in the registry record, so the comparative findings should be read as posted summaries rather than as a fully documented statistical analysis.

10. Confidence Intervals and Precision

The response counts are low in each arm, and the analyzed arm sizes range from 5 to 15. A small number of outcomes makes each estimate sensitive to individual observations and leaves substantial uncertainty about the underlying response patterns. The point estimates alone should therefore not be read as stable rankings of the preparations.

For the three comparisons with the vortex Montanide reference, the risk-difference intervals are -0.326 to 0.040, -0.326 to 0.040, and -0.216 to 0.330. Each contains zero and also spans values on both sides of zero. The results do not precisely distinguish a lower response proportion from a higher one. The exact confidence level and construction method are not reported in the registry record.

The relative estimates for saline plus imiquimod are also imprecise: the risk ratio is 1.4 with an interval from 0.273 to 7.176, while the odds ratio is 1.5 with an interval from 0.211 to 10.65. Both intervals cover a wide range of possible relative associations, including values in either direction around no relative difference.

There are no comparative confidence intervals posted for the two-syringe preparations. In addition, the registry states that response data are unavailable for all patients. Without details on the amount, pattern, and handling of missing response information, precision based on analyzed participants may not capture all uncertainty relevant to the full study population. Overall, the results support only a cautious description of observed counts; they do not provide a precise ordering of all preparations.

11. Multiplicity, Missing Data and Analysis Populations

The study compares six preparations, creating the possibility of multiple pairwise questions. The registry posts comparative estimates for three preparations versus the vortex Montanide reference. Estimates for the two-syringe preparations are not reported. The registry record does not report whether other comparisons were planned, whether the posted comparisons were prespecified, or whether any adjustment for multiple testing was used. The p-values are explicitly unadjusted, so they should not be treated as accounting for the full set of possible comparisons.

The registry identifies the number analyzed and results as correct, but also states that immunologic response-rate data are not available for all patients. This means the posted outcome data do not cover every patient for whom response information would be relevant. The number with unavailable outcome data by arm, the reasons for missingness, the method used to handle missing data, and any sensitivity analyses are not reported in the registry record.

Enrollment in the registry is listed as 104, while the brief summary describes enrollment of up to 132 participants. The record does not explain the relationship between these figures. The arm-level analysis counts are smaller than the planned maximum described in the summary, but the record does not say whether that reflects recruitment, eligibility, follow-up, outcome availability, or other analysis-population criteria.

The registry does not report whether analyses followed intention-to-treat principles, whether participants were excluded after randomization, or how protocol deviations were handled. It also does not describe an interim-analysis plan. These omissions do not alter the posted counts, but they limit assessment of how representative the analyzed participants are and how the comparative findings relate to the original randomized groups.

12. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

ArmParticipants with serious adverse eventsParticipants at riskPercentage
Adj-3 A2 gp209(2M) in IFA SQ (Vortex)0190.0%
Adj-3 A2 gp209(2M) in IFA SQ + Imiquimod (Vortex)0190.0%
Adj-3 A2 gp209(2M) in Saline ID0180.0%
Adj-3 A2 gp209(2M) in Saline ID + Imiquimod0190.0%
Adj-3 A2 gp209(2M) in IFA SQ (2 Syringe)0150.0%
Adj-3 A2 gp209(2M) in IFA SQ + Imiquimod (2 Syringe)0140.0%

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 0% reporting threshold.

ArmParticipants affected of at risk
Adj-3 A2 gp209(2M) in IFA SQ (Vortex)19 of 19
Adj-3 A2 gp209(2M) in IFA SQ + Imiquimod (Vortex)19 of 19
Adj-3 A2 gp209(2M) in Saline ID18 of 18
Adj-3 A2 gp209(2M) in Saline ID + Imiquimod19 of 19
Adj-3 A2 gp209(2M) in IFA SQ (2 Syringe)15 of 15
Adj-3 A2 gp209(2M) in IFA SQ + Imiquimod (2 Syringe)14 of 14

Most frequent non-serious adverse event terms

Event termOrgan systemAdj-3 A2 gp209(2M) in IFA SQ (Vortex)Adj-3 A2 gp209(2M) in IFA SQ + Imiquimod (Vortex)Adj-3 A2 gp209(2M) in Saline IDAdj-3 A2 gp209(2M) in Saline ID + ImiquimodAdj-3 A2 gp209(2M) in IFA SQ (2 Syringe)Adj-3 A2 gp209(2M) in IFA SQ + Imiquimod (2 Syringe)
Injection site reactionSkin and subcutaneous tissue disorders19 of 1919 of 1918 of 1819 of 1915 of 1514 of 14
PruritisSkin and subcutaneous tissue disorders5 of 191 of 190 of 180 of 191 of 152 of 14
FatigueGeneral disorders4 of 191 of 190 of 180 of 190 of 151 of 14
Rash desquamatingSkin and subcutaneous tissue disorders2 of 191 of 190 of 180 of 191 of 150 of 14
ChillsGeneral disorders2 of 190 of 190 of 180 of 190 of 151 of 14
MyalgiaMusculoskeletal and connective tissue disorders2 of 190 of 190 of 180 of 190 of 151 of 14
Leukocyte count decreasedBlood and lymphatic system disorders1 of 190 of 191 of 180 of 190 of 150 of 14
DiarrheaGastrointestinal disorders2 of 190 of 190 of 180 of 190 of 150 of 14
SweatingGeneral disorders1 of 190 of 190 of 180 of 190 of 150 of 14
NauseaGastrointestinal disorders1 of 190 of 190 of 180 of 190 of 150 of 14
Do not overextend the safety comparison. Serious-adverse-event counts are safety observations, not efficacy outcomes, and should not be combined with the primary result into a single benefit-risk number.

The serious-adverse-event figures list 0 affected participants in each of the six arms. The numbers at risk differ by arm: 19, 19, 18, 19, 15, and 14, respectively. These are the registry's reported serious-event counts and denominators; they are not the primary immunologic-response analysis counts.

The registry also lists other adverse events as affecting all participants at risk in each arm: 19 of 19, 19 of 19, 18 of 18, 19 of 19, 15 of 15, and 14 of 14. The record does not provide further detail about the nature, severity, duration, or attribution of these other events in the information. The serious adverse event terms are not reported in the registry record. Death counts are also not reported in the registry record.

These figures should be read as descriptive counts within the reported safety groups. They do not establish comparative safety, and the absence of reported serious events in these groups does not show that serious events are impossible. The registry does not report a statistical comparison or additional information needed to assess differences in safety between preparations.

13. What the Result Does, and Does Not, Mean

The posted data describe immunologic response counts for six gp100 preparations and provide unadjusted estimates for three comparisons with the vortex Montanide reference. The response counts are 2 in the reference arm, 0 for vortex Montanide plus imiquimod, 0 for saline, 3 for saline plus imiquimod, 1 for the two-syringe Montanide preparation, and 0 for the two-syringe Montanide preparation plus imiquimod. The comparative estimates are uncertain, and their confidence intervals include no difference.

These findings do not establish that any preparation is superior, equivalent, or inferior. Nor do the counts demonstrate that an added component caused a difference: the posted results are small, imprecise comparisons, and the analysis details are limited. The unadjusted p-values do not resolve those uncertainties, and the record does not report adjustment for multiple comparisons.

The endpoint measures an immune response by an Elispot threshold. It is not a direct measure of melanoma recurrence or another clinical outcome. The registry's stated rationale was to identify a preparation for possible future study based on immunization alone; the results cannot establish whether any preparation changes recurrence risk or other patient outcomes.

The registry says response data are not available for all patients, and the handling of unavailable results is not reported. Safety listings show no serious adverse events among those listed at risk, while other adverse events are recorded for all participants at risk in each arm. These safety counts are descriptive and do not support a definitive comparative safety conclusion. Taken together, the record provides exploratory information about observed immunologic responses, with substantial limits on precision and completeness.

14. Why This Trial Matters Statistically

This trial is statistically informative as an example of how a randomized comparison can still yield limited precision when event counts and analyzed arm sizes are small. The arms recorded between 0 and 3 immunologic responses, and the posted confidence intervals are broad. A point estimate may look favorable in one direction, but the interval shows that the estimate is compatible with a much wider range of underlying differences.

The comparison also involves more than one preparation. When many arms can be contrasted, multiplicity becomes relevant: selective attention to a single observed contrast can overstate how compelling it is. The registry reports three unadjusted comparisons against one reference arm but does not report a multiplicity strategy or the status of other planned contrasts. This makes it important to distinguish descriptive patterns from confirmatory evidence.

The outcome is an immunologic response, an intermediate measure intended to inform future research on vaccine preparation. Such an endpoint can answer a focused biological question without answering whether recurrence or other clinical outcomes change. Keeping that distinction clear prevents an immune-response count from being interpreted as direct evidence about a clinical endpoint.

Finally, missing response information and incomplete reporting of analysis methods affect interpretation even when the posted arm counts are considered accurate. The record's acknowledgment that response data are unavailable for all patients makes completeness a central issue, not a technical footnote. The trial illustrates why effect estimates, uncertainty, outcome meaning, analysis transparency, and multiplicity need to be considered together.

15. Limitations

The primary limitation is incomplete outcome availability: the registry says immunologic response-rate data are not available for all patients. It does not report the number with missing responses by arm, why results were unavailable, or how missing observations were handled. As a result, the posted analyzed counts cannot be assumed to describe all randomized participants equally well.

Arm sizes are small, and response counts are sparse. The reported confidence intervals are broad, and there are no comparative estimates for the two-syringe preparations. Although the study lists six preparations, the registry's comparative results cover only three contrasts against the vortex Montanide reference. It does not report how the other comparisons were analyzed or whether the reported contrasts were selected in advance.

Statistical reporting is limited. The analysis test, confidence-interval method, analysis population, allocation procedures, and multiplicity approach are not reported in the registry record. The planning illustration is based on the observed effect and specified assumptions; it is not the trial's own design justification. The record does not report the original sample-size rationale or an interim-analysis plan.

The primary endpoint is immunologic and does not directly measure recurrence. The registry's stated 48 months timeframe does not by itself clarify when immune responses were assessed or how repeated observations were summarized. The relationship between the listed enrollment of 104 and the brief summary's planned enrollment of up to 132 is also not explained. Safety information is limited to event counts; event terms and death counts are not reported in the registry record.

16. Related Tutorials

17. Related Statistical Calculators

18. Sources

Continue through the Clinical Biostats statistical pathway

Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.

19. Record Summary

The registry describes a completed randomized phase 2 parallel-group study with no masking, sponsored by the National Cancer Institute (NCI). It compared six gp100:209-217 (210M) preparations involving Montanide or saline, different injection routes, and imiquimod use. The primary endpoint was the number of participants meeting an immunologic response threshold, with a stated timeframe of 48 months.

Arm-level response counts are posted, along with three unadjusted comparisons against the vortex Montanide preparation. The estimates are imprecise, and response data are not available for all patients. The registry does not report comparative results for the two-syringe preparations or several details of the statistical analysis. Safety listings report 0 serious adverse events in each arm and other adverse events among all participants at risk. The findings describe immune-response counts, not melanoma recurrence outcomes.

Clinical Biostats