← Clinical Trials
Tobacco Smoking Phase 3 Continuous Endpoint NCT03272685

Impact of Very Low Nicotine Content Cigarettes in a Complex Marketplace: Complete Statistical Analysis

This analysis examines a randomized comparison of very low versus normal nicotine content cigarettes in an experimental marketplace. The primary endpoint is mean cigarettes smoked per day near the end of the study-cigarette phase.

Trial start: 2018-06-01  ·  Enrollment: 799  ·  Sponsor: University of Minnesota
Scope of this record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.

1. Trial at a Glance

This page covers the registry results for Impact of Very Low Nicotine Content Cigarettes in a Complex Marketplace (NCT03272685), a randomized phase 3 study. The primary outcome is Cigarettes Per Day (CPD).

799
Enrollment
Phase 3
2
Arms
In the primary outcome
5.90
Mean difference
Normal Nicotine Content Cigarettes
4.10–7.70
95% CI
Two-sided
FeatureRegistry value
ClinicalTrials.gov identifierNCT03272685
PhasePhase 3
ConditionTobacco Smoking, Nicotine Dependence
AllocationRandomized
Design modelParallel
MaskingNone (open label)
Enrollment799
Arms in the primary outcome2
Lead sponsorUniversity of Minnesota
Results postedYes

2. Clinical Question

Population

The registry identifies tobacco smoking and nicotine dependence as the conditions under study. Participants were enrolled in a trial conducted in an experimental tobacco and nicotine product marketplace. Further eligibility details and a fuller description of the participant population are not reported in the registry record.

Intervention

One group was assigned very low nicotine content cigarettes, described as containing 0.4 mg nicotine/g tobacco and 9 mg of tar. The median nicotine content was averaged across menthol and non-menthol cigarettes.

Comparator

The comparison group was assigned normal, or conventional, nicotine content cigarettes, described as containing 15.8 mg nicotine/g tobacco and 9 mg of tar. Median nicotine content was likewise averaged across menthol and non-menthol cigarettes.

Primary question

The primary endpoint compares mean cigarettes smoked per day, including study and non-study cigarettes, based on daily interactive voice response data for the 7 days prior to the week 12 visit. The registry describes this as the end of Phase 3, when study cigarettes were available in the experimental marketplace, compared with Phase 2, when usual brand cigarettes were available.

The central statistical question is whether the recorded mean cigarette consumption differed between the randomized groups at the stated endpoint. This is a comparison of group averages, not a description of every participant’s behavior. The registry’s summary comparison is expressed as the normal-nicotine group mean minus the very-low-nicotine group mean, so a positive difference indicates a higher recorded mean in the normal-nicotine group. The endpoint includes both study and non-study cigarettes, which makes it a measure of total reported cigarette consumption rather than study-cigarette use alone.

The trial is listed as phase 3, randomized, open-label, and parallel-group. The registry describes an experimental marketplace rather than a comparison limited to a single study product in isolation. The results therefore address the recorded group contrast in that setting and over the stated observation period. They do not, by themselves, describe effects outside the trial setting or establish how the group contrast would behave over a different period.

3. Trial Design

The registry lists a phase 3 randomized, parallel-group trial with no masking. The sponsor is the University of Minnesota. The study is marked completed, with a recorded enrollment of 799. The listed start date is 2018-06-01 and the primary completion date is 2022-09-30. These registry entries describe the study record; they do not give a full account of recruitment, follow-up, or analysis procedures.

The two intervention groups were assigned very low nicotine content cigarettes or normal nicotine content cigarettes in an experimental marketplace. The descriptions give nicotine content and tar content for each cigarette type, with nicotine content reported as a median averaged across menthol and non-menthol cigarettes. The study summary says that the project examined the impact of very low nicotine content cigarettes in a complex tobacco and nicotine product marketplace. It specifies a comparison of cigarettes smoked and cigarette-free days between marketplaces containing very low nicotine content versus normal nicotine content cigarettes.

The primary endpoint is recorded for the 7 days before the week 12 visit. The registry’s description places the measurement at the end of Phase 3 and compares the experimental marketplace with study cigarettes against Phase 2 with usual brand cigarettes. Daily interactive voice response data are the stated source for this primary measure. The trial’s arms are the very low nicotine and normal nicotine cigarette groups; the record does not provide a detailed description of the marketplace’s other available products or how participants used them.

Open-label means that masking is listed as none. The registry does not report whether participants, staff, or outcome assessors were kept unaware of assignment by any other means. It also does not report the original sample-size justification, planned interim analyses, or a full statistical analysis plan. The posted arm summaries contain endpoint-specific sample sizes that differ across measures; the record does not explain those differences. A detailed account of participant flow, adherence, withdrawals, and analysis populations is not reported in the registry record.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Before assignment: 799 potential participants were consented and attended the screening visit. 535 eligible participants entered Phase 1; 491 continued on to Phase 2; 438 were randomized into Phase 3. See description of Phases under Study Description.

Overall Study

StageVery Low Nicotine Content CigarettesNormal Nicotine Content Cigarettes
STARTED220218
COMPLETED166173
NOT COMPLETED5445

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

Population: Baseline characteristics are among those who were randomized.

CharacteristicUnitVery Low Nicotine Content CigarettesNormal Nicotine Content CigarettesTotal
Participants analysed220218438
Age, Categorical: <=18 yearsParticipants000
Age, Categorical: Between 18 and 65 yearsParticipants212209421
Age, Categorical: >=65 yearsParticipants8917
Sex: Female, Male: FemaleParticipants123102225
Sex: Female, Male: MaleParticipants97116213
Race (NIH/OMB): American Indian or Alaska NativeParticipants347
Race (NIH/OMB): AsianParticipants6713
Race (NIH/OMB): Native Hawaiian or Other Pacific IslanderParticipants011
Race (NIH/OMB): Black or African AmericanParticipants455499
Race (NIH/OMB): WhiteParticipants143139282
Race (NIH/OMB): More than one raceParticipants211334
Race (NIH/OMB): Unknown or Not ReportedParticipants202
Cigarettes Per Day (CPD)Number of Cigarettes Per Day15.6 (SD 6.9)15.5 (SD 7.6)15.5 (SD 7.3)

6. Primary Endpoint

The registry lists the primary outcome as Cigarettes Per Day (CPD), measured over 7 days prior to week 12 visit.

ElementRegistry entry
Result typeMean
Measure of spreadStandard Deviation
Unitcigarettes per day
Endpoint classificationContinuous Endpoint

The primary endpoint is mean cigarettes per day, measured for the 7 days prior to the week 12 visit. It includes both study and non-study cigarettes and is based on daily interactive voice response data. The registry places this measure at the end of Phase 3, when the experimental marketplace contained study cigarettes, and describes comparison with Phase 2, when the marketplace contained usual brand cigarettes.

A mean gives a summary of the average recorded cigarette consumption in each group. It can help describe a difference in typical group-level consumption, while not showing how values are distributed across individuals or how much participants vary. The accompanying standard deviations describe the spread of individual recorded values around each group mean. They are not standard errors and do not directly express uncertainty in the difference between group means.

This endpoint is used to quantify cigarette consumption in the marketplace setting, and its inclusion of non-study cigarettes matters to interpretation: it is not limited to the number of assigned study cigarettes consumed. Daily reports allow the endpoint to reflect reported consumption over the specified period. As with any measure based on participant reports, the registry record alone does not establish how complete or accurate each daily report was.

The endpoint is a continuous measure, so the main comparison is expressed as a difference in means. That difference describes the separation between the two group averages in cigarettes per day. It does not identify the reasons for any difference, distinguish changes for individual participants, or establish what would occur under different marketplace conditions or follow-up periods.

7. Results Posted in the Registry

Mean difference: Normal Nicotine Content Cigarettes

5.90

95% CI: 4.10 to 7.70

Recalculated from the posted summary statistics

Primary outcome by arm, with 95% confidence intervals
Primary outcome by arm with 95% confidence intervals5.07.09.111.113.115.1Very Low Nicotine Content Cig… (n=168)Normal Nicotine Content Cigar… (n=173)cigarettes per day (95% CI)
Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)Normal Nicotine Content Cigar…-0.621.172.964.746.538.32mean difference vs control (95% CI)

8. Secondary Efficacy Endpoints

The registry also posts results for secondary outcomes. For each outcome below, the endpoint type, the test applied to the posted summary statistics, the result and its interpretation are given in turn. Secondary endpoints are usually not adjusted for multiple testing, so they support rather than confirm the primary finding.

Secondary outcomeTypeEffect measureEstimate (95% CI)Planning size, 80% power
Study Cigarettes Per DayContinuous EndpointMean difference7.09 (5.37 to 8.81)21 per arm
Seven Day Point-prevalence CO-verified AbstinenceBinary EndpointRisk difference-11.8 pts (-17.9 to -5.6)126 per arm

Study Cigarettes Per Day

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)Normal Nicotine Content Cigar…-0.711.343.385.437.479.52mean difference vs control (95% CI)

Seven Day Point-prevalence CO-verified Abstinence

Treatment effect versus the control arm
Forest plot of risk difference (percentage points) vs control (95% CI)Normal Nicotine Content Cigar…-19-15-11-6.87-2.721.43risk difference (percentage points) vs control (95% CI)

The secondary results cover more than one aspect of cigarette use. One is study cigarettes per day, which is narrower than the primary endpoint because the primary measure includes both study and non-study cigarettes. Another is seven-day point-prevalence abstinence verified by carbon monoxide. The registry also lists percent change in CEMA among secondary outcomes, but an outcome result for CEMA is not reported in the registry record.

Across the posted secondary outcomes with results, the direction of the group comparisons is broadly consistent with the primary group contrast: the very-low-nicotine group has lower recorded cigarette consumption and a higher observed count of participants meeting the abstinence definition. This pattern provides context across related measures, but the endpoints are not interchangeable. Study-cigarette consumption does not represent total cigarette consumption, and a point-prevalence abstinence measure represents a status over a specified period rather than an average number of cigarettes smoked per day.

The secondary comparisons are unadjusted, and the registry lists no reported analyses for them. When several outcomes are examined, the chance of finding at least one apparently unusual result can increase unless the analysis accounts for multiple comparisons. The registry does not report a multiplicity adjustment or a hierarchy specifying how secondary outcomes were to be interpreted. For that reason, secondary findings generally carry less inferential weight than a clearly prespecified primary comparison, particularly when the analysis plan and adjustment procedures are unavailable.

The overall pattern can be considered supportive context for understanding the primary result, but it does not independently confirm a single underlying mechanism or establish a broader conclusion. Differences in outcome definition, sample size, missing-data handling, and measurement method can affect how results align. The registry record does not report enough analysis detail to determine whether the secondary outcomes were prespecified as confirmatory or exploratory. Their interpretation should therefore remain descriptive and distinct from the primary endpoint.

Secondary outcomes registered for this trial, for reference (only those above were recalculated):

9. Statistical Interpretation

Clinical Biostats interpretation

The posted primary group means are 7.05 cigarettes per day for the very low nicotine content group and 12.95 for the normal nicotine content group. The registry’s comparison is expressed as the normal-nicotine mean minus the very-low-nicotine mean: 5.9 cigarettes per day, with a 95% confidence interval from 4.098 to 7.702 and an unadjusted p-value of <0.001. The positive direction indicates that the recorded group mean was higher in the normal-nicotine group for this endpoint and time frame.

The interval describes uncertainty in the estimated mean difference under the calculation used. Its endpoints are both on the positive side of no difference, and the p-value is small under the unadjusted comparison. These statistics describe evidence in the posted summaries; they do not establish that every participant in one group smoked more than every participant in the other, nor do they explain the mechanisms behind the group-level contrast. The standard deviations, 7.88 and 9.07, also show substantial spread in recorded values around the means.

The comparison is specific to mean total cigarette consumption, including study and non-study cigarettes, during the 7 days before the week 12 visit. It should not be recast as a comparison of study cigarettes alone. The secondary endpoint for study cigarettes per day is a different measure, and the abstinence endpoint captures a different outcome again. Those secondary results generally point in a direction consistent with lower cigarette consumption and more recorded abstinence in the very-low-nicotine group, but they should be considered separately and with less inferential weight because the registry supplies unadjusted secondary comparisons.

The registry record does not report a full analysis plan, missing-data procedures, analysis populations, or multiplicity adjustment. Those omissions limit the ability to assess how the reported estimates relate to all planned analyses and how incomplete observations were handled. The posted comparison is unadjusted, and no sponsor-reported analysis details are listed. The summary statistics support a description of the observed group contrast, but they do not replace a complete account of the trial’s prespecified model and data handling.

These results also do not establish whether the contrast would persist in another setting, over a longer period, or under a different mix of available products. The trial was open-label and conducted in an experimental marketplace. The registry reports the endpoint and group summaries but does not provide enough detail to assess all contextual factors that may affect cigarette use. Statistical evidence for a group difference is not itself a clinical recommendation or a guarantee of an individual outcome.

10. Statistical Methods Explained

The primary outcome is continuous: it is a mean number of cigarettes per day. The posted summaries give a group mean and standard deviation for each arm. A mean is the arithmetic average of the observed endpoint values; the standard deviation describes how dispersed those values are around the average. A larger standard deviation means observations are more spread out, but it does not by itself indicate greater uncertainty in the comparison. Uncertainty in a mean or a difference in means also depends on the amount of information available.

What does the mean difference represent?

The comparison is calculated in the direction normal nicotine content minus very low nicotine content. The reported estimate of 5.9 is therefore the difference between the posted group means, in cigarettes per day. A positive value means the normal-nicotine group had the higher mean in this comparison. This is a group-level summary: it does not mean that each participant had an outcome equal to the group mean, and it does not describe the distribution of differences for individual participants.

The registry’s unadjusted comparison uses the posted summary statistics. It is not an adjusted model estimate that accounts for additional participant characteristics. No adjusted analyses are listed in the registry record. The comparison can be read as a direct contrast of the two posted group averages, while recognizing that details of the original analysis method are not reported.

How should the p-value be read?

A p-value describes how compatible the observed data are with a specified no-difference model, under the assumptions of the statistical test. The unadjusted primary p-value is <0.001. This value is evidence against a no-difference model for the stated comparison under that calculation; it is not the probability that the no-difference model is true, and it does not measure the size or importance of the difference. It also does not account for the possibility of many outcomes or analyses unless a multiplicity method is used. The registry does not report a multiplicity adjustment.

Statistical significance and effect size answer different questions. The estimated mean difference gives the size and direction of the group contrast in cigarettes per day. The p-value characterizes evidence relative to a no-difference model. Neither one describes how accurately an individual’s consumption can be predicted from their assigned group, nor does either explain why the groups differed.

What does the confidence interval add?

The 95% confidence interval runs from 4.098 to 7.702 cigarettes per day. In general, a confidence interval is a range of estimates compatible with the data and the procedure used to calculate it. It expresses uncertainty in the estimated group difference; it is not a range containing 95% of participant outcomes. The interval does not account for sources of uncertainty that were not included in the calculation, such as possible bias from missing data or limitations in the study design.

The interval’s location and width are useful alongside the point estimate. Here, both endpoints are above zero, so the range does not include a zero mean difference under the reported calculation. Its width reflects the precision of this unadjusted estimate. The interval should be interpreted for the specific measure, population, and time frame recorded, rather than as a universal range for other settings or future observations.

Why can over-dispersion matter?

General statistical explanation: count outcomes such as cigarettes per day can be more variable than a simple model assumes. This is called over-dispersion. If a count model assumes less variation than is actually present, its standard errors can be too small and its confidence intervals too narrow. The primary outcome is reported as a mean with a standard deviation, and the registry record does not report that a count model was used or provide a dispersion assessment. It is therefore not possible to assess from this record whether a particular count-model assumption was relevant to the sponsor’s analysis.

The planning illustrations use a normal approximation, as stated in the registry record. That is a planning convention and should not be confused with proof that the endpoint values follow a normal distribution. The record does not report diagnostic checks or a model specification for the original analysis. General statistical practice would examine whether the chosen analysis is suitable for the outcome and data structure, but the registry does not provide enough information to judge those choices.

What is and is not reported about the analysis?

The record lists no reported analyses for the secondary outcomes and no analysis details beyond the posted summaries and comparisons. The reported comparison values are unadjusted recalculations from the posted summary statistics, and no discrepancy is flagged. The sponsor’s own analysis would take precedence if the registry record identified a discrepancy, but it does not do so. The record does not report covariate adjustment, repeated-measures methods, treatment of missing observations, or the exact analysis population for the primary endpoint.

That absence does not demonstrate that such methods were not used in the trial; it means the registry record does not describe them. Without those details, the posted summaries are useful for understanding the group-level results and their unadjusted precision, but cannot support a complete reconstruction of the prespecified analysis. General statistical interpretation should distinguish the calculations available from the registry from any analysis that may have been documented elsewhere.

11. Confidence Intervals and Precision

The primary mean difference is 5.9 cigarettes per day, with a 95% confidence interval from 4.098 to 7.702. The interval is centered on the estimated contrast in the sense that it gives a range around the point estimate, but its endpoints are not plausible bounds on every participant’s outcome. It addresses uncertainty in the group mean difference under the calculation used.

In general, a narrower confidence interval indicates greater precision for the estimate, while a wider interval indicates more uncertainty. Precision depends on the variability in the observations and the amount of information contributing to the estimate, as well as the method used to calculate the interval. The primary group standard deviations are 7.88 and 9.07, indicating that individual recorded values vary around their respective means. Group means and their confidence interval do not capture all the variation among individuals.

Because the interval’s lower and upper limits are both positive, the unadjusted interval does not include a zero mean difference. The unadjusted p-value is <0.001. These are related descriptions of the primary comparison, but neither measure addresses potential bias from missing data, measurement error, or other design limitations that are not incorporated into the calculation. The registry does not report missing-data methods or the full analysis model, so the interval should be understood as precision under the posted summary calculation, not as a complete account of every uncertainty.

The interval applies to the stated endpoint and observation period: mean cigarettes per day, including study and non-study cigarettes, for the 7 days before the week 12 visit. It should not be transferred directly to study-cigarette consumption alone, abstinence, other follow-up periods, or other marketplace settings. Those are distinct measures or contexts with their own estimates and uncertainties.

12. Planning a Similar Trial: Sample Size

This is a planning illustration, not a re-evaluation of the original trial. It asks: if a new study wanted to detect a difference like the one observed, or a smaller one, how large would it need to be? It is deliberately not “observed power” of the finished trial, which is not a meaningful quantity.

Effect to detectParticipants per arm, 80% powerParticipants per arm, 90% power
100% of the observed effect3344
75% of the observed effect5878
50% of the observed effect131175
Sample size needed versus the size of the effect to detect
Sample size needed versus size of effect to detect205010020050040%60%80%100%80% power90% powersize of effect to detect, as % of the effect observed (log vertical scale: participants per arm)
Method and assumptions. Two-sided α = 0.05, 1:1 allocation, two-sample comparison of means with the pooled standard deviation. Calculated for the comparison: Normal Nicotine Content Cigarettes.

The planning figures are participants per arm for the continuous and binary outcomes in this record; none is a time-to-event outcome. The registry’s planning assumptions are a two-sided significance level of 0.05, equal allocation between the two arms, a normal approximation, and an effect to detect set to the stated fraction of the observed effect. The figures are planning illustrations based on the observed effect, not observed power. The original trial’s own sample-size assumptions are not reported in the registry record.

The 80% power column describes the planned number of participants per arm under the listed assumptions to have an 80% chance of detecting the chosen effect if that effect is present, using the stated test framework. The 90% power column describes the corresponding planning target for a 90% chance. These are design calculations, not probabilities that the trial result is correct, and they do not change the uncertainty in the observed estimate.

Rows that plan for a smaller fraction of the observed effect require more participants per arm than rows planning for the full observed effect. Smaller effects are harder to distinguish from ordinary sampling variation, so more information is generally needed to detect them at the same significance and power targets. The table’s effect-fraction labels indicate the assumed size relative to the effect observed in this trial; they are not different observed results.

The planning calculations use equal allocation, even though the posted endpoint group sizes are not exactly equal. They should not be read as a reconstruction of the trial’s original design or a recommendation for a future study without considering its own endpoint, design, anticipated effect, and analysis plan. The registry does not report the trial’s original sample-size justification. The curve and tabulated planning values are aids for understanding how sample-size requirements change with the assumed effect and power target, rather than evidence about how much power the completed trial actually had.

13. How the Sample Size Is Derived

Power is the probability that a study of a given size rejects the null hypothesis when a specific true effect exists. It depends on four things: the effect to detect, the variability of the outcome, the significance level (here a two-sided α of 0.05, so z1−α/2 = 1.960) and the desired power (z1−β = 0.842 for 80% and 1.282 for 90%).

Formula

n = 2 (z1−α/2 + z1−β)2 σ2 / Δ2

n is the number of participants in each arm, Δ is the difference in means to detect and σ is the common standard deviation.

Worked calculation for this trial

  1. Observed difference Δ = 5.900; pooled standard deviation σ = 8.505.
  2. n = 2 × (1.96 + 0.842)2 × 8.5052 / 5.9002 = 32.6, rounded up to 33 participants per arm for 80% power.

The smaller-effect rows in the table above repeat the same calculation with the effect multiplied by 0.75 and 0.5 (for ratios, applied to the logarithm of the ratio).

R code

alpha <- 0.05
z_a   <- qnorm(1 - alpha / 2)          # two-sided
delta <- 5.9                      # observed difference in means
sigma <- 8.5046105143034                     # pooled standard deviation
n_per_arm <- function(power, frac = 1) {
  ceiling(round(2 * (z_a + qnorm(power))^2 * sigma^2 / (delta * frac)^2, 6))
}
for (f in c(1, 0.75, 0.5))
  cat(sprintf("%3.0f%% of observed effect: n per arm = %s (80%% power), %s (90%% power)\n", 100 * f,
              format(n_per_arm(0.80, f), big.mark = ","), format(n_per_arm(0.90, f), big.mark = ",")))

# Check against R's built-in function (t-based, so very slightly larger)
cat("power.t.test:", round(power.t.test(delta = delta, sd = sigma, power = 0.80)$n, 1), "\n")

# Simulation: exact two-sample t-test using simulated means and variances
set.seed(3272685)
n    <- n_per_arm(0.80)
reps <- 20000
m_diff <- rnorm(reps, delta, sigma * sqrt(2 / n))             # difference in sample means
s2     <- sigma^2 * rchisq(reps, 2 * (n - 1)) / (2 * (n - 1))   # pooled sample variance
tstat  <- m_diff / sqrt(s2 * 2 / n)
cat(sprintf("Simulated power at n = %s per arm: %.3f (%d replicates)\n", format(n, big.mark = ","), mean(abs(tstat) > qt(0.975, 2 * (n - 1))), reps))

Output from running the code

100% of observed effect: n per arm = 33 (80% power), 44 (90% power)
 75% of observed effect: n per arm = 58 (80% power), 78 (90% power)
 50% of observed effect: n per arm = 131 (80% power), 175 (90% power)
power.t.test: 33.6 
Simulated power at n = 33 per arm: 0.791 (20000 replicates)

The simulation draws many sets of group means and variances at the planned sample size and counts how often the two-sample t-test rejects the null. It should land close to the target power; at very small required sample sizes it can fall below it, because the normal approximation is rough there.

14. Multiplicity, Missing Data and Analysis Populations

Multiplicity arises when a study evaluates several outcomes, time points, comparisons, or analytical approaches. If each is tested separately, the chance of at least one result appearing statistically unusual can increase. The registry lists multiple secondary outcomes, while the primary endpoint is cigarettes per day. The record does not report a multiplicity adjustment, a testing hierarchy, or which outcomes were intended to be confirmatory versus exploratory. The unadjusted p-values should therefore be read as results for individual comparisons, not as evidence that controls the overall error rate across all possible tests.

The registry lists no reported analyses for the secondary endpoints. It does not provide a detailed statistical analysis plan, interim-analysis information, or a full account of how the endpoint results were selected and analyzed. Whether interim analyses were planned or conducted is not reported in the registry record. The absence of such information does not establish that analyses were not performed; it limits what can be assessed from the record.

Missing-data handling is not reported. The arm-specific sample sizes differ across posted endpoints, and the record does not explain why. It does not give a participant-flow account for these outcomes, describe whether missing observations were excluded or imputed, or report sensitivity analyses. Without those details, it is not possible to evaluate whether the available observations represent the randomized groups equally or whether missingness could affect the estimates.

The analysis populations are also not reported. The registry does not state whether the primary comparison followed an intention-to-treat approach, included only participants with available endpoint data, or used another defined population. It does not report covariate adjustment or the method used to handle repeated measurements across phases. These are important distinctions because they affect the interpretation of a group comparison and its uncertainty. The posted summaries allow a direct reading of the recorded means, counts, and unadjusted comparisons, but they do not supply the detail needed to reconstruct the trial’s full analysis strategy.

15. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

ArmParticipants with serious adverse eventsParticipants at riskPercentage
Very Low Nicotine Content Cigarettes72203.2%
Normal Nicotine Content Cigarettes62182.8%
Participants with at least one serious adverse event
Serious adverse events by armVery Low Nicotine Content Cig…3.2%Normal Nicotine Content Cigar…2.8%% of participants with at least one serious adverse event

Deaths

ArmDeaths (participants affected of at risk)
Very Low Nicotine Content Cigarettes0 of 220
Normal Nicotine Content Cigarettes0 of 218

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 5% reporting threshold.

ArmParticipants affected of at risk
Very Low Nicotine Content Cigarettes39 of 220
Normal Nicotine Content Cigarettes42 of 218

Most frequent serious adverse event terms

Event termOrgan systemVery Low Nicotine Content CigarettesNormal Nicotine Content Cigarettes
HospitalizationGeneral disorders6 of 2206 of 218
Cancer DiagnosisNeoplasms benign, malignant and unspecified (incl cysts and polyps)1 of 2200 of 218

Most frequent non-serious adverse event terms

Event termOrgan systemVery Low Nicotine Content CigarettesNormal Nicotine Content Cigarettes
Elevated CES-D scorePsychiatric disorders39 of 22042 of 218
CoughRespiratory, thoracic and mediastinal disorders35 of 22020 of 218
Nasal congestion/RhinorrheaGeneral disorders34 of 22021 of 218
Headache/MigraineGeneral disorders34 of 22017 of 218
MyalgiaMusculoskeletal and connective tissue disorders25 of 22022 of 218
Sore/Itchy/Irritated ThroatGeneral disorders21 of 22013 of 218
Irritability/FrustrationGeneral disorders20 of 22013 of 218
StressSocial circumstances19 of 22014 of 218
Depressed/Sad MoodPsychiatric disorders16 of 22016 of 218
FeverGeneral disorders19 of 22010 of 218

Serious events with the highest arm-level rate: hospitalization (2.8%), cancer diagnosis (0.5%).

Do not overextend the safety comparison. Serious-adverse-event counts are safety observations, not efficacy outcomes, and should not be combined with the primary result into a single benefit-risk number.

The registry lists serious adverse events for groups at risk of 220 in the very low nicotine content arm and 218 in the normal nicotine content arm. It records 7 affected in the very-low-nicotine group and 6 in the normal-nicotine group. The listed top serious adverse event terms are hospitalization at 2.8% and cancer diagnosis at 0.5%. The registry also lists other adverse events affecting 39 and 42, respectively. Deaths are recorded as 0 in each group.

These figures are counts and percentages as recorded, not a complete description of event severity, timing, duration, or relationship to the assigned cigarettes. The registry does not provide a detailed breakdown of all event types or an adjusted comparison of adverse-event risk. The at-risk denominators for these safety summaries differ from the endpoint-specific sample sizes used in the efficacy summaries; the record does not explain the differences.

Counts alone do not establish whether event rates differ meaningfully between groups. Interpretation depends on the event definitions, observation period, completeness of reporting, and uncertainty around the estimates. The registry record does not report those details sufficiently for a comprehensive safety comparison. These summaries should be read as a description of the recorded serious and other adverse events, not as evidence that one group is safer or less safe.

16. What the Result Does, and Does Not, Mean

The results describe a group-level difference in mean cigarette consumption during the specified observation period in an experimental marketplace. The primary comparison is between very low and normal nicotine content cigarette groups, using cigarettes per day that include both study and non-study cigarettes. The posted means and confidence interval indicate that the recorded average was higher in the normal-nicotine group for this endpoint. The uncertainty interval and unadjusted p-value characterize that particular comparison.

These results do not show that every participant responded in the same way. The group standard deviations indicate that observations varied around each mean, and group averages do not reveal individual trajectories. They also do not establish why the groups differed, whether the assigned cigarette type alone accounts for the contrast, or how other products available in the experimental marketplace affected behavior.

The findings should not be generalized automatically to other populations, product markets, or time periods. The endpoint concerns the 7 days before the week 12 visit, and the trial is described as an experimental marketplace. Longer-term outcomes, other settings, and the effects of different product availability are not established by these posted summaries. The record does not provide the detail needed to assess how missing observations, adherence, or other features of the analysis may influence the estimates.

A statistically distinguishable group average is not the same as a clinical recommendation, and the registry results do not establish what an individual should do. They also do not establish whether any change in cigarette consumption translates into a health outcome. Although the registry lists serious and other adverse events, these counts are not a comprehensive comparative safety analysis. The appropriate interpretation is bounded by the measured outcomes, reported follow-up, and limited analysis details in the registry record.

17. Why This Trial Matters Statistically

This trial is statistically informative because it studies cigarette consumption in a marketplace that includes tobacco and nicotine products, rather than describing only the use of the assigned study cigarettes. The primary endpoint includes study and non-study cigarettes, so it addresses total recorded cigarette consumption under the stated marketplace conditions. That distinction matters: a change in the use of study cigarettes alone would not necessarily describe a change in overall cigarette use.

The posted results also illustrate why endpoint definitions need to be kept distinct. Mean cigarettes per day, study cigarettes per day, and a carbon-monoxide-verified abstinence status capture different features of behavior. Their results can provide complementary context, but they should not be combined as if they were the same measure. The primary result is a mean difference, while the abstinence result is a participant count in each group.

For biostatistical interpretation, the record offers a clear example of how a point estimate, confidence interval, standard deviations, and unadjusted p-value answer related but different questions. The mean difference describes the size and direction of the group contrast; the confidence interval describes its precision under the calculation; the p-value measures evidence relative to a no-difference model. None substitutes for the missing detail about the analysis plan, missing data, or multiplicity.

The record also shows why planning illustrations should be separated from the design of a completed study. Sample-size requirements depend on the effect chosen for planning and the assumptions used, while the trial’s original justification is not reported. These considerations help readers assess what the posted results can support without treating one statistical finding as a complete account of the trial.

18. Limitations

The trial is open-label, with masking listed as none. Knowledge of group assignment could affect behavior or reporting, although the registry does not report whether any specific safeguards were used. The primary endpoint is based on daily interactive voice response data, and the record does not report the completeness of those reports, validation procedures for cigarette counts, or how missing daily observations were handled.

The endpoint is limited to the 7 days prior to the week 12 visit. It therefore describes a specified period rather than long-term cigarette consumption. The study took place in an experimental marketplace, and the registry record does not describe the full range of available products or marketplace conditions. Results may not represent behavior in settings with different product availability, but the record does not provide data to quantify how such settings might differ.

The posted outcome sample sizes are not the same across all endpoints, and the reason is not reported. The record does not provide a detailed participant-flow account, analysis populations, missing-data procedures, or sensitivity analyses. These omissions make it difficult to assess the influence of incomplete follow-up or to determine whether the analyzed participants align with the randomized groups.

The record also does not describe the original sample-size justification, a full statistical analysis plan, multiplicity procedures, or interim analyses. No adjusted analysis is reported. The secondary outcomes have unadjusted comparisons, and a CEMA result is not reported in the registry record. These limitations constrain interpretation of the breadth of evidence and the robustness of the findings. They do not invalidate the posted summaries, but they prevent a complete assessment of trial conduct and analysis from the registry record alone.

19. Related Tutorials

20. Related Statistical Calculators

21. Sources

Continue through the Clinical Biostats statistical pathway

Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.

22. Record Summary

The registry record describes a completed, randomized, open-label, parallel-group phase 3 study sponsored by the University of Minnesota. It lists 799 enrolled participants and compares very low nicotine content cigarettes with normal nicotine content cigarettes in an experimental marketplace. The primary endpoint is mean cigarettes per day, including study and non-study cigarettes, for the 7 days before the week 12 visit.

The posted primary comparison reports a mean difference of 5.9 cigarettes per day, with a 95% confidence interval from 4.098 to 7.702 and an unadjusted p-value of <0.001, in the direction of a higher mean in the normal-nicotine group. Secondary results address study-cigarette consumption and carbon-monoxide-verified abstinence; a CEMA result is not reported in the registry record.

Analysis-plan details, missing-data handling, analysis populations, and multiplicity procedures are not reported. The results are best read as endpoint-specific group summaries and unadjusted comparisons for the stated trial setting and follow-up period.

Clinical Biostats