← Clinical Trials
Obstructive Sleep Apnea NA Continuous Endpoint NCT00458406

Evaluation of Adherence and Therapeutic Effectiveness of Bi-Flex Versus CPAP in Children With OSA: Complete Statistical Analysis

This randomized trial compared Bi-Flex with CPAP in children with obstructive sleep apnea, focusing on minutes of device use per night at month 1. The posted results also include selected secondary outcomes, while several details about analysis and missing data are not reported in the registry record.

Trial start: 2007-05  ·  Enrollment: 60  ·  Sponsor: Children's Hospital of Philadelphia
Scope of this record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.

1. Trial at a Glance

This page covers the registry results for Evaluation of Adherence and Therapeutic Effectiveness of Bi-Flex Versus CPAP in Children With OSA (NCT00458406), a randomized na study. The primary outcome is Minutes of Use Per Night at Month 1.

60
Enrollment
NA
2
Arms
In the primary outcome
16.00
Mean difference
CPAP
-72.42–104.42
95% CI
Two-sided
FeatureRegistry value
ClinicalTrials.gov identifierNCT00458406
PhaseNA
ConditionObstructive Sleep Apnea
AllocationRandomized
Design modelParallel
MaskingTriple
Enrollment60
Arms in the primary outcome2
Lead sponsorChildren's Hospital of Philadelphia
Results postedYes

2. Clinical Question

Population

Children with obstructive sleep apnea (OSA) were the study population. The registry describes a single-center study and reports enrollment of 60. The primary outcome results are posted for 43 participants in the Bi-Flex group and 13 in the CPAP group. The registry does not report further eligibility details or explain the difference between the enrollment figure and the group counts in the outcome results.

Intervention

Bi-Flex was the intervention. The registry describes it as bilevel positive airway pressure with pressure-release technology. The study objective was to assess whether Bi-Flex improved adherence compared with CPAP. The exact device settings and the details of treatment delivery are not reported in the registry record.

Comparator

CPAP was the comparison treatment and was described as standard continuous positive airway pressure. Children were randomized to Bi-Flex or CPAP in a parallel-group design. The registry does not report the randomization procedure or the allocation concealment method.

Primary question

The primary question was whether adherence differed between Bi-Flex and CPAP, measured as minutes of use per night at month 1. The posted means were 185.0 minutes for Bi-Flex and 201.0 minutes for CPAP. The estimated difference, defined as CPAP minus Bi-Flex, was 16.0 minutes, with a 95% confidence interval from -72.42 to 104.4. This interval is broad and includes values on either side of no difference.

3. Trial Design

The registry describes a randomized, parallel-group, single-center study of Bi-Flex versus CPAP in children with obstructive sleep apnea. Its design fields label masking as triple, while the study summary and arm descriptions use the term double-blind. Which people were masked, and how masking was maintained, are not reported in the registry record. The study is marked completed.

The registry reports enrollment of 60. For the primary outcome, results are posted for 43 participants in the Bi-Flex arm and 13 in the CPAP arm. The endpoint description also states that a study sample size of 45 in Bi-Flex and 15 in CPAP had 80% power to detect an effect size at least 0.85 using a 0.05 two-sided significance level. It further states that the 95% confidence interval for the difference between the means had a range of 1.282 standard deviations under that sample-size statement. These planning details are distinct from the observed group counts and results.

The study period is described as 3 months, and the primary endpoint was assessed at month 1. The registry lists additional measures including dropout, sleep-study results, comfort-related measures, and questionnaires. The detailed timing and measurement procedures for all outcomes are not reported in the registry record. The random sequence generation method, allocation concealment, analysis population, handling of missing observations, and any interim analyses are also not reported there.

Randomization can help balance prognostic factors across treatment groups, but it does not guarantee exact balance, particularly when group sizes differ. Masking may reduce biases related to treatment expectations or outcome assessment, but the registry does not identify the masked roles. Accordingly, the posted results describe the comparison that was recorded; they do not resolve uncertainties about implementation or analysis procedures that are absent from the record.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Before assignment: Sixty-nine consecutive families were approached for the study. Nine families declined the study. N=60 families were enrolled; N=4 of these were excluded due to various medical conditions. Of the remaining N=56, N=43 were enrolled into the Bi-Flex arm and N=13 were enrolled into the CPAP arm.

Month 1

StageBi-FlexCPAP
STARTED4313
COMPLETED4313
NOT COMPLETED00

Month 3

StageBi-FlexCPAP
STARTED4313
COMPLETED4313
NOT COMPLETED00

Analysis population for the primary outcome, as defined in the registry: The study sample size of 45 in the Bi-Flex group and 15 in the CPAP group had 80% power to detect an effect size ≥ 0.85 with a 0.05 two-sided significance level. In addition, with this sample size, the 95% CI for the difference between the 2 means had a range of 1.282 SD.

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

CharacteristicUnitBi-FlexCPAPTotal
Participants analysed431356
Age, Categorical: <=18 yearsParticipants431356
Age, Categorical: Between 18 and 65 yearsParticipants000
Age, Categorical: >=65 yearsParticipants000
Age, Continuousyears12 (SD 4)12 (SD 4)12 (SD 4)
Sex: Female, Male: FemaleParticipants15318
Sex: Female, Male: MaleParticipants281038
Region of Enrollment: United Statesparticipants431356

6. Primary Endpoint

The registry lists the primary outcome as Minutes of Use Per Night at Month 1, measured over 1 month.

ElementRegistry entry
Result typeMean
Measure of spreadStandard Deviation
Unitminutes
Endpoint classificationContinuous Endpoint

The primary endpoint was minutes of use per night at month 1. It measures device use as recorded in minutes, making it a direct adherence measure rather than a symptom score or sleep-study measure. The trial summary identifies adherence as the main reason for comparing Bi-Flex with CPAP: CPAP was described as the usual treatment, but as uncomfortable and often not tolerated. The study therefore asked whether the Bi-Flex approach was associated with greater use.

For Bi-Flex, the posted mean was 185.0 minutes per night, with a standard deviation of 165.0, among 43 participants. For CPAP, the mean was 201.0 minutes, with a standard deviation of 135.0, among 13 participants. The comparison is expressed as CPAP minus Bi-Flex, so the estimated difference of 16.0 minutes points toward a higher average in the CPAP group. The 95% confidence interval, from -72.42 to 104.4, indicates substantial uncertainty around that estimate.

As a general statistical point, an objective measure of device use can complement self-reported comfort or adherence because it records use rather than relying only on a participant’s account. The registry says objective compliance recordings were among the study measures, but the precise recording and data-processing procedures are not reported. A group mean also does not describe every participant’s use or the shape of the distribution. The large standard deviations relative to the means indicate considerable variation in recorded use within both groups.

7. Results Posted in the Registry

Mean difference: CPAP

16.00

95% CI: -72.42 to 104.42

Recalculated from the posted summary statistics

Primary outcome by arm, with 95% confidence intervals
Primary outcome by arm with 95% confidence intervals113148183219254289Bi-Flex (n=43)CPAP (n=13)minutes (95% CI)
Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)CPAP-87-46-4.513778119mean difference vs control (95% CI)

8. Secondary Efficacy Endpoints

The registry also posts results for secondary outcomes. For each outcome below, the endpoint type, the test applied to the posted summary statistics, the result and its interpretation are given in turn. Secondary endpoints are usually not adjusted for multiple testing, so they support rather than confirm the primary finding.

Secondary outcomeTypeEffect measureEstimate (95% CI)Planning size, 80% power
Drop Out RateBinary EndpointRisk difference+5.4 pts (-9.8 to 20.5)259 per arm
Change in ESS From Month 1 to Month 3Continuous EndpointMean difference2.20 (-0.67 to 5.07)57 per arm
Change in NOSE Scale Score From Month 1 to Month 3Continuous EndpointMean difference-4.10 (-7.90 to -0.30)41 per arm

Drop Out Rate

Treatment effect versus the control arm
Forest plot of risk difference (percentage points) vs control (95% CI)CPAP-12-5.191.858.891623risk difference (percentage points) vs control (95% CI)

Change in ESS From Month 1 to Month 3

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)CPAP-1.130.201.532.874.205.53mean difference vs control (95% CI)

Change in NOSE Scale Score From Month 1 to Month 3

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)CPAP-8.53-6.70-4.86-3.03-1.200.63mean difference vs control (95% CI)

The secondary outcomes broaden the questions beyond device use, but their coverage in the record is incomplete. The listed outcomes include dropout, apnea hypopnea index, OSA 18 score, ESS, NOSE scale score, and Pediatric Quality of Life. Detailed group results are posted for dropout and changes in ESS and NOSE. Detailed results for the other listed measures are not reported in the registry record.

Across the posted secondary results, there is not a single uniform pattern that resolves the primary adherence comparison. The recalculated dropout and ESS comparisons have confidence intervals that include no difference. The NOSE comparison has a recalculated interval that does not include zero, while the registry’s reported Wilcoxon result is p > 0.05. That difference in presentation illustrates why the sponsor’s rank-based test and a mean-difference recalculation should not be treated as tests of precisely the same estimand. The secondary results do not establish that the primary adherence question has a different answer, and they do not substitute for unposted sleep-study results.

Secondary outcomes are commonly useful for describing other dimensions of a trial, but they generally carry less confirmatory weight when they are not designated as the primary endpoint or when many outcomes are examined. Testing multiple outcomes increases the chance that at least one apparently notable result arises by chance. The registry does not report a multiplicity adjustment or a hierarchy governing interpretation of secondary outcomes. The selected results should therefore be viewed as exploratory context rather than as a set of independent confirmations.

The registry’s summary identifies comfort and therapeutic efficacy as additional objectives, but the detailed results available in this record do not cover all of those objectives. In particular, a full account of secondary evidence cannot be inferred from the measures with posted numerical results alone.

Secondary outcomes registered for this trial, for reference (only those above were recalculated):

9. Statistical Interpretation

Clinical Biostats interpretation

At month 1, the observed mean use was 185.0 minutes per night in the Bi-Flex group and 201.0 minutes in the CPAP group. The estimated mean difference was 16.0 minutes, defined as CPAP minus Bi-Flex. Thus, the point estimate is in the direction of greater average use with CPAP, not Bi-Flex. The 95% confidence interval runs from -72.42 to 104.4 minutes, encompassing a difference favoring either group as well as no difference. The unadjusted recalculation gives p = 0.723. Taken together, the posted summaries do not estimate a precise between-group difference in adherence.

The interval is more informative than treating the point estimate as a definitive ranking. It shows that the data are compatible with a range of potential differences, including a meaningful advantage in either direction. The record does not define a threshold for a clinically important difference in minutes of use, so the clinical importance of particular values within the interval cannot be judged from the registry information alone. Nor does a non-small p-value establish that the treatments are equivalent. A formal equivalence or non-inferiority conclusion would require an appropriate design and prespecified margin, neither of which is reported.

The primary result should be distinguished from the broader therapeutic question. Adherence was the primary outcome, while sleep-study efficacy was a secondary objective in the summary. The registry lists a change in apnea hypopnea index among secondary outcomes, but that result is not among the posted detailed secondary results in this record. Consequently, the adherence comparison alone cannot answer whether the treatments had similar therapeutic efficacy.

Several secondary measures are listed, and selected results are posted for dropout, change in ESS, and change in NOSE scale score. Those measures add context but do not replace the primary adherence endpoint. The registry lists other outcomes, including apnea hypopnea index and quality-of-life measures, without detailed results in the record. Conclusions across outcomes are also limited by the lack of reported multiplicity procedures and by the modest and unequal observed group counts.

The registry’s own primary analysis reports a two-sided t-test with p = 0.512, while the simple recalculation from the posted means, standard deviations, and group counts gives p = 0.723. The registry does not report the sponsor analysis’s estimated difference or confidence interval, so the p-values alone do not establish whether the analyses used different data, assumptions, or procedures. The study’s effect estimate and uncertainty should therefore be read alongside the sponsor’s reported test, not as a claim that the analysis details are fully reconciled.

10. Statistical Methods Explained

For the primary endpoint, the posted outcome is a mean and standard deviation for each group. A mean describes the average minutes of use per night, while the standard deviation describes how dispersed individual observations are around that average. The reported comparison is a mean difference, with CPAP minus Bi-Flex as its direction. A positive estimate therefore corresponds to a higher posted mean in CPAP; a negative estimate would correspond to a higher posted mean in Bi-Flex.

The unadjusted recalculation uses the displayed group summaries to estimate the difference and its uncertainty. It does not adjust for other participant characteristics or factors. The recalculated mean difference is 16.0 minutes, with a 95% confidence interval from -72.42 to 104.4 and p = 0.723. The registry’s own reported primary test is a two-sided t-test with p = 0.512. The registry does not supply the sponsor’s estimated difference or confidence interval. Since the posted summaries and the reported test result are not identical outputs, they should be recognized as separate presentations rather than assumed to be the same calculation.

A confidence interval gives a range of values compatible with the estimate under the analysis assumptions. In repeated use of the same method under its assumptions, a 95% confidence interval has a long-run coverage interpretation; it is not a statement that there is a 95% probability that the particular interval contains the true value. The interval includes zero, the value representing no mean difference, and extends into both negative and positive differences. Its breadth makes clear that the direction and size of any difference are uncertain.

A p-value describes how unusual data at least as incompatible with a specified null hypothesis would be if that null hypothesis and the analysis assumptions held. It is not the probability that the null hypothesis is true, and it does not measure the size or clinical importance of an effect. A p-value above a conventional threshold is not evidence by itself that two treatments are equivalent. The registry does not report a prespecified equivalence margin or a non-inferiority framework.

For continuous outcomes, the recalculated planning illustrations use an observed effect as a reference and show hypothetical group sizes for selected fractions of that effect. These are planning calculations, not measurements of the trial’s performance. The assumptions stated for these illustrations are a two-sided significance level of 0.05, equal allocation between arms, and a normal approximation. The stated detectable effect is the chosen fraction of the observed effect. The original design’s full sample-size assumptions are not reported in the registry record, apart from the separate planning statement in the primary endpoint description.

For a binary outcome such as dropout, the comparison can be expressed as a risk difference: the proportion with the event in one group minus the proportion in the other. The posted recalculation for dropout estimates a risk difference of 0.054, with a 95% confidence interval from -0.098 to 0.205 and p = 0.361. The group counts are small, and estimates of proportions can be imprecise when events are few. The registry’s reported test for dropout is a chi-squared test with p > 0.05. The recalculated risk difference and the reported test are different descriptions of the comparison and should not be treated as interchangeable output.

The secondary continuous outcomes are listed with group means and standard deviations. Their reported sponsor analyses use Wilcoxon (Mann-Whitney) tests for ESS and NOSE change, whereas the simple recalculated comparisons use mean differences. A rank-based test evaluates differences in the distributions of ranks and does not test precisely the same quantity as a test of means under general conditions. Thus, differences in the numerical results or significance labels can reflect the analysis target and method as well as the data.

Why does variation matter?

Variation affects how precisely a group mean and a between-group difference can be estimated. When participant measurements vary widely, the mean can be uncertain even when the average is clearly calculable. For minutes of use, the standard deviations are 165.0 minutes for Bi-Flex and 135.0 minutes for CPAP. Those spreads are substantial relative to the observed group means, and the observed group counts are unequal. The resulting confidence interval is broad. A mean and standard deviation are useful summaries, but they do not show whether the observations are symmetric, clustered, or strongly influenced by unusually high or low values.

For counts or rates, over-dispersion is a general concern when variability exceeds what a simple model assumes. In general, a model that understates variation can make uncertainty appear too small. The registry does not report a count-based model for the primary endpoint, and the posted primary outcome is continuous minutes of use. No distributional diagnostic or robust analysis is described in the registry record, so there is no basis to say whether such alternatives were used.

What does randomization contribute?

Random allocation supports a causal comparison by reducing systematic differences between groups in expectation. It does not eliminate chance imbalances, missing data, nonadherence, or measurement limitations. The record identifies the study as randomized but does not report the sequence-generation or concealment methods, nor does it state whether results were analyzed by assigned group. Those omissions matter when assessing how closely the reported comparison follows the randomized design.

How should the planning illustrations be read?

Power calculations describe the chance that a specified statistical procedure will reject a null hypothesis under an assumed effect and other planning conditions. The posted planning illustrations ask how many participants per arm would be needed under stated assumptions for 80% or 90% power. They are not a retrospective measure of whether this trial had adequate power, and they are not observed power. As a general principle, planning for a smaller effect requires more participants, all else equal. The observed group summaries, confidence intervals, and prespecified clinical objectives remain more useful for interpreting the trial’s evidence than a retrospective power label.

11. Confidence Intervals and Precision

The primary comparison has a 95% confidence interval from -72.42 to 104.4 minutes for CPAP minus Bi-Flex. The point estimate is 16.0 minutes, but the interval extends well in both directions around that estimate. Values below zero would favor a higher average for Bi-Flex, while values above zero would favor a higher average for CPAP. Because the interval includes zero, the posted estimate does not establish a direction of difference.

The interval is also broad enough that the results do not pin down the magnitude closely. It includes differences that could be relevant in either direction, although the registry does not report a threshold for clinical importance. The observed variability and the unequal group counts are important context for this imprecision: the standard deviations were 165.0 minutes and 135.0 minutes, and the primary results include 43 Bi-Flex participants and 13 CPAP participants.

Confidence intervals are not a guarantee that the true effect lies within the displayed endpoints. They quantify uncertainty under the analysis method and its assumptions. The registry does not report adjustment for covariates, sensitivity analyses, or details of missing-data handling that would show how robust the interval is to alternative choices. The sponsor’s own primary analysis reports p = 0.512 but does not include an effect estimate or confidence interval in the posted result. The recalculated interval should therefore be understood as an unadjusted summary-based estimate, not as a replacement for an unreported sponsor interval.

Precision and statistical significance are related but not identical. An estimate can be imprecise even when its point estimate appears small, and a narrow interval would still need to be judged against a clinically meaningful threshold. Here, the interval’s inclusion of both negative and positive values reinforces that the estimated comparison is uncertain rather than demonstrating equality.

12. Planning a Similar Trial: Sample Size

This is a planning illustration, not a re-evaluation of the original trial. It asks: if a new study wanted to detect a difference like the one observed, or a smaller one, how large would it need to be? It is deliberately not “observed power” of the finished trial, which is not a meaningful quantity.

Effect to detectParticipants per arm, 80% powerParticipants per arm, 90% power
100% of the observed effect1,5472,071
75% of the observed effect2,7503,682
50% of the observed effect6,1888,283
Sample size needed versus the size of the effect to detect
Sample size needed versus size of effect to detect1,0002,0005,00010,00020,00040%60%80%100%80% power90% powersize of effect to detect, as % of the effect observed (log vertical scale: participants per arm)
Treat these figures cautiously. The observed difference is imprecise: its confidence interval includes no difference at all. A sample size built on a noisy estimate can be far too small or too large, so the smaller-effect rows are the more cautious guide.
Method and assumptions. Two-sided α = 0.05, 1:1 allocation, two-sample comparison of means with the pooled standard deviation. Calculated for the comparison: CPAP.

The planning figures for these comparisons are stated as participants per arm, not total events. The general assumptions listed for the planning illustrations are a two-sided significance level of 0.05, equal allocation between the two arms, and a normal approximation. Each row considers an effect equal to a stated fraction of the observed effect. The original trial design assumptions are not reported in the registry record, apart from the separate sample-size statement in the primary endpoint description.

The 80% power column means the illustrative number of participants per arm under which the assumed test would have an 80% chance of detecting the chosen effect, if the planning assumptions and effect were correct. The 90% column gives the corresponding target for a 90% chance. These are prospective design concepts expressed as hypothetical sample-size requirements; they do not show that an observed result had a particular probability of being correct or of being detected.

Each effect fraction changes the planning question. Planning for 75% of the observed effect asks about a smaller effect than planning for 100%; planning for 50% asks about a still smaller one. Smaller effects generally require more participants to distinguish them from random variation at the same significance level and power target. For example, the primary-outcome illustration lists 1,547 participants per arm for planning around 100% of the observed effect at 80% power, and 6,188 participants per arm for 50% of that effect at 80% power.

These figures are planning illustrations based on the observed estimate, not the trial’s original recruitment target. They are not observed power. The endpoint description separately states a sample-size plan of 45 in Bi-Flex and 15 in CPAP, with 80% power to detect an effect size at least 0.85 at a 0.05 two-sided significance level. The registry does not provide enough detail to reconcile that statement with every assumption used in the recalculated illustrations.

13. How the Sample Size Is Derived

Power is the probability that a study of a given size rejects the null hypothesis when a specific true effect exists. It depends on four things: the effect to detect, the variability of the outcome, the significance level (here a two-sided α of 0.05, so z1−α/2 = 1.960) and the desired power (z1−β = 0.842 for 80% and 1.282 for 90%).

Formula

n = 2 (z1−α/2 + z1−β)2 σ2 / Δ2

n is the number of participants in each arm, Δ is the difference in means to detect and σ is the common standard deviation.

Worked calculation for this trial

  1. Observed difference Δ = 16.000; pooled standard deviation σ = 158.824.
  2. n = 2 × (1.96 + 0.842)2 × 158.8242 / 16.0002 = 1,546.8, rounded up to 1,547 participants per arm for 80% power.

The smaller-effect rows in the table above repeat the same calculation with the effect multiplied by 0.75 and 0.5 (for ratios, applied to the logarithm of the ratio).

R code

alpha <- 0.05
z_a   <- qnorm(1 - alpha / 2)          # two-sided
delta <- 16                      # observed difference in means
sigma <- 158.823801742686                     # pooled standard deviation
n_per_arm <- function(power, frac = 1) {
  ceiling(round(2 * (z_a + qnorm(power))^2 * sigma^2 / (delta * frac)^2, 6))
}
for (f in c(1, 0.75, 0.5))
  cat(sprintf("%3.0f%% of observed effect: n per arm = %s (80%% power), %s (90%% power)\n", 100 * f,
              format(n_per_arm(0.80, f), big.mark = ","), format(n_per_arm(0.90, f), big.mark = ",")))

# Check against R's built-in function (t-based, so very slightly larger)
cat("power.t.test:", round(power.t.test(delta = delta, sd = sigma, power = 0.80)$n, 1), "\n")

# Simulation: exact two-sample t-test using simulated means and variances
set.seed(458406)
n    <- n_per_arm(0.80)
reps <- 20000
m_diff <- rnorm(reps, delta, sigma * sqrt(2 / n))             # difference in sample means
s2     <- sigma^2 * rchisq(reps, 2 * (n - 1)) / (2 * (n - 1))   # pooled sample variance
tstat  <- m_diff / sqrt(s2 * 2 / n)
cat(sprintf("Simulated power at n = %s per arm: %.3f (%d replicates)\n", format(n, big.mark = ","), mean(abs(tstat) > qt(0.975, 2 * (n - 1))), reps))

Output from running the code

100% of observed effect: n per arm = 1,547 (80% power), 2,071 (90% power)
 75% of observed effect: n per arm = 2,750 (80% power), 3,682 (90% power)
 50% of observed effect: n per arm = 6,188 (80% power), 8,283 (90% power)
power.t.test: 1547.7 
Simulated power at n = 1,547 per arm: 0.805 (20000 replicates)

The simulation draws many sets of group means and variances at the planned sample size and counts how often the two-sample t-test rejects the null. It should land close to the target power; at very small required sample sizes it can fall below it, because the normal approximation is rough there.

14. Analyses Reported by the Sponsor

MethodEstimate95% CIP-value
t-test, 2 sidednot reported0.512

For the primary outcome, the registry reports the sponsor’s analysis as a two-sided t-test with p = 0.512. The summary-based recalculation gives a mean difference of 16.0 minutes for CPAP minus Bi-Flex, a 95% confidence interval from -72.42 to 104.4, and p = 0.723. Both reported p-values are above 0.05, but they are not identical.

The recalculation uses the posted group means, standard deviations, and group counts as an unadjusted comparison. The registry does not report the sponsor’s estimated difference, confidence interval, or further analytic details for this endpoint. It is therefore not possible to determine from the record why the reported p-values differ or whether the sponsor used additional information or a different procedure. The difference in p-values should not be interpreted as evidence of a different clinical conclusion by itself.

The sponsor’s analysis is the registry’s reported inferential result. The recalculation adds an estimate and interval derived from the posted summaries, but it cannot reproduce details that are not recorded. The registry does not report adjusted analyses or sensitivity analyses for the primary endpoint. Reading the reported test together with the recalculated estimate and its broad interval keeps the emphasis on both the trial’s own reported analysis and the uncertainty visible in the group summaries.

15. Multiplicity, Missing Data and Analysis Populations

The registry lists several outcome measures, including the primary adherence endpoint and secondary measures covering dropout, sleep-study indices, symptoms, and quality of life. It does not report whether the analysis plan used a hierarchy, a family-wise error adjustment, or another approach to multiplicity. Without such information, a nominal p-value from an individual secondary analysis should not be read as if it were the only statistical question posed by the study.

Multiplicity matters because examining many outcomes can increase the chance of at least one result appearing noteworthy by chance, even when no corresponding effect exists. This is a general statistical concern, not a claim that any particular posted finding is false. The registry does not report how many hypotheses were prespecified, whether analyses were exploratory, or whether outcome selection changed after data review. The analysis plan and any protocol amendments are not reported in the registry record.

Missing-data handling is also not reported. The group counts for the primary endpoint are 43 in Bi-Flex and 13 in CPAP, while the registry reports enrollment of 60. The record does not explain the relationship between enrollment and the outcome counts, identify why observations may be absent, or state whether all randomized participants were analyzed. It does not describe imputation, complete-case analysis, or sensitivity analyses for missing outcomes. No participant-flow explanation is available in the registry record, so the effect of missingness on the estimates cannot be assessed from these results alone.

The analysis population is not reported. The record does not state whether the primary analysis followed randomized assignment, included participants who used the assigned device, or used another definition. This distinction can matter in randomized trials because excluding participants after randomization may undermine the balance that randomization is intended to create. The randomization procedure and allocation concealment are also not reported, leaving additional design details unresolved.

Interim analyses and stopping rules are not reported in the registry record. That absence does not establish that interim analyses occurred or that they did not occur; it means the available record does not describe them. Overall, the missing analysis details limit the ability to judge prespecification, robustness, and the possible influence of missing observations or multiple testing.

16. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

ArmParticipants with serious adverse eventsParticipants at riskPercentage
Bi-Flex0430.0%
CPAP0130.0%

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 0% reporting threshold.

ArmParticipants affected of at risk
Bi-Flex0 of 43
CPAP0 of 13
Do not overextend the safety comparison. Serious-adverse-event counts are safety observations, not efficacy outcomes, and should not be combined with the primary result into a single benefit-risk number.

The registry records zero serious adverse events among 43 participants in the Bi-Flex group and zero among 13 participants in the CPAP group. It also records zero other adverse events in each group. These are the adverse-event counts posted for the groups, not proof that no adverse experiences occurred outside the registry’s reporting definitions or collection process.

Zero recorded events do not establish that the risk is zero. When an event is uncommon, a study with limited group counts may observe no cases even when some underlying risk exists. The record does not provide event-specific terms, a detailed safety assessment method, or information about how adverse events were solicited and followed. Death counts are not reported in the registry record.

These figures should be read as a description of the adverse events recorded in this trial, with the available follow-up and reporting details. They do not support a broad comparative safety conclusion, especially because the record does not describe adverse-event definitions, exposure time, or a formal analysis of between-group safety differences.

17. What the Result Does, and Does Not, Mean

The posted primary result estimates average device use at month 1 in the randomized Bi-Flex and CPAP groups. The observed means were 185.0 and 201.0 minutes per night, respectively, and the recalculated difference was 16.0 minutes for CPAP minus Bi-Flex. The 95% confidence interval, from -72.42 to 104.4, is broad and includes no difference. These data therefore provide an uncertain estimate of the direction and size of any average adherence difference.

This result does not establish that Bi-Flex improves adherence relative to CPAP. The point estimate is in the opposite direction, but the interval is too broad to support a precise ranking. It also does not demonstrate that the treatments are equivalent or that their adherence effects are clinically indistinguishable. Equivalence would require a prespecified margin and an analysis designed for that question; neither is reported in the registry record.

The endpoint concerns recorded minutes of use, not every aspect of treatment experience or therapeutic efficacy. The study summary identifies sleep-study findings, comfort, and questionnaires as additional interests. Selected secondary results are available, but detailed results for all listed outcomes are not reported in the registry record. The primary adherence estimate cannot answer whether sleep-study outcomes were similar or whether participants found one approach more comfortable.

Nor does the result establish what would happen in other settings or populations. The registry describes a single-center study in children with OSA, and the results are based on the group counts posted for the primary endpoint. Generalizability depends on details such as eligibility, treatment delivery, and patient characteristics that are not fully described in the record.

The appropriate reading is bounded: the trial recorded the stated group means and an imprecise between-group estimate, while the registry’s own test reports p = 0.512. The summaries do not provide a precise estimate of an adherence advantage in either direction. Interpretation of efficacy, comfort, safety, and broader clinical relevance requires evidence beyond this primary endpoint and the details available in the registry record.

18. Why This Trial Matters Statistically

This trial illustrates the difference between estimating an effect and deciding whether a statistical test crosses a threshold. The primary estimate is 16.0 minutes, but its 95% confidence interval extends from -72.42 to 104.4. The interval communicates that the data are compatible with a range of differences, not merely a single point estimate. It also shows why a result that does not meet a conventional significance threshold should not be translated into proof of no difference.

The group summaries also make the role of variability visible. Standard deviations of 165.0 and 135.0 minutes indicate considerable spread in use, while the primary outcome groups are unequal in size. Both features affect the precision of a comparison. Reporting the estimate and interval alongside the group means gives a more informative statistical account than a p-value alone.

The record provides an opportunity to distinguish sponsor-reported analyses from summary-based recalculations. The reported primary p-value is 0.512; the recalculated p-value is 0.723. A transparent account notes both, explains what the recalculation uses, and avoids implying that the registry contains enough detail to reproduce every aspect of the sponsor’s analysis.

Finally, the trial raises broader issues common to clinical research: how adherence should be measured, how multiple outcomes are interpreted, and how missing observations and analysis populations affect confidence in results. The registry identifies these questions but does not report all the information needed to resolve them. That distinction between what results show and what remains undocumented is central to careful statistical interpretation.

19. Limitations

The primary outcome results are based on unequal group counts: 43 for Bi-Flex and 13 for CPAP. The registry reports enrollment of 60 but does not explain how that figure relates to the counts used for the primary endpoint. Without a participant-flow account, the reasons for the difference and the possible consequences for interpretation are unclear.

The primary endpoint has substantial observed variation and a broad confidence interval. The registry does not report a clinically important difference in minutes of use, so the practical importance of the range of compatible estimates cannot be determined from the record alone. The primary endpoint is measured at month 1, while the study is described as lasting 3 months; the registry does not provide a detailed account of adherence over the full study period in the posted primary result.

Important design and analysis details are absent. The record does not describe the randomization sequence, concealment, which roles were masked, the analysis population, missing-data methods, or sensitivity analyses. It labels masking as triple while the narrative uses double-blind, without identifying the masked roles. These gaps restrict assessment of potential bias and robustness.

The results available for secondary outcomes are incomplete, and no multiplicity procedure is reported. Some listed outcomes, including apnea hypopnea index and Pediatric Quality of Life, do not have detailed results in this record. The registry’s reported primary test also lacks an accompanying sponsor effect estimate and interval, making direct comparison with the summary-based recalculation limited. The single-center setting further narrows the context in which these results can be interpreted, while eligibility and treatment-delivery details are not fully reported.

20. Related Tutorials

21. Related Statistical Calculators

22. Sources

Continue through the Clinical Biostats statistical pathway

Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.

23. Record Summary

The registry describes a completed randomized, parallel-group study comparing Bi-Flex with CPAP in children with obstructive sleep apnea. The study summary identifies adherence as the primary objective and minutes of use per night at month 1 as the primary endpoint. Enrollment is listed as 60, and the primary outcome results are posted for 43 Bi-Flex participants and 13 CPAP participants.

The observed mean use was 185.0 minutes per night with Bi-Flex and 201.0 minutes with CPAP. The recalculated mean difference, CPAP minus Bi-Flex, was 16.0 minutes, with a 95% confidence interval from -72.42 to 104.4 and p = 0.723. The registry’s reported two-sided t-test gives p = 0.512. The interval is broad and includes no difference, so the primary comparison is imprecise.

Selected secondary results are posted, but several listed outcomes and key analysis details are not reported in the registry record. The available data describe the recorded comparison; they do not establish equivalence, answer every therapeutic question, or resolve the limitations associated with missing design and analysis information.

Clinical Biostats