Study to Validate the Instructions for Use of TOBI® Podhaler™ in Cystic Fibrosis Patients: Complete Statistical Analysis

1. Trial at a Glance

This page covers the registry results for Study to Validate the Instructions for Use of TOBI® Podhaler™ in Cystic Fibrosis Patients (NCT02178540), a na phase 4 study. The primary outcome is The Use of the Approved US TOBI Podhaler Instructions for Use (IFU) to Communicates the Information Necessary to Achieve Safe and Effective Use of the Podhaler Device.

2. Clinical Question

3. Trial Design

This was a completed, multicenter, human-factors engineering usability study listed as Phase 4. Its stated purpose was to validate the approved US instructions for use for TOBI Podhaler by assessing whether those instructions communicated information needed for safe and effective device use. The study began in 2014-08 and had primary completion in 2015-02. The sponsor was Novartis Pharmaceuticals.

The design was single-group, open label, and without a randomized allocation. Enrollment was 45. The open-label arm used placebo capsules with the Podhaler device; the arm description specifies one dose of four capsules. Because the capsules contained placebo, this assessment was not an evaluation of the clinical effect of inhaled tobramycin. The registry record identifies the device and placebo as interventions, while the assessment itself focused on participant interaction with the device and instructions.

The intended users were cystic fibrosis patients who had not previously used the Podhaler and were untrained in its use; caregivers were included if applicable. The record lists age groups of 6-10 years, 11-17 years, and at least 18 years, with 15 participants at risk in each group. It does not report further details about participant characteristics, caregiver participation, or how recruitment was conducted.

During the assessment, participants inhaled the contents of at least one capsule and completed a related human-factors assessment to qualify for the Full Analysis Set. The primary outcome description calls for recording use errors and close calls while inhaling one dose, then evaluating whether errors associated with six defined critical errors arose from unclear or ambiguous instructions. The registry record reports one outcome measure but no analyses. It does not report a comparison group, a statistical analysis plan, sample-size justification, or interim analyses.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Overall Study

Analysis population for the primary outcome, as defined in the registry: The Full Analysis Set (FAS) included all enrolled patients who completed an HF assessment as defined by completion of inhalation of the contents of at least one capsule and related HF assessment.

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

6. Primary Endpoint

The registry lists the primary outcome as The Use of the Approved US TOBI Podhaler Instructions for Use (IFU) to Communicates the Information Necessary to Achieve Safe and Effective Use of the Podhaler Device, measured over 1 Day.

The primary endpoint was the number of patients failing to understand the approved instructions for use. Its stated basis was the assessment of use errors and close calls during inhalation of one dose of placebo capsules with the Podhaler device. The endpoint description specifies that investigators were to examine root causes for six defined critical errors agreed with the FDA and determine which errors could be attributed to unclear or ambiguous instructions.

This endpoint addresses a usability question: whether the instructions communicate the actions needed to operate the device, as judged through observed use and assessment of errors. Counting patients classified as failing to understand the instructions can describe how often that interpretation occurred in the assessed group. It is different from measuring a drug’s effect on cystic fibrosis, and it is not a comparison of clinical outcomes between treatment groups.

The assessment timeframe was 1 Day. The Full Analysis Set included enrolled patients who completed a human-factors assessment, defined as inhaling the contents of at least one capsule and completing the related assessment. The registry record does not report the endpoint count, the number of patients classified as failing to understand the instructions, or a denominator for the posted endpoint result. It therefore does not show the observed frequency or precision of the primary outcome.

7. Why No Re-analysis Is Shown

8. Statistical Interpretation

9. Statistical Methods Explained

What kind of question does the design address?

Human-factors studies examine how people interact with a product and its instructions. In general, an observed use error can reflect several possible sources, including misunderstanding an instruction, difficulty carrying out an action, or another aspect of the use situation. The study description says investigators were to record errors and close calls and assess their root causes, specifically identifying errors attributable to unclear or ambiguous instructions. This causal classification is part of the endpoint definition; the registry record does not report how those judgments were made in practice or the results of the classification.

The single-group, open-label design means participants used the device without a randomized comparison group and without masking. Such a design can document observed use in the study setting, but it does not estimate a between-group treatment effect. In general, random allocation helps balance prognostic characteristics when comparing interventions; without that structure, a direct comparison with another device or instructions is not available. In this study there is no such comparison to interpret.

How should the primary endpoint be understood?

The endpoint is a count of patients failing to understand the instructions, with failure linked in the description to use errors or close calls attributed to inadequate clarity or ambiguity. It is not simply a count of all errors: the description distinguishes errors and close calls from those judged attributable to the instructions. That distinction matters because errors may occur for reasons other than a failure to understand the written material. The registry record identifies six defined critical errors agreed with the FDA, but does not list them or report the resulting classifications.

A count is interpretable only alongside a clear analysis population and denominator. The record defines the Full Analysis Set as enrolled patients who completed an assessment, operationalized as inhalation of at least one capsule and completion of the related assessment. It does not state how many enrolled patients were included in that set or report the primary count. Without both the count and the denominator, the observed frequency cannot be described. No confidence interval or other measure of precision for the primary endpoint is reported in the registry record.

What does an estimate and its uncertainty usually convey?

In general, a point estimate describes the observed value in the analyzed participants, while a confidence interval describes a range of values compatible with the data under the assumptions of the method. A narrower interval generally indicates greater precision, and a wider interval indicates greater uncertainty. These concepts would be relevant to a patient count or proportion if an estimate and interval were reported. No primary estimate or confidence interval appears in the registry record, so uncertainty about the primary endpoint cannot be quantified from the posted information.

The registry record reports one outcome measure and zero analyses. This means the posted record contains an endpoint description but no statistical result for it. It is not appropriate to infer a favorable or unfavorable result from the study purpose, the study’s completed status, enrollment, or the fact that an outcome was registered. Nor can a p-value or statistical significance be interpreted when no analysis is reported.

Why does the absence of a comparator matter?

In a comparative trial, an effect estimate typically contrasts outcomes between groups. Here, the design is single-group and allocation is not applicable. The placebo capsules were used during device assessment; they were not a separate control arm. Therefore, there is no randomized contrast between active and placebo treatment, or between competing sets of instructions. General causal claims about how one approach changes outcomes relative to another require an appropriate comparison and assumptions about bias. This record does not provide that comparison.

The use of placebo capsules also limits the scope of the question. It allows the described task to involve inhalation through the device without testing active tobramycin. That is suitable to the stated human-factors objective, but it means the study does not estimate a pharmacologic effect. The endpoint concerns device use and instruction comprehension, not disease outcomes.

How should sample-size planning be read?

In general, sample-size planning uses assumptions about the outcome, the effect worth detecting, variability, significance level, allocation, and the desired probability of detecting an effect if it exists. A planning illustration is not an observed result and does not establish that the study had a particular probability of finding a result. The registry record does not report the trial’s own sample-size justification or a statistical design for the primary usability endpoint. It also does not report a planned hypothesis test or a prespecified target difference for that endpoint.

What is missing from the statistical report?

The record does not report the primary outcome count, a denominator for that count, an estimate of precision, a test statistic, or an analysis population size. It does not describe statistical methods used to analyze the primary endpoint. As a result, interpretation should stop at the design and intended measurement: no numerical primary result can be reconstructed from the endpoint description or enrollment alone. General statistical principles can clarify what such results would mean, but they cannot supply an estimate absent from the registry record.

10. Multiplicity, Missing Data and Analysis Populations

The registry record lists one outcome measure and zero analyses. It does not report multiple primary endpoints or a series of inferential tests for which adjustment for multiplicity could be assessed. Multiplicity refers, in general, to the increased chance of false-positive findings when many hypotheses are tested. Without reported analyses, hypotheses, or p-values, it is not possible to determine whether multiplicity was relevant to the study’s actual analysis or whether any adjustment was used. The statistical analysis plan is not reported in the registry record.

Missing-data handling is also not described. The Full Analysis Set definition requires enrollment, completion of a human-factors assessment, inhalation of at least one capsule, and completion of the related assessment. The registry record does not state how many enrolled patients met this definition, whether any participants did not complete the assessment, how incomplete assessments were treated, or whether any data were imputed. These details matter because excluding participants with incomplete assessments can affect what population the endpoint describes.

The record does not report a primary endpoint result for either the enrolled group or the Full Analysis Set. Enrollment of 45 should not be treated as the endpoint denominator: the analysis-set definition is narrower, and its size is not reported. The record also does not describe a per-protocol population, sensitivity analyses, interim analyses, or methods for handling missing endpoint classifications. These items are not reported in the registry record, so their use cannot be assumed.

11. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 3% reporting threshold.

Most frequent serious adverse event terms

Serious events with the highest arm-level rate: bronchopneumonia (6.7%), pulmonary function test decreased (6.7%).

The safety entries list one serious event among 45 participants in the total group. The 6-10 years group lists one serious event among 15 participants; the 11-17 years and at least 18 years groups each list zero serious events among 15 participants. The listed serious-event terms are Bronchopneumonia and Pulmonary function test decreased, each reported at 6.7%. The record lists zero participants with other, non-serious events in each group shown.

These are descriptive safety counts, not a comparison between randomized treatments. The registry record does not report a control group, event attribution, timing, duration, or further detail about the seriousness assessment. The serious-event terms and percentages do not establish that the study device or placebo caused an event. Death counts are not reported in the registry record. Because the assessment concerned placebo use and device handling, these safety entries should be read separately from the unreported primary usability endpoint and not as evidence about active tobramycin treatment.

12. What the Result Does, and Does Not, Mean

The record establishes that a completed, single-group human-factors study enrolled 45 participants and assessed use of the TOBI Podhaler instructions with placebo capsules. It describes an intended evaluation of errors and close calls, including a root-cause assessment for six defined critical errors agreed with the FDA. It also defines the Full Analysis Set by completion of an inhalation and related assessment. These details clarify what the study set out to evaluate and the setting in which participants used the device.

However, the record does not report the primary endpoint result. There is no posted count of patients judged to have failed to understand the instructions, no analysis-set denominator for that outcome, and no reported statistical analysis. Consequently, the record does not show how frequently instruction-related failures occurred or how precisely that frequency was estimated. Completion of the study and enrollment of participants do not establish the result of the primary assessment.

The study also does not compare the approved instructions with another instruction set or device. Its single-group design cannot estimate a comparative effect, and the placebo capsules mean it does not test the clinical effect of active tobramycin. The stated purpose is instruction usability, rather than clinical efficacy in cystic fibrosis. Any conclusions should remain within those boundaries.

The safety entries describe one serious event overall and provide serious-event terms, but do not establish causation. They are separate from the missing primary usability result. The record does not report the trial’s sample-size justification, statistical analysis plan, missing-data methods, or interim analyses. These omissions limit assessment of how the endpoint was analyzed and how representative the analyzed participants were.

Overall, the posted information supports a description of the study question, design, eligibility for the Full Analysis Set, and reported safety counts. It does not support a conclusion about whether the instructions successfully communicated device-use information, because the primary outcome result is not reported in the registry record. This is a limitation of the posted result, not a basis for inferring that the instructions succeeded or failed.

13. Why This Trial Matters Statistically

This study illustrates a statistical distinction between evaluating a clinical treatment and evaluating how people use a medical device. The endpoint was not a disease outcome or a comparison of active treatment with control. It concerned whether patients understood instructions while using a device, with errors and close calls assessed for attribution to unclear or ambiguous wording. Recognizing the question being measured is essential before interpreting a study’s numbers.

It also shows why endpoint definitions and analysis populations matter. The record defines failure through an assessment of use and root causes, and it gives a specific Full Analysis Set definition. Those details identify what was intended to count, but they do not reveal how many participants were analyzed or what the endpoint result was. An enrollment total alone cannot answer either question.

The single-group design makes the study descriptive rather than comparative. Without another instruction set or device as a control, the record cannot estimate a difference between approaches. This is not necessarily a flaw for every usability objective; it does mean that the scope of statistical conclusions must match the design. The study’s purpose and the data needed to answer that purpose should be distinguished from questions about clinical efficacy.

Finally, a registry record can describe a completed study and its planned outcome while still lacking a posted analysis. Here, the primary endpoint is specified, but the record lists no analyses and does not give the endpoint result. That gap limits independent statistical interpretation. For researchers, it emphasizes the importance of reporting outcome counts, analysis populations, and methods alongside a clear endpoint definition. Without those elements, readers can understand what was intended to be measured but cannot assess the observed finding or its precision.

14. Limitations

• The posted summary statistics are the only data these results rest on; patient-level data, full protocols and statistical analysis plans are not available.
• Recalculated results are simple, unadjusted calculations from posted summaries. They do not replace the sponsor's prespecified analysis.

The most important limitation for interpretation is that the primary endpoint result is not reported in the registry record. The outcome measure is described, but no count of patients failing to understand the instructions, denominator, estimate, or uncertainty measure is posted. The record reports one outcome measure and zero analyses, so the intended usability question cannot be answered from the posted results.

The study was single-group, open label, and had no randomized comparator. It therefore cannot estimate a difference between the approved instructions and another set of instructions, device, or training approach. The record also does not describe a comparison against usual use or a benchmark. Results from this assessment, even if reported elsewhere, would pertain to the study setting and its defined usability assessment rather than a randomized treatment contrast.

Enrollment was 45, but the size of the Full Analysis Set is not reported. The stated analysis-set definition requires completion of an assessment involving inhalation of at least one capsule and the related assessment. The record does not say how many participants met this definition, whether any participants were excluded, or how incomplete assessments were handled. Participant characteristics beyond the listed age groups and group counts are not reported in the registry record.

The assessment used placebo capsules, so it does not evaluate the clinical effect of active tobramycin. The record does not report the detailed process for classifying errors, the results for each of the six defined critical errors, or the statistical analysis plan. It also does not report sample-size justification, interim analyses, or methods for missing data. These gaps limit evaluation of the endpoint’s implementation, the precision of any result, and the robustness of an analysis. The listed adverse-event information is descriptive and does not establish causation.

15. Related Tutorials

16. Related Statistical Calculators

17. Sources

• ClinicalTrials.gov: Study to Validate the Instructions for Use of TOBI® Podhaler™ in Cystic Fibrosis Patients — NCT02178540.
• Registry record last updated 2016-05-23; status last verified 2016-04.
• Results first posted 2016-05-23.
• Data retrieved from ClinicalTrials.gov on 2026-11-09.
• Group sizes, means, event counts and sponsor-reported p-values are reproduced as posted. Effect estimates, confidence intervals and p-values not attributed to the sponsor are independently calculated from the posted summary statistics.

18. Record Summary

NCT02178540 is a completed, Phase 4, multicenter human-factors usability study sponsored by Novartis Pharmaceuticals. It enrolled 45 participants with cystic fibrosis and assessed the approved US TOBI Podhaler instructions for use in a single-group, open-label design. Participants used the device with placebo capsules; the arm description specifies one dose of four capsules.

The primary outcome was the number of patients failing to understand the instructions, based on recorded use errors and close calls and root-cause assessment for six defined critical errors. The registry record lists one outcome measure and no analyses. It does not report the primary outcome result, analysis-set size, or statistical analysis. Safety entries list one serious event among 45 participants overall, serious-event terms each reported at 6.7%, and no other events in the listed groups. Death counts are not reported in the registry record.