← Clinical Trials
Dry Eye NA Continuous Endpoint NCT02470429

Evaluation of Clinical Outcomes After the Use of SYSTANE® HYDRATION: Complete Statistical Analysis

This randomized, double-masked, parallel-group trial compared SYSTANE HYDRATION with Hyabak 0.15% for change in total ocular surface staining at Day 42. The posted results also include three secondary outcomes, while the registry record does not report a named analysis plan or secondary-outcome analyses.

Trial start: 2015-07-17  ·  Enrollment: 114  ·  Sponsor: Alcon Research
Scope of this record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.

1. Trial at a Glance

This page covers the registry results for Evaluation of Clinical Outcomes After the Use of SYSTANE® HYDRATION (NCT02470429), a randomized na study. The primary outcome is Change From Baseline in Total Ocular Surface Staining (TOSS) Score at Day 42.

114
Enrollment
NA
2
Arms
In the primary outcome
0.24
Mean difference
Hyabak 0.15%
-0.41–0.89
95% CI
Two-sided
FeatureRegistry value
ClinicalTrials.gov identifierNCT02470429
PhaseNA
ConditionDry Eye
AllocationRandomized
Design modelParallel
MaskingDouble
Enrollment114
Arms in the primary outcome2
Lead sponsorAlcon Research
Results postedYes

2. Clinical Question

Population

The study concerned subjects with dry eye. The registry record reports enrollment of 114 participants and describes the primary analysis population as the ITT Analysis Set, with the number analyzed defined as participants with a non-missing response. The primary endpoint analysis included 48 participants in the SYSTANE HYDRATION arm and 49 in the Hyabak 0.15% arm.

Intervention

The intervention of interest was SYSTANE HYDRATION lubricant eye drops. The arm description specifies 1 drop 4 times per day in each eye for 42 days. The listed intervention type is DEVICE.

Comparator

The active comparator was Hyabak 0.15% eye drops, also described as 1 drop 4 times per day in each eye for 42 days. The registry record additionally lists 0.9% saline eye drops as an intervention, but the posted primary outcome results give values for SYSTANE HYDRATION and Hyabak 0.15% only.

Primary question

The central comparison was change from baseline in total ocular surface staining score at Day 42. The endpoint combines staining grades across three ocular-surface areas in one study eye. The posted mean changes were -1.16 for SYSTANE HYDRATION and -0.92 for Hyabak 0.15%; a more negative change is described as indicating greater efficacy. The unadjusted comparison does not establish a clear difference between the arms: its confidence interval spans values on either side of zero, and its unadjusted p-value is 0.47.

3. Trial Design

The registry record describes a randomized, double-masked, parallel-group study. Its title is Evaluation of Clinical Outcomes After the Use of SYSTANE® HYDRATION, and the official title specifies subjects with dry eye. The study is marked completed; its phase is listed as NA. The sponsor is Alcon Research.

Enrollment was 114. The primary endpoint timeframe was baseline, identified as Day 0, through Day 42. The two reported primary-outcome arms were SYSTANE HYDRATION and Hyabak 0.15%. Each arm description specifies one drop in each eye four times per day for 42 days. Although 0.9% saline eye drops appear in the intervention list, the primary outcome results presented in the registry record are for the two named eye-drop arms.

Allocation is recorded as randomized, masking as double, and the model as parallel. The record does not specify who was masked or provide further details about the randomization procedure, allocation concealment, or conduct of masking. Those design details are not reported in the registry record.

The primary analysis population is identified as the ITT Analysis Set, and the outcome description says the number analyzed is the number of subjects with a non-missing response. The posted primary outcome has 48 analyzed participants in the SYSTANE HYDRATION arm and 49 in the Hyabak 0.15% arm. The registry record does not give a participant-flow account explaining the difference between overall enrollment and these outcome-specific analyzed counts.

Three secondary outcomes are also listed: change in IDEEL Treatment Effectiveness Score, change in IDEEL Treatment Inconvenience Score, and change in Tear Film Break-up Time. All are assessed at Day 42. The registry record does not report the original sample-size justification or the trial's own statistical analysis plan.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Before assignment: Of the 114 enrolled, 15 subjects were exited as screen failures prior to randomization. This reporting group includes all randomized subjects (99).

Overall Study

StageSYSTANE HYDRATIONHyabak 0.15%
STARTED5049
COMPLETED4849
NOT COMPLETED20

Reasons for not completing this period:

ReasonSYSTANE HYDRATIONHyabak 0.15%
Adverse Event10
Withdrawal by Subject10

Analysis population for the primary outcome, as defined in the registry: ITT Analysis Set. Number Analyzed is the number of subjects with non-missing response.

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

Population: This analysis population includes all subjects who were exposed to study drug (including the run-in therapy) (Safety Analysis Set).

CharacteristicUnitSYSTANE HYDRATIONHyabak 0.15%Total
Participants analysed504999
Age, Continuousyears61.7 (SD 12.29)56.7 (SD 14.29)59.2 (SD 13.49)
Sex: Female, Male: FemaleParticipants413879
Sex: Female, Male: MaleParticipants91120
Total Ocular Surface Staining (TOSS) Scoreunits on a scale5.26 (SD 1.411)4.98 (SD 1.090)5.12 (SD 1.264)
IDEEL Treatment Score: Treatment Effectivenessunits on a scale52.04 (SD 29.602)51.56 (SD 28.641)51.80 (SD 28.979)
IDEEL Treatment Score: Treatment Inconvenienceunits on a scale83.42 (SD 17.749)81.90 (SD 17.829)82.67 (SD 17.712)
Tear Film Break-up Time (TFBUT)seconds3.20 (SD 2.010)3.58 (SD 2.222)3.39 (SD 2.115)

6. Primary Endpoint

The registry lists the primary outcome as Change From Baseline in Total Ocular Surface Staining (TOSS) Score at Day 42, measured over Baseline (Day 0), Day 42.

ElementRegistry entry
Result typeLeast Squares Mean
Measure of spreadStandard Error
Unitunits on a scale
Endpoint classificationContinuous Endpoint

The primary endpoint is change from baseline in Total Ocular Surface Staining (TOSS) score at Day 42. The score is described as a cumulative cornea and conjunctival staining measure. After ophthalmic dye is instilled, an investigator grades three ocular-surface areas for dryness, with each area scored from 0, meaning absent, to 5, meaning severe. The three grades are summed to form an overall score on a 0–15 scale. One eye, designated the study eye, contributed to the analysis.

The endpoint captures staining observed on the ocular surface rather than relying only on a participant's description of symptoms. Change from baseline expresses how the score at follow-up differs from the baseline measurement. The registry description states that a more negative change indicates greater efficacy, so the direction of change matters when reading the arm means. It does not, by itself, determine whether a difference between arms is precise or whether an observed difference is attributable to treatment.

The posted arm estimates are least-squares means, with standard errors as the measure of dispersion. The registry record identifies the analysis population as the ITT Analysis Set and says participants without a non-missing response are not counted in the number analyzed. Details of how the least-squares means were modeled are not reported in the registry record.

7. Results Posted in the Registry

Mean difference: Hyabak 0.15%

0.24

95% CI: -0.41 to 0.89

Recalculated from the posted summary statistics

Primary outcome by arm, with 95% confidence intervals
Primary outcome by arm with 95% confidence intervals-1.7-1.5-1.2-0.9-0.6-0.4SYSTANE HYDRATION (n=48)Hyabak 0.15% (n=49)units on a scale (95% CI)
Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)Hyabak 0.15%-0.52-0.210.090.390.691.00mean difference vs control (95% CI)

8. Secondary Efficacy Endpoints

The registry also posts results for secondary outcomes. For each outcome below, the endpoint type, the test applied to the posted summary statistics, the result and its interpretation are given in turn. Secondary endpoints are usually not adjusted for multiple testing, so they support rather than confirm the primary finding.

Secondary outcomeTypeEffect measureEstimate (95% CI)Planning size, 80% power
Change From Baseline in IDEEL Treatment Effectiveness Score at Day 42Continuous EndpointMean difference3.18 (-5.63 to 11.99)746 per arm
Change From Baseline in IDEEL Treatment Inconvenience Score at Day 42Continuous EndpointMean difference12.56 (6.41 to 18.71)24 per arm
Change From Baseline in Tear Film Break-up Time (TFBUT) at Day 42Continuous EndpointMean difference0.29 (-0.75 to 1.33)1,273 per arm

Change From Baseline in IDEEL Treatment Effectiveness Score at Day 42

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)Hyabak 0.15%-7.04-2.951.145.229.3113mean difference vs control (95% CI)

Change From Baseline in IDEEL Treatment Inconvenience Score at Day 42

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)Hyabak 0.15%-1.502.847.19121620mean difference vs control (95% CI)

Change From Baseline in Tear Film Break-up Time (TFBUT) at Day 42

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)Hyabak 0.15%-0.92-0.430.050.531.011.50mean difference vs control (95% CI)

The three secondary outcomes cover participant-reported IDEEL treatment effectiveness, participant-reported IDEEL treatment inconvenience, and tear film break-up time. Together, they broaden the set of outcomes beyond ocular-surface staining: the IDEEL measures address treatment experience, while TFBUT is an additional tear-film measure. Their overall pattern is not uniform. The recalculated contrasts differ in direction and precision, and only the inconvenience-score comparison has an unadjusted interval that excludes zero and an unadjusted p-value below 0.001.

That pattern does not overturn or settle the primary result. The primary endpoint is the stated main comparison, and its unadjusted interval spans zero. Secondary endpoints can provide additional context, but they do not substitute for a clear and well-specified primary analysis. The different measures also capture different aspects of the study, so a result on one should not automatically be interpreted as confirmation of a result on another.

The registry record does not report named statistical analyses for the secondary outcomes. The posted comparisons are simple unadjusted recalculations from summary statistics, and the record does not state whether the original protocol specified a testing hierarchy or multiplicity control. When several outcomes are examined, the chance of finding at least one apparently unusual result can increase if each is tested independently without adjustment. In general, multiplicity procedures can limit that risk, but no such procedure is reported in the registry record.

For that reason, the secondary results carry less inferential weight than a prespecified, multiplicity-controlled analysis would. Their unadjusted p-values should be viewed as descriptive signals rather than definitive evidence. The registry record does not report whether these measures were designated as confirmatory or exploratory, so their intended role cannot be established. A reader should consider the coherence of the outcomes and the uncertainty around each comparison, while avoiding a single-result focus.

The registry record lists three secondary endpoints and reports values for each, but does not provide a multiplicity plan, analysis population details beyond the outcome-level analyzed counts, or a detailed model specification. These gaps make it difficult to determine how the secondary findings relate to any original inferential strategy. They are useful as supplementary descriptions of the posted results, but not as a replacement for the primary endpoint's uncertain comparison.

Secondary outcomes registered for this trial, for reference (only those above were recalculated):

9. Statistical Interpretation

Clinical Biostats interpretation

At Day 42, the posted mean change in TOSS was -1.16 for SYSTANE HYDRATION and -0.92 for Hyabak 0.15%. Because the endpoint description defines a more negative change as indicating greater efficacy, the arm estimates are directionally more negative for SYSTANE HYDRATION. That descriptive contrast should be read alongside its uncertainty, rather than treated on its own as evidence of a dependable difference.

The unadjusted mean difference, expressed as Hyabak 0.15% minus SYSTANE HYDRATION, is 0.24. Its confidence interval includes values below and above zero, and the unadjusted p-value is 0.47. In general, a confidence interval that spans zero is compatible with no difference as well as with differences in either direction under the assumptions used to construct it. The posted results therefore do not precisely distinguish the arm means. They do not establish equivalence: the registry record does not report an equivalence margin or a non-inferiority margin.

These comparisons are simple unadjusted recalculations from the posted summary statistics. The registry record reports no named statistical analyses for this endpoint, and no adjustment details are given. The comparison should not be mistaken for a detailed account of the trial's original analysis procedure. The arm means are reported as least-squares means with standard errors, but the modeling that produced those least-squares means is not described in the registry record.

The analyzed primary-outcome counts were 48 and 49. These outcome-specific counts are not identical to the overall enrollment figure of 114, and the record does not provide enough participant-flow detail to explain every difference. The record defines the number analyzed as those with non-missing response, but it does not describe how missing outcome values were handled beyond that definition. The analysis population label is ITT Analysis Set; that label alone does not reveal how missing data or deviations from assigned treatment were addressed.

For interpretation, the central statistical point is the combination of the direction of the observed estimates and the breadth of the uncertainty around the between-arm contrast. The estimate favors a more negative change in the SYSTANE HYDRATION arm by the endpoint's stated direction, but the interval and unadjusted p-value do not provide strong separation of the arm results. This is a statement about the posted estimates and their precision, not a conclusion about clinical importance. The registry record does not report a threshold for a clinically important TOSS difference.

There are no posted registry analyses beyond the reported outcome summaries and the comparisons recalculated from them. The comparison should therefore be read as a transparent, unadjusted description of the posted numbers, not as confirmation of a prespecified test or a complete report of the trial's statistical plan. The record also lists 0.9% saline as an intervention, but no corresponding primary outcome arm estimate appears in the posted results; the two-arm comparison cannot be extended to that intervention.

10. Statistical Methods Explained

The primary outcome is continuous: it is a numeric change score rather than a count or a time until an event. The registry record reports a least-squares mean for each arm and a standard error. A least-squares mean is generally a model-based estimate of an arm average; the exact model, covariates, and assumptions used for these estimates are not reported in the registry record. The reported standard error describes uncertainty in an estimated mean, not the spread of individual participants' scores.

What does the arm comparison represent?

The comparison is expressed as the mean for Hyabak 0.15% minus the mean for SYSTANE HYDRATION. The posted estimate is 0.24. A positive value under this ordering means the Hyabak estimate is numerically higher, while the primary endpoint description says that more negative change indicates greater efficacy. The subtraction order is important: reversing the arm order would reverse the sign without changing the underlying contrast.

The comparison and confidence interval are simple unadjusted recalculations from the posted summary statistics. They do not incorporate an adjustment for additional variables, and the registry record does not describe the model used for the posted least-squares means. The discrepancy indicator is false, so the recalculated contrast does not conflict with a sponsor analysis recorded in the registry record for this trial. The registry record nevertheless lists zero reported analyses, so it does not identify a sponsor-run inferential analysis to use as the primary account.

What do the standard errors and interval convey?

In general, a standard error quantifies the sampling uncertainty of an estimated mean. It is not the same as a standard deviation, which describes variation among individual observations. The arm standard errors for the primary outcome are 0.24 and 0.23. In general, a confidence interval gives a range of values compatible with the data and the method's assumptions; it is not a guarantee that the true value lies in that range. The interval for the arm contrast extends on both sides of zero, so the posted summary does not sharply locate the contrast in one direction.

The recalculated pooled standard deviation is approximate. The posted outcome estimates are least-squares means and their dispersion is reported as standard error, rather than as standard deviation. A standard deviation used for standardized-effect and planning calculations was therefore approximated from these summaries. Any standardized-effect value or planning illustration based on that approximation should be interpreted as an aid to understanding, not as a directly reported trial estimate.

Why can over-dispersion matter?

In general, over-dispersion means that variability in the observed data is greater than a model assumes. When a model understates variability, it can make standard errors too small and intervals too narrow, giving an overly precise impression. When variability is modeled appropriately, uncertainty estimates better reflect the scatter in the data. The registry record does not report a dispersion check or an over-dispersion adjustment for this continuous endpoint, so no claim can be made about whether such a check was performed. This general issue is relevant whenever a statistical model's assumptions determine the reported uncertainty.

What does the p-value add?

The unadjusted p-value for the primary comparison is 0.47. In general, a p-value measures how unusual data at least as inconsistent with a specified null hypothesis would be if that hypothesis and the test assumptions held. It does not measure the probability that the null hypothesis is true, the probability that the result occurred by chance, or the clinical importance of an estimate. The registry record does not report the test procedure or a multiplicity adjustment for this comparison. The p-value should therefore be read with the estimate and its interval, not as a standalone verdict.

The comparison is unadjusted, meaning no reported adjustment is reflected in the recalculated contrast. The registry record does not state whether a different adjustment was prespecified in the trial plan. It also does not give the original sample-size assumptions. The trial's own design assumptions are not reported in the registry record; the planning illustrations use a separate set of stated assumptions and must not be attributed to the original protocol.

How should the analysis population be understood?

The primary outcome identifies the ITT Analysis Set and defines the number analyzed as participants with a non-missing response. The analyzed counts are 48 for SYSTANE HYDRATION and 49 for Hyabak 0.15%. In general, an intention-to-treat approach aims to retain participants in their assigned groups, but the label alone does not establish how missing values were treated or whether every randomized participant contributed to the endpoint analysis. The missing-data method, handling of protocol deviations, and details of the analysis population are not reported in the registry record.

The record describes one study eye contributing to the TOSS analysis, which avoids treating two eyes from one person as if they were independent observations for this endpoint. The precise rule for selecting that eye and any other analysis details are not reported in the registry record. These omissions limit how fully an independent reader can reproduce or audit the analysis from the registry outcome summary alone.

11. Confidence Intervals and Precision

The primary arm means are -1.16 for SYSTANE HYDRATION and -0.92 for Hyabak 0.15%. The recalculated mean difference is 0.24, with a confidence interval that runs from a negative value to a positive value. Because zero lies within that interval, the range of values supported by the posted summary includes no between-arm difference as well as differences in either direction. The unadjusted p-value is 0.47.

In general, a confidence interval communicates both the direction and the precision of an estimate. A narrow interval concentrates support around a smaller range of values; a wider interval leaves more possible values compatible with the data and method. Here, the interval does not narrow the contrast to a single direction. The point estimate alone is therefore a limited description of the comparison, and its direction should not be confused with certainty about the underlying difference.

The reported arm standard errors are 0.24 and 0.23. These describe uncertainty around the least-squares means, while the interval for the comparison concerns the difference between those means. The registry record does not report the full model or adjustment procedure behind the least-squares means, and the recalculated interval is unadjusted. Precision should be understood in that context.

The comparison does not establish that the treatments are equivalent. Equivalence requires a prespecified range of differences considered acceptably small and an analysis designed to assess that range; neither is reported in the registry record. Nor does the interval alone identify which differences would matter clinically, because a clinically important TOSS threshold is not reported. The available precision supports a cautious description of the observed contrast, not a definitive claim of sameness or separation.

12. Planning a Similar Trial: Sample Size

This is a planning illustration, not a re-evaluation of the original trial. It asks: if a new study wanted to detect a difference like the one observed, or a smaller one, how large would it need to be? It is deliberately not “observed power” of the finished trial, which is not a meaningful quantity.

Effect to detectParticipants per arm, 80% powerParticipants per arm, 90% power
100% of the observed effect730977
75% of the observed effect1,2981,737
50% of the observed effect2,9193,908
Sample size needed versus the size of the effect to detect
Sample size needed versus size of effect to detect5001,0002,0005,00010,00040%60%80%100%80% power90% powersize of effect to detect, as % of the effect observed (log vertical scale: participants per arm)
Treat these figures cautiously. The observed difference is imprecise: its confidence interval includes no difference at all. A sample size built on a noisy estimate can be far too small or too large, so the smaller-effect rows are the more cautious guide.
Method and assumptions. Two-sided α = 0.05, 1:1 allocation, two-sample comparison of means with the pooled standard deviation. Standard deviation was approximated from model-based standard errors, so treat it as rough. Calculated for the comparison: Hyabak 0.15%.

The sample-size figures are planning illustrations based on the observed effect, not the trial's own original design assumptions. They use a two-sided significance level of 0.05, equal allocation between two arms, and a normal approximation. The listed effect to detect is a stated fraction of the observed effect: 100%, 75%, or 50%. The figures are participants per arm for the continuous outcomes, not total event counts.

The 80% power column indicates the number of participants per arm that the planning calculation estimates would be needed to have an 80% chance of detecting the specified effect under the stated assumptions, if that effect and the calculation assumptions hold. The 90% power column gives the corresponding planning number for a 90% chance. These percentages describe the design calculation, not the probability that a result in this trial is true or that a treatment has a particular effect.

Across the listed rows, planning for a smaller fraction of the observed effect requires more participants per arm. This is expected in general: smaller differences are harder to distinguish from random variation when measurement variability and other assumptions remain fixed. The figures depend on the observed effect used as their starting point, so they are sensitive to how precisely that effect was estimated in this trial.

The sample-size assumptions for the original trial are not reported in the registry record. These calculations are not observed power; they are hypothetical planning illustrations based on the observed contrast and the stated assumptions. They should not be read as evidence that the original design used these targets, nor as a retrospective judgment about whether the trial was adequately designed.

The plotted curve represents the same planning relationship across effect assumptions. It should be read as an illustration of how the required per-arm sample size changes with the effect being targeted, not as a new analysis of participant outcomes. No additional exact values need to be inferred from the curve beyond the listed planning figures.

13. How the Sample Size Is Derived

Power is the probability that a study of a given size rejects the null hypothesis when a specific true effect exists. It depends on four things: the effect to detect, the variability of the outcome, the significance level (here a two-sided α of 0.05, so z1−α/2 = 1.960) and the desired power (z1−β = 0.842 for 80% and 1.282 for 90%).

Formula

n = 2 (z1−α/2 + z1−β)2 σ2 / Δ2

n is the number of participants in each arm, Δ is the difference in means to detect and σ is the common standard deviation.

Worked calculation for this trial

  1. Observed difference Δ = 0.240; pooled standard deviation σ = 1.636.
  2. n = 2 × (1.96 + 0.842)2 × 1.6362 / 0.2402 = 729.7, rounded up to 730 participants per arm for 80% power.

The smaller-effect rows in the table above repeat the same calculation with the effect multiplied by 0.75 and 0.5 (for ratios, applied to the logarithm of the ratio).

R code

alpha <- 0.05
z_a   <- qnorm(1 - alpha / 2)          # two-sided
delta <- 0.24                      # observed difference in means
sigma <- 1.6363193614425                     # pooled standard deviation
n_per_arm <- function(power, frac = 1) {
  ceiling(round(2 * (z_a + qnorm(power))^2 * sigma^2 / (delta * frac)^2, 6))
}
for (f in c(1, 0.75, 0.5))
  cat(sprintf("%3.0f%% of observed effect: n per arm = %s (80%% power), %s (90%% power)\n", 100 * f,
              format(n_per_arm(0.80, f), big.mark = ","), format(n_per_arm(0.90, f), big.mark = ",")))

# Check against R's built-in function (t-based, so very slightly larger)
cat("power.t.test:", round(power.t.test(delta = delta, sd = sigma, power = 0.80)$n, 1), "\n")

# Simulation: exact two-sample t-test using simulated means and variances
set.seed(2470429)
n    <- n_per_arm(0.80)
reps <- 20000
m_diff <- rnorm(reps, delta, sigma * sqrt(2 / n))             # difference in sample means
s2     <- sigma^2 * rchisq(reps, 2 * (n - 1)) / (2 * (n - 1))   # pooled sample variance
tstat  <- m_diff / sqrt(s2 * 2 / n)
cat(sprintf("Simulated power at n = %s per arm: %.3f (%d replicates)\n", format(n, big.mark = ","), mean(abs(tstat) > qt(0.975, 2 * (n - 1))), reps))

Output from running the code

100% of observed effect: n per arm = 730 (80% power), 977 (90% power)
 75% of observed effect: n per arm = 1,298 (80% power), 1,737 (90% power)
 50% of observed effect: n per arm = 2,919 (80% power), 3,908 (90% power)
power.t.test: 730.7 
Simulated power at n = 730 per arm: 0.803 (20000 replicates)

The simulation draws many sets of group means and variances at the planned sample size and counts how often the two-sample t-test rejects the null. It should land close to the target power; at very small required sample sizes it can fall below it, because the normal approximation is rough there.

14. Multiplicity, Missing Data and Analysis Populations

The registry record does not report a statistical analysis plan describing how the primary and secondary endpoints were to be tested. It lists three secondary outcomes, but does not specify a testing hierarchy, a family of hypotheses, or an adjustment for multiple comparisons. The posted secondary p-values are unadjusted recalculations. In general, examining multiple outcomes without controlling multiplicity can raise the chance that at least one result appears statistically unusual even when the underlying effects are absent or small. The record does not say whether the original trial used a multiplicity procedure.

The primary endpoint is identified as an ITT Analysis Set outcome, with the number analyzed defined as participants with a non-missing response. The primary outcome counts are 48 and 49. However, the registry record does not report a participant-flow description that accounts for all enrolled participants, nor does it describe whether missing outcomes were imputed, excluded under any additional rule, or addressed through sensitivity analyses. The definition of the analyzed count clarifies who contributes a response, but not the method for handling absent responses.

The record also does not provide details on protocol deviations, treatment adherence, or how the analysis population was maintained after randomization. Those details are not reported in the registry record. The ITT label should not be treated as proof that all enrolled or randomized participants contributed data to the endpoint estimate, since the record explicitly defines the analyzed count by response availability.

The registry record lists zero reported analyses. This means it does not present a named analysis procedure for the endpoints; it does not establish that no analysis was conducted during the trial. The original sample-size justification, interim-analysis plan, and rules for stopping or modifying analyses are not reported in the registry record. No assumptions about those procedures can be inferred from the posted outcome summaries.

These omissions matter because the interpretation of an estimate depends not only on its numerical value but also on how outcomes, missing data, and multiple testing were handled. The published registry summaries permit a descriptive comparison and simple unadjusted recalculations, but they do not support a full audit of the original analysis strategy.

15. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

ArmParticipants with serious adverse eventsParticipants at riskPercentage
Pretreatment01140.0%
SYSTANE HYDRATION1502.0%
Hyabak 0.15%1492.0%
Participants with at least one serious adverse event
Serious adverse events by armPretreatment0.0%SYSTANE HYDRATION2.0%Hyabak 0.15%2.0%% of participants with at least one serious adverse event

Deaths

ArmDeaths (participants affected of at risk)
Pretreatment0 of 114
SYSTANE HYDRATION0 of 50
Hyabak 0.15%0 of 49

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 5% reporting threshold.

ArmParticipants affected of at risk
Pretreatment2 of 114
SYSTANE HYDRATION12 of 50
Hyabak 0.15%6 of 49

Most frequent serious adverse event terms

Event termOrgan systemPretreatmentSYSTANE HYDRATIONHyabak 0.15%
Intervertebral disc operationSurgical and medical procedures0 of 1140 of 501 of 49
CholelithiasisHepatobiliary disorders0 of 1141 of 500 of 49

Most frequent non-serious adverse event terms

Event termOrgan systemPretreatmentSYSTANE HYDRATIONHyabak 0.15%
Eye irritationEye disorders0 of 1145 of 503 of 49
NasopharyngitisInfections and infestations1 of 1145 of 501 of 49
Vision blurredEye disorders0 of 1145 of 501 of 49
HeadacheNervous system disorders1 of 1140 of 503 of 49

Serious events with the highest arm-level rate: intervertebral disc operation (2.0%), cholelithiasis (2.0%).

Do not overextend the safety comparison. Serious-adverse-event counts are safety observations, not efficacy outcomes, and should not be combined with the primary result into a single benefit-risk number.

The registry record reports serious adverse events by group. In the pretreatment group, 114 participants were at risk and 0 were reported with a serious adverse event. In the SYSTANE HYDRATION group, 50 were at risk and 1 was reported with a serious adverse event. In the Hyabak 0.15% group, 49 were at risk and 1 was reported with a serious adverse event. The record reports 0 deaths in each of these groups.

The serious-event figures are counts within the groups, not comparisons adjusted for differences in exposure or other factors. The pretreatment group is a distinct record category and should not be interpreted as a concurrent treatment arm. The registry also lists Intervertebral disc operation and Cholelithiasis among top serious-event terms, each at 2.0%; it does not provide enough context in these summaries to assign those terms to a particular treatment group.

These numbers describe what was recorded in this trial and do not, by themselves, establish that an event was caused by a treatment or that the groups have different safety profiles. The registry record does not provide further detail about event timing, duration, relatedness assessments, or exposure-adjusted comparisons.

16. What the Result Does, and Does Not, Mean

The posted primary results describe a change in TOSS over the study period for the two reported arms. The SYSTANE HYDRATION mean change is more negative than the Hyabak 0.15% mean change, and the endpoint description says that a more negative value indicates greater efficacy. The recalculated between-arm difference is 0.24 when expressed as Hyabak minus SYSTANE HYDRATION. Its unadjusted confidence interval spans zero, and the unadjusted p-value is 0.47. These statistics describe an uncertain comparison rather than a precise separation of the arm results.

The result does not show that the arms are equivalent, because the registry record does not report an equivalence margin or a design intended to demonstrate equivalence. It also does not establish that either arm is superior. The interval includes values in both directions, and the record does not report a clinically important difference threshold that would help determine the practical importance of the estimated contrast.

The result applies to the posted outcome analysis in this study: a Day 42 change in a staining score, based on one study eye and analyzed among participants with non-missing responses. It should not be generalized automatically to other populations, timeframes, outcomes, or interventions. In particular, although saline appears in the intervention list, no saline primary outcome estimate is included in the posted results described in the registry record.

The secondary endpoints add information about treatment experience and tear-film break-up time, but their unadjusted results do not repair the primary comparison's uncertainty. The registry record does not report a multiplicity strategy or identify the confirmatory status of those outcomes. Similarly, the adverse-event counts provide a descriptive account of serious events recorded in the groups; they do not prove causality or establish comparative safety.

The registry record also lacks details needed to reconstruct the original statistical analysis fully, including the model specification, missing-data handling, and original sample-size justification. A responsible interpretation stays close to the posted estimates, uncertainty, and design information, while treating unreported procedures as unknown rather than assuming how they were handled.

17. Why This Trial Matters Statistically

This trial illustrates why a directionally different point estimate is not the same as a precise treatment contrast. The primary outcome means are not identical, and the endpoint's scoring direction gives a clear way to describe which arm's estimate is more negative. But the confidence interval spans values on both sides of zero. Reading the estimate together with its uncertainty prevents the direction alone from carrying more weight than the data support.

It also shows the value of distinguishing model-based arm summaries from direct measures of participant-level variability. The registry reports least-squares means and standard errors, not standard deviations. The standardized-effect and planning illustrations therefore depend on an approximate pooled standard deviation derived from those summaries. This is a practical reminder that downstream calculations can involve additional assumptions when the original report does not provide every statistic needed directly.

Several outcomes are posted, yet the registry record does not describe a multiplicity plan or identify which secondary analyses were confirmatory. When many outcomes are considered, isolated unadjusted findings require restraint. The secondary endpoints may provide useful context, but they should not be treated as independent confirmation without a prespecified analysis framework.

Finally, the registry record contains meaningful gaps for statistical interpretation: no named analyses, no original sample-size justification, no detailed missing-data method, and no full model specification. Those omissions do not erase the value of the posted results, but they set a boundary on what can be independently checked. A careful reader can describe the estimates and their precision while keeping conclusions proportionate to the available record.

18. Limitations

The registry record does not describe the randomization sequence, allocation concealment, or who was masked, despite listing the study as randomized and double-masked. The exact procedures supporting those design labels are not reported in the registry record. The intervention list includes 0.9% saline eye drops, but the posted primary outcome arms contain only SYSTANE HYDRATION and Hyabak 0.15%; the role of saline in the reported primary comparison is therefore not clear from the outcome results.

The primary endpoint analysis includes 48 and 49 participants, while overall enrollment is 114. The record defines analyzed participants as those with non-missing responses but does not supply a full participant-flow account or explain missing outcomes. It also does not describe the model behind the least-squares means, the method for missing data, or sensitivity analyses. These details limit reproducibility and assessment of how robust the estimates are to analysis choices.

The registry record does not report the original sample-size rationale, a prespecified clinically important TOSS difference, or whether the study was designed to test superiority, non-inferiority, or equivalence. The planning illustrations are based on the observed effect under separate assumptions, not the original trial design. Consequently, they cannot answer whether the original design had a particular target or whether its assumptions were met.

There are three secondary outcomes, but no reported multiplicity strategy or named secondary analyses. The unadjusted results should therefore be interpreted cautiously. Safety summaries are limited to group counts and listed terms; further information on timing, relatedness, and exposure is not reported in the registry record. Together, these limitations constrain causal, clinical, and confirmatory interpretations beyond the descriptive statistical results.

19. Related Tutorials

20. Related Statistical Calculators

21. Sources

Continue through the Clinical Biostats statistical pathway

Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.

22. Record Summary

The registry record describes a completed, randomized, double-masked, parallel-group study of SYSTANE HYDRATION and Hyabak 0.15% in subjects with dry eye. Enrollment was 114. The primary outcome was change from baseline in TOSS at Day 42, with one study eye contributing to the analysis. The posted arm means were -1.16 and -0.92, respectively, and the unadjusted recalculated mean difference was 0.24 with an interval spanning zero and an unadjusted p-value of 0.47.

Three secondary outcomes are listed: IDEEL Treatment Effectiveness, IDEEL Treatment Inconvenience, and TFBUT. The record also posts serious adverse-event counts and reports 0 deaths in each listed group. It does not report named statistical analyses, the original sample-size justification, a multiplicity plan, detailed missing-data methods, or the model specification behind the least-squares means. The secondary comparisons and planning illustrations should be read with those limits in mind.

Clinical Biostats