← Clinical Trials
Hearing Loss NA Continuous Endpoint NCT05070429

ACHIEVE Hearing Intervention Follow-Up Study: Complete Statistical Analysis

This page examines a randomized comparison of telehealth and conventional hearing healthcare among older adults who already used hearing aids. It focuses on average daily hearing aid use through up to 1 year and the registry’s reported analysis and posted secondary outcomes.

Trial start: 2021-11-12  ·  Enrollment: 339  ·  Sponsor: Johns Hopkins University
Scope of this record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.

1. Trial at a Glance

This page covers the registry results for ACHIEVE Hearing Intervention Follow-Up Study (NCT05070429), a randomized na study. The primary outcome is Average Daily Hours of Hearing Aid Use.

339
Enrollment
NA
2
Arms
In the primary outcome
-0.17
Mean difference
Telehealth Hearing Healthcare Group
-1.30–0.96
95% CI
Two-sided
FeatureRegistry value
ClinicalTrials.gov identifierNCT05070429
PhaseNA
ConditionHearing Loss, Aging
AllocationRandomized
Design modelParallel
MaskingNone (open label)
Enrollment339
Arms in the primary outcome2
Lead sponsorJohns Hopkins University
Results postedYes

2. Clinical Question

Population

Older adults who were existing hearing aid users. The registry describes a study of hearing loss and aging, with enrollment of 339 participants.

Intervention

Telehealth audiological rehabilitative service delivery. The telehealth group was also scheduled for clinic-based visits every 6 months during the 2-year study and could use conventional options to address needs.

Comparator

Clinic-based audiological rehabilitative service delivery in the conventional hearing healthcare group, which was also scheduled for clinic-based visits every 6 months during the 2-year study.

Primary question

Did average daily hours of hearing aid use, measured using hearing aid data logging through up to 1 year, differ between the telehealth and conventional hearing healthcare groups?

The registry frames the study as a comparison of delivery models, rather than a comparison of hearing aids with no hearing aids. Both groups were existing hearing aid users, and both were described as having clinic-based visits during the study. The distinction was the delivery of audiological rehabilitative services: clinic-based in the conventional group and telehealth in the telehealth group, with the latter also able to use conventional options.

The primary outcome concerns use of hearing aids, not a direct measure of hearing ability. The registry also lists treatment satisfaction, achievement of a primary communication goal, and hearing-specific quality of life as secondary outcomes. Those measures provide other perspectives on participants’ experiences, but the primary question remains the between-group comparison of objectively logged average daily use. The registry record does not report a clinical threshold for a meaningful difference in daily use.

3. Trial Design

This was a randomized, parallel-group trial with no masking reported in the registry record. The registry lists Johns Hopkins University as the sponsor, a total enrollment of 339, and a completed status. The recorded study start was 2021-11-12 and the primary completion date was 2024-01-10. The registry describes the study as involving older adults who were existing hearing aid users.

Participants were assigned to conventional hearing healthcare or telehealth hearing healthcare. The conventional group was described as receiving clinic-based audiological rehabilitative service delivery. The telehealth group was described as receiving telehealth audiological rehabilitative service delivery, while also being able to use conventional options. Both arm descriptions specify clinic-based visits every 6 months for the duration of the 2-year study. The descriptions available in the registry record are truncated, so additional details about services or procedures are not reported in the registry record.

The main outcome was average daily hours of hearing aid use through up to 1 year. It was obtained from objective hearing aid data logging; when a participant wore a hearing aid in both ears, the ear with the greatest number of hours was selected. The posted group summaries include 159.0 participants in the conventional group and 153.0 in the telehealth group for this outcome. The record lists three secondary outcomes: treatment satisfaction, ability to hear for a primary communication goal, and hearing-specific quality of life.

The registry identifies the design as randomized, but details such as the randomization procedure, allocation concealment, stratification, and the planned sample-size justification are not reported in the registry record. The protocol’s original statistical plan, analysis populations, missing-data procedures, and any interim analyses are also not reported in the registry record. These omissions limit what can be inferred about how the study was planned and how the posted results were produced beyond the methods explicitly named in the record.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Overall Study

StageConventional Hearing Healthcare GroupTelehealth Hearing Healthcare Group
STARTED176163
COMPLETED159153
NOT COMPLETED1710

Reasons for not completing this period:

ReasonConventional Hearing Healthcare GroupTelehealth Hearing Healthcare Group
Death04
Withdrawal by Subject21
Other155

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

CharacteristicUnitConventional Hearing Healthcare GroupTelehealth Hearing Healthcare GroupTotal
Participants analysed176163339
Age, Categorical: <=18 yearsParticipants000
Age, Categorical: Between 18 and 65 yearsParticipants000
Age, Categorical: >=65 yearsParticipants176163339
Age, Continuousyears78.7 (SD 3.8)79.1 (SD 4.0)78.9 (SD 3.9)
Age, Customized: Age in Categories – Between 72 and 74 yearsParticipants272249
Age, Customized: Age in Categories – 75 - 79 yearsParticipants8265147
Age, Customized: Age in Categories – 80 - 84 yearsParticipants5356109
Age, Customized: Age in Categories – 85 - 88 yearsParticipants142034
Sex: Female, Male: FemaleParticipants9987186
Sex: Female, Male: MaleParticipants7776153
Ethnicity (NIH/OMB): Hispanic or LatinoParticipants134
Ethnicity (NIH/OMB): Not Hispanic or LatinoParticipants170158328
Ethnicity (NIH/OMB): Unknown or Not ReportedParticipants527
Race (NIH/OMB): American Indian or Alaska NativeParticipants101
Race (NIH/OMB): AsianParticipants101
Race (NIH/OMB): Native Hawaiian or Other Pacific IslanderParticipants000
Race (NIH/OMB): Black or African AmericanParticipants171835
Race (NIH/OMB): WhiteParticipants157145302
Race (NIH/OMB): More than one raceParticipants000
Race (NIH/OMB): Unknown or Not ReportedParticipants000
Region of Enrollment: United StatesParticipants176163339
Site: Forsyth County, NCParticipants373572
Site: Jackson, MSParticipants453984
Site: Minneapolis, MNParticipants434285
Site: Washington County, MDParticipants514798

6. Primary Endpoint

The registry lists the primary outcome as Average Daily Hours of Hearing Aid Use, measured over Up to 1 year.

ElementRegistry entry
Result typeMean
Measure of spreadStandard Deviation
UnitDaily hours
Endpoint classificationContinuous Endpoint

The primary endpoint is average daily hours of hearing aid use, reported as a mean with a standard deviation and measured through up to 1 year. The registry says the measure comes from objective hearing aid data logging. For participants wearing hearing aids in both ears, the ear with the greatest number of hours is selected. This definition makes the outcome a measure of recorded device use rather than a participant’s estimate of use or a direct test of hearing.

Use is relevant to the stated trial question because the study compares how hearing healthcare is delivered and asks whether the telehealth model improves hearing aid use and other communication outcomes compared with clinic-based care. The endpoint can therefore describe whether logged daily use differed between the randomized groups. It does not by itself measure satisfaction, communication success, or hearing-specific quality of life; those are addressed by separate secondary outcomes.

In general, an objectively logged measure can avoid some limitations of self-reported use, but its interpretation still depends on how the measure is defined and on the data available for analysis. Here, the registry specifies the greater-use ear when both ears have hearing aids. It does not report a threshold for a difference considered important to participants, or the details of how unavailable or incomplete data were handled. Those points are not reported in the registry record.

7. Results Posted in the Registry

Mean difference: Telehealth Hearing Healthcare Group

-0.17

95% CI: -1.30 to 0.96

Recalculated from the posted summary statistics

Primary outcome by arm, with 95% confidence intervals
Primary outcome by arm with 95% confidence intervals6.26.67.17.57.98.3Conventional Hearing Healthca… (n=159)Telehealth Hearing Healthcare… (n=153)Daily hours (95% CI)
Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)Telehealth Hearing Healthcare…-1.48-0.96-0.430.090.621.14mean difference vs control (95% CI)

8. Secondary Efficacy Endpoints

The registry also posts results for secondary outcomes. For each outcome below, the endpoint type, the test applied to the posted summary statistics, the result and its interpretation are given in turn. Secondary endpoints are usually not adjusted for multiple testing, so they support rather than confirm the primary finding.

Secondary outcomeTypeEffect measureEstimate (95% CI)Planning size, 80% power
Treatment Satisfaction as Assessed by a Single Item From the International Outcome Inventory - Comprehensive Hearing Intervention (IOI-CHI) ScaleContinuous EndpointMean difference0.00 (-0.10 to 0.10)n/a
Ability to Hear for Primary Communication Goal as Assessed by a Single Item From the Client-Oriented Scale of Improvement (COSI) Goals Achievement QuestionnaireContinuous EndpointMean difference0.04 (-0.12 to 0.20)5,029 per arm
Hearing-specific Quality of Life as Assessed by the Hearing Handicap Inventory for the Elderly - Screening Version (HHIE-S) QuestionnaireContinuous EndpointMean difference-0.17 (-1.68 to 1.34)25,174 per arm

Treatment Satisfaction as Assessed by a Single Item From the International Outcome Inventory - Comprehensive Hearing Intervention (IOI-CHI) Scale

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)Telehealth Hearing Healthcare…-0.12-0.07-0.020.020.070.12mean difference vs control (95% CI)

Ability to Hear for Primary Communication Goal as Assessed by a Single Item From the Client-Oriented Scale of Improvement (COSI) Goals Achievement Questionnaire

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)Telehealth Hearing Healthcare…-0.14-0.070.000.080.150.22mean difference vs control (95% CI)

Hearing-specific Quality of Life as Assessed by the Hearing Handicap Inventory for the Elderly - Screening Version (HHIE-S) Questionnaire

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)Telehealth Hearing Healthcare…-1.92-1.22-0.520.180.881.58mean difference vs control (95% CI)

Across the three posted secondary outcomes, the sponsor-reported analyses do not show clear between-group differences: all three reported confidence intervals include zero. Taken together, the pattern is broadly consistent with the primary analysis in that the posted results do not demonstrate clear differences between the telehealth and conventional groups. This is a summary of the overall pattern, not evidence that the outcomes are identical or that the delivery models have equivalent effects.

The secondary outcomes address different questions from the primary endpoint. Satisfaction, ability to hear for a primary communication goal, and hearing-specific quality of life are not interchangeable with objectively logged daily hearing aid use. Similarity in the overall direction of statistical conclusions does not mean the measures are redundant, nor does it show that one outcome explains another. The registry does not report an analysis linking changes in these outcomes to hearing aid use.

Unadjusted secondary results generally carry less confirmatory weight when several outcomes are examined, because the chance of finding an apparently unusual result can increase as more comparisons are made. In general, multiplicity procedures can address this issue, but the registry record does not report whether such a procedure was planned or used. The posted secondary p-values should therefore be read as results for individual analyses, not as a family-wise confirmatory claim.

The record lists three secondary outcomes and reports results for those three. It also lists five outcome measures and four analyses overall. The relationship between those counts and the complete set of planned or analyzed measures is not explained in the registry record. The secondary findings provide additional descriptive context, but they do not replace the primary endpoint or resolve the uncertainty in its estimate.

Secondary outcomes registered for this trial, for reference (only those above were recalculated):

9. Statistical Interpretation

Clinical Biostats interpretation

The posted mean average daily use was 7.37 daily hours in the conventional group and 7.2 daily hours in the telehealth group. The simple unadjusted recalculation gives a mean difference of -0.17 daily hours for telehealth compared with conventional care, with a 95% confidence interval from -1.302 to 0.962 and an unadjusted p-value of 0.768. The interval includes zero, so these posted summaries do not establish a clear between-group difference in average daily use.

The registry’s reported analysis used a generalized linear model (GLM) with maximum likelihood estimation. It reports an estimate of -0.035, a 95% confidence interval from -0.727 to 0.657, and p = 0.92. This estimate also has an interval that includes zero. The reported analysis and the simple unadjusted recalculation are not identical: the reported estimate is closer to zero, and its interval is narrower. The registry record does not provide enough detail to explain the difference between the model-based result and the recalculation from the posted group summaries.

Neither result should be read as proof that the groups were identical. A non-significant result means the analysis did not demonstrate a difference under the methods used; it does not show that every plausible difference is absent. The confidence intervals describe a range of values compatible with the data and analysis, and the primary reported interval includes both negative and positive values. The registry does not report a threshold for a clinically important difference, so the practical importance of values within the interval cannot be judged from this record alone.

The point estimates are small relative to the observed standard deviations in the two groups, but this descriptive comparison does not replace the reported analysis or establish equivalence. An equivalence or non-inferiority conclusion would require a prespecified margin and an appropriate analysis; such a margin or plan is not reported in the registry record. The result should therefore be described as an absence of a demonstrated difference in the posted analysis, rather than as evidence that the delivery models are interchangeable.

The three posted secondary outcomes follow a similarly inconclusive pattern in their sponsor-reported analyses: each confidence interval includes zero. Those findings are consistent with the primary result in the limited sense that the posted analyses do not show clear between-group differences. They do not independently confirm the primary result, and the secondary measures concern different aspects of the hearing healthcare experience.

The trial was randomized, which supports a comparison between assigned groups, but the registry record does not report analysis-population definitions or missing-data methods. The endpoint summaries use 159.0 participants in the conventional group and 153.0 in the telehealth group, while the total enrollment is 339. Without participant-flow and analysis-population details, the reason for the difference between enrollment and the posted endpoint group counts is not reported in the registry record. This limits assessment of how representative the analyzed data are of all enrolled participants.

10. Statistical Methods Explained

The posted results include a simple unadjusted recalculation based on the group means and standard deviations, alongside the registry’s reported model-based analysis. These answer related but not necessarily identical statistical questions. Reading both helps distinguish a calculation based directly on the displayed summaries from the sponsor’s reported inferential analysis.

What does the mean difference describe?

For a continuous outcome, a mean summarizes the group’s average measured value. The reported primary means are 7.37 daily hours for conventional care and 7.2 daily hours for telehealth care. The recalculated mean difference is expressed as telehealth minus conventional care, so its negative sign indicates that the posted telehealth mean is lower. The size and uncertainty of that difference matter more than the sign alone. The standard deviations, 5.15 and 5.05, describe variability among the observed values within the respective groups; they are not confidence intervals for the group means.

The recalculation is unadjusted: it compares the posted summaries without adjustment for other variables. Its mean difference is -0.17, with a 95% confidence interval from -1.302 to 0.962 and p = 0.768. It is useful as a transparent summary-based comparison, but it should not be mistaken for the trial’s full planned analysis. The registry’s original analysis plan and details of any adjustment variables are not reported in the registry record.

What is the role of the reported model?

The registry lists a generalized linear model (GLM) and maximum likelihood estimation (MLE) for the primary comparison. In general, a model-based analysis estimates a relationship between outcome and group according to the model specification, while maximum likelihood is a way of estimating model parameters from the observed data. A GLM is a broad class of models; its specific form depends on choices such as the outcome distribution, link function, covariates, and treatment of repeated observations. Those details are not reported in the registry record, so the model should not be described more specifically than the record allows.

The model-based result is -0.035, with a 95% confidence interval from -0.727 to 0.657 and p = 0.92. It is this sponsor-reported analysis that should be treated as the trial’s reported inferential result. Because the registry record does not describe the model specification, the simple summary-based recalculation cannot establish why its estimate and interval differ from the GLM result.

How should a confidence interval be read?

In general, a confidence interval conveys the uncertainty around an estimated effect under the statistical method used. A 95% confidence interval is generated by a procedure that, under its assumptions, would cover the underlying quantity in 95% of repeated applications. It is not a statement that there is a 95% probability that the particular interval contains the true effect. Both the reported model interval and the recalculated interval include zero, which means that no difference is among the values compatible with those intervals. The intervals also include non-zero values, so the data do not establish that the true difference is exactly zero.

A p-value measures how unusual the observed result, or a more extreme result, would be under a specified null hypothesis and the assumptions of the analysis. It is not the probability that the null hypothesis is true, nor a measure of the size or importance of an effect. Here, the sponsor-reported p-value is 0.92 and the unadjusted recalculated p-value is 0.768. The registry identifies the analysis type as superiority; it does not report an equivalence or non-inferiority objective.

Why might the analyses differ?

In general, a model-based analysis can differ from a comparison reconstructed from group means and standard deviations because the model may use a different outcome distribution, covariates, or other assumptions. The registry record does not report enough detail to identify the reason in this trial. The reported result and the summary-based recalculation should therefore be presented as distinct analyses, not combined into a new estimate. The record does not indicate a discrepancy that would call the sponsor’s analysis into question; the model result remains the principal result reported by the registry.

The registry reports standard deviations for the primary group summaries. In general, dispersion matters because greater variability makes it harder to estimate a group difference precisely for a fixed amount of information. Confidence intervals reflect both the estimated effect and its uncertainty; a small estimated difference does not necessarily imply a precise estimate. The broad span of the recalculated interval illustrates why the point estimate alone is insufficient for interpretation.

What cannot be determined from the posted methods?

Randomized allocation is reported, but methods for sequence generation, allocation concealment, analysis populations, missing observations, and handling of protocol deviations are not reported in the registry record. The registry also does not report a prespecified sample-size justification or interim-analysis plan. These omissions mean readers cannot fully assess whether the posted model follows the original protocol, whether all randomized participants were analyzed as assigned, or how missing outcome data may affect the estimates.

The calculations in the accompanying planning section are illustrations based on observed effects, not evidence about the trial’s original design or conduct. Generalized linear models can be useful when their assumptions suit the data, but the particular assumptions and diagnostics for this analysis are not reported in the registry record. The appropriate interpretation is consequently anchored in the results as posted, with the model’s reported estimate and uncertainty distinguished from the unadjusted recalculation.

11. Confidence Intervals and Precision

Precision is about how tightly an analysis estimates a difference, not simply whether a p-value crosses a conventional threshold. For the primary outcome, the sponsor-reported GLM estimate is -0.035 daily hours, with a 95% confidence interval from -0.727 to 0.657. This interval includes zero and also includes values on either side of zero. The estimate is therefore not precise enough to rule out all non-zero differences within the range covered by the interval.

The summary-based recalculation has a mean difference of -0.17 daily hours and a 95% confidence interval from -1.302 to 0.962. This is a separate, unadjusted calculation and not a replacement for the registry’s reported GLM result. The two intervals both include zero, but they have different estimates and widths. The registry record does not provide enough model detail to explain why.

In general, a confidence interval gives readers more information than a point estimate alone: it shows the uncertainty and the range of effect sizes that are compatible with the data and method. It does not show that every value in the interval is equally plausible, nor does it identify which value is correct. Because the registry does not report a threshold for a meaningful difference in daily hours, the interval cannot be translated into a judgment about clinical importance from this record alone.

The reported standard deviations are 5.15 for conventional care and 5.05 for telehealth care. These describe variation in individual measurements, whereas the confidence interval describes uncertainty about a group contrast. The number of analyzed participants, variability, analysis method, and any model adjustments all affect precision. Details needed to assess some of those features, including missing-data handling and model specification, are not reported in the registry record.

12. Planning a Similar Trial: Sample Size

This is a planning illustration, not a re-evaluation of the original trial. It asks: if a new study wanted to detect a difference like the one observed, or a smaller one, how large would it need to be? It is deliberately not “observed power” of the finished trial, which is not a meaningful quantity.

Effect to detectParticipants per arm, 80% powerParticipants per arm, 90% power
100% of the observed effect14,13518,923
75% of the observed effect25,12933,640
50% of the observed effect56,53975,690
Sample size needed versus the size of the effect to detect
Sample size needed versus size of effect to detect10,00020,00050,000100,000200,00040%60%80%100%80% power90% powersize of effect to detect, as % of the effect observed (log vertical scale: participants per arm)
Treat these figures cautiously. The observed difference is imprecise: its confidence interval includes no difference at all. A sample size built on a noisy estimate can be far too small or too large, so the smaller-effect rows are the more cautious guide.
Method and assumptions. Two-sided α = 0.05, 1:1 allocation, two-sample comparison of means with the pooled standard deviation. Calculated for the comparison: Telehealth Hearing Healthcare Group.

The sample-size table and curve are planning illustrations based on fractions of the observed effect; they are not a record of the trial’s original sample-size calculation. For these continuous outcomes, the entries are participants per arm, not total events. The planning assumptions are a two-sided significance level of 0.05, equal allocation between the two arms, and a normal approximation. The effect to detect is the stated fraction of the observed effect. The original design assumptions and sample-size justification are not reported in the registry record.

The column for 80% power gives the illustrated number of participants per arm for a design with an 80% chance of detecting the specified effect under the stated assumptions, if that effect and assumptions were correct. The 90% power column describes the corresponding planning target with a 90% chance. These percentages refer to properties of a hypothetical study design under specified assumptions, not the probability that the posted trial result is correct.

Rows describe planning for 100%, 75%, and 50% of the observed effect. As the target effect becomes smaller, more participants are needed to distinguish it from random variation under the same planning assumptions. The table makes that relationship visible; it should not be read as a recommendation or as evidence that the original trial was designed around any of those target effects.

These figures are not observed power. They are calculations for hypothetical future designs using the observed effect as a planning reference. Because the observed effect is itself uncertain, and the registry does not report a clinically important target difference or the trial’s own design rationale, the illustrations should be interpreted cautiously. The record does not report whether the original enrollment target was based on this endpoint, a different outcome, or other assumptions.

13. How the Sample Size Is Derived

Power is the probability that a study of a given size rejects the null hypothesis when a specific true effect exists. It depends on four things: the effect to detect, the variability of the outcome, the significance level (here a two-sided α of 0.05, so z1−α/2 = 1.960) and the desired power (z1−β = 0.842 for 80% and 1.282 for 90%).

Formula

n = 2 (z1−α/2 + z1−β)2 σ2 / Δ2

n is the number of participants in each arm, Δ is the difference in means to detect and σ is the common standard deviation.

Worked calculation for this trial

  1. Observed difference Δ = -0.170; pooled standard deviation σ = 5.101.
  2. n = 2 × (1.96 + 0.842)2 × 5.1012 / -0.1702 = 14,134.7, rounded up to 14,135 participants per arm for 80% power.

The smaller-effect rows in the table above repeat the same calculation with the effect multiplied by 0.75 and 0.5 (for ratios, applied to the logarithm of the ratio).

R code

alpha <- 0.05
z_a   <- qnorm(1 - alpha / 2)          # two-sided
delta <- -0.17                      # observed difference in means
sigma <- 5.10121269579518                     # pooled standard deviation
n_per_arm <- function(power, frac = 1) {
  ceiling(round(2 * (z_a + qnorm(power))^2 * sigma^2 / (delta * frac)^2, 6))
}
for (f in c(1, 0.75, 0.5))
  cat(sprintf("%3.0f%% of observed effect: n per arm = %s (80%% power), %s (90%% power)\n", 100 * f,
              format(n_per_arm(0.80, f), big.mark = ","), format(n_per_arm(0.90, f), big.mark = ",")))

# Check against R's built-in function (t-based, so very slightly larger)
cat("power.t.test:", round(power.t.test(delta = delta, sd = sigma, power = 0.80)$n, 1), "\n")

# Simulation: exact two-sample t-test using simulated means and variances
set.seed(5070429)
n    <- n_per_arm(0.80)
reps <- 20000
m_diff <- rnorm(reps, delta, sigma * sqrt(2 / n))             # difference in sample means
s2     <- sigma^2 * rchisq(reps, 2 * (n - 1)) / (2 * (n - 1))   # pooled sample variance
tstat  <- m_diff / sqrt(s2 * 2 / n)
cat(sprintf("Simulated power at n = %s per arm: %.3f (%d replicates)\n", format(n, big.mark = ","), mean(abs(tstat) > qt(0.975, 2 * (n - 1))), reps))

Output from running the code

100% of observed effect: n per arm = 14,135 (80% power), 18,923 (90% power)
 75% of observed effect: n per arm = 25,129 (80% power), 33,640 (90% power)
 50% of observed effect: n per arm = 56,539 (80% power), 75,690 (90% power)
power.t.test: 14135.7 
Simulated power at n = 14,135 per arm: 0.805 (20000 replicates)

The simulation draws many sets of group means and variances at the planned sample size and counts how often the two-sample t-test rejects the null. It should land close to the target power; at very small required sample sizes it can fall below it, because the normal approximation is rough there.

14. Analyses Reported by the Sponsor

MethodEstimate95% CIP-value
generalized linear model (GLM)Maximum likelihood (MLE) -0.035-0.727 to 0.6570.920

The registry’s reported primary analysis is the GLM with maximum likelihood estimation: an estimate of -0.035, a 95% confidence interval from -0.727 to 0.657, and p = 0.92. This is the sponsor-reported analysis and is the main inferential result to use when describing what the trial reported.

The simple recalculation from posted group means and standard deviations gives a mean difference of -0.17, a 95% confidence interval from -1.302 to 0.962, and an unadjusted p-value of 0.768. It is a summary-based, unadjusted calculation, not the same analysis as the GLM. The estimates differ, although both intervals include zero. The registry record does not describe the GLM specification or explain the difference between the estimates.

The record does not flag a discrepancy between the posted analysis and the recalculation. The recalculation can help readers see how the displayed summaries compare without adjustment, but it should not supersede the sponsor’s own reported model analysis. It also cannot establish whether the model’s assumptions were met, because the relevant details are not reported in the registry record.

15. Multiplicity, Missing Data and Analysis Populations

The registry lists a primary outcome and three posted secondary outcomes. It also records five outcome measures and four analyses overall. The record does not explain the difference between the total number of outcome measures and the analyses listed, or identify whether every measure was planned, analyzed, and reported. Details of an outcome hierarchy or a prespecified testing sequence are not reported in the registry record.

In general, when multiple outcomes or comparisons are tested, the chance of at least one apparently notable result can increase. Statistical plans may address this through a prespecified hierarchy or adjustment for multiple testing. The registry record does not report whether multiplicity was addressed for the secondary outcomes. Their p-values should therefore be treated as individual, unadjusted findings unless otherwise specified in the record, rather than as a set of results that has been shown to control a family-wise error rate.

Missing-data procedures are also not reported in the registry record. The primary outcome summaries include 159.0 participants in the conventional group and 153.0 in the telehealth group, while total enrollment is 339. The record does not provide participant flow, the reasons for unavailable outcome data, or a description of how missing measurements were handled. These figures alone do not establish why some enrolled participants are not represented in the posted group summaries.

Analysis-population definitions are not reported in the registry record. It is therefore not possible to determine from the posted information whether the GLM used all randomized participants, only participants with observed endpoint data, or another defined population. The record also does not state how adherence to assigned care, withdrawals, or protocol deviations were addressed. These omissions limit assessment of potential bias and prevent a full reconstruction of the analysis from the registry results.

The registry does not report the original statistical analysis plan, interim analyses, or sample-size justification. These are not details that can be inferred from the posted p-values or planning illustrations. The available findings can be described accurately, but the record does not permit a complete audit of prespecification, selective reporting, or the treatment of incomplete data.

16. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

ArmParticipants with serious adverse eventsParticipants at riskPercentage
Conventional Hearing Healthcare Group01760.0%
Telehealth Hearing Healthcare Group01630.0%

Deaths

ArmDeaths (participants affected of at risk)
Conventional Hearing Healthcare Group0 of 176
Telehealth Hearing Healthcare Group4 of 163

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 0% reporting threshold.

ArmParticipants affected of at risk
Conventional Hearing Healthcare Group7 of 176
Telehealth Hearing Healthcare Group11 of 163

Most frequent non-serious adverse event terms

Event termOrgan systemConventional Hearing Healthcare GroupTelehealth Hearing Healthcare Group
Cerumen impactionEar and labyrinth disorders4 of 1767 of 163
OtherEar and labyrinth disorders2 of 1762 of 163
Otitis externaEar and labyrinth disorders1 of 1762 of 163
Do not overextend the safety comparison. Serious-adverse-event counts are safety observations, not efficacy outcomes, and should not be combined with the primary result into a single benefit-risk number.

The registry lists zero serious adverse events among 176 participants at risk in the conventional group and zero among 163 participants at risk in the telehealth group. It lists 7 other adverse events among 176 at risk in the conventional group and 11 among 163 at risk in the telehealth group. The record also lists 0 deaths for the conventional group and 4 for the telehealth group.

These are registry counts, not a comparative statistical analysis. The record does not list serious adverse event terms, and it does not provide event descriptions or an explanation of the deaths. The death counts should not be assumed to be caused by, or unrelated to, either care-delivery model based on these figures alone. The record does not report a causal assessment.

In general, adverse-event counts need context, including definitions, timing, participant follow-up, and how events were collected. Such details are not reported in the registry record. The figures should be read as the posted safety summary, not as evidence on their own of a difference in risk between groups.

17. What the Result Does, and Does Not, Mean

The posted primary results do not demonstrate a clear difference in average daily hearing aid use between telehealth and conventional hearing healthcare. The sponsor-reported GLM estimate is close to zero, its 95% confidence interval includes zero, and its p-value is 0.92. The unadjusted recalculation from the group summaries likewise has an interval including zero. The appropriate conclusion is that the registry’s posted analyses did not establish a between-group difference in this endpoint.

This does not show that the groups were exactly the same. Both intervals permit non-zero differences, and the registry does not report a threshold that would distinguish a trivial difference from one important to participants. Nor does a non-significant superiority analysis establish equivalence or non-inferiority. Such claims require a suitable design and a prespecified margin, neither of which is reported in the registry record.

The primary endpoint is logged daily hearing aid use through up to 1 year. It cannot, by itself, answer whether participants communicated more effectively, were more satisfied, or experienced different hearing-specific quality of life. The record reports secondary measures addressing those areas, but their posted analyses also do not demonstrate clear differences. They remain distinct outcomes, and their interpretation is limited by the lack of reported multiplicity procedures and analysis details.

The trial compares models of healthcare delivery among older adults who were existing hearing aid users. It does not compare hearing aids with no hearing aids, and the posted primary outcome does not establish whether either model is preferable for every participant or setting. The registry record does not report enough detail about the population beyond the stated description to extend the findings to groups not represented in the study.

Interpretation is also constrained by absent information on missing data, analysis populations, model specification, and the original statistical plan. The posted numbers support a careful description of the analyses and their uncertainty, but not a broader causal explanation or a conclusion about unreported outcomes. No medical decision should be based on these results alone.

18. Why This Trial Matters Statistically

This trial illustrates why statistical interpretation should not stop at comparing point estimates or p-values. The primary group means are close, but the confidence intervals are essential for understanding what the data do and do not rule out. Both the reported model analysis and the summary-based recalculation include zero, yet neither establishes that the true difference is exactly zero.

The record also provides a useful contrast between an analysis reported by the sponsor and a simple unadjusted recalculation. These are not interchangeable: one is a GLM using maximum likelihood estimation, while the other is reconstructed from posted group summaries. The registry does not give enough detail to explain their differences, making transparent labeling of each result important. The model-based result remains the principal reported analysis.

Planning illustrations based on an observed effect can be informative about the relationship between target effect size and required sample size. They are not a substitute for a documented design rationale, and they cannot retrospectively show that a trial was adequately powered. Here, the original sample-size justification is not reported in the registry record. The distinction between planning calculations and properties of the completed trial is therefore central.

Finally, the trial shows the value of separating an objectively logged primary endpoint from secondary measures of satisfaction, communication goals, and quality of life. These outcomes capture different dimensions, and their pattern should be summarized without treating them as interchangeable. Missing information about multiplicity, analysis populations, and missing data further demonstrates why a registry result is informative but not always a complete statistical report.

19. Limitations

Important trial details are not reported in the registry record. These include the randomization procedure and allocation concealment, the original sample-size justification, the full statistical analysis plan, the model specification, analysis populations, and missing-data methods. The registry also does not report whether interim analyses were conducted. Without these details, readers cannot fully assess how the reported model was specified or how incomplete observations may have affected the results.

The primary endpoint summaries cover 159.0 participants in the conventional group and 153.0 in the telehealth group, while the registry lists enrollment of 339. Participant flow and reasons for the differing counts are not reported in the registry record. It is not possible to tell from these figures alone whether the difference reflects missing endpoint measurements, exclusions, or another aspect of reporting.

The registry’s arm descriptions are truncated. They state that both groups had clinic-based visits every 6 months during the 2-year study, but do not provide complete descriptions of all services and options. The record therefore does not support a detailed assessment of treatment fidelity, the amount of telehealth actually used, or differences in contact between groups.

The primary outcome is defined through up to 1 year, while the arm descriptions refer to a 2-year study. The registry record does not explain the relationship between that outcome timeframe and the full follow-up period. It also does not report a threshold for a meaningful difference in daily use. As a result, the statistical interval cannot be translated into a clinical importance judgment using this record alone.

There are three posted secondary outcomes, while the record lists five outcome measures and four analyses overall. The relationship between these counts and any unposted results is not explained. Multiplicity procedures are not reported. These limitations do not invalidate the posted values, but they narrow the conclusions that can be drawn from them.

20. Related Tutorials

21. Related Statistical Calculators

22. Sources

Continue through the Clinical Biostats statistical pathway

Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.

23. Record Summary

The ACHIEVE Hearing Intervention Follow-Up Study (NCT05070429) is a completed randomized, parallel-group trial sponsored by Johns Hopkins University. It compared telehealth and conventional clinic-based hearing healthcare delivery among older adults who were existing hearing aid users. The registry lists enrollment of 339 and no masking.

The primary outcome was average daily hours of hearing aid use through up to 1 year, measured using objective hearing aid data logging. The sponsor-reported GLM estimate was -0.035, with a 95% confidence interval from -0.727 to 0.657 and p = 0.92. The interval includes zero, so the posted analysis did not establish a clear between-group difference.

Three secondary outcomes are posted, and their reported confidence intervals also include zero. The record does not report the original sample-size justification, full model specification, analysis populations, missing-data methods, or multiplicity procedure. The results should be read as registry-reported findings with these reporting limitations in view.

Clinical Biostats