← Clinical Trials
Heart Failure NA Registry Results NCT01246050

"Hub and Satellite" Heart Failure Provider's Network Study: Complete Statistical Analysis

This pilot assessed the feasibility of a network model for heart-failure care in which trained primary care providers received support from a regional heart-failure center. The registry record describes a nine-measure performance endpoint but does not report its results or an analysis.

Trial start: 2010-05  ·  Enrollment: 6  ·  Sponsor: VA Office of Research and Development
Scope of this record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.

1. Trial at a Glance

This page covers the registry results for "Hub and Satellite" Heart Failure Provider's Network Study (NCT01246050), a non-randomized na study. The primary outcome is Number of Superior Heart Failure Performance Outcome Quality Measures.

6
Enrollment
NA
n/a
Arms
In the primary outcome
n/a
Effect
No re-analysis shown
n/a
95% CI
See limitations
FeatureRegistry value
ClinicalTrials.gov identifierNCT01246050
PhaseNA
ConditionHeart Failure
AllocationNon-Randomized
Design modelParallel
MaskingNone (open label)
Enrollment6
Arms in the primary outcomen/a
Lead sponsorVA Office of Research and Development
Results postedYes

2. Clinical Question

Population

The study concerned patients with heart failure cared for by primary care providers in VA Community Based Outpatient Clinics. The primary outcome description states that 129 patients were cared for by trained providers and 129 patients were in the control group. The registry enrollment field lists 6; the record does not reconcile that figure with the patient counts in the outcome description.

Intervention

Providers in the intervention arm received 3 days of heart-failure training, access to clinical pharmacist medication-titration services, and performance feedback. The intended model was a network of trained primary care providers supported by a Regional Heart Failure Center.

Comparator

The comparison group consisted of providers in the same CBOC who did not receive heart-failure training, clinical pharmacist services, or performance feedback. Assignment was nonrandomized, so the groups were not a like-for-like randomized comparison.

Primary question

At the 12-month timeframe, did at least 6 of 9 specified heart-failure performance measures show a higher score at follow-up than at baseline? The registry describes this threshold as the criterion for considering the primary outcome reached. It does not report whether the criterion was met.

3. Trial Design

This completed pilot study evaluated the feasibility of developing a hub-and-satellite network for heart-failure care. Its stated aim was to train primary care providers in VA Community Based Outpatient Clinics in heart-failure management and support them through a Regional Heart Failure Center. The registry lists the condition as heart failure and the sponsor as the VA Office of Research and Development.

The study is registered as a parallel, nonrandomized comparison with no masking. One arm received heart-failure training, pharmacist medication-titration services, and performance feedback; the other did not receive those supports. The record does not report how providers or clinics were assigned to the arms, or whether any adjustment was made for differences between them. Because allocation was nonrandomized, measured and unmeasured differences between groups could affect comparisons.

The registry lists the study start as 2010-05 and primary completion as 2011-05, with status completed. Phase is listed as NA. The primary outcome timeframe is 12 months. The study description calls it a pilot, qualitative study intended to assess feasibility and preliminary outcomes; the record does not give further details about feasibility criteria or how feasibility was assessed.

There is an unresolved discrepancy between the enrollment field, which lists 6, and the primary outcome description, which says 129 patients were cared for by trained providers and 129 patients were in the control group. The registry record does not explain whether these figures refer to different units or populations. That ambiguity limits interpretation of the study size and of who contributed to the outcome.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Overall Study

StageArm 1: Received HF TrainingArm 2: No HF Training
STARTED66
COMPLETED66
NOT COMPLETED00

Analysis population for the primary outcome, as defined in the registry: 129 patients cared for by HF trained primary care providers in Intervention Arm. 129 patients in the Control group, cared for by non-HF trained primary care providers.

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

Population: Characteristics of Patients Followed by Providers in each Arm

CharacteristicUnitArm 1: Received HF TrainingArm 2: No HF TrainingTotal
Participants analysed129129258
Age, Continuousyears65 (59 to 72)65 (62 to 74)65 (61 to 73)
Sex: Female, Male: FemaleParticipants415
Sex: Female, Male: MaleParticipants125128253
Coronary Artery Disease: Coronary Artery Disease presentparticipants10197198
Coronary Artery Disease: Coronary artery disease not presentparticipants283260
Hypertension: Hypertension presentparticipants119119238
Hypertension: Hypertension not presentparticipants101020
Diabetes: Diabetes presentparticipants7265137
Diabetes: Diabetes not presentparticipants5764121
Median ejection fraction% left ventricular end-diastolic volume30 (25 to 35)30 (25 to 35)30 (25 to 35)
Followed by Cardiology: Number followed by Cardiologyparticipants116108224
Followed by Cardiology: Number not followed by Cardiologyparticipants132134
Followed by Advanced Heart Failure Clinic: Followed by Heart failure Clinicparticipants263763
Followed by Advanced Heart Failure Clinic: Not followed by Heart Failure Clinicparticipants10392195
HF Hospitalization past year: No. with a HF hospitalization in the past yearparticipants261541
HF Hospitalization past year: No. without a HF hospitalization in the past yearparticipants103114217

6. Primary Endpoint

The registry lists the primary outcome as Number of Superior Heart Failure Performance Outcome Quality Measures, measured over 12 months.

ElementRegistry entry
Result typeNumber
Measure of spreadnot applicable
Unitnumber of outcome measures superior
Endpoint classificationnot reduced to a single comparison

The primary endpoint is the number of heart-failure performance outcome quality measures considered superior at follow-up compared with baseline. A measure counted as superior when its follow-up score was higher than its baseline score. The registry lists nine measures: weight measured at a clinic visit; activity assessed; volume status assessed; ACEI/ARB prescribed and at target dose; beta-blocker prescribed and at target dose; use of an evidence-based beta-blocker; and coumadin prescribed in atrial fibrillation.

The study defined the primary outcome as reached if 6 of the 9 measures were superior to baseline. This endpoint summarizes improvement across several aspects of provider performance rather than reporting a single patient-level clinical event. It was used in a pilot whose stated purpose included preliminary assessment of a provider-training and support model.

The registry does not report the observed number of superior measures, the individual measure results, or whether the stated threshold was reached. It also does not report the scoring rules for each measure beyond the comparison of follow-up and baseline scores. Without those results and details, the endpoint definition can be described, but its observed value and precision cannot be assessed.

7. Why No Re-analysis Is Shown

Reported as posted, not recalculated. Not a randomized comparison (allocation: non-randomized); arms are not a like-for-like control comparison. A result is recalculated only when the posted data support a clean two-arm comparison, so no result is shown beyond what the sponsor posted.

8. Statistical Interpretation

Clinical Biostats interpretation

The registry record describes an intended comparison of provider performance following a training and support program. It defines a threshold for the primary outcome, but does not post the observed count of superior measures, measure-specific results, or a statistical analysis. The record lists zero analyses. Consequently, it is not possible to determine from the registry results whether the primary threshold was met or how large or precise any difference between arms may have been.

The nonrandomized allocation is central to interpretation. Providers receiving training and providers not receiving training may have differed in ways other than the intervention. The record does not describe an adjustment strategy or establish that the groups were comparable at baseline. Even if comparative outcome values were available, an unadjusted difference would not by itself isolate an effect of training from other group differences.

The endpoint is based on whether each of nine measures had a higher score at follow-up than at baseline, with a specified threshold across the measures. This definition gives a clear rule for classifying the primary outcome, but it does not supply the actual measure scores or their uncertainty. The record also does not state whether the primary endpoint was analyzed at the patient, provider, or clinic level. The outcome description refers to patients cared for by providers, while the intervention was delivered to providers.

The enrollment figure of 6 does not align with the outcome description's patient counts of 129 in each group. Since the record does not clarify the units or populations represented by these values, the effective amount of outcome information cannot be determined from the entry. The completion status and stated timeframe do not resolve this inconsistency or substitute for reported results.

Accordingly, the posted record supports a description of the pilot's design and endpoint, not a conclusion about the direction, magnitude, statistical significance, or clinical importance of an observed result. The registry record does not report confidence intervals, p-values, or an analysis of the outcome.

9. Statistical Methods Explained

What does the endpoint count?

The endpoint counts how many of nine performance measures had a higher score at follow-up than at baseline. The registry's rule is directional: a measure is called superior when the follow-up score exceeds its baseline score. The primary outcome was considered reached if 6 of the 9 measures were superior. This threshold is a definition of the endpoint, not a result. The record does not state the observed count or provide the scores needed to reproduce it.

What does nonrandomized allocation imply?

The registry identifies allocation as nonrandomized. In a randomized study, a random assignment process is intended to balance both known and unknown participant characteristics across groups over time. That protection cannot be assumed for a nonrandomized comparison. General statistical principle: differences in baseline characteristics, care settings, provider experience, or other factors can be entangled with the intervention and can influence outcome comparisons. The registry record does not describe group assignment procedures or report a statistical adjustment for such differences.

Why does the unit of analysis matter?

The intervention was delivered to providers, while the outcome description gives patient counts. Patients cared for by the same provider or in the same clinic may have related outcomes. General statistical principle: when observations are grouped in this way, treating every patient as statistically independent can understate uncertainty if the analysis does not account for the grouping. The record does not report the analysis unit, whether provider or clinic clustering was considered, or how outcome scores were combined across patients and providers. These omissions prevent assessment of whether the analysis matched the way the intervention was delivered.

What can be said about precision?

A confidence interval describes a range of values compatible with an estimate under the statistical model; narrower intervals indicate greater precision, while wider intervals indicate more uncertainty. This is a general explanation, not a result for this study. The registry does not report an estimate, a confidence interval, or another uncertainty measure for the primary endpoint. No precision assessment can therefore be made from the posted results.

What does the record say about planning calculations?

The stated planning assumptions describe illustrations based on a fraction of an observed effect, with a two-sided significance level of 0.05, equal allocation, and a normal approximation. They distinguish total events for time-to-event outcomes from participants per arm for other outcomes. These are planning illustrations, not evidence of the study's original design or its achieved power. The registry record does not report the original sample-size justification, and it does not provide the numerical planning estimates in the registry record for this explanation. Sample-size illustrations should not be read as observed power or as evidence that the pilot could detect a particular effect.

What analyses are reported?

The registry lists one outcome measure and zero analyses. It does not report a statistical model, an estimation method, a test, an adjustment set, or an approach to missing observations. It is therefore not possible to determine how the investigators handled the nine component measures, how the threshold was evaluated, or whether the arm comparison was adjusted. General statistical principle: the analysis plan determines how data are translated into an estimate and its uncertainty; without that information and the results, neither can be independently interpreted.

The study description characterizes the work as a qualitative pilot, but the endpoint is defined as a count of measures meeting a directional criterion. The record does not explain how qualitative feasibility findings were collected or analyzed, nor how they related to the primary endpoint. Those methods are not reported in the registry record.

10. Multiplicity, Missing Data and Analysis Populations

The primary outcome draws on nine separate performance measures and defines success across them using a threshold of 6 superior measures. This rule is part of the endpoint definition. The registry does not report separate statistical tests for the component measures, an adjustment for multiple comparisons, or whether any components were designated as more important than others. It is therefore unclear whether the component measures were intended as descriptive inputs to one threshold or as separate inferential outcomes.

General statistical principle: examining multiple outcomes can increase the chance that at least one appears favorable by chance, especially when each is tested separately. A prespecified composite or threshold can address a different question from a collection of separate tests, but its interpretation still depends on the exact definition and analysis plan. The registry does not provide enough detail to establish how multiplicity was handled.

Missing-data methods are not reported in the registry record. The entry does not state whether all patients and providers had baseline and follow-up observations, how incomplete performance measures were treated, or whether any imputation or sensitivity analysis was used. Without those details, the potential effect of missing observations on the endpoint cannot be assessed.

The analysis populations are also not reported. The record does not say who was included in each analysis or how the discrepancy between enrollment of 6 and outcome-description counts of 129 patients in each group was resolved. These gaps limit assessment of the denominator, completeness, and comparability of the data underlying the endpoint.

11. What the Result Does, and Does Not, Mean

The registry record establishes that this was a completed pilot of a provider-training and support network and defines a primary performance endpoint. It does not report the endpoint result. No claim about improvement, lack of improvement, or the difference between arms can be drawn from the posted results. In particular, completion status alone does not show whether the primary criterion was met.

The endpoint concerns provider performance measures, including assessment and prescribing-related measures. It is not described as a direct measure of patient symptoms, survival, or another patient clinical outcome. The record does not report whether changes in the performance measures were associated with patient outcomes, nor does it provide a separate analysis of such outcomes.

The design also limits causal interpretation. Because allocation was nonrandomized, any comparison could reflect group differences as well as the training and related support. The record does not report adjustment methods that might address measured differences, and adjustment could not guarantee control of unmeasured differences.

The intervention combined training with access to pharmacist medication-titration services and performance feedback. If an outcome result had been reported, the design would not by itself separate the contribution of each component. The registry also does not explain how feasibility was operationalized, so the stated pilot purpose cannot be translated into a specific feasibility conclusion from the entry.

These limits do not erase the value of a clearly defined pilot question. They set boundaries around what the registry record can establish: the study's aims, arms, endpoint definition, and design are described, while the observed findings and their uncertainty are not reported.

12. Why This Trial Matters Statistically

This study is statistically notable for the distinction between intervention delivery and outcome measurement. Training and added support were directed to providers, while the endpoint was based on performance measures assessed across patients and visits. That structure makes the unit of analysis and any provider- or clinic-level grouping important to interpretation. The registry does not describe how these features were handled analytically.

The endpoint also illustrates a threshold-based summary across multiple measures. Counting measures that improved can provide a compact description of performance across several care processes, but the count does not convey the size of change in each measure. A small increase and a larger increase can both satisfy the directional definition, and the record does not report component scores or the observed count. This is a general property of threshold-based summaries, not a claim about this study's results.

The entry makes a useful distinction between a pilot's feasibility purpose and evidence of comparative effectiveness. It describes the intended network and a preliminary performance outcome, but supplies no analysis results from which to estimate a comparative effect. Nonrandomized allocation and the unresolved enrollment discrepancy further caution against treating the arm labels as proof of a balanced comparison.

For biostatistical interpretation, the record demonstrates why outcome definitions, denominators, analysis units, missing-data procedures, and uncertainty estimates all matter. Those details are needed to move from a study description to a defensible interpretation of findings.

13. Limitations

The central limitation is that the registry record does not report the primary outcome result or any analysis. It therefore provides no observed count of superior measures, no component-level values, and no estimate of uncertainty. The record also does not report the statistical plan, including the method for comparing arms or handling the nine measures.

The design was nonrandomized and unmasked. The record does not explain assignment, baseline comparability, or adjustment for potential confounding. It also does not state whether outcomes were assessed by personnel aware of group assignment. These omissions prevent a detailed appraisal of bias in measurement or comparison.

The population size is ambiguous: enrollment is listed as 6, while the primary outcome description gives 129 patients in each group. The registry does not clarify what the enrollment figure represents or how those patient counts relate to the analysis population. The unit of analysis and handling of patients clustered under providers or clinics are not reported.

Outcome scoring details, missing-data procedures, analysis populations, and feasibility assessment methods are not reported in the registry record. The adverse-event fields list zero at risk and zero affected in each arm, and deaths are null; the record does not provide context sufficient to interpret those entries as a complete assessment of safety. These limitations are specific to the information recorded for this pilot and constrain conclusions about both its results and its methods.

14. Related Tutorials

15. Related Statistical Calculators

16. Sources

Continue through the Clinical Biostats statistical pathway

Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.

17. Record Summary

NCT01246050 is a completed, parallel, nonrandomized, unmasked pilot study sponsored by the VA Office of Research and Development. Its aim was to assess a hub-and-satellite heart-failure provider network involving trained primary care providers supported by a Regional Heart Failure Center. The intervention combined 3 days of training with pharmacist medication-titration services and performance feedback; the comparison arm received none of those supports.

The primary endpoint counted how many of nine heart-failure performance measures had higher follow-up than baseline scores, with 6 of 9 defined as reaching the primary outcome. The timeframe was 12 months. The registry lists enrollment of 6, but the outcome description states that 129 patients were cared for by trained providers and 129 were in the control group; this discrepancy is not explained. The registry reports zero analyses and does not report the primary outcome result.

Clinical Biostats