← Clinical Trials
Palliative Care NA Binary Endpoint NCT01990742

Improving Palliative Care Through Teamwork: Complete Statistical Analysis

This randomized parallel-group trial evaluated nursing-home palliative care teams and standard care, with hospital site of death as the primary outcome. The registry record also reports hospitalizations and contains sponsor analyses that differ from simple recalculations of the posted summaries.

Trial start: 2013-09-27  ·  Enrollment: 31  ·  Sponsor: University of Rochester
Scope of this record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.

1. Trial at a Glance

This page covers the registry results for Improving Palliative Care Through Teamwork (NCT01990742), a randomized na study. The primary outcome is Hospital Site of Death: Number of Decedents Cared for in an Enrolled and Assigned NH Facility, Who Were Transferred to a Hospital and Died in the Hospital During the Study Period.

31
Enrollment
NA
2
Arms
In the primary outcome
+5.5 pts
Risk difference
Palliative Care Team (PCTeam)
3.5 to 7.4 pts
95% CI
Two-sided
FeatureRegistry value
ClinicalTrials.gov identifierNCT01990742
PhaseNA
ConditionPalliative Care
AllocationRandomized
Design modelParallel
MaskingNone (open label)
Enrollment31
Arms in the primary outcome2
Lead sponsorUniversity of Rochester
Results postedYes

2. Clinical Question

Population

Nursing-home residents cared for in an assigned facility who died during the study timeframe. The primary outcome timeframe is 1 year. The registry record describes enrolled nursing homes and reports an enrollment of 31, while the posted primary outcome groups contain 2852 and 2978 participants; how these enrollment figures relate is not reported in the registry record.

Intervention

Palliative Care Team (PCTeam): palliative care teams were to be established and round with residents in intervention homes. The trial objective describes implementation of palliative and end-of-life care practice guidelines through these teams.

Comparator

Standard Care: residents in control homes received usual care. The record identifies no masking, so the comparison is described as an unmasked randomized trial.

Primary question

Among nursing-home residents who died during the study timeframe, how many were transferred to a hospital and died there, comparing residents cared for in PCTeam homes with those receiving standard care? The endpoint is a count of participants meeting that description; it concerns the location of death following transfer, not all hospital use or all deaths considered together.

The registry objective was to evaluate whether nursing-home palliative care practice guidelines implemented through teams would improve care processes and outcomes for residents at the end of life. The primary outcome operationalizes one aspect of that objective: hospital death after transfer from a nursing home. It does not, by itself, describe symptoms, comfort, the quality of communication, or the reasons for a transfer. The posted results also include hospitalizations as a secondary outcome, measured as the mean number during the last 90 days of life. These outcomes therefore address related but distinct questions: one concerns where death occurred after transfer, and the other concerns hospital use near the end of life.

3. Trial Design

The registry record describes a randomized, parallel-group trial with no masking and lists the phase as NA. Its title is “Improving Palliative Care Through Teamwork,” and the official title is “Improving Palliative and End-of-Life Care in Nursing Homes.” The University of Rochester is listed as the sponsor. The record gives a start date of 2013-09-27, a primary completion date of 2016-12-31, and a completed status.

The intervention was a Palliative Care Team. The arm description says teams would be established and would round with residents in intervention homes. The standard-care arm is described as usual care for residents in control homes. The registry summary frames the study as a randomized controlled trial of nursing-home-based teams and says its objective was to use a difference-in-differences analytic approach. The reported analysis entries, however, identify Monte Carlo simulation and do not provide an effect estimate, confidence interval, or test statistic. Further details of the analysis used for the posted sponsor results are not reported in the registry record.

The record lists enrollment as 31. The posted primary outcome results give participant counts of 2852 for PCTeam and 2978 for standard care, and the secondary outcome gives counts of 1907 and 1930. The relationship between the enrollment figure and these outcome counts, including the units represented by enrollment and how participants were included in each outcome, is not reported in the registry record. The group descriptions refer to intervention and control homes, but the record does not give enough information to characterize the allocation unit or the handling of residents nested within homes. That matters statistically because outcomes from residents at the same home may be related; whether and how such dependence was incorporated into the analyses is not reported in the registry record.

The trial is marked completed, but completion alone does not provide details about adherence, follow-up completeness, changes to the analysis plan, or the timing of any analyses. Those details are not reported in the registry record. The posted results are therefore best read alongside the stated design and the specific outcome definitions, while keeping the unreported design and analysis details in view.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Before assignment: Nursing Homes, not individual participants, were enrolled in this RCT study, and were the unit of intervention. However, the outcomes analysis was performed on decedents who were cared for in the enrolled Nursing Homes.

Overall Study

StagePalliative Care Team (PCTeam)Standard Care
STARTED32594331
COMPLETED28522978
NOT COMPLETED4071353

Reasons for not completing this period:

ReasonPalliative Care Team (PCTeam)Standard Care
Withdrawal by facility4071083
Facility closed0270

Analysis population for the primary outcome, as defined in the registry: Nursing home residents cared for in an assigned facility, who died during the study timeframe

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

Population: All decedents with data who resided in assigned facilities.

CharacteristicUnitPalliative Care Team (PCTeam)Standard CareTotal
Participants analysed285229785830
Age, Continuousyears86.0 (SD 8.9)86.2 (SD 9.0)86.1 (SD 9.0)
Sex: Female, Male: FemaleParticipants181319303743
Sex: Female, Male: MaleParticipants103910482087
Ethnicity (NIH/OMB): Hispanic or LatinoParticipants11819
Ethnicity (NIH/OMB): Not Hispanic or LatinoParticipants285129605811
Ethnicity (NIH/OMB): Unknown or Not ReportedParticipants000
Race (NIH/OMB): American Indian or Alaska NativeParticipants222244
Race (NIH/OMB): AsianParticipants111122
Race (NIH/OMB): Native Hawaiian or Other Pacific IslanderParticipants000
Race (NIH/OMB): Black or African AmericanParticipants108153261
Race (NIH/OMB): WhiteParticipants271127925503
Race (NIH/OMB): More than one raceParticipants000
Race (NIH/OMB): Unknown or Not ReportedParticipants000
Region of Enrollment: United Statesparticipants285229785830

6. Primary Endpoint

The registry lists the primary outcome as Hospital Site of Death: Number of Decedents Cared for in an Enrolled and Assigned NH Facility, Who Were Transferred to a Hospital and Died in the Hospital During the Study Period, measured over 1 year.

ElementRegistry entry
Result typeCount Of Participants
Measure of spreadnot applicable
UnitParticipants
Endpoint classificationBinary Endpoint

The primary endpoint is the number of decedents cared for in an enrolled and assigned nursing-home facility who were transferred to a hospital and died there during the study period. The registry defines the population as nursing-home residents cared for in an assigned facility who died during the study timeframe, and gives a timeframe of 1 year. The unit is participants, and the measure is a count of participants meeting the endpoint definition.

This endpoint is used to describe one care process and outcome relevant to end-of-life care: whether death occurred in the nursing home or in a hospital following transfer from the nursing home. It is narrower than a general measure of hospital use. A resident may be hospitalized without dying in hospital, and a death in hospital after transfer is only one possible pathway. The endpoint does not identify why a transfer occurred, whether it was consistent with the resident’s preferences, or whether the care received was appropriate. Those details are not reported in the registry record.

The posted results list 579 participants in the PCTeam group and 441 in standard care for this outcome, with group counts of 2852 and 2978, respectively. The posted comparison also gives proportions of 0.203 and 0.148, and a risk difference of 0.055. These are descriptive estimates from the posted summaries; the sponsor’s own analysis is reported separately and takes precedence where it conflicts with a recalculation. The registry record does not describe how deaths or transfers were verified, how residents with incomplete information were handled, or whether the endpoint was analyzed with adjustment for the nursing-home structure.

7. Results Posted in the Registry

Risk difference: Palliative Care Team (PCTeam)

+5.5

95% CI: 3.5 to 7.4 percentage points

Recalculated from the posted summary statistics

Primary outcome by arm, with 95% confidence intervals
Primary outcome by arm with 95% confidence intervals12.814.716.718.720.722.6Palliative Care Team (PCTeam) (n=2852)Standard Care (n=2978)% of participants (95% CI)
Treatment effect versus the control arm
Forest plot of risk difference (percentage points) vs control (95% CI)Palliative Care Team (PCTeam)-0.601.132.864.596.318.04risk difference (percentage points) vs control (95% CI)

8. Secondary Efficacy Endpoints

The registry also posts results for secondary outcomes. For each outcome below, the endpoint type, the test applied to the posted summary statistics, the result and its interpretation are given in turn. Secondary endpoints are usually not adjusted for multiple testing, so they support rather than confirm the primary finding.

Secondary outcomeTypeEffect measureEstimate (95% CI)Planning size, 80% power
HospitalizationsContinuous EndpointMean difference0.05 (0.01 to 0.09)2,700 per arm

Hospitalizations

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)Palliative Care Team (PCTeam)-0.010.010.040.060.080.10mean difference vs control (95% CI)

The registry lists hospitalizations as the secondary outcome. Its posted summary gives the mean number of hospitalizations during the last 90 days of life, and the simple recalculation gives an unadjusted mean difference of 0.05. The registry’s own analysis reports Monte Carlo simulation with p >0.05, while the simple recalculation gives p = 0.018. The sponsor analysis takes precedence because the record identifies a discrepancy.

The secondary outcome is related to the primary question because both concern aspects of hospital use near the end of life. They are not interchangeable outcomes: the primary endpoint concerns death in hospital after transfer, while hospitalizations measures a mean count during a specified period. A difference in one does not necessarily imply a difference in the other, and the secondary outcome does not directly explain why a resident was transferred or where death occurred.

Unadjusted secondary results carry less weight than a prespecified primary analysis for several reasons. Secondary outcomes may be among multiple questions examined, raising the chance of an apparently notable result by chance when no multiplicity adjustment is used. The registry record does not report whether adjustment was made. The secondary outcome also has its own population, measurement, and analysis choices, and the record does not describe how missing observations or clustering were handled. The recalculated p-value alone therefore should not be treated as confirmatory evidence.

Across the outcomes with posted sponsor analyses, the reported p-values are both >0.05, while unadjusted recalculations produce smaller p-values. This is a pattern of discordant inference rather than a consistent basis for choosing the recalculations over the trial’s own analysis. The record does not report other secondary outcome results in sufficient detail to characterize a broader pattern across all outcomes. No conclusion about the overall quality of end-of-life care can be drawn from the hospitalization outcome alone.

Secondary outcomes registered for this trial, for reference (only those above were recalculated):

9. Statistical Interpretation

Clinical Biostats interpretation

The posted primary outcome summaries report 579 participants meeting the hospital-site-of-death definition among 2852 in the PCTeam group and 441 among 2978 in standard care. The posted proportions are 0.203 for PCTeam and 0.148 for standard care. The simple unadjusted recalculation gives a risk difference of 0.055, with a confidence interval from 0.035 to 0.074, and an unadjusted p-value of <0.001. These figures describe the posted summaries; they do not substitute for the sponsor’s own analysis.

The registry’s reported analysis for the primary outcome is described as Monte Carlo simulation and gives p >0.05. It supplies no corresponding estimate or confidence interval. Because the reported sponsor result differs from the simple recalculation, the sponsor’s own analysis takes precedence. The recalculated contrast can help readers understand the direction and scale represented by the posted group summaries, but its unadjusted p-value should not be presented as the trial’s definitive inferential finding. The registry record does not report enough analytic detail to explain the difference between the reported analysis and the recalculation.

The primary endpoint is specific: death in hospital after transfer from a nursing home. Its interpretation is not equivalent to a broad assessment of end-of-life care quality, and the group contrast does not explain the reasons for transfer, the residents’ preferences, or the context of an individual death. The registry record does not report these details. Nor does it provide information about whether the groups differed in measured characteristics or whether analyses adjusted for differences between homes or residents.

The trial summary describes an intended difference-in-differences approach, while the registry’s reported analysis entry identifies Monte Carlo simulation without a numerical estimate. The information available does not establish how these approaches were combined, what quantities were modeled, or what assumptions underlay the sponsor’s test. The record also does not report the analysis population, missing-data handling, or any adjustment for multiple outcomes. These omissions limit what can be inferred from the reported p-value alone.

For hospitalizations, the posted summaries report means of 0.34 for PCTeam and 0.29 for standard care during the last 90 days of life. The simple unadjusted mean difference is 0.05, with a confidence interval from 0.009 to 0.091 and an unadjusted p-value of 0.018. The registry’s sponsor analysis again reports Monte Carlo simulation with p >0.05. Since the record flags a discrepancy, the sponsor’s analysis takes precedence as well. This secondary outcome should not be treated as independent confirmation of the primary result, particularly because it is one of several outcomes and the registry does not report a multiplicity strategy.

Overall, the registry supports a careful distinction between descriptive group summaries, simple unadjusted recalculations, and the sponsor’s reported analyses. The first two characterize the posted data in different ways; the third is the trial’s own reported inferential result. The record does not provide enough methodological detail to resolve the discordance or to determine how sensitive the sponsor analysis is to assumptions about homes, residents, outcome ascertainment, and missing data. The estimates should therefore be read as evidence about the posted outcomes, not as a complete account of the intervention’s broader effects.

10. Statistical Methods Explained

Several statistical ideas help distinguish what the posted numbers describe from what the registry’s reported analysis establishes. The endpoint is a count of participants meeting a binary definition: each person either met the definition of hospital death after transfer during the study period or did not. For such an outcome, a group proportion expresses the share of the group with the event. A risk difference compares those proportions by subtraction; its sign and size depend on which group is treated as the intervention and which as the comparator. The posted recalculation uses standard care as the reference and reports a risk difference of 0.055 for PCTeam.

What does an unadjusted recalculation represent?

An unadjusted recalculation uses the group counts and denominators in the posted summaries without accounting for other variables or design features. It is useful as a transparent description of the contrast implied by those summaries. It is not necessarily the same estimand or analysis used by the trial sponsor. An adjusted or model-based analysis may account for factors such as the way residents are grouped within homes, changes over time, or other covariates. Whether those features were used in the sponsor’s analysis is not reported in the registry record.

The primary recalculation reports a risk difference and confidence interval, and an unadjusted p-value of <0.001. A p-value summarizes how compatible the observed data are with a specified null hypothesis under the assumptions of the test; it is not the probability that the null hypothesis is true, nor does it describe clinical importance. The registry’s reported Monte Carlo simulation result is p >0.05. Since the record flags a discrepancy between the sponsor result and a recalculation, the sponsor’s own analysis takes precedence. The record does not report enough detail to identify why these methods yield different inferences.

Why might the analysis approach matter?

The registry summary describes the planned objective as using a difference-in-differences analytic approach. In general, difference-in-differences compares changes over time between groups, rather than relying only on a single end-of-study comparison. Its interpretation depends on the data available over time and on assumptions about how the groups would otherwise have changed. The registry record does not report the time-specific outcome data or the assumptions assessed for this trial. The sponsor’s reported analysis entry names Monte Carlo simulation, but provides no model specification, estimate, or confidence interval. The record therefore does not show how the stated objective and reported method relate in the final analysis.

The intervention and control descriptions refer to nursing homes, while outcome summaries report participant counts. In general, residents within the same home may share care processes, staffing, and local circumstances. If outcomes within a home are correlated, an analysis that treats every resident as independent can understate uncertainty. Analyses can account for such clustering, but the registry record does not report the allocation unit or whether clustering was incorporated. This is a limitation in interpreting the precision of any resident-level comparison, not evidence that a particular adjustment was or was not used.

What does the confidence interval add?

A confidence interval describes the range of effect estimates that are reasonably compatible with the data under the method’s assumptions. A narrower interval indicates greater statistical precision than a wider interval, but precision is distinct from freedom from bias. A confidence interval does not account automatically for unmeasured confounding, incorrect outcome classification, clustering ignored by the method, or incomplete follow-up. The intervals reported for the recalculations are based on simple unadjusted methods; they should not be assumed to represent the sponsor’s analysis.

For the primary outcome, the posted recalculation gives a confidence interval from 0.035 to 0.074 around the risk difference of 0.055. For hospitalizations, the unadjusted mean difference is 0.05 with a confidence interval from 0.009 to 0.091. These intervals characterize uncertainty around the recalculated contrasts only. They do not resolve the difference from the sponsor’s p >0.05 results or establish which analysis assumptions are appropriate.

How should the secondary continuous outcome be read?

The hospitalizations outcome is reported as the mean number of hospitalizations during the last 90 days of life, with standard deviations of 0.69 in PCTeam and 0.62 in standard care. A mean difference summarizes the contrast between group averages. The standard deviation describes spread among observations within a group; it is not the same as the standard error, which describes uncertainty in an estimated mean. The recalculation uses a pooled standard deviation of 0.656 and reports a standardized effect size of 0.076. Those are descriptive quantities from the unadjusted calculation and are not the sponsor’s reported effect estimate.

The posted secondary outcome also has different group counts from the primary outcome. The timeframe is the last 90 days of life, so its analytic population and observation window differ from the primary endpoint’s 1 year timeframe. The registry record does not explain the selection or availability of observations for either outcome, or how deaths and follow-up were handled in the hospitalization analysis. Such details matter when interpreting why outcome denominators differ and whether the groups remain comparable in the analysis.

What cannot be concluded from the reported methods?

The registry record does not report a full statistical analysis plan, the original sample-size justification, interim analyses, missing-data methods, or the population used for each analysis. It also does not provide enough information to assess covariate adjustment, clustering, model diagnostics, or the assumptions of the Monte Carlo simulation. The trial summary’s mention of difference-in-differences is not a substitute for those specifications. The available figures allow a reader to describe the posted group results and understand the simple recalculations, but not to reconstruct the sponsor’s full analysis.

These distinctions are especially important when a small p-value from a simple recalculation differs from the sponsor’s reported result. Statistical methods answer questions under their own assumptions; they are not interchangeable labels for the same calculation. The unadjusted recalculation should be read as a secondary analytical aid, while the sponsor analysis remains the primary reported inference for this trial. Neither resolves broader questions about outcome meaning, generalizability, or data completeness that the registry record does not address.

11. Confidence Intervals and Precision

The primary outcome recalculation estimates a risk difference of 0.055, with a confidence interval from 0.035 to 0.074. The interval conveys uncertainty around this unadjusted contrast under the calculation’s assumptions. It is not a range guaranteed to contain the true effect, and it does not account for possible bias, outcome misclassification, or dependence among residents in the same home. The registry record does not state whether the sponsor’s analysis produced a confidence interval; none is reported with its Monte Carlo result.

For hospitalizations, the unadjusted mean difference is 0.05, with a confidence interval from 0.009 to 0.091. This interval describes uncertainty around the difference in group means, not the range of individual residents’ hospitalization counts. The group standard deviations, 0.69 and 0.62, describe observed spread; they do not replace the interval around the estimated mean difference.

Precision and validity are separate. A calculation can have a relatively narrow interval and still be affected by a mismatch between the analysis and trial design, incomplete outcome data, or other biases. In this trial, the reported discrepancy between recalculations and sponsor analyses is particularly relevant: the intervals belong to the recalculated contrasts and should not be read as supporting the sponsor’s result. The registry record does not report enough detail to quantify how accounting for homes or other design features would change uncertainty.

The posted denominators are substantial at the participant level, but the enrollment figure is 31 and its relationship to the outcome counts is not explained. Larger participant counts do not, by themselves, establish greater precision if the analysis structure or effective amount of independent information is unclear. The confidence intervals are useful descriptions of the unadjusted estimates, while the registry’s limited reporting constrains how confidently they can be interpreted as trial-level uncertainty.

12. Planning a Similar Trial: Sample Size

This is a planning illustration, not a re-evaluation of the original trial. It asks: if a new study wanted to detect a difference like the one observed, or a smaller one, how large would it need to be? It is deliberately not “observed power” of the finished trial, which is not a meaningful quantity.

Effect to detectParticipants per arm, 80% powerParticipants per arm, 90% power
100% of the observed effect7521,006
75% of the observed effect1,2961,735
50% of the observed effect2,8223,777
Sample size needed versus the size of the effect to detect
Sample size needed versus size of effect to detect5001,0002,0005,00010,00040%60%80%100%80% power90% powersize of effect to detect, as % of the effect observed (log vertical scale: participants per arm)
Method and assumptions. Two-sided α = 0.05, 1:1 allocation, pooled-variance normal approximation for two proportions (control proportion held at the observed value). Calculated for the comparison: Palliative Care Team (PCTeam).

The planning figures are illustrations based on the observed effect, not the trial’s original design assumptions. The registry record does not report the trial’s own sample-size justification or original planning assumptions. These illustrations use a two-sided significance level of 0.05, equal allocation between the two arms, and a normal approximation. The effect to detect is set at the stated fraction of the observed effect.

For these outcomes, the planning values are participants per arm, not total events. The 80% power column gives the estimated participants per arm for a design with an 80% chance of detecting the stated effect under the illustration’s assumptions, if that effect and assumptions were correct. The 90% power column gives the corresponding participants per arm for a design with a 90% chance. Higher target power requires more participants under otherwise unchanged assumptions.

Rows that plan for 100%, 75%, or 50% of the observed effect show how the required sample size changes as the target effect becomes smaller. Smaller effects are harder to distinguish from random variation, so the planning illustration requires more participants per arm to detect them at the same target power. The figures are not observed power: they are prospective planning illustrations, not a measure of the probability that this completed trial detected an effect.

The illustrations are tied to the simple observed-effect calculations and do not resolve the discrepancy with the sponsor’s reported analyses. They also do not account for any design features that are not included in the stated assumptions, such as possible dependence among residents in the same home. The registry record does not report the original sample-size calculation, so these values should not be interpreted as evidence that the trial was designed around them.

13. How the Sample Size Is Derived

Power is the probability that a study of a given size rejects the null hypothesis when a specific true effect exists. It depends on four things: the effect to detect, the variability of the outcome, the significance level (here a two-sided α of 0.05, so z1−α/2 = 1.960) and the desired power (z1−β = 0.842 for 80% and 1.282 for 90%).

Formula

n = [ z1−α/2 √(2p̄(1−p̄)) + z1−β √(p0(1−p0) + p1(1−p1)) ]2 / (p1 − p0)2

n is the number of participants in each arm, p0 and p1 are the control and treatment proportions, and p̄ is their average.

Worked calculation for this trial

  1. Control proportion p0 = 0.148; treatment proportion p1 = 0.203; average p̄ = 0.176.
  2. First term: z1−α/2 × √[2p̄(1−p̄)] = 1.96 × 0.5380 = 1.0545.
  3. Second term: z1−β × √[p0(1−p0) + p1(1−p1)] = 0.842 × 0.5366 = 0.4516.
  4. n = (1.0545 + 0.4516)2 / (0.0549)2 = 751.8, rounded up to 752 participants per arm for 80% power.

The smaller-effect rows in the table above repeat the same calculation with the effect multiplied by 0.75 and 0.5 (for ratios, applied to the logarithm of the ratio).

R code

alpha <- 0.05
z_a   <- qnorm(1 - alpha / 2)          # two-sided
p0 <- 0.14808596373405                          # control proportion
p1 <- 0.203015427769986                          # treatment proportion
n_per_arm <- function(power, frac = 1) {
  q1 <- p0 + (p1 - p0) * frac               # smaller effect = fraction of the observed difference
  pbar <- (p0 + q1) / 2
  z_b <- qnorm(power)
  ceiling(round((z_a * sqrt(2 * pbar * (1 - pbar)) + z_b * sqrt(p0 * (1 - p0) + q1 * (1 - q1)))^2 / (q1 - p0)^2, 6))
}
for (f in c(1, 0.75, 0.5))
  cat(sprintf("%3.0f%% of observed effect: n per arm = %s (80%% power), %s (90%% power)\n", 100 * f,
              format(n_per_arm(0.80, f), big.mark = ","), format(n_per_arm(0.90, f), big.mark = ",")))

# Check against R's built-in function (unrounded n per arm)
cat("power.prop.test:", round(power.prop.test(p1 = p0, p2 = p1, power = 0.80)$n, 1), "\n")

# Simulation: how often does the z-test reject at the 80%-power sample size?
set.seed(1990742)
n    <- n_per_arm(0.80)
reps <- 20000
x0 <- rbinom(reps, n, p0); x1 <- rbinom(reps, n, p1)
ph <- (x0 + x1) / (2 * n)
z  <- ((x1 - x0) / n) / sqrt(ph * (1 - ph) * 2 / n)
cat(sprintf("Simulated power at n = %s per arm: %.3f (%d replicates)\n", format(n, big.mark = ","), mean(abs(z) > z_a, na.rm = TRUE), reps))

Output from running the code

100% of observed effect: n per arm = 752 (80% power), 1,006 (90% power)
 75% of observed effect: n per arm = 1,296 (80% power), 1,735 (90% power)
 50% of observed effect: n per arm = 2,822 (80% power), 3,777 (90% power)
power.prop.test: 751.8 
Simulated power at n = 752 per arm: 0.804 (20000 replicates)

The simulation draws many pairs of event counts at the planned sample size and counts how often the two-proportion z-test rejects the null. It should land close to the target power; at very small required sample sizes it can fall below it, because the normal approximation is rough there.

14. Analyses Reported by the Sponsor

MethodEstimate95% CIP-value
MOnte carlo simulationnot reported> 0.050
Where the two analyses differ, rely on the sponsor's. The simple re-calculation above reaches a different conclusion from the sponsor's analysis, usually because the sponsor adjusts for covariates, stratification or repeated measures, or (for event rates) uses a negative binomial model that allows for over-dispersion and so gives wider intervals.

The registry reports Monte Carlo simulation for the primary outcome and gives p >0.05, without an effect estimate or confidence interval. For hospitalizations, the reported analysis is also Monte Carlo simulation with p >0.05. Simple recalculations from the posted summaries instead give p <0.001 for the primary outcome and 0.018 for hospitalizations. The registry record flags a discrepancy between sponsor analyses and recalculations.

Because of that discrepancy, the sponsor’s own analysis takes precedence. The recalculations are unadjusted comparisons derived from posted group summaries; they may not reproduce the sponsor’s model, assumptions, or treatment of the trial design. The record does not provide enough detail to explain why the results differ, including the simulation procedure, model specification, or any adjustment for nursing homes or other factors.

The sponsor results should not be treated as proof that the groups were identical, just as the unadjusted p-values should not replace the sponsor’s reported analysis. A p-value does not quantify the size or practical importance of an effect. Without the sponsor’s effect estimates and uncertainty intervals, the magnitude and precision of its analysis are not reported in the registry record. The most transparent reading is to keep the sponsor result distinct from the descriptive summaries and to recognize that the registry does not supply sufficient methodological detail to reconcile them.

15. Multiplicity, Missing Data and Analysis Populations

The registry reports one primary outcome and lists hospitalizations as a secondary outcome, while also stating that there were three outcome measures and three analyses. The other outcomes and their results are not described in the record excerpt. A multiplicity strategy—such as whether outcomes were ranked, adjusted, or treated as exploratory—is not reported in the registry record. Without that information, unadjusted secondary p-values should be interpreted cautiously because examining multiple outcomes can increase the chance of finding a result that appears unusual by chance.

Missing-data methods are not reported in the registry record. It does not state how residents with unavailable outcome information were handled, whether the outcome counts include all eligible residents, or whether any imputation or sensitivity analysis was performed. The group counts differ between the primary and secondary outcomes, but the record does not explain why. Different outcome definitions and timeframes may be relevant, but the specific reason for the difference is not reported.

The analysis populations are also not specified. The record does not say whether analyses followed an intention-to-treat principle, included only residents with complete outcome information, or used another population definition. It gives an enrollment of 31 and participant counts in the posted outcomes that are much larger; the relationship between these figures is not reported. The unit represented by enrollment and the role of nursing homes in the analysis therefore remain unclear.

Finally, the registry does not report whether statistical methods accounted for residents being grouped within homes, how the Monte Carlo simulation was constructed, or whether the stated difference-in-differences objective was implemented in the final analysis. These omissions matter for uncertainty, comparability, and interpretation. They do not establish that any particular method was absent; they mean the relevant details are not reported in the registry record.

16. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

ArmParticipants with serious adverse eventsParticipants at riskPercentage
Palliative Care Team (PCTeam)28522852100.0%
Standard Care29782978100.0%
Participants with at least one serious adverse event
Serious adverse events by armPalliative Care Team (PCTeam)100.0%Standard Care100.0%% of participants with at least one serious adverse event

Deaths

ArmDeaths (participants affected of at risk)
Palliative Care Team (PCTeam)2852 of 2852
Standard Care2978 of 2978

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 0% reporting threshold.

ArmParticipants affected of at risk
Palliative Care Team (PCTeam)0 of 2852
Standard Care0 of 2978

Most frequent serious adverse event terms

Event termOrgan systemPalliative Care Team (PCTeam)Standard Care
Death from causes not associated with the studyGeneral disorders2852 of 28522978 of 2978

Serious events with the highest arm-level rate: death from causes not associated with the study (100.0%).

Do not overextend the safety comparison. Serious-adverse-event counts are safety observations, not efficacy outcomes, and should not be combined with the primary result into a single benefit-risk number.

The serious adverse event entries list 2852 participants at risk and affected in the PCTeam group, and 2978 at risk and affected in standard care. The registry also lists 2852 and 2978 deaths, respectively. The leading serious event term is “Death from causes not associated with the study,” reported as 100.0%. No other adverse events are listed in the other-event fields.

These are registry reporting figures and should be read in the context of the outcome and population entries. The primary outcome itself concerns deaths and their location after transfer. The adverse-event entries do not, by themselves, establish that the intervention caused deaths or that all deaths were attributable to an adverse event. The listed term explicitly characterizes the deaths as from causes not associated with the study.

The record does not provide a narrative explaining how adverse events were collected, how seriousness or relatedness was determined, or how the entries correspond to the outcome population and follow-up. Nor does it report additional detail about event timing or individual causes. The figures therefore describe the registry’s adverse-event reporting, but they do not support a causal safety comparison beyond what is explicitly recorded.

17. What the Result Does, and Does Not, Mean

The posted results describe differences between the PCTeam and standard-care groups for the recorded outcomes. For the primary endpoint, the posted counts and unadjusted proportions yield a risk difference of 0.055 in the PCTeam direction. The sponsor’s own analysis reports p >0.05, and the registry flags the discrepancy with the unadjusted recalculation. That sponsor analysis takes precedence; the available registry information does not provide an estimate or interval from it.

This does not establish that the groups were identical, nor does it establish a definitive effect in either direction. A non-small p-value is not proof of no difference, and a smaller p-value from a simple recalculation is not proof that the sponsor analysis is wrong. Interpretation depends on the design and assumptions behind each analysis, several of which are not reported in the registry record.

The endpoint is limited to hospital death after transfer from a nursing home. It does not measure all dimensions of palliative or end-of-life care, and it cannot explain whether transfers were appropriate, whether care matched residents’ preferences, or why particular decisions were made. The registry objective included care processes and resident and staff outcomes, but the results described in the record do not provide a complete evaluation of those domains.

The trial’s setting and intervention are relevant to nursing-home practice, but the record does not report enough information about the facilities, residents, implementation, or analysis to judge how broadly the findings apply. The enrollment figure and posted participant counts are not reconciled, and details of missing data and clustering are not reported. The secondary hospitalization result is also subject to the sponsor-versus-recalculation discrepancy and is not a substitute for the primary outcome.

Accordingly, the most defensible interpretation separates the descriptive posted summaries from the sponsor’s reported inference. The summaries show the observed group data as recorded; the sponsor analysis is the trial’s own reported statistical conclusion. Neither alone answers broader questions about quality of care, resident preferences, or the mechanisms behind transfers. Those conclusions require information that is not reported in the registry record.

18. Why This Trial Matters Statistically

This trial raises a central statistical issue in applied clinical research: a result can look different when analyzed from simple group summaries than when evaluated using the sponsor’s own method. The primary outcome recalculation gives p <0.001, while the registry’s reported Monte Carlo analysis gives p >0.05. The hospitalizations recalculation gives 0.018, while its reported sponsor analysis also gives p >0.05. The registry flags this discrepancy, so the sponsor analysis takes precedence, but the record does not provide enough detail to understand the source of the difference.

The trial also illustrates why the level of observation and the level of intervention need to be clear. The intervention is described in terms of teams and nursing homes, while results are reported as participant counts. Residents within a home may share care context, and the registry does not state how that structure was handled statistically. Clear reporting of allocation units, analytic populations, clustering, and outcome denominators is important for interpreting both effect estimates and their precision.

Another lesson is the need to distinguish outcomes that are related but not equivalent. Hospital death after transfer and the mean number of hospitalizations in the last 90 days of life address different aspects of end-of-life care. Neither alone captures the full quality of care or residents’ preferences. Reporting outcome definitions and analysis methods together helps readers understand what a trial result does and does not represent.

Finally, planning illustrations based on an observed effect are not a substitute for the original sample-size rationale. The registry record does not report that rationale, and the illustrations are not observed power. Transparent records of prespecified analyses, missing-data handling, multiplicity, and design assumptions would help readers distinguish planned inference from post hoc recalculation and assess the reliability of reported conclusions.

19. Limitations

Several trial-specific limitations arise from gaps in the registry record. The record lists enrollment as 31, whereas the posted primary outcome group counts are 2852 and 2978. The secondary outcome counts are 1907 and 1930. The relationship among these figures, including the units each represents and how each outcome population was defined, is not reported. This makes it difficult to interpret the flow from enrollment to analysis.

The intervention and control descriptions refer to nursing homes, but the record does not specify the allocation unit or explain whether statistical analyses accounted for residents grouped within homes. If residents in the same home have related outcomes, that structure can affect uncertainty estimates. The record does not say whether such dependence was addressed, so the recalculated intervals should be understood as unadjusted rather than assumed to represent the full design.

The registry describes a difference-in-differences objective but reports Monte Carlo simulation for the sponsor analyses without an estimate, confidence interval, or model details. It does not explain how the final analysis relates to the stated objective, why the sponsor results differ from simple recalculations, or what assumptions were used. Missing-data handling, analysis populations, multiplicity procedures, interim analyses, and the original sample-size justification are not reported in the registry record.

The primary outcome is narrowly defined as death in hospital following transfer. It does not measure all aspects of palliative care quality or explain the circumstances of transfer. The record also does not give detailed information about facility characteristics, implementation fidelity, resident preferences, outcome verification, or follow-up completeness. These limitations restrict interpretation of the posted results and their applicability beyond the outcomes and setting described in the registry.

20. Related Tutorials

21. Related Statistical Calculators

22. Sources

Continue through the Clinical Biostats statistical pathway

Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.

23. Record Summary

The registry record describes a completed, randomized, parallel-group, unmasked trial sponsored by the University of Rochester. It compares Palliative Care Teams, whose members would round with residents in intervention homes, with standard care in control homes. The primary outcome is the count of residents who were transferred from a nursing home and died in hospital during the 1 year timeframe.

The posted primary group summaries yield an unadjusted risk difference of 0.055, while the sponsor’s reported Monte Carlo analysis gives p >0.05. Hospitalizations during the last 90 days of life is listed as a secondary outcome; its sponsor analysis also reports p >0.05. The registry flags discrepancies between the sponsor analyses and simple recalculations, so the sponsor analyses take precedence.

The record does not report enough detail to reconcile enrollment with outcome counts or to assess the analysis population, missing data, multiplicity, or handling of residents within homes. The results are therefore best interpreted as outcome-specific registry reports, not as a complete assessment of end-of-life care quality.

Clinical Biostats