← Clinical Trials
Kidney Transplantation Phase 3 Binary Endpoint NCT00256750

Belatacept Evaluation of Nephroprotection and Efficacy as First-line Immunosuppression (BENEFIT): Complete Statistical Analysis

BENEFIT was a randomized, parallel-group Phase 3 trial comparing belatacept regimens with cyclosporine after kidney transplantation. The primary outcome was survival with a functioning graft through Month 12.

Trial start: 2005-03  ·  Enrollment: 738  ·  Sponsor: Bristol-Myers Squibb
Scope of this record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.

1. Trial at a Glance

This page covers the registry results for Belatacept Evaluation of Nephroprotection and Efficacy as First-line Immunosuppression (BENEFIT) (NCT00256750), a randomized phase 3 study. The primary outcome is Percent of Participants Surviving With a Functioning Graft by Month 12.

738
Enrollment
Phase 3
3
Arms
In the primary outcome
+3.7 pts
Risk difference
Belatacept LI
-0.5 to 7.9 pts
95% CI
Two-sided
FeatureRegistry value
ClinicalTrials.gov identifierNCT00256750
PhasePhase 3
ConditionKidney Transplantation, Chronic Kidney Failure
AllocationRandomized
Design modelParallel
MaskingSingle
Enrollment738
Arms in the primary outcome3
Lead sponsorBristol-Myers Squibb
Results postedYes

2. Clinical Question

Population

People undergoing kidney transplantation, with the primary analysis defined as all randomized, transplanted, and treated participants in the intent-to-treat population. The registry lists kidney transplantation and chronic kidney failure as conditions.

Intervention

Belatacept in a less intensive regimen (LI) or a more intensive regimen (MI). The registry identifies both as drug interventions but does not report further regimen details in the record summarized for this trial.

Comparator

Cyclosporine (CsA), the active comparator. The primary outcome results are reported separately for each belatacept regimen against cyclosporine.

Primary question

What proportion of participants survived with a functioning graft from Day 1 to Month 12, and how did the proportions for the two belatacept regimens compare with cyclosporine?

The clinical question concerns both participant survival and continued graft function. A graft counted as lost if it was lost physically or functionally. Functional loss included a sustained serum creatinine threshold, dialysis for a specified duration, or renal impairment leading to retransplantation. These criteria make the outcome broader than graft survival defined only by whether a transplant remained physically present.

The registry also describes interest in kidney function, patient survival, and safety, with secondary outcomes covering measured glomerular filtration rate, chronic allograft nephropathy, adverse events, blood pressure, laboratory abnormalities, and anti-donor antibodies. These outcomes add different perspectives, but they do not replace the primary question. The primary result is a Month 12 binary outcome: each participant either met the definition of survival with a functioning graft or did not.

3. Trial Design

BENEFIT (Belatacept Evaluation of Nephroprotection and Efficacy as First-line Immunosuppression) is recorded as a Phase 3 randomized, single-masked, parallel-group trial. The registry lists Bristol-Myers Squibb as sponsor and enrollment of 738. The study is marked completed. The recorded start is 2005-03 and primary completion is 2008-06.

Participants were assigned to cyclosporine, belatacept LI, or belatacept MI. The primary endpoint results use the intent-to-treat population described as all randomized, transplanted, and treated participants. The reported endpoint-specific group sizes are 221 for cyclosporine, 226 for belatacept LI, and 219 for belatacept MI. These endpoint denominators need not match the overall enrollment because enrollment and an outcome-specific analysis denominator describe different things.

Single masking is the masking information recorded, but who was masked and how masking was maintained are not reported in the registry record. The arm descriptions are blank, so details beyond the intervention names and the LI and MI labels are not reported in the registry record. The original allocation procedures, follow-up procedures, and trial-specific sample-size rationale are also not reported in the registry record.

The registry lists 43 outcome measures and 178 analyses. The primary outcome is survival with a functioning graft by Month 12, with a timeframe from Day 1 to Month 12. Secondary outcomes extend to Month 84 for some measures, while others are assessed at Month 12 or Month 36. The range of follow-up windows means that findings across outcomes should not be treated as if they describe the same period or the same event process.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Before assignment: 738 participants enrolled, 686 randomized. Reasons for non-randomization include 5 participants withdrew consent, 1 lost to follow-up, 34 no longer met study criteria, and 12 for other non-listed reasons. 666 participants randomized, but not transplanted. 20 not transplanted; 10, 4, 6 in the CsA, Belatacept LI, Belatacept MI, respectively.

Transplanted Pre-Treatment

StageCyclosporineBelatacept LIBelatacept MI
STARTED221226219
COMPLETED215226219
NOT COMPLETED600

Reasons for not completing this period:

ReasonCyclosporineBelatacept LIBelatacept MI
Withdrawal by Subject300
Other200
Death100

Post-Transplant Treated (12 Months)

StageCyclosporineBelatacept LIBelatacept MI
STARTED215226219
COMPLETED174183173
NOT COMPLETED414346

Reasons for not completing this period:

ReasonCyclosporineBelatacept LIBelatacept MI
Adverse Event20128
Death324
Lack of Efficacy102227
Lost to Follow-up100
Other542
Withdrawal by Subject035
Protocol Violation200

Post-Transplant Treated (24 Months)

StageCyclosporineBelatacept LIBelatacept MI
STARTED174183173
COMPLETED153176164
NOT COMPLETED2179

Reasons for not completing this period:

ReasonCyclosporineBelatacept LIBelatacept MI
Adverse Event736
Withdrawal by Subject510
Death300
Lack of Efficacy432
Other201

Post-Transplant Treated (36 Months)

StageCyclosporineBelatacept LIBelatacept MI
STARTED153176164
COMPLETED143170158
NOT COMPLETED1066

Reasons for not completing this period:

ReasonCyclosporineBelatacept LIBelatacept MI
Adverse Event512
Withdrawal by Subject101
Death021
Subject no longer meets study criteria001
Lack of Efficacy410
Protocol Violation010
Other011

Analysis population for the primary outcome, as defined in the registry: All randomized, transplanted, and treated participants; intent to treat (ITT) population

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

Population: Baseline characteristics of transplant recipients: All randomized and transplanted participants, intent to treat (ITT) population

CharacteristicUnitCyclosporineBelatacept LIBelatacept MITotal
Participants analysed221226219666
Age, Continuousyears43.5 (SD 14.3)42.6 (SD 13.4)43.6 (SD 14.6)43.2 (SD 14.1)
Age, Customized: Between 18 and 45 years:participants110124111345
Age, Customized: Between 46 and 65 years:participants1019393287
Age, Customized: > 65 years:participants1091534
Sex: Female, Male: FemaleParticipants568068204
Sex: Female, Male: MaleParticipants165146151462
Previous Number of Transplant: 0participants208218210636
Previous Number of Transplant: 1participants95519
Previous Number of Transplant: 2participants0011
Previous Number of Transplant: Missingparticipants43310

6. Primary Endpoint

The registry lists the primary outcome as Percent of Participants Surviving With a Functioning Graft by Month 12, measured over Day 1 to Month 12.

ElementRegistry entry
Result typeNumber
Measure of spread95% Confidence Interval
Unitpercentage of participants
Endpoint classificationBinary Endpoint

The primary endpoint is the percentage of participants surviving with a functioning graft by Month 12, measured from Day 1 to Month 12. It combines two clinically important conditions: the participant is alive, and the transplanted kidney has not met the registry’s definition of graft loss. The outcome is therefore not simply a measure of kidney function at a single visit.

Graft loss includes physical loss, such as nephrectomy, and functional loss. Functional loss was defined using sustained serum creatinine at or above 6.0 milligrams per deciliter or 530 micromolar per liter, dialysis for at least 56 consecutive days, or impairment of renal function severe enough to lead to retransplantation. The creatinine criterion is described as sustained for at least 4 weeks or at least 56 consecutive days.

A binary endpoint is useful for comparing the proportion of participants meeting a clearly specified outcome by a fixed follow-up time. It can capture events with different clinical pathways under one prespecified definition. At the same time, it does not show when within the follow-up period an event occurred, how kidney function changed among participants who retained a functioning graft, or which component of the composite definition determined an outcome. Those questions require other outcomes and analyses. The posted primary results report the group percentages and confidence intervals, while the registry record does not report a breakdown of the primary endpoint by its component criteria.

7. Results Posted in the Registry

Risk difference: Belatacept LI

+3.7

95% CI: -0.5 to 7.9 percentage points

Recalculated from the posted summary statistics

Primary outcome by arm, with 95% confidence intervals
Primary outcome by arm with 95% confidence intervals87.689.992.294.596.899.2Cyclosporine (n=221)Belatacept LI (n=226)Belatacept MI (n=219)% of participants (95% CI)
Treatment effect versus the control arm
Forest plot of risk difference (percentage points) vs control (95% CI)Belatacept LIBelatacept MI-2.49-0.261.974.196.428.65risk difference (percentage points) vs control (95% CI)

8. Secondary Efficacy Endpoints

The registry also posts results for secondary outcomes. For each outcome below, the endpoint type, the test applied to the posted summary statistics, the result and its interpretation are given in turn. Secondary endpoints are usually not adjusted for multiple testing, so they support rather than confirm the primary finding.

Secondary outcomeTypeEffect measureEstimate (95% CI)Planning size, 80% power
Percent of Participants With Prevalence of Chronic Allograft Nephropathy (CAN) at Month 12Binary EndpointRisk difference-8.5 pts (-16.9 to -0.2)436 per arm
Percent of Participants With Development of Anti-Donor HLA Positive Antibodies by Month 84Binary EndpointRisk difference-8.5 pts (-13.4 to -3.7)146 per arm
Percent of Participants With a Decrease in Measured Glomerular Filtration Rate (mGFR) Greater Than or Equal to 10mL/Min/1.73m^2 From Month 3 to Month 12Binary EndpointRisk difference-4.8 pts (-13.1 to 3.5)1,300 per arm

Percent of Participants With Prevalence of Chronic Allograft Nephropathy (CAN) at Month 12

Treatment effect versus the control arm
Forest plot of risk difference (percentage points) vs control (95% CI)Belatacept LIBelatacept MI-24-19-14-8.52-3.371.78risk difference (percentage points) vs control (95% CI)

Percent of Participants With Development of Anti-Donor HLA Positive Antibodies by Month 84

Treatment effect versus the control arm
Forest plot of risk difference (percentage points) vs control (95% CI)Belatacept LIBelatacept MI-16-13-9.12-5.69-2.251.18risk difference (percentage points) vs control (95% CI)

Percent of Participants With a Decrease in Measured Glomerular Filtration Rate (mGFR) Greater Than or Equal to 10mL/Min/1.73m^2 From Month 3 to Month 12

Treatment effect versus the control arm
Forest plot of risk difference (percentage points) vs control (95% CI)Belatacept LIBelatacept MI-15-11-6.99-3.040.904.84risk difference (percentage points) vs control (95% CI)

The secondary outcomes address several dimensions beyond the primary Month 12 graft-and-survival measure. They include kidney function, chronic allograft nephropathy, adverse events, blood pressure, laboratory abnormalities, and anti-donor antibodies. Their follow-up periods vary, extending to Month 84 for some outcomes, so they represent a broader and longer-term picture than the primary endpoint alone.

Across the posted binary secondary results with detailed comparisons, the direction of the estimates is not uniform across all outcome types. Some outcomes have lower percentages in the belatacept groups than in the cyclosporine group, while the comparison for decline in measured glomerular filtration rate has intervals that include no difference. This range of patterns does not conflict with the primary result: secondary measures capture different events, definitions, and follow-up periods, and they need not move in parallel with survival with a functioning graft by Month 12.

Secondary analyses generally carry less weight than the primary endpoint for confirmatory interpretation, especially when many outcomes and comparisons are examined. With multiple opportunities to find a nominally unusual result, unadjusted p-values do not control the overall chance of false-positive findings across the full family of analyses. The registry lists 43 outcome measures and 178 analyses, but a multiplicity adjustment or hierarchy for interpreting those analyses is not reported in the registry record.

Secondary findings can help identify patterns that merit attention and can complement the primary result, but they should be interpreted with their own denominators, confidence intervals, and timeframes. They should not be used to make a broad claim about every aspect of kidney function or safety. The registry record does not report an integrated analysis that combines the secondary outcomes into a single overall measure.

Secondary outcomes registered for this trial, for reference (only those above were recalculated):

9. Statistical Interpretation

Clinical Biostats interpretation

By Month 12, the posted proportions surviving with a functioning graft were 92.8% with cyclosporine, 96.5% with belatacept LI, and 95.4% with belatacept MI. The arm-specific 95% confidence intervals were 89.3% to 96.2%, 94.1% to 98.9%, and 92.7% to 98.2%, respectively. The displayed estimates are close, and each interval reflects uncertainty around its group estimate.

The recalculated, unadjusted risk difference for belatacept LI versus cyclosporine was 0.037, with a 95% confidence interval from -0.005 to 0.079 and p = 0.083. For belatacept MI versus cyclosporine, the recalculated risk difference was 0.027, with a 95% confidence interval from -0.017 to 0.071 and p = 0.234. Both intervals include zero, so these unadjusted comparisons do not provide a precise estimate that excludes no difference on the risk-difference scale. That does not establish that the regimens are equivalent, nor does it establish that there is no difference.

The registry also classifies its sponsor-reported primary comparisons as non-inferiority or equivalence analyses. Those reported differences are 3.7 percentage points for LI versus cyclosporine and 2.7 percentage points for MI versus cyclosporine, each with a 97.3% confidence interval. The corresponding intervals are -1.1 to 9.0 and -2.5 to 8.1. The non-inferiority margin and decision rule are not reported in the registry record, so the reported intervals cannot be judged against that criterion from this record alone.

The percentages are descriptive estimates for the analyzed groups, not proof that a treatment caused an outcome. The registry’s population definition, the study design, and the sponsor’s analysis all matter to interpretation. A confidence interval that includes zero can still be compatible with effects in either direction, and its width indicates that the estimate is not exact. The primary outcome also says nothing by itself about the full range of kidney function, adverse events, or longer-term outcomes.

In short, the posted Month 12 estimates are numerically higher in both belatacept groups than in the cyclosporine group, while the recalculated intervals include no difference. The registry’s own analysis labels the comparisons as non-inferiority or equivalence, but the information needed to assess the criterion is not reported in the registry record. The results should be read as estimates with uncertainty, rather than as a definitive claim of superiority, equivalence, or absence of difference.

10. Statistical Methods Explained

The primary outcome is binary: a participant either survived with a functioning graft by Month 12 or did not meet that definition. For a binary outcome, a group percentage describes the proportion of analyzed participants meeting the definition. A comparison can then be expressed as a difference between group proportions. The recalculated comparisons use the risk-difference scale and are unadjusted calculations from the posted summary statistics.

What does a confidence interval describe?

A confidence interval describes statistical uncertainty around an estimated quantity under the assumptions of the method used. For an arm-specific percentage, it gives a range of values compatible with the data and method. For a risk difference, it gives a range of plausible differences between groups. A narrower interval indicates greater precision than a wider interval, but neither interval removes uncertainty or accounts automatically for every possible source of bias.

The registry reports 95% confidence intervals for the arm percentages. The sponsor-reported primary contrasts are recorded with 97.3% confidence intervals. Those interval levels should not be treated as interchangeable: a confidence interval’s level is part of its definition. The record does not state the method used for the sponsor’s primary analysis, so that method is not reported in the registry record.

How should the p-values be read?

The recalculated p-values are unadjusted tests based on the posted summary statistics. A p-value describes how compatible the observed data are with a specified null model, under the assumptions of the test. It is not the probability that the null hypothesis is true, and it does not measure the size or clinical importance of a difference. The LI comparison has p = 0.083 and the MI comparison has p = 0.234. These values should be read alongside the estimates and confidence intervals rather than as standalone verdicts.

The registry’s sponsor-reported primary results do not include p-values. The reported analysis type is non-inferiority or equivalence, which asks a different question from a conventional test for any difference. A non-inferiority interpretation depends on a prespecified margin and an analysis rule. Neither is reported in the registry record. Thus, the sponsor-reported classification can be described, but the criterion cannot be independently evaluated from the registry record.

Why distinguish sponsor results from recalculations?

The recalculated statistics are simple, unadjusted calculations from posted counts and denominators. They are useful for understanding the raw group comparison, but they are not a substitute for the trial’s full analysis. The sponsor’s analysis may use a different method, population handling, or confidence-interval construction; the registry record does not report enough detail to specify those choices for the primary endpoint. The posted sponsor analysis should therefore be kept distinct from the recalculation, rather than blending their interval levels or methods.

What does the randomization contribute?

Random assignment is intended to make the treatment groups comparable on average at the start of a trial, including for factors that were not measured. This supports a causal comparison when the trial is conducted and analyzed as planned. Randomization does not guarantee that every group is identical, prevent missing outcomes, or remove uncertainty from finite data. The registry says the trial was randomized and parallel-group, but the detailed randomization procedure and the trial-specific analysis plan are not reported in the registry record.

Why does over-dispersion matter?

Over-dispersion is a general issue for count or rate outcomes when observed variability is greater than a simple statistical model expects. It can make standard errors too small if the extra variability is ignored. The primary endpoint is a binary percentage, not a count-rate endpoint, and the registry record does not report an over-dispersion adjustment for this endpoint. For other outcomes, the appropriate model depends on the outcome type and analysis plan; those model details are not reported in the registry record.

More broadly, the registry lists many outcomes and analyses. Separate unadjusted comparisons across many outcomes increase the chance that some results appear notable by chance. The registry record does not report a multiplicity strategy for the full set of analyses. Accordingly, secondary comparisons are best treated as supportive or exploratory unless their analysis and interpretation are established by a documented plan.

11. Confidence Intervals and Precision

The arm-specific confidence intervals give a sense of the precision of the Month 12 estimates. For cyclosporine, the estimate is 92.8%, with a 95% confidence interval from 89.3% to 96.2%. For belatacept LI, the estimate is 96.5%, with an interval from 94.1% to 98.9%. For belatacept MI, the estimate is 95.4%, with an interval from 92.7% to 98.2%. Each range includes uncertainty around the corresponding group percentage; it is not a range of individual participants’ outcomes.

For the recalculated group contrasts, the LI risk-difference interval runs from -0.005 to 0.079, and the MI interval runs from -0.017 to 0.071. Both span zero. Thus, the posted summary data are compatible with effects on either side of no difference under these calculations. The intervals also permit a range of possible effects, so a single point estimate should not be read as the exact underlying difference.

The sponsor-reported contrast intervals are at the 97.3% level and have different limits from the recalculated 95% intervals. This difference in interval level is important when comparing apparent precision. The sponsor’s LI interval is -1.1 to 9.0, and its MI interval is -2.5 to 8.1, for the reported difference-in-percent results. The non-inferiority margin is not reported in the registry record, preventing assessment of whether these intervals meet a particular margin-based criterion.

Precision is limited by the amount of information available for an outcome and by the number of events, not merely by the overall trial enrollment. The primary endpoint denominators are the reported endpoint group sizes, and other outcomes use their own denominators. Confidence intervals quantify sampling uncertainty under the relevant analysis; they do not account for unreported design details, outcome misclassification, or other possible systematic errors.

12. Planning a Similar Trial: Sample Size

This is a planning illustration, not a re-evaluation of the original trial. It asks: if a new study wanted to detect a difference like the one observed, or a smaller one, how large would it need to be? It is deliberately not “observed power” of the finished trial, which is not a meaningful quantity.

Effect to detectParticipants per arm, 80% powerParticipants per arm, 90% power
100% of the observed effect584781
75% of the observed effect1,1231,502
50% of the observed effect2,7133,631
Sample size needed versus the size of the effect to detect
Sample size needed versus size of effect to detect5001,0002,0005,00010,00040%60%80%100%80% power90% powersize of effect to detect, as % of the effect observed (log vertical scale: participants per arm)
Treat these figures cautiously. The observed difference is imprecise: its confidence interval includes no difference at all. A sample size built on a noisy estimate can be far too small or too large, so the smaller-effect rows are the more cautious guide.
Method and assumptions. Two-sided α = 0.05, 1:1 allocation, pooled-variance normal approximation for two proportions. Counts were reconstructed from the posted percentages and arm sizes, so small rounding differences are possible. Calculated for the comparison: Belatacept LI.

The sample-size illustrations are planning calculations based on the observed effect, not the original trial’s design assumptions. For these binary percentage outcomes, the figures are participants per arm, not total events. The stated planning assumptions are a two-sided significance level of 0.05, equal allocation between the two arms, and a normal approximation. Each row considers an effect equal to the stated fraction of the observed effect.

The 80% power column gives the planned participants per arm under those assumptions for a design with an 80% chance of detecting the specified effect if that effect is real and the assumptions hold. The 90% power column makes the corresponding illustration for a 90% chance. Greater planned power generally requires more participants when other assumptions are held constant. Smaller effects require more participants to detect than larger effects, which is why the illustrations increase as the assumed fraction of the observed effect decreases.

These values are not observed power. They are hypothetical planning illustrations calculated after the trial from the observed effect, and they do not establish whether the trial was adequately designed for its original purpose. The registry’s original sample-size justification and design assumptions are not reported in the registry record. The calculations also depend on the observed effect, which is uncertain, so they should not be treated as a forecast of what another study would necessarily require.

The planning assumptions describe equal allocation between the two arms for each comparison. They do not describe the three-arm trial’s original allocation process. The illustrations should be interpreted as a way to understand how assumed effect size and target power relate to required per-arm enrollment, not as a recommendation or a reconstruction of the trial protocol.

13. How the Sample Size Is Derived

Power is the probability that a study of a given size rejects the null hypothesis when a specific true effect exists. It depends on four things: the effect to detect, the variability of the outcome, the significance level (here a two-sided α of 0.05, so z1−α/2 = 1.960) and the desired power (z1−β = 0.842 for 80% and 1.282 for 90%).

Formula

n = [ z1−α/2 √(2p̄(1−p̄)) + z1−β √(p0(1−p0) + p1(1−p1)) ]2 / (p1 − p0)2

n is the number of participants in each arm, p0 and p1 are the control and treatment proportions, and p̄ is their average.

Worked calculation for this trial

  1. Control proportion p0 = 0.928; treatment proportion p1 = 0.965; average p̄ = 0.946.
  2. First term: z1−α/2 × √[2p̄(1−p̄)] = 1.96 × 0.3194 = 0.6259.
  3. Second term: z1−β × √[p0(1−p0) + p1(1−p1)] = 0.842 × 0.3183 = 0.2679.
  4. n = (0.6259 + 0.2679)2 / (0.0370)2 = 583.5, rounded up to 584 participants per arm for 80% power.

The smaller-effect rows in the table above repeat the same calculation with the effect multiplied by 0.75 and 0.5 (for ratios, applied to the logarithm of the ratio).

R code

alpha <- 0.05
z_a   <- qnorm(1 - alpha / 2)          # two-sided
p0 <- 0.927601809954751                          # control proportion
p1 <- 0.964601769911504                          # treatment proportion
n_per_arm <- function(power, frac = 1) {
  q1 <- p0 + (p1 - p0) * frac               # smaller effect = fraction of the observed difference
  pbar <- (p0 + q1) / 2
  z_b <- qnorm(power)
  ceiling(round((z_a * sqrt(2 * pbar * (1 - pbar)) + z_b * sqrt(p0 * (1 - p0) + q1 * (1 - q1)))^2 / (q1 - p0)^2, 6))
}
for (f in c(1, 0.75, 0.5))
  cat(sprintf("%3.0f%% of observed effect: n per arm = %s (80%% power), %s (90%% power)\n", 100 * f,
              format(n_per_arm(0.80, f), big.mark = ","), format(n_per_arm(0.90, f), big.mark = ",")))

# Check against R's built-in function (unrounded n per arm)
cat("power.prop.test:", round(power.prop.test(p1 = p0, p2 = p1, power = 0.80)$n, 1), "\n")

# Simulation: how often does the z-test reject at the 80%-power sample size?
set.seed(256750)
n    <- n_per_arm(0.80)
reps <- 20000
x0 <- rbinom(reps, n, p0); x1 <- rbinom(reps, n, p1)
ph <- (x0 + x1) / (2 * n)
z  <- ((x1 - x0) / n) / sqrt(ph * (1 - ph) * 2 / n)
cat(sprintf("Simulated power at n = %s per arm: %.3f (%d replicates)\n", format(n, big.mark = ","), mean(abs(z) > z_a, na.rm = TRUE), reps))

Output from running the code

100% of observed effect: n per arm = 584 (80% power), 781 (90% power)
 75% of observed effect: n per arm = 1,123 (80% power), 1,502 (90% power)
 50% of observed effect: n per arm = 2,713 (80% power), 3,631 (90% power)
power.prop.test: 583.5 
Simulated power at n = 584 per arm: 0.806 (20000 replicates)

The simulation draws many pairs of event counts at the planned sample size and counts how often the two-proportion z-test rejects the null. It should land close to the target power; at very small required sample sizes it can fall below it, because the normal approximation is rough there.

14. Analyses Reported by the Sponsor

MethodEstimate95% CIP-value
not statedDifference in Percent 3.7-1.1 to 9.0not reported
not statedDifference in Percent 2.7-2.5 to 8.1not reported

The registry’s sponsor-reported primary analyses compare cyclosporine with each belatacept regimen and label the results as non-inferiority or equivalence analyses. For LI, the reported difference in percent is 3.7, with a 97.3% confidence interval from -1.1 to 9.0. For MI, the reported difference in percent is 2.7, with a 97.3% confidence interval from -2.5 to 8.1. The registry does not report p-values for these primary analyses.

The recalculated comparisons use the posted counts and denominators to estimate unadjusted risk differences. Their confidence intervals are at the 95% level, and the calculations yield p = 0.083 for LI and p = 0.234 for MI. These results are related to the sponsor comparisons but are not the same analysis: they use a different calculation and interval level. They should therefore be presented separately rather than substituted for the sponsor’s reported results.

The registry record does not report the non-inferiority margin or the sponsor’s detailed primary analysis method. Without the margin and decision rule, the sponsor’s analysis classification cannot be fully assessed from the registry record. The record does not flag a discrepancy between the sponsor’s results and the recalculation. The sponsor’s own analysis remains the trial’s reported analysis; the recalculation is a descriptive, unadjusted check based on posted summary statistics.

15. Multiplicity, Missing Data and Analysis Populations

Multiplicity arises when a study makes many statistical comparisons. Even if each comparison uses a conventional threshold, testing many outcomes can increase the chance that at least one result appears statistically notable by chance. This is a general statistical concern, not evidence that any particular posted result is false. BENEFIT has 43 listed outcome measures and 178 analyses, so the context for interpreting individual secondary findings matters.

A prespecified hierarchy, adjustment procedure, or clear distinction between confirmatory and exploratory outcomes can help explain how multiple results were intended to be interpreted. Such a strategy is not reported in the registry record. The registry also does not report whether interim analyses were conducted or what stopping rules, if any, were used. These details should not be inferred from the completed status or the posted outcome results.

The primary analysis population is described as all randomized, transplanted, and treated participants in the intent-to-treat population. That description is useful, but the registry record does not give a detailed account of how missing primary outcomes were handled, whether participants with incomplete follow-up were imputed or otherwise classified, or what sensitivity analyses were performed. The outcome-specific denominators differ across measures, and reasons for those differences are not reported in the registry record.

The registry record does not report a detailed statistical analysis plan, the sponsor’s primary endpoint method, or the non-inferiority margin. It also does not report whether the planned comparisons were adjusted for baseline variables. For these reasons, the posted estimates can be described and the simple recalculations can be checked against posted summaries, but full assessment of prespecification, missing-data assumptions, and multiplicity control is not possible from the registry record alone.

These gaps do not erase the observed estimates. They define the limits of what can be concluded from the registry record: the reported results can be interpreted as results of the analyses recorded, while the unreported decisions and safeguards remain unknown.

16. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

ArmParticipants with serious adverse eventsParticipants at riskPercentage
Cyclosporine16721577.7%
Belatacept - LI16022670.8%
Belatacept - MI16421974.9%
Participants with at least one serious adverse event
Serious adverse events by armCyclosporine77.7%Belatacept - LI70.8%Belatacept - MI74.9%% of participants with at least one serious adverse event

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 5% reporting threshold.

ArmParticipants affected of at risk
Cyclosporine213 of 215
Belatacept - LI222 of 226
Belatacept - MI216 of 219

Most frequent serious adverse event terms

Event termOrgan systemCyclosporineBelatacept - LIBelatacept - MI
Urinary tract infectionInfections and infestations32 of 21526 of 22621 of 219
PyrexiaGeneral disorders16 of 21517 of 22613 of 219
PneumoniaInfections and infestations17 of 21514 of 2269 of 219
Cytomegalovirus infectionInfections and infestations8 of 21513 of 22616 of 219
Blood creatinine increasedInvestigations16 of 21510 of 2265 of 219
DiarrhoeaGastrointestinal disorders9 of 21512 of 2269 of 219
Basal cell carcinomaNeoplasms benign, malignant and unspecified (incl cysts and polyps)12 of 2159 of 2268 of 219
Squamous cell carcinoma of skinNeoplasms benign, malignant and unspecified (incl cysts and polyps)9 of 2158 of 2269 of 219
PyelonephritisInfections and infestations9 of 2159 of 2268 of 219
Acute kidney injuryRenal and urinary disorders13 of 2154 of 2266 of 219

Most frequent non-serious adverse event terms

Event termOrgan systemCyclosporineBelatacept - LIBelatacept - MI
DiarrhoeaGastrointestinal disorders92 of 215115 of 226118 of 219
AnaemiaBlood and lymphatic system disorders86 of 21592 of 22685 of 219
HypertensionVascular disorders82 of 21587 of 22670 of 219
Urinary tract infectionInfections and infestations77 of 21591 of 22671 of 219
Oedema peripheralGeneral disorders87 of 21570 of 22664 of 219
ConstipationGastrointestinal disorders68 of 21583 of 22665 of 219
CoughRespiratory, thoracic and mediastinal disorders57 of 21581 of 22669 of 219
NauseaGastrointestinal disorders70 of 21562 of 22659 of 219
DyslipidaemiaMetabolism and nutrition disorders70 of 21559 of 22662 of 219
HeadacheNervous system disorders46 of 21575 of 22665 of 219

Serious events with the highest arm-level rate: urinary tract infection (14.9%), pneumonia (7.9%), pyrexia (7.5%), blood creatinine increased (7.4%), cytomegalovirus infection (7.3%).

Do not overextend the safety comparison. Serious-adverse-event counts are safety observations, not efficacy outcomes, and should not be combined with the primary result into a single benefit-risk number.

The posted serious adverse event counts are 167 affected among 215 at risk for cyclosporine, 160 among 226 at risk for belatacept LI, and 164 among 219 at risk for belatacept MI. The other-adverse-event counts are 213 among 215 at risk, 222 among 226 at risk, and 216 among 219 at risk, respectively. These are counts with the recorded at-risk denominators; they are not calculated percentages, and no additional percentages are inferred.

The most frequently listed serious adverse event terms include urinary tract infection at 14.9%, pneumonia at 7.9%, pyrexia at 7.5%, blood creatinine increased at 7.4%, cytomegalovirus infection at 7.3%, and acute kidney injury at 6.0%. Those entries describe listed event terms, not a complete account of every safety outcome. The registry record does not report deaths for these groups, and the detailed timing and event-specific denominators are not reported in the registry record.

Safety counts should be read with the trial’s follow-up and event definitions in mind. They do not by themselves establish a comparative safety profile, especially without detailed information on event ascertainment, duration at risk, and analysis methods. They should also be kept distinct from the primary endpoint, which concerns survival with a functioning graft by Month 12.

17. What the Result Does, and Does Not, Mean

The posted results describe outcomes among participants assigned to three immunosuppression groups in a randomized, parallel-group trial. For the primary endpoint, the observed Month 12 percentages are 92.8% for cyclosporine, 96.5% for belatacept LI, and 95.4% for belatacept MI. The unadjusted recalculated confidence intervals for the risk differences include zero, leaving uncertainty about the direction and size of the group contrasts under those calculations.

The sponsor-reported analyses are classified as non-inferiority or equivalence analyses, but the non-inferiority margin and decision rule are not reported in the registry record. The classification alone is not enough to determine whether a prespecified non-inferiority criterion was met. The sponsor’s reported confidence intervals and the recalculated intervals also reflect different methods and interval levels, so one should not treat them as interchangeable.

These results do not establish that belatacept is superior, equivalent, or inferior to cyclosporine across all outcomes. Nor do they establish that the groups have identical outcomes. An estimate is a summary of observed data with uncertainty, and the primary endpoint combines survival with a defined set of graft-loss criteria at a particular follow-up time.

The result also does not answer every question about kidney function, longer-term graft status, adverse events, or patient experience. Secondary measures address some of these issues, but they differ in definitions and follow-up and are subject to the limitations of multiple comparisons and incomplete reporting. No treatment recommendation follows from these registry results alone. Their interpretation is bounded by the outcomes, populations, methods, and follow-up documented in the registry record.

18. Why This Trial Matters Statistically

BENEFIT illustrates why statistical interpretation should distinguish a group percentage from a between-group comparison. The arm-specific values describe the observed outcome in each group, while the risk difference directly represents the estimated contrast. Confidence intervals then show how much uncertainty surrounds those estimates. Reading all three together avoids treating a point estimate as an exact or definitive treatment effect.

The trial also highlights the importance of matching the statistical question to the analysis. A non-inferiority or equivalence analysis is not interpreted in the same way as a test for any difference. Its conclusion depends on a prespecified margin and decision rule. Although the registry labels the sponsor analyses as non-inferiority or equivalence, the margin is not reported, so the key criterion cannot be checked from the registry record.

Another important lesson is that the primary endpoint is a composite of survival and functioning graft status. This creates a clinically interpretable summary, but it can conceal which component drives the result. Separate measures of kidney function and safety can add context, yet multiple secondary analyses require cautious interpretation and clear attention to their timeframes and uncertainty.

Finally, the distinction between a trial’s own analysis and an unadjusted recalculation matters. Recalculation helps readers understand the posted summaries, but it cannot recreate missing design or analysis details. Transparent reporting of analysis populations, missing-data handling, multiplicity plans, and non-inferiority criteria is essential for judging how strongly trial estimates answer their intended questions.

19. Limitations

Several trial-specific details needed for a complete appraisal are not reported in the registry record. These include the original sample-size justification, the non-inferiority margin, detailed primary analysis methods, the detailed randomization procedure, and who was masked. The registry’s intervention descriptions provide the treatment names and LI or MI labels but not further regimen details.

The primary endpoint is a composite outcome. Although its definition is detailed, a breakdown of the primary result by physical graft loss, functional graft loss, and participant survival is not reported in the registry record. The endpoint therefore cannot show which component accounts for the group percentages. It also does not describe kidney function among participants who met the functioning-graft definition.

Follow-up windows and denominators vary among the primary and secondary outcomes. Reasons for outcome-specific denominator differences, the handling of incomplete follow-up, and sensitivity analyses for missing data are not reported in the registry record. The safety information includes counts and selected serious-event terms, but the full event definitions, timing, and detailed exposure or follow-up context are not reported in the registry record.

The registry lists many outcomes and analyses but does not report a multiplicity plan or a complete statistical analysis plan. As a result, secondary findings should not be treated as though every comparison had the same confirmatory status. The available registry information supports description of the posted estimates and cautious statistical interpretation, but does not resolve these reporting gaps.

20. Related Tutorials

21. Related Statistical Calculators

22. Sources

Continue through the Clinical Biostats statistical pathway

Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.

23. Record Summary

BENEFIT is a completed randomized, single-masked, parallel-group Phase 3 trial sponsored by Bristol-Myers Squibb. It enrolled 738 and compared cyclosporine with belatacept LI and belatacept MI after kidney transplantation.

The primary outcome was survival with a functioning graft by Month 12. The posted percentages were 92.8% for cyclosporine, 96.5% for belatacept LI, and 95.4% for belatacept MI. Recalculated unadjusted risk-difference intervals include zero for both comparisons. The registry classifies the sponsor’s primary analyses as non-inferiority or equivalence, but the margin and detailed analysis method are not reported in the registry record. Secondary outcomes cover kidney function, graft-related findings, antibodies, and safety; multiplicity and missing-data procedures are not reported in the registry record.

Clinical Biostats