← Clinical Trials
Hepatocellular Carcinoma Phase 3 Time-to-Event Analysis NCT02576509

An Investigational Immuno-therapy Study of Nivolumab Compared to Sorafenib as a First Treatment in Patients With Advanced Hepatocellular Carcinoma: Complete Statistical Analysis

This analysis examines the registry results for nivolumab versus sorafenib as first-line treatment for advanced hepatocellular carcinoma. It focuses on overall survival, the sponsor-reported comparison, secondary outcomes, and the precision and limitations of the posted estimates.

Trial start: 2015-12-07  ·  Enrollment: 743  ·  Sponsor: Bristol-Myers Squibb
Scope of this record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.

1. Trial at a Glance

This page covers the registry results for An Investigational Immuno-therapy Study of Nivolumab Compared to Sorafenib as a First Treatment in Patients With Advanced Hepatocellular Carcinoma (NCT02576509), a randomized phase 3 study. The primary outcome is Overall Survival (OS).

743
Enrollment
Phase 3
2
Arms
In the primary outcome
0.85
Hazard ratio
Nivolumab 240 mg vs Sorafenib 400 mg
0.71–1.02
95% CI
Two-sided
FeatureRegistry value
ClinicalTrials.gov identifierNCT02576509
PhasePhase 3
ConditionHepatocellular Carcinoma
AllocationRandomized
Design modelParallel
MaskingNone (open label)
Enrollment743
Arms in the primary outcome2
Lead sponsorBristol-Myers Squibb
Results postedYes

2. Clinical Question

Population

Participants with advanced hepatocellular carcinoma were eligible for this first-line treatment study. The primary outcome is defined for all randomized participants, with participants who remained alive censored at their last known alive dates. Further eligibility details are not reported in the registry record.

Intervention

The intervention was nivolumab, listed in the arm description as Nivolumab 240 mg. The registry describes a specified dose on specified days, but the actual schedule details are not reported in the registry record. The study was randomized and used a parallel-group design.

Comparator

The comparator was sorafenib, listed as Sorafenib 400 mg. Its arm description also refers to a specified dose on specified days without giving the schedule details. The registry lists no masking, so it does not describe a blinded comparison.

Primary question

The primary question was whether overall survival differed between the treatment groups. Overall survival was measured from randomization until death from any cause, with follow-up assessed up to June 2019 (approximately 41 months). The registry reports Kaplan-Meier median estimates and a hazard ratio comparison.

This is a comparative question about outcomes under randomized assignment, not a direct statement about what will happen to an individual participant. Randomization is intended to support a fair comparison between assigned groups, but the registry record does not report details of how the randomization sequence was generated or concealed. Nor does it report the original statistical plan, the protocol's sample-size justification, or the intended decision threshold for the primary analysis. Those details matter when judging how the sponsor planned to interpret the result. The posted primary comparison should therefore be read in light of the estimates and uncertainty that are recorded, without inferring unreported design choices.

3. Trial Design

The registry identifies NCT02576509 as a randomized, multicenter Phase III study of nivolumab versus sorafenib for first-line treatment of advanced hepatocellular carcinoma. Its design is parallel-group, with no masking listed. The record names Bristol-Myers Squibb as sponsor and lists the study as completed. The study start date is 2015-12-07, and the primary completion date is 2019-05-30.

Enrollment is reported as 743. The primary endpoint population is all randomized participants. For the posted overall survival estimates, the Nivolumab 240 mg group has 371 participants and the Sorafenib 400 mg group has 372. These are the groups used in the reported primary comparison. The arm descriptions give the treatments and doses, but refer to specified dosing days without providing the full schedules in the registry record.

The primary outcome is overall survival, measured from randomization to death from any cause. The record states that participants still alive are censored at their last known alive dates and that the median estimates use Kaplan-Meier estimates. The primary comparison is reported as a hazard ratio using a Log Rank method. Secondary outcomes listed include objective response rate per BICR RECIST 1.1, progression-free survival, and outcomes by PD-L1 expression for overall survival, progression-free survival, and response. The registry lists five outcome measures and twelve analyses, but it does not provide a complete account of the analysis plan or the results for every listed analysis.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Pre-Treatment Period

StageNivolumab 240 mgSorafenib 400 mg
STARTED371372
COMPLETED367363
NOT COMPLETED49

Reasons for not completing this period:

ReasonNivolumab 240 mgSorafenib 400 mg
Participant request to stop therapy02
Participant withdrew consent15
Participant no longer meets criteria32

Treatment Period

StageNivolumab 240 mgSorafenib 400 mg
STARTED367363
COMPLETED00
NOT COMPLETED367363

Reasons for not completing this period:

ReasonNivolumab 240 mgSorafenib 400 mg
Disease progression263244
Study drug toxicity3741
Death11
Adverse event unrelated to study drug3941
Participant request to stop treatment818
Participant withdrew consent37
Lost to Follow-up01
Maximum clinical benefit10
Poor/non-compliance11
Participant no longer meets criteria10
Other reason128
NOT REPORTED10

Analysis population for the primary outcome, as defined in the registry: all randomized participants

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

CharacteristicUnitNivolumab 240 mgSorafenib 400 mgTotal
Participants analysed371372743
Age, Categorical: <=18 yearsParticipants000
Age, Categorical: Between 18 and 65 yearsParticipants185176361
Age, Categorical: >=65 yearsParticipants186196382
Age, Continuousyears63.9 (SD 10.61)64.5 (SD 10.91)64.2 (SD 10.76)
Sex: Female, Male: FemaleParticipants5755112
Sex: Female, Male: MaleParticipants314317631
Ethnicity (NIH/OMB): Hispanic or LatinoParticipants51015
Ethnicity (NIH/OMB): Not Hispanic or LatinoParticipants180170350
Ethnicity (NIH/OMB): Unknown or Not ReportedParticipants186192378
Race (NIH/OMB): American Indian or Alaska NativeParticipants011
Race (NIH/OMB): AsianParticipants165167332
Race (NIH/OMB): Native Hawaiian or Other Pacific IslanderParticipants000
Race (NIH/OMB): Black or African AmericanParticipants325
Race (NIH/OMB): WhiteParticipants199196395
Race (NIH/OMB): More than one raceParticipants000
Race (NIH/OMB): Unknown or Not ReportedParticipants4610

6. Primary Endpoint

The registry lists the primary outcome as Overall Survival (OS), measured over time from the date of randomization to the date of death due to any cause, assessed up to June 2019 (approximately 41 months).

ElementRegistry entry
Result typeMedian
Measure of spread95% Confidence Interval
UnitMonths
Endpoint classificationTime-to-Event Analysis

Overall survival measures the time from randomization until death from any cause. It is a time-to-event endpoint: the event is death, and the measured time is the interval from the specified starting point to that event. The registry defines the endpoint for all randomized participants and states that participants who are alive are censored at their last known alive dates. Censoring means that a participant contributes follow-up information up to the last time known to be alive, without being counted as having died at that point.

Overall survival is used because it captures time to death from any cause rather than relying on a particular tumor measurement or a judgment about why a participant died. Its definition does not require classifying the cause of death. The registry reports the median overall survival estimated with the Kaplan-Meier method, along with a 95% confidence interval for each group. A median is the estimated time by which half of the survival distribution has experienced the event; it is not the mean survival time and does not describe each participant's experience.

The comparison between groups is expressed as a hazard ratio. This summarizes the relative event rate over follow-up under the analysis, rather than subtracting the two group medians. A hazard ratio does not itself show the absolute survival probability at a particular time. The registry record does not report further details about the timing or completeness of follow-up beyond the stated assessment period, nor does it give the sponsor's full analytic plan for this endpoint.

7. Results Posted in the Registry

Hazard ratio: Nivolumab 240 mg vs Sorafenib 400 mg

0.85

95% CI: 0.71 to 1.02

As reported in the registry

Treatment effect versus the control arm
Forest plot of hazard ratio (as reported) vs control (95% CI)Nivolumab 240 mg vs Sorafenib…0.690.750.820.890.971.05hazard ratio (as reported) vs control (95% CI)

8. Secondary Efficacy Endpoints

The registry also posts results for secondary outcomes. For each outcome below, the endpoint type, the test applied to the posted summary statistics, the result and its interpretation are given in turn. Secondary endpoints are usually not adjusted for multiple testing, so they support rather than confirm the primary finding.

Secondary outcomeTypeEffect measureEstimate (95% CI)Planning size, 80% power
Objective Response Rate (ORR) Per BICR RECIST 1.1Binary EndpointRisk difference-8.4 pts (-12.9 to -3.9)222 per arm
Progression-Free Survival (PFS)Time-to-Event AnalysisHazard ratio0.93 (0.79 to 1.10)5,962 events

Objective Response Rate (ORR) Per BICR RECIST 1.1

Treatment effect versus the control arm
Forest plot of risk difference (percentage points) vs control (95% CI)Sorafenib 400 mg-14-11-7.93-4.94-1.961.03risk difference (percentage points) vs control (95% CI)

Progression-Free Survival (PFS)

Treatment effect versus the control arm
Forest plot of hazard ratio (as reported) vs control (95% CI)Nivolumab 240 mg vs Sorafenib…0.770.830.900.971.051.13hazard ratio (as reported) vs control (95% CI)

The secondary outcomes add information about tumor response, progression, and outcomes by PD-L1 expression. The posted response estimates and comparison indicate a different response pattern between the groups, while the progression-free survival estimates and hazard ratio are closer in their direction and less conclusive in their uncertainty. These endpoints do not establish the primary overall survival result; they describe distinct outcomes with their own definitions and analyses.

The overall pattern should be read alongside the primary result rather than as a collection of independent confirmations. Response is a measure of objective tumor change under the named criteria, whereas progression-free survival combines progression and death over time. Neither is identical to overall survival. A secondary outcome may support biological or clinical context, but agreement or disagreement with the primary endpoint does not by itself determine the validity of either result.

The registry lists efficacy analyses by PD-L1 expression for overall survival and progression-free survival, as well as response by PD-L1 expression. Results for those analyses are not reported in the registry record. The result record also lists secondary outcomes beyond the estimates, so the absence of posted estimates limits assessment of the complete secondary-outcome pattern.

Unadjusted secondary findings generally carry less confirmatory weight when many outcomes or subgroup comparisons are examined. The more comparisons made, the more opportunity there is for apparently noteworthy findings to arise by chance. A multiplicity adjustment or a prespecified hierarchy can address this concern, but the registry record does not report whether either was used. The unadjusted response recalculation should therefore be interpreted as exploratory statistical context, not as an independently definitive claim. The same caution applies to secondary comparisons whose analysis plan and multiplicity handling are not stated.

Secondary outcomes registered for this trial, for reference (only those above were recalculated):

9. Statistical Interpretation

Clinical Biostats interpretation

The posted median overall survival estimates are 16.39 months for Nivolumab 240 mg, with a 95% confidence interval from 13.93 to 18.37 months, and 14.69 months for Sorafenib 400 mg, with a 95% confidence interval from 11.89 to 17.22 months. These are Kaplan-Meier estimates for the randomized groups. The estimates describe the center of each group's estimated survival distribution; they do not establish how long any particular participant lived.

The sponsor-reported hazard ratio for Nivolumab 240 mg versus Sorafenib 400 mg is 0.85, with a 95% confidence interval from 0.71 to 1.02 and a Log Rank p-value of 0.075. A hazard ratio below the no-difference value points toward a lower estimated hazard in the nivolumab group over the comparison period, but the confidence interval also extends to values on the other side of no difference. The estimate is therefore not precise enough to rule out a range of comparative effects. The p-value describes how compatible the observed test statistic is with the null hypothesis under the test's assumptions; it does not measure the probability that the null hypothesis is true or quantify clinical importance. The registry record does not report the planned significance threshold for this primary test, so a formal conclusion based on a prespecified threshold cannot be reconstructed from the posted record alone.

The primary outcome should be considered alongside its uncertainty, not inferred from the two median values alone. A hazard ratio compares event rates over follow-up, while the medians summarize different points on the estimated survival distributions. Neither statistic supplies the full survival curve or the probability of being alive at a particular time. The posted record does not give those time-specific survival probabilities in the registry record analysed for this explanation.

The secondary endpoints contribute additional perspectives, including tumor response and progression-free survival, but they do not replace the primary overall survival comparison. Their estimates can help describe the pattern of observed outcomes, while multiplicity and incomplete reporting affect how confidently they can be interpreted as confirmatory evidence. In particular, the listed PD-L1 analyses have no results reported in the registry record. Taken together, the record supports describing the observed estimates and their uncertainty, rather than making a categorical claim about treatment effectiveness.

10. Statistical Methods Explained

Several statistical ideas help interpret the posted results. The record identifies time-to-event outcomes, group medians, confidence intervals, hazard ratios, and a Log Rank method for the primary comparison. These methods answer related but different questions, so their estimates should not be treated as interchangeable.

What does the Kaplan-Meier median describe?

As a general statistical explanation, the Kaplan-Meier method estimates the probability of remaining free of the event over follow-up while accounting for censoring. Participants who have not experienced the event contribute information until their last known follow-up. The estimated median is the point in time at which the estimated event-free proportion reaches its midpoint. It is a summary of the estimated distribution, not an arithmetic average of observed times and not a guarantee about an individual participant.

For overall survival, the event is death from any cause. For progression-free survival, the registry defines the event as the first objectively documented tumor progression or death. These definitions make clear that overall survival and progression-free survival capture different outcomes. The posted median for each endpoint should be understood in relation to its own event definition and follow-up information.

What does a hazard ratio express?

As a general explanation, a hazard ratio compares the instantaneous event rates between groups over follow-up. A value below the no-difference value favors the group in the numerator in the direction of a lower event hazard; a value above it points in the opposite direction. This interpretation concerns relative event rates and does not directly provide an absolute risk difference, a median difference, or the chance that a participant will experience an event.

The primary hazard ratio is reported as 0.85, with a 95% confidence interval from 0.71 to 1.02. The registry states that the comparison uses a Log Rank method. The reported p-value is 0.075. A p-value is a measure of how unusual the observed result, or a more extreme result, would be under a specified null model and test assumptions. It is not a measure of effect size, nor is it the probability that the result occurred by chance. The registry record does not provide the full statistical plan, so details such as any covariate adjustment, handling of departures from model assumptions, or interim testing are not reported in the registry record.

Why do confidence intervals matter?

As a general explanation, a confidence interval communicates sampling uncertainty around an estimate. A narrower interval indicates greater precision, while a wider interval leaves a broader set of plausible values. The confidence intervals in the registry are reported at the 95% level. They should be read together with the point estimate, since a point estimate alone hides uncertainty. An interval that spans the no-difference value is compatible with effects in more than one direction under the interval's construction; that does not prove the absence of an effect.

How are response and progression outcomes different?

Objective response rate is a binary outcome expressed as the percentage of participants classified as having an objective response under the named assessment criteria. The registry specifies BICR RECIST 1.1. The listed response estimates are 15.4% for nivolumab and 7.0% for sorafenib, each with a 95% confidence interval. The registry also reports a difference of ORRs of 8.3 with a 95% confidence interval from 3.9 to 12.7, and an odds ratio of 2.41 with a 95% confidence interval from 1.48 to 3.92. These summaries describe response, not survival duration.

Progression-free survival is a time-to-event outcome, with progression or death counted as the event. Its posted medians are 3.68 months for nivolumab and 3.75 months for sorafenib. The reported hazard ratio is 0.93, with a 95% confidence interval from 0.79 to 1.10. The registry does not report a p-value for this comparison. The response and progression-free survival findings should be understood as secondary results and not as substitutes for the primary endpoint.

What does over-dispersion mean in general?

Over-dispersion is a general statistical issue that occurs when observed variability is greater than a model assumes. When it is present, standard errors can be too small if the model does not account for the extra variability, making intervals appear more precise than warranted. The registry record does not identify over-dispersion as an issue in this trial, and no conclusion about it can be drawn from the posted results.

11. Confidence Intervals and Precision

Precision is conveyed chiefly by the confidence intervals around the reported estimates. For overall survival, the median estimate for Nivolumab 240 mg is 16.39 months, with a 95% confidence interval from 13.93 to 18.37 months. For Sorafenib 400 mg, the median estimate is 14.69 months, with a 95% confidence interval from 11.89 to 17.22 months. These ranges describe uncertainty in the estimated medians, not the spread of individual survival times.

The primary hazard ratio is 0.85, and its 95% confidence interval runs from 0.71 to 1.02. Because that interval includes values on both sides of the no-difference value, the point estimate alone gives a more definite impression than the uncertainty supports. The interval allows a range of comparative effects, including values that do not favor nivolumab. The p-value of 0.075 is another summary of uncertainty under the reported test, but it does not replace the confidence interval or establish the probability that a treatment effect exists.

Secondary estimates also have uncertainty. The objective response estimates have confidence intervals, as do the reported difference of ORRs and odds ratio. The PFS medians and hazard ratio are likewise reported with confidence intervals. Precision varies by estimate, and the interval should be considered with the outcome definition and analysis population. No results for the listed PD-L1 subgroup analyses are reported in the registry record, so their precision cannot be assessed.

In general, confidence intervals quantify uncertainty under the method used; they do not account automatically for every possible bias, missing-data issue, or unreported analysis choice. The record does not provide enough information to evaluate all such factors. A narrow interval would not by itself resolve limitations in study conduct, while a broad interval signals that the estimate remains uncertain even if the study was randomized.

12. Planning a Similar Trial: Sample Size

This is a planning illustration, not a re-evaluation of the original trial. It asks: if a new study wanted to detect a difference like the one observed, or a smaller one, how large would it need to be? It is deliberately not “observed power” of the finished trial, which is not a meaningful quantity.

Effect to detect (log scale)Hazard ratioEvents, 80% powerEvents, 90% power
100% of the observed effect0.851,1891,592
75% of the observed effect0.892,1142,829
50% of the observed effect0.924,7556,366
Sample size needed versus the size of the effect to detect
Sample size needed versus size of effect to detect1,0002,0005,00010,00020,00040%60%80%100%80% power90% powersize of effect to detect, as % of the effect observed (log vertical scale: events required (total))
Treat these figures cautiously. The observed difference is imprecise: its confidence interval includes no difference at all. A sample size built on a noisy estimate can be far too small or too large, so the smaller-effect rows are the more cautious guide.
Method and assumptions. Two-sided α = 0.05, 1:1 allocation, Schoenfeld approximation for the log-rank test or Cox model. The answer is the total number of events, not participants; the number of participants depends on how quickly events accrue. Calculated for the comparison: Nivolumab 240 mg vs Sorafenib 400 mg.

The planning figures are illustrations based on the observed effects, not the original trial design calculations. The registry record does not report the trial's own original sample-size assumptions or justification. For time-to-event outcomes, including overall survival and progression-free survival, the planning values are total event counts. For the binary response outcome, they are participants per arm.

The stated illustration assumes a two-sided significance level of 0.05, equal allocation between the two arms, and a normal approximation. It considers detecting the stated fraction of the observed effect. The rows for 100% of the observed effect represent planning around the full observed effect; the rows for 75% and 50% represent smaller target effects. For overall survival, the total events listed for 80% power are 1,189, 2,114, and 4,755 across those effect assumptions, respectively. For 90% power, the corresponding event totals are 1,592, 2,829, and 6,366.

For objective response, the figures are participants per arm. Planning for 100% of the observed effect gives 222 participants per arm for 80% power and 296 for 90% power. Planning for 75% of the observed effect gives 426 participants per arm for 80% power and 570 for 90% power. Planning for 50% of the observed effect gives 1,030 participants per arm for 80% power and 1,378 for 90% power. The same general relationship applies to event-based planning: smaller effects require more information, which means more participants or more events.

In plain terms, the 80% and 90% power targets describe the chance of detecting the assumed effect under the stated planning model if that effect were present. Higher target power generally requires more information. These figures are planning illustrations, not observed power.

13. How the Sample Size Is Derived

Power is the probability that a study of a given size rejects the null hypothesis when a specific true effect exists. It depends on four things: the effect to detect, the variability of the outcome, the significance level (here a two-sided α of 0.05, so z1−α/2 = 1.960) and the desired power (z1−β = 0.842 for 80% and 1.282 for 90%).

Formula

d = 4 (z1−α/2 + z1−β)2 / [ln(HR)]2

d is the total number of events needed (Schoenfeld's formula) with 1:1 allocation and proportional hazards.

Worked calculation for this trial

  1. Hazard ratio HR = 0.850, so ln(HR) = -0.1625.
  2. d = 4 × (1.96 + 0.842)2 / [ln(0.850)]2 = 1,188.7, rounded up to 1,189 events in total for 80% power.

The smaller-effect rows in the table above repeat the same calculation with the effect multiplied by 0.75 and 0.5 (for ratios, applied to the logarithm of the ratio).

R code

alpha <- 0.05
z_a   <- qnorm(1 - alpha / 2)          # two-sided
hr <- 0.85                              # observed hazard ratio
events_needed <- function(power, frac = 1) ceiling(round(4 * (z_a + qnorm(power))^2 / log(hr^frac)^2, 6))   # Schoenfeld, 1:1 allocation
for (f in c(1, 0.75, 0.5))
  cat(sprintf("%3.0f%% of observed effect: events = %s (80%% power), %s (90%% power)\n", 100 * f,
              format(events_needed(0.80, f), big.mark = ","), format(events_needed(0.90, f), big.mark = ",")))

# Simulation: given d total events under proportional hazards, events in the treatment arm are Binomial(d, hr / (1 + hr)).
# The score (log-rank type) statistic is (D1 - d / 2) / sqrt(d / 4).
set.seed(2576509)
d    <- events_needed(0.80)
reps <- 20000
D1 <- rbinom(reps, d, hr / (1 + hr))
z  <- (D1 - d / 2) / sqrt(d / 4)
cat(sprintf("Simulated power with %s events: %.3f (%d replicates)\n", format(d, big.mark = ","), mean(abs(z) > z_a), reps))

Output from running the code

100% of observed effect: events = 1,189 (80% power), 1,592 (90% power)
 75% of observed effect: events = 2,114 (80% power), 2,829 (90% power)
 50% of observed effect: events = 4,755 (80% power), 6,366 (90% power)
Simulated power with 1,189 events: 0.794 (20000 replicates)

The simulation uses the fact that, with d events in total and proportional hazards, the number of events in the treatment arm is binomial. It is an approximation that conditions on the total number of events, and it should land close to the target power.

14. Group-Sequential Design Analysis

Many time-to-event trials, especially in oncology, stop or report early when interim data are overwhelming, so a single fixed-sample number understates the real design problem. The calculation below is an illustrative group-sequential design built from this trial's posted control median and hazard ratio. The registry record does not state the planned number of looks or the spending function, so the design is a planning illustration, not a reconstruction of the protocol. Assumed: one-sided α = 0.025, 90% power, three equally spaced looks on information, Lan-DeMets O'Brien-Fleming spending, 24 months of accrual, 60 months in total and a 1% monthly dropout hazard.

Under these assumptions the design needs about 2,158 participants in total, with the boundaries below.

AnalysisCalendar time (months)EventsEfficacy boundary (z)Nominal one-sided pCumulative alpha spent
Look 119.45363.7100.00010.0001
Look 230.91,0722.5110.00600.0060
Look 360.01,6091.9930.02310.0250
01234z = 3.7119 mo536 eventsz = 2.5131 mo1072 eventsz = 1.9960 mo1609 eventsUpper efficacy boundary (z)

Fixed design versus group-sequential alternatives

DesignPowerEvents at final analysisParticipantsStudy length (months)
Fixed design, one analysis80%1,1871,59360.0
Two looks, O'Brien-Fleming80%1,1921,59860.0
Three looks, O'Brien-Fleming80%1,2021,61360.0
Three looks, Pocock80%1,3901,86460.0
Fixed design, one analysis90%1,5902,13260.0
Two looks, O'Brien-Fleming90%1,5952,14060.0
Three looks, O'Brien-Fleming90%1,6092,15860.0
Three looks, Pocock90%1,8352,46160.0

Group-sequential designs cost a small increase in maximum sample size and events compared with the fixed design, in exchange for the chance to stop early for overwhelming efficacy. O'Brien-Fleming spending keeps early boundaries very conservative and the final boundary close to the fixed-design value, whereas Pocock spending spends more alpha early.

Sensitivity to a smaller true effect

Planning for exactly the observed effect is optimistic, because observed effects in published trials tend to be somewhat larger than the true effect. The table repeats the main design (three looks, O'Brien-Fleming spending, 90% power) for smaller true hazard ratios.

True effect assumedHazard ratioEvents at final analysisParticipants
100% of the observed effect0.8501,6092,158
75% of the observed effect0.8852,8613,807
50% of the observed effect0.9226,4398,505

For context, this trial enrolled 743 participants.

Cross-check, upper boundaries: gsDesign 3.71, 2.511, 1.993 | rpact 3.71, 2.511, 1.993. Agreement between the two packages confirms the boundary calculation.

R code and output

suppressWarnings(suppressMessages({ library(gsDesign); library(rpact) }))
med_control <- 14.69          # control-arm median, months (converted from the posted unit)
hr          <- 0.85          # hazard ratio used for planning
lambdaC     <- log(2) / med_control
eta         <- 0.01               # dropout hazard per month (assumption)
acc_months  <- 24                 # accrual duration (assumption)
study_months<- 60                 # total study duration (assumption)

design <- function(k, sfu, beta, h = hr) gsSurv(k = k, test.type = 1, alpha = 0.025, beta = beta, sfu = sfu,
  lambdaC = lambdaC, hr = h, hr0 = 1, eta = eta, gamma = 1, R = acc_months, T = study_months, minfup = study_months - acc_months)

# Main design: 3 looks, Lan-DeMets O'Brien-Fleming spending, one-sided alpha 0.025, 90% power
x <- design(3, sfLDOF, 0.10)
cat(sprintf("N_TOTAL|%s\n", format(ceiling(sum(x$gamma * x$R)), big.mark = ",")))
for (i in 1:3) cat(sprintf("GS|%d|%.1f|%.0f|%.3f|%.5f|%.5f\n", i, x$T[i], x$n.I[i], x$upper$bound[i], pnorm(-x$upper$bound[i]), cumsum(x$upper$spend)[i]))
cat("\n"); print(gsBoundSummary(x))

# Comparison of designs
cmp <- list(list("Fixed design, one analysis", 1, sfLDOF), list("Two looks, O'Brien-Fleming", 2, sfLDOF),
            list("Three looks, O'Brien-Fleming", 3, sfLDOF), list("Three looks, Pocock", 3, sfLDPocock))
cat("\n")
for (b in c(0.20, 0.10)) for (d in cmp) {
  y <- design(d[[2]], d[[3]], b)
  cat(sprintf("DES|%s|%d|%.0f|%s|%.1f\n", d[[1]], round(100 * (1 - b)), tail(y$n.I, 1), format(ceiling(sum(y$gamma * y$R)), big.mark = ","), tail(y$T, 1)))
}

# Sensitivity: what if the true effect is smaller than the observed one? (3 looks, O'Brien-Fleming, 90% power)
cat("\n")
for (fr in c(1, 0.75, 0.5)) {
  y <- design(3, sfLDOF, 0.10, exp(log(hr) * fr))
  cat(sprintf("SENS|%.2f|%.3f|%.0f|%s\n", fr, exp(log(hr) * fr), tail(y$n.I, 1), format(ceiling(sum(y$gamma * y$R)), big.mark = ",")))
}

# Independent cross-check of the boundaries with rpact
r <- getDesignGroupSequential(kMax = 3, alpha = 0.025, beta = 0.10, sided = 1, typeOfDesign = "asOF", informationRates = x$timing)
cat(sprintf("\nCross-check, upper boundaries: gsDesign %s | rpact %s\n", paste(round(x$upper$bound, 3), collapse = ", "), paste(round(r$criticalValues, 3), collapse = ", ")))

Method: LachinFoulkes 
     Analysis               Value Efficacy
    IA 1: 33%                   Z   3.7103
      N: 1744         p (1-sided)   0.0001
  Events: 537        ~HR at bound   0.7258
    Month: 19    P(Cross) if HR=1   0.0001
              P(Cross) if HR=0.85   0.0338
    IA 2: 67%                   Z   2.5114
      N: 2158         p (1-sided)   0.0060
 Events: 1073        ~HR at bound   0.8578
    Month: 31    P(Cross) if HR=1   0.0060
              P(Cross) if HR=0.85   0.5603
        Final                   Z   1.9930
      N: 2158         p (1-sided)   0.0231
 Events: 1609        ~HR at bound   0.9054
    Month: 60    P(Cross) if HR=1   0.0250
              P(Cross) if HR=0.85   0.9000



Cross-check, upper boundaries: gsDesign 3.71, 2.511, 1.993 | rpact 3.71, 2.511, 1.993

15. Analyses Reported by the Sponsor

MethodEstimate95% CIP-value
Log RankHazard Ratio (HR) 0.850.71 to 1.020.075

The primary comparison is reported by the sponsor as a hazard ratio of 0.85, with a 95% confidence interval from 0.71 to 1.02 and a Log Rank p-value of 0.075. For this time-to-event endpoint, the statistical summary uses the sponsor-reported hazard ratio; the posted median estimates remain useful descriptions of each group but do not reproduce the hazard-ratio analysis.

For objective response, the sponsor reports a difference of ORRs of 8.3, with a 95% confidence interval from 3.9 to 12.7, and an odds ratio of 2.41, with a 95% confidence interval from 1.48 to 3.92. A simple unadjusted recalculation from the posted summary statistics gives a p-value of <0.001 for the response comparison. That recalculation is not a substitute for the sponsor's analysis: it may not reflect the sponsor's analysis population, covariate handling, or other choices that are not described in the registry record. No discrepancy is flagged between the posted sponsor results and the available comparison details.

Recalculated results are useful as a check on the arithmetic implied by posted summaries, but they cannot recover details of an analysis that are not reported. When a sponsor result is available, it remains the primary reported analysis to interpret. The registry record does not give a comparable sponsor p-value for progression-free survival.

16. Multiplicity, Missing Data and Analysis Populations

Multiplicity concerns arise when a study examines more than one endpoint, analysis, subgroup, or comparison. Each test can produce an apparently notable result by chance, and the chance of at least one such finding can increase as more tests are considered. This is why confirmatory trial plans often specify a primary endpoint, define how secondary tests will be interpreted, and describe any adjustment or testing hierarchy.

The registry identifies overall survival as the primary endpoint and lists several secondary outcomes, including response, progression-free survival, and analyses by PD-L1 expression. It reports twelve analyses. However, multiplicity procedures, any prespecified testing order, and the intended confirmatory status of individual secondary analyses are not reported in the registry record. Without that information, secondary p-values or confidence intervals should not be treated as though they necessarily control the overall chance of false-positive findings.

Missing-data and analysis-population details are also incomplete. For overall survival, the record states that living participants are censored at the last known alive dates and defines the population as all randomized participants. This does not describe every aspect of follow-up, such as the amount of missing status information, or how other potential data issues were handled. For the response and progression-free survival results, the record gives group counts and outcome definitions but does not provide a complete account of the analysis populations, missing observations, or sensitivity analyses.

The registry also does not report interim analyses, stopping rules, the original sample-size justification, or the full statistical analysis plan. Those omissions do not invalidate the posted results, but they limit evaluation of whether analyses and decisions followed prespecified procedures. The reported estimates can be interpreted descriptively, while stronger claims about confirmatory testing require information not reported in the registry record.

17. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

ArmParticipants with serious adverse eventsParticipants at riskPercentage
Nivolumab 240 mg21636758.9%
Sorafenib 400 mg21636359.5%
Participants with at least one serious adverse event
Serious adverse events by armNivolumab 240 mg58.9%Sorafenib 400 mg59.5%% of participants with at least one serious adverse event

Deaths

ArmDeaths (participants affected of at risk)
Nivolumab 240 mg321 of 371
Sorafenib 400 mg335 of 372

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 5% reporting threshold.

ArmParticipants affected of at risk
Nivolumab 240 mg339 of 367
Sorafenib 400 mg351 of 363

Most frequent serious adverse event terms

Event termOrgan systemNivolumab 240 mgSorafenib 400 mg
Malignant neoplasm progressionNeoplasms benign, malignant and unspecified (incl cysts and polyps)69 of 36770 of 363
General physical health deteriorationGeneral disorders8 of 36714 of 363
Abdominal painGastrointestinal disorders7 of 36711 of 363
Hepatic failureHepatobiliary disorders10 of 3677 of 363
AscitesGastrointestinal disorders9 of 3677 of 363
PyrexiaGeneral disorders8 of 3677 of 363
AnaemiaBlood and lymphatic system disorders8 of 3676 of 363
Gastrointestinal haemorrhageGastrointestinal disorders7 of 3676 of 363
Oesophageal varices haemorrhageGastrointestinal disorders4 of 3678 of 363
Hepatic encephalopathyNervous system disorders6 of 3676 of 363

Most frequent non-serious adverse event terms

Event termOrgan systemNivolumab 240 mgSorafenib 400 mg
DiarrhoeaGastrointestinal disorders100 of 367191 of 363
FatigueGeneral disorders103 of 367117 of 363
Decreased appetiteMetabolism and nutrition disorders77 of 367135 of 363
Palmar-plantar erythrodysaesthesia syndromeSkin and subcutaneous tissue disorders29 of 367181 of 363
Abdominal painGastrointestinal disorders69 of 36782 of 363
Aspartate aminotransferase increasedInvestigations84 of 36760 of 363
PruritusSkin and subcutaneous tissue disorders88 of 36751 of 363
RashSkin and subcutaneous tissue disorders75 of 36759 of 363
NauseaGastrointestinal disorders62 of 36770 of 363
PyrexiaGeneral disorders71 of 36758 of 363

Serious events with the highest arm-level rate: malignant neoplasm progression (19.3%), general physical health deterioration (3.9%), abdominal pain (3.0%), hepatic failure (2.7%), ascites (2.5%).

Do not overextend the safety comparison. Serious-adverse-event counts are safety observations, not efficacy outcomes, and should not be combined with the primary result into a single benefit-risk number.

The registry reports serious adverse event figures by treatment group. For Nivolumab 240 mg, 216 participants are listed as affected among 367 at risk; for Sorafenib 400 mg, 216 are listed as affected among 363 at risk. These are counts, not comparative risk estimates. The record also gives other adverse event figures: 339 affected among 367 at risk for nivolumab and 351 among 363 at risk for sorafenib. The registry record does not define further how these two categories relate to one another.

Deaths are listed as 321 for nivolumab and 335 for sorafenib. The adverse-event figures alone do not establish that an event was caused by treatment, and the death counts do not identify cause. The most frequently listed serious terms include malignant neoplasm progression at 19.3%, general physical health deterioration at 3.9%, abdominal pain at 3.0%, hepatic failure at 2.7%, ascites at 2.5%, and oesophageal varices haemorrhage at 2.2%.

These summaries are useful for describing what the record reports, but they are not a complete assessment of comparative safety. The registry record does not provide additional details about event timing, severity grading, exposure duration, or how events were attributed. Counts and percentages should therefore be read as registry safety summaries, not as proof that a treatment caused or prevented an event.

18. What the Result Does, and Does Not, Mean

The posted results describe a randomized comparison of nivolumab and sorafenib for advanced hepatocellular carcinoma. The primary overall survival estimate is a hazard ratio of 0.85, with a 95% confidence interval from 0.71 to 1.02 and a p-value of 0.075. The interval leaves meaningful uncertainty around the estimate, including values compatible with effects in either direction. The result is not a precise estimate of a single underlying treatment effect.

The group medians provide an additional descriptive summary but do not replace the time-to-event comparison. They do not show survival probabilities at particular times, nor do they explain how the estimated survival distributions developed throughout follow-up. The registry record does not report the full statistical analysis plan, so it is not possible to reconstruct every planned inference or confirmatory decision rule from the posted results alone.

Secondary outcomes address response and progression as well as the listed PD-L1 analyses. The response findings have their own uncertainty and the progression-free survival result is not identical to the primary endpoint. Secondary outcomes can help characterize the pattern of evidence, but they should not be used to overrule the primary endpoint without considering prespecification, multiplicity, and analysis details. The PD-L1 subgroup results are not reported in the registry record.

These statistics do not establish what will happen to an individual participant, do not prove a treatment effect in either direction, and do not by themselves settle clinical decisions. They describe estimates for the trial groups under the recorded outcome definitions and analysis. Important details such as eligibility criteria beyond the broad population, the complete dosing schedules, missing-data handling, and the original statistical plan are not reported in the registry record. The appropriate reading is therefore measured: the posted estimates offer evidence about comparative outcomes, but their uncertainty and reporting limitations remain relevant.

19. Why This Trial Matters Statistically

This study is statistically informative because it places a randomized comparison of two first-line treatment strategies in a time-to-event framework, with overall survival designated as the primary outcome. Randomization supports comparison between assigned groups, while the all-cause death endpoint avoids relying on a subjective assessment of cause. The Kaplan-Meier medians and reported hazard ratio summarize different aspects of the survival data and illustrate why multiple measures are often needed to describe a trial result.

The primary hazard-ratio interval is important because it shows that the point estimate should not be treated as a settled effect. The estimate points in one direction, but the confidence interval extends across the no-difference value. The p-value provides a complementary test summary but does not remove the uncertainty or define clinical importance. This is a useful example of why interpretation should combine effect estimates, uncertainty, outcome definitions, and the study's prespecified analysis plan.

The secondary response and progression outcomes show how distinct endpoints may offer different views of treatment outcomes. Their interpretation also illustrates the statistical challenge of multiple analyses: without a reported multiplicity plan, secondary findings warrant caution. The absence of posted PD-L1 results and details about the analysis plan further demonstrates how registry reporting completeness affects what can be concluded.

Finally, planning illustrations based on observed effects are not a substitute for the original design justification. They can show the relationship between effect size, power targets, and the information required under stated assumptions, but they cannot reveal the trial's own design rationale or amount to observed power. Keeping these distinctions clear helps readers separate the trial's reported evidence from statistical explanation and planning scenarios.

20. Limitations

Several limitations specific to this record constrain interpretation. The registry reports a primary completion date of 2019-05-30 and describes overall survival assessment up to June 2019 (approximately 41 months), but does not provide detailed follow-up distributions or time-specific survival probabilities in the results used. The median and hazard-ratio summaries cannot show every feature of the survival experience.

The record lists no masking. It also does not report how allocation was generated or concealed, or provide full eligibility criteria and dosing schedules. The primary outcome is defined for all randomized participants, and the record specifies censoring of participants known to be alive at their last known alive dates, but detailed missing-data and sensitivity-analysis procedures are not reported. For the secondary outcomes, the complete analysis populations are not described in the registry record.

The registry lists analyses by PD-L1 expression but does not report their results. It also does not report the original sample-size justification, interim analyses, stopping rules, the full statistical analysis plan, or multiplicity procedures. These omissions limit assessment of prespecification and confirmatory status. The response recalculation is unadjusted and should not be confused with the sponsor's full analysis. The planning illustrations use observed effects and stated assumptions rather than the trial's original design inputs. Finally, safety counts do not provide the detail needed to infer treatment causation or to compare event risk after accounting for exposure and other factors.

21. Related Tutorials

22. Related Statistical Calculators

23. Sources

Continue through the Clinical Biostats statistical pathway

Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.

24. Record Summary

NCT02576509 is a completed randomized, multicenter Phase III parallel-group study comparing nivolumab with sorafenib as first-line treatment for advanced hepatocellular carcinoma. The registry lists no masking and records enrollment of 743. The primary endpoint is overall survival, defined as time from randomization to death from any cause, with Kaplan-Meier median estimates and a sponsor-reported hazard ratio.

The reported primary hazard ratio is 0.85, with a 95% confidence interval from 0.71 to 1.02 and a Log Rank p-value of 0.075. The interval reflects uncertainty around the comparative estimate. Secondary results include objective response rate and progression-free survival; the registry also lists PD-L1 subgroup analyses, whose results are not reported in the registry record. Multiplicity procedures, the full analysis plan, and the original sample-size justification are not reported. Interpretation should account for that uncertainty and incomplete reporting.

Clinical Biostats