← Clinical Trials
Esophageal Squamous Cell Carcinoma Phase 2 Time-to-Event Analysis NCT03116152

Study of IBI308 With Advanced/Metastatic Esophageal Squamous Cell Carcinoma After Failure of First-line Treatment: Complete Statistical Analysis

A statistical reading of ORIENT-2, a randomized phase 2 comparison of sintilimab (IBI308) and paclitaxel/irinotecan after first-line treatment failure in advanced or metastatic esophageal squamous cell carcinoma. The focus is overall survival, the registry’s reported comparisons, and the limits of interpreting the posted estimates.

Trial start: 2017-05-10  ·  Enrollment: 190  ·  Sponsor: Innovent Biologics (Suzhou) Co. Ltd.
Scope of this record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.

1. Trial at a Glance

This page covers the registry results for Study of IBI308 With Advanced/Metastatic Esophageal Squamous Cell Carcinoma After Failure of First-line Treatment (NCT03116152), a randomized phase 2 study. The primary outcome is Overall Survival.

190
Enrollment
Phase 2
2
Arms
In the primary outcome
0.70
Hazard ratio
Sintilimab vs Chemotherapy
0.50–0.97
95% CI
Two-sided
FeatureRegistry value
ClinicalTrials.gov identifierNCT03116152
PhasePhase 2
ConditionEsophageal Squamous Cell Carcinoma
AllocationRandomized
Design modelParallel
MaskingNone (open label)
Enrollment190
Arms in the primary outcome2
Lead sponsorInnovent Biologics (Suzhou) Co. Ltd.
Results postedYes

2. Clinical Question

Population

Participants with advanced or metastatic esophageal squamous cell carcinoma after failure of first-line treatment. The efficacy analysis population consisted of all randomized participants.

Intervention

IBI308, identified in the study arms as sintilimab, administered as a 200mg intravenous drip every three weeks.

Comparator

Paclitaxel/irinotecan chemotherapy: paclitaxel 175mg/㎡ by intravenous drip every three weeks and irinotecan 180mg/㎡ by intravenous drip every two weeks.

Primary question

How did overall survival compare between the randomized groups through the final analysis data cutoff date of 2-August-2019? Overall survival was defined as time from randomization to death due to any cause, with the median and a 95% confidence interval reported for each group.

The trial addressed a treatment-comparison question in a defined clinical setting: advanced or metastatic esophageal squamous cell carcinoma following failure of first-line treatment. The study compared IBI308 with a chemotherapy regimen containing paclitaxel and irinotecan. Its primary endpoint was overall survival, a time-to-event outcome that follows participants from randomization until death from any cause. The registry record also lists progression-free survival, objective response rate, and duration of response as secondary outcomes.

The main comparative statistic is the hazard ratio reported by the sponsor using a Log Rank analysis. It expresses the relative event rate over follow-up under the analysis assumptions; it is not a ratio of the two median survival times. The group medians and their confidence intervals provide a complementary description of the observed survival distributions. Neither statistic alone describes every participant’s course or establishes why an outcome occurred.

The study was randomized and open-label. Randomization supports a comparison between assigned groups, while the absence of masking means participants and study staff knew the assigned treatment. The registry record does not report details such as the randomization procedure or safeguards used for particular outcome assessments. The results therefore need to be read as estimates from this specific trial and analysis population, rather than as a complete account of every clinical consideration.

3. Trial Design

ORIENT-2 was a randomized, open-label, multicenter, parallel-group phase 2 study. It enrolled 190 participants with advanced or metastatic esophageal squamous cell carcinoma after failure of first-line treatment. The registry record lists 95 participants in each efficacy group. It identifies the study as completed, with a start date of 2017-05-10 and primary completion on 2019-10-02.

The intervention was IBI308, called sintilimab in the reported arms. The listed regimen was 200mg by intravenous drip every three weeks. The comparator was paclitaxel/irinotecan: paclitaxel 175mg/㎡ by intravenous drip every three weeks and irinotecan 180mg/㎡ by intravenous drip every two weeks. The study was not masked. The registry record describes a parallel-group comparison, rather than a design in which participants switch between treatments.

The primary endpoint was overall survival. The registry defines it as time from randomization to death due to any cause and reports the median with a 95% confidence interval. The stated timeframe is through the final analysis data cutoff date of 2-August-2019, up to approximately 26 months. The efficacy analysis population consisted of all randomized participants. This description identifies the population used for efficacy analysis; it does not establish that every randomized participant had complete follow-up or outcome information.

Progression-free survival, objective response rate, and duration of response were listed as secondary outcomes. The registry record reports analyses for progression-free survival and objective response rate, but a result for duration of response is not reported in the registry record. Detailed eligibility criteria, the original sample-size justification, allocation procedures, treatment discontinuation rules, and the protocol’s full statistical analysis plan are not reported in the registry record. The planning illustrations based on observed effects should not be mistaken for the design assumptions used when the trial was planned.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Before assignment: 253 enrolled. 190 randomized. Non-randomized reasons: 55 no longer met study criteria, 4 withdrew consent, 4 other. 181 treated (94 sintilimab, 87 chemotherapy).

Overall Study

StageSintilimabChemotherapy
STARTED9595
Treated9487
COMPLETED40
NOT COMPLETED9195

Reasons for not completing this period:

ReasonSintilimabChemotherapy
Disease Progression4947
Death52
Adverse Event217
Protocol Violation22
Withdrawal by Subject01
Physician Decision32
other1134

Analysis population for the primary outcome, as defined in the registry: The efficacy analysis population consisted of all randomized participants.

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

Population: All randomized participants

CharacteristicUnitSintilimabChemotherapyTotal
Participants analysed9595190
Age, Categorical: <=18 yearsParticipants000
Age, Categorical: Between 18 and 65 yearsParticipants7475149
Age, Categorical: >=65 yearsParticipants212041
Age, Continuousyears58.8 (SD 7.23)59.4 (SD 7.06)59.1 (SD 7.13)
Sex: Female, Male: FemaleParticipants71118
Sex: Female, Male: MaleParticipants8884172
Race (NIH/OMB): American Indian or Alaska NativeParticipants000
Race (NIH/OMB): AsianParticipants9595190
Race (NIH/OMB): Native Hawaiian or Other Pacific IslanderParticipants000
Race (NIH/OMB): Black or African AmericanParticipants000
Race (NIH/OMB): WhiteParticipants000
Race (NIH/OMB): More than one raceParticipants000
Race (NIH/OMB): Unknown or Not ReportedParticipants000
Region of Enrollment: Chinaparticipants9595190

6. Primary Endpoint

The registry lists the primary outcome as Overall Survival, measured over Through Final Analysis data cutoff date of 2-August-2019 (up to approximately 26 months).

ElementRegistry entry
Result typeMedian
Measure of spread95% Confidence Interval
Unitmonth
Endpoint classificationTime-to-Event Analysis

Overall survival measures the time from randomization until death from any cause. The registry reports this endpoint as a median time in months for each group, together with a 95% confidence interval, and defines the analysis period as through the final analysis data cutoff date of 2-August-2019, up to approximately 26 months.

A time-to-event endpoint uses both whether an event occurred and when it occurred. Participants whose deaths have not been observed by the cutoff may contribute follow-up information up to their last recorded time without being treated as if they had died. The registry record does not describe the handling of censoring or missing survival information in detail. In general, survival methods are useful when follow-up times differ and some event times are not observed during the analysis period.

The median is the time by which half of the relevant survival distribution has experienced the event, under the survival estimate used. It offers an interpretable summary of follow-up, but it does not capture the entire survival curve. The hazard ratio reported for the comparison instead summarizes relative event rates over follow-up under its statistical assumptions. It is not interchangeable with a difference between medians, and it does not state how long any individual participant lived.

Overall survival is used because it concerns death from any cause rather than a measure that depends on judging disease progression or tumor response. That makes its event definition comparatively direct, though follow-up and analysis choices still matter. The registry’s endpoint definition does not by itself explain the completeness of follow-up, censoring decisions, or any sensitivity analyses.

7. Results Posted in the Registry

Hazard ratio: Sintilimab vs Chemotherapy

0.70

95% CI: 0.50 to 0.97

As reported in the registry

Treatment effect versus the control arm
Forest plot of hazard ratio (as reported) vs control (95% CI)Sintilimab vs Chemotherapy0.480.560.660.770.901.06hazard ratio (as reported) vs control (95% CI)

8. Secondary Efficacy Endpoints

The registry also posts results for secondary outcomes. For each outcome below, the endpoint type, the test applied to the posted summary statistics, the result and its interpretation are given in turn. Secondary endpoints are usually not adjusted for multiple testing, so they support rather than confirm the primary finding.

Secondary outcomeTypeEffect measureEstimate (95% CI)Planning size, 80% power
Progression-free SurvivalTime-to-Event AnalysisHazard ratio1.00 (0.72 to 1.39)7,864,581 events
Objective Response RateBinary EndpointRisk difference-6.3 pts (-14.6 to 2.0)337 per arm

Progression-free Survival

Treatment effect versus the control arm
Forest plot of hazard ratio (as reported) vs control (95% CI)Sintilimab vs Chemotherapy0.690.800.931.081.261.47hazard ratio (as reported) vs control (95% CI)

Objective Response Rate

Treatment effect versus the control arm
Forest plot of risk difference (percentage points) vs control (95% CI)Chemotherapy-16-12-8.24-4.39-0.553.29risk difference (percentage points) vs control (95% CI)

The secondary outcomes add context but do not replace the primary overall-survival comparison. Progression-free survival concerns a different point in the disease course and is analyzed as a time-to-event outcome. Objective response rate is a binary summary of response. Duration of response is listed among the secondary outcomes, but a result is not reported in the registry record. Because the endpoints capture different events and use different summaries, their estimates need not move in the same direction or carry the same precision.

Across the posted secondary results, progression-free survival does not show a clear comparative separation in the sponsor-reported analysis, while the objective-response estimates are accompanied by uncertainty that includes no difference in the sponsor-reported interval. These findings do not erase or confirm the overall-survival result: each outcome addresses a separate question and has its own analysis and measurement considerations. The registry record does not provide a complete account of assessment schedules, missing assessments, or endpoint-specific sensitivity analyses.

Secondary analyses generally carry less weight when many outcomes or comparisons are examined without a reported adjustment for multiplicity. Testing multiple hypotheses increases the chance that at least one result appears unusual by chance. The registry record does not report a multiplicity adjustment or a hierarchy for interpreting secondary outcomes. Thus, secondary results are best read as supportive or exploratory evidence, with attention to their uncertainty, rather than as independent confirmations of the primary finding.

The registry lists four outcome measures and reports analyses for overall survival, progression-free survival, and objective response rate. A duration-of-response result is not reported in the registry record. The absence of a posted result does not establish why it is absent or whether the outcome was not measured; that explanation is not reported in the registry record.

Secondary outcomes registered for this trial, for reference (only those above were recalculated):

9. Statistical Interpretation

Clinical Biostats interpretation

For overall survival, the reported median was 7.23 months for sintilimab, with a 95% confidence interval from 5.82 to 9.69, and 6.21 months for chemotherapy, with a 95% confidence interval from 5.39 to 7.85. The sponsor-reported hazard ratio for sintilimab versus chemotherapy was 0.701, with a 95% confidence interval from 0.504 to 0.972 and p = 0.032 from a Log Rank analysis. The posted analysis is classified as a superiority analysis.

These figures describe the trial’s observed data and its reported comparison. The hazard ratio is below 1, and its reported confidence interval does not include 1; the reported p-value is 0.032. Under the analysis used, this is evidence of a difference in overall survival between the assigned groups. It is not a measure of the size of a survival-time gain for an individual, and the hazard ratio should not be read as a percentage change in median survival. The medians describe each group separately; they are not a substitute for the time-to-event comparison.

Uncertainty remains. The confidence interval around the hazard ratio ranges from 0.504 to 0.972, so the estimate does not identify a single precise relative effect. Confidence intervals for the group medians also overlap. Overlap or non-overlap of separate group intervals is not the formal test of the between-group effect; the reported Log Rank comparison is the relevant sponsor analysis. General statistical interpretation also requires attention to the analysis population, follow-up, censoring, and assumptions, not just whether a p-value is below a threshold.

The secondary outcomes provide additional but distinct perspectives. The registry reports a progression-free survival hazard ratio close to 1, with a confidence interval that includes 1 and a p-value of 0.979. For objective response rate, the group percentages are 12.6% and 6.3%; the sponsor reports a difference in percentages of 6.3 with a 95% confidence interval from -2.2 to 15.4. These secondary findings do not supply the same inferential support as the primary analysis, particularly because the registry record does not report an adjustment for multiple testing. Duration of response is listed as an outcome, but a result is not reported in the registry record.

The registry record’s result is specific to this population, treatment comparison, and analysis period. It does not establish that the same estimate would apply in other settings, nor does a group-level comparison determine an individual participant’s outcome. The open-label design and limited detail about analysis procedures are relevant when judging the breadth of conclusions that can be drawn.

10. Statistical Methods Explained

The primary outcome is time-to-event data: each participant contributes information about the time from randomization to death or, if death has not been observed during follow-up, to the last time that can be used in the analysis. General survival methods can include such censored follow-up rather than discarding participants who have not had the event by the cutoff. The registry record defines overall survival and gives the cutoff period, but detailed censoring rules and checks of those rules are not reported in the registry record.

What does a median survival time describe?

A median is a summary of the estimated survival distribution, marking the time at which the estimated proportion still alive reaches the halfway point. It is not the mean survival time and does not show the shape of the full survival curve. A median can be estimated even when some participants are censored, depending on the observed follow-up and the method used. The registry gives group medians and confidence intervals, but does not provide enough detail to reconstruct the full curves or evaluate the method’s diagnostics.

How should the hazard ratio be read?

The reported hazard ratio compares the event rate between groups over the observed follow-up, according to the sponsor’s analysis. A value below 1 indicates a lower estimated hazard in the first-named group relative to the second-named group under that comparison; a value near 1 indicates little estimated relative difference. It is not the ratio of the two medians, nor does it directly give the probability that a participant survives to a particular time.

A hazard ratio is often interpreted as a single summary across follow-up. That summary can be harder to interpret if the relative event rates change over time. The registry record reports the hazard ratio and Log Rank method but does not report a proportional-hazards assessment, time-varying effects, or an alternative model. Therefore, the reported statistic should be understood as the sponsor’s chosen summary, not as evidence that its assumptions were tested or confirmed.

What does the Log Rank method contribute?

In general, a Log Rank test compares the event experience of groups over follow-up, taking account of the timing of events and censored observations. The registry identifies Log Rank as the method for the overall-survival comparison and reports a hazard ratio with a 95% confidence interval and p-value. The record does not state all details of how the hazard ratio was estimated alongside the test, nor whether any stratification or covariate adjustment was used. Those details are not reported in the registry record.

How do confidence intervals and p-values differ?

A confidence interval describes the uncertainty around an estimate under the analysis method. The interval for a hazard ratio gives a range of values compatible with the data and assumptions at the stated confidence level; it is not a range of individual participant outcomes. A p-value assesses how unusual the observed test statistic would be under a specified null hypothesis and model. It does not measure the probability that the null hypothesis is true, nor does it measure clinical importance. Both statistics depend on the analysis and the data; neither removes uncertainty about design or conduct.

For objective response rate, the outcome is binary: participants are categorized according to whether a response was observed under the outcome definition. The registry posts group percentages and a sponsor-reported difference in percentages with a confidence interval. The recalculated comparison is an unadjusted calculation from posted summary statistics and should not be treated as identical to a protocol-specified model. The response criteria, assessment schedule, and handling of missing response assessments are not reported in the registry record.

The sample-size illustrations use the observed effect as a planning reference, with the effect reduced to stated fractions for alternative scenarios. For time-to-event outcomes, the illustration is expressed as total events and uses the Schoenfeld approach. For other outcomes, it is expressed as participants per arm. The stated planning assumptions are two-sided significance level 0.05, equal allocation between the two arms, and a normal approximation. These are assumptions for the illustrations, not evidence about the trial’s original design calculations. The original sample-size justification and design assumptions are not reported in the registry record.

General statistical interpretation also distinguishes an analysis plan from an analysis that can be reconstructed from posted summary results. The registry identifies the efficacy analysis population as all randomized participants, but it does not report a complete analysis plan, the treatment of protocol deviations, missing-data methods, or sensitivity analyses. Those omissions limit independent evaluation of the robustness of the reported estimates.

11. Confidence Intervals and Precision

The overall-survival hazard ratio is 0.701, with a 95% confidence interval from 0.504 to 0.972. This interval indicates uncertainty around the estimated relative event rate, while also remaining below 1. It is not a guarantee that the underlying value lies within those endpoints, nor does it describe variation in outcomes among individual participants. The reported p-value is 0.032, from the Log Rank analysis.

The median estimate for sintilimab is 7.23 months, with a 95% confidence interval from 5.82 to 9.69. For chemotherapy, the median is 6.21 months, with a 95% confidence interval from 5.39 to 7.85. These intervals describe uncertainty in the group medians. They should not be used as a substitute for the interval around the comparative hazard ratio, since the statistics answer different questions.

Precision is affected by the amount and timing of observed information, including the number of events and the length and completeness of follow-up. The registry states an analysis cutoff through 2-August-2019, up to approximately 26 months, but detailed follow-up distributions and censoring information are not reported in the registry record. The confidence intervals are therefore important alongside the point estimates: they show that the estimates remain uncertain even though the primary comparison is reported as statistically significant.

In general, a narrower confidence interval indicates greater statistical precision than a wider one, all else equal. Precision is distinct from clinical importance and from freedom from bias. A result can be estimated relatively precisely while still depending on the design, measurement, analysis choices, and population studied. The posted confidence intervals do not resolve limitations arising from the open-label design or missing reporting details.

12. Planning a Similar Trial: Sample Size

This is a planning illustration, not a re-evaluation of the original trial. It asks: if a new study wanted to detect a difference like the one observed, or a smaller one, how large would it need to be? It is deliberately not “observed power” of the finished trial, which is not a meaningful quantity.

Effect to detect (log scale)Hazard ratioEvents, 80% powerEvents, 90% power
100% of the observed effect0.70249334
75% of the observed effect0.77443593
50% of the observed effect0.849961,333
Sample size needed versus the size of the effect to detect
Sample size needed versus size of effect to detect2005001,0002,00040%60%80%100%80% power90% powersize of effect to detect, as % of the effect observed (log vertical scale: events required (total))
Method and assumptions. Two-sided α = 0.05, 1:1 allocation, Schoenfeld approximation for the log-rank test or Cox model. The answer is the total number of events, not participants; the number of participants depends on how quickly events accrue. Calculated for the comparison: Sintilimab vs Chemotherapy.

The planning illustrations translate observed effects into hypothetical sample-size requirements under stated assumptions. For overall survival and progression-free survival, the figures are total events, not participants per arm. For objective response rate, the figures are participants per arm. The distinction matters because a time-to-event study’s information depends strongly on event accumulation, whereas a binary-outcome calculation is expressed as the number of participants assigned to each group.

The stated planning assumptions are a two-sided significance level of 0.05, equal allocation between the two arms, and a normal approximation. Each scenario uses a stated fraction of the observed effect. The time-to-event illustrations use the Schoenfeld approach. For each target power, the 80% column means the hypothetical event or participant count needed to have an 80% chance of detecting the specified effect under those assumptions; the 90% column uses a higher target chance of detection. These are planning concepts, not guarantees that a study will detect an effect.

Rows describing planning for 100%, 75%, and 50% of the observed effect illustrate how requirements change if the effect to detect is smaller than the observed estimate. A smaller effect generally requires more information to distinguish it from no difference at the same significance level and target power. The very large event requirements in the progression-free survival illustration reflect the observed hazard ratio’s proximity to 1 under this calculation; they should not be read as a recommendation or as a feasible design for this trial.

These values are planning illustrations based on observed results, not the original trial design calculations. The trial’s own sample-size justification and original assumptions are not reported in the registry record. This is not observed power: it does not measure the probability that the completed trial “had power” after seeing its results, and it should not be used to reinterpret the p-value.

13. How the Sample Size Is Derived

Power is the probability that a study of a given size rejects the null hypothesis when a specific true effect exists. It depends on four things: the effect to detect, the variability of the outcome, the significance level (here a two-sided α of 0.05, so z1−α/2 = 1.960) and the desired power (z1−β = 0.842 for 80% and 1.282 for 90%).

Formula

d = 4 (z1−α/2 + z1−β)2 / [ln(HR)]2

d is the total number of events needed (Schoenfeld's formula) with 1:1 allocation and proportional hazards.

Worked calculation for this trial

  1. Hazard ratio HR = 0.701, so ln(HR) = -0.3552.
  2. d = 4 × (1.96 + 0.842)2 / [ln(0.701)]2 = 248.8, rounded up to 249 events in total for 80% power.

The smaller-effect rows in the table above repeat the same calculation with the effect multiplied by 0.75 and 0.5 (for ratios, applied to the logarithm of the ratio).

R code

alpha <- 0.05
z_a   <- qnorm(1 - alpha / 2)          # two-sided
hr <- 0.701                              # observed hazard ratio
events_needed <- function(power, frac = 1) ceiling(round(4 * (z_a + qnorm(power))^2 / log(hr^frac)^2, 6))   # Schoenfeld, 1:1 allocation
for (f in c(1, 0.75, 0.5))
  cat(sprintf("%3.0f%% of observed effect: events = %s (80%% power), %s (90%% power)\n", 100 * f,
              format(events_needed(0.80, f), big.mark = ","), format(events_needed(0.90, f), big.mark = ",")))

# Simulation: given d total events under proportional hazards, events in the treatment arm are Binomial(d, hr / (1 + hr)).
# The score (log-rank type) statistic is (D1 - d / 2) / sqrt(d / 4).
set.seed(3116152)
d    <- events_needed(0.80)
reps <- 20000
D1 <- rbinom(reps, d, hr / (1 + hr))
z  <- (D1 - d / 2) / sqrt(d / 4)
cat(sprintf("Simulated power with %s events: %.3f (%d replicates)\n", format(d, big.mark = ","), mean(abs(z) > z_a), reps))

Output from running the code

100% of observed effect: events = 249 (80% power), 334 (90% power)
 75% of observed effect: events = 443 (80% power), 593 (90% power)
 50% of observed effect: events = 996 (80% power), 1,333 (90% power)
Simulated power with 249 events: 0.811 (20000 replicates)

The simulation uses the fact that, with d events in total and proportional hazards, the number of events in the treatment arm is binomial. It is an approximation that conditions on the total number of events, and it should land close to the target power.

14. Group-Sequential Design Analysis

Many time-to-event trials, especially in oncology, stop or report early when interim data are overwhelming, so a single fixed-sample number understates the real design problem. The calculation below is an illustrative group-sequential design built from this trial's posted control median and hazard ratio. The registry record does not state the planned number of looks or the spending function, so the design is a planning illustration, not a reconstruction of the protocol. Assumed: one-sided α = 0.025, 90% power, three equally spaced looks on information, Lan-DeMets O'Brien-Fleming spending, 24 months of accrual, 60 months in total and a 1% monthly dropout hazard.

Under these assumptions the design needs about 377 participants in total, with the boundaries below.

AnalysisCalendar time (months)EventsEfficacy boundary (z)Nominal one-sided pCumulative alpha spent
Look 115.61123.7100.00010.0001
Look 224.82242.5110.00600.0060
Look 360.03361.9930.02310.0250
01234z = 3.7116 mo112 eventsz = 2.5125 mo224 eventsz = 1.9960 mo336 eventsUpper efficacy boundary (z)

Fixed design versus group-sequential alternatives

DesignPowerEvents at final analysisParticipantsStudy length (months)
Fixed design, one analysis80%24827860.0
Two looks, O'Brien-Fleming80%24927960.0
Three looks, O'Brien-Fleming80%25128260.0
Three looks, Pocock80%29032660.0
Fixed design, one analysis90%33237360.0
Two looks, O'Brien-Fleming90%33337460.0
Three looks, O'Brien-Fleming90%33637760.0
Three looks, Pocock90%38343060.0

Group-sequential designs cost a small increase in maximum sample size and events compared with the fixed design, in exchange for the chance to stop early for overwhelming efficacy. O'Brien-Fleming spending keeps early boundaries very conservative and the final boundary close to the fixed-design value, whereas Pocock spending spends more alpha early.

Sensitivity to a smaller true effect

Planning for exactly the observed effect is optimistic, because observed effects in published trials tend to be somewhat larger than the true effect. The table repeats the main design (three looks, O'Brien-Fleming spending, 90% power) for smaller true hazard ratios.

True effect assumedHazard ratioEvents at final analysisParticipants
100% of the observed effect0.701336377
75% of the observed effect0.766598666
50% of the observed effect0.8371,3471,489

For context, this trial enrolled 190 participants.

Cross-check, upper boundaries: gsDesign 3.71, 2.511, 1.993 | rpact 3.71, 2.511, 1.993. Agreement between the two packages confirms the boundary calculation.

R code and output

suppressWarnings(suppressMessages({ library(gsDesign); library(rpact) }))
med_control <- 6.21          # control-arm median, months (converted from the posted unit)
hr          <- 0.701          # hazard ratio used for planning
lambdaC     <- log(2) / med_control
eta         <- 0.01               # dropout hazard per month (assumption)
acc_months  <- 24                 # accrual duration (assumption)
study_months<- 60                 # total study duration (assumption)

design <- function(k, sfu, beta, h = hr) gsSurv(k = k, test.type = 1, alpha = 0.025, beta = beta, sfu = sfu,
  lambdaC = lambdaC, hr = h, hr0 = 1, eta = eta, gamma = 1, R = acc_months, T = study_months, minfup = study_months - acc_months)

# Main design: 3 looks, Lan-DeMets O'Brien-Fleming spending, one-sided alpha 0.025, 90% power
x <- design(3, sfLDOF, 0.10)
cat(sprintf("N_TOTAL|%s\n", format(ceiling(sum(x$gamma * x$R)), big.mark = ",")))
for (i in 1:3) cat(sprintf("GS|%d|%.1f|%.0f|%.3f|%.5f|%.5f\n", i, x$T[i], x$n.I[i], x$upper$bound[i], pnorm(-x$upper$bound[i]), cumsum(x$upper$spend)[i]))
cat("\n"); print(gsBoundSummary(x))

# Comparison of designs
cmp <- list(list("Fixed design, one analysis", 1, sfLDOF), list("Two looks, O'Brien-Fleming", 2, sfLDOF),
            list("Three looks, O'Brien-Fleming", 3, sfLDOF), list("Three looks, Pocock", 3, sfLDPocock))
cat("\n")
for (b in c(0.20, 0.10)) for (d in cmp) {
  y <- design(d[[2]], d[[3]], b)
  cat(sprintf("DES|%s|%d|%.0f|%s|%.1f\n", d[[1]], round(100 * (1 - b)), tail(y$n.I, 1), format(ceiling(sum(y$gamma * y$R)), big.mark = ","), tail(y$T, 1)))
}

# Sensitivity: what if the true effect is smaller than the observed one? (3 looks, O'Brien-Fleming, 90% power)
cat("\n")
for (fr in c(1, 0.75, 0.5)) {
  y <- design(3, sfLDOF, 0.10, exp(log(hr) * fr))
  cat(sprintf("SENS|%.2f|%.3f|%.0f|%s\n", fr, exp(log(hr) * fr), tail(y$n.I, 1), format(ceiling(sum(y$gamma * y$R)), big.mark = ",")))
}

# Independent cross-check of the boundaries with rpact
r <- getDesignGroupSequential(kMax = 3, alpha = 0.025, beta = 0.10, sided = 1, typeOfDesign = "asOF", informationRates = x$timing)
cat(sprintf("\nCross-check, upper boundaries: gsDesign %s | rpact %s\n", paste(round(x$upper$bound, 3), collapse = ", "), paste(round(r$criticalValues, 3), collapse = ", ")))

Method: LachinFoulkes 
    Analysis              Value Efficacy
   IA 1: 33%                  Z   3.7103
      N: 246        p (1-sided)   0.0001
 Events: 113       ~HR at bound   0.4960
   Month: 16   P(Cross) if HR=1   0.0001
             P(Cross) if HR=0.7   0.0338
   IA 2: 67%                  Z   2.5114
      N: 378        p (1-sided)   0.0060
 Events: 225       ~HR at bound   0.7149
   Month: 25   P(Cross) if HR=1   0.0060
             P(Cross) if HR=0.7   0.5603
       Final                  Z   1.9930
      N: 378        p (1-sided)   0.0231
 Events: 337       ~HR at bound   0.8046
   Month: 60   P(Cross) if HR=1   0.0250
             P(Cross) if HR=0.7   0.9000



Cross-check, upper boundaries: gsDesign 3.71, 2.511, 1.993 | rpact 3.71, 2.511, 1.993

15. Analyses Reported by the Sponsor

MethodEstimate95% CIP-value
Log RankHazard Ratio (HR) 0.7010.504 to 0.9720.032

The registry reports a sponsor analysis for overall survival using the Log Rank method: hazard ratio 0.701, 95% confidence interval 0.504 to 0.972, and p = 0.032. The posted recalculation does not flag a discrepancy for this result. The sponsor’s reported analysis is the trial’s own comparative result and is the primary reference for interpreting the trial’s conclusion.

For progression-free survival, the sponsor reports a hazard ratio of 1.002, with a 95% confidence interval from 0.722 to 1.391 and p = 0.979. For objective response rate, the sponsor reports a difference in percentages of 6.3, with a 95% confidence interval from -2.2 to 15.4; a sponsor-reported p-value is not present in the registry record. The recalculated unadjusted objective-response comparison gives p = 0.137, based on the posted summary statistics. That calculation is a separate, unadjusted check, not a replacement for an analysis specified by the sponsor.

In general, recalculation from summary statistics cannot reproduce methods that require participant-level records, stratification variables, covariate adjustments, or details of handling missing observations. The registry record does not provide those details. Where sponsor and recalculated results differ, the sponsor’s own analysis takes precedence; the discrepancy flag is false for this record. Recalculations should therefore be read as supplementary checks, not as a competing primary analysis.

16. Multiplicity, Missing Data and Analysis Populations

Multiplicity arises when several statistical hypotheses are examined. Each additional test creates another opportunity for a result to appear statistically unusual by chance, even if no corresponding effect exists. This is one reason secondary outcomes are usually interpreted with more caution than a designated primary endpoint. The registry record lists progression-free survival, objective response rate, and duration of response as secondary outcomes, but a multiplicity adjustment, testing hierarchy, or other family-wise error procedure is not reported in the registry record.

The primary endpoint is identified as overall survival, and a sponsor-reported analysis is posted for it. The registry record does not report whether interim analyses were conducted, whether alpha was allocated across analyses, or how any interim monitoring would have affected the final analysis. These details are not reported in the registry record and should not be inferred from the final result alone.

The stated efficacy analysis population consisted of all randomized participants. This helps define who was intended to contribute to the efficacy analysis, but the registry record does not describe the handling of participants with missing outcome data, withdrawals, treatment changes, or protocol deviations. It also does not give the number censored at particular times or describe sensitivity analyses for missingness. Those details are not reported in the registry record.

For general interpretation, missing outcome information can matter if the chance of missingness is related to prognosis or treatment experience. Time-to-event methods commonly use censoring, but the validity of an estimate can depend on how censoring relates to the event process. The registry gives the endpoint definition and final-analysis cutoff but does not report enough detail to assess these assumptions. For objective response, missing assessments can affect whether a response is classified as observed, but the relevant rules are not reported in the registry record.

The original protocol, full statistical analysis plan, interim-analysis plan, and detailed missing-data procedures are not reported in the registry record. These are substantive limits on independent evaluation of the analysis, rather than evidence that a particular method was or was not used.

17. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

ArmParticipants with serious adverse eventsParticipants at riskPercentage
Sintilimab419443.6%
Chemotherapy238726.4%
Participants with at least one serious adverse event
Serious adverse events by armSintilimab43.6%Chemotherapy26.4%% of participants with at least one serious adverse event

Deaths

ArmDeaths (participants affected of at risk)
Sintilimab73 of 95
Chemotherapy82 of 95

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 5% reporting threshold.

ArmParticipants affected of at risk
Sintilimab88 of 94
Chemotherapy78 of 87

Most frequent serious adverse event terms

Event termOrgan systemSintilimabChemotherapy
Lung infectionInfections and infestations5 of 944 of 87
Upper gastrointestinal haemorrhageGastrointestinal disorders5 of 941 of 87
PneumoniaInfections and infestations6 of 940 of 87
PneumonitisRespiratory, thoracic and mediastinal disorders6 of 940 of 87
Bone marrow failureBlood and lymphatic system disorders0 of 946 of 87
Hepatic function abnormalHepatobiliary disorders4 of 940 of 87
Acquired tracheo-oesophageal fistulaRespiratory, thoracic and mediastinal disorders1 of 942 of 87
AnaemiaBlood and lymphatic system disorders2 of 941 of 87
DysphagiaGastrointestinal disorders2 of 940 of 87
Gastrointestinal haemorrhageGastrointestinal disorders2 of 940 of 87

Most frequent non-serious adverse event terms

Event termOrgan systemSintilimabChemotherapy
AnaemiaBlood and lymphatic system disorders46 of 9443 of 87
White blood cell count decreasedInvestigations13 of 9445 of 87
DiarrhoeaGastrointestinal disorders12 of 9432 of 87
Weight decreasedInvestigations28 of 9415 of 87
NauseaGastrointestinal disorders12 of 9431 of 87
Neutrophil count decreasedInvestigations10 of 9432 of 87
AstheniaGeneral disorders16 of 9423 of 87
ConstipationGastrointestinal disorders19 of 9414 of 87
VomitingGastrointestinal disorders12 of 9421 of 87
HypoproteinaemiaMetabolism and nutrition disorders23 of 948 of 87

Serious events with the highest arm-level rate: bone marrow failure (6.9%), pneumonia (6.4%), pneumonitis (6.4%), upper gastrointestinal haemorrhage (5.3%), lung infection (5.3%).

Do not overextend the safety comparison. Serious-adverse-event counts are safety observations, not efficacy outcomes, and should not be combined with the primary result into a single benefit-risk number.

The registry posts serious adverse event figures for groups with 94 participants at risk in the sintilimab group and 87 at risk in the chemotherapy group. It reports 41 participants affected in the sintilimab group and 23 in the chemotherapy group. The other-adverse-event figures are 88 affected among 94 at risk for sintilimab and 78 affected among 87 at risk for chemotherapy. The registry also reports deaths of 73 and 82, respectively. These are posted counts and should be read with their stated at-risk denominators, not treated as rates calculated on a different denominator.

The registry lists bone marrow failure at 6.9%, pneumonia at 6.4%, pneumonitis at 6.4%, upper gastrointestinal haemorrhage at 5.3%, lung infection at 5.3%, and hepatic function abnormal at 4.3% among the top serious terms. These terms describe reported events; the record excerpt does not establish that each event was caused by assigned treatment. The death counts likewise do not show that deaths were treatment-related. Overall survival counts death from any cause, whereas safety attribution is a separate question.

Adverse-event counts can depend on definitions, observation periods, reporting practices, and whether multiple events in one participant are counted separately. The registry record does not provide the detailed coding, exposure-adjusted analyses, severity breakdown, or causal assessments needed for a fuller comparison. The figures describe the posted safety data, not a complete assessment of benefit and risk.

18. What the Result Does, and Does Not, Mean

The primary result is a sponsor-reported overall-survival comparison in a randomized phase 2 study of IBI308, identified as sintilimab in the results, versus paclitaxel/irinotecan after first-line treatment failure in advanced or metastatic esophageal squamous cell carcinoma. The reported hazard ratio is 0.701, with a 95% confidence interval from 0.504 to 0.972 and p = 0.032. The group median estimates and their intervals provide additional descriptions of the observed survival data.

Statistically, the reported comparison is evidence of a difference between the assigned groups under the sponsor’s analysis. It does not prove that every participant in one group had a better outcome than every participant in the other. It does not determine the outcome for a particular person, establish the mechanism behind the observed difference, or show that the estimate will hold in other populations or settings. No medical advice follows from these statistics alone.

Overall survival is a measure of time to death from any cause, not a direct measure of symptoms, quality of life, or treatment burden. The registry record does not report those outcomes in the registry record described. Safety counts also require separate interpretation and do not, by themselves, establish causation. The endpoint results and safety reports are complementary, not interchangeable.

The open-label design means treatment assignment was known to participants and study staff. That feature is less directly tied to the definition of death than to outcomes involving clinical assessment or participant reporting, but it remains relevant to trial conduct and interpretation. Detailed information about blinded assessment, follow-up, missing data, and analysis choices is not reported in the registry record. The posted result is therefore best understood as a trial-specific estimate, with uncertainty and reporting limitations, rather than as a complete answer to every question about the treatments.

19. Why This Trial Matters Statistically

ORIENT-2 illustrates how a clinical trial can report several statistical summaries for one primary time-to-event question. Group medians describe the estimated timing of the event within each group; the hazard ratio summarizes the relative event experience over follow-up; and the confidence intervals convey uncertainty around estimates. These quantities answer related but different questions and should not be collapsed into a single number or interpretation.

The trial also demonstrates why the primary endpoint and secondary outcomes need to be kept distinct. Overall survival is the designated primary outcome. Progression-free survival and objective response rate capture other aspects of the disease course, and duration of response is listed without a posted result. Their differing results are not inherently contradictory because the endpoints use different definitions and analysis methods. Multiplicity and the absence of a reported adjustment further counsel against treating each secondary p-value or estimate as an independent confirmatory test.

The sample-size illustrations offer another statistical lesson: planning requirements depend on the effect one intends to detect, the target power, the significance level, allocation assumptions, and the outcome type. For time-to-event comparisons, the illustrations are expressed in total events; for the binary outcome, they are expressed per arm. These retrospective illustrations do not reveal the trial’s original planning rationale.

Finally, a statistically significant primary comparison does not eliminate uncertainty about precision, follow-up, missing information, assumptions, or generalizability. Reading the effect estimate together with its confidence interval, design, analysis population, secondary outcomes, and reporting gaps gives a more balanced understanding than relying on the p-value alone.

20. Limitations

The registry identifies the study as open-label and reports no masking. Knowledge of treatment assignment can influence aspects of study conduct and assessments, particularly for outcomes that require clinical judgment. Overall survival has a direct event definition, but an open-label design remains part of the context in which all results were generated. The registry record does not report whether any outcome assessment was independently reviewed or blinded.

The reported primary analysis uses a Log Rank method and gives a hazard ratio, but detailed modeling choices and assumption checks are not reported in the registry record. In particular, the record does not describe a proportional-hazards assessment, stratification factors, covariate adjustment, or sensitivity analyses. It also does not provide detailed censoring and follow-up information needed to assess how incomplete observation may have affected the time-to-event estimates.

Although the efficacy analysis population is described as all randomized participants, handling of missing outcome information, protocol deviations, treatment discontinuation, and crossover is not reported in the registry record. The original sample-size justification, interim-analysis procedures, and full statistical analysis plan are also not reported. The sample-size illustrations are based on observed effects and should not be treated as evidence of the planned design.

The registry lists duration of response as a secondary outcome but does not report a result for it. Multiplicity procedures for secondary outcomes are not reported. The posted safety summary does not supply detailed causal attribution or exposure-adjusted analyses. Finally, the trial addresses a specific disease setting and treatment comparison; the registry results alone do not establish how the estimates apply outside that setting.

21. Related Tutorials

22. Related Statistical Calculators

23. Sources

Continue through the Clinical Biostats statistical pathway

Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.

24. Record Summary

NCT03116152, ORIENT-2, was a randomized, open-label, multicenter, parallel-group phase 2 study of IBI308 versus paclitaxel/irinotecan in advanced or metastatic esophageal squamous cell carcinoma after failure of first-line treatment. The registry lists enrollment of 190 and 95 participants in each efficacy group. The study is marked completed.

The primary endpoint was overall survival, defined as time from randomization to death due to any cause. Through the final analysis data cutoff date of 2-August-2019, up to approximately 26 months, the sponsor reported a Log Rank hazard ratio of 0.701, with a 95% confidence interval from 0.504 to 0.972 and p = 0.032. The efficacy analysis population consisted of all randomized participants.

Progression-free survival and objective response rate were also reported as secondary outcomes. Duration of response was listed, but a result is not reported in the registry record. Detailed analysis-plan, missing-data, multiplicity, and follow-up procedures are not reported in the registry record.

Clinical Biostats