← Clinical Trials
Advanced Solid Tumors Phase 2 Objective Response Rate NCT02628067

KEYNOTE-158: Complete Statistical Analysis of Pembrolizumab in Advanced Solid Tumors

An independent statistical review of the phase 2 KEYNOTE-158 study of pembrolizumab in participants with advanced solid tumors, focusing on the registry-defined objective response rate endpoint, its response criteria, and the statistical framework appropriate for a non-randomized study.

Phase 2  ·  Non-randomized  ·  Enrollment 1,609  ·  Active, not recruiting
Official registry record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record.

1. Trial at a Glance

KEYNOTE-158 is a phase 2, non-randomized, parallel-design study evaluating pembrolizumab in participants with advanced solid tumors and a range of specified cancer conditions. The registry lists an enrollment of 1,609 participants, two study arms, no masking, and a primary endpoint of objective response rate (ORR).

1,609
Enrollment
Registry-listed participants
2
Study arms
Both interventions listed as pembrolizumab
Phase 2
Development phase
Treatment study
ORR
Primary endpoint
Up to approximately 10.5 years
FeatureKEYNOTE-158
Study acronymKEYNOTE-158
NCT identifierNCT02628067
PhasePhase 2
StatusActive, not recruiting
AllocationNon-randomized
Design modelParallel
MaskingNone
Primary purposeTreatment
Enrollment1,609
Number of arms2
InterventionsPembrolizumab; pembrolizumab
Lead sponsorMerck Sharp & Dohme LLC
Sponsor typeIndustry
Start date2015-12-18
Primary completion date2027-05-04

2. Clinical Question

The central statistical question is how frequently participants in this broad advanced-solid-tumor population experience an objective response to pembrolizumab according to the registry-defined response framework.

Population

Participants with advanced solid tumors and the cancer conditions listed in the registry, including anal carcinoma, biliary cancer, neuroendocrine tumors, endometrial carcinoma, cervical carcinoma, vulvar carcinoma, small cell lung cancer, mesothelioma, thyroid carcinoma, salivary gland cancer, advanced solid tumors, and colorectal carcinoma.

Intervention

Pembrolizumab is listed as the biological intervention. The registry lists pembrolizumab for both of the two study arms.

Comparator

No separate comparator treatment is specified in the registry information summarized here. The study allocation is explicitly non-randomized.

Primary question

What percentage of participants experience a complete response or partial response under the registry-defined modified RECIST 1.1 response assessment?

3. Trial Design

01
Enroll 1,609 participants
02
Assign Non-randomized study allocation
03
Treat Pembrolizumab
04
Assess Modified RECIST 1.1 response
05
Summarize Objective response rate
Allocation
Non-randomized. The registry does not describe random assignment between the two listed arms.
Design model
Parallel. The registry identifies two study arms within the parallel study design.
Masking
None. The study is listed as an unmasked trial.
Primary purpose
Treatment. The registry identifies treatment as the primary purpose of the study.

The design has an important statistical consequence: because allocation is non-randomized, the primary ORR is naturally interpreted as a response proportion within the study population rather than as a randomized estimate of a treatment-versus-control causal contrast. The registry also lists pembrolizumab as the intervention in both arms, so the available information does not define a conventional treatment-control comparison.

Two-arm design does not automatically mean two randomized treatments. KEYNOTE-158 has two listed arms, but the registry specifies non-randomized allocation and identifies pembrolizumab as the intervention in both arms. Without additional arm-level definitions, the two-arm structure should not be interpreted as evidence of a randomized comparator.

4. Population and Disease Scope

The registry describes a heterogeneous advanced-cancer population rather than a single disease entity. The listed conditions include advanced cancer and advanced solid tumors together with several specific tumor types.

Registry-listed condition groupConditions
GeneralAdvanced Cancer; Advanced Solid Tumors
Anal / gastrointestinalAnal Carcinoma; Anal Cancer; Colorectal Carcinoma
BiliaryBiliary Cancer; Cholangiocarcinoma; Bile Duct Cancer
NeuroendocrineNeuroendocrine Tumor; Carcinoid Tumor
GynecologicEndometrial Carcinoma; Endometrial Cancer; Cervical Carcinoma; Cervical Cancer; Vulvar Carcinoma; Vulvar Cancer
ThoracicSmall Cell Lung Carcinoma; Small Cell Lung Cancer (SCLC); Mesothelioma
Endocrine / salivaryThyroid Carcinoma; Thyroid Cancer; Salivary Gland Carcinoma; Salivary Gland Cancer; Salivary Cancer; Parotid Gland Cancer

This breadth matters statistically because an overall response proportion combines participants with different diseases and potentially different underlying response probabilities. A single pooled ORR therefore describes the enrolled study population as a whole; it does not automatically represent the response probability for every individual tumor type listed in the eligibility scope.

5. Primary Endpoint

EndpointRegistry definitionTime frame
Objective Response Rate (ORR) ORR is defined as the percentage of participants who have a Complete Response (CR: Disappearance of all target lesions) or a Partial Response (PR: At least a 30% decrease in the sum of diameters of target lesions) per RECIST 1.1 modified to follow a maximum of 10 target lesions and a maximum of 5 target lesions per organ at any time during the trial. Responses will be determined by independent central radiologic review, with confirmatory assessment as required per RECIST 1.1. Participants with unknown or missing response information will be treated as non-responders. The percentage of participants who experience a CR or PR based on modified RECIST 1.1 will be presented. Up to approximately 10.5 years

What exactly counts as a response?

The endpoint combines two response categories. A complete response requires disappearance of all target lesions. A partial response requires at least a 30% decrease in the sum of diameters of target lesions. Either category qualifies as an objective response.

The response assessment uses RECIST 1.1 with a protocol-specific modification limiting the number of target lesions to a maximum of 10 overall and a maximum of 5 target lesions per organ. The registry specifies independent central radiologic review and confirmatory assessment when required by RECIST 1.1.

Conceptual ORR calculation
ORR = (Number with CR + Number with PR) / Analysis population

The resulting proportion is expressed as the percentage of participants classified as having a complete or partial response under the prespecified response criteria. The registry explicitly states that participants with unknown or missing response information are treated as non-responders.

6. Why the Endpoint Definition Matters

ORR is a binary endpoint at the participant level: each participant is ultimately classified as having an objective response or not having an objective response under the specified assessment rules. That makes the endpoint statistically different from a continuous tumor-measurement outcome or a time-to-event endpoint.

Response is not survival

ORR measures whether a predefined tumor response occurred. It does not measure time until death, time until progression, or duration of survival.

Response is not treatment effect by itself

In a non-randomized study, an observed response proportion does not by itself establish how many additional responses were caused by treatment compared with an untreated or alternative-treatment population.

Missing responses are classified

The registry specifies that unknown or missing response information is treated as non-response. This directly affects the numerator and denominator used for the reported ORR.

Central review reduces subjectivity

Independent central radiologic review provides a standardized assessment framework for determining whether lesions meet the response criteria.

7. Planned Analysis

The registry identifies ORR as the primary endpoint and specifies that the percentage of participants experiencing a complete response or partial response will be presented. The endpoint is assessed through independent central radiologic review under modified RECIST 1.1, with confirmatory assessment as required.

For a binary response endpoint of this type, a typical statistical analysis would estimate the response proportion and an appropriate binomial confidence interval. The response count and analysis denominator should follow the prespecified response-evaluation population, including the registry rule that unknown or missing response information is treated as non-response.

Because the study is non-randomized and the registry information does not specify a separate comparator treatment, the central inferential quantity is the response proportion within the studied population rather than a randomized between-treatment effect estimate. A comparison with an external benchmark, if one were prespecified in a statistical analysis plan, would require that benchmark and its assumptions to be explicitly defined.

ClinicalTrials.gov reporting status: no formal statistical analyses are posted to ClinicalTrials.gov for the primary endpoint in the registry information. The record identifies what will be measured and how the response endpoint is defined, but it does not provide a posted statistical estimate, confidence interval, or p-value for ORR.

8. Statistical Methodology

Binary endpoint analysis

ORR is fundamentally a binary outcome at the participant level. Each participant contributes either a response classification or a non-response classification. The simplest descriptive estimator is the observed response proportion.

Observed response proportion
p̂ = r / n

Here, r represents the number of participants with a complete or partial response and n represents the prespecified analysis population after applying the response rules.

The statistical uncertainty around a proportion is commonly expressed with a binomial confidence interval. The interval reflects sampling uncertainty in the estimated response proportion; it is not a range containing the response probability of individual patients.

Why binomial methods fit ORR

Unlike a continuous endpoint, ORR does not require calculating a mean and standard deviation. The relevant outcome is whether a participant satisfies a categorical response definition. Binomial methods are therefore natural for estimating the proportion of participants meeting that definition.

Role of independent central review

The registry states that responses will be determined by independent central radiologic review, with confirmatory assessment as required under RECIST 1.1. Statistically, this creates a standardized adjudication process for the binary endpoint and helps define consistently which participants enter the response numerator.

Missing response information

The registry explicitly specifies that participants with unknown or missing response information will be treated as non-responders. This is an endpoint-definition rule rather than an instruction to impute a continuous measurement. It means that missing response status does not contribute to the response numerator.

9. Statistical Methods Explained

What is an objective response rate?

ORR is the percentage of participants who achieve either a complete response or a partial response according to the specified response criteria. In this study, the complete-response and partial-response definitions are based on modified RECIST 1.1.

Why is ORR a binary endpoint?

Although tumor measurements are continuous during radiologic assessment, the primary endpoint converts those measurements into a categorical clinical outcome: response versus non-response. This allows the study to summarize the percentage of participants meeting the predefined threshold for CR or PR.

Why does the denominator matter?

A response rate cannot be interpreted without knowing the population to which the percentage applies. The registry specifies that unknown or missing response information is treated as non-response, so those participants affect the denominator and do not enter the response numerator.

What does a confidence interval around ORR mean?

A confidence interval quantifies statistical uncertainty around the estimated response proportion under the specified sampling framework. A narrower interval indicates greater statistical precision; a wider interval indicates less precision. It does not mean that individual participants have responses occurring within the interval.

Why does non-randomization matter?

Randomization is the mechanism that balances measured and unmeasured prognostic factors probabilistically between treatment groups. Because this study is listed as non-randomized, an observed ORR should not automatically be interpreted as a causal treatment effect relative to another therapy.

Why can ORR not answer every clinical question?

A response endpoint captures tumor shrinkage according to a predefined threshold. It does not by itself describe how long a response lasts, how long participants remain alive, or what happens to participants whose disease does not meet the CR or PR criteria.

10. Interpretation of the Primary Endpoint

Statistical interpretation

An ORR estimate answers a focused question: what proportion of the analyzed participants experienced a complete or partial response under the prespecified radiologic criteria? It is a population-level proportion, not a patient-level prediction.

What ORR does not mean

ORR does not mean that the responding participants were cured, that every responder experienced the same magnitude of benefit, or that participants who did not meet CR or PR necessarily experienced no clinical benefit. It is specifically defined by the response criteria used in the trial.

What precision would tell us

A confidence interval around ORR would describe uncertainty in the estimated response proportion. The interval would not measure heterogeneity of treatment response among individual patients and would not establish causality in a non-randomized study.

Why p-values are not the main effect measure

A p-value, if a formal hypothesis test were specified, would address evidence against a particular null hypothesis. It would not quantify the magnitude of the response proportion. For ORR, the estimated percentage and its confidence interval provide the direct description of the observed response experience.

11. Analysis Population and Missing Data

The registry identifies an overall enrollment of 1,609 participants but does not provide a separate posted analysis population for the primary endpoint in the information summarized here. The endpoint definition itself does specify an important handling rule: participants with unknown or missing response information are treated as non-responders.

Statistical issueRegistry informationInterpretation
Total enrollment1,609Overall enrollment in the study
Primary endpointORRBinary response classification
Missing / unknown responseTreated as non-respondersDirectly affects the observed response proportion
Response assessmentIndependent central radiologic reviewCentralized assessment of response
Confirmatory assessmentAs required per RECIST 1.1Supports confirmation of response classifications

It is important to distinguish an endpoint-specific missing-data rule from broader statistical imputation. The registry specifies how missing or unknown response information is classified for ORR; it does not describe a general multiple-imputation or model-based missing-data strategy in the available record.

12. Non-Randomized Design and Causal Interpretation

The study is explicitly classified as non-randomized. This is one of the most consequential statistical features of the design because the observed response rate is not protected by randomization against differences in prognosis across treatment groups or cohorts.

QuestionWhat the design supportsWhat requires additional information
How often did participants respond? An ORR can describe the proportion meeting CR or PR criteria. The posted numerical response estimate and uncertainty are not present in the registry analysis information.
Was treatment superior to another treatment? No randomized comparison is specified. A causal comparative conclusion would require an appropriate comparator and design or analytic framework.
What factors influence response? Observed participant-level or disease-level characteristics could potentially be studied. Such analyses would require additional data and prespecified methods.

This distinction is central to interpreting phase 2 oncology studies. A high response proportion can be clinically informative while still being different from a randomized treatment effect. The design determines what statistical conclusions can be attached to the estimate.

13. Two Arms Without a Randomized Comparator

The registry lists two arms and identifies pembrolizumab as the biological intervention in both. Because allocation is non-randomized, the existence of two arms does not establish a conventional experimental-versus-control comparison.

What is established

The study contains two listed arms, has a parallel design model, and assigns no randomization according to the registry.

What is not established

The available registry information does not define a separate comparator therapy for the second arm.

For statistical interpretation, this prevents the two arms from being automatically summarized as a randomized treatment-versus-control contrast. Additional arm-specific definitions would be required before a comparative analysis could be specified accurately.

14. Response Assessment Under Modified RECIST 1.1

The response framework is one of the most important methodological details in the registry record. It uses RECIST 1.1 with a modification limiting the number of target lesions to a maximum of 10 overall and a maximum of 5 target lesions per organ.

ComponentRegistry specification
Complete responseDisappearance of all target lesions
Partial responseAt least a 30% decrease in the sum of diameters of target lesions
Response frameworkRECIST 1.1 modified to follow a maximum of 10 target lesions and a maximum of 5 target lesions per organ
Maximum target lesions10
Maximum target lesions per organ5
AssessmentIndependent central radiologic review
ConfirmationConfirmatory assessment as required per RECIST 1.1
Unknown or missing responseTreated as non-responders
Assessment periodAt any time during the trial; endpoint time frame up to approximately 10.5 years

These rules make the endpoint reproducible at the participant level. The same underlying imaging data could produce different response classifications if a different response framework or target-lesion rule were used, which is why the endpoint definition is an essential part of the statistical analysis rather than merely a clinical detail.

15. Time Frame and Ongoing Study Status

The registry lists the study start date as 2015-12-18 and the primary completion date as 2027-05-04. The current study status is listed as ACTIVE_NOT_RECRUITING.

2015-12-18

Study start

The registry lists this as the study start date.

Phase 2

Development phase

The study is classified as phase 2, with treatment as its primary purpose.

Active, not recruiting

Current registry status

The registry identifies KEYNOTE-158 as active, not recruiting.

2027-05-04

Primary completion date

The registry lists this as the primary completion date.

The ORR endpoint has a time frame of up to approximately 10.5 years. Because the trial remains listed as active, not recruiting and has a future primary completion date in the registry, the endpoint time frame should not be confused with a claim that a complete 10.5-year efficacy analysis has been posted.

16. What the Registry Does and Does Not Establish Statistically

Statistical questionRegistry information availableInterpretive consequence
What is the primary endpoint?Objective Response RateThe principal efficacy measure is a response proportion.
How is response defined?CR or PR under modified RECIST 1.1The endpoint has a prespecified categorical definition.
Who assesses response?Independent central radiologic reviewResponse classification uses centralized review.
How are missing responses handled?Unknown or missing responses are treated as non-respondersMissing response information is incorporated into the endpoint definition.
Is allocation randomized?NoThe design does not support a standard randomized causal treatment contrast.
Are numerical ORR results posted?No formal statistical analyses are posted in the registry record summarized here.A numerical effect estimate, confidence interval, and p-value cannot be attributed to a posted ClinicalTrials.gov analysis.

This distinction between endpoint specification and posted statistical results is important. A registry can define an endpoint precisely even when the record does not contain a formal statistical analysis of that endpoint.

17. Limitations

18. Why This Trial Matters Statistically

KEYNOTE-158 is useful as a statistical teaching case because it illustrates how a phase 2 response endpoint is constructed in a large, heterogeneous, non-randomized oncology study.

ConceptHow it appears in KEYNOTE-158
Non-randomized designAllocation is explicitly listed as non-randomized.
Parallel designThe design model is listed as parallel.
Binary efficacy endpointORR classifies participants according to whether they achieve CR or PR.
RECIST-based assessmentResponse is determined according to modified RECIST 1.1.
Independent central reviewResponses are determined by independent central radiologic review.
Confirmatory assessmentConfirmation is performed as required by RECIST 1.1.
Missing-data handlingUnknown or missing response information is treated as non-response.
Binomial inferenceORR is naturally summarized as a proportion with binomial uncertainty.
Population heterogeneityThe registry lists numerous tumor types and advanced-cancer conditions.
Interpretation of causalityNon-randomized allocation limits direct causal comparison with another treatment.

19. Clinical Interpretation vs Statistical Interpretation

Statistical interpretation

The primary endpoint is a prespecified binary response measure. Its natural summary is the proportion of participants achieving CR or PR, accompanied by an appropriate measure of statistical uncertainty.

Clinical interpretation

The response classification describes tumor response under a defined radiologic framework. It does not by itself summarize survival, durability, or every dimension of clinical benefit.

The distinction is particularly important in a non-randomized study. Statistical estimation can describe the response experience of the enrolled population, while causal interpretation requires stronger assumptions or an appropriate comparison framework.

20. Questions a Statistical Reviewer Should Ask

Is the overall ORR enough to compare the different diseases represented?

No. A pooled ORR combines participants across multiple listed disease categories. If disease-specific response rates were available, they would answer more focused questions. Comparisons across tumor types would also require attention to sample size, eligibility criteria, response assessment, and multiplicity.

Does independent central review make the study randomized?

No. Central review addresses consistency of response assessment; it does not change the allocation mechanism. The registry still classifies the study as non-randomized.

Does treating missing responses as non-response solve missing-data concerns?

It defines how missing response information contributes to ORR, but it does not make the missingness mechanism irrelevant. If missingness is related to disease status, treatment exposure, toxicity, or follow-up, the resulting ORR can be affected.

Can a response rate establish superiority?

Not without an appropriate comparative framework. A response proportion can describe the observed study population, but superiority requires a defined comparator and a statistical hypothesis appropriate to the design.

Why is the response threshold clinically important?

Because ORR is determined by whether tumor measurements cross a prespecified threshold. The 30% decrease criterion for partial response is therefore part of the endpoint definition and cannot be separated from the resulting statistical estimate.

Why does the maximum number of target lesions matter?

The registry specifies a maximum of 10 target lesions overall and a maximum of 5 per organ. This creates a standardized measurement framework for calculating the change in the sum of diameters used in response classification.

21. Record Summary

KEYNOTE-158 is a phase 2, non-randomized, unmasked, parallel-design treatment study with 1,609 enrolled participants and two listed arms, both identifying pembrolizumab as the biological intervention. Its registered primary endpoint is objective response rate, defined as the percentage of participants achieving a complete response or partial response according to modified RECIST 1.1, with independent central radiologic review and confirmatory assessment as required.

From a statistical perspective, the key features are the binary response endpoint, explicit handling of unknown or missing response information as non-response, centralized response assessment, and non-randomized allocation. These features mean that ORR can be interpreted as a population-level response proportion, while a causal treatment comparison requires additional design or comparative information.

Statistical takeaway: The most important lesson from KEYNOTE-158 is that endpoint definition and study design determine what an efficacy percentage can legitimately mean. A precisely defined ORR can be statistically informative, but its interpretation depends on the population, response rules, missing-data handling, and whether the study provides a randomized comparator.

22. Sources

Continue through the Clinical Biostats knowledge graph

Explore additional clinical-trial results, statistical tutorials, and analysis tools across the Clinical Biostats library.