← Clinical Trials
Schizophrenia Phase 2 Continuous Endpoint NCT02969382

A Study to Evaluate the Efficacy and Safety of SEP-363856 in Acutely Psychotic Adults With Schizophrenia: Complete Statistical Analysis

This page examines a randomized, placebo-controlled phase 2 study of SEP-363856 in acutely psychotic adults with schizophrenia. It focuses on the Week 4 change in PANSS total score, the registry’s reported analysis, and how to read the posted secondary, safety, and sample-size information.

Trial start: 2016-12-05  ·  Enrollment: 245  ·  Sponsor: Otsuka Pharmaceutical Development & Commercialization, Inc.
Scope of this record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.

1. Trial at a Glance

This page covers the registry results for A Study to Evaluate the Efficacy and Safety of SEP-363856 in Acutely Psychotic Adults With Schizophrenia (NCT02969382), a randomized phase 2 study. The primary outcome is Change From Baseline in Positive and Negative Syndrome Scale (PANSS) Total Score at Week 4.

245
Enrollment
Phase 2
2
Arms
In the primary outcome
-7.50
Mean difference
SEP-363856
-12.03–-2.97
95% CI
Two-sided
FeatureRegistry value
ClinicalTrials.gov identifierNCT02969382
PhasePhase 2
ConditionSchizophrenia
AllocationRandomized
Design modelParallel
MaskingQuadruple
Enrollment245
Arms in the primary outcome2
Lead sponsorOtsuka Pharmaceutical Development & Commercialization, Inc.
Results postedYes

2. Clinical Question

Population

Adults with schizophrenia who were acutely psychotic. The registry record lists 245 participants enrolled; eligibility details beyond this description are not reported in the registry record.

Intervention

SEP-363856 capsule, flexibly dosed at 50 mg or 75 mg once daily.

Comparator

A placebo capsule once daily.

Primary question

How did PANSS total score change from baseline to Week 4 in the SEP-363856 group compared with the placebo group?

The primary endpoint is a between-group comparison of change in PANSS total score over the study period. PANSS measures symptoms using 30 items, which contribute to positive, negative, and general psychopathology subscales and a total score. The registry describes higher total scores as indicating more severe outcomes. Accordingly, the posted negative changes represent reductions in score from baseline. The key statistical question is whether the estimated average change differed between the randomized groups, and how uncertain that estimate is.

The registry record identifies the trial as randomized, parallel-group, placebo-controlled, and quadruple-masked; its official title also describes it as double-blind. The record does not specify which people or roles were included in the masking designation. The tables present the reported results alongside straightforward summaries of the posted group estimates. Those summaries help describe the size and precision of the observed contrast, but they do not establish what would happen in other populations or settings.

3. Trial Design

This was a phase 2, randomized, parallel-group study of SEP-363856 versus placebo in acutely psychotic adults with schizophrenia. The official title describes a four-week, multicenter, flexibly dosed study. The registry lists 245 participants enrolled: 120 in the SEP-363856 group and 125 in the placebo group. Participants assigned to SEP-363856 received a 50 mg or 75 mg capsule once daily; the comparator group received a placebo capsule once daily.

The registry records quadruple masking, while the official title calls the study double-blind. The record does not identify the specific parties masked or explain the relationship between those descriptions. It lists randomization and a parallel-group model, but details such as the randomization procedure, allocation concealment, site count, eligibility criteria, and dose-adjustment rules are not reported in the registry record.

The primary outcome was change from baseline in PANSS total score at Week 4. The posted primary analysis is described as a mixed models analysis and reports a mean difference, confidence interval, and p-value. The registry also lists secondary outcomes covering clinical severity, PANSS subscales and response, negative symptoms, depression symptoms, and adverse events. The record lists 12 outcome measures and 11 analyses, although detailed numerical comparisons in the posted results represented are available for the primary endpoint and three secondary endpoints.

The study status is completed. The record gives a start date of 2016-12-05 and a primary completion date of 2018-07-31. The sponsor is Otsuka Pharmaceutical Development & Commercialization, Inc. The original design’s sample-size rationale, planned analysis populations, missing-data procedures, interim analyses, and multiplicity strategy are not reported in the registry record.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Overall Study

StagePlaceboSEP-363856
STARTED125120
Subjects Continued Into Extension Study7978
COMPLETED9994
NOT COMPLETED2626

Reasons for not completing this period:

ReasonPlaceboSEP-363856
Adverse Event810
Lack of Efficacy45
Death01
PROTOCOL DEVIATION01
Withdrawal by Subject149

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

CharacteristicUnitPlaceboSEP-363856Total
Participants analysed125120245
Age, Categorical: <=18 yearsParticipants202
Age, Categorical: Between 18 and 65 yearsParticipants123120243
Age, Categorical: >=65 yearsParticipants000
Age, ContinuousYears30.6 (SD 6.07)30.0 (SD 5.76)30.3 (SD 5.91)
Sex: Female, Male: FemaleParticipants464389
Sex: Female, Male: MaleParticipants7977156
Ethnicity (NIH/OMB): Hispanic or LatinoParticipants6511
Ethnicity (NIH/OMB): Not Hispanic or LatinoParticipants119115234
Ethnicity (NIH/OMB): Unknown or Not ReportedParticipants000
Race (NIH/OMB): American Indian or Alaska NativeParticipants145
Race (NIH/OMB): AsianParticipants000
Race (NIH/OMB): Native Hawaiian or Other Pacific IslanderParticipants000
Race (NIH/OMB): Black or African AmericanParticipants201939
Race (NIH/OMB): WhiteParticipants10496200
Race (NIH/OMB): More than one raceParticipants011
Race (NIH/OMB): Unknown or Not ReportedParticipants000
Age, Customized: >=18 - <25 yearsParticipants292655
Age, Customized: >=25 - <=40 yearsParticipants9694190
Baseline Height (cm)cm172.7 (SD 7.78)173.0 (SD 8.50)172.8 (SD 8.12)
Baseline Weight (kg)kg73.74 (SD 12.645)75.23 (SD 15.768)74.47 (SD 14.250)
Baseline Body Mass Index (kg/m^2)kg/m^224.71 (SD 3.727)25.01 (SD 4.238)24.86 (SD 3.981)
Baseline Body Mass Index (BMI) Group: <18.5 kg/m^2Participants145
Baseline Body Mass Index (BMI) Group: >=18.5 - <25.0 kg/m^2Participants7059129
Baseline Body Mass Index (BMI) Group: >=25.0 - <30.0 kg/m^2Participants434184
Baseline Body Mass Index (BMI) Group: >=30.0 kg/m^2Participants111627
Baseline Waist Circumference (cm)cm84.18 (SD 12.186)85.21 (SD 14.191)84.68 (SD 13.189)
Country: HungaryParticipants6612
Country: RomaniaParticipants5510
Country: RussiaParticipants524698
Country: UkraineParticipants373673
Country: United StatesParticipants252752

6. Primary Endpoint

The registry lists the primary outcome as Change From Baseline in Positive and Negative Syndrome Scale (PANSS) Total Score at Week 4, measured over Baseline, Week 4.

ElementRegistry entry
Result typeLeast Squares Mean
Measure of spreadStandard Error
UnitUnits on a scale
Endpoint classificationContinuous Endpoint

The primary endpoint is change from baseline in PANSS total score at Week 4. PANSS is a structured measure composed of 30 items, each scored on an anchored Likert scale from 1 - 7. The registry states that values of 2 and above indicate the presence of progressively more severe symptoms. Item scores contribute to positive, negative, and general psychopathology subscales, as well as a total score. The listed range for the total score is 30-210, and higher total scores mean a more severe outcome.

Change from baseline summarizes how the score at the follow-up visit differs from the participant’s starting score. The registry reports group least-squares means for this change and a between-group mean difference. The least-squares mean is an estimate from a statistical model; it is not necessarily the same thing as a simple arithmetic average. The registry does not report enough model detail to explain precisely how its estimates were adjusted or which observations contributed to the model.

Using a symptom scale as the primary endpoint allows the study to compare average measured symptom change across randomized groups over the stated follow-up. A negative change on this scale means the measured score was lower than at baseline; because the registry says higher PANSS scores indicate more severe outcomes, lower scores correspond to lower measured severity on this scale. This endpoint is a score-based measure, not a complete account of each participant’s experience, functioning, or longer-term course. The four-week result also addresses the recorded time point, not outcomes beyond it.

7. Results Posted in the Registry

Mean difference: SEP-363856

-7.50

95% CI: -12.03 to -2.97

Recalculated from the posted summary statistics

Primary outcome by arm, with 95% confidence intervals
Primary outcome by arm with 95% confidence intervals-21.8-18.5-15.2-11.8-8.5-5.2Placebo (n=125)SEP-363856 (n=120)Units on a scale (95% CI)
Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)SEP-363856-13-10-7.41-4.62-1.830.96mean difference vs control (95% CI)

8. Secondary Efficacy Endpoints

The registry also posts results for secondary outcomes. For each outcome below, the endpoint type, the test applied to the posted summary statistics, the result and its interpretation are given in turn. Secondary endpoints are usually not adjusted for multiple testing, so they support rather than confirm the primary finding.

Secondary outcomeTypeEffect measureEstimate (95% CI)Planning size, 80% power
Change From Baseline in Clinical Global Impression - Severity (CGI-S) Score at Week 4Continuous EndpointMean difference-0.50 (-0.75 to -0.25)63 per arm
Change From Baseline in Positive and Negative Syndrome Scale (PANSS) Positive Subscale Score at Week 4Continuous EndpointMean difference-1.60 (-3.04 to -0.16)203 per arm
Change From Baseline in Positive and Negative Syndrome Scale (PANSS) Negative Subscale Score at Week 4Continuous EndpointMean difference-1.50 (-2.65 to -0.35)148 per arm

Change From Baseline in Clinical Global Impression - Severity (CGI-S) Score at Week 4

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)SEP-363856-0.81-0.64-0.46-0.29-0.110.06mean difference vs control (95% CI)

Change From Baseline in Positive and Negative Syndrome Scale (PANSS) Positive Subscale Score at Week 4

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)SEP-363856-3.28-2.58-1.87-1.17-0.460.24mean difference vs control (95% CI)

Change From Baseline in Positive and Negative Syndrome Scale (PANSS) Negative Subscale Score at Week 4

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)SEP-363856-2.86-2.25-1.63-1.02-0.400.21mean difference vs control (95% CI)

The detailed secondary results cover change in CGI-S and PANSS positive and negative subscale scores at Week 4. For each of these measures, the posted group estimates indicate a larger average reduction in the SEP-363856 group than in the placebo group. The sponsor’s reported analyses give between-group differences and p-values for these comparisons. These outcomes are related to the primary result because they assess clinical severity or components of the symptom domains captured by PANSS.

The overall direction across these posted secondary comparisons is therefore consistent with the primary endpoint’s direction. That consistency can provide context, but it does not make the secondary results equivalent to the primary result. Secondary measures address different aspects of symptoms, and they are not independent replications of the primary outcome. The registry lists a wider set of secondary outcomes, including negative symptoms, depression symptoms, PANSS response, and adverse events; detailed numerical results for all of those outcomes are not reported in the registry record represented.

The secondary p-values are unadjusted in the posted results. When several outcomes are tested, the chance of observing at least one small p-value by chance can rise. Without a reported testing hierarchy or multiplicity adjustment, individual secondary p-values carry less confirmatory weight than a prespecified primary analysis. The registry record does not report how multiplicity was handled in the original statistical plan, so no adjustment should be assumed.

These secondary outcomes are best read as supportive descriptive evidence, alongside their estimates and uncertainty, rather than as a separate set of definitive conclusions. Their interpretation also depends on the analysis details, missing-data handling, and measurement properties, which are not fully described in the registry record.

Secondary outcomes registered for this trial, for reference (only those above were recalculated):

9. Statistical Interpretation

Clinical Biostats interpretation

The posted primary group estimates were a least-squares mean change of -9.7 for placebo and -17.2 for SEP-363856. The sponsor’s mixed models analysis reports a mean difference (net) of -7.5, with a 95% confidence interval from -11.9 to -3.0 and p = 0.001. The direction is consistent with a larger average reduction in PANSS total score in the SEP-363856 group than in the placebo group at Week 4. This describes the posted comparison; it is not a recommendation or a conclusion about effects outside this trial.

The registry record identifies the primary analysis as a superiority analysis. Its confidence interval does not include zero, and its p-value is 0.001. These are features of the reported statistical comparison, not measures of the probability that the treatment effect is real or the probability that the result will recur. The registry does not report the full analysis specification, such as model terms, assumptions, or handling of missing observations, so the posted estimate should be interpreted with that limit in mind.

The re-calculation shown alongside the sponsor’s result is a simple, unadjusted summary based on the posted group estimates and standard errors. It gives a mean difference of -7.5, with a 95% confidence interval from -12.03 to -2.968 and an unadjusted p-value of 0.001. The sponsor’s analysis is the trial’s reported analysis; the re-calculation is a separate summary and does not replace it. The two intervals are close but are not identical, as expected when a simple calculation is compared with a model-based analysis. The re-calculation also uses an approximate standard deviation derived from the posted standard errors.

The endpoint’s direction is important: higher PANSS total scores indicate more severe outcomes, while the reported changes are negative. The between-group estimate therefore describes how much more the score fell on average in one group relative to the other, according to the posted analysis. It does not show how every participant’s score changed, and a group average can conceal variation among participants.

The secondary results add context across related symptom measures. The registry’s detailed results for CGI-S and PANSS positive and negative subscales also show larger reductions in the SEP-363856 group, with the posted sponsor analyses reporting differences and p-values. Those outcomes are secondary, and the registry record does not report a multiplicity adjustment. Their p-values should therefore be read as unadjusted evidence for individual comparisons, not as a set of confirmatory findings independent of the primary endpoint.

Safety results are counts of participants with events during the study, not estimates of comparative risk adjusted for other factors. The registry lists serious adverse events in both groups, other adverse events in both groups, and one death in the SEP-363856 group. Event counts alone do not establish cause, relatedness, or a full benefit-risk balance. The record’s short follow-up and the information limit what can be concluded about events outside the recorded period.

10. Statistical Methods Explained

What does the mixed models analysis report?

The registry describes the primary analysis as a mixed models analysis and reports a mean difference (net). A model-based mean difference compares the estimated average change between groups, while a mixed model is a general class of methods that can account for structured data, such as repeated measurements. That is general statistical background; the registry record does not report the exact model, its included terms, covariance structure, or estimation details. It is therefore not possible from the posted record to reconstruct the sponsor’s full analysis.

The reported primary contrast is -7.5, with a 95% confidence interval from -11.9 to -3.0 and p = 0.001. The group estimates are least-squares means, which are model-based estimates rather than necessarily raw averages. The record does not describe whether or how the model adjusted for baseline score, site, or other variables. Do not assume those details from the phrase “mixed models analysis.”

What is a confidence interval?

General explanation: a confidence interval is a range of estimates compatible with the data and the statistical method under its assumptions. It communicates precision as well as direction. A narrower interval indicates less uncertainty in the estimate than a wider interval on the same scale. A 95% confidence interval does not mean there is a 95% probability that the particular interval contains the true effect; it describes a long-run property of the interval-producing procedure under the model assumptions.

For the primary result, the posted sponsor interval extends from -11.9 to -3.0. Its location below zero is consistent with a negative estimated difference on the change-score scale. Since the scale’s higher values indicate more severe outcomes, this direction corresponds to a larger average score reduction in the SEP-363856 group. The interval does not describe the full range of individual participant responses.

How should the p-value be read?

General explanation: a p-value summarizes how unusual results at least as incompatible with a specified null hypothesis would be under that hypothesis and the analysis assumptions. It is not the probability that the null hypothesis is true, nor does it measure the size or clinical importance of an effect. The primary reported p-value is 0.001. The registry does not report enough information to assess every modeling assumption or the full analysis plan.

The secondary results include p-values for separate outcomes. An unadjusted p-value evaluates an individual comparison without accounting for the fact that several outcomes may have been examined. When many tests are considered, the chance of at least one apparently unusual result can increase. General statistical practice may address that issue through a prespecified hierarchy or adjustment, but the strategy for this trial is not reported in the registry record. The secondary p-values should therefore be interpreted as individual, unadjusted results.

What is the role of the re-calculation?

The re-calculation uses the posted group least-squares means, standard errors, and group sizes to make a simple unadjusted comparison. The posted values for the primary endpoint are -9.7 for placebo and -17.2 for SEP-363856, with standard errors 1.61 and 1.66. The re-calculated contrast is -7.5, with a 95% confidence interval from -12.03 to -2.968 and unadjusted p = 0.001. This is not a reconstruction of the mixed model. The pooled standard deviation is marked as approximate because it is inferred from the standard errors and sample sizes rather than reported directly.

General explanation: a standard error describes the estimated uncertainty of a sample estimate, whereas a standard deviation describes variation among observations. They are related but not interchangeable. Translating a standard error into an approximate standard deviation requires assumptions about the estimate and sample size. That approximation is useful for an illustrative standardized effect and planning calculation, but it should not be confused with a model-based treatment estimate.

Why do power and sample-size illustrations depend on assumptions?

The sample-size table uses an illustrative calculation based on the observed effect, a two-sided significance level of 0.05, equal allocation between the two arms, and a normal approximation. It considers the stated fractions of the observed effect. These are planning scenarios, not the trial’s reported original design calculations. The registry record does not report the trial’s own sample-size justification or assumptions.

General explanation: power is the probability that a specified statistical procedure would reject a null hypothesis when a particular effect is present, under the assumptions used in the calculation. A planning illustration asks what sample size would be needed for a chosen power under its assumed effect and model. It does not tell us the probability that this completed trial’s finding is true. The listed participant counts are not observed power. Smaller effects are harder to distinguish from random variation and therefore require more participants under otherwise similar assumptions.

What cannot be recovered from the registry description?

The record does not describe the analysis population, missing-data method, prespecified covariates, treatment of protocol deviations, interim analyses, or multiplicity procedure. It also does not give enough information to determine whether the reported model included every randomized participant or how incomplete Week 4 observations were handled. These details matter because analytical choices can affect estimates and uncertainty. The results can be summarized as posted, but the absent details should not be filled in by assuming a conventional approach.

11. Confidence Intervals and Precision

The sponsor-reported primary estimate is a mean difference of -7.5, with a 95% confidence interval from -11.9 to -3.0. This interval conveys uncertainty around the estimated group contrast. Its values are all negative, so the direction of the reported contrast is consistent across the interval with a greater average reduction in PANSS total score in the SEP-363856 group, given the outcome’s scoring direction. It does not imply that every participant had a reduction or that individual responses fall within this interval.

The simple re-calculation gives a 95% confidence interval from -12.03 to -2.968. This is an unadjusted approximation from posted summary statistics, not the sponsor’s mixed models analysis. Its endpoints differ from the sponsor-reported interval, and the sponsor’s own analysis is the primary reported result. The approximate standard deviation used for re-calculation is inferred from standard errors and group sizes, rather than directly reported.

General explanation: precision concerns how tightly an estimate is determined by the data and method. Confidence intervals help readers see both the estimated direction and the range of values reasonably compatible with the analysis. Statistical precision is not the same as clinical importance. The registry does not provide a threshold for a clinically important PANSS difference, so the interval cannot establish whether particular values are meaningful to patients.

The posted group sizes were 125 for placebo and 120 for SEP-363856. Sample size contributes to uncertainty, but interval width also depends on variability, the model, and the analysis. The registry record does not provide individual-level data or sufficient model details to independently verify the sponsor interval. The displayed precision should therefore be read as the precision reported for this analysis, not as a guarantee about estimates in future studies or other populations.

12. Planning a Similar Trial: Sample Size

This is a planning illustration, not a re-evaluation of the original trial. It asks: if a new study wanted to detect a difference like the one observed, or a smaller one, how large would it need to be? It is deliberately not “observed power” of the finished trial, which is not a meaningful quantity.

Effect to detectParticipants per arm, 80% powerParticipants per arm, 90% power
100% of the observed effect92123
75% of the observed effect163218
50% of the observed effect366490
Sample size needed versus the size of the effect to detect
Sample size needed versus size of effect to detect1002005001,00040%60%80%100%80% power90% powersize of effect to detect, as % of the effect observed (log vertical scale: participants per arm)
Method and assumptions. Two-sided α = 0.05, 1:1 allocation, two-sample comparison of means with the pooled standard deviation. Standard deviation was approximated from model-based standard errors, so treat it as rough. Calculated for the comparison: SEP-363856.

The sample-size table and curve are planning illustrations derived from the observed effect, not the trial’s own original design calculation. The entries are participants per arm, not a total across both arms and not a total number of events. This is a continuous-outcome comparison, so the figures describe participant counts for each arm.

The calculation assumes a two-sided significance level of 0.05, equal allocation between the two arms, and a normal approximation. It considers detecting 100% of the observed effect, 75% of the observed effect, or 50% of the observed effect. The registry record does not report the original sample-size assumptions or the justification used when planning this trial.

The 80% power column gives the illustrative participants per arm for a design with an 80% chance of detecting the assumed effect under the stated calculation assumptions. The 90% power column gives the corresponding number for a 90% chance. These are conditional planning targets, not guarantees; actual operating characteristics depend on the assumptions and the analysis. This is not observed power.

The table shows why the assumed effect matters. Planning for 75% or 50% of the observed effect requires more participants per arm than planning for the full observed effect. Smaller effects are more difficult to distinguish from random variation, so they generally require larger samples when other assumptions are held constant. The illustrative values should not be treated as evidence that the completed trial was adequately or inadequately sized, because its original design assumptions are not reported in the registry record.

13. How the Sample Size Is Derived

Power is the probability that a study of a given size rejects the null hypothesis when a specific true effect exists. It depends on four things: the effect to detect, the variability of the outcome, the significance level (here a two-sided α of 0.05, so z1−α/2 = 1.960) and the desired power (z1−β = 0.842 for 80% and 1.282 for 90%).

Formula

n = 2 (z1−α/2 + z1−β)2 σ2 / Δ2

n is the number of participants in each arm, Δ is the difference in means to detect and σ is the common standard deviation.

Worked calculation for this trial

  1. Observed difference Δ = -7.500; pooled standard deviation σ = 18.091.
  2. n = 2 × (1.96 + 0.842)2 × 18.0912 / -7.5002 = 91.3, rounded up to 92 participants per arm for 80% power.

The smaller-effect rows in the table above repeat the same calculation with the effect multiplied by 0.75 and 0.5 (for ratios, applied to the logarithm of the ratio).

R code

alpha <- 0.05
z_a   <- qnorm(1 - alpha / 2)          # two-sided
delta <- -7.5                      # observed difference in means
sigma <- 18.0907085716816                     # pooled standard deviation
n_per_arm <- function(power, frac = 1) {
  ceiling(round(2 * (z_a + qnorm(power))^2 * sigma^2 / (delta * frac)^2, 6))
}
for (f in c(1, 0.75, 0.5))
  cat(sprintf("%3.0f%% of observed effect: n per arm = %s (80%% power), %s (90%% power)\n", 100 * f,
              format(n_per_arm(0.80, f), big.mark = ","), format(n_per_arm(0.90, f), big.mark = ",")))

# Check against R's built-in function (t-based, so very slightly larger)
cat("power.t.test:", round(power.t.test(delta = delta, sd = sigma, power = 0.80)$n, 1), "\n")

# Simulation: exact two-sample t-test using simulated means and variances
set.seed(2969382)
n    <- n_per_arm(0.80)
reps <- 20000
m_diff <- rnorm(reps, delta, sigma * sqrt(2 / n))             # difference in sample means
s2     <- sigma^2 * rchisq(reps, 2 * (n - 1)) / (2 * (n - 1))   # pooled sample variance
tstat  <- m_diff / sqrt(s2 * 2 / n)
cat(sprintf("Simulated power at n = %s per arm: %.3f (%d replicates)\n", format(n, big.mark = ","), mean(abs(tstat) > qt(0.975, 2 * (n - 1))), reps))

Output from running the code

100% of observed effect: n per arm = 92 (80% power), 123 (90% power)
 75% of observed effect: n per arm = 163 (80% power), 218 (90% power)
 50% of observed effect: n per arm = 366 (80% power), 490 (90% power)
power.t.test: 92.3 
Simulated power at n = 92 per arm: 0.798 (20000 replicates)

The simulation draws many sets of group means and variances at the planned sample size and counts how often the two-sample t-test rejects the null. It should land close to the target power; at very small required sample sizes it can fall below it, because the normal approximation is rough there.

14. Analyses Reported by the Sponsor

MethodEstimate95% CIP-value
Mixed Models AnalysisMean Difference (Net) -7.5-11.9 to -3.00.001

The sponsor’s reported primary analysis is a mixed models analysis with a mean difference (net) of -7.5, a 95% confidence interval from -11.9 to -3.0, and p = 0.001. This is the trial’s posted analysis and should be the main reference for interpreting the primary endpoint.

The separate re-calculation uses the posted group estimates and standard errors to produce an unadjusted mean difference of -7.5, a 95% confidence interval from -12.03 to -2.968, and an unadjusted p-value of 0.001. It is a simple summary, not a substitute for the sponsor’s model. Its standard deviation is approximate, and it does not reproduce the model’s unreported specifications.

The two estimates have the same reported contrast and similar interval and p-value, while their confidence interval endpoints differ. This page does not identify a discrepancy between the sponsor’s result and the re-calculation. The distinction remains important: the sponsor’s analysis is the official reported analysis, whereas the re-calculation is an explanatory check based on summary statistics. The registry does not provide enough information to reproduce the full mixed models analysis or evaluate all of its assumptions.

15. Multiplicity, Missing Data and Analysis Populations

The registry lists a primary endpoint and multiple secondary outcomes, and it reports analyses for the primary endpoint and several secondary measures. Testing multiple outcomes raises a multiplicity question: if each comparison is assessed separately, the overall chance of at least one apparently positive result may be greater than the chance associated with any single test. General statistical approaches include prespecified testing sequences or adjustments to significance thresholds, but the registry record does not report the strategy used for this trial.

The secondary p-values should therefore be treated as unadjusted individual results. Their pattern may be useful context, but the record does not establish that they were protected from multiplicity or that they were all confirmatory. The primary analysis is distinct because it is designated as the primary outcome in the registry, but details of the original analysis plan are not reported in the registry record.

Missing-data handling is also not described. The record does not say how participants without a Week 4 score were handled, whether any imputation was used, or how the mixed models analysis treated incomplete follow-up. The numbers assigned to the two groups are reported, but the available record does not establish how many participants contributed data to each outcome analysis or whether all randomized participants were included.

The analysis population is not reported in the registry record. It is not possible to determine from the posted details whether the analysis followed an intention-to-treat principle, a per-protocol definition, or another population. The record also does not specify exclusions after randomization, protocol deviations, interim analyses, or sensitivity analyses. These omissions do not change the numerical result as posted, but they limit independent assessment of how robust it is to analytical choices.

General explanation: missing outcomes can affect estimates when the likelihood of missingness is related to outcomes or treatment, and different assumptions can lead to different analyses. A mixed model can use available repeated observations under particular assumptions, but the method label alone does not tell us which assumptions or implementation were used. The registry record does not provide sufficient detail to judge that issue.

16. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

ArmParticipants with serious adverse eventsParticipants at riskPercentage
Placebo31252.4%
SEP-36385621201.7%
Participants with at least one serious adverse event
Serious adverse events by armPlacebo2.4%SEP-3638561.7%% of participants with at least one serious adverse event

Deaths

ArmDeaths (participants affected of at risk)
Placebo0 of 125
SEP-3638561 of 120

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 5% reporting threshold.

ArmParticipants affected of at risk
Placebo47 of 125
SEP-36385635 of 120

Most frequent serious adverse event terms

Event termOrgan systemPlaceboSEP-363856
SchizophreniaPsychiatric disorders3 of 1251 of 120
Cardiovascular insufficiencyCardiac disorders0 of 1251 of 120
Suicide attemptPsychiatric disorders1 of 1250 of 120

Most frequent non-serious adverse event terms

Event termOrgan systemPlaceboSEP-363856
HeadacheNervous system disorders15 of 12511 of 120
InsomniaPsychiatric disorders13 of 1254 of 120
SomnolenceNervous system disorders6 of 1258 of 120
SchizophreniaPsychiatric disorders7 of 1257 of 120
AgitationPsychiatric disorders6 of 1256 of 120
AnxietyPsychiatric disorders9 of 1252 of 120
NauseaGastrointestinal disorders4 of 1256 of 120

Serious events with the highest arm-level rate: schizophrenia (2.4%), cardiovascular insufficiency (0.8%), suicide attempt (0.8%).

Do not overextend the safety comparison. Serious-adverse-event counts are safety observations, not efficacy outcomes, and should not be combined with the primary result into a single benefit-risk number.

The registry lists serious adverse events among 3 of 125 participants at risk in the placebo group and 2 of 120 participants at risk in the SEP-363856 group. It lists other adverse events among 47 of 125 participants at risk in the placebo group and 35 of 120 participants at risk in the SEP-363856 group. These are counts of participants with events as posted; they should not be read as proof that assignment caused or prevented an event.

The record lists one death in the SEP-363856 group and none in the placebo group. It does not report the cause of death or whether it was considered related to study treatment. The listed serious-event terms include Schizophrenia at 2.4%, Cardiovascular insufficiency at 0.8%, and Suicide attempt at 0.8%. The record does not provide enough context to attribute those terms to a particular group or infer causality.

Safety counts are descriptive and do not, by themselves, establish comparative safety. The study lasted four weeks, and the record does not provide the timing, severity, relatedness, or detailed clinical course for each event in this summary. Absence of an event in a group’s count is not evidence that the event cannot occur.

17. What the Result Does, and Does Not, Mean

The primary result describes an average difference in change in PANSS total score between randomized groups at Week 4. The sponsor-reported estimate is -7.5, with a 95% confidence interval from -11.9 to -3.0. Because higher PANSS total scores indicate more severe outcomes, the negative changes and contrast are consistent with a larger average score reduction in the SEP-363856 group than in the placebo group in this study.

This does not mean that every participant experienced the same change. A mean difference summarizes a group-level comparison and does not show the distribution of individual responses. It also does not establish how participants would fare beyond the recorded four-week period. The trial’s listed population is acutely psychotic adults with schizophrenia; results should not automatically be extended to populations or circumstances not described in the registry.

The p-value and confidence interval address statistical uncertainty under the reported analysis. They do not establish clinical importance. The registry record does not provide a threshold for a clinically meaningful change in PANSS total score, and statistical significance alone cannot answer that question. The record also does not provide enough analysis detail to independently evaluate the mixed model, missing-data assumptions, or analysis population.

Secondary measures show a broadly similar direction among the detailed results, but they are not substitutes for the primary result. They are individual secondary comparisons, and multiplicity handling is not reported. Safety counts are likewise descriptive; they do not determine whether an event was caused by study treatment or establish a full balance of benefits and harms.

Overall, the posted data support a description of the observed Week 4 group contrast and its reported precision. They do not, on their own, settle questions about longer-term outcomes, clinical importance, generalizability, or treatment decisions.

18. Why This Trial Matters Statistically

This trial is statistically informative because it reports a randomized, placebo-controlled comparison with a defined primary symptom-scale endpoint and a model-based estimate of the between-group difference. Randomization is intended, in general, to make treatment groups comparable on average, while a concurrent placebo group helps distinguish changes occurring over time from differences between assigned groups. The registry identifies the study as randomized, though details of the randomization process are not reported.

The posted primary result is accompanied by a confidence interval and p-value, allowing readers to assess direction and statistical precision rather than relying only on a point estimate. The simple re-calculation offers a transparent comparison based on posted summary statistics, while the sponsor’s mixed models analysis remains the trial’s reported analysis. Seeing both makes clear that summary-statistic checks and model-based analyses answer related, but not identical, questions.

The study also highlights the importance of separating primary from secondary outcomes. The secondary comparisons provide context about related symptom measures, but their unadjusted p-values should be interpreted cautiously when multiple outcomes are examined. The registry’s safety counts likewise illustrate why descriptive event totals should not be treated as causal comparisons.

Finally, the sample-size illustrations show how planning depends on assumed effect size and power, while the trial’s original sample-size rationale is not reported. Distinguishing those planning scenarios from the completed trial’s observed results helps avoid treating an illustrative calculation as evidence about the design quality or the probability that the result is true.

19. Limitations

The registry record does not report several details needed for a full appraisal of the analysis. These include the original sample-size justification, exact mixed-model specification, analysis population, missing-data method, interim analyses, and multiplicity strategy. The record also does not identify which people or roles were masked, despite listing quadruple masking and describing the study as double-blind in its official title.

The primary endpoint is a continuous score at Week 4. The registry describes the scale and its direction, but does not provide a threshold for clinical importance or individual-level response distributions for the primary endpoint. The result is therefore most directly interpreted as a group-average score contrast, not as a count of participants who experienced a particular degree of benefit.

The posted secondary results are not a complete numerical account of every secondary outcome listed in the registry. The broader list includes measures and event outcomes for which detailed comparisons are not reported in the registry record represented. The available secondary p-values are unadjusted, and the record does not explain how multiple testing was addressed.

The re-calculation is limited by reliance on summary statistics and an approximate standard deviation inferred from standard errors and group sizes. It is not a replication of the sponsor’s mixed models analysis. The sponsor-reported result should remain the reference for the primary analysis.

The safety summary gives event counts and selected serious-event terms, but does not give sufficient detail about event timing, treatment relatedness, severity, or causes. The four-week follow-up also limits what can be said about longer-term outcomes. These limitations define the scope of interpretation; they do not alter the values reported in the posted results.

20. Related Tutorials

21. Related Statistical Calculators

22. Sources

Continue through the Clinical Biostats statistical pathway

Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.

23. Record Summary

This completed phase 2 trial randomized 245 acutely psychotic adults with schizophrenia to SEP-363856 or placebo. The SEP-363856 group received a flexible 50 mg or 75 mg capsule once daily; the placebo group received a placebo capsule once daily. The primary outcome was change from baseline in PANSS total score at Week 4.

The sponsor-reported mixed models analysis gave a mean difference of -7.5, with a 95% confidence interval from -11.9 to -3.0 and p = 0.001. The direction corresponds to a larger average reduction in PANSS total score in the SEP-363856 group. The registry also posts secondary symptom outcomes and descriptive adverse-event counts, but details of the analysis plan, missing-data handling, and multiplicity strategy are not reported in the registry record.

Clinical Biostats