← Clinical Trials
Polymyositis Phase 3 Binary Endpoint NCT02971683

Trial to Evaluate the Efficacy and Safety of Abatacept in Combination With Standard Therapy Compared to Standard Therapy Alone in Improving Disease Activity in Adults With Active Idiopathic Inflammatory Myopathy: Complete Statistical Analysis

The registry record describes a randomized Phase 3 trial comparing abatacept plus standard treatment with placebo plus standard treatment in adults with active idiopathic inflammatory myopathy. The primary comparison concerns improvement without rescue at Week 24; the posted results also include secondary outcomes and safety counts.

Trial start: 2017-05-04  ·  Enrollment: 149  ·  Sponsor: Bristol-Myers Squibb
Scope of this record

This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.

1. Trial at a Glance

This page covers the registry results for Trial to Evaluate the Efficacy and Safety of Abatacept in Combination With Standard Therapy Compared to Standard Therapy Alone in Improving Disease Activity in Adults With Active Idiopathic Inflammatory Myopathy (NCT02971683), a randomized phase 3 study. The primary outcome is Number of Participants Achieving International Myositis Assessment and Clinical Studies Definition of Improvement (IMACS DOI) at Week 24 Without Rescue.

149
Enrollment
Phase 3
2
Arms
In the primary outcome
-13.5 pts
Risk difference
Placebo + Standard Treatment
-29.5 to 2.4 pts
95% CI
Two-sided
FeatureRegistry value
ClinicalTrials.gov identifierNCT02971683
PhasePhase 3
ConditionPolymyositis, Dermatomyositis, Autoimmune Necrotizing Myopathy
AllocationRandomized
Design modelParallel
MaskingQuadruple
Enrollment149
Arms in the primary outcome2
Lead sponsorBristol-Myers Squibb
Results postedYes

2. Clinical Question

Population

Adults with active idiopathic inflammatory myopathy, including the listed conditions of polymyositis, dermatomyositis, autoimmune necrotizing myopathy, overlap myositis, and juvenile myositis above the age of 18. The primary outcome population is described as treated participants excluding participants with relevant protocol deviations.

Intervention

Abatacept subcutaneous weekly in addition to each participant’s current standard treatment. The double-blind treatment period lasted 24 weeks, followed by a 28 week open-label period of abatacept plus standard treatment.

Comparator

Placebo of abatacept subcutaneous weekly in addition to each participant’s current standard treatment during the 24-week double-blind period. The arm description specifies abatacept plus standard treatment during the subsequent 28 week open-label period.

Primary question

At Week 24, how many participants in each treatment group achieved the IMACS definition of improvement without rescue medication? The registry reports 42 participants in the abatacept group and 31 in the placebo group. These counts describe the outcome; by themselves, they do not establish how precise or statistically persuasive the between-group difference is.

The primary outcome combines improvement across core measures of myositis activity and function. The registry defines improvement as at least 20% from baseline in 3 IMACS core measures, while limiting worsening in core-measure scores. Rescue medication is part of the endpoint rule: improvement counts only when achieved without rescue.

The question is therefore not simply whether participants’ scores changed, or whether improvement occurred in either arm. It is whether the proportion meeting the specified composite improvement criterion differed between the randomized treatment strategies at Week 24. The posted results give an unadjusted risk-difference re-calculation and a logistic-regression analysis. Those estimates express the comparison on different statistical scales and should be read with their respective uncertainty intervals.

3. Trial Design

The registry describes a randomized, parallel-group Phase 3 trial with quadruple masking. The trial compared abatacept subcutaneous plus standard treatment with placebo plus standard treatment in adults with active idiopathic inflammatory myopathy. The registry lists 149 participants enrolled and a completed status. The start date is 2017-05-04, and the primary completion date is 2020-07-27.

During the double-blind period, participants assigned to the abatacept group received weekly subcutaneous abatacept in addition to their current standard treatment. Participants in the comparison group received weekly placebo of abatacept subcutaneous alongside their current standard treatment. This design aims to keep the groups’ care similar apart from the randomized study treatment during the blinded comparison. The registry identifies masking as quadruple but does not report which specific roles were masked.

The arm descriptions specify a 24-week double-blind period followed by a 28 week open-label period. In the open-label period, both arm descriptions specify abatacept plus standard treatment. The primary endpoint is assessed at Week 24, at the end of the double-blind period, rather than after the open-label period. The primary timeframe is described as from first dose to 24 weeks after first dose, approximately 169 days.

The primary outcome population is defined as all treated participants excluding participants with relevant protocol deviations. The registry record does not report the original sample-size justification, the detailed allocation procedure, or the full analysis plan. It also does not report the precise roles covered by quadruple masking. These details should not be inferred from the trial title or from the posted outcome summaries.

Fourteen outcome measures are recorded, with 13 secondary outcomes posted and 1 analysis reported for the primary endpoint. The secondary outcomes include measures of disability, muscle endurance, extra-muscular disease activity, total improvement, and adverse events. As with the primary result, the interpretation of each outcome depends on its measurement scale, analysis population, and uncertainty.

4. Participant Flow and Accounting

The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.

Double-Blind (24 Weeks)

StageAbatacept + Standard TreatmentPlacebo + Standard Treatment
STARTED7573
COMPLETED6965
NOT COMPLETED68

Reasons for not completing this period:

ReasonAbatacept + Standard TreatmentPlacebo + Standard Treatment
Other reasons01
Poor/Non-Compliance01
Lost to Follow-up10
Participant withdrew consent11
Participant request to discontinue study treatment11
Adverse Event02
Lack of Efficacy22
Participant no longer meets study criteria10

Open-Label

StageAbatacept + Standard TreatmentPlacebo + Standard Treatment
STARTED6963
COMPLETED6561
NOT COMPLETED42

Reasons for not completing this period:

ReasonAbatacept + Standard TreatmentPlacebo + Standard Treatment
Lost to Follow-up10
Participants withdrew consent02
Participant request to discontinue study treatment10
Lack of Efficacy20

Long-Term Open Label

StageAbatacept + Standard TreatmentPlacebo + Standard Treatment
STARTED2521
COMPLETED10
NOT COMPLETED2421

Reasons for not completing this period:

ReasonAbatacept + Standard TreatmentPlacebo + Standard Treatment
Administrative reason by sponsor2017
Participant withdrew consent10
Participant request to discontinue study treatment11
Adverse Event12
Lack of Efficacy11

Analysis population for the primary outcome, as defined in the registry: All treated participants excluding participants with relevant protocol deviations

5. Baseline Characteristics

The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.

CharacteristicUnitAbatacept + Standard TreatmentPlacebo + Standard TreatmentTotal
Participants analysed7573148
Age, ContinuousYears49.3 (SD 14.41)48.1 (SD 14.09)48.7 (SD 14.22)
Age, Customized: 16-29 years oldParticipants9918
Age, Customized: 30-39 years oldParticipants81422
Age, Customized: 40-49 years oldParticipants141428
Age, Customized: 50-59 years oldParticipants311950
Age, Customized: >/= 60 years oldParticipants131730
Sex: Female, Male: FemaleParticipants5254106
Sex: Female, Male: MaleParticipants231942
Ethnicity (NIH/OMB): Hispanic or LatinoParticipants7310
Ethnicity (NIH/OMB): Not Hispanic or LatinoParticipants191938
Ethnicity (NIH/OMB): Unknown or Not ReportedParticipants4951100
Race/Ethnicity, Customized: American Indian or Alaska NativeParticipants336
Race/Ethnicity, Customized: AsianParticipants10616
Race/Ethnicity, Customized: Black or African AmericanParticipants9817
Race/Ethnicity, Customized: WhiteParticipants424284
Race/Ethnicity, Customized: JapaneseParticipants111021
Race/Ethnicity, Customized: OtherParticipants033
Race/Ethnicity, Customized: UnknownParticipants011

6. Primary Endpoint

The registry lists the primary outcome as Number of Participants Achieving International Myositis Assessment and Clinical Studies Definition of Improvement (IMACS DOI) at Week 24 Without Rescue, measured over From first dose to 24 weeks after first dose. (Approximately 169 days).

ElementRegistry entry
Result typeCount Of Participants
Measure of spreadnot applicable
UnitParticipants
Endpoint classificationBinary Endpoint

The primary endpoint counts participants who achieve the International Myositis Assessment and Clinical Studies definition of improvement, or IMACS DOI, at Week 24 without rescue medication. The registry defines improvement as an improvement of at least 20% from baseline in 3 IMACS core measures, with no more than 2 core-measure scores worsening by at least 25% from baseline. The description repeats the worsening criterion; the registry record does not clarify that repetition.

The core measures named in the record are Physician Global Assessment of Disease Activity, Patient (Subject) Global Assessment of Disease Activity, Manual Muscle Test (MMT-8), Health Assessment Questionnaire-Disability Index, muscle enzyme levels, and the extra-muscular global activity assessment from the Myositis Disease Activity Assessment Tool. A composite definition can capture change across different aspects of disease activity and function rather than relying on a single score. It also makes the improvement rule explicit, including the allowance for some measures to worsen.

The endpoint is a count of participants meeting the full rule, not a mean change in a single scale. The comparison is therefore naturally expressed as a difference in the probability of meeting the criterion. Requiring improvement without rescue distinguishes the endpoint from improvement that occurs after rescue medication. The registry does not report further details about how rescue was defined or handled beyond its inclusion in the endpoint rule.

7. Results Posted in the Registry

Risk difference: Placebo + Standard Treatment

-13.5

95% CI: -29.5 to 2.4 percentage points

Recalculated from the posted summary statistics

Primary outcome by arm, with 95% confidence intervals
Primary outcome by arm with 95% confidence intervals28.336.745.053.461.870.2Abatacept + Standard Treatment (n=75)Placebo + Standard Treatment (n=73)% of participants (95% CI)
Treatment effect versus the control arm
Forest plot of risk difference (percentage points) vs control (95% CI)Placebo + Standard Treatment-32-25-17-9.83-2.424.98risk difference (percentage points) vs control (95% CI)

8. Secondary Efficacy Endpoints

The registry also posts results for secondary outcomes. For each outcome below, the endpoint type, the test applied to the posted summary statistics, the result and its interpretation are given in turn. Secondary endpoints are usually not adjusted for multiple testing, so they support rather than confirm the primary finding.

Secondary outcomeTypeEffect measureEstimate (95% CI)Planning size, 80% power
Mean Change in Health Assessment Questionnaire-Disability Index (HAQ-DI) From Baseline to Week 24Continuous EndpointMean difference0.11 (-0.08 to 0.30)384 per arm
Mean Change in Muscle Endurance Using the Myositis Function Index (FI-2) From Baseline to Week 24Continuous EndpointMean difference-2.90 (-6.66 to 0.86)201 per arm
Mean Change in Myositis Disease Activity Assessment Tool (MDAAT) Assessment of Extra-muscular From Baseline to Week 24Continuous EndpointMean difference0.16 (-0.41 to 0.73)1,584 per arm

Mean Change in Health Assessment Questionnaire-Disability Index (HAQ-DI) From Baseline to Week 24

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)Placebo + Standard Treatment-0.11-0.020.070.150.240.33mean difference vs control (95% CI)

Mean Change in Muscle Endurance Using the Myositis Function Index (FI-2) From Baseline to Week 24

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)Placebo + Standard Treatment-7.26-5.51-3.77-2.03-0.291.46mean difference vs control (95% CI)

Mean Change in Myositis Disease Activity Assessment Tool (MDAAT) Assessment of Extra-muscular From Baseline to Week 24

Treatment effect versus the control arm
Forest plot of mean difference vs control (95% CI)Placebo + Standard Treatment-0.50-0.240.030.290.560.82mean difference vs control (95% CI)

The posted secondary outcomes cover disability, muscle endurance, extra-muscular disease activity, total improvement, and safety. The available re-calculations for continuous outcomes have mixed directions across their measurement scales, and each interval spans the no-difference value. That pattern does not provide a consistent, precise secondary signal that independently settles the primary comparison. It is also important not to interpret every change score in the same direction: the measures assess different concepts and use different scales.

The secondary outcomes provide context for the primary IMACS DOI result because they assess related but distinct aspects of function and disease activity. A composite improvement endpoint and individual mean-change measures need not produce identical estimates. The record also lists the Myositis Response Criteria Total Improvement Score and adverse-event outcomes among its secondary measures, but the information summarized for those outcomes does not support adding further numerical comparisons.

Unadjusted secondary results carry less weight when many outcomes are examined. Each additional comparison creates more opportunity for an apparently notable result to arise by chance, unless the analysis plan accounts for multiplicity. The registry record does not report a multiplicity adjustment or a hierarchy specifying which secondary outcomes should be treated as confirmatory. Therefore, secondary estimates are best read as descriptive and exploratory rather than as independent proof of a treatment effect.

The number of secondary outcomes posted is 13, while the record lists 14 outcome measures overall. That breadth makes it especially important to distinguish the prespecified primary question from secondary analyses and to avoid selecting only a favorable-looking result. The full prespecified status and analysis plan for each secondary endpoint are not reported in the registry record.

Secondary outcomes registered for this trial, for reference (only those above were recalculated):

9. Statistical Interpretation

Clinical Biostats interpretation

The posted primary counts are 42 participants achieving IMACS DOI without rescue in the abatacept plus standard-treatment group and 31 in the placebo plus standard-treatment group. The corresponding arm sizes in the primary results are 75 and 73. The unadjusted re-calculation expresses the comparison as a risk difference of -0.135 for placebo relative to abatacept, with a 95% confidence interval from -0.295 to 0.024 and p = 0.1. The negative sign reflects the stated comparison order: placebo minus abatacept.

The confidence interval includes zero, the value representing no risk difference. Thus, the re-calculated estimate is compatible with a range extending from a difference favoring the abatacept group to a small difference in the other direction. The interval is broad enough that the point estimate alone should not be treated as a precise description of the underlying contrast. The unadjusted p-value is not below 0.05, but a p-value is not a measure of the probability that either treatment strategy is effective or ineffective.

The registry also reports a logistic-regression odds ratio of 1.8, with a 95% confidence interval from 0.9 to 3.5 and p = 0.083. That analysis uses odds, whereas the re-calculation uses a risk difference. The reported odds ratio is above 1, but its confidence interval includes 1, the null value for an odds ratio. These results do not provide clear statistical separation from their respective null values. The two estimates are not numerically interchangeable because they use different scales.

The secondary continuous-outcome re-calculations also have confidence intervals that include zero: HAQ-DI mean difference 0.11, with an interval from -0.079 to 0.298; FI-2 mean difference -2.9, with an interval from -6.656 to 0.856; and MDAAT extra-muscular mean difference 0.16, with an interval from -0.408 to 0.728. Their directions and scales differ, so their signs should not be read as a common measure of benefit. These unadjusted comparisons are exploratory in the context of multiple outcomes.

Overall, the registry reports more primary-endpoint participants in the abatacept arm than in the placebo arm, while the interval-based comparisons remain uncertain. The results support describing the observed counts and estimates, not making a definitive claim about a treatment effect. The registry record does not report enough information about missing data, multiplicity handling, or the full prespecified analysis plan to resolve those sources of uncertainty.

10. Statistical Methods Explained

Randomization assigns participants to treatment groups so that, in expectation, prognostic characteristics are not systematically allocated to one group. It supports a between-group comparison, but it does not guarantee that the groups are identical in a particular trial. The registry describes randomized allocation and a parallel-group design. The record does not report the detailed randomization method or allocation-concealment procedure.

What does the primary contrast measure?

The primary endpoint is binary at the participant level: each treated participant either meets the IMACS DOI rule without rescue at Week 24 or does not. A risk is the proportion of participants meeting that outcome in a group. The risk difference subtracts one group’s risk from the other’s. The posted unadjusted re-calculation uses placebo minus abatacept, giving -0.135. A negative value in this ordering means the observed outcome proportion was lower in the placebo group. The estimate is an unadjusted summary, not a model-based causal estimate adjusted for participant characteristics.

The primary results list 42 of 75 participants in the abatacept group and 31 of 73 in the placebo group. The posted risk estimates are 0.56 and 0.425, respectively. The re-calculated risk difference is accompanied by a confidence interval and an unadjusted p-value. The registry’s own logistic-regression analysis instead reports an odds ratio. Odds compare the chance of an event with the chance of no event; an odds ratio contrasts those odds between groups. A risk difference and odds ratio describe different quantities, so their numerical values cannot be compared as if they were the same effect measure.

What does a confidence interval add?

A confidence interval describes the statistical uncertainty around an estimate under the assumptions of the method used. It identifies values that are reasonably compatible with the observed data and model. For the risk difference, zero represents no difference. For an odds ratio, 1 represents equal odds. An interval containing the relevant null value indicates that the data do not clearly distinguish the estimate from that null value at the corresponding confidence level. It does not establish that the true effect is exactly null, and it does not give the probability that a particular treatment effect is true.

A p-value measures how unusual results at least as incompatible with the null hypothesis would be, assuming that hypothesis and the statistical model. It is not the probability that the null hypothesis is true. The primary re-calculation reports p = 0.1, while the registry’s logistic-regression analysis reports p = 0.083. Those values arise from different analysis scales and may also reflect different analysis procedures. The registry record does not report enough detail to reconstruct the sponsor’s model or determine every reason for the numerical difference.

How should continuous outcomes be read?

The secondary HAQ-DI, FI-2, and MDAAT outcomes are reported as mean changes from baseline, with standard errors. A mean summarizes the average observed change, while a standard error describes the estimated sampling uncertainty around that mean. The re-calculated comparisons are mean differences between groups. A confidence interval for a mean difference that crosses zero is compatible with differences in either direction. Interpretation of direction depends on the outcome’s scale and scoring meaning; a negative change is not automatically better or worse across all measures.

The registry lists HAQ-DI changes of -0.31 and -0.2, FI-2 changes of 4.1 and 1.2, and MDAAT changes of -1.56 and -1.4 for abatacept and placebo, respectively. The associated standard errors and re-calculated intervals are posted. Standard errors are not standard deviations: they describe precision of an estimated mean rather than the spread of individual participant values. The registry does not post sponsor-reported analyses for these three outcomes in the record summarized.

Why do planning calculations use assumptions?

The sample-size planning illustrations use two-sided significance level 0.05, equal allocation, and a normal approximation. They calculate participants per arm for stated fractions of the observed effect. The assumed effect is not a guaranteed future treatment effect. Smaller target effects require more participants to detect under otherwise similar assumptions. These calculations are planning illustrations, not evidence about the trial’s achieved power. The original trial design assumptions and sample-size justification are not reported in the registry record.

For count outcomes, over-dispersion can matter when a count varies more than a simple statistical model expects. General statistical principle: if such extra variation is present and not accommodated, uncertainty can be understated. The primary endpoint is analyzed as a participant-level binary outcome rather than a rate of recurrent events, so that count-model issue is not the main interpretation of its risk difference. The registry record does not report an over-dispersion assessment or enough detail to infer one.

11. Confidence Intervals and Precision

Precision concerns how narrowly the data constrain an estimate. The primary unadjusted risk difference is -0.135, with a 95% confidence interval from -0.295 to 0.024. That interval includes zero, so the posted summary is compatible with no risk difference as well as differences in either direction. Its breadth also means the point estimate should not be treated as a sharply determined effect size.

The registry’s logistic-regression estimate is an odds ratio of 1.8, with a 95% confidence interval from 0.9 to 3.5. The interval includes 1, the null value for an odds ratio. The re-calculated risk-difference interval and the sponsor-reported odds-ratio interval answer related but distinct questions, and their bounds should not be directly compared numerically.

The continuous secondary comparisons also have intervals spanning zero: -0.079 to 0.298 for HAQ-DI, -6.656 to 0.856 for FI-2, and -0.408 to 0.728 for MDAAT extra-muscular assessment. These intervals indicate uncertainty about the direction and size of each unadjusted mean difference. Their interpretation also depends on the outcome scale, which differs across measures.

Confidence intervals reflect sampling uncertainty under the analysis assumptions; they do not account automatically for every limitation, such as missing observations, protocol deviations, or selective reporting. The registry record does not report enough detail to assess all such influences. The endpoint counts, arm sizes, and intervals should therefore be considered together rather than relying only on the point estimate or p-value.

12. Planning a Similar Trial: Sample Size

This is a planning illustration, not a re-evaluation of the original trial. It asks: if a new study wanted to detect a difference like the one observed, or a smaller one, how large would it need to be? It is deliberately not “observed power” of the finished trial, which is not a meaningful quantity.

Effect to detectParticipants per arm, 80% powerParticipants per arm, 90% power
100% of the observed effect214285
75% of the observed effect380508
50% of the observed effect8541,143
Sample size needed versus the size of the effect to detect
Sample size needed versus size of effect to detect2005001,0002,00040%60%80%100%80% power90% powersize of effect to detect, as % of the effect observed (log vertical scale: participants per arm)
Treat these figures cautiously. The observed difference is imprecise: its confidence interval includes no difference at all. A sample size built on a noisy estimate can be far too small or too large, so the smaller-effect rows are the more cautious guide.
Method and assumptions. Two-sided α = 0.05, 1:1 allocation, pooled-variance normal approximation for two proportions (control proportion held at the observed value). Calculated for the comparison: Placebo + Standard Treatment.

The planning illustrations are expressed as participants per arm for the binary primary outcome and the continuous outcomes in the posted results. They are not totals across treatment groups. The sample-size assumptions are a two-sided significance level of 0.05, equal allocation between the two arms, and a normal approximation. Each planning scenario uses a stated fraction of the observed effect as the effect to detect. The original trial’s own design assumptions and sample-size justification are not reported in the registry record.

The 80% power column gives the number of participants per arm estimated to be needed, under those assumptions, for an 80% chance of detecting the specified effect if that effect is the true one. The 90% power column gives the corresponding planning estimate for a 90% chance. Higher target power generally requires a larger planned sample under otherwise similar assumptions. The values are not guarantees that a future study will reach a particular result.

Rows for 100% of the observed effect, 75% of the observed effect, and 50% of the observed effect illustrate how the target effect changes the planning estimate. A smaller effect is harder to distinguish from random variation, so detecting a smaller effect generally requires more participants. For the primary outcome, the listed estimates range from 214 to 854 participants per arm for 80% power and from 285 to 1,143 participants per arm for 90% power across those effect assumptions. The exact values depend on which stated fraction is used.

These figures are planning illustrations based on the observed effect, not observed power. They do not indicate the probability that the completed trial produced a statistically significant result, and they do not establish that the original trial was designed around these assumptions. The registry record does not report that original design rationale.

13. How the Sample Size Is Derived

Power is the probability that a study of a given size rejects the null hypothesis when a specific true effect exists. It depends on four things: the effect to detect, the variability of the outcome, the significance level (here a two-sided α of 0.05, so z1−α/2 = 1.960) and the desired power (z1−β = 0.842 for 80% and 1.282 for 90%).

Formula

n = [ z1−α/2 √(2p̄(1−p̄)) + z1−β √(p0(1−p0) + p1(1−p1)) ]2 / (p1 − p0)2

n is the number of participants in each arm, p0 and p1 are the control and treatment proportions, and p̄ is their average.

Worked calculation for this trial

  1. Control proportion p0 = 0.560; treatment proportion p1 = 0.425; average p̄ = 0.492.
  2. First term: z1−α/2 × √[2p̄(1−p̄)] = 1.96 × 0.7070 = 1.3857.
  3. Second term: z1−β × √[p0(1−p0) + p1(1−p1)] = 0.842 × 0.7005 = 0.5896.
  4. n = (1.3857 + 0.5896)2 / (-0.1353)2 = 213.0, rounded up to 214 participants per arm for 80% power.

The smaller-effect rows in the table above repeat the same calculation with the effect multiplied by 0.75 and 0.5 (for ratios, applied to the logarithm of the ratio).

R code

alpha <- 0.05
z_a   <- qnorm(1 - alpha / 2)          # two-sided
p0 <- 0.56                          # control proportion
p1 <- 0.424657534246575                          # treatment proportion
n_per_arm <- function(power, frac = 1) {
  q1 <- p0 + (p1 - p0) * frac               # smaller effect = fraction of the observed difference
  pbar <- (p0 + q1) / 2
  z_b <- qnorm(power)
  ceiling(round((z_a * sqrt(2 * pbar * (1 - pbar)) + z_b * sqrt(p0 * (1 - p0) + q1 * (1 - q1)))^2 / (q1 - p0)^2, 6))
}
for (f in c(1, 0.75, 0.5))
  cat(sprintf("%3.0f%% of observed effect: n per arm = %s (80%% power), %s (90%% power)\n", 100 * f,
              format(n_per_arm(0.80, f), big.mark = ","), format(n_per_arm(0.90, f), big.mark = ",")))

# Check against R's built-in function (unrounded n per arm)
cat("power.prop.test:", round(power.prop.test(p1 = p0, p2 = p1, power = 0.80)$n, 1), "\n")

# Simulation: how often does the z-test reject at the 80%-power sample size?
set.seed(2971683)
n    <- n_per_arm(0.80)
reps <- 20000
x0 <- rbinom(reps, n, p0); x1 <- rbinom(reps, n, p1)
ph <- (x0 + x1) / (2 * n)
z  <- ((x1 - x0) / n) / sqrt(ph * (1 - ph) * 2 / n)
cat(sprintf("Simulated power at n = %s per arm: %.3f (%d replicates)\n", format(n, big.mark = ","), mean(abs(z) > z_a, na.rm = TRUE), reps))

Output from running the code

100% of observed effect: n per arm = 214 (80% power), 285 (90% power)
 75% of observed effect: n per arm = 380 (80% power), 508 (90% power)
 50% of observed effect: n per arm = 854 (80% power), 1,143 (90% power)
power.prop.test: 213 
Simulated power at n = 214 per arm: 0.794 (20000 replicates)

The simulation draws many pairs of event counts at the planned sample size and counts how often the two-proportion z-test rejects the null. It should land close to the target power; at very small required sample sizes it can fall below it, because the normal approximation is rough there.

14. Analyses Reported by the Sponsor

MethodEstimate95% CIP-value
Regression, LogisticOdds Ratio (OR) 1.80.9 to 3.50.083

The registry reports the sponsor’s primary analysis as logistic regression, with an odds ratio of 1.8, a 95% confidence interval from 0.9 to 3.5, and p = 0.083. The posted unadjusted re-calculation is a risk difference of -0.135 for placebo relative to abatacept, with a 95% confidence interval from -0.295 to 0.024 and p = 0.1. The signs and scales differ because the estimates use different contrasts and effect measures.

The odds ratio above 1 points toward greater odds of the primary outcome in the group represented in the registry analysis, while the risk-difference calculation explicitly presents placebo minus abatacept. These estimates should not be treated as direct numerical equivalents. The registry record does not provide sufficient model details to determine whether the reported logistic regression included covariates or other adjustments, so it should not be characterized as adjusted without further information.

The confidence interval for the sponsor-reported odds ratio includes 1, and the interval for the re-calculated risk difference includes zero. Both analyses therefore retain uncertainty around the size and direction of the between-group contrast. The discrepancy flag is false, but the sponsor analysis remains the registry’s reported analysis and the re-calculation is a simple, unadjusted comparison from posted summary statistics. The two results serve different descriptive purposes rather than replacing one another.

15. Multiplicity, Missing Data and Analysis Populations

Multiplicity arises when a trial evaluates multiple outcomes, time points, groups, or statistical comparisons. Even when each analysis uses a conventional significance threshold, examining many results increases the chance that at least one will appear statistically persuasive by chance. Common approaches include adjusting the significance threshold, controlling a family-wise error rate, or defining a hierarchy of outcomes. General statistical principle: the method should be specified in advance and matched to the questions the trial is intended to answer.

The registry lists 14 outcome measures, including the primary endpoint and 13 posted secondary outcomes. It reports one primary analysis and several categories of secondary measures. The multiplicity strategy, if any, is not reported in the registry record. Consequently, the unadjusted secondary p-values should not be interpreted as if each were an isolated confirmatory test. The primary outcome is the clearest single efficacy question in the posted results, but the registry record does not report enough detail to establish the full prespecified testing hierarchy.

Missing-data handling can also affect interpretation. The primary population is described as all treated participants excluding participants with relevant protocol deviations, but the registry record does not report a detailed analysis-population definition, the number of missing Week 24 outcomes, or the method used to handle missing values. It does not report whether sensitivity analyses examined alternative assumptions about missing outcomes. Without these details, it is not possible to assess how much the primary estimate depends on the treatment of incomplete follow-up.

The registry also does not report details of interim analyses, stopping rules, or the original statistical analysis plan. Their presence or absence should not be inferred. These omissions do not invalidate the posted estimates, but they limit assessment of whether the reported analyses fully match the prespecified design and how robust the conclusions are to analytical choices.

16. Safety Results

The registry reports serious adverse events as affected participants divided by participants at risk.

ArmParticipants with serious adverse eventsParticipants at riskPercentage
Abatacept + Standard Treatment2213815.9%
Placebo + Standard Treatment5736.8%
Participants with at least one serious adverse event
Serious adverse events by armAbatacept + Standard Treatment15.9%Placebo + Standard Treatment6.8%% of participants with at least one serious adverse event

Deaths

ArmDeaths (participants affected of at risk)
Abatacept + Standard Treatment0 of 138
Placebo + Standard Treatment1 of 73

Other (non-serious) adverse events

Participants with at least one non-serious event at or above the registry's 5% reporting threshold.

ArmParticipants affected of at risk
Abatacept + Standard Treatment31 of 138
Placebo + Standard Treatment23 of 73

Most frequent serious adverse event terms

Event termOrgan systemAbatacept + Standard TreatmentPlacebo + Standard Treatment
Urinary tract infectionInfections and infestations3 of 1380 of 73
PolymyositisMusculoskeletal and connective tissue disorders2 of 1381 of 73
Large intestine polypGastrointestinal disorders2 of 1380 of 73
CellulitisInfections and infestations2 of 1380 of 73
Herpes zosterInfections and infestations1 of 1381 of 73
Spinal compression fractureInjury, poisoning and procedural complications2 of 1380 of 73
Muscular weaknessMusculoskeletal and connective tissue disorders1 of 1381 of 73
Coronary artery diseaseCardiac disorders1 of 1380 of 73
GlaucomaEye disorders1 of 1380 of 73
Upper gastrointestinal haemorrhageGastrointestinal disorders1 of 1380 of 73

Most frequent non-serious adverse event terms

Event termOrgan systemAbatacept + Standard TreatmentPlacebo + Standard Treatment
NasopharyngitisInfections and infestations9 of 1388 of 73
HeadacheNervous system disorders8 of 1387 of 73
InfluenzaInfections and infestations3 of 1386 of 73
Back painMusculoskeletal and connective tissue disorders7 of 1382 of 73
FallInjury, poisoning and procedural complications4 of 1384 of 73
HypertensionVascular disorders7 of 1381 of 73

Serious events with the highest arm-level rate: urinary tract infection (2.2%), large intestine polyp (1.4%), cellulitis (1.4%), spinal compression fracture (1.4%), polymyositis (1.4%).

Do not overextend the safety comparison. Serious-adverse-event counts are safety observations, not efficacy outcomes, and should not be combined with the primary result into a single benefit-risk number.

The safety record reports serious adverse events for 22 participants at risk in the abatacept plus standard-treatment group, with 138 at risk, and 5 participants at risk in the placebo plus standard-treatment group, with 73 at risk. It also reports other adverse events for 31 participants in the abatacept group and 23 in the placebo group, using the same respective at-risk counts. These are counts, not estimates of comparative risk adjusted for follow-up or other factors.

The registry lists deaths of 0 in the abatacept group and 1 in the placebo group. The listed serious-event terms include urinary tract infection at 2.2%, large intestine polyp at 1.4%, cellulitis at 1.4%, spinal compression fracture at 1.4%, polymyositis at 1.4%, and vomiting at 1.4%. These term-level percentages are reported as listed and should not be interpreted as a complete description of safety.

Safety counts require context about exposure time, event definitions, and whether participants can experience more than one event. The registry record does not provide enough detail to calculate or interpret comparative event rates. These counts describe reported events; they do not by themselves establish that a treatment caused an event or characterize the full benefit-risk balance.

17. What the Result Does, and Does Not, Mean

The registry record describes a randomized comparison of abatacept plus standard treatment against placebo plus standard treatment, with the primary question focused on IMACS-defined improvement without rescue at Week 24. More participants in the abatacept group met the posted primary outcome count than in the placebo group. The unadjusted risk-difference estimate and the sponsor-reported logistic-regression estimate both have confidence intervals that include their respective null values.

Those results do not establish that the treatment strategy improves outcomes, nor do they establish that the strategies are equivalent. A result that is statistically inconclusive can reflect a modest effect, substantial uncertainty, or both. The interval around the risk difference includes a range of possible contrasts, and the registry’s primary counts do not by themselves resolve which underlying effect is most plausible.

The endpoint is a composite rule spanning disease activity and function, and it includes a requirement that improvement occur without rescue medication. It therefore does not represent every clinically relevant outcome or capture all dimensions of an individual participant’s experience. The secondary measures add context but are not uniformly precise, and the registry record does not report a multiplicity strategy for interpreting them together.

The safety counts report serious and other adverse events, but they do not alone show whether events were caused by treatment or permit a complete comparison of risks. The results should be read as the posted statistical evidence for this trial, with attention to the trial population, endpoint definition, uncertainty, and reporting limitations. They do not answer questions beyond the studied comparison and time frame.

18. Why This Trial Matters Statistically

This trial illustrates why a treatment-group count is only the beginning of statistical interpretation. The primary result reports the number of participants meeting a defined improvement criterion, but the between-group estimate and its uncertainty are needed to judge how well the data distinguish a treatment contrast from no contrast. Here, the unadjusted risk-difference interval includes zero, while the sponsor-reported odds-ratio interval includes 1.

It also shows why the scale of an effect matters. A risk difference describes a contrast in outcome probability, while an odds ratio compares odds. They can point in a compatible direction while having different numerical values and interpretations. Clear reporting of the contrast order is essential: the re-calculation is placebo minus abatacept, so its negative estimate corresponds to a lower observed outcome proportion in the placebo group.

The secondary outcomes show another statistical issue: multiple measures can address related but nonidentical aspects of disease and function. A collection of unadjusted results should not be treated as a set of independent confirmations. Prespecified priorities and multiplicity methods help distinguish the primary evidentiary question from exploratory comparisons, but those details are not reported in the registry record.

Finally, planning calculations based on observed effects are not a substitute for the original trial rationale. Their assumptions can illustrate how target effect size and desired power influence sample-size planning, while leaving the actual design decisions unknown. Together, these points make the trial useful for understanding effect scales, uncertainty, multiplicity, and the limits of registry-level reporting.

19. Limitations

The registry record does not report the original sample-size justification, detailed randomization procedures, allocation concealment, or the full statistical analysis plan. It also does not specify which roles were covered by quadruple masking. These omissions limit assessment of design and analysis choices beyond the trial features explicitly recorded.

The primary population is described as treated participants excluding participants with relevant protocol deviations, but detailed handling of protocol deviations and missing outcomes is not reported. The record does not provide the number of missing Week 24 outcomes or sensitivity analyses for missing data. Without that information, the robustness of the reported estimates to incomplete follow-up cannot be assessed from the registry summary alone.

The sponsor analysis is reported as logistic regression, but model covariates and other implementation details are not described. The unadjusted re-calculation uses posted summary statistics and therefore does not reproduce every possible feature of the sponsor’s analysis. Its risk-difference scale is also different from the sponsor’s odds-ratio scale.

The registry reports many outcome measures, but its multiplicity approach and confirmatory status for secondary outcomes are not reported. This limits the strength of conclusions drawn from unadjusted secondary comparisons. In addition, the open-label period follows the 24-week double-blind comparison, so the Week 24 primary result should not be conflated with outcomes from later open-label treatment. The registry-level safety counts likewise lack enough exposure and event-detail information for a full comparative safety assessment.

20. Related Tutorials

21. Related Statistical Calculators

22. Sources

Continue through the Clinical Biostats statistical pathway

Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.

23. Record Summary

The registry record describes a completed, randomized, quadruple-masked, parallel-group Phase 3 trial of abatacept subcutaneous plus standard treatment versus placebo plus standard treatment in adults with active idiopathic inflammatory myopathy. It lists 149 participants enrolled. The double-blind period lasted 24 weeks and was followed by a 28 week open-label period of abatacept plus standard treatment.

The primary endpoint was the number of participants achieving IMACS DOI at Week 24 without rescue. The posted counts were 42 of 75 in the abatacept group and 31 of 73 in the placebo group. The unadjusted risk-difference re-calculation was -0.135 for placebo relative to abatacept, with a 95% confidence interval from -0.295 to 0.024 and p = 0.1. The reported logistic-regression odds ratio was 1.8, with a 95% confidence interval from 0.9 to 3.5 and p = 0.083.

The record includes secondary outcome and safety measures, but important details about multiplicity, missing-data handling, and the original design assumptions are not reported in the registry record.

Clinical Biostats