This page provides an independent statistical analysis and educational interpretation of publicly reported results. ClinicalTrials.gov provides the official trial registry record. Numerical trial results on this page are restricted to the results posted in the ClinicalTrials.gov record; calculations added by Clinical Biostats are labelled as such.
1. Trial at a Glance
This page covers the registry results for Trial to Evaluate the Efficacy and Safety of Abatacept in Combination With Standard Therapy Compared to Standard Therapy Alone in Improving Disease Activity in Adults With Active Idiopathic Inflammatory Myopathy (NCT02971683), a randomized phase 3 study. The primary outcome is Number of Participants Achieving International Myositis Assessment and Clinical Studies Definition of Improvement (IMACS DOI) at Week 24 Without Rescue.
| Feature | Registry value |
|---|---|
| ClinicalTrials.gov identifier | NCT02971683 |
| Phase | Phase 3 |
| Condition | Polymyositis, Dermatomyositis, Autoimmune Necrotizing Myopathy |
| Allocation | Randomized |
| Design model | Parallel |
| Masking | Quadruple |
| Enrollment | 149 |
| Arms in the primary outcome | 2 |
| Lead sponsor | Bristol-Myers Squibb |
| Results posted | Yes |
2. Clinical Question
Population
Adults with active idiopathic inflammatory myopathy, including the listed conditions of polymyositis, dermatomyositis, autoimmune necrotizing myopathy, overlap myositis, and juvenile myositis above the age of 18. The primary outcome population is described as treated participants excluding participants with relevant protocol deviations.
Intervention
Abatacept subcutaneous weekly in addition to each participant’s current standard treatment. The double-blind treatment period lasted 24 weeks, followed by a 28 week open-label period of abatacept plus standard treatment.
Comparator
Placebo of abatacept subcutaneous weekly in addition to each participant’s current standard treatment during the 24-week double-blind period. The arm description specifies abatacept plus standard treatment during the subsequent 28 week open-label period.
Primary question
At Week 24, how many participants in each treatment group achieved the IMACS definition of improvement without rescue medication? The registry reports 42 participants in the abatacept group and 31 in the placebo group. These counts describe the outcome; by themselves, they do not establish how precise or statistically persuasive the between-group difference is.
The primary outcome combines improvement across core measures of myositis activity and function. The registry defines improvement as at least 20% from baseline in 3 IMACS core measures, while limiting worsening in core-measure scores. Rescue medication is part of the endpoint rule: improvement counts only when achieved without rescue.
The question is therefore not simply whether participants’ scores changed, or whether improvement occurred in either arm. It is whether the proportion meeting the specified composite improvement criterion differed between the randomized treatment strategies at Week 24. The posted results give an unadjusted risk-difference re-calculation and a logistic-regression analysis. Those estimates express the comparison on different statistical scales and should be read with their respective uncertainty intervals.
3. Trial Design
The registry describes a randomized, parallel-group Phase 3 trial with quadruple masking. The trial compared abatacept subcutaneous plus standard treatment with placebo plus standard treatment in adults with active idiopathic inflammatory myopathy. The registry lists 149 participants enrolled and a completed status. The start date is 2017-05-04, and the primary completion date is 2020-07-27.
During the double-blind period, participants assigned to the abatacept group received weekly subcutaneous abatacept in addition to their current standard treatment. Participants in the comparison group received weekly placebo of abatacept subcutaneous alongside their current standard treatment. This design aims to keep the groups’ care similar apart from the randomized study treatment during the blinded comparison. The registry identifies masking as quadruple but does not report which specific roles were masked.
The arm descriptions specify a 24-week double-blind period followed by a 28 week open-label period. In the open-label period, both arm descriptions specify abatacept plus standard treatment. The primary endpoint is assessed at Week 24, at the end of the double-blind period, rather than after the open-label period. The primary timeframe is described as from first dose to 24 weeks after first dose, approximately 169 days.
The primary outcome population is defined as all treated participants excluding participants with relevant protocol deviations. The registry record does not report the original sample-size justification, the detailed allocation procedure, or the full analysis plan. It also does not report the precise roles covered by quadruple masking. These details should not be inferred from the trial title or from the posted outcome summaries.
Fourteen outcome measures are recorded, with 13 secondary outcomes posted and 1 analysis reported for the primary endpoint. The secondary outcomes include measures of disability, muscle endurance, extra-muscular disease activity, total improvement, and adverse events. As with the primary result, the interpretation of each outcome depends on its measurement scale, analysis population, and uncertainty.
4. Participant Flow and Accounting
The registry reports how participants moved through each stage of the study. All counts below are exactly as posted; missing counts are not inferred from other stages.
Double-Blind (24 Weeks)
| Stage | Abatacept + Standard Treatment | Placebo + Standard Treatment |
|---|---|---|
| STARTED | 75 | 73 |
| COMPLETED | 69 | 65 |
| NOT COMPLETED | 6 | 8 |
Reasons for not completing this period:
| Reason | Abatacept + Standard Treatment | Placebo + Standard Treatment |
|---|---|---|
| Other reasons | 0 | 1 |
| Poor/Non-Compliance | 0 | 1 |
| Lost to Follow-up | 1 | 0 |
| Participant withdrew consent | 1 | 1 |
| Participant request to discontinue study treatment | 1 | 1 |
| Adverse Event | 0 | 2 |
| Lack of Efficacy | 2 | 2 |
| Participant no longer meets study criteria | 1 | 0 |
Open-Label
| Stage | Abatacept + Standard Treatment | Placebo + Standard Treatment |
|---|---|---|
| STARTED | 69 | 63 |
| COMPLETED | 65 | 61 |
| NOT COMPLETED | 4 | 2 |
Reasons for not completing this period:
| Reason | Abatacept + Standard Treatment | Placebo + Standard Treatment |
|---|---|---|
| Lost to Follow-up | 1 | 0 |
| Participants withdrew consent | 0 | 2 |
| Participant request to discontinue study treatment | 1 | 0 |
| Lack of Efficacy | 2 | 0 |
Long-Term Open Label
| Stage | Abatacept + Standard Treatment | Placebo + Standard Treatment |
|---|---|---|
| STARTED | 25 | 21 |
| COMPLETED | 1 | 0 |
| NOT COMPLETED | 24 | 21 |
Reasons for not completing this period:
| Reason | Abatacept + Standard Treatment | Placebo + Standard Treatment |
|---|---|---|
| Administrative reason by sponsor | 20 | 17 |
| Participant withdrew consent | 1 | 0 |
| Participant request to discontinue study treatment | 1 | 1 |
| Adverse Event | 1 | 2 |
| Lack of Efficacy | 1 | 1 |
Analysis population for the primary outcome, as defined in the registry: All treated participants excluding participants with relevant protocol deviations
5. Baseline Characteristics
The table reproduces the baseline characteristics posted in the registry, which describe the participants analysed at baseline and help show whether the randomized groups were comparable.
| Characteristic | Unit | Abatacept + Standard Treatment | Placebo + Standard Treatment | Total |
|---|---|---|---|---|
| Participants analysed | 75 | 73 | 148 | |
| Age, Continuous | Years | 49.3 (SD 14.41) | 48.1 (SD 14.09) | 48.7 (SD 14.22) |
| Age, Customized: 16-29 years old | Participants | 9 | 9 | 18 |
| Age, Customized: 30-39 years old | Participants | 8 | 14 | 22 |
| Age, Customized: 40-49 years old | Participants | 14 | 14 | 28 |
| Age, Customized: 50-59 years old | Participants | 31 | 19 | 50 |
| Age, Customized: >/= 60 years old | Participants | 13 | 17 | 30 |
| Sex: Female, Male: Female | Participants | 52 | 54 | 106 |
| Sex: Female, Male: Male | Participants | 23 | 19 | 42 |
| Ethnicity (NIH/OMB): Hispanic or Latino | Participants | 7 | 3 | 10 |
| Ethnicity (NIH/OMB): Not Hispanic or Latino | Participants | 19 | 19 | 38 |
| Ethnicity (NIH/OMB): Unknown or Not Reported | Participants | 49 | 51 | 100 |
| Race/Ethnicity, Customized: American Indian or Alaska Native | Participants | 3 | 3 | 6 |
| Race/Ethnicity, Customized: Asian | Participants | 10 | 6 | 16 |
| Race/Ethnicity, Customized: Black or African American | Participants | 9 | 8 | 17 |
| Race/Ethnicity, Customized: White | Participants | 42 | 42 | 84 |
| Race/Ethnicity, Customized: Japanese | Participants | 11 | 10 | 21 |
| Race/Ethnicity, Customized: Other | Participants | 0 | 3 | 3 |
| Race/Ethnicity, Customized: Unknown | Participants | 0 | 1 | 1 |
6. Primary Endpoint
The registry lists the primary outcome as Number of Participants Achieving International Myositis Assessment and Clinical Studies Definition of Improvement (IMACS DOI) at Week 24 Without Rescue, measured over From first dose to 24 weeks after first dose. (Approximately 169 days).
| Element | Registry entry |
|---|---|
| Result type | Count Of Participants |
| Measure of spread | not applicable |
| Unit | Participants |
| Endpoint classification | Binary Endpoint |
The primary endpoint counts participants who achieve the International Myositis Assessment and Clinical Studies definition of improvement, or IMACS DOI, at Week 24 without rescue medication. The registry defines improvement as an improvement of at least 20% from baseline in 3 IMACS core measures, with no more than 2 core-measure scores worsening by at least 25% from baseline. The description repeats the worsening criterion; the registry record does not clarify that repetition.
The core measures named in the record are Physician Global Assessment of Disease Activity, Patient (Subject) Global Assessment of Disease Activity, Manual Muscle Test (MMT-8), Health Assessment Questionnaire-Disability Index, muscle enzyme levels, and the extra-muscular global activity assessment from the Myositis Disease Activity Assessment Tool. A composite definition can capture change across different aspects of disease activity and function rather than relying on a single score. It also makes the improvement rule explicit, including the allowance for some measures to worsen.
The endpoint is a count of participants meeting the full rule, not a mean change in a single scale. The comparison is therefore naturally expressed as a difference in the probability of meeting the criterion. Requiring improvement without rescue distinguishes the endpoint from improvement that occurs after rescue medication. The registry does not report further details about how rescue was defined or handled beyond its inclusion in the endpoint rule.
7. Results Posted in the Registry
- Placebo + Standard Treatment: 42.5% (31/73) versus 56.0% (42/75) on control; risk difference -13.5 percentage points (95% CI -29.5 to 2.4), risk ratio 0.76 (0.54–1.06); unadjusted two-proportion z-test p = 0.100.
Risk difference: Placebo + Standard Treatment
95% CI: -29.5 to 2.4 percentage points
Recalculated from the posted summary statistics
8. Secondary Efficacy Endpoints
The registry also posts results for secondary outcomes. For each outcome below, the endpoint type, the test applied to the posted summary statistics, the result and its interpretation are given in turn. Secondary endpoints are usually not adjusted for multiple testing, so they support rather than confirm the primary finding.
| Secondary outcome | Type | Effect measure | Estimate (95% CI) | Planning size, 80% power |
|---|---|---|---|---|
| Mean Change in Health Assessment Questionnaire-Disability Index (HAQ-DI) From Baseline to Week 24 | Continuous Endpoint | Mean difference | 0.11 (-0.08 to 0.30) | 384 per arm |
| Mean Change in Muscle Endurance Using the Myositis Function Index (FI-2) From Baseline to Week 24 | Continuous Endpoint | Mean difference | -2.90 (-6.66 to 0.86) | 201 per arm |
| Mean Change in Myositis Disease Activity Assessment Tool (MDAAT) Assessment of Extra-muscular From Baseline to Week 24 | Continuous Endpoint | Mean difference | 0.16 (-0.41 to 0.73) | 1,584 per arm |
Mean Change in Health Assessment Questionnaire-Disability Index (HAQ-DI) From Baseline to Week 24
- Endpoint type: Continuous: a mean value per participant, compared as a difference in means.
- Test: Unadjusted two-sample z-test for the difference in means, using the posted standard errors.
- Result:
- Placebo + Standard Treatment: mean -0.20 versus -0.31 on control; difference 0.11 (95% CI -0.08 to 0.30), standardized effect d = 0.20; z-test p = 0.253.
- Interpretation:
- The 95% confidence interval includes no difference, so these data do not show a statistically significant difference between Placebo + Standard Treatment and the control. The interval gives the range of effects that remain compatible with the data.
Mean Change in Muscle Endurance Using the Myositis Function Index (FI-2) From Baseline to Week 24
- Endpoint type: Continuous: a mean value per participant, compared as a difference in means.
- Test: Unadjusted two-sample z-test for the difference in means, using the posted standard errors.
- Result:
- Placebo + Standard Treatment: mean 1.20 versus 4.10 on control; difference -2.90 (95% CI -6.66 to 0.86), standardized effect d = -0.28; z-test p = 0.130.
- Interpretation:
- The 95% confidence interval includes no difference, so these data do not show a statistically significant difference between Placebo + Standard Treatment and the control. The interval gives the range of effects that remain compatible with the data.
Mean Change in Myositis Disease Activity Assessment Tool (MDAAT) Assessment of Extra-muscular From Baseline to Week 24
- Endpoint type: Continuous: a mean value per participant, compared as a difference in means.
- Test: Unadjusted two-sample z-test for the difference in means, using the posted standard errors.
- Result:
- Placebo + Standard Treatment: mean -1.40 versus -1.56 on control; difference 0.16 (95% CI -0.41 to 0.73), standardized effect d = 0.10; z-test p = 0.581.
- Interpretation:
- The 95% confidence interval includes no difference, so these data do not show a statistically significant difference between Placebo + Standard Treatment and the control. The interval gives the range of effects that remain compatible with the data.
The posted secondary outcomes cover disability, muscle endurance, extra-muscular disease activity, total improvement, and safety. The available re-calculations for continuous outcomes have mixed directions across their measurement scales, and each interval spans the no-difference value. That pattern does not provide a consistent, precise secondary signal that independently settles the primary comparison. It is also important not to interpret every change score in the same direction: the measures assess different concepts and use different scales.
The secondary outcomes provide context for the primary IMACS DOI result because they assess related but distinct aspects of function and disease activity. A composite improvement endpoint and individual mean-change measures need not produce identical estimates. The record also lists the Myositis Response Criteria Total Improvement Score and adverse-event outcomes among its secondary measures, but the information summarized for those outcomes does not support adding further numerical comparisons.
Unadjusted secondary results carry less weight when many outcomes are examined. Each additional comparison creates more opportunity for an apparently notable result to arise by chance, unless the analysis plan accounts for multiplicity. The registry record does not report a multiplicity adjustment or a hierarchy specifying which secondary outcomes should be treated as confirmatory. Therefore, secondary estimates are best read as descriptive and exploratory rather than as independent proof of a treatment effect.
The number of secondary outcomes posted is 13, while the record lists 14 outcome measures overall. That breadth makes it especially important to distinguish the prespecified primary question from secondary analyses and to avoid selecting only a favorable-looking result. The full prespecified status and analysis plan for each secondary endpoint are not reported in the registry record.
Secondary outcomes registered for this trial, for reference (only those above were recalculated):
- Mean Change in Health Assessment Questionnaire-Disability Index (HAQ-DI) From Baseline to Week 24
- Mean Change in Muscle Endurance Using the Myositis Function Index (FI-2) From Baseline to Week 24
- Mean Change in Myositis Disease Activity Assessment Tool (MDAAT) Assessment of Extra-muscular From Baseline to Week 24
- Myositis Response Criteria (MRC) Total Improvement Score From Baseline to Week 24
- Number of Participants Experiencing Adverse Events (AE) in the Double-Blind Period
- Number of Participants Experiencing Serious Adverse Events (SAE) in the Double-Blind Period
- Number of Participants Experiencing Adverse Events (AE) of Special Interest in the Double-Blind Period
- Number of Participants Experiencing Laboratory Test Abnormalities in the Double-Blind Period
9. Statistical Interpretation
The posted primary counts are 42 participants achieving IMACS DOI without rescue in the abatacept plus standard-treatment group and 31 in the placebo plus standard-treatment group. The corresponding arm sizes in the primary results are 75 and 73. The unadjusted re-calculation expresses the comparison as a risk difference of -0.135 for placebo relative to abatacept, with a 95% confidence interval from -0.295 to 0.024 and p = 0.1. The negative sign reflects the stated comparison order: placebo minus abatacept.
The confidence interval includes zero, the value representing no risk difference. Thus, the re-calculated estimate is compatible with a range extending from a difference favoring the abatacept group to a small difference in the other direction. The interval is broad enough that the point estimate alone should not be treated as a precise description of the underlying contrast. The unadjusted p-value is not below 0.05, but a p-value is not a measure of the probability that either treatment strategy is effective or ineffective.
The registry also reports a logistic-regression odds ratio of 1.8, with a 95% confidence interval from 0.9 to 3.5 and p = 0.083. That analysis uses odds, whereas the re-calculation uses a risk difference. The reported odds ratio is above 1, but its confidence interval includes 1, the null value for an odds ratio. These results do not provide clear statistical separation from their respective null values. The two estimates are not numerically interchangeable because they use different scales.
The secondary continuous-outcome re-calculations also have confidence intervals that include zero: HAQ-DI mean difference 0.11, with an interval from -0.079 to 0.298; FI-2 mean difference -2.9, with an interval from -6.656 to 0.856; and MDAAT extra-muscular mean difference 0.16, with an interval from -0.408 to 0.728. Their directions and scales differ, so their signs should not be read as a common measure of benefit. These unadjusted comparisons are exploratory in the context of multiple outcomes.
Overall, the registry reports more primary-endpoint participants in the abatacept arm than in the placebo arm, while the interval-based comparisons remain uncertain. The results support describing the observed counts and estimates, not making a definitive claim about a treatment effect. The registry record does not report enough information about missing data, multiplicity handling, or the full prespecified analysis plan to resolve those sources of uncertainty.
10. Statistical Methods Explained
Randomization assigns participants to treatment groups so that, in expectation, prognostic characteristics are not systematically allocated to one group. It supports a between-group comparison, but it does not guarantee that the groups are identical in a particular trial. The registry describes randomized allocation and a parallel-group design. The record does not report the detailed randomization method or allocation-concealment procedure.
What does the primary contrast measure?
The primary endpoint is binary at the participant level: each treated participant either meets the IMACS DOI rule without rescue at Week 24 or does not. A risk is the proportion of participants meeting that outcome in a group. The risk difference subtracts one group’s risk from the other’s. The posted unadjusted re-calculation uses placebo minus abatacept, giving -0.135. A negative value in this ordering means the observed outcome proportion was lower in the placebo group. The estimate is an unadjusted summary, not a model-based causal estimate adjusted for participant characteristics.
The primary results list 42 of 75 participants in the abatacept group and 31 of 73 in the placebo group. The posted risk estimates are 0.56 and 0.425, respectively. The re-calculated risk difference is accompanied by a confidence interval and an unadjusted p-value. The registry’s own logistic-regression analysis instead reports an odds ratio. Odds compare the chance of an event with the chance of no event; an odds ratio contrasts those odds between groups. A risk difference and odds ratio describe different quantities, so their numerical values cannot be compared as if they were the same effect measure.
What does a confidence interval add?
A confidence interval describes the statistical uncertainty around an estimate under the assumptions of the method used. It identifies values that are reasonably compatible with the observed data and model. For the risk difference, zero represents no difference. For an odds ratio, 1 represents equal odds. An interval containing the relevant null value indicates that the data do not clearly distinguish the estimate from that null value at the corresponding confidence level. It does not establish that the true effect is exactly null, and it does not give the probability that a particular treatment effect is true.
A p-value measures how unusual results at least as incompatible with the null hypothesis would be, assuming that hypothesis and the statistical model. It is not the probability that the null hypothesis is true. The primary re-calculation reports p = 0.1, while the registry’s logistic-regression analysis reports p = 0.083. Those values arise from different analysis scales and may also reflect different analysis procedures. The registry record does not report enough detail to reconstruct the sponsor’s model or determine every reason for the numerical difference.
How should continuous outcomes be read?
The secondary HAQ-DI, FI-2, and MDAAT outcomes are reported as mean changes from baseline, with standard errors. A mean summarizes the average observed change, while a standard error describes the estimated sampling uncertainty around that mean. The re-calculated comparisons are mean differences between groups. A confidence interval for a mean difference that crosses zero is compatible with differences in either direction. Interpretation of direction depends on the outcome’s scale and scoring meaning; a negative change is not automatically better or worse across all measures.
The registry lists HAQ-DI changes of -0.31 and -0.2, FI-2 changes of 4.1 and 1.2, and MDAAT changes of -1.56 and -1.4 for abatacept and placebo, respectively. The associated standard errors and re-calculated intervals are posted. Standard errors are not standard deviations: they describe precision of an estimated mean rather than the spread of individual participant values. The registry does not post sponsor-reported analyses for these three outcomes in the record summarized.
Why do planning calculations use assumptions?
The sample-size planning illustrations use two-sided significance level 0.05, equal allocation, and a normal approximation. They calculate participants per arm for stated fractions of the observed effect. The assumed effect is not a guaranteed future treatment effect. Smaller target effects require more participants to detect under otherwise similar assumptions. These calculations are planning illustrations, not evidence about the trial’s achieved power. The original trial design assumptions and sample-size justification are not reported in the registry record.
For count outcomes, over-dispersion can matter when a count varies more than a simple statistical model expects. General statistical principle: if such extra variation is present and not accommodated, uncertainty can be understated. The primary endpoint is analyzed as a participant-level binary outcome rather than a rate of recurrent events, so that count-model issue is not the main interpretation of its risk difference. The registry record does not report an over-dispersion assessment or enough detail to infer one.
11. Confidence Intervals and Precision
Precision concerns how narrowly the data constrain an estimate. The primary unadjusted risk difference is -0.135, with a 95% confidence interval from -0.295 to 0.024. That interval includes zero, so the posted summary is compatible with no risk difference as well as differences in either direction. Its breadth also means the point estimate should not be treated as a sharply determined effect size.
The registry’s logistic-regression estimate is an odds ratio of 1.8, with a 95% confidence interval from 0.9 to 3.5. The interval includes 1, the null value for an odds ratio. The re-calculated risk-difference interval and the sponsor-reported odds-ratio interval answer related but distinct questions, and their bounds should not be directly compared numerically.
The continuous secondary comparisons also have intervals spanning zero: -0.079 to 0.298 for HAQ-DI, -6.656 to 0.856 for FI-2, and -0.408 to 0.728 for MDAAT extra-muscular assessment. These intervals indicate uncertainty about the direction and size of each unadjusted mean difference. Their interpretation also depends on the outcome scale, which differs across measures.
Confidence intervals reflect sampling uncertainty under the analysis assumptions; they do not account automatically for every limitation, such as missing observations, protocol deviations, or selective reporting. The registry record does not report enough detail to assess all such influences. The endpoint counts, arm sizes, and intervals should therefore be considered together rather than relying only on the point estimate or p-value.
12. Planning a Similar Trial: Sample Size
This is a planning illustration, not a re-evaluation of the original trial. It asks: if a new study wanted to detect a difference like the one observed, or a smaller one, how large would it need to be? It is deliberately not “observed power” of the finished trial, which is not a meaningful quantity.
| Effect to detect | Participants per arm, 80% power | Participants per arm, 90% power |
|---|---|---|
| 100% of the observed effect | 214 | 285 |
| 75% of the observed effect | 380 | 508 |
| 50% of the observed effect | 854 | 1,143 |
The planning illustrations are expressed as participants per arm for the binary primary outcome and the continuous outcomes in the posted results. They are not totals across treatment groups. The sample-size assumptions are a two-sided significance level of 0.05, equal allocation between the two arms, and a normal approximation. Each planning scenario uses a stated fraction of the observed effect as the effect to detect. The original trial’s own design assumptions and sample-size justification are not reported in the registry record.
The 80% power column gives the number of participants per arm estimated to be needed, under those assumptions, for an 80% chance of detecting the specified effect if that effect is the true one. The 90% power column gives the corresponding planning estimate for a 90% chance. Higher target power generally requires a larger planned sample under otherwise similar assumptions. The values are not guarantees that a future study will reach a particular result.
Rows for 100% of the observed effect, 75% of the observed effect, and 50% of the observed effect illustrate how the target effect changes the planning estimate. A smaller effect is harder to distinguish from random variation, so detecting a smaller effect generally requires more participants. For the primary outcome, the listed estimates range from 214 to 854 participants per arm for 80% power and from 285 to 1,143 participants per arm for 90% power across those effect assumptions. The exact values depend on which stated fraction is used.
These figures are planning illustrations based on the observed effect, not observed power. They do not indicate the probability that the completed trial produced a statistically significant result, and they do not establish that the original trial was designed around these assumptions. The registry record does not report that original design rationale.
13. How the Sample Size Is Derived
Power is the probability that a study of a given size rejects the null hypothesis when a specific true effect exists. It depends on four things: the effect to detect, the variability of the outcome, the significance level (here a two-sided α of 0.05, so z1−α/2 = 1.960) and the desired power (z1−β = 0.842 for 80% and 1.282 for 90%).
Formula
n is the number of participants in each arm, p0 and p1 are the control and treatment proportions, and p̄ is their average.
Worked calculation for this trial
- Control proportion p0 = 0.560; treatment proportion p1 = 0.425; average p̄ = 0.492.
- First term: z1−α/2 × √[2p̄(1−p̄)] = 1.96 × 0.7070 = 1.3857.
- Second term: z1−β × √[p0(1−p0) + p1(1−p1)] = 0.842 × 0.7005 = 0.5896.
- n = (1.3857 + 0.5896)2 / (-0.1353)2 = 213.0, rounded up to 214 participants per arm for 80% power.
The smaller-effect rows in the table above repeat the same calculation with the effect multiplied by 0.75 and 0.5 (for ratios, applied to the logarithm of the ratio).
R code
alpha <- 0.05
z_a <- qnorm(1 - alpha / 2) # two-sided
p0 <- 0.56 # control proportion
p1 <- 0.424657534246575 # treatment proportion
n_per_arm <- function(power, frac = 1) {
q1 <- p0 + (p1 - p0) * frac # smaller effect = fraction of the observed difference
pbar <- (p0 + q1) / 2
z_b <- qnorm(power)
ceiling(round((z_a * sqrt(2 * pbar * (1 - pbar)) + z_b * sqrt(p0 * (1 - p0) + q1 * (1 - q1)))^2 / (q1 - p0)^2, 6))
}
for (f in c(1, 0.75, 0.5))
cat(sprintf("%3.0f%% of observed effect: n per arm = %s (80%% power), %s (90%% power)\n", 100 * f,
format(n_per_arm(0.80, f), big.mark = ","), format(n_per_arm(0.90, f), big.mark = ",")))
# Check against R's built-in function (unrounded n per arm)
cat("power.prop.test:", round(power.prop.test(p1 = p0, p2 = p1, power = 0.80)$n, 1), "\n")
# Simulation: how often does the z-test reject at the 80%-power sample size?
set.seed(2971683)
n <- n_per_arm(0.80)
reps <- 20000
x0 <- rbinom(reps, n, p0); x1 <- rbinom(reps, n, p1)
ph <- (x0 + x1) / (2 * n)
z <- ((x1 - x0) / n) / sqrt(ph * (1 - ph) * 2 / n)
cat(sprintf("Simulated power at n = %s per arm: %.3f (%d replicates)\n", format(n, big.mark = ","), mean(abs(z) > z_a, na.rm = TRUE), reps))
Output from running the code
100% of observed effect: n per arm = 214 (80% power), 285 (90% power)
75% of observed effect: n per arm = 380 (80% power), 508 (90% power)
50% of observed effect: n per arm = 854 (80% power), 1,143 (90% power)
power.prop.test: 213
Simulated power at n = 214 per arm: 0.794 (20000 replicates)
The simulation draws many pairs of event counts at the planned sample size and counts how often the two-proportion z-test rejects the null. It should land close to the target power; at very small required sample sizes it can fall below it, because the normal approximation is rough there.
14. Analyses Reported by the Sponsor
| Method | Estimate | 95% CI | P-value |
|---|---|---|---|
| Regression, Logistic | Odds Ratio (OR) 1.8 | 0.9 to 3.5 | 0.083 |
The registry reports the sponsor’s primary analysis as logistic regression, with an odds ratio of 1.8, a 95% confidence interval from 0.9 to 3.5, and p = 0.083. The posted unadjusted re-calculation is a risk difference of -0.135 for placebo relative to abatacept, with a 95% confidence interval from -0.295 to 0.024 and p = 0.1. The signs and scales differ because the estimates use different contrasts and effect measures.
The odds ratio above 1 points toward greater odds of the primary outcome in the group represented in the registry analysis, while the risk-difference calculation explicitly presents placebo minus abatacept. These estimates should not be treated as direct numerical equivalents. The registry record does not provide sufficient model details to determine whether the reported logistic regression included covariates or other adjustments, so it should not be characterized as adjusted without further information.
The confidence interval for the sponsor-reported odds ratio includes 1, and the interval for the re-calculated risk difference includes zero. Both analyses therefore retain uncertainty around the size and direction of the between-group contrast. The discrepancy flag is false, but the sponsor analysis remains the registry’s reported analysis and the re-calculation is a simple, unadjusted comparison from posted summary statistics. The two results serve different descriptive purposes rather than replacing one another.
15. Multiplicity, Missing Data and Analysis Populations
Multiplicity arises when a trial evaluates multiple outcomes, time points, groups, or statistical comparisons. Even when each analysis uses a conventional significance threshold, examining many results increases the chance that at least one will appear statistically persuasive by chance. Common approaches include adjusting the significance threshold, controlling a family-wise error rate, or defining a hierarchy of outcomes. General statistical principle: the method should be specified in advance and matched to the questions the trial is intended to answer.
The registry lists 14 outcome measures, including the primary endpoint and 13 posted secondary outcomes. It reports one primary analysis and several categories of secondary measures. The multiplicity strategy, if any, is not reported in the registry record. Consequently, the unadjusted secondary p-values should not be interpreted as if each were an isolated confirmatory test. The primary outcome is the clearest single efficacy question in the posted results, but the registry record does not report enough detail to establish the full prespecified testing hierarchy.
Missing-data handling can also affect interpretation. The primary population is described as all treated participants excluding participants with relevant protocol deviations, but the registry record does not report a detailed analysis-population definition, the number of missing Week 24 outcomes, or the method used to handle missing values. It does not report whether sensitivity analyses examined alternative assumptions about missing outcomes. Without these details, it is not possible to assess how much the primary estimate depends on the treatment of incomplete follow-up.
The registry also does not report details of interim analyses, stopping rules, or the original statistical analysis plan. Their presence or absence should not be inferred. These omissions do not invalidate the posted estimates, but they limit assessment of whether the reported analyses fully match the prespecified design and how robust the conclusions are to analytical choices.
16. Safety Results
The registry reports serious adverse events as affected participants divided by participants at risk.
| Arm | Participants with serious adverse events | Participants at risk | Percentage |
|---|---|---|---|
| Abatacept + Standard Treatment | 22 | 138 | 15.9% |
| Placebo + Standard Treatment | 5 | 73 | 6.8% |
Deaths
| Arm | Deaths (participants affected of at risk) |
|---|---|
| Abatacept + Standard Treatment | 0 of 138 |
| Placebo + Standard Treatment | 1 of 73 |
Other (non-serious) adverse events
Participants with at least one non-serious event at or above the registry's 5% reporting threshold.
| Arm | Participants affected of at risk |
|---|---|
| Abatacept + Standard Treatment | 31 of 138 |
| Placebo + Standard Treatment | 23 of 73 |
Most frequent serious adverse event terms
| Event term | Organ system | Abatacept + Standard Treatment | Placebo + Standard Treatment |
|---|---|---|---|
| Urinary tract infection | Infections and infestations | 3 of 138 | 0 of 73 |
| Polymyositis | Musculoskeletal and connective tissue disorders | 2 of 138 | 1 of 73 |
| Large intestine polyp | Gastrointestinal disorders | 2 of 138 | 0 of 73 |
| Cellulitis | Infections and infestations | 2 of 138 | 0 of 73 |
| Herpes zoster | Infections and infestations | 1 of 138 | 1 of 73 |
| Spinal compression fracture | Injury, poisoning and procedural complications | 2 of 138 | 0 of 73 |
| Muscular weakness | Musculoskeletal and connective tissue disorders | 1 of 138 | 1 of 73 |
| Coronary artery disease | Cardiac disorders | 1 of 138 | 0 of 73 |
| Glaucoma | Eye disorders | 1 of 138 | 0 of 73 |
| Upper gastrointestinal haemorrhage | Gastrointestinal disorders | 1 of 138 | 0 of 73 |
Most frequent non-serious adverse event terms
| Event term | Organ system | Abatacept + Standard Treatment | Placebo + Standard Treatment |
|---|---|---|---|
| Nasopharyngitis | Infections and infestations | 9 of 138 | 8 of 73 |
| Headache | Nervous system disorders | 8 of 138 | 7 of 73 |
| Influenza | Infections and infestations | 3 of 138 | 6 of 73 |
| Back pain | Musculoskeletal and connective tissue disorders | 7 of 138 | 2 of 73 |
| Fall | Injury, poisoning and procedural complications | 4 of 138 | 4 of 73 |
| Hypertension | Vascular disorders | 7 of 138 | 1 of 73 |
Serious events with the highest arm-level rate: urinary tract infection (2.2%), large intestine polyp (1.4%), cellulitis (1.4%), spinal compression fracture (1.4%), polymyositis (1.4%).
The safety record reports serious adverse events for 22 participants at risk in the abatacept plus standard-treatment group, with 138 at risk, and 5 participants at risk in the placebo plus standard-treatment group, with 73 at risk. It also reports other adverse events for 31 participants in the abatacept group and 23 in the placebo group, using the same respective at-risk counts. These are counts, not estimates of comparative risk adjusted for follow-up or other factors.
The registry lists deaths of 0 in the abatacept group and 1 in the placebo group. The listed serious-event terms include urinary tract infection at 2.2%, large intestine polyp at 1.4%, cellulitis at 1.4%, spinal compression fracture at 1.4%, polymyositis at 1.4%, and vomiting at 1.4%. These term-level percentages are reported as listed and should not be interpreted as a complete description of safety.
Safety counts require context about exposure time, event definitions, and whether participants can experience more than one event. The registry record does not provide enough detail to calculate or interpret comparative event rates. These counts describe reported events; they do not by themselves establish that a treatment caused an event or characterize the full benefit-risk balance.
17. What the Result Does, and Does Not, Mean
The registry record describes a randomized comparison of abatacept plus standard treatment against placebo plus standard treatment, with the primary question focused on IMACS-defined improvement without rescue at Week 24. More participants in the abatacept group met the posted primary outcome count than in the placebo group. The unadjusted risk-difference estimate and the sponsor-reported logistic-regression estimate both have confidence intervals that include their respective null values.
Those results do not establish that the treatment strategy improves outcomes, nor do they establish that the strategies are equivalent. A result that is statistically inconclusive can reflect a modest effect, substantial uncertainty, or both. The interval around the risk difference includes a range of possible contrasts, and the registry’s primary counts do not by themselves resolve which underlying effect is most plausible.
The endpoint is a composite rule spanning disease activity and function, and it includes a requirement that improvement occur without rescue medication. It therefore does not represent every clinically relevant outcome or capture all dimensions of an individual participant’s experience. The secondary measures add context but are not uniformly precise, and the registry record does not report a multiplicity strategy for interpreting them together.
The safety counts report serious and other adverse events, but they do not alone show whether events were caused by treatment or permit a complete comparison of risks. The results should be read as the posted statistical evidence for this trial, with attention to the trial population, endpoint definition, uncertainty, and reporting limitations. They do not answer questions beyond the studied comparison and time frame.
18. Why This Trial Matters Statistically
This trial illustrates why a treatment-group count is only the beginning of statistical interpretation. The primary result reports the number of participants meeting a defined improvement criterion, but the between-group estimate and its uncertainty are needed to judge how well the data distinguish a treatment contrast from no contrast. Here, the unadjusted risk-difference interval includes zero, while the sponsor-reported odds-ratio interval includes 1.
It also shows why the scale of an effect matters. A risk difference describes a contrast in outcome probability, while an odds ratio compares odds. They can point in a compatible direction while having different numerical values and interpretations. Clear reporting of the contrast order is essential: the re-calculation is placebo minus abatacept, so its negative estimate corresponds to a lower observed outcome proportion in the placebo group.
The secondary outcomes show another statistical issue: multiple measures can address related but nonidentical aspects of disease and function. A collection of unadjusted results should not be treated as a set of independent confirmations. Prespecified priorities and multiplicity methods help distinguish the primary evidentiary question from exploratory comparisons, but those details are not reported in the registry record.
Finally, planning calculations based on observed effects are not a substitute for the original trial rationale. Their assumptions can illustrate how target effect size and desired power influence sample-size planning, while leaving the actual design decisions unknown. Together, these points make the trial useful for understanding effect scales, uncertainty, multiplicity, and the limits of registry-level reporting.
19. Limitations
- The posted summary statistics are the only data these results rest on; patient-level data, full protocols and statistical analysis plans are not available.
- Recalculated results are simple, unadjusted calculations from posted summaries. They do not replace the sponsor's prespecified analysis.
The registry record does not report the original sample-size justification, detailed randomization procedures, allocation concealment, or the full statistical analysis plan. It also does not specify which roles were covered by quadruple masking. These omissions limit assessment of design and analysis choices beyond the trial features explicitly recorded.
The primary population is described as treated participants excluding participants with relevant protocol deviations, but detailed handling of protocol deviations and missing outcomes is not reported. The record does not provide the number of missing Week 24 outcomes or sensitivity analyses for missing data. Without that information, the robustness of the reported estimates to incomplete follow-up cannot be assessed from the registry summary alone.
The sponsor analysis is reported as logistic regression, but model covariates and other implementation details are not described. The unadjusted re-calculation uses posted summary statistics and therefore does not reproduce every possible feature of the sponsor’s analysis. Its risk-difference scale is also different from the sponsor’s odds-ratio scale.
The registry reports many outcome measures, but its multiplicity approach and confirmatory status for secondary outcomes are not reported. This limits the strength of conclusions drawn from unadjusted secondary comparisons. In addition, the open-label period follows the 24-week double-blind comparison, so the Week 24 primary result should not be conflated with outcomes from later open-label treatment. The registry-level safety counts likewise lack enough exposure and event-detail information for a full comparative safety assessment.
20. Related Tutorials
21. Related Statistical Calculators
22. Sources
- ClinicalTrials.gov: Trial to Evaluate the Efficacy and Safety of Abatacept in Combination With Standard Therapy Compared to Standard Therapy Alone in Improving Disease Activity in Adults With Active Idiopathic Inflammatory Myopathy — NCT02971683.
- Registry record last updated 2023-10-30; status last verified 2023-10.
- Results first posted 2021-09-17.
- Data retrieved from ClinicalTrials.gov on 2026-11-09.
- Group sizes, means, event counts and sponsor-reported p-values are reproduced as posted. Effect estimates, confidence intervals and p-values not attributed to the sponsor are independently calculated from the posted summary statistics.
Continue through the Clinical Biostats statistical pathway
Use this trial's endpoint as a starting point for deeper study of effect measures, confidence intervals, and sample-size planning.
23. Record Summary
The registry record describes a completed, randomized, quadruple-masked, parallel-group Phase 3 trial of abatacept subcutaneous plus standard treatment versus placebo plus standard treatment in adults with active idiopathic inflammatory myopathy. It lists 149 participants enrolled. The double-blind period lasted 24 weeks and was followed by a 28 week open-label period of abatacept plus standard treatment.
The primary endpoint was the number of participants achieving IMACS DOI at Week 24 without rescue. The posted counts were 42 of 75 in the abatacept group and 31 of 73 in the placebo group. The unadjusted risk-difference re-calculation was -0.135 for placebo relative to abatacept, with a 95% confidence interval from -0.295 to 0.024 and p = 0.1. The reported logistic-regression odds ratio was 1.8, with a 95% confidence interval from 0.9 to 3.5 and p = 0.083.
The record includes secondary outcome and safety measures, but important details about multiplicity, missing-data handling, and the original design assumptions are not reported in the registry record.