Tutorials › Group Sequential Methods and Sample Size Re-Estimation › Sample-Size Updates For Risk-Difference Trials

Blinded Re-Estimation · Tutorial 376 of 699

Sample-Size Updates For Risk-Difference Trials

Learn how a blinded pooled event rate and a prespecified risk difference determine an updated sample size, and how to check the calculation's assumptions and limitations.

Intermediate 11 min read

What You'll Learn

  • Reconstruct the two arm-specific event rates from a blinded pooled rate and the planned absolute risk difference.
  • Derive the normal-approximation sample-size formula for an equal-allocation risk-difference test.
  • Recalculate the target enrollment using a blinded interim event rate.
  • Distinguish the null variance from the alternative variance used in the calculation.
  • Check whether estimated rates and the normal approximation are plausible for the design.
  • Recognize why a plug-in update does not guarantee exact power or preserve every operating characteristic.

Why Update a Risk-Difference Design?

For a binary outcome, the sample size needed to detect a specified risk difference depends on the event rates in both arms. Before enrollment, those rates are often uncertain. A blinded internal-pilot update can use the overall event rate observed so far to revise the enrollment target without using treatment labels. The absolute effect used for planning remains prespecified: the pooled rate informs the nuisance-rate estimate, while the planned effect determines how that rate is apportioned between arms.

This tutorial considers a two-arm, individually randomized trial with equal allocation and a binary endpoint. The outcome is recorded for every participant, and participants' outcomes are independent. The calculation is a normal approximation for a two-sided comparison of risks. It is a planning method, not a substitute for checking the design's operating characteristics.

Definition: Let \(p_C\) and \(p_T\) be the event probabilities in the control and treatment arms. Define the planned risk difference as \(\delta=p_C-p_T\), with \(\delta>0\) when the planned treatment risk is lower. For equal allocation, the pooled event rate is \(q=(p_C+p_T)/2\). A blinded estimate \(\hat q\) is the number of observed events divided by the total number of participants with observed outcomes, without separating events by assigned arm.

The update assumes that the planned risk difference is still a suitable design effect and that the interim pooled rate is informative about the event-rate level in the trial. For a given pooled rate \(q\) and planned difference \(\delta\), the implied arm risks are

$$ p_C=q+\frac{\delta}{2}, \qquad p_T=q-\frac{\delta}{2}. $$

Both implied risks must lie between zero and one. If they do not, the pooled rate and planned difference are incompatible; the calculation cannot be used as written. The blinded pooled rate is not itself an estimate of either arm's risk.

Sample-Size Formula and Its Justification

Suppose the trial tests \(H_0:p_C=p_T\) against a two-sided alternative at significance level \(\alpha\), and is planned to have power \(1-\beta\) for the risk difference \(\delta\). With \(n\) participants per arm, the usual large-sample test has a null standard error based on the common risk. At the planning value \(q\), the null variance of the difference in sample proportions is approximately \(2q(1-q)/n\). Under the alternative, its variance is approximately \(\{p_C(1-p_C)+p_T(1-p_T)\}/n\).

A normal-approximation design chooses \(n\) so that the planned difference is large enough to exceed the two-sided critical value under the null and the desired normal quantile under the alternative. This gives the commonly used formula below. Here \(z_a\) is the \(a\) quantile of the standard normal distribution.

$$ n \approx \frac{ \left[ z_{1-\alpha/2}\sqrt{2q(1-q)} + z_{1-\beta}\sqrt{p_C(1-p_C)+p_T(1-p_T)} \right]^2 }{\delta^2}. $$

For the blinded update, substitute \(\hat q\) for \(q\), then reconstruct the arm risks using the prespecified \(\delta\). The first variance term is the null variance; the second is the alternative variance. Keeping these roles distinct matters: using the same variance in both terms is a different approximation.

The variance relationship also explains why simply treating the pooled rate as though both arms had that rate under the alternative is not quite right. Substituting \(q+\delta/2\) and \(q-\delta/2\) gives

$$ p_C(1-p_C)+p_T(1-p_T) =2q(1-q)-\frac{\delta^2}{2}. $$

Thus the pooled-rate null variance coefficient \(2q(1-q)\) exceeds the alternative variance coefficient by \(\delta^2/2\). The formula uses the former for the null critical threshold and the latter for power under the planned alternative.

Because \(n\) is a number per arm, round it up to a whole participant per arm. With equal allocation, the total target is twice that rounded number. If participants already enrolled in the internal pilot are included in the final analysis and meet the trial's outcome requirements, the update revises the total target rather than adding the full target again.

Worked Example: Planning From a Blinded Rate

Suppose a hypothetical equal-allocation trial plans a two-sided test with \(\alpha=0.05\), 80% power, and a treatment risk 0.10 lower than the control risk. The blinded planning rate is \(q=0.30\). Find the target enrollment.

The planned difference is \(\delta=0.10\), so the implied risks are \(p_C=0.30+0.05=0.35\) and \(p_T=0.30-0.05=0.25\). Both are valid probabilities. The assumptions for the formula are independent binary outcomes, equal allocation, and the stated normal-approximation design.

Using \(z_{0.975}=1.960\) and \(z_{0.80}=0.8416\), the null variance coefficient is \(2(0.30)(0.70)=0.4200\), and the alternative coefficient is \((0.35)(0.65)+(0.25)(0.75)=0.4150\). Therefore,

$$ n \approx \frac{\left[1.960\sqrt{0.4200}+0.8416\sqrt{0.4150}\right]^2}{0.10^2} = \frac{(1.2702+0.5422)^2}{0.0100} \approx 328.5. $$

Rounding up gives 329 participants per arm, or 658 in total. This is the approximate target for the stated risks, effect, significance level, and power; it is not a guarantee that the realized trial will attain exactly 80% power.

Recalculating Enrollment at an Interim Point

At an interim point, the blinded event rate is calculated across both arms. For example, with equal allocation and complete binary outcomes, 52 events among 160 participants gives \(\hat q=52/160\). The same prespecified effect, \(\alpha\), and target power are then used to obtain a revised total sample size. The observed pooled rate changes the estimated nuisance event rate; it does not reveal which arm had the higher risk.

An internal-pilot update should be specified before the interim data are examined. That plan should state the event-rate calculation, the assumed effect, the sample-size formula, and how the interim participants count toward the final target. The update is a blinded nuisance-parameter calculation, not an interim comparison of treatment groups.

Worked Example: Updating From 160 Participants

In a hypothetical equal-allocation trial, 160 participants have completed the binary outcome assessment and 52 events have been observed across both masked groups. The design prespecifies a risk difference of 0.10, two-sided \(\alpha=0.05\), and 80% power. Recalculate the target.

The blinded rate is \(\hat q=52/160=0.3250\). The implied risks are \(p_C=0.3250+0.0500=0.3750\) and \(p_T=0.3250-0.0500=0.2750\), both within the probability range. The null variance coefficient is \(2(0.3250)(0.6750)=0.43875\). The alternative coefficient is \((0.3750)(0.6250)+(0.2750)(0.7250)=0.43375\).

$$ n \approx \frac{\left[1.960\sqrt{0.43875}+0.8416\sqrt{0.43375}\right]^2}{0.10^2} = \frac{(1.2983+0.5543)^2}{0.0100} \approx 343.2. $$

The revised target is 344 participants per arm, 688 total. If the 160 participants already enrolled are included in the final analysis, 528 further participants are needed to reach that total, subject to the prespecified enrollment and outcome rules. The update does not mean that the observed 52 events determine an arm-specific rate: the arm-specific values above are reconstructed from the pooled rate and the planned effect.

Diagnostics, Alternatives, and Limitations

A blinded update is most useful when uncertainty in the event-rate level is an important source of uncertainty in the original sample-size calculation. It cannot establish that the planned effect is correct. Nor does a single pooled rate show whether treatment groups differ in risk. The following checks help identify when the calculation needs careful review:

  • Check the implied risks. Confirm that \(\hat q+\delta/2\) and \(\hat q-\delta/2\) are both between zero and one. Invalid values indicate incompatible inputs, not a reason to silently truncate a risk.
  • Check the interim information. A pooled rate based on few participants or few events can be imprecise. Consider whether the interim sample is large enough to provide a useful nuisance-rate estimate, and examine how reasonable changes in \(\hat q\) would affect the target.
  • Check the design assumptions. Unequal allocation, clustering, repeated outcomes, missing outcomes, or dependence between participants can invalidate this equal-allocation, independent-outcome formula unless separately accounted for.
  • Check whether the approximation is adequate. When event rates are near zero or one, or expected event counts are small, a normal approximation may be poor. A more suitable design calculation may be needed; do not treat this formula as reliable merely because it returns a number.

The main alternative is to retain the original fixed sample size, which avoids changing enrollment in response to an interim nuisance estimate but may leave the study under- or over-sized if the event rate differs from planning assumptions. A blinded pooled-rate update can adapt the target to the observed overall rate while keeping the effect assumption fixed. A calculation that uses the pooled rate as the alternative risk in both arms is simpler, but it fails to represent the prespecified difference in the alternative variance. An unblinded recalculation uses arm-specific information and raises different design and operating-characteristic questions; it is not the procedure derived here.

Finally, plugging in an estimated rate does not automatically establish exact power or preserve every error-rate property of an adaptive trial. The formula is an approximate conditional planning calculation. Its suitability depends on the update rule, timing, endpoint availability, and analysis plan. The update should therefore be prespecified and evaluated as part of the full design, rather than improvised after seeing interim results.

Worked Example: Checking a Low Pooled Rate

A hypothetical trial has a blinded pooled rate of \(\hat q=0.12\) and a prespecified risk difference of \(\delta=0.06\), with treatment risk planned to be lower. The target is two-sided \(\alpha=0.05\) and 80% power. First check the implied risks, then calculate the approximate target.

The implied values are \(p_C=0.12+0.03=0.15\) and \(p_T=0.12-0.03=0.09\), so neither is outside the probability range. The null coefficient is \(2(0.12)(0.88)=0.2112\), and the alternative coefficient is \((0.15)(0.85)+(0.09)(0.91)=0.2094\). Thus,

$$ n \approx \frac{\left[1.960\sqrt{0.2112}+0.8416\sqrt{0.2094}\right]^2}{0.06^2} = \frac{(0.9007+0.3851)^2}{0.0036} \approx 459.3. $$

The normal-approximation target is 460 participants per arm, or 920 total. The rate and difference are mathematically compatible, but this check alone does not establish that the approximation is adequate: the expected event counts and the planned analysis should also be reviewed, particularly for a low event rate.

Key takeaway: For an equal-allocation blinded risk-difference update, use the pooled event rate to reconstruct arm risks around that pooled value, then calculate the null and alternative variance terms separately. Round the per-arm target up, count eligible internal-pilot participants once, and treat the result as an approximation whose assumptions and operating characteristics require review.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. A blinded rate is 0.40 and the planned risk difference is 0.10, with lower risk in treatment. What arm risks are implied?
  2. Why does the sample-size formula use different variance terms for the null and the planned alternative?
  3. A trial has 200 participants with outcomes and 70 events. What is the blinded pooled rate? If \(\delta=0.08\), are the reconstructed risks valid?
  4. What does a revised target of 300 participants per arm imply if 90 eligible participants per arm have already enrolled?

Solutions. (1) \(p_C=0.40+0.05=0.45\) and \(p_T=0.40-0.05=0.35\); both are valid probabilities. (2) Under the null, the variance uses the common risk, giving coefficient \(2q(1-q)\); under the alternative, it uses the two planned arm risks, giving coefficient \(p_C(1-p_C)+p_T(1-p_T)\). (3) \(\hat q=70/200=0.35\); the implied risks are \(0.35+0.04=0.39\) and \(0.35-0.04=0.31\), both valid. (4) The target remains 300 per arm, so 210 additional participants per arm are needed if those 90 per arm count toward the final target.

Clinical Biostats