Tutorials › Adaptive Clinical Trial Design › Binary Outcome Re-Estimation With Unequal Allocation

Sample Size Re-Estimation · Tutorial 335 of 799

Binary Outcome Re-Estimation With Unequal Allocation

Learn how to convert a pooled interim event rate into an unequal-allocation sample-size target, then inflate that target for anticipated attrition.

Advanced 12 min read

What You'll Learn

  • Calculate the variance of a two-arm risk-difference estimator under unequal allocation.
  • Reconstruct arm-specific rates from a pooled rate and a prespecified target difference.
  • Derive the normal-approximation sample size for a two-sided test.
  • Convert evaluable sample-size targets into randomized enrollment targets with equal or differential attrition.
  • Identify when the pooled-rate approximation or normal approximation may be unreliable.
  • Distinguish a blinded nuisance-rate update from an unblinded effect-based update.

Why allocation and pooled rates matter

For a binary endpoint, the variance of a difference in event rates depends on both event probabilities and the number assigned to each arm. When allocation is unequal, applying an equal-allocation formula can produce the wrong target sample size. A blinded interim review adds another issue: the pooled event rate does not reveal either arm’s rate separately. A defensible update must state how that pooled rate is used, which effect is assumed, and how attrition is handled.

This tutorial considers a two-arm superiority design with a binary outcome observed for each participant. Let \(p_C\) be the event probability in the control arm and \(p_T\) the event probability in the treatment arm. Define the target risk difference as \(\Delta=p_T-p_C\), with its sign oriented so that the anticipated treatment effect is positive. Let \(r=n_T/n_C\) be the planned treatment-to-control allocation ratio. The sample-size target is first calculated for participants with an observed endpoint; anticipated attrition is applied afterward.

Definition: The blinded pooled event rate is the total number of observed events across both arms divided by the total number of participants with observed outcomes. If the interim arm sizes are \(m_C\) and \(m_T\), and their event counts are \(x_C\) and \(x_T\), then \(\hat q=(x_C+x_T)/(m_C+m_T)\). It estimates the allocation-weighted event probability in the pooled interim sample; it is not, in general, an estimate of either arm’s event probability.

Variance and sample-size calculation

For independent participants with observed binary outcomes, the estimated risk difference is \(\hat p_T-\hat p_C\). Under the alternative rates used for planning, its variance is approximately \(p_T(1-p_T)/n_T+p_C(1-p_C)/n_C\). This uses the binomial variance \(p(1-p)\) for each arm and independence between arms. With \(n_T=rn_C\), the variance becomes \(A(r)/n_C\), where \(A(r)=p_C(1-p_C)+p_T(1-p_T)/r\).

The pooled interim rate supplies one nuisance-rate estimate, but a target difference is also needed to assign rates to the arms. Suppose the interim allocation ratio is \(r_0=m_T/m_C\), and the design uses the prespecified difference \(\Delta\) to reconstruct planning rates. The pooled rate estimates the weighted average \(q=(p_C+r_0p_T)/(1+r_0)\). Combining this with \(p_T-p_C=\Delta\) yields the rates below. The interim ratio is used for the reconstruction; the planned final ratio is used in the final variance.

$$ p_C=q-\frac{r_0\Delta}{1+r_0}, \qquad p_T=q+\frac{\Delta}{1+r_0}, \qquad A(r)=p_C(1-p_C)+\frac{p_T(1-p_T)}{r}. $$

The reconstructed rates must lie between zero and one. If they do not, the pooled rate and assumed difference are incompatible with this reconstruction. The design should have a prespecified response, such as examining plausible alternative assumptions or applying a justified constrained method; silently replacing an invalid rate by zero or one changes the method.

Planning result: For a two-sided test at significance level \(\alpha\), the usual normal-approximation target is \(n_C \approx (z_{1-\alpha/2}+z_{1-\beta})^2 A(r)/\Delta^2\), with \(n_T=rn_C\). Here \(1-\beta\) is the target power and \(z_u\) is the \(u\) quantile of the standard normal distribution. Round arm sizes upward while respecting the allocation plan. This approximation uses the variance under the planning alternative and approximates power by setting the standardized mean difference to \(z_{1-\alpha/2}+z_{1-\beta}\).

A short justification makes the role of unequal allocation explicit. Under the alternative, the estimated difference has mean \(\Delta\) and approximate standard deviation \(\sqrt{A(r)/n_C}\), so its standardized mean is \(\Delta\sqrt{n_C/A(r)}\). For a two-sided normal test, the critical value is \(z_{1-\alpha/2}\). The common planning approximation sets the standardized mean to the critical value plus \(z_{1-\beta}\), giving the stated expression after squaring. It is a planning approximation, not an exact identity for power: exact normal-approximation power also includes the probability in the opposite tail.

Worked Example: Reconstructing Rates and Updating the Target

Suppose the blinded interim event rate is \(0.40\), interim and planned allocation both use \(r_0=r=1.5\), and the prespecified target difference is \(\Delta=0.12\). Find the approximate evaluable sample size for a two-sided test with \(\alpha=0.05\) and 90% power. These are hypothetical design values.

The reconstructed planning rates are \(p_C=0.40-(1.5)(0.12)/(2.5)=0.328\) and \(p_T=0.40+0.12/2.5=0.448\). Both are valid probabilities, and their weighted average is \((0.328+1.5(0.448))/2.5=0.400\), as required.

The variance coefficient per control participant is \(A(1.5)=0.328(0.672)+0.448(0.552)/1.5=0.220416+0.164864=0.385280\). Using \(z_{0.975}=1.960\) and \(z_{0.90}=1.2816\), \(n_C\approx(1.960+1.2816)^2(0.385280)/(0.12)^2=281.1\). Thus, rounding the control target up to 282 gives a treatment target of \(1.5(282)=423\), for 705 evaluable participants in total. The result is an approximate target under the specified rates and normal approximation, not a guarantee of 90% power in every possible data-generating scenario.

From evaluable outcomes to randomized enrollment

The preceding calculation targets participants whose endpoint is observed. If a proportion \(a\) is expected to have no usable endpoint, the approximate randomized target is the evaluable target divided by \(1-a\). With unequal or arm-specific attrition, each arm must have enough randomized participants to meet its evaluable target, while also respecting the planned allocation. Attrition assumptions concern endpoint availability; they do not alter the event-rate variance formula for participants whose outcomes are observed.

Worked Example: Allowing for Differential Attrition

Use the targets from the previous example: 282 evaluable control participants and 423 evaluable treatment participants, with a planned 3:2 treatment-to-control ratio. Suppose anticipated attrition is 8% in control and 12% in treatment. Find the smallest enrollment that preserves the exact 3:2 ratio.

If \(N_C\) is the randomized control count, the treatment count is \(1.5N_C\). The control requirement is \(0.92N_C\ge282\), or \(N_C\ge282/0.92=306.52\). The treatment requirement is \(0.88(1.5N_C)\ge423\), or \(N_C\ge423/1.32=320.45\). The treatment requirement is more restrictive.

An exact 3:2 ratio requires \(N_C\) to be a multiple of 2. The smallest such value at least 320.45 is \(N_C=322\), giving \(N_T=483\) and total enrollment of 805. The expected evaluable counts are \(322(0.92)=296.24\) and \(483(0.88)=425.04\), both above their targets. Expected counts need not be integers; actual endpoint counts will vary.

When a sample-size update is made after enrollment begins, the calculated target is ordinarily the desired final total, not an additional number to recruit on top of everyone already randomized. Enrollment planning must therefore account for participants already randomized and any participants whose outcomes are already observed. The protocol should specify the rounding rule, the minimum and maximum sample sizes, and how accrued participants count toward the final target.

Blinded updating, assumptions, and diagnostics

This procedure uses the pooled interim rate as a nuisance-rate input while keeping treatment assignments concealed. It does not estimate the treatment effect from the interim data: the assumed \(\Delta\) remains the design target. The reconstruction also assumes the pooled rate corresponds to the interim allocation weighting and that the target difference is a useful planning assumption for separating the two rates. If the interim allocation differs from the planned final allocation, use the actual interim weighting to reconstruct rates and the planned final ratio in \(A(r)\).

The calculation relies on independent participant outcomes, a well-defined binary endpoint, accurate event and denominator counts, and a normal approximation adequate for the planned test. It also presumes that attrition can be represented by the anticipated arm-specific fractions and that the target difference, significance level, allocation ratio, and power were specified appropriately. If event probabilities are near zero or one, or the arm sizes and expected event counts are small, the normal approximation can be poor; a method based on exact binomial power or simulation may be preferable.

Several checks help identify a failing update. Verify that pooled counts use participants with observed outcomes, not all randomized participants if some have missing endpoints. Confirm the actual interim allocation ratio and the planned final ratio separately. Check that both reconstructed rates are in \([0,1]\), that the variance coefficient is positive, and that the rounded enrollment meets both arm targets after attrition. Finally, compare the updated target with the prespecified floor and cap. An unexpectedly large change can indicate a changed event rate, an incompatible target difference, or a data-handling error; it should not be accepted without investigation.

Worked Example: A Blinded Interim Update

In a hypothetical trial, 500 participants have observed outcomes: 200 in control and 300 in treatment, with 180 total events. The allocation ratio is 1.5. Use a blinded pooled rate, target difference \(\Delta=0.10\), \(\alpha=0.05\), and 80% power to calculate the approximate evaluable target.

The pooled rate is \(\hat q=180/500=0.360\). With \(r_0=1.5\), the planning rates are \(p_C=0.360-(1.5)(0.10)/2.5=0.300\) and \(p_T=0.360+0.10/2.5=0.400\). Their weighted average is \((0.300+1.5(0.400))/2.5=0.360\).

For the planned ratio \(r=1.5\), \(A(r)=0.300(0.700)+0.400(0.600)/1.5=0.210+0.160=0.370\). Since \(z_{0.975}=1.960\) and \(z_{0.80}=0.8416\), \(n_C\approx(1.960+0.8416)^2(0.370)/(0.10)^2=290.4\). A nearby integer allocation meeting the target is 291 control and 437 treatment participants, total 728. The interim 500 participants are part of that final total, not an additional 500. This update uses only the pooled event count and the prespecified effect assumption; it does not estimate the treatment effect from the concealed interim data.

Alternatives and common pitfalls

A simple blinded approximation sets both planning rates equal to the pooled rate. That can be convenient, but it ignores the assumed difference when calculating the alternative variance. The reconstruction used here retains the target difference while using the pooled rate to estimate the weighted average. Neither variance approximation is guaranteed to be conservative: their relative size depends on the pooled rate, target difference, and allocation ratio.

An unblinded approach could use separate interim arm rates to estimate the alternative variance directly. It uses more information about the observed treatment difference, but that difference may be highly variable at an interim analysis and can lead to unstable or biased sample-size changes. A fixed nuisance-rate update avoids basing the target directly on the interim effect estimate, but still depends on its pooled-rate and target-effect assumptions. Exact power calculations or simulation are alternatives when normal approximations are questionable. Any adaptive update should be prespecified, and the final inferential procedure must support the intended type I error control; a blinded update alone does not guarantee it.

Common mistake: “There were fewer events than expected, so I can plug the pooled rate into the equal-allocation formula and multiply the total by an attrition factor.” This reasoning can be wrong twice: unequal allocation changes the variance, and a pooled rate is not generally the rate in each arm. Instead, reconstruct planning rates using the pooled allocation-weighted rate and the prespecified target difference, calculate the variance at the planned ratio, then inflate arm-specific evaluable targets for anticipated attrition.

Key takeaway: A transparent binary-outcome update separates three decisions: estimate the pooled nuisance rate, translate it into planning rates using an explicit target difference, and convert the resulting evaluable sample sizes into enrollment targets under the allocation and attrition plan.

Check Your Understanding

Answer each question, then check the short solutions below.

  1. With \(r=2\), which arm’s variance contribution is divided by 2 in the variance coefficient \(A(r)\), and why?
  2. If \(\hat q=0.30\), \(r_0=1\), and the assumed difference is \(\Delta=0.10\), what planning rates follow from the reconstruction?
  3. A planned evaluable target is 400 participants and anticipated attrition is 20% in both arms. How many randomized participants are needed in total if allocation is equal?
  4. Why is it not generally correct to treat a blinded pooled event rate as the event probability in both arms?

Solutions. 1. The treatment contribution \(p_T(1-p_T)\) is divided by 2 because \(n_T=2n_C\), so its variance contribution per control participant is half as large. 2. \(p_C=0.30-0.10/2=0.25\) and \(p_T=0.30+0.10/2=0.35\); their equal-weight average is 0.30. 3. The target is \(400/(1-0.20)=500\) randomized participants, or 250 per arm. 4. The pooled rate is a weighted average of the arm rates, with weights determined by the allocation; it does not identify both rates separately when they differ.

Clinical Biostats