Tutorials › Adaptive Clinical Trial Design › Promising-Zone Sample Size Adaptation

Sample Size Re-Estimation · Tutorial 323 of 799

Promising-Zone Sample Size Adaptation

You will calculate conditional-power boundaries, determine when an interim result falls in the promising zone, and apply a prespecified target and cap to the sample-size update.

Advanced 10 min read

What You'll Learn

  • Define a promising zone using lower and upper conditional-power thresholds.
  • Calculate interim conditional power under a prespecified effect assumption.
  • Distinguish the zone boundaries from the target conditional power used for re-estimation.
  • Find a permitted sample-size increase that meets a target without exceeding the maximum.
  • Interpret what to do when the target cannot be reached within the cap.
  • Recognize assumptions, diagnostics, and common errors in promising-zone rules.

Why a Promising Zone Uses Conditional Power

An interim result can be neither clearly discouraging nor already sufficiently encouraging. A promising-zone rule formalizes this middle ground: it specifies a range of interim conditional-power values within which the trial may increase its planned sample size. The boundaries and the maximum increase are set before the interim data are examined. They are not chosen afterward to make a particular result look favorable.

Conditional power is calculated relative to a specified effect assumption. It answers a conditional planning question: if the interim data are as observed and the assumed effect governs the remaining data, what is the probability of crossing the final efficacy boundary? A promising-zone rule uses this quantity to decide whether, and by how much, to increase the planned information. It does not make conditional power a probability that the treatment works.

Definition: A promising zone is a prespecified interval of interim conditional-power values, commonly written \([L,U]\), where \(L\) is the lower boundary and \(U\) is the upper boundary. If the interim conditional power falls within this interval, a prespecified sample-size rule may increase the planned total. The rule also specifies the effect assumption used for conditional power, a target conditional power, the permitted increments, and a maximum total sample size.

The rule distinguishes three quantities that should not be conflated. The lower and upper boundaries decide whether the interim result is in the zone. The target conditional power determines the desired degree of assurance after an increase. The maximum sample size restricts how far the trial can grow. A trial may be in the zone but unable to reach its target before the cap.

Model and Conditional-Power Calculation

For a transparent derivation, consider a one-sided normal test at significance level \(\alpha=0.025\), with final critical value \(c=1.96\). Let \(I_1\) be the interim information, \(I\) the proposed total information, and \(Z_1=z_1\) the interim standardized statistic. Assume \(I>I_1\). Under a fixed assumed treatment effect \(\theta\), represent the accumulated score at information \(I\) as \(S(I)\), with independent increments such that the future score increment over \(\Delta I=I-I_1\) is normally distributed with mean \(\theta\Delta I\) and variance \(\Delta I\). The interim score is \(S(I_1)=z_1\sqrt{I_1}\). This normal-increments model is appropriate, for example, for a normal endpoint with known variance and a fixed analysis plan.

Under these assumptions, the final score is the observed interim score plus the future increment, and the final statistic is that score divided by \(\sqrt I\). Conditional power is the probability that the final statistic exceeds \(c\), given the interim result and the assumed effect:

$$ CP(I\mid z_1,\theta) = P\left( \frac{S(I_1)+[S(I)-S(I_1)]}{\sqrt I}>c \;\middle|\; Z_1=z_1,\theta \right) = \Phi\left( \frac{z_1\sqrt{I_1}+\theta(I-I_1)-c\sqrt I} {\sqrt{I-I_1}} \right). $$

Here \(\Phi\) is the standard normal cumulative distribution function. The denominator is the standard deviation of the future score increment, not the standard deviation of the final statistic. Equivalently, conditional on the interim result, the final statistic has mean \(\{z_1\sqrt{I_1}+\theta(I-I_1)\}/\sqrt I\) and standard deviation \(\sqrt{(I-I_1)/I}\). Subtracting the critical value and dividing by that conditional standard deviation gives the same formula.

Assumptions for this calculation: The interim information and statistic are correctly specified; future score increments are independent of the observed interim score and follow the stated normal model; the effect \(\theta\) used for the calculation is fixed in advance; and the proposed total information exceeds the information already observed. If information is proportional to sample size under the planned allocation and analysis, an information increase translates directly into a sample-size increase.

The equation follows directly from the normal distribution of the future increment. Given the interim score \(z_1\sqrt{I_1}\), reaching the final boundary requires the future increment to exceed \(c\sqrt I-z_1\sqrt{I_1}\). Standardizing that increment gives:

$$ P\{S(I)-S(I_1)>c\sqrt I-z_1\sqrt{I_1}\} = 1-\Phi\left( \frac{c\sqrt I-z_1\sqrt{I_1}-\theta(I-I_1)} {\sqrt{I-I_1}} \right) = \Phi\left( \frac{z_1\sqrt{I_1}+\theta(I-I_1)-c\sqrt I} {\sqrt{I-I_1}} \right). $$

This conditional probability depends on the assumed effect as well as the observed interim statistic. A promising-zone policy therefore must state which effect assumption defines its boundaries. In the examples below, the assumed effect is \(\theta=0.20\). The numerical information units are illustrative; when information is proportional to total sample size, the proportional conversion is stated explicitly.

Worked Examples of Zone Classification and Adaptation

Worked Example: Classifying Interim Results

Suppose \(I_1=100\), the planned total information is \(I=200\), and the interim statistic is \(z_1=1.20\). Use the assumed effect \(\theta=0.20\), the one-sided critical value \(c=1.96\), and a promising zone from \(L=0.20\) to \(U=0.80\). Calculate conditional power and classify the result.

Substitute the values into the conditional-power formula. The interim score is \(1.20\sqrt{100}=12\), the assumed mean of the future score is \(0.20(200-100)=20\), and the boundary on the score scale is \(1.96\sqrt{200}\approx27.719\):

$$ CP(200\mid 1.20,0.20) = \Phi\left( \frac{12+20-1.96\sqrt{200}}{\sqrt{100}} \right) = \Phi\left( \frac{12+20-27.7185858}{10} \right) = \Phi(0.4281) \approx 0.6659. $$

Since \(0.20\leq0.6659\leq0.80\), this interim result is in the promising zone. That classification alone does not determine the new sample size; the target conditional power, permitted increments, and cap are also needed.

For comparison, if the same planned design had \(z_1=-0.20\), the calculation would be:

$$ CP(200\mid -0.20,0.20) = \Phi\left( \frac{-2+20-27.7185858}{10} \right) = \Phi(-0.9719) \approx 0.1656. $$

This value is below \(L=0.20\), so it is outside the promising zone. The calculation does not itself prescribe stopping; any futility decision must be specified separately.

Worked Example: Choosing the Smallest Permitted Increase That Meets a Target

Use \(I_1=100\), \(z_1=1.20\), and \(\theta=0.20\). Suppose the original total is \(I_0=200\), the target conditional power is 0.80, permitted totals are multiples of 10 information units, and the maximum is \(I_{\max}=250\). The interim conditional power at the original total is 0.6659, so it lies in the zone \([0.20,0.80]\). Find the permitted total that first reaches the target, if one exists.

Evaluate candidate totals in order. At \(I=240\), the remaining information is 140, and:

$$ CP(240\mid 1.20,0.20) = \Phi\left( \frac{12+0.20(140)-1.96\sqrt{240}}{\sqrt{140}} \right) = \Phi\left( \frac{40-30.3641894}{11.8321596} \right) = \Phi(0.8144) \approx 0.7923. $$

This is below 0.80. At \(I=250\), the remaining information is 150:

$$ CP(250\mid 1.20,0.20) = \Phi\left( \frac{12+0.20(150)-1.96\sqrt{250}}{\sqrt{150}} \right) = \Phi\left( \frac{42-30.9903211}{12.2474487} \right) = \Phi(0.8989) \approx 0.8155. $$

Thus the smallest permitted total that meets the 0.80 target is \(I=250\). If the original total of 200 information units corresponds to 400 participants and information is proportional to sample size, the revised total is \(400(250/200)=500\) participants. This is a total, not an additional 500 participants; the increase over the original plan is 100 participants.

Worked Example: Applying a Cap When the Target Is Unreachable

Suppose \(I_1=100\), \(z_1=0.50\), \(\theta=0.20\), and the planned total is \(I_0=200\). Let the zone be \([0.20,0.80]\), the target be 0.80, and the maximum total be \(I_{\max}=300\). First verify the zone classification, then determine what the rule does at the cap.

At the original total:

$$ CP(200\mid 0.50,0.20) = \Phi\left( \frac{5+20-1.96\sqrt{200}}{10} \right) = \Phi(-0.2719) \approx 0.3929. $$

Because \(0.20\leq0.3929\leq0.80\), the result is in the zone. At the maximum total \(I=300\), the remaining information is 200:

$$ CP(300\mid 0.50,0.20) = \Phi\left( \frac{5+0.20(200)-1.96\sqrt{300}}{\sqrt{200}} \right) = \Phi\left( \frac{45-33.948196}{14.1421356} \right) = \Phi(0.7811) \approx 0.7827. $$

The cap is reached, but conditional power remains below the 0.80 target. Under the stated rule, the total is therefore set to the maximum, \(I=300\), and the achieved conditional power is reported as approximately 0.7827. It would be incorrect to report that the target was met. If \(I=200\) corresponds to 400 participants, the capped total corresponds to \(400(300/200)=600\) participants.

Writing the Rule Before the Interim

A reproducible promising-zone rule needs more than two boundaries. Its protocol or statistical analysis plan should specify the conditional-power effect assumption, the interim analysis and its information, \(L\) and \(U\), the target power, the permitted sample-size totals or increments, and the maximum total. It should also say what happens below the zone, above the zone, and when no permitted total up to the cap reaches the target.

One possible policy is to leave the original total unchanged outside the zone. Within the zone, it selects the smallest permitted total that reaches the target, or the maximum if none does. This is only one policy; other prespecified actions are possible. For example, a separate futility rule could apply below the zone. The boundaries and actions should be treated as a single decision rule, not improvised separately after the interim result is known.

1
Calculate interim conditional power.
Use the specified interim statistic, information, critical value, and effect assumption.
2
Classify the result.
Compare the calculated value with the prespecified lower and upper boundaries.
3
Apply the adaptation policy.
If in the zone, evaluate permitted totals against the target and stop the search at the prespecified maximum.
4
Document the outcome.
Record the selected total, whether the target was reached, and the assumptions used in the calculation.

Diagnostics, Alternatives, and Limitations

Several checks help identify a faulty calculation or an unsuitable rule. Confirm that \(I>I_1\); at \(I=I_1\), there is no future information and the formula is undefined. Check that the observed statistic, information, assumed effect, and final critical value all come from the planned analysis. Recompute conditional power at the original total before evaluating increases, and inspect the full permitted grid rather than assuming an increase will meet the target. Because the formula can depend nonlinearly on \(I\), do not assume that an unverified interpolation or a rounded intermediate value identifies the first qualifying total.

Conditional power is also sensitive to the effect assumption. A rule using a larger assumed effect can produce higher conditional power and a different sample-size decision than a rule using a smaller, clinically relevant effect. This is why the assumed effect is part of the prespecified rule. An effect assumption is not a claim that the effect is known, and conditional power is not the unconditional probability that the trial will succeed.

A fixed-sample design avoids a sample-size decision based on interim conditional power, but it cannot respond to an interim result that is promising yet short of the desired target. Other re-estimation approaches can use nuisance-parameter estimates to update information requirements rather than using an unblinded treatment-effect statistic to define a promising zone. Each approach answers a different design question and has its own assumptions and error-control considerations. A conditional-power calculation by itself does not establish that the final adaptive test controls type I error; that property must be evaluated for the complete design and analysis procedure.

Common Pitfalls

  • Using the observed interim effect as if it were the future effect assumption. The observed statistic is already represented by \(z_1\); the future score in this calculation uses the prespecified \(\theta\). Substituting an unplanned effect assumption changes the rule.
  • Calling conditional power the probability that the null hypothesis is false. It is a probability of crossing the final boundary conditional on the interim data and a specified model assumption. It is not a probability about whether a hypothesis is true.
  • Confusing zone boundaries with the target. A result can be in the zone without reaching the target at the maximum. State both the classification and the achieved power after adaptation.
  • Ignoring the cap or reporting an unattainable target as achieved. If no permitted total reaches the target, apply the prespecified capped action and report the shortfall accurately.
Key takeaway: A promising-zone adaptation is a prespecified mapping from interim conditional power to a permitted total sample size. Its interpretation depends on the assumed effect, its boundaries, its target, and its cap; none can be replaced by an informal judgment after the interim result is observed.

Check Your Understanding

Answer each question, then compare with the solutions.

  1. With \(I_1=100\), \(z_1=0.50\), \(\theta=0.20\), and \(I=200\), what is the conditional power to four significant figures?
  2. If the promising zone is \([0.20,0.80]\), is the result in Question 1 in the zone? Does that classification alone specify a new sample size?
  3. In a rule with a target conditional power of 0.80 and a cap of \(I=300\), what should be reported if the conditional power at the cap is 0.7827?
  4. Why must a promising-zone rule state the assumed effect used to calculate conditional power?

Solutions. (1) Substitution gives \(\Phi((5+20-1.96\sqrt{200})/10)=\Phi(-0.2719)\approx0.3929\). (2) Yes: \(0.20\leq0.3929\leq0.80\). No: the target, permitted increases, maximum, and actions outside the zone are also needed. (3) Report that the cap was used and that the target was not reached; the achieved conditional power is approximately 0.7827. (4) The assumed effect determines the distribution assigned to future score increments, so changing it changes conditional power and can change both zone classification and the resulting sample-size decision.

Clinical Biostats