Tutorials › Group Sequential Methods and Sample Size Re-Estimation › Choosing the Interim Information Fraction

Unblinded Re-Estimation and the Promising Zone · Tutorial 410 of 699

Choosing the Interim Information Fraction

Learn to compare interim information fractions using estimate precision, decision probabilities, expected sample size, and operational limits.

Advanced 11 min read

What You'll Learn

  • Define an interim information fraction and relate it to sample size under a simple normal model.
  • Quantify how estimate standard errors and confidence-interval widths change with interim timing.
  • Calculate the probability of a sample-size increase and the resulting expected final sample size.
  • Distinguish the statistical range of revised sample sizes from recruitment and calendar constraints.
  • Identify why a later interim look does not always make a particular adaptation decision more or less likely.
  • Recognise diagnostics and design limitations when selecting an interim time.

Why the Interim Time Matters

A sample-size re-estimation rule acts on information available at an interim analysis. If that analysis occurs early, the effect estimate is usually imprecise, so small changes in the observed data can change whether the rule recommends an increase. A later analysis usually gives a more precise estimate, but leaves less time to recruit participants and complete follow-up. Choosing the interim time therefore involves both statistical and operational considerations.

The key quantity is the interim information fraction. It measures how much information has accrued at the interim analysis relative to the information planned at the original final analysis. In a simple model where every observation contributes the same amount of information, this fraction is the interim sample size divided by the originally planned final sample size. In other designs, such as event-driven studies or settings with unequal information per participant, the information fraction need not equal the fraction of participants enrolled.

Definition: Let \(I_1\) be the information available at the interim analysis and \(I_0\) the information planned for the original final analysis. The interim information fraction is \(t=I_1/I_0\), with \(0<t<1\). Under equal information per participant, \(t=n_1/N_0\), where \(n_1\) is the interim sample size and \(N_0\) is the originally planned final sample size.

To isolate the effect of timing, suppose observations follow a normal model \(X_i\sim N(\theta,\sigma^2)\), with independent observations, a common known variance \(\sigma^2\), and a stable outcome measurement process. The interim estimate is \(\hat{\theta}_1=\bar{x}_1\), and its standard error is \(SE(\hat{\theta}_1)=\sigma/\sqrt{n_1}\). These assumptions make the precision comparison transparent; in a real design, the appropriate information measure and variance model must match the endpoint and allocation.

Precision Changes With the Information Fraction

If \(n_1=tN_0\), the standard error at the interim analysis is

$$ SE(\hat{\theta}_1)=\frac{\sigma}{\sqrt{tN_0}} =\frac{SE(\hat{\theta}_0)}{\sqrt{t}}, \qquad SE(\hat{\theta}_0)=\frac{\sigma}{\sqrt{N_0}}. $$

Thus, relative to the standard error at the planned final sample size, an interim estimate has standard error \(1/\sqrt{t}\) times as large. Precision does not increase linearly with sample size: quadrupling the information halves the standard error. Under the normal model, a two-sided 95% interval for \(\theta\) at the interim has the form \(\hat{\theta}_1\pm1.96SE(\hat{\theta}_1)\). Its width contracts as information accrues, although the estimate's realized value can move in either direction.

Worked Example: Comparing Interim Estimate Precision

Suppose a hypothetical normal-endpoint study plans \(N_0=200\) observations and has a known outcome standard deviation of \(\sigma=20\) units. Compare interim analyses at \(t=0.25\) and \(t=0.75\). The model assumptions are independent observations with the stated common standard deviation and equal information per observation.

At \(t=0.25\), \(n_1=0.25(200)=50\). The interim standard error is

$$ SE_{0.25}=\frac{20}{\sqrt{50}}=2.828\text{ units}. $$

At \(t=0.75\), \(n_1=0.75(200)=150\), so

$$ SE_{0.75}=\frac{20}{\sqrt{150}}=1.633\text{ units}. $$

The later estimate's standard error is \(1.633/2.828=0.5774\) times as large, consistent with \(\sqrt{50/150}=0.5774\). The corresponding 95% interval half-widths are \(1.96(2.828)=5.543\) units and \(1.96(1.633)=3.201\) units. The later interim estimate is more precise under this model, but neither interval guarantees that the observed estimate is close to the true effect.

Timing Changes the Chance of Triggering an Increase

Precision matters because a re-estimation rule is applied to an observed interim result. Consider a deliberately simple rule that increases the planned final sample size from \(N_0\) to \(N_{\max}\) when the estimate falls in a specified region \(A\). If the true effect is \(\theta\), then under the normal model

$$ P(\text{increase})=P(\hat{\theta}_1\in A\mid\theta). $$

This probability depends on both the information fraction and the location of the region relative to the true effect. A more precise estimate concentrates more tightly around \(\theta\); it does not, by itself, imply that an increase becomes more or less likely. For a real promising-zone rule, \(A\) may be defined through a conditional-power or effect-estimate criterion. The earlier material on conditional power and promising-zone rules supplies those decision constructs; here the focus is how their operating probabilities can change with timing.

For a binary rule that either retains \(N_0\) or increases to \(N_{\max}\), expected final sample size follows directly by weighting the two possible final sizes by their probabilities:

$$ E(N_{\mathrm{final}}\mid\theta) =N_0P(\text{no increase}\mid\theta) +N_{\max}P(\text{increase}\mid\theta) =N_0+(N_{\max}-N_0)P(\text{increase}\mid\theta). $$

Worked Example: Expected Sample Size at Two Interim Times

Continue with the hypothetical model \(\sigma=20\), \(N_0=200\), and compare \(t=0.25\) with \(t=0.75\). Suppose the true effect is \(\theta=0\) units, and, solely to illustrate the timing calculation, the rule increases the final target to \(N_{\max}=280\) if \(-1<\hat{\theta}_1<1\) unit. The increase is 80 observations. The rule is a teaching example, not a recommended clinical decision rule.

At \(t=0.25\), the standard error is \(20/\sqrt{50}=2.828\). Under \(\theta=0\), the standardized boundaries are \(-1/2.828=-0.3536\) and \(1/2.828=0.3536\). Therefore,

$$ P(\text{increase}\mid\theta=0,t=0.25) =\Phi(0.3536)-\Phi(-0.3536) \approx 0.2763. $$

The expected final sample size is

$$ E(N_{\mathrm{final}}\mid\theta=0,t=0.25) =200+80(0.2763)=222.1\text{ observations}. $$

At \(t=0.75\), the standard error is \(20/\sqrt{150}=1.633\), giving standardized boundaries \(-0.6124\) and \(0.6124\). Thus,

$$ P(\text{increase}\mid\theta=0,t=0.75) =\Phi(0.6124)-\Phi(-0.6124) \approx 0.4597, $$

and

$$ E(N_{\mathrm{final}}\mid\theta=0,t=0.75) =200+80(0.4597)=236.8\text{ observations}. $$

For this particular true effect and trigger region, the later look is more likely to trigger an increase because the estimate is more concentrated near zero, inside the region. This conclusion follows from the specified model and rule; it is not a general principle that later looks increase sample size.

Worked Example: The Trigger Probability Depends on the True Effect

Use the same hypothetical rule, model, and sample sizes, but suppose the true effect is \(\theta=2\) units. The rule still increases the sample size only when \(-1<\hat{\theta}_1<1\). At \(t=0.25\), \(SE=2.828\), so the standardized interval boundaries are \((-1-2)/2.828=-1.061\) and \((1-2)/2.828=-0.3536\). Hence,

$$ P(\text{increase}\mid\theta=2,t=0.25) =\Phi(-0.3536)-\Phi(-1.061) \approx 0.217. $$

At \(t=0.75\), \(SE=1.633\), and the boundaries are \(-3/1.633=-1.837\) and \(-1/1.633=-0.6124\). Therefore,

$$ P(\text{increase}\mid\theta=2,t=0.75) =\Phi(-0.6124)-\Phi(-1.837) \approx 0.237. $$

The corresponding expected final sample sizes are approximately \(200+80(0.217)=217.4\) and \(200+80(0.237)=219.0\) observations. These probabilities differ from those in the preceding example because the true effect is now outside the trigger region. The calculation demonstrates why timing comparisons should be made across plausible true effects, rather than inferred from precision alone.

What Timing Does—and Does Not—Change About Sample-Size Range

In the examples, the possible final targets are 200 and 280 observations at either interim time. The range of possible increases over the original plan is therefore zero to 80 observations, independent of \(t\), because the rule's permitted targets are fixed. Timing changes how likely each target is under a given true effect, and therefore changes expected sample size; it does not automatically change the design's stated maximum.

Operationally, however, timing changes how much recruitment remains. At \(t=0.25\), 50 observations have accrued: reaching 200 requires 150 more, while reaching 280 requires 230 more. At \(t=0.75\), 150 have accrued: reaching 200 requires 50 more, and reaching 280 requires 130 more. The extra 80 observations beyond the original plan are the same in both cases, but the later decision leaves less calendar time to obtain them and complete follow-up. If a protocol also imposes a fixed recruitment window or a limit on the number of participants that can still be enrolled, some nominally permitted final targets may no longer be feasible.

Keep these two meanings separate: the statistical range is the set of final sample sizes allowed by the rule and its cap; the operationally feasible range is the subset that can still be recruited and followed on schedule. State explicitly whether a cap refers to final total sample size or to additional recruitment after the interim. Confusing the two can make a design appear to permit an increase that cannot actually be delivered.

Choosing and Checking a Timing

There is no universally best information fraction. An earlier interim analysis provides more opportunity to act on a recommendation, but its effect estimate is noisier. A later analysis gives a more precise estimate, but can make a permitted increase impractical. The choice should be evaluated against the planned decision rule, recruitment and follow-up timelines, and the effects and variances considered plausible for the endpoint.

A useful comparison evaluates, at several candidate values of \(t\), both the probability of each sample-size decision and the expected final sample size across a range of true effects. For a rule with more than two possible final sizes, use the general calculation

$$ E(N_{\mathrm{final}}\mid\theta,t) =\sum_j N_jP(N_{\mathrm{final}}=N_j\mid\theta,t), $$

where \(N_j\) are the permitted final sample sizes. The probabilities must reflect the actual interim estimator distribution and the prespecified rule, including any rounding or bounds. A single expected sample size can hide very different decision probabilities across effects, so it should not be considered in isolation.

Several checks help reveal a problematic timing choice:

  • Precision check: calculate the interim standard error at each candidate information fraction. If the estimate is too noisy to distinguish regions that lead to different actions, the rule may be unstable.
  • Feasibility check: verify that recruitment and outcome ascertainment can reach every permitted target after the proposed look. Account for the time needed to act on the recommendation.
  • Operating-characteristic check: calculate decision probabilities and expected sample size across plausible true effects, not only at the planning effect.
  • Model check: confirm that the assumed information accrual, variance, and estimator distribution are reasonable. Unequal information per participant, missing outcomes, or a changing variance can make \(n_1/N_0\) a poor substitute for an information fraction.

A fixed-sample design avoids an interim adaptation decision and has a simpler sample-size profile, but cannot respond to interim evidence. A rule based on conditional power or a promising zone can respond to interim information, yet its decision probabilities depend on the look's timing and the rule's assumptions. Neither approach is automatically preferable. In particular, changing sample size based on unblinded interim estimates can affect the final test's operating characteristics; those characteristics must be evaluated for the actual adaptive design rather than assumed to be unchanged.

Common Pitfall and Limitations

Wrong reasoning: “A later interim analysis is more precise, so it must make a sample-size increase less likely.” Precision describes the spread of the estimate, not the position of the increase region. If the true effect lies inside that region, added information may increase the chance of an increase; if the true effect lies elsewhere, the probability can move differently. The correction is to calculate \(P(\hat{\theta}_1\in A\mid\theta,t)\) under the model for each relevant \(\theta\) and \(t\).

The normal known-variance examples are deliberately simple. Actual designs may use a treatment-effect estimator with a different variance, unequal allocation, binary outcomes, or event-driven information. Interim estimates may also be affected by missing data, delayed outcomes, or variance estimation. The information-fraction comparison remains useful, but its numerical calculations must use the design's correct estimator distribution. Finally, expected sample size is an average over repeated studies under specified assumptions; it does not guarantee that a particular study will use that many participants.

Key takeaway: A later interim look generally improves estimate precision, while reducing the time available to implement a sample-size increase. The effect on the probability of increasing and on expected sample size depends on the true effect, the decision region, and the sample-size rule. Compare both statistical operating characteristics and operational feasibility.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. Under the equal-information normal model, by what factor does the interim standard error change when \(t\) rises from 0.25 to 1?
  2. A design has \(N_0=240\) and permits a final maximum of 300. What is the range of possible increases over the original plan, and does changing \(t\) alone alter that range?
  3. Why can greater interim precision increase the probability of an increase under one true effect but decrease it under another?
  4. Name two reasons the information fraction may not equal the fraction of participants enrolled.

Solutions. (1) Since \(SE(t)=SE(1)/\sqrt{t}\), at \(t=0.25\) the standard error is twice the planned-final standard error. Raising \(t\) from 0.25 to 1 halves the interim standard error. (2) The increase ranges from 0 to \(300-240=60\) participants. If the permitted final targets and cap remain unchanged, changing \(t\) alone does not change this statistical range, though it changes recruitment still required and may change feasibility. (3) A more precise estimate concentrates around the true effect; whether this places more probability inside the increase region depends on where that region lies relative to the true effect. (4) Examples include event-driven accrual, unequal information per participant, unequal allocation, and missing or incomplete outcomes.

Clinical Biostats