Tutorials › Group Sequential Methods and Sample Size Re-Estimation › Early Information Behavior of Spending Curves

Alpha Spending Functions · Tutorial 140 of 699

Early Information Behavior of Spending Curves

Learn to compare spending curves near zero information and translate their early spending into a first-look boundary under the canonical group-sequential model.

Advanced 12 min read

What You'll Learn

  • Relate a spending function’s initial growth rate to its early cumulative Type I error spending.
  • Derive the first interim boundary from the one-sided spending amount and the null distribution of the canonical statistic.
  • Compare linear, power, Hwang–Shih–DeCani, Pocock-like, and O’Brien–Fleming-like early behavior.
  • Calculate and interpret hypothetical first-look boundaries at a common information fraction.
  • Diagnose misleading comparisons and recognize the limits of small-information approximations.

Why Early Spending Matters

A spending function allocates a cumulative Type I error budget across information time. Its behavior near zero is especially consequential when the first interim analysis occurs early: a curve that spends more alpha by that information fraction generally permits a lower first-look efficacy boundary, while a curve that spends almost none requires a higher boundary. Comparing curves only at the final information time can therefore conceal important differences in early stopping opportunities.

Here the focus is the first look for a one-sided efficacy test. Let \(t\) denote the information fraction, with \(0\leq t\leq1\), and let \(A(t)\) be cumulative one-sided alpha spent by information fraction \(t\). Assume \(A(0)=0\), \(A(1)=\alpha\), and that \(A(t)\) is nondecreasing. In the canonical group-sequential model under \(H_0\), the first standardized statistic satisfies \(Z_1\sim N(0,1)\). At the first look, there are no earlier looks to account for, so the boundary is determined directly by the marginal upper-tail probability.

Definition: For a one-sided efficacy spending function \(A(t)\), the first-look boundary at information fraction \(t_1\) is \(b_1=\Phi^{-1}\{1-A(t_1)\}\), where \(\Phi\) is the standard normal cumulative distribution function. Thus, under \(H_0\), \(P(Z_1\geq b_1)=A(t_1)\).

This formula assumes the canonical null distribution is standard normal at the first look and that the design assigns cumulative one-sided spending \(A(t_1)\) through that look. If the test is two-sided and \(A(t_1)\) denotes total spending allocated equally to both tails, the corresponding positive boundary is \(\Phi^{-1}\{1-A(t_1)/2\}\). The examples below use one-sided spending throughout so the curves and boundaries are directly comparable.

How Curves Grow Near Zero

For a differentiable spending function with \(A(0)=0\), a finite initial slope \(A'(0)\) gives the local approximation \(A(t)=A'(0)t+o(t)\). The initial slope therefore describes the leading amount spent at very small information fractions. A power curve with exponent below one has no finite initial slope: it grows faster than a linear curve near zero. An O’Brien–Fleming-like curve has a different pattern, with spending that is smaller than every power of \(t\) as \(t\) approaches zero.

Key result: At a fixed first-look information fraction \(t_1\), larger \(A(t_1)\) means a smaller boundary \(b_1\), because \(\Phi^{-1}(1-u)\) decreases as \(u\) increases. The local growth rate helps explain early behavior, but the exact first-look boundary must use the curve’s actual value \(A(t_1)\), not its slope alone.

Several common families illustrate these patterns. For the power family, \(A(t)=\alpha t^\rho\), where \(\rho>0\). If \(\rho<1\), its spending is relatively front-loaded near zero; if \(\rho=1\), it is linear; and if \(\rho>1\), it is relatively back-loaded near zero. The Hwang–Shih–DeCani family is \(A(t)=\alpha\{1-\exp(-\gamma t)\}/\{1-\exp(-\gamma)\}\) when \(\gamma\neq0\), and \(A(t)=\alpha t\) when \(\gamma=0\). Its initial slope is \(\alpha\gamma/\{1-\exp(-\gamma)\}\). The Pocock-like curve considered here is \(A(t)=\alpha\log\{1+(e-1)t\}\), whose initial slope is \(\alpha(e-1)\).

For comparison, a standard one-sided O’Brien–Fleming-like spending curve is \(A(t)=1-\Phi\{z_{1-\alpha}/\sqrt{t}\}\) for \(t>0\), with \(A(0)=0\). Here \(z_{1-\alpha}=\Phi^{-1}(1-\alpha)\). As \(t\) becomes small, this curve evaluates a normal upper tail at a very large positive value. The normal-tail approximation gives \(A(t)\) approximately \(\sqrt{t}\exp\{-z_{1-\alpha}^2/(2t)\}/\{z_{1-\alpha}\sqrt{2\pi}\}\). This exponential term decays especially rapidly as \(t\) approaches zero, explaining the very high early boundary.

Worked Comparisons at an Early Look

The following examples use hypothetical design choices with one-sided \(\alpha=0.025\) and \(t_1=0.10\). The canonical null assumption is \(Z_1\sim N(0,1)\) in each case. These are design calculations, not results from an actual trial.

Worked Example: Hwang–Shih–DeCani Early Spending

Suppose the Hwang–Shih–DeCani shape parameter is \(\gamma=4\). Calculate its spending at \(t_1=0.10\) and the first-look boundary.

Substitute the design values into the spending function:

$$ A(0.10)=0.025\frac{1-\exp(-4\times0.10)}{1-\exp(-4)} =0.025\frac{0.329680}{0.981684} \approx 0.0083958. $$

The one-sided first-look boundary is therefore

$$ b_1=\Phi^{-1}(1-0.0083958) =\Phi^{-1}(0.9916042) \approx 2.391. $$

Under the null, the chance of crossing this first-look boundary is approximately \(0.0083958\), or 0.840 percent. This is the cumulative alpha spent by the first look for this design, not the probability that the null hypothesis is true.

Worked Example: Pocock-Like Early Spending

For the same \(\alpha\) and \(t_1\), use the Pocock-like curve \(A(t)=\alpha\log\{1+(e-1)t\}\).

First calculate the logarithm and then the spending:

$$ A(0.10)=0.025\log\{1+(e-1)(0.10)\} =0.025\log(1.171828) \approx0.025(0.158565) \approx0.0039641. $$

Thus the first-look boundary is

$$ b_1=\Phi^{-1}(1-0.0039641) =\Phi^{-1}(0.9960359) \approx2.655. $$

The first-look upper-tail probability is about 0.396 percent. It is smaller than the Hwang–Shih–DeCani example’s spending, so its boundary is higher: \(2.655\) rather than \(2.391\). Both curves ultimately spend the same total alpha, but their allocations by \(t=0.10\) differ.

Worked Example: Power Curves on Either Side of Linear Spending

Compare power curves with \(\rho=0.5\) and \(\rho=2\), again using \(\alpha=0.025\) and \(t_1=0.10\). The power family is \(A(t)=\alpha t^\rho\).

For \(\rho=0.5\), the spending is

$$ A(0.10)=0.025(0.10)^{0.5} =0.025(0.316228) \approx0.0079057, \qquad b_1=\Phi^{-1}(0.9920943)\approx2.413. $$

For \(\rho=2\), the calculation is

$$ A(0.10)=0.025(0.10)^2 =0.0002500, \qquad b_1=\Phi^{-1}(0.9997500)\approx3.481. $$

The \(\rho=0.5\) curve spends more by the first look and therefore has a lower boundary. The \(\rho=2\) curve spends much less and requires stronger first-look evidence. For comparison, linear spending gives \(A(0.10)=0.025(0.10)=0.002500\) and \(b_1=\Phi^{-1}(0.997500)\approx2.807\), between these two power-curve boundaries.

Worked Example: O’Brien–Fleming-Like Early Spending

Use the one-sided O’Brien–Fleming-like curve with \(\alpha=0.025\) and \(t_1=0.10\). Since \(z_{1-\alpha}=\Phi^{-1}(0.975)\approx1.960\), its spending is

$$ A(0.10)=1-\Phi\left(\frac{1.960}{\sqrt{0.10}}\right) =1-\Phi(6.198) \approx2.9\times10^{-10}. $$

The boundary follows directly from the spending definition:

$$ b_1=\Phi^{-1}\{1-A(0.10)\} =\frac{1.960}{\sqrt{0.10}} \approx6.198. $$

At this early look the nominal upper-tail spending is negligible, and the boundary is correspondingly extreme. This calculation illustrates the early behavior of this particular O’Brien–Fleming-like spending curve; the comparison does not imply that all curves labelled “O’Brien–Fleming-like” are parameterized identically.

Why Spending Changes the Boundary

The link between spending and the boundary can be justified directly. Under the stated first-look null model, \(Z_1\sim N(0,1)\). A boundary \(b_1\) has upper-tail crossing probability \(P(Z_1\geq b_1)=1-\Phi(b_1)\). To spend exactly \(A(t_1)\) by that look, set \(1-\Phi(b_1)=A(t_1)\). Rearranging gives \(\Phi(b_1)=1-A(t_1)\), hence \(b_1=\Phi^{-1}\{1-A(t_1)\}\). Because \(\Phi^{-1}\) is increasing, \(b_1\) decreases as \(A(t_1)\) increases.

The numerical comparisons also show why slope alone is not enough for every practical comparison. For differentiable curves, comparing initial slopes ranks their spending only sufficiently close to zero when the leading terms differ. At a specific \(t_1\), higher-order terms may matter; calculate the actual \(A(t_1)\) before calculating the boundary. For a power curve with \(\rho\neq1\), a finite-slope comparison is not available at zero, so compare its actual spending or its order of growth instead.

Diagnostics, Alternatives, and Limitations

A useful diagnostic is to tabulate \(A(t)\) at the planned first-look information fraction and verify that it lies between zero and the total \(\alpha\). Then check the boundary by substituting it back into the null tail: \(1-\Phi(b_1)\) should equal the reported spending, up to rounding. Large discrepancies often indicate a tail-direction error, a mistaken information fraction, or confusion between one-sided alpha and total two-sided alpha.

The alternatives differ in the early error budget they allocate. A power curve allows direct control through \(\rho\); Hwang–Shih–DeCani provides a shape parameter through its exponential form; the Pocock-like example has a finite, relatively large initial slope; and the O’Brien–Fleming-like form has extremely small early spending. Linear spending is a simple benchmark. A fixed boundary is a different design approach: repeatedly applying a constant threshold does not, in general, allocate the same cumulative Type I error as a spending-function design. The spending-function approach specifies cumulative error at information times and calibrates boundaries to that allocation.

These comparisons do not choose a universally best curve. A lower early boundary can make early stopping for efficacy easier, but the curve must still be appropriate for the design’s intended error allocation and operating characteristics. Small-information approximations describe behavior near zero, not the entire curve. In addition, the boundary formula here is specifically for the first look under the canonical null distribution. Later-look boundaries must account for the joint distribution and previous crossing regions; the first-look calculation cannot simply be reused unchanged.

A common mistake is to infer that a curve with a steep initial rise must have a low first boundary at every early look, or to calculate the boundary from the slope alone. The slope describes a local approximation, while the boundary at the planned look depends on the exact cumulative spending \(A(t_1)\). Another frequent error is to divide alpha by two without first deciding whether the specified spending is one-sided or total two-sided spending. State the tail convention, evaluate the spending function, and only then apply the appropriate normal quantile.

1
Specify the convention.
Identify whether \(A(t)\) is one-sided spending or total two-sided spending, and state the null distribution of the first-look statistic.
2
Evaluate the curve at the first look.
Calculate the exact \(A(t_1)\); use a small-\(t\) expansion only to explain or approximate its behavior.
3
Convert spending to a boundary and check it.
For one-sided efficacy, use \(b_1=\Phi^{-1}\{1-A(t_1)\}\), then verify \(1-\Phi(b_1)=A(t_1)\).

Check Your Understanding

Answer each question using the one-sided canonical first-look setup. Solutions follow the questions.

  1. If two admissible spending curves have values \(0.004\) and \(0.009\) at the same first-look information fraction, which yields the lower boundary, and why?
  2. For \(A(t)=\alpha t^\rho\), describe the relative early growth when \(\rho=0.5\), \(\rho=1\), and \(\rho=2\).
  3. With \(\alpha=0.025\) and \(t_1=0.10\), what is the spending and approximate first-look boundary for linear spending?
  4. Why is it not sufficient to compare only the initial slopes when choosing a curve for a particular \(t_1\)?
  5. A designer reports a two-sided total spend of \(0.008\) at the first look. Under equal tail allocation, what is the positive boundary formula?

Solutions. (1) The curve spending \(0.009\) gives the lower boundary, since \(\Phi^{-1}(1-u)\) decreases as \(u\) increases. (2) At \(\rho=0.5\), spending grows faster than linearly near zero; \(\rho=1\) is linear; and \(\rho=2\) grows more slowly than linearly near zero. (3) \(A(0.10)=0.025(0.10)=0.002500\), so \(b_1=\Phi^{-1}(0.997500)\approx2.807\). (4) A slope is a local description; at the specified information fraction, the exact curve value can reflect higher-order terms, so evaluate \(A(t_1)\). (5) Split the total spending equally between tails, giving \(b_1=\Phi^{-1}(1-0.008/2)=\Phi^{-1}(0.996)\approx2.652\).

Clinical Biostats