Tutorials › Group Sequential Methods and Sample Size Re-Estimation › Choosing A Wang-Tsiatis Shape

Classical Boundaries · Tutorial 103 of 699

Choosing A Wang-Tsiatis Shape

You will compare Wang–Tsiatis shapes by their early-to-final threshold profiles and use those comparisons to guide a calibrated design choice.

Intermediate 10 min read

What You'll Learn

  • Compute the relative interim-to-final critical-value ratio for a Wang–Tsiatis shape.
  • Explain how increasing the shape parameter changes early-look stringency.
  • Separate shape comparisons from calibration to a planned type I error rate.
  • Use an early-threshold preference to screen candidate shape values.
  • Identify assumptions and common errors when comparing candidate designs.

Why the Shape Choice Matters

A group sequential efficacy design can allow a study to stop early when the accumulating evidence is sufficiently strong. The Wang–Tsiatis family describes a range of boundary shapes, from the relatively flat Pocock shape to the more stringent-early-look O’Brien–Fleming shape. Choosing a shape is therefore a way of expressing how demanding the design should be at interim analyses relative to the final analysis.

The shape parameter does not, by itself, specify a complete test. A design also needs a planned information schedule, a testing direction, a target type I error rate, and a boundary constant calibrated to that schedule. The comparisons below first isolate the effect of shape using a common final threshold; the practical design step is to recalibrate the constant for each candidate.

Definition: For planned information fractions \(0<t_1<\cdots<t_K=1\), the one-sided Wang–Tsiatis efficacy boundary has the form \(b_k=c/t_k^\Delta\). Here \(b_k\) is the critical value for the standardized test statistic \(Z_k\) at look \(k\), \(c>0\) is a boundary constant, and \(\Delta\) is the shape parameter. At a look, the efficacy boundary is crossed when \(Z_k\ge b_k\). The conventional range \(0\le\Delta\le0.5\) runs from the Pocock shape at \(\Delta=0\) to the O’Brien–Fleming shape at \(\Delta=0.5\).

For this one-sided rule, the null hypothesis concerns no effect in the prespecified direction, and the alternative concerns an effect in that direction. The planned looks and their information fractions must be fixed for the calibration being used. Under the null, the standardized statistics are assumed to follow the canonical joint normal model: each \(Z_k\) has mean 0 and variance 1, and for \(i<j\), their correlation is \(\sqrt{t_i/t_j}\). This model follows from independent increments of information in the usual group sequential setting. If the analysis uses a different valid joint model, the calibration must use that model instead.

Reading the Shape From Early and Final Thresholds

Because the final information fraction is \(t_K=1\), the final threshold is \(b_K=c\), whatever the value of \(\Delta\). At an earlier look \(t_k<1\), the threshold is higher than the final threshold when \(\Delta>0\). Dividing the two thresholds removes the common constant:

$$ \frac{b_k}{b_K}=\frac{c/t_k^\Delta}{c}=t_k^{-\Delta}. $$

This ratio is the cleanest way to compare shapes before calibration. For any fixed early information fraction, it increases as \(\Delta\) increases. Thus, for a common final threshold, larger \(\Delta\) makes an early efficacy stop harder to achieve relative to stopping at the final look. At \(\Delta=0\), all thresholds equal \(c\). At \(\Delta=0.5\), an early threshold is multiplied by \(1/\sqrt{t_k}\).

Key distinction: The ratio \(t_k^{-\Delta}\) describes the shape relative to the final threshold. It does not determine the type I error rate. For a target one-sided familywise type I error rate \(\alpha\), \(c\) must be chosen so that, under the null model, the probability of crossing at any planned look equals \(\alpha\). That calibrated value of \(c\) can differ across shape parameters.

Worked Comparisons

Worked Example: Comparing Shapes at a Quarter of the Information

Suppose an interim analysis is planned at \(t_1=0.25\). To isolate shape, take a common final threshold of \(c=2.00\). Compare \(\Delta=0.20\) with the Pocock and O’Brien–Fleming shapes.

For \(\Delta=0.20\), the interim-to-final ratio is

$$ 0.25^{-0.20}=\exp\{-0.20\log(0.25)\}=1.3195079\ldots\approx1.320. $$

The interim boundary is therefore \(b_1=2.00(1.3195079\ldots)=2.639\), while the final boundary is \(b_K=2.00\). With the Pocock shape, \(\Delta=0\), the ratio is \(0.25^0=1\), so the interim threshold is \(2.00\). With the O’Brien–Fleming shape, \(\Delta=0.5\), the ratio is \(0.25^{-0.5}=2\), so the interim threshold is \(4.00\). On this common-final-threshold comparison, the \(\Delta=0.20\) profile is between the two endpoints.

These are shape comparisons, not three calibrated designs with equal type I error. Each candidate would need its own \(c\) calibrated for the same schedule and target \(\alpha\) before error-controlled designs were compared.

Worked Example: A Half-Information Interim Look

Consider an interim look at \(t_1=0.50\) and use the hypothetical common final threshold \(c=2.07\). For \(\Delta=0.25\), the interim value is

$$ b_1=\frac{2.07}{0.5^{0.25}} =\frac{2.07}{0.8408964\ldots} =2.46166\ldots\approx2.462. $$

Its interim-to-final ratio is \(2.46166\ldots/2.07=1.189207\ldots\). For comparison, \(\Delta=0\) gives \(b_1=2.070\), while \(\Delta=0.5\) gives

$$ b_1=\frac{2.07}{\sqrt{0.5}}=2.92742\ldots\approx2.927. $$

All three profiles have the same stipulated final value, \(2.07\), but they demand different evidence at the interim look. If the statistic were \(Z_1=2.50\), it would cross the \(\Delta=0.25\) illustrative boundary but not the \(\Delta=0.5\) boundary. This comparison says nothing about the actual probability of crossing under the null until each candidate is calibrated.

Worked Example: Turning an Early-Threshold Preference Into a Candidate Shape

Suppose a team plans its first interim analysis at \(t_1=0.20\). For an initial design screen, it wants the early threshold to be no more than 1.50 times the final threshold. What shape values satisfy that preference?

The requirement is \(t_1^{-\Delta}\le1.50\). Taking logarithms and using \(-\log(0.20)=\log(5)>0\) gives

$$ \Delta\log(5)\le\log(1.50), \qquad \Delta\le\frac{\log(1.50)}{\log(5)} =0.2519\ldots. $$

Thus, among the conventional range, candidate values up to about \(0.252\) meet this relative-threshold preference before calibration. For example, \(\Delta=0.25\) gives a ratio \(5^{0.25}=1.49535\ldots\), whereas \(\Delta=0.30\) gives \(5^{0.30}=1.62066\ldots\) and fails the screen. If the hypothetical common final threshold were \(2.10\), the \(\Delta=0.25\) early threshold would be \(2.10(1.49535\ldots)=3.140\).

The preference is a design input, not an error-rate guarantee. The actual early threshold after calibration may differ because the calibrated \(c\) depends on the chosen \(\Delta\) and the whole schedule. The team should therefore use the ratio to shortlist shapes, then examine calibrated boundaries for its specified \(\alpha\).

Calibration and a Practical Selection Process

For each candidate \(\Delta\), the boundary constant is selected using the joint null distribution and the planned information fractions. In the one-sided case, calibration sets the probability of at least one efficacy crossing under the null to the target \(\alpha\):

$$ P_{H_0}\left(\bigcup_{k=1}^{K}\{Z_k\ge c/t_k^\Delta\}\right)=\alpha. $$

This probability accounts for the dependence among repeated looks. It is not obtained by assigning the full \(\alpha\) independently to every look. The earlier material on familywise type I error and the Wang–Tsiatis boundary family provides the relevant background; for choosing a shape, the operational point is that the calibration is repeated for every candidate value of \(\Delta\).

1
Specify the design before comparing shapes.
Record the planned information fractions, the one- or two-sided testing direction, the target \(\alpha\), and the null model used for the sequential statistics.
2
Screen candidate values by relative thresholds.
At each important early look, compute \(t_k^{-\Delta}\). This shows how demanding that look is relative to the final look and can rule out shapes inconsistent with the intended early-stopping emphasis.
3
Calibrate each remaining candidate.
For each \(\Delta\), find the value of \(c\) that gives the specified familywise type I error under the planned joint null model. Recalculate all absolute critical values \(c/t_k^\Delta\).
4
Review the calibrated profiles in context.
Check the actual early and final critical values, the implications for early stopping, and whether the design priorities are met. A shape choice is not established merely by its relative ratio.

A flat Pocock-like profile places less relative penalty on an early crossing. An O’Brien–Fleming-like profile demands substantially stronger evidence early and places more of its opportunity for rejection near the final analysis. Intermediate \(\Delta\) values provide intermediate relative profiles, but after calibration, the absolute thresholds must be read from the resulting design rather than inferred from the shape label alone.

Diagnostics, Alternatives, and Limitations

A useful diagnostic is to check the calculated ratio at every planned interim look. For \(\Delta>0\), it should exceed 1 at every \(t_k<1\), and it should approach 1 as \(t_k\) approaches 1. If a calculation gives an early-to-final ratio below 1, check the sign in the exponent: the boundary is \(c/t_k^\Delta\), not \(ct_k^\Delta\). Also verify that the final look is assigned \(t_K=1\); otherwise its threshold will not reduce to \(c\).

The main alternative is not another formula for the same fixed shape, but a different boundary emphasis. The Pocock and O’Brien–Fleming boundaries are the endpoint shapes within the conventional Wang–Tsiatis range. A candidate between them is useful when the desired early-to-final contrast lies between those endpoints. A flat boundary is more permissive early relative to the final look, while a strongly increasing early threshold is more conservative at interim analyses. The right comparison depends on the study’s priorities; the ratio alone does not rank designs on every operating characteristic.

Several limitations matter in practice. First, the ratio comparison holds the final threshold fixed, while actual calibrated candidates generally have different values of \(c\). Second, the shape does not encode a change to the information schedule: moving a look changes \(t_k^{-\Delta}\) and requires recalibration. Third, an efficacy-boundary shape does not specify futility stopping rules or other adaptations. Finally, a design calibrated under one null distribution or analysis plan may not retain its intended error rate if the actual analysis departs from those assumptions. Such departures require an appropriate design-specific evaluation.

Common Mistakes

  • Choosing \(\Delta\) and treating \(c\) as universal. The constant that achieves a target \(\alpha\) depends on the shape and planned schedule. Calibrate each candidate separately.
  • Calling a lower early threshold “more conservative.” With the same final threshold, a lower early cutoff is easier to cross and thus allows earlier efficacy stopping more readily. Error-rate comparisons still require calibration.
  • Comparing absolute thresholds while changing both \(c\) and \(\Delta\) without explanation. Use \(t_k^{-\Delta}\) to isolate shape, or state that the values being compared are fully calibrated design thresholds.
  • Assuming an intermediate shape guarantees an intermediate operating characteristic. The relative threshold profile is intermediate, but power, stopping probabilities, and other operating characteristics depend on the effect and full design.
Key takeaway: Use \(t_k^{-\Delta}\) to understand how a Wang–Tsiatis shape weights early evidence relative to the final look. Use separately calibrated boundary constants to judge actual candidate designs at a common type I error rate.

Check Your Understanding

Answer each question, then check the concise solutions below.

  1. At \(t=0.36\), what is the interim-to-final threshold ratio for \(\Delta=0.5\)?
  2. For an early look at \(t=0.25\), does increasing \(\Delta\) make the threshold more or less demanding relative to the final threshold? Give the mathematical reason.
  3. Why is it not valid to compare two candidate shapes at a common \(c\) and conclude that they control the same familywise type I error?
  4. A design preference requires \(b_1/b_K\le1.40\) at \(t_1=0.25\). Does \(\Delta=0.25\) meet this relative-threshold screen?

Solutions. (1) The ratio is \(0.36^{-0.5}=1/\sqrt{0.36}=1.667\) to three significant figures. (2) It becomes more demanding: \(t^{-\Delta}=\exp\{-\Delta\log(t)\}\), and \(-\log(t)>0\) for \(0<t<1\), so the ratio increases with \(\Delta\). (3) The joint probability of crossing any look depends on the entire boundary and the correlation among looks; calibration generally gives a different \(c\) for each shape. (4) The ratio is \(0.25^{-0.25}=\sqrt{2}=1.414\), which exceeds 1.40, so it does not meet the screen.

Clinical Biostats