Tutorials › Group Sequential Methods and Sample Size Re-Estimation › Power At Each Event-Driven Look

Group Sequential Logrank Tests · Tutorial 513 of 699

Power At Each Event-Driven Look

Learn to calculate and interpret power at one event-driven logrank look from the assumed hazard ratio, accumulated information, and efficacy boundary.

Advanced 10 min read

What You'll Learn

  • Define marginal power at a specified event-driven look.
  • Convert a proportional-hazards alternative into the mean of the standardized logrank statistic.
  • Calculate the probability of exceeding a one-sided efficacy boundary.
  • Distinguish marginal power at one look from probability of crossing at that look under a stopping rule.
  • Check the assumptions and calculations behind a per-look power approximation.

What Power at One Look Measures

In an event-driven group sequential trial, a logrank statistic is evaluated when specified amounts of event information have accumulated. At a particular look, its marginal power is the probability, under a specified alternative, that the statistic exceeds the efficacy boundary assigned to that look. This is a single-look probability: it does not account for whether the trial would already have stopped at an earlier look.

That distinction matters. A statistic can exceed the boundary at look \(k\) in the probability model even on paths that would have crossed an earlier boundary, so the marginal power at look \(k\) is not the probability that look \(k\) is the first crossing. Calculating power for the full stopping rule requires the joint distribution across looks. Here we calculate the probability for one specified look.

The calculation uses the canonical normal approximation for sequential logrank statistics and a proportional-hazards alternative. It is most useful when the assumed treatment effect, the accumulated information, and the efficacy boundary are all stated on compatible scales.

Model and Per-Look Power

Definition: Let \(Z_k\) be the standardized logrank statistic at look \(k\), oriented so that larger values favor treatment. Let \(I_k\) be the accumulated information at that look, and let \(c_k\) be its one-sided efficacy boundary. Under the proportional-hazards alternative, define \(\theta=\log(HR_{\text{control}}/HR_{\text{treatment}})\), so \(\theta>0\) represents a beneficial treatment effect. Under the canonical normal approximation, \(Z_k\sim N(\theta\sqrt{I_k},1)\). The marginal power at look \(k\) is \(P(Z_k\ge c_k)\).

The information \(I_k\) is the information for the log hazard-ratio contrast used by the standardized statistic; it is not necessarily the event count itself. The event count may be used to plan or approximate information, but the power calculation uses \(I_k\). In this parameterization, the alternative's drift, or mean of \(Z_k\), is \(\theta\sqrt{I_k}\). The variance of the standardized statistic is one.

For this approximation to be appropriate, the logrank statistic must be oriented consistently with the definition of \(\theta\), and the proportional-hazards alternative treats the hazard ratio as constant over follow-up. The usual large-sample logrank approximation is also assumed, along with suitable censoring and risk-set behavior for the logrank score and its information estimate. The canonical model treats the information at the look as specified (or uses a planned/realized information value as an approximation). If the effect changes over time, or information is substantially different from what the model assumes, the calculation may not describe the actual distribution well.

$$ \begin{aligned} \text{Power}_k &=P(Z_k\ge c_k)\\ &=P\left(\frac{Z_k-\theta\sqrt{I_k}}{1}\ge c_k-\theta\sqrt{I_k}\right)\\ &=1-\Phi\left(c_k-\theta\sqrt{I_k}\right)\\ &=\Phi\left(\theta\sqrt{I_k}-c_k\right). \end{aligned} $$

The standardization in the second line is valid because, under the assumed alternative, subtracting the mean \(\theta\sqrt{I_k}\) gives a standard normal variable. The last expression is often convenient: calculate the alternative drift, subtract the efficacy boundary, and evaluate the standard normal distribution function.

Worked Per-Look Calculations

Worked Example: A Specified Boundary and Information

Suppose a hypothetical event-driven trial assumes a constant hazard ratio \(HR_{\text{treatment}}/HR_{\text{control}}=\exp(-0.30)\approx0.7408\). At a specified look, accumulated information is \(I_k=36\), and the one-sided efficacy boundary is \(c_k=2.40\). Calculate the marginal power at this look.

With the treatment-benefit orientation in the definition, \(\theta=\log(HR_{\text{control}}/HR_{\text{treatment}})=0.30\). Thus the alternative drift is

$$ \theta\sqrt{I_k}=0.30\sqrt{36}=0.30(6)=1.80. $$

The power is the probability that a normal statistic with mean 1.80 and standard deviation 1 exceeds 2.40:

$$ \begin{aligned} P(Z_k\ge2.40) &=1-\Phi(2.40-1.80)\\ &=1-\Phi(0.60)\\ &\approx 0.2743. \end{aligned} $$

Under the stated model and assumed hazard ratio, the probability of exceeding this look's boundary is approximately 27.43%. It is not the probability of first crossing at this look, nor the probability of crossing any boundary during the trial.

Worked Example: Calculating a Small Boundary-Exceedance Probability

For a second hypothetical trial, suppose \(\theta=0.25\), accumulated information is \(I_k=25\), and the specified one-sided boundary is \(c_k=2.13428224\). The value \(\theta=0.25\) corresponds to \(HR_{\text{treatment}}/HR_{\text{control}}=\exp(-0.25)\approx0.7788\). Find the marginal power.

The alternative drift is \(0.25\sqrt{25}=1.25\). Therefore the distance from the drift to the boundary is \(2.13428224-1.25=0.88428224\), giving

$$ \begin{aligned} P(Z_k\ge c_k) &=1-\Phi(2.13428224-1.25)\\ &=1-\Phi(0.88428224)\\ &\approx 0.1883. \end{aligned} $$

Thus the marginal probability of exceeding the boundary at this look is about 18.83% under the specified alternative. The tail probability is rounded to 0.1883.

Worked Example: Comparing Two Event-Driven Looks

Consider a hypothetical trial with a constant assumed hazard ratio \(HR_{\text{treatment}}/HR_{\text{control}}=0.80\). Then \(\theta=\log(1/0.80)\approx0.22314\). Suppose the first look has \(I_1=16\) and boundary \(c_1=2.40\), while the second has \(I_2=36\) and boundary \(c_2=2.00\). Calculate the marginal power separately at each look.

At the first look, the drift is \(0.22314\sqrt{16}=0.89256\). Hence

$$ P(Z_1\ge2.40)=1-\Phi(2.40-0.89256) =1-\Phi(1.50744)\approx0.0658. $$

At the second look, the drift is \(0.22314\sqrt{36}=1.33884\). Therefore

$$ P(Z_2\ge2.00)=1-\Phi(2.00-1.33884) =1-\Phi(0.66116)\approx0.2543. $$

The marginal boundary-exceedance probabilities are approximately 6.58% and 25.43%, respectively. These calculations use different information values and boundaries. They do not add to give overall trial power: the two statistics are dependent, and the probability of crossing at either look requires accounting for their joint behavior and the stopping rule.

Why the Formula Works—and What It Does Not Say

The calculation follows directly from the assumed distribution. If \(Z_k\sim N(\theta\sqrt{I_k},1)\), then \(Z_k-\theta\sqrt{I_k}\sim N(0,1)\). The event \(Z_k\ge c_k\) is equivalent to \(Z_k-\theta\sqrt{I_k}\ge c_k-\theta\sqrt{I_k}\). By the definition of the standard normal distribution function, the probability of being at least \(a\) is \(1-\Phi(a)\). This yields the stated power formula without needing a separate approximation for the tail.

The interpretation is conditional on the model inputs: the assumed effect, information, boundary, and normal approximation. It is not a probability that the hazard ratio is true, and it does not guarantee that the trial will reach that look. If an earlier efficacy boundary is crossed, the actual design stops; the marginal calculation at a later look still describes the distributional event at that look, not the operational chance of observing it after continuing the trial.

Key takeaway: At one specified look, use the assumed proportional-hazards effect to obtain drift \(\theta\sqrt{I_k}\), then calculate \(\Phi(\theta\sqrt{I_k}-c_k)\). Label the result as marginal per-look power, not overall sequential power or probability of a first crossing.

Diagnostics, Alternatives, and Limitations

Several checks help catch errors before interpreting the result:

  • Check the direction. With the stated convention, a beneficial treatment has \(\theta>0\) and raises the mean of \(Z_k\). Reversing the log hazard-ratio contrast without reversing the statistic changes the interpretation and can produce a nonsensical power calculation.
  • Check the scale. The drift uses \(\theta\sqrt{I_k}\), not \(\theta I_k\). A larger information value increases the drift for a fixed positive effect, but it does not change the variance of the standardized \(Z_k\) from one.
  • Check the boundary and tail. An upper efficacy boundary uses \(P(Z_k\ge c_k)\). A lower or two-sided rule requires a different event definition; do not substitute an absolute-value rule for a one-sided benefit boundary.
  • Check the resulting probability. It must lie between zero and one. With a positive upper boundary and no effect (\(\theta=0\)), the formula gives the one-look null exceedance probability \(1-\Phi(c_k)\). For a fixed boundary, increasing a beneficial effect or information should increase the calculated power.

A single-look normal approximation is simpler than evaluating the joint sequential distribution, but it cannot answer how likely the design is to cross at least one boundary or to cross first at a particular look. Those are overall sequential power questions. A simulation based on the intended event process and monitoring rule can be useful when the normal approximation, constant hazard ratio, or planned information values are questionable. Neither method removes the need to specify a realistic treatment effect and appropriate censoring and event assumptions.

A frequent mistake is to calculate \(P(Z_k\ge c_k)\) and call it the probability that the trial rejects by look \(k\). That reasoning ignores earlier looks: a path may have crossed an earlier boundary, and a later look's statistic is correlated with earlier statistics. The correction is to call the single-look result marginal power at look \(k\). To obtain rejection probability under the complete sequential design, one must account for the joint distribution and stopping rule, not add the per-look probabilities.

Check Your Understanding

Use the one-look normal approximation unless a question asks otherwise. Solutions follow the questions.

  1. Under the treatment-benefit orientation, what is \(\theta\) when \(HR_{\text{treatment}}/HR_{\text{control}}=0.90\)? Is the implied drift positive or negative?
  2. A hypothetical look has \(\theta=0.20\), \(I_k=25\), and \(c_k=2.00\). Calculate the marginal power.
  3. Why is the marginal power at look 3 not necessarily the probability of first crossing at look 3?
  4. For a fixed positive \(\theta\) and fixed boundary, what happens to per-look power as information increases? State the model-based reason.

Solutions. (1) \(\theta=\log(1/0.90)\approx0.1054\), which is positive, so the assumed direction is beneficial. (2) The drift is \(0.20\sqrt{25}=1.00\), so the power is \(1-\Phi(2.00-1.00)=1-\Phi(1.00)\approx0.1587\), or 15.87%. (3) The marginal event \(Z_3\ge c_3\) does not require that earlier boundaries were not crossed; first crossing also requires no earlier crossing, which depends on the joint distribution across looks. (4) The drift \(\theta\sqrt{I_k}\) increases with information when \(\theta>0\), moving the standardized statistic's mean farther above the fixed boundary and increasing \(\Phi(\theta\sqrt{I_k}-c_k)\).

Clinical Biostats