Tutorials › Group Sequential Methods and Sample Size Re-Estimation › Power and Sample Size for Weighted Logrank Designs

Non-Proportional Hazards and Delayed Effects · Tutorial 561 of 699

Power and Sample Size for Weighted Logrank Designs

You will translate a specified time-varying treatment effect and weight function into a power and event-target calculation, and assess sequential designs with analytic approximations or simulation.

Advanced 13 min read

What You'll Learn

  • Define the weighted logrank drift and variance under a specified time-varying hazard alternative.
  • Use weighted event-time summaries to approximate power and required events.
  • Explain why a fixed-look sample-size formula is not, by itself, a group sequential power calculation.
  • Calculate sequential power from correlated information-time statistics or estimate it by simulation.
  • Check assumptions, Monte Carlo error, and failure modes when planning a weighted logrank design.

Why Power Depends on the Effect Over Time

A weighted logrank design is intended to detect a treatment effect that may change over follow-up. Its power therefore depends not just on an overall hazard ratio, but on when events occur, how the treatment effect changes over time, and which event times receive the greatest weight. A weight that emphasizes the period of benefit can improve sensitivity to that particular alternative; it can also reduce sensitivity if benefit occurs elsewhere.

For a fixed-look calculation, weighted drift and variance give a useful analytic approximation to power and the required number of events. For a group sequential design, the statistics at the interim looks are correlated, and power is the probability of crossing at least one efficacy boundary. That probability must account for the full sequence of looks, using a multivariate normal approximation or simulation.

Definition: Let \(Y_T(t)\) and \(Y_C(t)\) be the numbers at risk in the treatment and control groups just before time \(t\), and let \(dN_T(t)\) and \(dN_C(t)\) denote their event counts at \(t\). For a prespecified, nonnegative weight function \(w(t)\), define the benefit-oriented weighted logrank score $$ U_w=\sum_j w(t_j)\left\{\frac{Y_T(t_j)}{Y_T(t_j)+Y_C(t_j)}\,dN(t_j)-dN_T(t_j)\right\}, $$ where \(dN(t_j)=dN_T(t_j)+dN_C(t_j)\). Positive values favor treatment. Its usual variance estimate is $$ V_w=\sum_j w(t_j)^2\frac{Y_T(t_j)Y_C(t_j)}{\{Y_T(t_j)+Y_C(t_j)\}^2}\,dN(t_j). $$ The standardized statistic is \(Z_w=U_w/\sqrt{V_w}\).

Assumptions and the Planning Approximation

The planning approximation below assumes randomized treatment allocation with treatment fraction \(q\), a prespecified weight function, independent censoring conditional on treatment and modeled covariates, and a specified alternative hazard ratio \(HR(t)=\lambda_T(t)/\lambda_C(t)\). It also assumes enough events for the weighted score to be approximately normal. The event-time distribution used in the integrals must describe the design’s anticipated event pattern; under larger effects, that distribution can differ between arms. The approximation is most reliable when the alternative is not so large that this difference materially changes the risk sets and event mix.

Let \(f_D(t)\) be a normalized event-time density over the planned follow-up under a chosen reference model, so that \(\int f_D(t)\,dt=1\). Write \(\beta(t)=\log HR(t)\), and define

$$ J=\int w(t)\{-\beta(t)\}f_D(t)\,dt,\qquad C=\int w(t)^2f_D(t)\,dt. $$

Here \(J\) is the benefit-oriented weighted effect averaged over the event-time distribution, and \(C\) is the corresponding average squared weight. Under the planning approximation, with \(D\) total events and a stable allocation fraction \(q\),

$$ E(U_w)\approx Dq(1-q)J,\qquad \operatorname{Var}(U_w)\approx Dq(1-q)C,\qquad \mu_D\approx \sqrt{Dq(1-q)}\,\frac{J}{\sqrt C}. $$

Thus the approximate one-sided power at a single final analysis with critical value \(z_{1-\alpha}\) is \(1-\Phi(z_{1-\alpha}-\mu_D)\), where \(\Phi\) is the standard normal cumulative distribution function. Solving for the event target for power \(1-\gamma\) gives

$$ D\approx\frac{(z_{1-\alpha}+z_{1-\gamma})^2C}{q(1-q)J^2}. $$

This formula shows why a favorable average effect alone is not enough: weights that increase the drift can also increase the variance through \(C\). It is the ratio \(J/\sqrt C\), rather than \(J\) by itself, that determines the approximate standardized signal per square root of an event.

From a Fixed Look to Sequential Power

At interim look \(k\), let \(U_k\) and \(V_k\) denote the cumulative weighted score and its variance estimate. Under the null, independent increments of the score imply that standardized statistics at ordered looks have approximate correlations \(\operatorname{Corr}(Z_i,Z_j)\approx\sqrt{V_i/V_j}\) for \(i<j\). Under a specified alternative, calculate the mean at each look from the cumulative weighted drift through that look, divided by \(\sqrt{V_k}\). The sequence is then approximated by a multivariate normal vector with those means and the corresponding covariance matrix.

If \(b_k\) is the efficacy boundary at look \(k\), one-sided sequential power is the probability that at least one statistic crosses its boundary:

$$ P_{\!A}\left(\bigcup_{k=1}^{K}\{Z_k\ge b_k\}\right). $$

The boundaries must be those calibrated for the design’s null type I error and the prespecified analysis plan. A fixed-look formula using \(z_{1-\alpha}\) does not account for repeated opportunities to stop early. For sample-size planning, evaluate sequential power over candidate event targets and increase or decrease \(D\) until the desired power is reached. When the alternative changes substantially over time, each look’s mean should be computed from its own cumulative drift rather than assuming it is proportional to the square root of information.

Worked Example: A Fixed-Look Event Target

Suppose a hypothetical equal-allocation design has \(q=0.50\), and its planning calculations give \(J=0.1427\) and \(C=0.40\). These summaries are assumed to come from the specified time-varying hazard alternative, weight function, and reference event-time distribution. For one-sided \(\alpha=0.025\) and target power \(0.80\), use \(z_{1-\alpha}=1.960\) and \(z_{1-\gamma}=0.8416\).

The approximate event target is

$$ D\approx \frac{(1.960+0.8416)^2(0.40)} {(0.50)(0.50)(0.1427)^2} = \frac{3.139585}{0.0050908225} \approx 616.7. $$

Because events are counted in whole numbers, round up to 617 events. This is a fixed-look normal approximation, not a sequential boundary-crossing calculation. For a group sequential design, 617 is a starting candidate: evaluate its power using the actual boundaries and look information, then adjust the target if needed.

Checking the Effect Shape and Weight

The weighted summaries can be inspected directly when the alternative is piecewise constant. This is useful both for checking arithmetic and for seeing which periods drive the planned sensitivity. The following calculation treats the event-time fractions as specified planning inputs; in an actual design they should be justified by the assumed hazards, follow-up, and censoring.

Worked Example: Two Periods with Delayed Benefit

Consider a hypothetical alternative with 60% of reference events in an early period and 40% in a late period. Let \(HR=1\) early and \(HR=0.70\) late. Use weights 0.5 early and 1.5 late, with equal allocation. The early log hazard ratio is zero, while the late value is \(\log(0.70)\approx-0.3567\).

Using the benefit-oriented definition of \(J\), the early period contributes zero. The late period contributes

$$ J=(0.60)(0.5)(0)+(0.40)(1.5)\{-\log(0.70)\} \approx 0.2140. $$

The squared-weight average is

$$ C=(0.60)(0.5^2)+(0.40)(1.5^2)=0.15+0.90=1.05. $$

For one-sided \(\alpha=0.025\) and power \(0.80\), the fixed-look approximation gives

$$ D\approx \frac{(1.960+0.8416)^2(1.05)} {(0.50)(0.50)(0.2140)^2} \approx 719.8, $$

so the rounded target is 720 events. The high late weight emphasizes the period in which benefit occurs, but also increases \(C\). This calculation is conditional on the assumed 60/40 event split and the specified hazard pattern; changing either can change both \(J\) and \(C\), and therefore the event target.

Estimating Sequential Power by Simulation

Simulation is often preferable when the hazard changes sharply, censoring is substantial, allocation among those still at risk shifts over time, or the analytic normal approximation is questionable. A simulation should reproduce the planned randomization, event and censoring distributions, prespecified weights, information-based analysis times, and boundaries. Each simulated trial is analyzed using the same weighted score and stopping rule intended for the real design. Power is estimated by the fraction of simulated trials that cross an efficacy boundary.

1
Specify the alternative and design.
Set the treatment and control hazards over time, allocation, censoring assumptions, event target, weights, looks, and calibrated boundaries.
2
Generate one trial and apply the monitoring rule.
Simulate event and censoring times, calculate \(Z_k\) at each planned look, and record whether any efficacy boundary is crossed.
3
Repeat and quantify simulation error.
For \(M\) independent simulated trials and \(R\) trials with a crossing, estimate power by \(\hat{p}=R/M\), with Monte Carlo standard error \(\sqrt{\hat{p}(1-\hat{p})/M}\).

Worked Example: Monte Carlo Power and Its Uncertainty

Suppose a hypothetical simulation of a weighted group sequential design uses 100,000 independent trials under its specified time-varying hazard alternative. Assume 80,610 trials cross an efficacy boundary. The estimated power is

$$ \hat{p}=\frac{80{,}610}{100{,}000}=0.8061. $$

The estimated Monte Carlo standard error is

$$ SE_{\mathrm{MC}}= \sqrt{\frac{0.8061(1-0.8061)}{100{,}000}} \approx 0.001250. $$

Thus estimated power is about 80.61%, with one Monte Carlo standard error of about 0.125 percentage points. This uncertainty describes simulation variability, not uncertainty in the treatment effect or the design assumptions. A rough two-standard-error range for Monte Carlo error alone is about 80.36% to 80.86%; it does not account for misspecification of the hazard, censoring, or event-time distribution.

Diagnostics, Alternatives, and Limitations

Before relying on a power estimate, check that the design inputs describe the intended analysis. In particular, verify that the weight function is prespecified and implemented consistently at every look, the assumed event-time fractions are compatible with the hazard and follow-up assumptions, and the sequential boundaries match the specified type I error. In simulation, check that event counts, allocation, censoring, and look timing behave as intended. Under the null, a separate simulation can assess whether the full stopping rule has the intended type I error; the alternative simulation estimates power, not type I error.

A common mistake is to calculate a weighted logrank event target from a fixed-look formula and call it the required group sequential sample size. That calculation omits the probability of crossing at earlier looks and the correlation among looks. Use it as an initial estimate, then evaluate the actual sequential crossing probability. Another mistake is to choose weights after inspecting the observed treatment differences: data-adaptive weights can invalidate the intended type I error unless the adaptation is handled by a valid prespecified procedure.

The main alternatives answer different questions. A logrank design with constant weights is a natural comparator when proportional hazards are plausible or when a broad average effect is the target. A weighted logrank design can focus sensitivity on a prespecified effect pattern, but its power may be poor for a different pattern. Simulation can accommodate complex designs more directly than the analytic approximation, but it depends on the correctness of the simulated model and can have material Monte Carlo error if too few trials are run. No method removes the need to examine how conclusions change under plausible alternatives; the calculated power is conditional on the modeled hazards and design assumptions.

Key takeaway: For weighted logrank planning, the time-varying alternative and event-time distribution determine the weighted drift, while the weights also determine the variance. Use the resulting fixed-look event target as an approximation; obtain group sequential power by evaluating the joint boundary-crossing probability or by simulating the complete monitoring design.

Check Your Understanding

Answer each question, then compare with the solutions.

  1. Under the planning approximation, what do \(J\) and \(C\) summarize, and why does the event target depend on both?
  2. A weight is doubled at every event time while the alternative and event distribution stay fixed. How do \(J\), \(C\), and the ratio \(J/\sqrt C\) change?
  3. Why can a fixed-look event target not be used directly as the final sample size for a group sequential design?
  4. A simulation estimates power as 0.70 from 10,000 trials. Calculate its approximate Monte Carlo standard error.
  5. Name two design features that should be reproduced in a simulation of weighted logrank power.

Solutions. (1) \(J\) is the event-time average of weighted benefit-oriented log hazard ratio; \(C\) is the event-time average squared weight. The target depends on \(J^2/C\), the squared standardized drift per event. (2) \(J\) doubles and \(C\) becomes four times as large, so \(J/\sqrt C\) is unchanged; under this approximation, power is unchanged. (3) Sequential power is the probability of crossing any boundary and depends on the correlated statistics at all looks and their boundaries. (4) \(\sqrt{0.70(0.30)/10{,}000}=\sqrt{0.000021}\approx0.00458\), or about 0.458 percentage points. (5) Examples include the time-varying hazards, censoring, allocation, weights, event-based look timing, and efficacy boundaries.

Clinical Biostats