Tutorials › Group Sequential Methods and Sample Size Re-Estimation › Worked Design of a Group Sequential Trial with Delayed Benefit

Non-Proportional Hazards and Delayed Effects · Tutorial 566 of 699

Worked Design of a Group Sequential Trial with Delayed Benefit

Learn how to assemble and critically review a group sequential survival-trial design when the treatment benefit is expected to begin after a delay.

Advanced 14 min read

What You'll Learn

  • Specify a delayed treatment-effect model and the assumptions needed for its use.
  • Define a prespecified weighted logrank statistic aligned with the expected effect pattern.
  • Connect event-based interim looks to sequential efficacy boundaries.
  • Calculate a fixed-horizon RMST contrast under piecewise exponential survival.
  • Assess sensitivity to later onset and weaker post-onset benefit.
  • Identify diagnostics and design choices that can undermine the planned operating characteristics.

From a Delayed-Effect Assumption to a Trial Design

A trial designed around a constant hazard ratio can be poorly matched to a treatment whose benefit is expected only after an induction period, biological latency, or completion of a treatment phase. The design must connect that scientific expectation to the test statistic, the interim schedule, and an interpretable summary of survival. This tutorial develops one hypothetical design as a single chain of decisions. It is not a template for choosing a delay after inspecting trial results: the model, weight, estimand, and monitoring rules must be prespecified.

Suppose adults are randomized equally to control or treatment, and follow-up time \(t\) is measured in months from randomization. A useful planning model assumes an exponential control hazard and a treatment hazard that initially matches control, then falls at a specified onset time. This is a simplifying design model, not a claim that real survival data must be exponential. The weighted logrank analysis can test a broader null of equal survival distributions, while the model supplies a plausible alternative for evaluating power and summaries.

Definition: In a delayed-effect model with onset \(\delta\), the control hazard is \(\lambda_0(t)=\lambda_0\), while the treatment hazard is \(\lambda_1(t)=\lambda_0\) for \(t\leq\delta\) and \(\lambda_1(t)=\theta\lambda_0\) for \(t>\delta\), where \(0<\theta<1\) represents a post-onset reduction in hazard. The treatment hazard ratio is therefore time-varying: it is 1 before onset and \(\theta\) after onset.

This model assumes a common onset time and a constant hazard within each specified segment. It also assumes that the anticipated pattern is scientifically credible across the relevant population. For the usual survival-score calculations, censoring must be independent of the event process within treatment groups, conditional on any variables used in the analysis; follow-up and event times must be recorded consistently. Randomization supports the treatment comparison but does not make informative censoring harmless.

Worked Design: Model, Test, and Monitoring Plan

Consider a hypothetical two-arm trial with equal allocation. For planning, let the control hazard be \(0.080\) per month, the treatment onset be \(\delta=6\) months, and the post-onset treatment hazard be \(0.052\) per month. Thus \(\theta=0.052/0.080=0.650\). The model says there is no treatment hazard difference through month 6 and a 35% lower instantaneous hazard thereafter. It does not say that every treated participant experiences a 35% longer survival time.

For the primary efficacy analysis, prespecify a one-sided weighted logrank test, with positive values defined to favor treatment. At each event time \(t_j\), let \(d_{1j}\) be the number of treatment-arm events, \(Y_{1j}\) the treatment risk set, and \(d_j,Y_j\) the corresponding totals across both arms. Under the null, the expected treatment events at that time are \(Y_{1j}d_j/Y_j\). Use weight \(w(t)=0\) through month 6 and \(w(t)=1\) after month 6. The weighted score and its null variance are

$$ U_w=\sum_j w(t_j)\left(\frac{Y_{1j}d_j}{Y_j}-d_{1j}\right), \qquad V_w=\sum_j w(t_j)^2\frac{Y_{1j}Y_{0j}d_j(Y_j-d_j)}{Y_j^2(Y_j-1)}, \qquad Z_w=\frac{U_w}{\sqrt{V_w}}. $$

Here \(Y_{0j}\) is the control risk set. The sign convention makes \(Z_w>0\) evidence of fewer treatment events than expected, conditional on the risk sets. Tied-event implementations may use the corresponding standard tie adjustment. The weight is fixed by time since randomization, so it does not depend on the observed treatment difference. Under the null and regularity conditions, the score is approximately normal; its sequential values are correlated because the looks use accumulating data.

Use three event-driven analyses at 120, 180, and 240 total primary events. Prespecify a one-sided overall type I error of \(0.025\). The actual efficacy boundaries must be calibrated under the null for this weight, event schedule, and chosen analysis procedure; they should not be borrowed from a different monitoring plan. For illustration, suppose null calibration gives standardized boundaries 3.35, 2.40, and 2.02 at the three looks. The design stops for efficacy at the first look with \(Z_w\) at or above its boundary. Any futility rule, including whether stopping for futility is binding, must also be stated in the protocol and included in performance calculations.

Worked Example: Checking a Hypothetical Interim Result

At the 120-event look, suppose the prespecified analysis reports \(Z_w=2.10\). Compare it with the first-look boundary of 3.35.

The efficacy condition is \(Z_w\geq 3.35\). Since \(2.10<3.35\), the trial does not stop for efficacy at this look. This is not evidence that the null hypothesis is true; it means only that this interim statistic has not crossed the prespecified boundary. The trial continues to the next planned analysis, subject to any separately specified futility rule and data-monitoring procedures.

At the 180-event look, suppose \(Z_w=2.55\). Since \(2.55\geq2.40\), the efficacy boundary is crossed and the trial stops for efficacy under this hypothetical plan. The final 240-event look is not then performed as a confirmatory efficacy test. Sequentially adjusted inference should follow the prespecified group sequential procedure rather than treating the crossing statistic as an ordinary unadjusted final \(Z\)-test.

RMST as a Complementary Treatment Summary

A weighted logrank test targets evidence against equality of survival distributions using a chosen time weighting. A complementary summary is the restricted mean survival time (RMST) through a prespecified horizon \(\tau\), defined as the area under the survival curve up to that time. It has units of time and can be interpreted without reducing a non-proportional hazard pattern to one constant hazard ratio. The horizon must be chosen in advance and supported by adequate follow-up.

Definition: For survival function \(S_a(t)\) in arm \(a\), the RMST through \(\tau\) is \(\operatorname{RMST}_a(\tau)=\int_0^\tau S_a(t)\,dt\). The treatment contrast is \(\operatorname{RMST}_1(\tau)-\operatorname{RMST}_0(\tau)\), measured in the same time units as \(t\).

For a constant hazard \(\lambda\), \(S(t)=e^{-\lambda t}\), so the area over an interval can be integrated directly. With a piecewise hazard, survival is continuous at the onset: the post-onset survival starts from the probability of surviving to \(\delta\), not from 1.

Worked Example: Calculating the 24-Month RMST Contrast

Use the planning hazards above and set \(\tau=24\) months. For control, survival is \(e^{-0.08t}\). For treatment it is \(e^{-0.08t}\) through month 6, then \(e^{-0.08(6)}e^{-0.052(t-6)}\).

The control RMST is

$$ \operatorname{RMST}_0(24) =\frac{1-e^{-0.08(24)}}{0.08} =\frac{1-e^{-1.92}}{0.08} \approx 10.67\text{ months}. $$

The treatment RMST adds the area before onset to the post-onset area:

$$ \begin{aligned} \operatorname{RMST}_1(24) &=\frac{1-e^{-0.08(6)}}{0.08} +e^{-0.08(6)}\frac{1-e^{-0.052(18)}}{0.052}\\ &\approx 4.765+7.233\\ &\approx 11.998\text{ months}. \end{aligned} $$

The modeled treatment-minus-control contrast is \(11.998-10.667\approx1.331\) months, or about 1.33 months. Under this hypothetical model, treatment adds about 1.33 months of expected survival restricted to the first 24 months. This is a model-based planning summary, not a confidence interval or a guarantee about an eventual trial estimate.

Design Justification and Operating Characteristics

The design is defensible only if the choices work together. A delayed-effect alternative makes an ordinary unweighted logrank test potentially less efficient than a test that emphasizes post-onset events. The chosen indicator weight expresses a strong version of that emphasis: events before month 6 contribute no primary weighted score. This may improve sensitivity to the specified delay, but it can lose information if benefit begins earlier, later, or gradually. The test should be selected for a prespecified scientific rationale, not because it gives the most favorable result in the observed data.

A group sequential design must account for repeated looks. Under the null, standardized score statistics at information times \(I_1,\ldots,I_K\) are often approximated by a joint normal process with correlations \(\operatorname{Corr}(Z_k,Z_l)\approx\sqrt{I_k/I_l}\) for \(I_k\leq I_l\). That approximation motivates sequential boundary calibration, but with a weighted statistic and event-driven looks its adequacy should be checked under the planned design. The boundary sequence controls the probability of at least one false efficacy crossing under the null only when calibrated for the actual analysis plan.

In practice, simulate trial histories under both the null and the delayed-effect alternatives. Each simulated trial should reproduce randomization, event and censoring processes, the prespecified weight, look triggers, stopping rules, and analysis method. Estimate type I error as the proportion of null trials crossing an efficacy boundary, and power as the proportion of alternative trials crossing one. The event target can then be adjusted until power meets its target while the calibrated type I error remains controlled. Calendar dates and the number to enroll require separate accrual and follow-up assumptions; event targets alone do not determine those quantities.

Worked Example: Interpreting a Hypothetical Simulation-Based Design Check

Suppose a planning simulation uses the piecewise hazards above, independent censoring as specified in the design, equal randomization, and the three event looks. Assume the calibrated boundaries are the illustrative values given earlier. In 20,000 simulated trials under the null, 486 trials cross an efficacy boundary. The estimated one-sided type I error is

$$ \widehat{\alpha}=\frac{486}{20{,}000}=0.0243. $$

This estimate is close to the target \(0.025\), though simulation error means it is not an exact proof of control. If, under the delayed-effect alternative, 16,120 of 20,000 trials cross a boundary, estimated power is \(16{,}120/20{,}000=0.806\), or 80.6%. These numbers are hypothetical simulation outputs, not universal properties of a 240-event design. A different censoring pattern, treatment effect, delay, or analysis implementation can change both results.

Sensitivity, Diagnostics, and Limitations

A design based on one assumed onset and one post-onset hazard ratio should be challenged with alternatives. For example, later onset reduces the period during which the weight captures the treatment difference. A weaker post-onset effect also reduces the expected weighted score. RMST provides a useful additional check: the same trial may have a meaningful 24-month RMST contrast even when a particular weighted test has limited power, or the reverse. These summaries answer related but different questions and should not be presented as interchangeable.

Worked Example: Sensitivity to Later Onset and Weaker Benefit

Keep the control hazard at \(0.080\) per month and \(\tau=24\) months. First delay onset from 6 to 9 months but retain the treatment hazard of \(0.052\) afterward. The control RMST remains 10.667 months. Treatment RMST is

$$ \begin{aligned} \operatorname{RMST}_1(24) &=\frac{1-e^{-0.08(9)}}{0.08} +e^{-0.08(9)}\frac{1-e^{-0.052(15)}}{0.052}\\ &\approx 6.416+5.070\\ &\approx11.485\text{ months}. \end{aligned} $$

The contrast is \(11.485-10.667\approx0.818\) months, about 0.82 months, smaller than the 1.33-month contrast under onset at month 6.

Now return to onset at 6 months but weaken the post-onset benefit to a hazard of \(0.064\) per month, corresponding to a hazard ratio of \(0.80\). Then

$$ \begin{aligned} \operatorname{RMST}_1(24) &=\frac{1-e^{-0.08(6)}}{0.08} +e^{-0.08(6)}\frac{1-e^{-0.064(18)}}{0.064}\\ &\approx4.765+6.613\\ &\approx11.378\text{ months}. \end{aligned} $$

The contrast is \(11.378-10.667\approx0.711\) months, about 0.71 months. These calculations show why the assumed onset and effect size matter. They do not by themselves provide power under either sensitivity scenario; rerun the complete sequential simulation under each scenario.

Before interpreting interim data, review whether the planned analysis remains credible: check event counts and timing, risk-set sizes, censoring by arm, data completeness, and whether the observed pattern is broadly compatible with the assumed delayed-effect rationale. A survival-curve pattern that differs from the planning model is a warning to scrutinize interpretation and sensitivity analyses, not a license to change the weight or onset based on the interim treatment difference. Any adaptations must be prespecified and preserve valid error control.

The weighted logrank test and RMST contrast also have limitations. The indicator weight discards pre-onset events from its score and can be inefficient or misleading when the delay is misspecified. RMST depends on the chosen horizon and may be imprecise if few participants remain under observation near that horizon. Neither measure removes the need to report absolute survival estimates, follow-up context, and uncertainty. The design should report the test result and the RMST estimate with an appropriate interval, while avoiding a causal interpretation beyond the randomized treatment contrast and the trial's target population.

  • Common mistake: treating the interim weighted \(Z\)-statistic as if it were an ordinary final test at every look. Correction: compare it with its own prespecified sequential boundary and use sequentially adjusted inference.
  • Common mistake: interpreting a hazard ratio below 1 as a constant effect throughout follow-up. Correction: in this model the ratio is 1 until onset and only then equals the specified post-onset ratio.
  • Common mistake: assuming a chosen delayed-effect weight guarantees power if the effect is delayed. Correction: evaluate power and type I error under plausible delay, effect, censoring, and follow-up scenarios.
Key takeaway: A credible delayed-benefit design prespecifies a scientifically motivated effect model, a matching but defensible test, calibrated sequential rules, and an interpretable survival summary. Its operating characteristics must be checked under the complete analysis plan and under plausible departures from the planning assumptions.

Check Your Understanding

Answer each question, then compare with the brief solutions below.

  1. Under the stated planning model, what are the treatment hazard ratio before and after month 6?
  2. If an interim weighted statistic is 2.30 at the second look, with boundary 2.40, what is the efficacy decision?
  3. Why does the post-onset term in the treatment RMST include a factor \(e^{-0.08(6)}\)?
  4. What is one important consequence of using a weight that is zero through month 6?
  5. Why must the sequential boundaries be calibrated for the actual weighted statistic and look schedule?

Solutions. (1) The ratio is 1 through month 6 and 0.650 after month 6. (2) Since \(2.30<2.40\), the efficacy boundary is not crossed; continue according to the prespecified plan. (3) It is the probability of surviving to the onset under the treatment model, so the later survival area begins at the survival level reached by month 6. (4) Events before month 6 add no score information for this test, which can reduce efficiency if benefit begins earlier or the delayed-effect assumption is wrong. (5) Repeated, correlated looks affect the probability of at least one false crossing; the calibrated boundaries must reflect the statistic's null distribution, information pattern, and monitoring schedule.

Clinical Biostats