Why Nonproportional Hazards Change the Confirmatory Question
A survival test is not merely a way to obtain a p-value. Its construction determines which differences between treatment and control contribute most to the evidence. This matters when hazards are nonproportional: the treatment effect may change over time, and a single hazard ratio may not summarize that pattern. In a seamless trial, the stagewise tests must also represent a coherent confirmatory question, even when early-stage evidence informed the transition to the confirmatory stage.
For example, a treatment might initially delay benefit because of a biological lag, then reduce the event hazard later. A conventional log-rank test gives events equal weight over time, so early and late differences can offset one another. A weighted log-rank test changes that balance. The weight function must therefore be chosen for a clinical reason and specified before examining the confirmatory-stage outcomes.
Constructing a Stagewise Weighted Survival Test
Let \(T\) denote the treatment group and \(C\) the control group. At event time \(t\), let \(Y_T(t)\) and \(Y_C(t)\) be the numbers at risk immediately before \(t\), and let \(Y(t)=Y_T(t)+Y_C(t)\). Let \(dN_T(t)\) and \(dN_C(t)\) be the observed event counts at \(t\), and \(dN(t)=dN_T(t)+dN_C(t)\). Under equal survival distributions, the expected treatment-group event count at that time is \(Y_T(t)dN(t)/Y(t)\).
A weighted log-rank score subtracts that expected count from the observed count and weights the difference. We use the sign convention that a positive \(Z_w\) favors treatment: the score itself is negated because fewer treatment-group events than expected is favorable.
For untied event times, the usual null variance estimate is
For tied events, the variance calculation should use the appropriate finite-population correction for the tied risk set; the formula above is the familiar large-sample form. Under the null of equal survival distributions, randomization, independent censoring within groups, and adequate event information, \(Z_w\) is approximately standard normal. The weight function should be fixed in advance or be a prespecified predictable function of the pooled history. A common choice is \(w(t)=1\), the ordinary log-rank test. Other weights can emphasize earlier or later events.
Each stage uses its own participants and its own stagewise score and p-value. The weight rule, event-time horizon, censoring conventions, direction of benefit, and hypothesis must be aligned across stages. If an early-stage treatment is selected from several candidates, its p-value must also be valid for that selection procedure; an unadjusted p-value for the winner is not automatically confirmatory.
Worked Example: A Prespecified Late-Emphasis Test in Stage 1
Hypothetical data. Suppose Stage 1 has four event times, each with one event. The risk sets are balanced at each time: 40 participants per group at the first event, then 30, 20, and 10 per group. All four events occur in control. To emphasize later events, the prespecified weights for these times are \(0.5, 0.5, 1.5,\) and \(1.5\). Assume no tied events and independent censoring.
At each event time, the expected treatment event count is \(Y_T/Y=0.5\). The observed count is zero, so each unweighted score contribution is \(0-0.5=-0.5\). Therefore,
Because the risk groups are balanced, each event contributes \(0.25\) to the unweighted variance. Thus,
The standardized statistic is \(Z_w=-(-2.00)/\sqrt{1.25}=1.789\). The one-sided normal-approximation p-value is approximately \(1-\Phi(1.789)=0.0368\). This is evidence favoring treatment under the prespecified late-emphasis test, but it does not establish that treatment reduces the hazard by a particular percentage. The example is deliberately small; in a real trial, the normal approximation and event-information assumptions would need to be credible.
What the Weighting Means for the Treatment Effect
With \(w(t)=1\), each event contributes according to the risk-set comparison at its time. A weight that is larger later makes late event differences more influential; a weight that is larger earlier does the reverse. This can improve sensitivity to a prespecified pattern, but it also changes the scientific question. If treatment helps late and harms early, a late-emphasis test can favor treatment even when an unweighted test does not.
That is why a test statistic and an effect estimate must not be treated as interchangeable. A weighted log-rank test provides a test of equality of survival distributions against a chosen weighted direction. It does not, by itself, produce a readily interpretable treatment-effect quantity such as “months gained.” The protocol should name the confirmatory test and its weighting rationale, and should report an effect estimate that directly communicates the intended clinical contrast.
One useful effect measure is the difference in restricted mean survival time (RMST) through a prespecified time \(\tau\). For a survival function \(S(t)\), RMST through \(\tau\) is the area under the survival curve from time 0 to \(\tau\). It answers a different, directly time-based question: how much survival time, on average, is accumulated within that horizon? If the confirmatory test is weighted log-rank, an RMST estimate can aid interpretation, but it does not turn the weighted test into an RMST test. The test and reported estimate should be clearly distinguished.
Worked Example: Crossing Curves and an RMST Contrast
Hypothetical data. Suppose estimated survival probabilities at months 0, 6, 12, 18, and 24 are \(1.00, 0.82, 0.62, 0.45, 0.32\) for control and \(1.00, 0.75, 0.60, 0.55, 0.50\) for treatment. The treatment curve is lower early but higher later. Use linear interpolation between these time points to approximate RMST through month 24.
For equal six-month intervals, the trapezoidal approximation is the sum of six times the average survival at each pair of interval endpoints. For control, the calculation is \(6[(1.00+0.82)/2+(0.82+0.62)/2+(0.62+0.45)/2+(0.45+0.32)/2]=6(0.91+0.72+0.535+0.385)=15.30\) months. For treatment, it is \(6[(1.00+0.75)/2+(0.75+0.60)/2+(0.60+0.55)/2+(0.55+0.50)/2]=6(0.875+0.675+0.575+0.525)=15.90\) months.
The estimated RMST difference is \(15.90-15.30=0.60\) months in favor of treatment through month 24. This descriptive contrast does not supply a standard error or a significance test, and the piecewise-linear approximation is illustrative. It shows why the horizon must be stated: the RMST difference is defined through month 24, while another horizon could give a different contrast. It also illustrates why a single hazard ratio can be a poor summary when survival curves cross.
Combining Stagewise Evidence
A simple way to combine stagewise evidence is the inverse-normal method. For each stage \(k\), let \(p_k\) be a valid one-sided p-value in the direction favoring treatment, and define \(Z_k=\Phi^{-1}(1-p_k)\). If the stagewise tests are independent under the null and the weights \(a_k\) are fixed in advance, the combined statistic is
Its null calibration follows directly. Under the null, each \(Z_k\) is approximately standard normal; independent stage data make the \(Z_k\) independent. Therefore the weighted sum has mean zero and variance \(\sum_k a_k^2\). Dividing by its standard deviation gives an approximately standard normal statistic. For a one-sided test at level \(\alpha\), reject \(H_0\) when \(Z_{\mathrm{comb}}>z_{1-\alpha}\), where \(z_{1-\alpha}\) is the \(1-\alpha\) standard-normal quantile.
This calculation assumes the stagewise p-values test the same directional confirmatory claim and are valid after any selection or adaptation. The simple formula also assumes independent stagewise evidence and fixed combination weights. Reusing participants across stages, choosing weights based on interim results, or selecting among several treatments can change the null distribution. Such designs require a procedure calibrated for that dependence or adaptation; the fixed-weight formula should not simply be applied as if nothing changed.
Worked Example: Combining Two Stagewise Survival Tests
Hypothetical data. Suppose a trial has two nonoverlapping stages, and the prespecified late-emphasis test is used in both. Assume the Stage 1 result above supplies \(p_1=0.0368\), a separate independent Stage 2 analysis gives \(Z_2=1.500\), and hence \(p_2=1-\Phi(1.500)=0.0668\). Assume selection, if any, has already been handled so these are valid stagewise p-values for the confirmatory claim. Use fixed equal weights \(a_1=a_2=1\).
The inverse-normal statistic is
The one-sided combined p-value is approximately \(1-\Phi(2.326)=0.0100\). At a prespecified one-sided level of \(\alpha=0.025\), the result is significant because \(2.326>z_{0.975}=1.960\). The conclusion is evidence favoring treatment under the chosen late-emphasis survival test. It is not evidence that the hazard ratio is constant, nor is it an estimate of the number of months gained.
Design Checks, Alternatives, and Common Mistakes
Before the trial begins, the analysis plan should make the test reproducible: state the weight function, the time origin, the event definition, the analysis horizon, censoring assumptions, the direction of benefit, the stagewise p-value method, and the rule for combining evidence. Check that event accrual and follow-up will provide information at the times the weights emphasize. A late-emphasis test is uninformative if follow-up ends before enough late events occur.
Diagnostics should examine whether the observed survival curves and estimated hazards suggest substantial time variation, whether censoring differs in ways that undermine independent censoring, and whether the prespecified weights align with the intended clinical pattern. These checks help explain results; they do not license choosing a new weight after seeing confirmatory outcomes and then reporting its ordinary p-value. If a prespecified weighted test and the observed pattern disagree, report that discrepancy rather than silently changing the confirmatory test.
| Approach | What it emphasizes or estimates | Key limitation |
|---|---|---|
| Ordinary log-rank test | Compares event experience with equal event-time weighting | May lose sensitivity when effects vary or reverse over time |
| Weighted log-rank test | Emphasizes event times specified by its weight function | Its conclusion depends on the chosen weighting; it does not give a universal effect size |
| RMST contrast | Difference in average survival time accumulated through a stated horizon | The horizon must be chosen, and the contrast changes with that horizon |
A common mistake is to inspect the survival curves, select the weight that gives the smallest p-value, and call that result confirmatory. The reasoning is that the selected test “best matches” the data. The correction is that selection among tests uses the data twice and generally inflates the type I error unless the selection is included in the calibration. Prespecify the test and its clinical rationale, or use an analysis that accounts for the data-dependent choice.
Other limitations remain. Weighted log-rank tests can have low power if their weights emphasize the wrong period or if treatment effects change direction in a way that cancels even after weighting. Large-sample normal approximations may be unreliable with few events. In addition, neither a stagewise combination rule nor a nonproportional-hazards test repairs informative censoring, an invalid selection adjustment, or an ill-defined endpoint. The confirmatory conclusion is only as credible as these design and analysis assumptions.
Check Your Understanding
Answer each question, then compare with the brief solutions below.
- If treatment reduces early events but increases late events, why might the ordinary log-rank test be a poor match to a late-benefit clinical question?
- A stagewise weighted log-rank score is \(U_w=-3.00\) with \(V_w=4.00\). What is \(Z_w\), and which direction does it favor?
- Two independent stages have \(Z_1=1.00\) and \(Z_2=2.00\), combined with fixed equal weights. Calculate the inverse-normal statistic.
- Why is a late-emphasis weighted log-rank test not, by itself, an estimate of months of survival gained?
- What is wrong with choosing a weight function after reviewing confirmatory-stage results and reporting its unadjusted p-value?
Solutions. (1) Equal event-time weighting can let early and late differences offset, whereas the question prioritizes later outcomes; a prespecified late-emphasis test may better align with that question. (2) \(Z_w=-(-3.00)/\sqrt{4.00}=1.50\), so it favors treatment under the stated sign convention. (3) \(Z_{\mathrm{comb}}=(1.00+2.00)/\sqrt{2}=2.121\). (4) The weighted test is a test based on weighted event-time contrasts; months gained is a time-based effect measure such as an RMST difference through a stated horizon. (5) Choosing weights after seeing the results makes the test data-dependent and can inflate type I error; prespecify the weights or calibrate for the selection.