Tutorials › Group Sequential Methods and Sample Size Re-Estimation › Co-Primary Endpoints Under Group Sequential Testing

Multiple Endpoints Across Interim Looks · Tutorial 617 of 699

Co-Primary Endpoints Under Group Sequential Testing

Formulate an all-endpoints success rule, justify its error control under sequential monitoring, and assess how interim looks affect the chance and timing of a joint co-primary claim.

Advanced 11 min read

What You'll Learn

  • Define the joint alternative and success rule for co-primary hypotheses.
  • Explain why requiring rejection of every co-primary null controls the joint type I error.
  • Apply endpoint-specific group sequential boundaries across interim looks.
  • Distinguish an endpoint crossing from success of the overall co-primary claim.
  • Calculate joint power under independence and identify when marginal powers are insufficient.
  • Diagnose common errors in alpha allocation, monitoring, and interpretation.

Why Co-Primary Endpoints Require a Joint Decision

A study with co-primary endpoints is designed to support its principal efficacy conclusion only if every required endpoint demonstrates benefit. For example, a hypothetical treatment might need to improve both symptom severity and physical function. A strong result on symptoms does not compensate for a failure on function if both are necessary to justify the intended claim.

Group sequential monitoring adds a second dimension to this requirement. Each endpoint may be assessed at several planned interim looks, and it may cross its efficacy boundary at a different look from the other endpoints. The design must therefore specify both how each endpoint is tested over time and when the combined co-primary conclusion is allowed.

Definition: For \(m\) co-primary endpoints, let \(H_{0j}\) be the null hypothesis for endpoint \(j\), and \(H_{aj}\) its efficacy alternative, for \(j=1,\ldots,m\). The co-primary alternative is the intersection \(H_{a1}\cap\cdots\cap H_{am}\): the intended claim requires efficacy on every endpoint. The corresponding null for the joint claim is the union \(H_{01}\cup\cdots\cup H_{0m}\): at least one endpoint fails to meet its efficacy alternative.

For a one-sided efficacy test on endpoint \(j\), let \(Z_{jk}\) be its test statistic at interim look \(k\), and let \(b_{jk}\) be the prespecified upper efficacy boundary at that look. The endpoint is rejected if its statistic crosses a boundary at any permitted look. Write \(R_j=1\) if endpoint \(j\) is rejected by the planned end of monitoring and \(R_j=0\) otherwise. The overall study succeeds only if every endpoint is rejected.

$$ R_{\mathrm{joint}}=1 \quad\Longleftrightarrow\quad R_j=1\ \text{for every }j=1,\ldots,m. $$

In an implementation, the first crossing for each endpoint is recorded as a rejection; a later value that falls below the boundary does not undo it. The trial may stop for efficacy as soon as all required endpoints have crossed. If one or more have not crossed by the final planned look, the co-primary success criterion is not met, even if the remaining endpoints have shown strong evidence.

Sequential Error Control for the Joint Claim

Suppose each endpoint's group sequential test controls its type I error at level \(\alpha\) over all its planned looks. This means that, when \(H_{0j}\) is true, the probability that endpoint \(j\) crosses an efficacy boundary at any look is at most \(\alpha\). This component-level guarantee must be valid for the actual monitoring plan, including its boundary calibration, information times, and any permitted changes to the plan.

No assumption that endpoint statistics are independent is needed to control the type I error of the joint co-primary claim. If the joint null is true, at least one component null, say \(H_{0r}\), is true. Joint success requires rejecting that true component null. Therefore the event of a false joint claim is contained in the event of rejecting \(H_{0r}\), which has probability at most \(\alpha\).

$$ P(\text{false joint claim}) =P(R_1=\cdots=R_m=1) \leq P(R_r=1) \leq \alpha, \qquad \text{when } H_{0r}\text{ is true}. $$

This is the intersection-union logic of co-primary testing: the overall alternative requires all component alternatives, so the study declares success only after rejecting every component null. It explains why one does not automatically divide \(\alpha\) among co-primary endpoints to control the type I error of this single, all-endpoints claim. Each component test can use level \(\alpha\), provided its sequential procedure is itself valid at that level.

This conclusion is specific to the joint success claim. It does not mean that one may make an unrestricted collection of separate endpoint claims at level \(\alpha\). If the intended conclusion includes claims such as “the treatment is effective on endpoint 1” even when endpoint 2 fails, those component claims form a different inferential objective and require an appropriate multiplicity procedure.

A Simple Valid Boundary Construction

A group sequential design will usually choose boundaries that account for the correlation of repeated statistics across looks and allocate error over time using a prespecified spending rule. As a transparent conservative construction, consider \(K\) looks for one endpoint, with a one-sided marginal \(Z\)-statistic that is standard normal under its null at each look. Testing each look at level \(\alpha/K\) gives the endpoint a sequential type I error no greater than \(\alpha\), by the union bound:

$$ P_{H_{0j}}(\text{cross at any look}) \leq \sum_{k=1}^{K}P_{H_{0j}}(Z_{jk}>c) \leq K\frac{\alpha}{K} =\alpha, \qquad c=\Phi^{-1}\!\left(1-\frac{\alpha}{K}\right). $$

This construction is valid without assuming independence across looks, because it bounds the probability of the union of crossing events by the sum of their probabilities. It is generally conservative: standard group sequential boundaries can use the joint distribution of statistics across looks to avoid paying the full union-bound penalty. Either way, it is the validity of each endpoint's whole sequential test—not a nominal single-look threshold by itself—that supports the joint error-control argument.

Worked Example: Two Co-Primary Endpoints and Two Looks

Hypothetical design. A trial has two one-sided co-primary endpoints and two planned looks. It uses \(\alpha=0.05\) for each endpoint. For an easily checked conservative design, it tests each look at \(\alpha/2=0.025\). The standard-normal critical value is \(c=\Phi^{-1}(0.975)=1.960\). Under each endpoint null, assume the \(Z\)-statistic at each look has a standard normal marginal distribution; the union-bound argument above then gives sequential type I error at most 0.05 per endpoint.

At look 1, suppose the symptom endpoint has \(Z_{11}=2.10\), while the function endpoint has \(Z_{21}=1.70\). Since \(2.10>1.960\), the symptom endpoint crosses its efficacy boundary. Since \(1.70<1.960\), function has not crossed. There is not yet a co-primary success.

At look 2, suppose \(Z_{12}=1.85\) and \(Z_{22}=2.20\). The symptom statistic is below the boundary at this look, but that does not reverse its earlier rejection. Function now crosses because \(2.20>1.960\). Both endpoint nulls have therefore been rejected by the end of look 2, so the prespecified joint success criterion is met. Under the joint null, its false-success probability is at most 0.05 by the containment argument, regardless of dependence between the two endpoints or between their looks.

Interim Timing and the Probability of Joint Success

The joint type I error bound is not a statement about power. Power for the co-primary claim is the probability that all required endpoint tests reject when all corresponding alternatives are true. It depends on the endpoint effects, information accrued at each look, boundary choices, and dependence among the endpoint statistics.

For each endpoint, define \(T_j\) as the first look at which its efficacy boundary is crossed; set \(T_j=\infty\) if it never crosses by the final look. The joint stopping look for efficacy is the latest of the endpoint crossing times, provided all are finite. Thus early crossing on one endpoint can reduce neither the evidence requirement nor the information needed on another: the study cannot make the joint claim until the last required endpoint has crossed.

If the endpoint processes are independent under a specified alternative, then their joint power is the product of their individual sequential powers. Without independence, marginal powers alone do not determine joint power. For two events with marginal probabilities \(p_1\) and \(p_2\), their intersection probability can range from \(\max(0,p_1+p_2-1)\) to \(\min(p_1,p_2)\). Correlated endpoint statistics and shared interim data can therefore materially alter the chance of meeting the all-endpoints criterion.

Worked Example: Joint Power Under Independence

Hypothetical operating characteristics. Suppose a two-endpoint design has two planned looks, and under a specified alternative its sequential power is 0.80 for endpoint 1 and 0.75 for endpoint 2. These probabilities are assumed to include crossing at either look. Assume the endpoint crossing processes are independent under this alternative.

The joint study succeeds only when both endpoints cross by the final look. Independence gives

$$ P(\text{joint success}) =P(R_1=1,R_2=1) =P(R_1=1)P(R_2=1) =(0.80)(0.75)=0.600. $$

Thus the joint power is 60.0%, not 80.0% or 75.0%. If independence were not justified, the marginal values alone would only imply the bounds

$$ \max(0,0.80+0.75-1)=0.55 \leq P(R_1=1,R_2=1) \leq \min(0.80,0.75)=0.75. $$

The interim schedule affects the marginal crossing probabilities and the distribution of the time by which all endpoints have crossed. A design report should therefore distinguish endpoint-specific sequential power from joint power and should state the dependence model used for any joint-power calculation.

What Interim Monitoring Changes—and What It Does Not

For co-primary endpoints, interim monitoring changes the opportunities to establish each endpoint's efficacy and can change when the joint claim becomes available. It does not change the logical form of the claim: every required endpoint must still be rejected. If one endpoint crosses early and another crosses later, joint success occurs only at the later crossing. If any endpoint never crosses, no joint success is declared.

The principal alternatives are different testing objectives, not interchangeable ways of stating the same objective. A co-primary rule is an intersection-union test for a single all-endpoints claim. A procedure that allocates alpha across endpoints, such as a Bonferroni procedure, is often used when separate endpoint rejections themselves support claims and familywise control is required. Graphical procedures can specify how testing levels change after rejections when the aim includes a broader family of claims. For the co-primary joint claim, such allocation is not required solely to control the probability of falsely declaring that all endpoints are effective; it may still be required by a different claim structure or protocol commitment.

Key takeaway: Calibrate a valid sequential test for each co-primary endpoint, then declare overall efficacy only when every endpoint has crossed its prespecified boundary. This controls the false joint claim at level \(\alpha\), but joint power and the timing of success depend on the joint behavior of the endpoint processes.

Diagnostics, Pitfalls, and Limitations

  • Using a single-look threshold at every look. Repeatedly checking an ordinary level-\(\alpha\) test generally inflates that endpoint's type I error. Use boundaries or a spending rule calibrated for the complete monitoring schedule.
  • Splitting alpha automatically across co-primary endpoints. That is not needed solely for the all-endpoints claim, because a false joint success entails rejection of at least one true component null. It may be needed for a different goal involving separate endpoint claims.
  • Calling the trial successful when only some endpoints cross. A co-primary design requires every endpoint. Report which endpoint did not meet its criterion and do not replace the prespecified joint rule with a favorable subset after seeing results.
  • Undoing a prior crossing after a later statistic falls. Under a standard sequential rejection rule, crossing is the endpoint's rejection event. A later statistic below the boundary does not erase that event; any alternative rule must be specified and calibrated in advance.
  • Multiplying marginal powers without checking dependence. The product is justified only under independence of the relevant endpoint rejection events under the alternative. Otherwise use a joint model or simulation consistent with the design.
  • Ignoring endpoint-specific information or missing results. If endpoints mature at different times, or a required endpoint is unavailable at a look, the all-endpoints claim cannot be treated as met by the available results. The planned handling of delayed or missing endpoint information must be followed.

The simple error-control result also has limits. It assumes the component sequential tests really do control their stated levels under the nulls, and that the endpoint hypotheses and efficacy directions have been prespecified. It does not validate a boundary after unplanned looks, changes in the analysis, or data-dependent endpoint selection. Nor does type I error control guarantee adequate joint power: when several endpoints must all succeed, the overall probability of success may be substantially lower than any individual endpoint's power.

Worked Example: One Endpoint Fails to Cross

Hypothetical design. Use the same two-look, one-sided construction as before: \(\alpha=0.05\) per endpoint, with the conservative boundary \(1.960\) at both looks. Suppose endpoint A has \(Z_{A1}=2.05\) and endpoint B has \(Z_{B1}=1.55\). At the final look, let \(Z_{A2}=2.30\) and \(Z_{B2}=1.90\). Assume the endpoint statistics have standard normal marginals under their respective nulls, as required for the stated construction.

Endpoint A crosses at look 1 because \(2.05>1.960\), and its rejection remains recorded. Endpoint B is below the boundary at look 1 and remains below it at the final look because \(1.90<1.960\). Consequently, B has not been rejected and the joint co-primary rule is not met. It would be incorrect to declare overall success because A is significant or because B's final statistic appears close to the boundary. The prespecified sequential decision is based on crossing, not on proximity.

Check Your Understanding

Answer each question using the all-endpoints success rule and the stated monitoring design.

  1. There are three co-primary endpoints, each tested sequentially at level \(\alpha=0.05\). Under the joint null, at least one component null is true. Explain why the probability of a false joint claim is at most 0.05 without assuming endpoint independence.
  2. Two endpoints have sequential powers 0.90 and 0.70 under a specified alternative. If their rejection events are independent, calculate joint power. If independence is not assumed, give the general lower and upper bounds from these marginals.
  3. A component test has two looks and uses a one-sided level of 0.04 per endpoint. Using the equal Bonferroni allocation across looks, find the per-look tail probability and approximate standard-normal boundary.
  4. In a two-endpoint study, endpoint 1 crosses at the first look. Endpoint 2 never crosses by the final look. What is the conclusion about the co-primary claim, and does endpoint 1's crossing need to be reversed?

Solutions. (1) At least one null, say \(H_{0r}\), is true under the joint null. False joint success requires rejecting every endpoint, so it is contained in the event \(R_r=1\). Hence \(P(\text{false joint claim})\leq P(R_r=1)\leq0.05\). No independence assumption is used. (2) Under independence, joint power is \((0.90)(0.70)=0.63\), or 63%. Without independence, it lies between \(\max(0,0.90+0.70-1)=0.60\) and \(\min(0.90,0.70)=0.70\). (3) Each look receives \(0.04/2=0.02\); the one-sided boundary is \(\Phi^{-1}(0.98)\approx2.054\). The marginal standard-normal assumption at each look makes the union-bound construction valid. (4) The joint claim is not met because endpoint 2 did not cross. Endpoint 1's earlier crossing remains a rejection under the prespecified sequential rule and is not reversed.

Clinical Biostats