Tutorials › Model-Informed Drug Development (MIDD) › Composite and Hierarchical Endpoints With Unequal Component Effects

Model-Based Endpoint and Sample Size Planning · Tutorial 318 of 596

Composite and Hierarchical Endpoints With Unequal Component Effects

Compare composite and hierarchical endpoints by calculating how their component risks, dependence, and treatment effects influence the overall contrast and its power.

Advanced 13 min read

What You'll Learn

  • Calculate a binary composite event probability from component risks and their overlap.
  • Explain why marginal treatment effects alone may not determine a composite effect.
  • Estimate sample size for a simple two-arm comparison of composite event risks.
  • Calculate wins, losses, and ties for a two-component prioritized endpoint.
  • Identify assumptions and diagnostics that matter when planning composite or hierarchical endpoints.
  • Distinguish an overall endpoint effect from the effects and clinical importance of its components.

Why component effects matter

A trial endpoint may combine several outcomes to increase the number of informative events or to reflect more than one way a patient can benefit. But a single summary can hide important differences: components may occur at very different rates, overlap in the same patients, differ in clinical importance, and respond differently to treatment. An overall treatment contrast is therefore not interpretable from the endpoint label alone. Its meaning depends on the rule used to combine components and on the joint distribution of those components.

This tutorial focuses on two approaches. A composite endpoint defines one event or score from multiple components, commonly counting a patient as having the event if any component occurs. A hierarchical endpoint compares outcomes in a prespecified order of clinical priority; a comparison on a lower-priority component matters only when the higher-priority comparison is tied. These rules answer different questions and generally have different power characteristics.

Definition: For components \(A\) and \(B\), a binary “\(A\) or \(B\)” composite is positive if either component is present. A two-component hierarchical comparison first compares patients on the higher-priority component; it compares them on the second component only if they tie on the first. The component definitions, direction of benefit, priority, and assessment time must be prespecified.

Composite endpoints: prevalence, overlap, and unequal effects

Let \(A\) and \(B\) denote binary component events measured on each participant. For an “\(A\) or \(B\)” endpoint, the probability of a composite event in a treatment arm is

$$ p_{A\cup B}=P(A\cup B)=p_A+p_B-p_{AB}, \qquad p_{AB}=P(A\cap B). $$

The subtraction avoids counting participants with both events twice. The composite probability is not determined by the two marginal probabilities \(p_A\) and \(p_B\) unless their overlap is also known. Across randomized arms, the treatment contrast in composite risk is

$$ \Delta_{\mathrm{comp}} =(p_{A,T}-p_{A,C})+(p_{B,T}-p_{B,C})-(p_{AB,T}-p_{AB,C}), $$

where \(T\) and \(C\) denote treatment and control. Thus, even the component risk differences do not by themselves determine the composite risk difference: the change in overlap also matters. A component that is common can contribute many events, while a rare component may contribute little to the total event count. Neither fact establishes its clinical importance.

For a simple planning calculation, suppose participants are independently randomized in equal numbers, each participant contributes one binary composite outcome, and the planned analysis compares the two arm-specific event proportions. Assume a fixed assessment time, complete outcome ascertainment, and no clustering. Under these conditions, a usual large-sample approximation for the number \(n\) per arm for a two-sided test is

$$ n \approx \frac{ \left[ z_{1-\alpha/2}\sqrt{2\bar p(1-\bar p)} +z_{1-\beta}\sqrt{p_T(1-p_T)+p_C(1-p_C)} \right]^2 }{(p_T-p_C)^2}, \qquad \bar p=\frac{p_T+p_C}{2}. $$

Here \(\alpha\) is the type I error rate, \(1-\beta\) is the target power, and the \(z\) values are standard normal quantiles. This approximation plans power for the specified composite contrast, not for each component separately. It relies on the proposed risks being credible and on the analysis matching the stated comparison.

Worked Example: Unequal Effects in a Binary Composite

Suppose a hypothetical trial defines its endpoint as the occurrence of either hospitalization (component \(A\)) or symptom worsening (component \(B\)) by a fixed follow-up visit. In control, let \(p_{A,C}=0.20\), \(p_{B,C}=0.30\), and \(p_{AB,C}=0.10\). In treatment, let \(p_{A,T}=0.10\), \(p_{B,T}=0.27\), and \(p_{AB,T}=0.07\). These joint probabilities are feasible because each overlap is no greater than either corresponding marginal probability.

The control composite risk is \(0.20+0.30-0.10=0.40\). The treatment composite risk is \(0.10+0.27-0.07=0.30\). The risk difference, treatment minus control, is \(0.30-0.40=-0.10\), a 10-percentage-point lower composite event risk in treatment. The component risk differences are \(-0.10\) for hospitalization and \(-0.03\) for symptom worsening; the overall contrast does not imply equal effects on both components.

For an illustrative equal-allocation calculation with two-sided \(\alpha=0.05\) and 80% power, use \(z_{0.975}=1.96\), \(z_{0.80}=0.842\), and \(\bar p=(0.30+0.40)/2=0.35\):

$$ n \approx \frac{\left[ 1.96\sqrt{2(0.35)(0.65)} +0.842\sqrt{(0.30)(0.70)+(0.40)(0.60)} \right]^2}{(0.30-0.40)^2} $$

The first square root is \(\sqrt{0.455}=0.6745\); the second is \(\sqrt{0.45}=0.6708\). Therefore \(n\approx[(1.96)(0.6745)+(0.842)(0.6708)]^2/0.01=(1.322+0.565)^2/0.01\approx356\) participants per arm. This is an approximate planning result for the composite risk difference. It does not establish adequate power for either component on its own.

Why dependence changes the planning picture

Dependence affects how many distinct participants experience at least one component. For fixed marginal risks, more overlap means fewer distinct composite events. It can also affect the treatment contrast if overlap differs between arms. This is why planning from component prevalences alone can misstate the composite risk and the expected treatment effect.

Worked Example: Same Marginal Risks, Different Overlap

Consider two hypothetical scenarios with control risks \(p_{A,C}=0.10\), \(p_{B,C}=0.40\) and treatment risks \(p_{A,T}=0.05\), \(p_{B,T}=0.35\). In both scenarios each component risk is 5 percentage points lower on treatment. In scenario 1, suppose the overlaps are \(p_{AB,C}=0.08\) and \(p_{AB,T}=0.04\). Then control composite risk is \(0.10+0.40-0.08=0.42\), treatment composite risk is \(0.05+0.35-0.04=0.36\), and the treatment-minus-control difference is \(-0.06\).

In scenario 2, suppose instead that the overlaps are \(0.02\) in both arms. The composite risks are \(0.10+0.40-0.02=0.48\) in control and \(0.05+0.35-0.02=0.38\) in treatment; the difference is \(-0.10\). Both sets of overlaps are feasible given the marginal probabilities. The component risk differences are identical across scenarios, yet the composite risk difference differs by 4 percentage points because the overlap pattern differs.

This calculation is not evidence that one overlap pattern will occur in a future trial. It shows why the joint distribution, not only the marginal event rates, belongs in the planning assumptions.

A practical justification follows directly from the identity \(P(A\cup B)=p_A+p_B-p_{AB}\): subtracting the two arms’ identities gives the composite contrast formula above. If overlap is unknown, a planner must either obtain defensible joint data, consider plausible overlap scenarios, or use simulation under an explicitly specified joint model. Assuming independence is one possible scenario, not a default truth; under independence \(p_{AB}=p_Ap_B\), an assumption that should be checked against available clinical knowledge or data.

Hierarchical endpoints: priority, wins, and ties

A hierarchical endpoint retains an explicit priority order rather than treating every component event as interchangeable. In a pairwise comparison, one participant from treatment is compared with one from control. If the treatment participant has a better outcome on the highest-priority component, that pair is a treatment win; if worse, it is a loss. Only a tie on that component permits comparison on the next component. A final tie is possible if the pair ties on all ranked components.

Definition: Let \(W\) be the probability that an independently selected treatment participant wins a treatment-control pair under the specified hierarchy, and \(L\) the probability of a loss. The win ratio is \(W/L\), when \(L>0\); the net win probability is \(W-L\). A win ratio greater than 1 favors treatment under this comparison rule, but does not mean that every component favors treatment.

The hierarchy’s power depends on how frequently comparisons are decided at each level, as well as on the treatment effects at those levels. A common, highly prioritized component may decide many pairs before lower-priority outcomes are considered. A less common component may influence relatively few pairs even if its treatment effect is large. Conversely, a lower-priority component can contribute useful information when many pairs tie on higher-priority outcomes. Component dependence affects the frequency of those ties and the outcomes observed among them.

Worked Example: Calculating Wins Under a Two-Level Hierarchy

Suppose a hypothetical endpoint ranks absence of a serious event first, followed by symptom response. For this arithmetic example only, assume that serious-event status and symptom response are independent within each arm, and that treatment and control participants are independently sampled. Let serious-event risks be 0.10 on treatment and 0.20 on control, with lower risk better. Let symptom-response probabilities be 0.60 on treatment and 0.40 on control, with response preferred.

A treatment participant wins at level 1 if they have no serious event and the control participant has one: \(0.90\times0.20=0.18\). A loss at level 1 has probability \(0.10\times0.80=0.08\). The probability of a tie on serious-event status is \(0.90\times0.80+0.10\times0.20=0.74\).

Under the stated independence assumption, within those tied pairs the probability of a symptom-response win is \(0.60\times(1-0.40)=0.36\), and the probability of a loss is \((1-0.60)\times0.40=0.16\). Thus total win probability is \(W=0.18+(0.74)(0.36)=0.4464\), and loss probability is \(L=0.08+(0.74)(0.16)=0.1984\). The remaining probability is a tie: \(1-W-L=0.3552\). The win ratio is \(0.4464/0.1984\approx2.25\), and the net win probability is \(0.4464-0.1984=0.2480\).

These quantities describe pairwise outcomes under this particular hierarchy and these assumed distributions. They are not component-specific treatment effects, and this calculation alone does not provide a trial’s power. In real planning, dependence between components can change the probabilities among pairs tied at level 1. The example’s independence assumption is what permits the simple multiplication.

Planning, interpretation, and diagnostics

For either endpoint type, begin by stating the clinical question and the exact outcome rule. A composite asks about the probability, rate, or other summary of the defined combined event. A hierarchy asks how often treatment wins or loses under a specified ordering. These are different estimands, so choosing one should not be treated as a purely statistical way to increase power.

1
Define each component.
Specify the event or measurement, direction of benefit, assessment period, and how a participant with multiple events is classified.
2
Specify the combining rule.
For a composite, state whether any event, all events, or another rule defines the endpoint. For a hierarchy, state the priority order and how ties are resolved.
3
Quantify component distributions.
Plan with plausible marginal prevalences or distributions, overlap or dependence, and treatment effects that may differ by component.
4
Calculate and interpret the planned contrast.
Use a method matched to the endpoint and analysis. Check that the resulting contrast answers a clinically meaningful question and that component results will not be obscured by the summary.

For binary composites, useful diagnostics include checking that proposed joint probabilities are feasible, calculating the implied composite rate separately in each arm, and confirming that the assumed risk difference has the intended sign and size. Compare implied rates with relevant historical or pilot data. For hierarchical endpoints, tabulate or simulate the expected proportions of wins, losses, and ties at each priority level. A large fraction of pairs decided at the first level means later components have limited influence on the overall comparison.

When dependence or the hierarchy’s win distribution makes a simple formula unreliable, simulate complete participant outcomes under the proposed joint distributions, apply the prespecified endpoint algorithm to each simulated trial, and estimate the proportion meeting the planned rejection rule. The simulation must represent the analysis and type I error target actually intended. It should include plausible alternatives for component effects and dependence, because a single assumed joint distribution can give a misleading impression of power.

No combined endpoint makes unequal component effects disappear. Report and interpret the overall result alongside component-specific event rates or comparisons, while recognizing that these component analyses may have different precision and may not have been powered for confirmatory conclusions. A statistically favorable composite may be driven mainly by a frequent, less consequential component; a neutral composite may also conceal divergent component effects. The endpoint should be judged against the clinical importance and interpretation of its components, not only against the anticipated power.

Common mistakes and limitations

  • Adding component risks without subtracting overlap. For an “A or B” endpoint, use \(p_A+p_B-p_{AB}\). Adding marginal risks double-counts participants with both events.
  • Assuming marginal effects determine the composite effect. They do not if overlap changes across arms. Specify or vary the joint probabilities.
  • Calling a composite effect a uniform component effect. The contrast is for the combined endpoint; components can have unequal, null, or opposing effects.
  • Interpreting a hierarchy as an ordinary average. Priority rules decide which component is considered for each pair; they do not assign a fixed numerical weight to each component.
  • Using pair counts as independent observations. In a trial, many pairwise comparisons share participants. Treating all pairs as independent generally gives an incorrect variance and power calculation; use an appropriate variance method or trial-level simulation.

Composite endpoints can be sensitive to component definitions, event ascertainment, and the chosen assessment period. Hierarchical endpoints depend on the priority order and may leave lower-ranked outcomes with little influence when higher-ranked outcomes frequently decide pairs. Both approaches summarize multiple outcomes, so they can trade a single interpretable endpoint for less visibility into the separate clinical effects. Their power estimates are conditional on the assumed component distributions, dependence, analysis method, and trial design; they are not guarantees of realized power.

Check Your Understanding

Answer each question, then compare with the solutions below.

  1. In an “A or B” endpoint, \(p_A=0.25\), \(p_B=0.20\), and \(p_{AB}=0.08\). What is the composite event probability?
  2. Two treatment arms have the same component risk differences, but the overlap changes between arms. Can the composite risk difference still change? Explain briefly.
  3. In a hierarchical endpoint, what does a tie on the first component permit, and what does it not imply?
  4. For a pairwise hierarchy, \(W=0.40\) and \(L=0.20\). Calculate the win ratio and net win probability and interpret them.
  5. Name one reason a binary-composite sample-size calculation may fail to represent the planned trial.

Solutions. (1) \(0.25+0.20-0.08=0.37\), or a 37% composite event probability. (2) Yes. The composite risk difference includes the negative of the between-arm difference in overlap, so changing overlap can change the composite contrast even when both marginal risk differences are fixed. (3) It permits comparison on the next-priority component; it does not mean the participants are equal on all outcomes or that lower-priority effects are irrelevant in every pair. (4) The win ratio is \(0.40/0.20=2.00\), and the net win probability is \(0.40-0.20=0.20\). Under the specified hierarchy, wins are twice as likely as losses, with a 20-percentage-point excess of wins over losses; this is not a statement that every component favors treatment. (5) For example, the calculation may assume complete ascertainment, a fixed assessment time, independent participants, or a risk difference analysis when the actual trial violates that assumption or uses a different analysis.