Tutorials › Adaptive Clinical Trial Design › Composite Estimands for Treatment Discontinuation

Estimand Preservation Under Adaptation · Tutorial 25 of 799

Composite Estimands for Treatment Discontinuation

Build and interpret composite endpoints for discontinuation while keeping the target treatment contrast explicit and clinically meaningful.

Advanced 10 min read

What You'll Learn

  • Define a composite strategy for treatment discontinuation and distinguish it from missing-data handling.
  • Specify a composite variable, treatment contrast, population, and event window.
  • Derive how a binary composite success probability combines discontinuation and clinical response.
  • Calculate treatment contrasts and uncertainty for hypothetical binary composite outcomes.
  • Recognize how a composite contrast can reflect both clinical response and discontinuation.
  • Compare composite, treatment-policy, and hypothetical strategies without changing the target mid-trial.

Why Put Discontinuation Into the Outcome?

If participants discontinue assigned treatment, a trial must specify how that event relates to the outcome it aims to compare. A composite strategy makes discontinuation part of the outcome definition. For example, a participant may count as a treatment failure if they discontinue before the endpoint visit, even if their later clinical outcome is known. The resulting contrast answers a question about a combined outcome, not solely about clinical response among participants who remain on treatment.

This choice is relevant in adaptive trials because adaptations can change allocation, follow-up, or other features of trial conduct. The estimand remains interpretable only if its target population, treatment conditions, event handling, outcome definition, and summary are kept explicit. In particular, changing the rule for discontinuation partway through a trial can change what the treatment contrast means.

Definition: A composite strategy handles an intercurrent event by incorporating it into the outcome variable. For treatment discontinuation, the endpoint might define any discontinuation before a specified time as failure, or assign a prespecified outcome value or rank to discontinuation. The treatment contrast then compares the distributions or summaries of these composite outcomes in the target population.

Specify the Composite Before Estimating It

A useful specification states which discontinuations count, when they count, and exactly how they enter the endpoint. “Discontinuation” alone is not sufficiently precise. A protocol should say whether discontinuation includes stopping all assigned treatment, switching treatment, or stopping for particular reasons; whether the event must occur before the endpoint time; and whether a participant who restarts treatment is still classified as having discontinued. It should also state how discontinuation is combined with the clinical outcome.

For a binary endpoint, one straightforward definition is success only if the participant meets the clinical response criterion and has not discontinued by the endpoint time. If \(D=1\) denotes discontinuation by that time and \(R=1\) denotes clinical response, define composite success as \(Z=1\) when \(D=0\) and \(R=1\); otherwise \(Z=0\). For a continuous measure, a rule might assign a specified low value to discontinuation. That value must have a defensible interpretation on the outcome scale.

The composite endpoint is not the same thing as a missing-data rule. A recorded discontinuation can be incorporated into the endpoint even when the clinical outcome after discontinuation is unavailable. But if a participant does not discontinue and their endpoint assessment is missing, the composite may still be missing: the protocol needs a separate plan for that case. Nor does a composite rule imply that the clinical outcome after discontinuation is irrelevant for every possible estimand. It means that the chosen endpoint has defined that event as part of its outcome.

Key distinction: A composite strategy assigns a defined outcome to the intercurrent event. A treatment-policy strategy instead uses the outcome regardless of the event, when that outcome is available and defined. A hypothetical strategy targets an outcome under a specified scenario in which the event did not occur. These strategies generally answer different questions.

A Binary Composite: Definition and Interpretation

Let \(a\) denote a randomized treatment condition. Let \(D^a\) indicate whether a participant would discontinue assigned treatment by week 12 under that condition, and let \(R^a\) indicate whether they would meet the response criterion by week 12. Define \(Z^a=1\) if \(D^a=0\) and \(R^a=1\), and \(Z^a=0\) otherwise. The population-level estimand may be the risk difference in composite success:

$$ \Delta_Z=P(Z^{1}=1)-P(Z^{0}=1). $$

Here \(Z^1\) and \(Z^0\) refer to the composite outcomes under the two treatment conditions in the fixed target population. A positive \(\Delta_Z\) means a higher probability of meeting the combined success definition under treatment 1. It does not, by itself, isolate a treatment effect on the clinical response criterion.

The relationship to response and discontinuation can be shown directly. Because composite success requires both no discontinuation and response, the multiplication rule for probabilities gives:

$$ P(Z^a=1)=P(D^a=0,\ R^a=1) =P(D^a=0)\,P(R^a=1\mid D^a=0). $$

Thus, the composite success probability depends on both the probability of remaining on assigned treatment and the response probability among those who do not discontinue. The second factor is a conditional probability, not automatically a causal treatment effect among a comparable group: who discontinues may differ between treatment conditions. The composite contrast avoids defining the target as a comparison restricted to observed non-discontinuers, but it combines distinct ways of achieving or failing the endpoint.

Worked Example: Week-12 Composite Response

Hypothetical data. In a randomized trial, 120 participants are assigned to each of two treatment conditions. The prespecified composite defines success as meeting a symptom-response threshold at week 12 without discontinuing assigned treatment before that visit. Suppose 54 participants in condition 1 and 39 in condition 0 meet this full definition. Assume each participant's discontinuation status and response status are ascertained sufficiently to classify this composite, and that the randomized groups are analyzed as assigned.

The estimated composite-success risks are:

$$ \hat{p}_1=\frac{54}{120}=0.450,\qquad \hat{p}_0=\frac{39}{120}=0.325. $$

The estimated risk difference is:

$$ \hat{\Delta}_Z=\hat{p}_1-\hat{p}_0 =0.450-0.325=0.125. $$

The estimated composite-success probability is therefore 12.5 percentage points higher in condition 1. For an approximate standard error, using independent randomized groups and the usual large-sample Wald calculation:

$$ SE(\hat{\Delta}_Z) =\sqrt{\frac{0.450(1-0.450)}{120} +\frac{0.325(1-0.325)}{120}} =\sqrt{0.003891}=0.06238. $$

An approximate 95% confidence interval is:

$$ 0.125\mathbin{\pm}1.96(0.06238) =0.125\mathbin{\pm}0.1223 =(0.0027,\ 0.2473). $$

Under the Wald approximation, the corresponding test statistic for \(H_0:\Delta_Z=0\) is \(z=0.125/0.06238=2.004\), giving a two-sided \(p\)-value of about 0.045. The interval and test concern the composite-success risk difference, not a response-only effect. This calculation also relies on an adequate large-sample approximation; it does not resolve any missing endpoint assessments that prevent composite classification.

Other Composite Scales

A composite need not be binary. It can retain more information by assigning a value or rank to discontinuation, provided the rule is defined in advance and the resulting scale is interpretable. If higher values represent greater benefit, for example, a protocol could assign a low score to discontinuation and compare mean scores. That estimate describes the average of the constructed composite score; it is not an estimate of the mean clinical outcome that would have been observed had everyone continued treatment.

Worked Example: Assigning a Score at Discontinuation

Hypothetical data. Consider a symptom-improvement scale from 0 to 30 points, where higher is better. The protocol defines a composite score as the observed week-12 improvement for participants who have not discontinued and zero for anyone who discontinued before week 12. In condition 1, 8 of 40 participants discontinue and the other 32 have a mean improvement of 12.5 points. In condition 0, 4 of 40 discontinue and the other 36 have a mean improvement of 11.0 points. Assume these summaries are complete for the defined endpoint.

In condition 1, the 32 non-discontinuers contribute \(32(12.5)=400\) points and the 8 discontinuers contribute \(8(0)=0\). The composite mean is:

$$ \bar{Q}_1=\frac{32(12.5)+8(0)}{40} =\frac{400}{40}=10.0\text{ points}. $$

In condition 0, the 36 non-discontinuers contribute \(36(11.0)=396\) points and the 4 discontinuers contribute zero:

$$ \bar{Q}_0=\frac{36(11.0)+4(0)}{40} =\frac{396}{40}=9.90\text{ points}. $$

The estimated mean contrast is \(10.0-9.90=0.10\) points in favor of condition 1. The small contrast is a comparison on the protocol-defined composite scale. It is not a comparison of the completer means, which are 12.5 and 11.0 points, and it does not mean that discontinuation itself is equivalent to zero symptom improvement. The assignment of zero is part of the endpoint definition and needs clinical justification.

Composite time-to-event endpoints use a related idea: the event can be defined as the first occurrence of discontinuation or a clinical event such as worsening. The event definition must specify which components count and how their timing is handled. A time-to-first-event summary then concerns time until any qualifying component, not time until clinical worsening alone.

Worked Example: Discontinuation or Clinical Worsening

Hypothetical data. In a 24-week trial, the composite event is the first occurrence of discontinuation for any reason or documented clinical worsening. Among 100 participants per group, suppose 16 in condition 1 experience a first composite event: 11 discontinue first and 5 worsen first. In condition 0, 25 experience a first event: 14 discontinue first and 11 worsen first. Assume follow-up to week 24 is complete for event ascertainment and the groups are independent by randomization.

The estimated event risks are \(16/100=0.160\) and \(25/100=0.250\), so the risk difference is \(0.160-0.250=-0.090\), or 9.0 percentage points lower in condition 1. Its approximate standard error is:

$$ SE=\sqrt{\frac{0.160(0.840)}{100} +\frac{0.250(0.750)}{100}} =\sqrt{0.003219}=0.05674. $$

An approximate 95% confidence interval for the risk difference is \(-0.090\mathbin{\pm}1.96(0.05674)=(-0.201,\ 0.021)\). The data are compatible with a lower composite-event risk in condition 1, but this interval includes zero. The estimate combines discontinuation and worsening. Reporting the component counts alongside it helps readers see which events contributed; the overall risk difference alone does not establish that either component was reduced.

Assumptions, Diagnostics, and Comparisons

The numerical calculations above require correctly applied endpoint rules, valid ascertainment of the events and outcomes that define the composite, and an analysis consistent with the randomized comparison. The Wald calculations additionally use a large-sample approximation. If endpoint status is missing, a separate missing-data approach and its assumptions are needed; missingness must not be silently treated as discontinuation or as composite failure. The causal interpretation of the randomized treatment contrast also relies on the trial's design and conduct supporting comparison of the assigned treatment conditions in the target population.

Diagnostics should begin with the event and endpoint records, not only the final treatment contrast. Check event timing against the specified window, reasons for discontinuation, whether restarting treatment changes classification, and whether every participant can be assigned a composite outcome. Tabulate each composite component by treatment group. For a score-based endpoint, inspect how many observations receive the assigned discontinuation value and whether that value is at the intended end of the scale. If a composite is based on first events, confirm that event order is recorded well enough to classify the first qualifying event.

The main alternatives differ in their target. A treatment-policy estimand uses outcomes regardless of discontinuation when those outcomes are defined and available; it answers a question about treatment assignment in the presence of subsequent events. A hypothetical estimand targets a specified scenario in which the event did not occur. A composite estimand instead counts the event through the outcome rule. A while-on-treatment approach focuses on outcomes during treatment exposure and raises distinct questions about outcomes after treatment stops. These approaches should not be treated as interchangeable sensitivity analyses: changing strategy changes the question.

A composite can be attractive when discontinuation is itself clinically important, when it represents lack of tolerability or efficacy, or when assigning success despite discontinuation would be misleading for the decision at hand. Its limitations follow from that same construction. The contrast can be driven by different components in different treatment groups; components may differ substantially in severity; and an assigned score or failure rule can be arbitrary if not clinically justified. A single summary can hide those differences, so component results and the full endpoint definition should accompany it.

1
Fix the target and event window.
State the population, randomized treatment conditions, and time through which discontinuation or other events count.
2
Define the composite variable.
Specify the clinical criterion and the exact event rule, including reasons, timing, and any assigned score or rank.
3
Preserve and report the definition.
Use the same endpoint rule across relevant trial stages, address missing assessments separately, and report the composite together with its components.

In an adaptive trial, changing allocation does not by itself require redefining a composite endpoint. But a change to the event window, discontinuation rule, or assigned score can change the estimand. If an adaptation makes such a change necessary, the resulting endpoint definitions and the populations or stages to which they apply must be stated clearly; a pooled estimate cannot be assumed to represent one unchanged composite without justification.

Common pitfall: “Among participants who stayed on treatment, response was higher, so the treatment improved the composite.” This conditions on a post-randomization event and does not establish the composite contrast. The correction is to apply the prespecified composite rule to every randomized participant, estimate the resulting group-level contrast, and describe the component outcomes separately.

Check Your Understanding

Try each question, then check the brief solutions below.

  1. A composite defines success as symptom response without discontinuation by week 12. What happens to someone who discontinues at week 8 and has a documented response at week 12?
  2. Why is a missing week-12 assessment among a participant who did not discontinue not automatically a composite failure?
  3. In a hypothetical trial, 30 of 100 participants in condition 1 and 20 of 100 in condition 0 meet a prespecified binary composite. Calculate the risk difference.
  4. A mean composite score assigns zero to discontinuation. What does a treatment contrast in this score estimate, and what should be reported alongside it?

Solutions. (1) The participant is a composite failure because success requires both response and no discontinuation by week 12. (2) The composite rule defines the event's contribution, but does not define the unobserved response; missing outcome handling must be specified separately. (3) The risk difference is \(30/100-20/100=0.100\), or 10 percentage points higher in condition 1. (4) It estimates a contrast in the protocol-defined score, not a response-only effect; report the endpoint rule and component results, including discontinuation counts.

Clinical Biostats