Tutorials › Bayesian Clinical Trials › Estimands for Recurrent Events and Event Burden

Bayesian Estimands and Regulatory Interpretation · Tutorial 285 of 696

Estimands for Recurrent Events and Event Burden

Define and compare treatment effects for recurrent-event counts, rates, and time with events, with attention to the follow-up and event-handling choices that determine what burden means.

Advanced 12 min read

What You'll Learn

  • Define a recurrent-event count estimand over a fixed follow-up horizon.
  • Distinguish a mean event-rate contrast from a contrast in event counts.
  • Define cumulative time-with-events burden and interpret it in days or as a proportion of follow-up.
  • Identify how death, discontinuation, and incomplete event ascertainment affect the target question.
  • Compare count, rate, and time-burden summaries for the same clinical setting.
  • Check whether a reported treatment effect matches its stated population, horizon, and burden scale.

Why Recurrent-Event Estimands Need More Than an Event Count

For many chronic conditions, a patient may experience several events during a trial: exacerbations, hospital admissions, infections, or episodes of severe pain. A single “event or no event” outcome discards how often events recur. Yet a total count alone does not describe every relevant aspect of burden: patients may have different lengths of observed follow-up, and an event rate or the amount of time spent symptomatic may answer a different clinical question.

An estimand makes that question precise. For recurrent events, it must specify the treatment strategies being compared, the target population, the event definition, the follow-up horizon, how intercurrent events are handled, and the summary measure of burden. The choice between counts, rates, and time with events is not merely a choice of statistical model. It changes what treatment effect is being asked about.

Definition: Let \(a=1\) denote assignment to the treatment strategy and \(a=0\) assignment to the comparator strategy. For a patient in the target population, let \(N^a(\tau)\) be the number of qualifying recurrent events by the prespecified horizon \(\tau\) under strategy \(a\). A mean-count estimand is \(\mu_a(\tau)=E[N^a(\tau)]\), and its treatment-effect contrast, using treatment minus comparator, is \(\Delta_N(\tau)=\mu_1(\tau)-\mu_0(\tau)\). The unit is events per patient over the specified horizon.

The potential outcome \(N^a(\tau)\) describes the event history under a treatment strategy, not simply the observed count for someone who happened to receive that treatment. As with other estimands, the target population and treatment strategies must be stated; the observed-data analysis is a separate step. In a randomized trial, randomization supports comparison of assigned strategies, but the endpoint definition and intercurrent-event strategy still determine what outcome is being compared.

Three Ways to Summarize Recurrent-Event Burden

A mean count answers, “How many events, on average, occur per patient by the horizon?” It gives each patient a count over the same stated horizon and does not require dividing by observed time. A count difference is often direct to explain, while a count ratio expresses relative burden. Neither is universally preferable: a difference emphasizes absolute events avoided, whereas a ratio emphasizes proportional change.

An event rate relates event frequency to time at risk or another prespecified exposure duration. A rate-based estimand must define the exposure time as carefully as the event count. In a population, one possible marginal rate is the ratio of expected event count to expected exposure time. This is not generally the same as the average of each patient’s individual rate.

Definition: Let \(Y^a(\tau)\) be the exposure time accumulated by horizon \(\tau\) under strategy \(a\). Provided \(E[Y^a(\tau)]>0\), define the marginal event rate as \(\lambda_a(\tau)=E[N^a(\tau)]/E[Y^a(\tau)]\). It is measured in events per unit of exposure time. A rate difference is \(\lambda_1-\lambda_0\), and a rate ratio is \(\lambda_1/\lambda_0\), when the comparator rate is positive.

This definition makes the denominator part of the estimand. Exposure might be time alive, time on treatment, or time under observation, depending on the clinical question and the chosen intercurrent-event strategy. These choices are not interchangeable. For instance, an on-treatment rate may describe event frequency while patients remain on assigned treatment, but it does not by itself describe the effect of assignment over the full trial horizon. The earlier material on while-on-treatment estimands and treatment discontinuation is relevant when selecting such a strategy.

A third summary measures time with events. For a symptom that can be present on multiple days, define \(I^a(t)=1\) when the patient has the symptom at time \(t\) under strategy \(a\), and \(0\) otherwise. The accumulated burden is the integral of this indicator over follow-up. For day-level data, it is the number of days with the symptom. If a day can contain several episodes, counting days with any symptom differs from counting episodes.

Definition: The time-with-events burden through horizon \(\tau\) is \(B^a(\tau)=\int_0^\tau I^a(t)\,dt\). Its mean is \(E[B^a(\tau)]\), and the treatment effect may be reported as a mean difference in time with events or as a difference in the proportion of the fixed horizon spent with events. For day-level outcomes, the units are days per patient or a proportion of days.

These measures can lead to different conclusions because they answer different questions. A reduction in event counts does not necessarily imply fewer days affected: one strategy might reduce the number of episodes while making the remaining episodes longer. A rate can differ from a fixed-horizon count comparison when exposure time differs. The estimand should therefore match the clinical meaning of burden that matters to patients and decision-makers.

Worked Examples

Worked Example: Mean Recurrent-Event Count

Hypothetical data. In a 24-week trial, four patients assigned to treatment have 1, 0, 2, and 1 exacerbations; four assigned to comparator have 2, 3, 1, and 2. Assume the event definition is identical between arms and every patient’s count is ascertained through week 24. The target is the mean number of exacerbations per patient over 24 weeks.

The treatment mean is \((1+0+2+1)/4=4/4=1.00\) exacerbation per patient over 24 weeks. The comparator mean is \((2+3+1+2)/4=8/4=2.00\) exacerbations per patient over 24 weeks.

The treatment-minus-comparator mean-count contrast is

$$ \Delta_N(24\text{ weeks})=1.00-2.00=-1.00 $$

In this hypothetical sample, the treatment group averaged 1.00 fewer exacerbation per patient over 24 weeks. This is an absolute difference on the count scale; it is not a rate difference and does not mean every treated patient avoided exactly one event.

Worked Example: Rate Difference and Rate Ratio

Hypothetical data. Over a prespecified 1-year period, treatment patients contribute 20, 30, and 50 person-years of exposure and experience 3, 6, and 9 events, respectively. Comparator patients contribute 15, 35, and 50 person-years and experience 4, 8, and 12 events. Assume events and exposure are ascertained under the same rules in both groups, and the intended rate is total events divided by total exposure time.

Treatment contributes \(3+6+9=18\) events over \(20+30+50=100\) person-years. Its rate is \(18/100=0.180\) events per person-year. Comparator contributes \(4+8+12=24\) events over \(15+35+50=100\) person-years, for a rate of \(24/100=0.240\) events per person-year.

The rate difference and rate ratio are

$$ \lambda_1-\lambda_0=0.180-0.240=-0.0600 \quad\text{events per person-year} $$
$$ \frac{\lambda_1}{\lambda_0}=\frac{0.180}{0.240}=0.750 $$

On this rate scale, the treatment group’s rate is 0.0600 events per person-year lower, and its rate is 0.750 times the comparator rate. The ratio describes a 25.0% lower rate in this hypothetical comparison. It does not establish a 25.0% reduction in each patient’s count over a fixed horizon.

Worked Example: Days With Symptoms

Hypothetical data. In a 28-day study, four treatment patients have symptoms on 2, 0, 4, and 2 days; four comparator patients have symptoms on 8, 6, 10, and 4 days. A day with symptoms is counted once, even if several episodes occur that day. Assume the status of every day is known for every patient.

The treatment group has \(2+0+4+2=8\) symptom-days, or \(8/4=2.00\) days per patient. The comparator group has \(8+6+10+4=28\) symptom-days, or \(28/4=7.00\) days per patient.

The mean difference is \(2.00-7.00=-5.00\) symptom-days per patient over 28 days. Equivalently, the proportions of days with symptoms are \(2/28=0.0714\) for treatment and \(7/28=0.250\) for comparator, a difference of \(0.0714-0.250=-0.1786\), or 17.9 percentage points lower in the treatment group. Both summaries describe the same day-level burden here, expressed on different scales.

Why the Burden Definitions Matter

For a fixed horizon with complete follow-up, the mean count gives every patient the same calendar window. For a rate, patients may contribute different exposure times. Dividing by exposure is useful when the target is event frequency per unit time, but it also changes the question. In particular, a group’s total events divided by total exposure estimates a ratio of expected counts to expected exposure in the target population; it is not automatically an estimate of the average patient-specific rate.

The relationship between time with events and a daily symptom indicator follows directly from accumulation over time. If \(I(t)\) is one on symptom days and zero otherwise, then adding the daily indicators gives the number of symptom-days. Dividing by the fixed number of days \(\tau\) gives the fraction of days affected:

$$ B(\tau)=\sum_{d=1}^{\tau} I(d), \qquad \frac{B(\tau)}{\tau}=\frac{1}{\tau}\sum_{d=1}^{\tau} I(d) $$

Thus a mean difference in symptom-days and a mean difference in the fraction of days affected differ only by the fixed scale factor \(\tau\), if everyone has the same complete horizon and the day-level definition is unchanged. If follow-up lengths vary, that simple equivalence no longer holds without specifying how unobserved days and differing exposure are handled.

Death, Discontinuation, and Incomplete Follow-Up

A patient who dies before the planned horizon cannot simply be assigned zero events for the remaining time without changing the meaning of the outcome. Zero events after death may make a strategy that causes earlier death appear to reduce event burden. Nor is it always appropriate to divide only by time alive: that produces a rate among time alive and may conceal differences in survival. The earlier material on death as an intercurrent event or endpoint component helps frame the choices.

Possible targets include a count by a fixed horizon under a specified strategy for death, a rate per time alive, a composite outcome that incorporates death and recurrent events, or a burden summary defined only while alive. Each has a distinct interpretation. Similarly, stopping assigned treatment does not automatically end outcome collection: a treatment-policy question may seek events through the horizon regardless of discontinuation, whereas an on-treatment question may stop or redefine follow-up at discontinuation. The chosen strategy must be stated rather than inferred from the analysis method.

Incomplete event observation is also not itself an estimand choice. If events are missed, or follow-up ends early for reasons related to a patient’s event history, the observed count may not represent the intended count. Defining the target does not eliminate the need for assumptions or suitable data collection to identify it.

1
Name the event and horizon.
State what qualifies as an event, whether episodes or affected days are counted, and the time window over which burden is summarized.
2
Specify exposure and intercurrent-event handling.
For a rate, define the denominator. State how death, treatment discontinuation, rescue therapy, and other relevant events affect the outcome or observation period.
3
Choose the burden scale and contrast.
Use a count, rate, or time-with-events summary that matches the clinical question, then report the treatment-effect contrast with units and horizon.

Comparisons, Diagnostics, and Limitations

A mean-count contrast is straightforward when a common follow-up horizon and complete event collection are central to the question. A rate contrast is more natural when exposure time is central, but it relies on a meaningful and consistently defined denominator. Time-with-events summaries capture duration or frequency of symptomatic days, but depend on reliable repeated measurement and a clear rule for overlapping episodes. These summaries are complementary, not competing estimates of one universal “burden.”

Before interpreting an estimate, check whether the follow-up horizon is comparable across arms; whether event definitions and ascertainment are consistent; whether patients with early death or discontinuation are handled as specified; and whether the reported denominator matches the stated estimand. A rate based on time on treatment should not be described as the effect of assignment over the full follow-up period unless those targets coincide by design. A count without its horizon is incomplete, and a symptom-day proportion without its definition of a symptom day is ambiguous.

A frequent mistake is to treat a lower observed event count as evidence of lower patient burden even when follow-up differs substantially. The correction is to inspect the target: if the question is events per fixed period, define the fixed-horizon count and address incomplete follow-up; if it is event frequency per exposure time, define the exposure-based rate and interpret it as such. Neither adjustment nor a particular model can repair a mismatch between the clinical question and the estimand.

All these summaries compress an event history. Two patients with the same count may differ in event timing, severity, clustering, or duration. A rate may hide whether events occur early or late; total symptom-days may hide whether burden is continuous or intermittent. If those features matter clinically, the outcome definition or additional summaries must capture them. The estimand should remain explicit about which aspects of burden it does and does not represent.

Key takeaway: A recurrent-event estimand is defined not only by its event measure, but also by its population, horizon, exposure definition, and intercurrent-event strategy. Counts, rates, and time with events answer different questions; report the scale and units so the clinical meaning is unambiguous.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. A trial reports 1.4 fewer admissions per patient over 6 months. Is this a rate difference? What additional information is needed to interpret the count contrast?
  2. In a hypothetical comparison, treatment has 12 events over 60 person-years and comparator has 15 events over 50 person-years. Calculate both rates, their difference, and their ratio.
  3. Explain why counting symptom-days differs from counting symptom episodes when a patient can have multiple episodes in one day.
  4. A patient dies at month 4 of a 12-month trial. Explain why assigning zero events for months 5 through 12 may misrepresent recurrent-event burden.

Solutions. (1) No. It is a mean-count difference, with units of admissions per patient over 6 months. Interpretation also requires the event definition, target population, and stated handling of intercurrent events and incomplete follow-up. (2) The rates are \(12/60=0.200\) and \(15/50=0.300\) events per person-year. The difference is \(0.200-0.300=-0.100\) events per person-year, and the ratio is \(0.200/0.300=0.667\). (3) Symptom-days count each affected day once, whereas episodes count distinct occurrences; multiple episodes on one day increase the episode count but not the day count. (4) The patient is no longer at risk of experiencing the event after death. Coding the remaining time as event-free can make earlier death look like reduced burden, so death must be handled according to the explicitly chosen estimand strategy.

Clinical Biostats