Tutorials › Competing Risks and Multi-State Models › Choosing A Recurrent-Event Model By Estimand

Recurrent-Event Estimands and Models · Tutorial 591 of 699

Choosing A Recurrent-Event Model By Estimand

Choose an Andersen–Gill, PWP, or WLW approach by identifying the event contrast and population each model is intended to describe.

Advanced 10 min read

What You'll Learn

  • Distinguish conditional event-intensity, conditional event-order, and marginal event-order targets.
  • Match a scientific question to the risk sets and time scale it requires.
  • Interpret event-order-specific and event-intensity hazard ratios in context.
  • Recognize assumptions about history, eligibility, censoring, and within-person dependence.
  • Identify when none of these three model targets answers a question about average event counts.

Start With the Target, Not the Model Name

Three recurrent-event models can be fitted to the same cohort and produce coefficients that look like hazard ratios, yet those coefficients need not answer the same question. The choice should begin with the scientific contrast: do you want an event intensity that updates with a person’s event history, a hazard among people who have reached a particular event order, or an event-order-specific contrast that averages over earlier histories? These are different estimands, not interchangeable ways of describing one universal treatment effect.

The Andersen–Gill (AG), Prentice–Williams–Peterson (PWP), and Wei–Lin–Weissfeld (WLW) approaches differ chiefly in their risk sets and conditioning. Their assumptions and coefficient interpretations must be considered along with the research question. A good fit statistic cannot, by itself, make a model’s estimand match the question.

Definition: An estimand is the precisely specified quantity a study aims to learn about. For a recurrent-event model, specify at least the event outcome, the population or risk set being compared, what event history is conditioned on or averaged over, and the time scale. A model’s coefficient is an estimate of an estimand only under the model and observation assumptions that give that coefficient its stated interpretation.

Three Targets and Their Risk Sets

Let \(N_i(t)\) be the number of recurrent events experienced by subject \(i\) by time \(t\), and let \(Y_i(t)\) indicate that the subject is under observation and eligible for the event process at \(t\). Let \(Z_i\) be a treatment indicator. The event history just before \(t\) is denoted by \(\mathcal{H}_i(t-)\). The conditional event intensity describes the instantaneous event rate given that history:

$$ E\{dN_i(t)\mid\mathcal{H}_i(t-)\} =Y_i(t)\lambda_i\{t\mid\mathcal{H}_i(t-)\}\,dt+o(dt). $$

In an AG model, a common specification is \(\lambda_i\{t\mid\mathcal{H}_i(t-)\}=\lambda_0(t)\exp(\beta Z_i)\). The coefficient \(\beta\) describes a conditional intensity ratio, \(\exp(\beta)\), for subjects with different \(Z_i\) values at the same modeled time and with the histories represented by the model held fixed. The model uses a recurrent-event counting process and does not require a person to have reached a specified event order before contributing to its risk set.

A PWP model instead targets an event-order-specific hazard conditional on reaching that order. For the \(k\)th event, a subject enters that event’s risk set after experiencing \(k-1\) events and remains eligible until the \(k\)th event or censoring. A PWP model can use total time since study entry or gap time since the preceding event. These clocks define different time comparisons; neither changes the defining conditioning on having reached event order \(k\).

A WLW model specifies marginal event-order-specific hazards. For the \(k\)th event outcome, subjects can contribute from the common time origin until that event or censoring, including subjects who have not yet experienced \(k-1\) events. Thus, the event-order contrast is not restricted to people who have reached the preceding order. “Marginal” here refers to not conditioning the event-order-specific contrast on having reached the preceding order; it does not mean that all dependence among a subject’s event outcomes disappears.

ApproachWho is compared?What history defines the target?
AGSubjects contributing to the recurrent-event risk process at time \(t\)Conditional intensity given modeled event history and covariates
PWPSubjects who have reached event order \(k\) and remain eligible for the \(k\)th eventHazard conditional on reaching order \(k\)
WLWSubjects still without the \(k\)th event and under observation, from a common originEvent-order-specific hazard without restricting eligibility to those already at order \(k-1\)

Assumptions Before Interpretation

For any of these models, the recorded event times, event order, censoring times, and covariates must support the specified risk sets. Censoring must be independent of the relevant event process conditional on variables included in the analysis, or the analysis must use a justified method that accounts for informative censoring. The proportional-hazards or proportional-intensity form must be reasonable for a single constant coefficient over the modeled time range. If that constancy is not plausible, the coefficient may be an inadequate summary.

The AG intensity interpretation requires that the conditioning history be adequately represented for the intended comparison. PWP requires that event order and eligibility be defined correctly; its conditional target is specifically about subjects who reach that order. WLW requires meaningful event-order outcomes and correct handling of censoring for each one. Because a subject can contribute multiple event-order outcomes, within-subject dependence matters for uncertainty estimates. A robust variance estimator can address dependence in standard errors under suitable conditions; it does not change the estimand or repair a mismatched risk set.

The treatment coefficient in an observational study is generally an adjusted association unless the design and analysis support a causal interpretation. Even in a randomized study, a hazard ratio is a contrast of hazards or intensities, not automatically a contrast in mean event counts or in the probability of ever having an event.

Worked Example: A Question About Current Event Intensity

Suppose a hypothetical randomized study asks: “Among participants still under follow-up, what is the treatment-associated ratio of recurrent-event intensities at a given time, accounting for the event process up to that time?” The analysis team specifies an AG proportional-intensity model with treatment indicator \(Z_i\), and assumes that its time-varying treatment contrast is adequately summarized by one coefficient.

This question names an intensity at time \(t\) and asks for a comparison within the recurrent-event process. The AG target is therefore appropriate: the analysis uses each participant’s event history through the counting process, rather than limiting the comparison to those who have already reached the second, third, or another specified event order.

Suppose the hypothetical fitted coefficient is \(\hat{\beta}=0.4055\). The estimated intensity ratio is \( \exp(\hat{\beta})=\exp(0.4055)\approx1.50 \). Under the model, the estimated recurrent-event intensity in the treatment group is 1.50 times that in the reference group at a given modeled time, conditional on the modeled history and covariates. This is a 50% higher estimated intensity, not a claim that participants experience 50% more events over the full study.

The model’s interpretation also depends on the stated assumptions: follow-up and censoring must be handled appropriately, and a common proportional treatment effect must be a defensible summary. If the scientific question instead concerns only the third event among people who have already had two, this AG coefficient does not target that conditional comparison.

Worked Example: A Question About the Third Event Among Those Who Reach It

In a hypothetical study of recurrent infections, investigators ask whether treatment changes the hazard of a third infection among participants who have already experienced two infections. They choose a PWP model for the third event, using time since study entry. The target population at each time consists of participants who have reached two infections and remain under observation without a third.

Suppose the fitted third-event treatment coefficient is \(\hat{\beta}_3=-0.3567\). Then the estimated conditional hazard ratio is \( \exp(-0.3567)\approx0.7000 \). Under the model, among participants eligible for the third-event risk set at a given total time, the treatment-group third-infection hazard is estimated to be 0.70 times the reference-group hazard, conditional on reaching the third-event risk set and on modeled covariates. This is a 30% lower estimated hazard in that conditional risk set; it is not the treatment effect for all enrolled participants.

The conditioning is central, not a technical footnote. Reaching the third-event risk set may be related to a participant’s prior health and event history. Consequently, this result answers the stated conditional question; it does not by itself describe what would happen to all participants if treatment changed who went on to have two infections. The interpretation also requires correctly recorded event order, appropriate censoring assumptions, and a reasonable proportional-hazards summary.

Worked Example: A Marginal Contrast for the Second Event

A hypothetical trial team asks: “How does treatment relate to the time-specific hazard of a second event when the comparison is not restricted to people who have already had a first event?” The team chooses a WLW model for the second-event outcome. Its risk set may include participants who have not yet experienced their first event, provided they remain under observation and have not had their second.

Suppose the estimated coefficient for treatment in that second-event model is \(\hat{\beta}_2=0.2231\). The estimated event-order-specific hazard ratio is \( \exp(0.2231)\approx1.250 \). Under the WLW model, the treatment group’s hazard for the second-event outcome is estimated to be 1.25 times the reference group’s hazard at a given modeled time. The comparison is not conditional on already having had the first event. It therefore answers a different question from a PWP model for the second event, even though both model a “second event.”

This interpretation requires a correctly defined second-event outcome and suitable censoring assumptions. The within-participant dependence among event-order outcomes must be reflected in inference. The estimate is not an estimate of the probability of a second event, and it does not imply that treatment causes more events.

Why the Distinction Matters

The choice changes who contributes to a comparison and what the coefficient summarizes. Conditioning on having reached an event order can be scientifically appropriate, but it changes the target population. A WLW event-order model avoids that eligibility restriction, but its marginal event-order contrast should not be described as the effect among people who have reached the preceding order. The AG model targets a history-conditioned intensity, which is not identical to either of those event-order-specific questions.

A short derivation clarifies why the PWP condition is part of the estimand. Let \(T_{ik}\) be the time of subject \(i\)’s \(k\)th event. A PWP \(k\)th-event risk indicator is zero before the subject has experienced \(k-1\) events, and after that point is one only while the subject remains observed and has not yet had event \(k\). Thus the conditional hazard has the form

$$ \lambda_{ik}^{\text{PWP}}(t) = \lim_{\Delta t\downarrow0} \frac{P(t\leq T_{ik}<t+\Delta t\mid T_{i,k-1}<t,\ T_{ik}\geq t,\ \text{observed at }t)} {\Delta t}. $$

The event \(T_{ik}\) can occur in the interval only after \(T_{i,k-1}<t\). Restricting the conditional probability to people who have reached order \(k\) therefore defines the PWP risk set and target. In a WLW model for the same \(k\)th event, the risk set is instead defined by not yet having the \(k\)th event and remaining observed; it is not narrowed to subjects with \(k-1\) prior events. Changing that condition changes the quantity being modeled.

These three approaches also do not automatically answer a question about the average number of events accumulated by a fixed time. An event intensity, an event-order-specific hazard, and an average event count are distinct summaries. If the primary question is about average burden or a marginal event rate, specify that target directly and use a method designed for it rather than relabeling one of these hazard ratios.

Selection, Diagnostics, and Limitations

1
Write the question as a contrast.
Name the event order, time scale, comparison groups, and whether the target conditions on reaching earlier orders.
2
Define eligibility at each time.
Ask whether all observed participants contribute to a recurrent-event intensity, only those who have reached order \(k\) contribute, or the event-order outcome is followed from a common origin.
3
Choose the matching estimand.
Use AG for the history-conditioned recurrent-event intensity, PWP for an event-order hazard conditional on reaching that order, or WLW for a marginal event-order-specific hazard without that restriction.
4
Check whether the model can support the interpretation.
Verify event-order coding, risk-set construction, censoring assumptions, time scale, proportional-effect adequacy, and inference that accounts for repeated outcomes within a participant.

Useful diagnostics include tabulating the number of participants and events contributing to each event order, checking that risk-set entry and exit times match the intended definition, and examining whether the fitted treatment contrast is plausibly stable over time. Sparse higher-order events can make event-order estimates imprecise or unstable. A marked change in the composition of participants across event orders also warns that a conditional PWP contrast and a marginal WLW contrast may differ substantially for substantive reasons.

A frequent mistake is to select whichever model gives the most favorable or smallest \(p\)-value, then describe its coefficient as the treatment effect on recurrent events generally. The correction is to specify the estimand before looking at the result and to report the actual risk-set and conditioning interpretation. Robust standard errors do not make different estimands equivalent, and agreement in point estimates would not prove that the models answer the same question.

No one approach is universally best. AG is natural when the scientific target is a history-conditioned event intensity over the observed recurrent-event process. PWP is natural when event order and the experience of prior events define the population of scientific interest. WLW is useful when event-order-specific marginal outcomes are the target and the comparison should not be restricted to prior-event attainment. All can be limited by small numbers of later events, informative censoring, misspecified time effects, or a mismatch between the hazard target and the research question.

Key takeaway: Select the recurrent-event model by defining who is compared, what prior event history is conditioned on, and which time scale matters. AG, PWP, and WLW coefficients are not interchangeable merely because each can be exponentiated into a ratio.

Check Your Understanding

For each question, identify the most aligned approach and explain what its coefficient would describe.

  1. A team asks about current recurrent-event intensity, conditional on the event history represented in its model. Which approach is aligned?
  2. A study asks about the fourth-event hazard only among participants who have already had three events. Which approach is aligned?
  3. For a second-event outcome, investigators want a comparison from a common time origin that does not require participants to have had a first event to enter the risk set. Which approach is aligned?
  4. Why does a robust variance estimate not make a WLW coefficient a conditional PWP coefficient?
  5. A clinical team asks for the average number of events per participant by the end of follow-up. Is any of these three hazard estimands automatically the requested target?

Solutions. (1) AG, whose coefficient represents a conditional event-intensity ratio under the specified history and model. (2) PWP, whose fourth-event hazard is conditional on reaching the fourth-event risk set. (3) WLW, whose second-event outcome is modeled without requiring first-event attainment for risk-set entry. (4) Robust variance estimation concerns uncertainty under within-person dependence; it does not alter the model’s risk set or conditioning, so the WLW and PWP estimands remain different. (5) No. An average event count is a different target and requires a method designed to estimate that quantity.

Clinical Biostats