Tutorials › Adaptive Clinical Trial Design › Interpreting Safety Listings and Summaries

Data Monitoring Committees and Interim Logistics · Tutorial 750 of 799

Interpreting Safety Listings and Summaries

You will learn to interpret safety counts, participant proportions, and exposure-adjusted event rates while checking how coding and missingness affect what a display can support.

Intermediate 10 min read

What You'll Learn

  • Distinguish adverse-event records from participants who experienced at least one event.
  • Identify whether a safety proportion uses randomized, treated, or assessed participants as its denominator.
  • Calculate and interpret exposure-adjusted event rates and rate ratios.
  • Check how coding choices and changes in coding affect safety summaries.
  • Recognize when missing safety information makes a comparison uncertain.

Reading Safety Displays as Evidence

Safety displays compress many records into tables, counts, and rates. Their summaries are useful only when the reader can tell what is being counted, which participants are represented, and over what period the information was collected. A total of 18 adverse events, for example, is not the same as 18 participants experiencing an adverse event: some participants may have several events, and others none.

In a DMC review, an adverse-event listing gives the detail needed to understand the records behind aggregate summaries. The listing and summary should be read together. The listing can reveal repeated events, timing, severity, and missing fields; the summary can show whether a pattern is widespread or concentrated. Neither one, on its own, gives a complete account of safety.

Definition: An event count is the number of adverse-event records meeting a stated definition. A participant count is the number of distinct participants with at least one qualifying event. A participant proportion is that participant count divided by a specified participant denominator. An exposure-adjusted event rate is the number of qualifying event records divided by the total exposure time in a specified group.

These quantities answer different questions. Event counts describe records, participant counts describe how many people were affected at least once, and exposure-adjusted rates relate records to time at risk or under observation. A display should label the event definition, denominator, time unit, and analysis population clearly enough to identify which quantity it reports.

Start With the Listing

A listing is usually organized by participant and event, with fields such as treatment group, event term, onset and end dates, severity, seriousness, action taken, outcome, and investigator-assessed relationship to treatment. Before interpreting apparent patterns, check how many rows represent distinct events and how many belong to the same participant. Also check whether event terms are coded, whether the coding dictionary and version are stated, and whether key fields are missing.

Worked Example: Events Versus Participants in a Listing

Suppose a hypothetical listing contains eight event records among six participants receiving a study treatment. The participant-level record counts are: participant 01 has three records; participants 02 through 06 each have one. Assume the eight rows represent distinct records under the listing’s event definition.

Event count. The total is \(3+1+1+1+1+1=8\) event records.

Participant count. Six distinct participants have at least one record. The number of participants is not eight, because three records belong to participant 01 and the remaining five records belong to five other participants.

Interpretation. This listing supports the statement that six participants experienced at least one qualifying event and that there were eight event records. It does not show that each participant had one event, nor does it establish that the events were clinically unrelated or equally important. The event details, timing, and clinical review are needed for those judgments.

A participant’s multiple records may reflect different event types or repeated episodes; they should not automatically be treated as separate affected people. Conversely, records with similar terms should not automatically be merged. The event definition and coding rules determine whether records are distinct, while clinical review may be needed to assess whether separate reports represent one continuing episode.

Check the Denominator Before Comparing Proportions

A safety proportion is interpretable only in relation to its denominator. Common choices include participants randomized, participants who received at least one dose, or participants with an assessment in a specified period. These populations are not interchangeable. If a table reports 12 participants with an event out of 100 treated, the observed proportion is \(12/100=0.120\), or 12.0% of treated participants. It is not a proportion of all randomized participants unless those 100 are in fact the randomized denominator.

For a participant-level comparison, the numerator should count distinct participants meeting the event criterion at least once during the stated period, not the number of event records. It is also important to check whether the same participant can appear in multiple event categories. For example, one participant may contribute to both the “nausea” row and the “headache” row, so row counts cannot necessarily be added to obtain the total with any event.

Worked Example: Interpreting a Participant Proportion

In a hypothetical trial, 120 participants received at least one dose of Treatment A. During the stated follow-up period, 18 distinct participants had at least one recorded adverse event. A separate listing contains 25 event records for those 18 participants.

The participant proportion is

$$ \hat{p}=\frac{18}{120}=0.150=15.0\%. $$

Thus, 15.0% of participants who received Treatment A had at least one recorded event during the specified period. The 25 event records are not the numerator for this participant proportion. They describe event records, some of which occurred in participants who had more than one record.

This is a descriptive summary. It does not by itself establish a treatment effect or describe what would have happened to these participants under another treatment. The denominator, event ascertainment period, and treatment exposure should be considered before making any comparison with another group.

Use Exposure Time Carefully

When follow-up or treatment duration differs across participants, event counts alone can be misleading. An exposure-adjusted event rate divides event records by total exposure time. If \(E\) is the number of qualifying event records and \(T\) is total exposure time in participant-months, the rate is \(E/T\) events per participant-month. A scaled rate, such as events per 1,000 participant-months, multiplies this quantity by 1,000.

Interpretation: An exposure-adjusted event rate describes the observed number of event records relative to the accumulated exposure time, using the specified event definition and time unit. It is not the proportion of participants affected and is not automatically a risk or probability.

A rate ratio compares two such rates. Its interpretation is descriptive unless the design, data quality, and analysis support a stronger inference. A rate ratio below 1 means the observed rate in the numerator group is lower than the observed rate in the reference group; it does not mean that the same percentage fewer participants experienced an event.

Worked Example: Comparing Exposure-Adjusted Event Rates

In hypothetical safety summaries, Treatment A has 27 event records over 900 participant-months of exposure, while Control has 40 event records over 900 participant-months. Assume the event definition is the same in both groups and exposure time is calculated consistently.

For Treatment A, the rate per 1,000 participant-months is

$$ \frac{27}{900}\times 1000=30.0 \quad\text{events per 1,000 participant-months}. $$

For Control, it is

$$ \frac{40}{900}\times 1000=44.4 \quad\text{events per 1,000 participant-months}. $$

The rate ratio, retaining the exact event counts and exposure times in the calculation, is

$$ \widehat{RR} =\frac{27/900}{40/900} =\frac{27}{40} =0.675. $$

The observed event-record rate in Treatment A is 0.675 times the Control rate, or 67.5% of it, in this hypothetical summary. The difference is descriptive: the rates do not show how many distinct participants had events, and a rate ratio alone does not establish a causal treatment effect. Equal total exposure also does not guarantee that exposure duration was distributed similarly across participants.

The basic rate calculation is an accounting identity: adding each participant’s exposure time gives total exposure \(T\), and dividing the observed event count \(E\) by \(T\) expresses the records per unit of accumulated time. If both groups use the same time unit, the scale factor cancels in the rate ratio:

$$ \frac{(E_A/T_A)\times 1000}{(E_C/T_C)\times 1000} =\frac{E_A/T_A}{E_C/T_C}. $$

This calculation does not make participants’ event processes identical. Interpreting a rate as a stable summary is most defensible when event ascertainment is comparable, exposure is measured consistently, and the event definition is applied consistently. Marked differences in follow-up, event recurrence, or participant risk over time can make a single rate summary inadequate. The rate should therefore be read alongside participant counts, exposure distributions, and the listing.

Coding, Missingness, and Display Quality

Adverse-event terms may be coded into standardized categories. Coding makes summaries easier to organize, but a coded category is not a direct substitute for the original reported term. Check the coding dictionary and version, the level of aggregation shown, and whether coding conventions were applied consistently across groups and time. A change in dictionary version or recoding process can alter category assignments even if the underlying reports have not changed.

Missing information also needs explicit attention. “No event recorded” is not equivalent to “confirmed no event” if a participant’s safety status was not assessed or the relevant information is unavailable. For a proportion, distinguish participants known to have no event from participants whose event status is unknown. For a rate, check whether exposure time is missing or truncated and whether event dates are sufficient to place records in the analysis period.

Worked Example: Assessing Missing Event Status

Suppose a hypothetical treatment group has 100 treated participants. Event status during the reporting period is known for 94 participants, of whom 12 had at least one event. The status of the other six participants is unknown. Assume the 12 confirmed cases are distinct participants.

Among participants with known status, the observed proportion is

$$ \frac{12}{94}=0.1277\approx 12.8\%. $$

If the intended denominator is all 100 treated participants, the missing statuses should not silently be classified as no event. A simple range for the proportion in the full group is 12/100 if none of the six unknown participants had an event, up to 18/100 if all six did:

$$ \frac{12}{100}=12.0\% \quad\text{to}\quad \frac{12+6}{100}=18.0\%. $$

This range makes the uncertainty from missing status visible; it is not a confidence interval and does not model why information is missing. The 12.8% figure describes only those with known status. A comparison with another group should show the corresponding denominator and missingness there as well, because different completeness can distort an apparent contrast.

A reader can use the following checks to decide whether a display is interpretable:

  • Does the header state whether the measure is event records, distinct participants, a proportion, or a rate?
  • Is the denominator defined and aligned with the stated analysis population and time period?
  • Are event coding, category level, and dictionary version clear and consistent?
  • Are missing event status, dates, severity, or exposure time visible rather than implicitly treated as absent?
  • Do listing details support the aggregate total, including repeat records and participants represented in several categories?

Choosing the Right Summary and Avoiding Overinterpretation

Counts, proportions, and rates are complementary rather than competing summaries. Counts preserve the number of records; proportions describe the share of participants affected at least once; rates account for total exposure time. The choice depends on the question, and often more than one measure is needed.

Display measureWhat it summarizesKey check
Event countNumber of qualifying event recordsAre repeat events and duplicate or continuing records handled consistently?
Participant count or proportionDistinct participants with at least one event; proportion uses a stated participant denominatorIs the denominator population and follow-up period clear?
Exposure-adjusted rateEvent records relative to accumulated exposure timeAre time units, exposure calculation, and ascertainment comparable?
ListingParticipant-level event detail and record completenessCan the displayed aggregate patterns be traced to the underlying records?

A common mistake is to read an event-record rate ratio as a ratio of participants’ risks. For example, a rate ratio of 0.675 does not mean that 32.5% fewer participants experienced an event. The calculation compares records per unit of exposure time; a participant-level proportion requires distinct participant counts and a participant denominator. Another mistake is to assume that a lower event count necessarily indicates better safety when one group had less exposure or less complete ascertainment.

These displays have important limits. A short summary cannot capture the clinical seriousness, timing, reversibility, or plausibility of every event. Rare but important events can be obscured by aggregate totals, and a large number of repeated records can make event counts look substantial while involving relatively few participants. Missingness and coding choices can also change what appears in a category. Interpret the displays as structured evidence for review, not as a substitute for examining relevant cases and data quality.

Key takeaway: Before interpreting a safety number, identify its unit of analysis, event definition, denominator or exposure time, coding basis, and missingness. Only then can the number answer the question it appears to address.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A listing contains 11 event records among seven distinct participants. What can you conclude about the number of records beyond one per participant, and what can you not infer about how those records are distributed?
  2. A hypothetical group has 9 distinct participants with an event among 75 treated participants. Calculate the participant proportion and state its interpretation.
  3. Group A has 16 event records over 400 participant-months, and Group B has 20 records over 400 participant-months. Calculate both rates per 1,000 participant-months and their rate ratio. Interpret the ratio correctly.
  4. Why is it incorrect to classify participants with unknown event status as having no event without further justification?

Solutions. (1) Seven participants account for seven records if each contributes one, so there are \(11-7=4\) additional records beyond one per participant. Those four additional records may be concentrated in one participant or spread across several; the total alone does not identify the distribution. (2) The proportion is \(9/75=0.120=12.0\%\). In this hypothetical group, 12.0% of treated participants had at least one recorded event during the specified period. (3) Group A’s rate is \((16/400)\times1000=40.0\) events per 1,000 participant-months; Group B’s is \((20/400)\times1000=50.0\). The rate ratio is \((16/400)/(20/400)=16/20=0.800\). Group A’s observed event-record rate is 80.0% of Group B’s; this is not a comparison of participant proportions. (4) Unknown status means event ascertainment is incomplete, not that absence of an event was established. Treating unknown participants as event-free can understate the proportion and bias comparisons if missingness differs between groups.

Clinical Biostats