Reading Safety Displays as Evidence
Safety displays compress many records into tables, counts, and rates. Their summaries are useful only when the reader can tell what is being counted, which participants are represented, and over what period the information was collected. A total of 18 adverse events, for example, is not the same as 18 participants experiencing an adverse event: some participants may have several events, and others none.
In a DMC review, an adverse-event listing gives the detail needed to understand the records behind aggregate summaries. The listing and summary should be read together. The listing can reveal repeated events, timing, severity, and missing fields; the summary can show whether a pattern is widespread or concentrated. Neither one, on its own, gives a complete account of safety.
These quantities answer different questions. Event counts describe records, participant counts describe how many people were affected at least once, and exposure-adjusted rates relate records to time at risk or under observation. A display should label the event definition, denominator, time unit, and analysis population clearly enough to identify which quantity it reports.
Start With the Listing
A listing is usually organized by participant and event, with fields such as treatment group, event term, onset and end dates, severity, seriousness, action taken, outcome, and investigator-assessed relationship to treatment. Before interpreting apparent patterns, check how many rows represent distinct events and how many belong to the same participant. Also check whether event terms are coded, whether the coding dictionary and version are stated, and whether key fields are missing.
Worked Example: Events Versus Participants in a Listing
Suppose a hypothetical listing contains eight event records among six participants receiving a study treatment. The participant-level record counts are: participant 01 has three records; participants 02 through 06 each have one. Assume the eight rows represent distinct records under the listing’s event definition.
Event count. The total is \(3+1+1+1+1+1=8\) event records.
Participant count. Six distinct participants have at least one record. The number of participants is not eight, because three records belong to participant 01 and the remaining five records belong to five other participants.
Interpretation. This listing supports the statement that six participants experienced at least one qualifying event and that there were eight event records. It does not show that each participant had one event, nor does it establish that the events were clinically unrelated or equally important. The event details, timing, and clinical review are needed for those judgments.
A participant’s multiple records may reflect different event types or repeated episodes; they should not automatically be treated as separate affected people. Conversely, records with similar terms should not automatically be merged. The event definition and coding rules determine whether records are distinct, while clinical review may be needed to assess whether separate reports represent one continuing episode.
Check the Denominator Before Comparing Proportions
A safety proportion is interpretable only in relation to its denominator. Common choices include participants randomized, participants who received at least one dose, or participants with an assessment in a specified period. These populations are not interchangeable. If a table reports 12 participants with an event out of 100 treated, the observed proportion is \(12/100=0.120\), or 12.0% of treated participants. It is not a proportion of all randomized participants unless those 100 are in fact the randomized denominator.
For a participant-level comparison, the numerator should count distinct participants meeting the event criterion at least once during the stated period, not the number of event records. It is also important to check whether the same participant can appear in multiple event categories. For example, one participant may contribute to both the “nausea” row and the “headache” row, so row counts cannot necessarily be added to obtain the total with any event.
Worked Example: Interpreting a Participant Proportion
In a hypothetical trial, 120 participants received at least one dose of Treatment A. During the stated follow-up period, 18 distinct participants had at least one recorded adverse event. A separate listing contains 25 event records for those 18 participants.
The participant proportion is
Thus, 15.0% of participants who received Treatment A had at least one recorded event during the specified period. The 25 event records are not the numerator for this participant proportion. They describe event records, some of which occurred in participants who had more than one record.
This is a descriptive summary. It does not by itself establish a treatment effect or describe what would have happened to these participants under another treatment. The denominator, event ascertainment period, and treatment exposure should be considered before making any comparison with another group.
Use Exposure Time Carefully
When follow-up or treatment duration differs across participants, event counts alone can be misleading. An exposure-adjusted event rate divides event records by total exposure time. If \(E\) is the number of qualifying event records and \(T\) is total exposure time in participant-months, the rate is \(E/T\) events per participant-month. A scaled rate, such as events per 1,000 participant-months, multiplies this quantity by 1,000.
A rate ratio compares two such rates. Its interpretation is descriptive unless the design, data quality, and analysis support a stronger inference. A rate ratio below 1 means the observed rate in the numerator group is lower than the observed rate in the reference group; it does not mean that the same percentage fewer participants experienced an event.
Worked Example: Comparing Exposure-Adjusted Event Rates
In hypothetical safety summaries, Treatment A has 27 event records over 900 participant-months of exposure, while Control has 40 event records over 900 participant-months. Assume the event definition is the same in both groups and exposure time is calculated consistently.
For Treatment A, the rate per 1,000 participant-months is
For Control, it is
The rate ratio, retaining the exact event counts and exposure times in the calculation, is
The observed event-record rate in Treatment A is 0.675 times the Control rate, or 67.5% of it, in this hypothetical summary. The difference is descriptive: the rates do not show how many distinct participants had events, and a rate ratio alone does not establish a causal treatment effect. Equal total exposure also does not guarantee that exposure duration was distributed similarly across participants.
The basic rate calculation is an accounting identity: adding each participant’s exposure time gives total exposure \(T\), and dividing the observed event count \(E\) by \(T\) expresses the records per unit of accumulated time. If both groups use the same time unit, the scale factor cancels in the rate ratio:
This calculation does not make participants’ event processes identical. Interpreting a rate as a stable summary is most defensible when event ascertainment is comparable, exposure is measured consistently, and the event definition is applied consistently. Marked differences in follow-up, event recurrence, or participant risk over time can make a single rate summary inadequate. The rate should therefore be read alongside participant counts, exposure distributions, and the listing.
Coding, Missingness, and Display Quality
Adverse-event terms may be coded into standardized categories. Coding makes summaries easier to organize, but a coded category is not a direct substitute for the original reported term. Check the coding dictionary and version, the level of aggregation shown, and whether coding conventions were applied consistently across groups and time. A change in dictionary version or recoding process can alter category assignments even if the underlying reports have not changed.
Missing information also needs explicit attention. “No event recorded” is not equivalent to “confirmed no event” if a participant’s safety status was not assessed or the relevant information is unavailable. For a proportion, distinguish participants known to have no event from participants whose event status is unknown. For a rate, check whether exposure time is missing or truncated and whether event dates are sufficient to place records in the analysis period.
Worked Example: Assessing Missing Event Status
Suppose a hypothetical treatment group has 100 treated participants. Event status during the reporting period is known for 94 participants, of whom 12 had at least one event. The status of the other six participants is unknown. Assume the 12 confirmed cases are distinct participants.
Among participants with known status, the observed proportion is
If the intended denominator is all 100 treated participants, the missing statuses should not silently be classified as no event. A simple range for the proportion in the full group is 12/100 if none of the six unknown participants had an event, up to 18/100 if all six did:
This range makes the uncertainty from missing status visible; it is not a confidence interval and does not model why information is missing. The 12.8% figure describes only those with known status. A comparison with another group should show the corresponding denominator and missingness there as well, because different completeness can distort an apparent contrast.
A reader can use the following checks to decide whether a display is interpretable:
- Does the header state whether the measure is event records, distinct participants, a proportion, or a rate?
- Is the denominator defined and aligned with the stated analysis population and time period?
- Are event coding, category level, and dictionary version clear and consistent?
- Are missing event status, dates, severity, or exposure time visible rather than implicitly treated as absent?
- Do listing details support the aggregate total, including repeat records and participants represented in several categories?
Choosing the Right Summary and Avoiding Overinterpretation
Counts, proportions, and rates are complementary rather than competing summaries. Counts preserve the number of records; proportions describe the share of participants affected at least once; rates account for total exposure time. The choice depends on the question, and often more than one measure is needed.
| Display measure | What it summarizes | Key check |
|---|---|---|
| Event count | Number of qualifying event records | Are repeat events and duplicate or continuing records handled consistently? |
| Participant count or proportion | Distinct participants with at least one event; proportion uses a stated participant denominator | Is the denominator population and follow-up period clear? |
| Exposure-adjusted rate | Event records relative to accumulated exposure time | Are time units, exposure calculation, and ascertainment comparable? |
| Listing | Participant-level event detail and record completeness | Can the displayed aggregate patterns be traced to the underlying records? |
A common mistake is to read an event-record rate ratio as a ratio of participants’ risks. For example, a rate ratio of 0.675 does not mean that 32.5% fewer participants experienced an event. The calculation compares records per unit of exposure time; a participant-level proportion requires distinct participant counts and a participant denominator. Another mistake is to assume that a lower event count necessarily indicates better safety when one group had less exposure or less complete ascertainment.
These displays have important limits. A short summary cannot capture the clinical seriousness, timing, reversibility, or plausibility of every event. Rare but important events can be obscured by aggregate totals, and a large number of repeated records can make event counts look substantial while involving relatively few participants. Missingness and coding choices can also change what appears in a category. Interpret the displays as structured evidence for review, not as a substitute for examining relevant cases and data quality.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions below.
- A listing contains 11 event records among seven distinct participants. What can you conclude about the number of records beyond one per participant, and what can you not infer about how those records are distributed?
- A hypothetical group has 9 distinct participants with an event among 75 treated participants. Calculate the participant proportion and state its interpretation.
- Group A has 16 event records over 400 participant-months, and Group B has 20 records over 400 participant-months. Calculate both rates per 1,000 participant-months and their rate ratio. Interpret the ratio correctly.
- Why is it incorrect to classify participants with unknown event status as having no event without further justification?
Solutions. (1) Seven participants account for seven records if each contributes one, so there are \(11-7=4\) additional records beyond one per participant. Those four additional records may be concentrated in one participant or spread across several; the total alone does not identify the distribution. (2) The proportion is \(9/75=0.120=12.0\%\). In this hypothetical group, 12.0% of treated participants had at least one recorded event during the specified period. (3) Group A’s rate is \((16/400)\times1000=40.0\) events per 1,000 participant-months; Group B’s is \((20/400)\times1000=50.0\). The rate ratio is \((16/400)/(20/400)=16/20=0.800\). Group A’s observed event-record rate is 80.0% of Group B’s; this is not a comparison of participant proportions. (4) Unknown status means event ascertainment is incomplete, not that absence of an event was established. Treating unknown participants as event-free can understate the proportion and bias comparisons if missingness differs between groups.