Tutorials › Adaptive Clinical Trial Design › Audit Logs for Detecting Unauthorized Access

Operational Bias and Trial Integrity · Tutorial 100 of 799

Audit Logs for Detecting Unauthorized Access

Learn to align system records, identify access patterns that merit scrutiny, and state carefully what audit evidence can—and cannot—show about interim-information exposure.

Intermediate 10 min read

What You'll Learn

  • Distinguish authentication, permission, content access, export, and evidence of human interpretation.
  • Reconcile timestamps, user identities, roles, and objects across system records.
  • Recognize patterns that warrant scrutiny without treating them as proof of unauthorized exposure.
  • Assess the strengths and limitations of access logs, export histories, and permission-change records.
  • Apply a structured review to hypothetical audit trails and explain the resulting uncertainty.
  • Identify common logging gaps and avoid overclaiming from incomplete records.

Why Audit Records Matter

In an adaptive trial, interim information may be restricted to designated roles so that people responsible for recruitment, care, or outcome assessment do not change their behavior in response to emerging arm differences. Role-based access and output masking help establish those boundaries. Audit records provide a way to examine whether system activity appears consistent with them. They are especially useful when records from several systems can be aligned: a permissions change in one system may precede a data query in another, while an export history may show that a file was created or downloaded.

An audit trail is evidence about recorded system events, not a direct recording of everything a person knew or did. A successful login does not show that the user saw interim results. A data export does not, by itself, show who opened the exported file or what they understood. The central task is therefore to reconstruct the sequence supported by the records and to describe uncertainty without turning suspicion into a conclusion.

Definition: An audit event is a recorded system action associated with a time, an account or service identity, an object or resource, and an outcome such as success or failure. An access review compares relevant events—such as permission changes, queries, and exports—with the approved roles, purposes, and information boundaries for the trial. An event is suspicious when it is unexpected under those arrangements and merits verification; suspicious does not mean proven unauthorized access.

What the Records Can Establish

Different records answer different questions. Access logs may record authentication attempts, successful sessions, queries, or views of a named resource. Export histories may record file creation, download, or transfer events, sometimes with a filename, row count, or destination. Permission-change records may identify an account, the role or privilege changed, the actor making the change, and the effective time. These records should not be treated as interchangeable: permission to view is not the same as a recorded view, and a recorded view is not evidence that the content was understood or communicated.

Before interpreting events, identify what each system actually logs. A system that records successful authentication but not page views cannot establish which pages a user opened. A log showing an export job may establish that a file was generated, but not that it was downloaded. A download record may establish a transfer to a device or account, but not who subsequently opened it. When a record does not capture an action, the absence of that action in the log is not evidence that it did not occur.

For each relevant record, check the account or service identity, event type, object, timestamp and time zone, outcome, and any available session or job identifier. Compare those details with the authorized role and purpose in force at that time. Use the approved role and permissions arrangements as the reference point; the introductory material on role-based access establishes why a user's nominal job title alone is not enough to determine whether an event was appropriate.

A useful reconstruction joins events across systems while preserving their original meaning. For example, a permission-change event can be compared with a subsequent successful query and an export event. If the systems use different clocks, first verify their time zones and known clock offsets. Do not infer sequence from timestamps that have not been reconciled. Keep an untouched copy of each source record and document any normalization or matching choices, so that the review can be checked against the originals.

Interpretive principle: The evidence for exposure generally becomes more specific as records connect an account to an authorized or unauthorized session, a session to a protected object, and that object to a view or export event. Even a well-matched chain supports only the actions the systems recorded. It does not, by itself, establish the user's attention, understanding, later use, or disclosure to another person.

A Structured Review

A disciplined review separates the question “what happened in the systems?” from “was the event permitted?” and from “what did a person learn?” The following sequence helps keep those questions distinct.

1
Define the protected information and period.
Specify which interim outputs or data objects are relevant and the dates or review window being examined. A broad search without a defined object or period can produce many irrelevant events.
2
Establish the expected access boundary.
Identify which roles could access the object, for what purpose, and when any permissions were effective. Consider the actual system privilege, not just the person's organizational title.
3
Collect and align the records.
Compare access events, export histories, and permission changes. Match using available account, object, session, job, and timestamp fields; note unmatched events and uncertain identity links.
4
Classify what is observed.
Separate failed attempts, successful authentication, permission availability, content views, exports, and transfers. Record what each source directly supports and what remains unknown.
5
State a bounded conclusion.
Describe the verified event sequence, its fit with the approved boundary, and the limitations of the records. Use “consistent with” or “warrants verification” where the evidence does not establish more.

Worked Applications

Worked Example: A Permission Change Followed by a Query

Suppose a hypothetical trial's access log shows that account R17 had no permission to open an interim dashboard before 09:00 UTC on 12 May. A permissions record shows that an administrator added the dashboard-view role to R17 at 09:00. The access log records a successful dashboard query by R17 at 09:12, and the dashboard is designated for the unblinded statistical group. The approved role list does not include R17.

The records establish a sequence: the permission was added at 09:00, and a successful query by the same account was recorded 12 minutes later. The elapsed time is \(09{:}12-09{:}00=12\) minutes. Because R17 is not on the approved role list, this sequence is inconsistent with the stated access boundary and warrants scrutiny.

The records do not establish why the role was added, whether the account was used by its assigned person, what content appeared in the query, or whether anyone interpreted or shared the result. A careful conclusion is: “The logs record a role addition followed 12 minutes later by a successful query from an account not listed for dashboard access.” Calling this proof that a particular person saw or disclosed interim results goes beyond these records.

Worked Example: An Export Without a Recorded View

In a hypothetical review, the analytics system records an export job at 14:05 UTC under service account S4. Its history gives the output name “interim_summary.csv” and 240 rows. The file-transfer system records a download at 14:11 to a shared team drive. The access log for the dashboard contains no view event for S4.

The records support an export job producing a 240-row file, followed six minutes later by a download to the shared drive: \(14{:}11-14{:}05=6\) minutes. If the file name and system documentation confirm that the output contains restricted interim information, the sequence indicates that an output was transferred to that destination.

The missing dashboard view does not contradict the export: the export may have been produced by a job that does not create a dashboard-view event. Nor does the transfer record establish who opened the file on the shared drive. The next interpretive question is whether the service account and destination were authorized for this output. The available records alone cannot answer whether a particular team member read it.

Worked Example: Failed Attempts and a Successful Session

Suppose a hypothetical access log records three failed attempts for account T8 at 08:40, 08:42, and 08:44 UTC, followed by a successful login at 08:47. The account's approved role permits access to blinded operational data but not an interim treatment-comparison table. A query event at 08:52 names that table.

There are three failed attempts, then one successful login. The recorded interval from the successful login to the query is \(08{:}52-08{:}47=5\) minutes. Since the query names an object outside T8's approved access, the query event is the most specific evidence of a potentially improper system access. The failed attempts may be relevant context, but they do not show that interim information was exposed.

The log supports that a successful session associated with T8 was followed by a query event naming the restricted table. It does not establish who controlled the account, whether the query returned data, or whether any result was read. Check whether “query” means a request, a successful data return, or merely an attempted action in that system; the event label must be interpreted according to the system's documented behavior.

Justifying the Evidence Chain

The logic of a cross-system review can be stated as a sequence of increasingly specific claims. Let \(A\) denote a record that an account had access enabled, \(Q\) a successful query or view event for a protected object, and \(E\) a recorded export or transfer of that object. Each claim requires evidence for its own event; one event should not be substituted for another.

$$ A \text{ supports permission availability}; \qquad Q \text{ supports a recorded interaction with the object}; \qquad E \text{ supports a recorded output or transfer}. $$

This distinction follows directly from what each record describes. A permission change alters the system's authorization state, but does not assert that a user opened the object. A query event asserts a recorded interaction only to the extent defined by that system's logging behavior. An export event asserts that the recorded export action occurred, not that a person read the resulting file. Therefore, \(A\) alone cannot establish \(Q\), and \(Q\) alone cannot establish \(E\). Joining records can strengthen the reconstruction of a sequence, but does not convert system events into evidence of human understanding or onward communication.

Diagnostics, Alternatives, and Limits

Several checks can reveal when an apparent pattern may be misleading. Look for inconsistent time zones, clock drift, reused or shared accounts, service accounts that act automatically, duplicate records, delayed batch jobs, and changes in how events are named or retained. Verify whether failed events were attempts to reach the protected object or only failed logins. Check whether a reported export was generated, downloaded, or both. If a person appears to have accessed an object, confirm that the account identity is reliably attributable to that person rather than merely to a team or automated process.

A suspicious event is not automatically unauthorized. A role may have been temporarily approved, a test may have used production-like data, or an automated process may have run under a service identity. Compare the event with the documented authorization and the purpose in force at the time, rather than inferring intent from unusual timing alone. Conversely, a clean log is not proof that no exposure occurred: logging may be incomplete, a file may move outside monitored systems, or access may occur through a shared identity.

Record or approachWhat it can supportImportant limitation
Permission-change historyWhen an account's system privileges changed, if recordedPrivilege availability does not establish use
Access logRecorded login, query, or view events, depending on the systemEvent labels may not establish that content was displayed or read
Export and transfer historyRecorded file generation, download, or transfer eventsMay not identify who opened or understood the output
Cross-system reconstructionA more complete, time-ordered account of recorded eventsDepends on accurate matching, clock alignment, and complete records

The main alternative to a cross-system reconstruction is to rely on one source, such as the access log alone. That may be appropriate for a narrow question—for example, whether a login succeeded—but it cannot answer questions that require permission history or file-transfer evidence. Combining sources is more informative when their identities, timestamps, and object references can be matched; it is also more vulnerable to false matches if those fields are ambiguous. Report unmatched events rather than forcing them into a single narrative.

Audit logs also have limits as evidence of trial impact. They can help determine whether recorded system activity appears inconsistent with an information boundary. They cannot, by themselves, show that recruitment, care, outcome assessment, or analysis was influenced. Nor can an access trail establish the truth of a person's recollection. Keep the conclusion proportional to the evidence: describe recorded actions, the relevant authorization, and unresolved questions separately.

Common Mistake

A common mistake is to reason, “The user's account successfully logged in, so the user saw the interim result.” A successful login establishes only that the system recorded an authenticated session for that account. It does not establish which object was opened, whether a query succeeded, whether the content was visible, or who was operating the account. The correction is to identify the most specific recorded event available, verify what that event means in the system, and state the remaining uncertainty explicitly.

Key takeaway: Treat access logs, export histories, and permission changes as complementary records of system events. A well-reconciled trail can identify activity that merits investigation, but it does not automatically prove a person's identity, understanding, intent, or disclosure.

Check Your Understanding

Answer each question using only the evidence described. Short solutions follow the questions.

  1. A permission record shows that account M2 was granted access to a protected report. No query or view event is available. What can the record establish?
  2. An export job is logged at 10:20 and a download at 10:26. Calculate the interval and name one conclusion the records do not support.
  3. A log shows two failed logins followed by a successful login. Is that enough to conclude that interim information was exposed? Why or why not?
  4. Two systems record the same event using different time zones. What must be checked before deciding which event occurred first?

Solutions. 1. It establishes that access was granted to the account, subject to the accuracy and meaning of that permission record; it does not establish that the report was opened. 2. The interval is \(10{:}26-10{:}20=6\) minutes. The records do not establish who opened or understood the downloaded file. 3. No. The successful login shows a recorded session, but without a relevant query, view, or export event it does not establish exposure of interim information. 4. Convert timestamps using the systems' documented time zones and check clock alignment or drift before inferring event order.

Clinical Biostats