Why Acute-Care Emulations Need a Precise Clock
Acute treatments are often started within minutes or hours of a patient becoming eligible. That urgency makes the protocol’s timing consequential: a patient’s severity can change quickly, treatment decisions and outcome measurements may be recorded close together, and the data may contain orders without reliable administration times. A defensible emulation must say exactly when eligibility is assessed, when strategies begin, and how long outcomes are followed.
Consider a hypothetical emergency-department question about two clinically acceptable rescue medications for adults presenting with an acute migraine. The purpose here is to specify the trial that the observational analysis would emulate, not to recommend either medication. Treatment choice should be clinically plausible in both groups; if one option is contraindicated for a patient, that patient should not be treated as eligible for both strategies.
Specify the Acute-Care Trial Before Looking at Outcomes
Suppose the target trial enrolls adults at their first qualifying emergency-department encounter during the study period. Eligibility is assessed at the first documented clinical decision that rescue treatment is indicated, before either study medication is administered. A possible protocol requires a clinician-recorded acute migraine diagnosis, a baseline pain score in a prespecified range, no study medication already given during the encounter, and no contraindication to either option. It also requires enough prior records to measure prespecified baseline characteristics. These rules should be operationalized using fields and timestamps that actually exist in the data.
The strategies are to initiate medication A or medication B within 30 minutes of eligibility, using a prespecified dose and route. The first administration, not merely a medication order, defines initiation. Subsequent care is usual care under either strategy, including additional rescue medication if clinically needed. Thus, the contrast concerns the effect of the initial-treatment strategy, not the effect of taking only that medication throughout follow-up.
Time zero is the instant eligibility is first met and the treatment strategy would be assigned in the hypothetical trial. Follow-up starts at that same instant for everyone, including people whose medication is administered later in the 30-minute window. The primary outcome could be adequate symptom response by 2 hours after time zero, defined in advance as a pain-score decrease of at least 2 points from baseline. The outcome must be measured consistently enough in routine records to apply that definition. A separate protocol might use a clinically justified assessment window around 2 hours, but it must specify that window before examining results.
This estimand is an average effect in the eligible population. It is not automatically the effect among patients who actually received a medication, because actual treatment is selected in clinical practice. Nor is it the effect of treatment A versus no treatment: the comparator is initiation of B.
Work Through Eligibility and Time Zero
Worked Example: Applying the Eligibility Rules
In a hypothetical record, an adult arrives at 10:00 with an acute migraine. At 10:08, a clinician documents a qualifying pain score and indicates that rescue treatment is needed. Neither medication has yet been administered, both are clinically permissible, and the record contains the required baseline history. The patient meets eligibility at 10:08, so 10:08 is time zero. An order for A is entered at 10:10 and A is administered at 10:18.
The relevant initiation time is 10:18, not the order time of 10:10. It falls within the 30-minute window, so the observed course is consistent with the A strategy. Follow-up for the 2-hour outcome ends at 12:08, not 12:18: the protocol measures time from eligibility and assignment, not from the later administration. A pain score taken at 12:08 can therefore be evaluated against the baseline score recorded before treatment.
Now suppose the chart instead shows that B was administered at 10:25 after an A order was canceled. The administration record supports B initiation; the canceled order does not establish A exposure. This distinction is essential when medication orders and medication administrations are stored separately.
When strategy initiation is allowed during a grace period, patients cannot safely be classified at time zero simply by looking forward and placing them in the group matching the medication they eventually received. Doing so can create immortal-time bias: a patient must remain alive and observable long enough to receive the medication used to define the group. The protocol must handle the 30-minute period with an appropriate grace-period emulation, such as cloning compatible individuals to the strategies at time zero and censoring a clone when its observed care becomes inconsistent with that strategy, with suitable adjustment for informative censoring. The earlier material on treatment grace periods and cloning strategies develops those methods.
Assumptions Behind a Causal Interpretation
A carefully written protocol does not by itself make the comparison causal. The observational data must also support identification of the specified contrast. Let \(L\) denote measured characteristics recorded before time zero, including baseline pain, symptom duration, prior treatment, contraindications, comorbidities, and indicators of acuity that influence both treatment choice and response.
- Consistency: a person’s observed outcome under the strategy actually followed equals that person’s potential outcome under that strategy. This requires sufficiently well-defined versions of A and B, including dose, route, and what subsequent care the strategy permits.
- Conditional exchangeability: after accounting for \(L\), the treatment strategy followed is independent of the potential outcomes. In practice, this assumption is threatened if clinicians choose A or B based on unrecorded severity, contraindications, or patient preferences that also predict response.
- Positivity: for every relevant baseline history in the target population, there is a positive probability of following either strategy. If nearly all patients with a particular contraindication receive only one medication, they should not be included as though both strategies were feasible for them.
- Correct temporal and outcome measurement: eligibility, baseline covariates, administrations, and outcome assessments must be dated and recorded well enough to establish their order and apply the endpoint consistently. Loss of outcome observation must also be addressed under a prespecified rule.
Under these conditions, a baseline-adjusted comparison can identify the stated contrast. For example, if \(L\) is represented by prespecified strata and each stratum has support for both strategies, standardization expresses the target risk under strategy A as a weighted average of stratum-specific risks:
The weights are the distribution of \(L\) in the target eligible population. The analogous quantity for B uses \(P(Y=1\mid B,l)\), and their difference estimates \(\Delta\) if the assumptions hold. This is a justification for adjusting for baseline differences, not a guarantee that every relevant confounder has been measured. The treatment assignment model and adjustment method should follow the prespecified analysis strategy.
Worked Example: Why Baseline Severity Matters
Suppose a hypothetical emulation includes 240 eligible encounters. The following table shows adequate response by 2 hours, grouped by baseline severity. All counts are invented for illustration.
| Baseline severity | A: response / total | B: response / total |
|---|---|---|
| Milder | 54 / 90 | 48 / 80 |
| More severe | 18 / 30 | 12 / 40 |
The crude A risk is \(72/120=0.600\), and the crude B risk is \(60/120=0.500\). The crude risk difference is \(0.600-0.500=0.100\), or 10.0 percentage points in favor of A. But the A group contains 90 milder and 30 more severe encounters, while the B group contains 80 milder and 40 more severe encounters.
The target population has 170 milder encounters and 70 more severe encounters, so the respective standardization weights are \(170/240=0.7083\) and \(70/240=0.2917\). The estimated standardized risk under A is $$ (54/90)(170/240)+(18/30)(70/240) = (0.600)(0.7083)+(0.600)(0.2917) =0.600. $$
For B, the standardized risk is $$ (48/80)(170/240)+(12/40)(70/240) = (0.600)(0.7083)+(0.300)(0.2917) =0.5125. $$
The standardized risk difference is \(0.600-0.5125=0.0875\), or 8.75 percentage points. In this illustration severity adjustment changes the crude contrast. Neither number is automatically causal: the standardized contrast has a causal interpretation only if the required assumptions hold, including adequate control of other treatment-outcome confounders and positivity within the relevant histories.
Check Feasibility and Diagnose Failure Modes
Before estimating an effect, check whether the protocol can be implemented in the actual records. Useful diagnostics include the proportion with a usable baseline pain score, the frequency and precision of administration timestamps, whether follow-up pain assessments are recorded near the planned time, and how often each treatment occurs among eligible clinical subgroups. These are not merely data-cleaning details: they test whether the emulation corresponds to the trial question.
Worked Example: Assessing the Outcome Window
Imagine a hypothetical data audit of 500 eligible encounters. A pain score is recorded at baseline for 450, and 315 of those have a follow-up score between 90 and 150 minutes after time zero. Thus, the observed outcome rate is \(315/450=0.700\), or 70.0%, among records with baseline measurement, and only \(315/500=0.630\), or 63.0%, of all eligible encounters have a score in the proposed window.
These calculations do not establish that missing outcomes are harmless. The audit should also compare the availability of follow-up scores by initial strategy and measured acuity. If follow-up scores are much less common after one medication or among patients with severe symptoms, complete-record risks may describe selected patients rather than the eligible population. The protocol must state how missing outcome data are handled and whether the data can support that approach. If the records do not capture the outcome adequately, a different outcome or a different data source may be necessary.
Several patterns should prompt revision or caution:
- Unclear or delayed eligibility timestamps: if the time treatment was indicated cannot be distinguished from the time it was administered, baseline and exposure may be misordered.
- Orders substituted for administrations: an order may be canceled, delayed, or never given. Treating it as initiation misclassifies the strategy.
- Little treatment overlap: if one medication is virtually never used for patients with a given severity or contraindication profile, adjustment cannot reliably recover a comparison for those histories.
- Unequal outcome recording: if response measurements are more likely after one strategy, observed outcome differences may reflect measurement or follow-up processes.
- Changing treatment before initiation: if patients receive another rescue medication during the grace period, that event must be handled according to the prespecified strategy rules rather than ignored.
What This Acute-Treatment Contrast Does and Does Not Answer
An active-comparator trial of A versus B is often more clinically coherent than comparing A with no treatment when both are accepted rescue options. It can also make the eligible population clearer because both strategies must be feasible at the decision point. By contrast, an untreated group may differ sharply in indication, severity, or contraindications. An active comparator does not remove confounding, however; treatment selection can still depend on patient history and clinician judgment.
The 2-hour response outcome is suited to an acute question, but the endpoint must be clinically interpretable and reliably recorded. A different protocol could prioritize adverse events, need for additional rescue treatment, or return to care, but those endpoints have different measurement and follow-up requirements. Follow-up from time zero also means that delayed initiation leaves less time after the first dose for response to develop. That feature is part of the specified strategy contrast; changing the clock to start separately at each person’s administration would change the question and could introduce selection problems.
Finally, an initial-treatment strategy with usual subsequent care should not be interpreted as a comparison of sustained treatment regimens. Its result does not by itself describe the effect of continuing a medication over days or months. The protocol’s value is precisely its narrowness: it defines an acute decision, a short initiation window, a common outcome clock, and an explicit eligible population.
Check Your Understanding
Use the hypothetical protocol and calculations above. Each solution follows the question.
- A patient meets eligibility at 14:00 and receives medication B at 14:22. When does the 2-hour follow-up end, and which observed strategy is consistent with this initiation?
- Why is an order for medication A at 09:05 insufficient evidence that A was initiated?
- In the worked severity example, what is the crude risk difference, and why is it not automatically a causal effect?
- Suppose follow-up pain scores are missing much more often among patients receiving B. Name one concern this raises for the comparison.
Solutions. (1) Follow-up ends at 16:00, two hours after time zero; B initiation at 14:22 is within the 30-minute window and is consistent with the B strategy. (2) An order may be canceled or never administered, so an administration record is needed to establish initiation. (3) The crude difference is \(72/120-60/120=0.100\), or 10.0 percentage points in favor of A; confounding by severity or other factors can explain some or all of it. (4) The observed B outcomes may represent a selected subset, so differential outcome observation could bias the comparison unless handled under a defensible missing-outcome plan.