Why the Study Clock Matters
An observational question can sound clear while leaving crucial details unsettled. “Does starting a medication reduce hospitalization?” does not say which patients are being studied, when they qualify, what counts as starting, or how long hospitalization is monitored. Different answers define different studies—and can define different causal questions.
The key is to set a common time zero: the point when eligibility is assessed, the exposure strategy is assigned or recorded, and outcome follow-up begins. Eligibility, exposure, and follow-up must be aligned to that point. Otherwise, the compared groups may not represent the same population at the same stage of their health history.
Specify the Population Before Comparing Exposures
Eligibility criteria should describe who could enter the study at time zero, using information available by that time. They might specify age, diagnosis, clinical setting, and whether a person has previously used a treatment. The criteria should also make clear the relevant calendar period and, when needed, the source population from which eligible people are drawn.
This is not merely administrative detail. If one study includes all adults with a condition and another includes only people newly diagnosed and not previously treated, the two studies concern different target populations. Even if they compare the same exposure strategies, their average causal effects need not be identical: the people and their risks may differ.
Eligibility should not depend on future information that would only become known after time zero. For example, requiring that a person remain alive for 30 days after enrollment selects people based on what happens during follow-up. Such a rule changes the population in a way that can distort the intended comparison. State eligibility using facts that are established at the common start.
Set Exposure Status and Follow-Up at the Same Point
In an observational study, exposure is not randomly assigned. Nevertheless, the question needs a clearly specified exposure contrast: which strategies or exposure states are being compared, and when is each person classified? For a treatment question, a contrast might be “initiate treatment at today’s eligible visit” versus “do not initiate at that visit.” The exposure rule should be precise enough that two people applying it to the same record would classify the person the same way.
Follow-up begins at time zero, not at a later date chosen separately for each exposure group. The outcome definition should state what event counts, how it is identified, and the time period over which it is counted. For example, “hospitalization” might mean any unplanned admission, and the window might be the 90 days after the eligible visit. A count at 30 days and a count at one year answer different questions.
The causal estimand also needs a population. Let \(Y^1\) and \(Y^0\) denote the potential outcomes under two specified exposure strategies for a person in the target population. For a binary outcome by a fixed horizon, a population-average risk difference can be written as:
This expression is meaningful only after the eligible population, the strategies, the outcome, and the horizon have been specified. It describes a contrast in potential outcomes for that population; it is not automatically equal to the observed difference between exposed and unexposed people. A causal interpretation from observational data also requires assumptions about how exposure and outcomes relate to measured and unmeasured factors. Defining time zero is necessary for a coherent question, but it does not by itself establish those assumptions.
Worked Example: A Medication Initiation Question
Hypothetical question: Among adults with newly diagnosed hypertension who have not previously used the medication, what is the effect of initiating it on the risk of stroke within one year?
Eligibility and population. Suppose the source is adults seen at participating clinics from January through December. An eligible person must be at least 18 years old, have a new hypertension diagnosis recorded at the visit, and have no prior use of the medication. These criteria define the target population at the eligible clinic visit; they do not require surviving or remaining in care after that visit.
Exposure and time zero. Set time zero to the date of that visit. Compare the strategy “initiate the medication at the visit” with “do not initiate it at the visit.” Exposure status is determined from the treatment decision at time zero, rather than from whether a person starts sometime later.
Outcome and estimand. Define the outcome as stroke within 365 days after the visit. The target contrast is the difference between the two strategies’ 365-day stroke risks among people eligible at that visit. If, purely as a hypothetical calculation, the corresponding causal risks were 48 out of 600 (8.0%) under initiation and 72 out of 600 (12.0%) under non-initiation, the risk difference would be \(0.080-0.120=-0.040\), or 4.0 percentage points lower under initiation. These numbers illustrate the estimand; they are not evidence that the observed groups in an observational data set are comparable or that the contrast is causal.
Why Misaligned Timing Can Mislead
A common timing error is to start follow-up at an initial visit but define the exposed group by whether a person receives treatment later. People classified as exposed must remain alive and observable long enough to receive it. If events during that waiting period are counted for the unexposed group but cannot occur for the future-treated group before treatment, the groups have been given unequal opportunities for the outcome. This is one form of immortal time bias.
The problem is not solved by calling the future-treated people “exposed.” Their exposure classification uses information from after follow-up began. One remedy, when it matches the question, is to define the comparison at a common decision point and classify the strategies using information available then. Other designs may require more careful methods; the central lesson here is to specify the question and timeline before choosing an analysis.
Worked Example: Comparing Treatment at Discharge
Hypothetical question: Among patients discharged after a first heart-failure admission, is starting a follow-up program at discharge associated with a different 90-day readmission risk than not starting it at discharge?
Common time zero. Use the discharge date for every eligible patient. Eligibility is determined at discharge: for example, adults discharged alive after their first recorded heart-failure admission during a specified calendar year. The exposure is whether the program is started as part of the discharge plan, not whether the patient attends a session several weeks later.
Outcome window. Count unplanned readmissions beginning after discharge and through day 90. A readmission before a later program session still belongs to the follow-up outcome; it must not disappear because the patient had not yet attended.
What goes wrong with a future definition? Suppose follow-up still begins at discharge, but “exposed” is defined as attending a first session within 30 days. A patient who is readmitted on day 5 before attending would not qualify as exposed under that definition, even if the person had been referred at discharge. The future-attendance rule can therefore sort people using events after time zero. Defining initiation at discharge instead gives a clear, common starting classification. It does not remove confounding: patients referred to the program may differ from those not referred, and those differences still matter to causal interpretation.
How Choices Change the Causal Contrast
Changing eligibility or timing changes what effect is being asked about, not just which rows appear in a data set. Consider two plausible questions about the same medication: its effect among newly diagnosed, treatment-naive adults at their first eligible visit, and its effect among all adults with the condition, including people who have used the medication before. The second population includes different treatment histories and may have different baseline risks. The two population-average contrasts are not interchangeable.
Likewise, an outcome horizon is part of the estimand. A treatment could affect short-term risk differently from longer-term risk. “Risk by 30 days” and “risk by 365 days” refer to different potential outcomes and different contrasts, even when eligibility and exposure strategies are otherwise the same. State the horizon explicitly rather than relying on a vague phrase such as “during follow-up.”
Worked Example: Two Populations, Two Questions
Consider a hypothetical observational study of a preventive drug and a 30-day complication. One proposed target population is all eligible adults at a routine clinic visit. Another is eligible adults at their first diagnosis, with no previous use of the drug. Both questions compare initiation at that visit with non-initiation and use the same 30-day outcome, but their target populations differ.
For illustration, suppose the causal risks in the first population were 30 complications per 1,000 people under initiation and 40 per 1,000 under non-initiation. The risk difference would be \(30/1000-40/1000=-0.010\), or 1.0 percentage point lower under initiation.
Suppose instead that, in the newly diagnosed population, the corresponding causal risks were 12 per 1,000 and 20 per 1,000. The difference would be \(12/1000-20/1000=-0.008\), or 0.8 percentage point lower. The contrasts differ because both the target population and its risks differ. These hypothetical calculations do not imply that the treatment effect truly varies between the populations; they show why a result must be tied to its specified population rather than described as an effect for everyone.
A Practical Specification
Before analyzing observational data, write the study question in a form that makes the timeline inspectable. A compact specification should answer each of the following:
- Target population: Who is eligible, where and when could they enter, and which eligibility facts are known at time zero?
- Exposure strategies: What exactly distinguishes the groups, and at what point is exposure assigned or recorded?
- Time zero: What single event or date starts eligibility assessment and outcome follow-up?
- Outcome: What event or measurement counts, and how will it be determined?
- Horizon: How long after time zero is the outcome assessed?
- Contrast: Which population-level quantity is of interest, such as a risk difference by the stated horizon?
Then check that the timeline is coherent: eligibility is established by time zero, exposure classification does not quietly depend on later events, and outcomes are counted over the same stated period. This check will not settle every causal question, but it prevents an avoidable mismatch between the question and the data.
Common Mistakes
- Using future survival as an eligibility rule. Requiring people to remain alive or event-free after entry can select the study population using post-entry information. Define eligibility from facts available at time zero.
- Classifying exposure by later treatment receipt. If follow-up starts before exposure classification, the groups may have unequal time at risk. State the exposure strategy at a common time zero.
- Leaving the outcome window vague. “Later readmission” does not define an estimand. Specify the event and the horizon, such as unplanned readmission within 90 days.
- Assuming alignment proves causality. A clear target population and timeline make a causal question interpretable; they do not guarantee that exposed and unexposed people are comparable.
- Reporting an effect without naming the population. A population-average effect always refers to a specified group. Avoid generalizing beyond the eligibility criteria without justification.
Check Your Understanding
Answer each question by naming the relevant population or timing choice.
- A study includes only people who survive 30 days after enrollment. Why might this eligibility rule be problematic if follow-up starts at enrollment?
- For a treatment question, what does time zero need to align?
- Why is “started treatment at some point during follow-up” potentially a problematic exposure definition?
- Give two details needed to define an outcome window for a readmission question.
- How could changing from all eligible adults to newly diagnosed adults change the causal question, even if the exposure contrast and outcome horizon stay the same?