Tutorials › Joint Modeling of Longitudinal and Time-to-Event Data › Outcome-Triggered Monitoring In Clinical Follow-Up

Informative Observation Schedules · Tutorial 33 of 697

Outcome-Triggered Monitoring In Clinical Follow-Up

Learn to recognize when worsening health or previous results shape clinical follow-up, and why measurements collected at those visits may not represent the full patient population.

Advanced 10 min read

What You'll Learn

  • Distinguish routine follow-up from symptom-triggered and prior-result-triggered monitoring.
  • Explain how health-dependent appointment decisions alter the mix of observed measurements.
  • Calculate and interpret selection effects in hypothetical clinical follow-up data.
  • Identify records and comparisons that can help diagnose outcome-triggered monitoring.
  • Compare fixed, triggered-only, and hybrid monitoring plans, including their limitations.

When Health Determines When It Is Measured

In clinical follow-up, measurements are not always collected at identical times for every patient. A patient whose symptoms worsen may call the clinic, receive an earlier appointment, and have an additional laboratory test. Another patient with stable symptoms may wait for the next routine visit. Clinicians may also schedule earlier follow-up after seeing a concerning test result. In each case, a patient's health helps determine when the next longitudinal measurement is collected.

This matters because measurements observed at clinical visits can overrepresent patients whose health has prompted closer monitoring. The resulting set of measurements may describe the people who were seen, at the times they were seen, rather than the health of the full cohort at a common time. The issue is not that a clinician acted improperly: responding to symptoms or results is often appropriate care. The statistical concern is that the observation schedule carries information about health.

Definition: Outcome-triggered monitoring occurs when a patient's current health, symptoms, or previously observed outcome helps determine whether or when a subsequent measurement or appointment occurs. A measurement is observed at a visit only if the patient attends and the relevant measurement is collected. A fixed visit plan can coexist with extra visits triggered by health; this is a hybrid monitoring plan.

For clarity, let \(Y_i(t)\) denote the health measurement that would be obtained for patient \(i\) at time \(t\) if it were measured, and let \(R_i(t)=1\) indicate that it is actually measured at that time. For example, \(Y_i(t)\) could be a laboratory marker in mmol/L. A target such as the average \(Y_i(t)\) across all patients at a specified time is different from the average among patients measured at a visit. The latter conditions on \(R_i(t)=1\), and that condition can select patients with different health.

How Clinical Triggers Shape the Observed Data

There are several clinically plausible routes from health to measurement. Symptoms can directly prompt a patient to contact the clinic. A clinician may initiate an appointment after receiving a concerning result, or after noticing a change in function or examination findings. A previous laboratory value can also trigger a shorter interval to the next test. These triggers differ in what information is available at the time of the decision, but each can make visit timing informative about the patient's health history.

A symptom need not be the laboratory outcome itself to affect which laboratory values are observed. If symptoms are associated with the underlying biomarker, then selecting visits based on symptoms can also select patients with different biomarker values. Similarly, if a previous laboratory result predicts the current result, then scheduling more follow-up after a high previous result can change the distribution of current results among those measured.

A compact way to see the selection is to consider a health value \(Y\) at a particular time and an indicator \(R\) for whether it is measured. If the probability of measurement depends on \(Y\), the distribution among measured patients is proportional to the population distribution multiplied by the measurement probability:

$$ f(y\mid R=1) = \frac{P(R=1\mid Y=y)f(y)}{P(R=1)}. $$

Here \(f(y)\) is the population distribution at that time, and \(P(R=1\mid Y=y)\) describes how likely a measurement is for patients with value \(y\). The denominator \(P(R=1)\) normalizes the selected distribution so its probabilities sum to one. If measurement probability is higher for some health values than others, the distribution among measured patients generally differs from the population distribution. In practice, the trigger may be symptoms or prior results rather than the unobserved current value itself. The same selection concern arises when those triggers are associated with current health.

Worked Example: Extra Tests After Worsening Symptoms

Hypothetical data. Consider 100 patients assessed at a particular follow-up window. Before the window, 20 have worsening symptoms and 80 have stable symptoms. Suppose the mean biomarker value in the full worsening-symptom group is 12 mmol/L, while the mean in the stable-symptom group is 6 mmol/L. During the window, 80% of the worsening-symptom group and 10% of the stable-symptom group receive a laboratory test.

Assumptions for this calculation. Treat the group sizes, group means, and test probabilities as fixed for this hypothetical window. Within each symptom group, assume tested patients have the group's mean biomarker value. The calculation compares the full cohort mean with the expected mean among tested patients; it does not claim these values describe any real patients.

The cohort mean, counting all 100 patients, is

$$ \frac{20(12)+80(6)}{100} = \frac{240+480}{100} = 7.20\ \text{mmol/L}. $$

Among patients tested, the expected numbers from the two groups are \(20(0.80)=16\) and \(80(0.10)=8\). The expected mean among tests is therefore

$$ \frac{16(12)+8(6)}{16+8} = \frac{192+48}{24} = 10.0\ \text{mmol/L}. $$

The measured value is 2.80 mmol/L higher than the cohort mean in this example. The difference arises because worsening symptoms are associated with a higher biomarker mean and make testing more likely. It does not show that testing caused the higher values, nor that every cohort with symptom-triggered tests will have an upward shift.

Prior Results Can Trigger the Next Measurement

The trigger for a visit may be a previously measured outcome rather than a new symptom. This creates a feedback pattern: a result influences the timing of the next measurement, and the next measurement may be related to that result because health persists over time. A common analysis mistake is to treat all recorded values as though they had been collected on a common schedule without considering why some patients were measured sooner or more often.

Worked Example: Shortened Follow-Up After a High Result

Hypothetical data. At an earlier visit, 15 of 50 patients have a high result and 35 have a low result. Their current biomarker means at the follow-up window of interest are 9 mmol/L and 5 mmol/L, respectively. After the earlier visit, 80% of the high-result group and 20% of the low-result group receive a test in the follow-up window.

Assumptions for this calculation. Assume the group sizes and current group means describe all 50 patients at the target window, whether or not they are tested. Within each earlier-result group, assume testing is unrelated to the current value. This isolates selection caused by the earlier-result group; additional selection within groups could change the result.

The mean current value in the full cohort is

$$ \frac{15(9)+35(5)}{50} = \frac{135+175}{50} = 6.20\ \text{mmol/L}. $$

Expected test counts are \(15(0.80)=12\) after a high earlier result and \(35(0.20)=7\) after a low earlier result. Thus the mean among the tests is

$$ \frac{12(9)+7(5)}{12+7} = \frac{108+35}{19} = 7.526\ \text{mmol/L}. $$

In this example, the measured mean is about 1.33 mmol/L above the full-cohort mean. The reason is that patients with an earlier high result are more likely to be tested again, and their current mean is higher. The comparison depends on the stated assumption that testing does not further select patients within each earlier-result group.

Clinician-Initiated Appointments Are Part of the Observation Story

Not every outcome-triggered visit begins with a patient reporting symptoms. A clinician may review a prior test, receive a message from another care team, or observe a concerning change and arrange an appointment. These decisions matter for longitudinal data even when the reason for the appointment is not recorded as a laboratory trigger. The timing of the measurement reflects a clinical decision based on information about the patient's health.

A useful first description is to compare the frequency of clinician-initiated appointments across patient-time windows with different health histories. The comparison can establish that appointment occurrence is related to those histories. It cannot, on its own, establish that the health history caused the appointment, because the clinician may have acted on additional information and the records may not capture the full decision process.

Worked Example: Comparing Clinician-Initiated Follow-Up

Hypothetical data. Over the same four-week window, complete records are available for 40 patients, each contributing one patient-window. Ten patients have documented symptom worsening before the window; eight receive a clinician-initiated appointment. Of the 30 patients without documented worsening, two receive such an appointment. Assume the symptom classification precedes the appointment and that all appointments in the window are recorded.

The appointment proportion is \(8/10=0.80\) among patients with documented worsening and \(2/30=0.0667\) among those without it. The difference is

$$ 0.80-0.0667=0.7333, $$

or 73.3 percentage points. In these hypothetical records, clinician-initiated appointments are much more frequent in patient-windows with documented worsening. This is evidence that appointment occurrence is associated with the recorded health history, not proof that worsening alone determined the clinician's decision. The comparison also describes patient-windows, not the proportion of all visits that are clinician-initiated.

Recognizing and Checking the Trigger

A diagnosis of outcome-triggered monitoring should be based on the clinical and recording process, not inferred merely from irregular dates. Useful checks include examining appointment reasons, distinguishing routine from unscheduled visits, ordering symptom reports and results by time, and comparing follow-up frequency across histories known before the visit. A record showing that a high result was followed by a shorter planned interval is direct evidence of a result-triggered schedule. A symptom report recorded only after a laboratory test does not establish that the symptom triggered that test.

Timing and ordering are essential. The trigger must be available to the patient or clinician before the appointment decision for it to explain that decision. A symptom recorded at the visit may have begun earlier, but if onset time is unavailable, the data may not reveal whether it preceded scheduling. Likewise, a laboratory result measured at a visit cannot be the trigger for that same visit, though an earlier result may have triggered it.

The main alternatives differ in what determines measurement times. Under a fixed schedule, visits are planned in advance at common times, though missed appointments can still produce selective observation. Under triggered-only monitoring, measurements occur when a clinical trigger leads to contact or testing; there may be little information during periods without a trigger. A hybrid plan combines routine visits with additional outcome-triggered measurements. Hybrid schedules are common and should be described as such rather than forced into either a purely fixed or purely triggered category.

Describing the schedule is not itself a complete adjustment strategy. Whether a particular analysis can ignore the schedule depends on the target question and on what information was recorded. For example, if the trigger is fully observed and appropriately accounted for, it may be possible to address some selection concerns. If triggering depends on unrecorded symptoms or unmeasured health, the available records may not be enough to determine how observed visits relate to the full population's health. The details of formal visit-process models and corrections require additional methods beyond this introductory motivation.

Common Pitfall and Practical Limits

  • Wrong reasoning: “The laboratory value was measured at a clinic visit, so the visit date can be treated as unrelated to the patient's health.” Correction: A symptom report, earlier result, or clinician assessment may have helped determine that date. Check the decision history before treating observed measurements as a neutral sample.
  • Wrong reasoning: “More visits prove that patients were sicker.” Correction: More visits can reflect worse health, closer surveillance, access to care, clinician practice, or several factors together. Visit frequency alone does not identify which explanation is correct.
  • Wrong reasoning: “Every unscheduled visit is outcome-triggered.” Correction: Visits can be rescheduled for logistical reasons, and not all clinical triggers are outcomes. Use documented reasons and temporal ordering where possible.

Even detailed records may omit informal calls, symptoms that patients did not report, or clinical judgments that were not documented. A comparison of recorded visit rates can therefore reveal patterns without fully explaining the mechanism. Moreover, a visit-based mean may be a meaningful summary if the scientific target is the experience at clinical encounters. It is not automatically the right summary for a question about average health at a common time in all eligible patients. State the target before interpreting the observed values.

Key takeaway: When symptoms, earlier outcomes, or clinical assessments influence follow-up, observed measurement times carry information about health. Separate the target population quantity from the quantity among patients measured, and use clinical records and temporal ordering to assess how monitoring was triggered.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. Why can a symptom-triggered laboratory sample have a different mean from the cohort's mean at the same time?
  2. A high result at one visit causes an earlier repeat test. What information must be established before concluding that the earlier result triggered the repeat?
  3. In a hypothetical cohort of 60 patients, 12 have worsening symptoms and 75% of them are tested; 48 are stable and 25% of them are tested. How many tests are expected from each group?
  4. Does a higher rate of clinician-initiated appointments among patients with worsening symptoms prove that worsening symptoms caused those appointments? Explain.

Solutions. (1) If symptoms are associated with health and make testing more likely, the tested patients are a selected subset, so their values need not represent the full cohort. (2) Confirm that the high result was known before the repeat-test decision and that the repeat was arranged in response to it; temporal order and the recorded clinical reason matter. (3) The expected counts are \(12(0.75)=9\) and \(48(0.25)=12\), for 21 tests in total. (4) No. The association is consistent with symptom-triggered follow-up, but clinicians may also have used other information, and the records may omit factors affecting the decision.

Clinical Biostats