Tutorials › Optimal Design and Model-Informed Dosing › Safe Decisions with Missing or Delayed Measurements

Clinical Utility and Safety Nets · Tutorial 491 of 497

Safe Decisions with Missing or Delayed Measurements

Build dosing rules that distinguish current evidence from missing, stale, and pending measurements, and specify what to do when safety cannot be confirmed.

Advanced 11 min read

What You'll Learn

  • Distinguish a missing measurement, a pending result, and a result that is available but stale.
  • Specify freshness rules using sample time, result time, and variable-specific validity windows.
  • Use uncertainty about a patient’s current state to explain why an old value cannot establish present safety.
  • Design interim actions that prevent unsupported automated dosing decisions while directing appropriate follow-up.
  • Identify data-quality and workflow failures that can make a measurement appear more current or reassuring than it is.

Why Measurement Availability Is a Safety Question

A dosing policy can be well calibrated and still make an unsafe decision if it treats unavailable information as reassuring. A missing concentration is not a low concentration; a pending laboratory result is not a normal result; and a once-valid measurement may no longer describe the patient’s current state. The policy therefore needs an explicit response to measurement status, not just a rule for interpreting measured values.

The issue is especially important when a dose decision depends on a safety laboratory value or a measured drug concentration. A policy must determine whether a result is valid for the current decision, what to do if it is not, and how to prevent an automated recommendation from proceeding on the basis of an assumption disguised as data. The specific clinical action depends on the drug, the measurement, the patient, and the approved protocol; the general safety principle is that unknown status must remain unknown until valid evidence or an explicitly approved fallback resolves it.

Definition: For a dosing decision made at time \(t_d\), a measurement is current and usable only if it is attributable to the right patient and decision context, passes required quality and unit checks, and its sample time is within the policy’s specified validity window for that variable. A measurement is missing when no usable result is available; pending when a sample or test is in process but no reportable result is available; and stale when a result exists but is too old for the current decision. These statuses are not evidence that the patient’s value is normal.

Define Freshness Before Applying a Dosing Rule

Freshness is not a universal number of hours. It is a policy specification for a particular measurement and decision context. A rapidly changing laboratory value may require a shorter validity window than a relatively stable measurement; the appropriate interval also depends on clinical circumstances and the intended dosing action. A policy should state the interval in advance rather than deciding after seeing a value.

Record at least two times when they are available: sample time, when the specimen was collected, and result time, when the result became available to the system or clinician. The sample time determines the age of the biological information. A result delivered now from a specimen collected yesterday is not a measurement of the patient now. The result time still matters operationally: a long reporting delay may mean the patient’s decision was made without information that was eventually reported.

For measurement \(j\), let \(t_{s,j}\) be its sample time and let \(\tau_j\) be the policy-defined maximum age for using it. Its age at decision time is

$$ \Delta_j=t_d-t_{s,j}. $$

The value meets the time criterion only when \(0\leq\Delta_j\leq\tau_j\). Passing this test alone is not enough: identity, units, specimen quality, and any relevant context must also be valid. If the sample time is absent or unreliable, the system cannot establish that the measurement is current. It should not silently substitute the result time or the time the record was entered.

A practical policy treats measurement handling as a sequence of checks: confirm that a result exists, establish its provenance and sample time, assess quality and units, compare its age with the applicable validity window, then decide whether the dosing rule may use it. If any required check fails, the policy routes the case to a specified response rather than passing an unverified value downstream.

Reasoning From an Old Measurement to Current Uncertainty

A previous value can sometimes inform a range of plausible current values, but it does not automatically identify the current value. To illustrate, suppose a hypothetical protocol has a safety boundary \(c\), and a measured value \(y\) was obtained \(\Delta\) hours before the decision. If the protocol has justified a maximum rate of change \(r\) and a measurement-error bound \(e\), then a conservative range for the current value is

$$ [y-r\Delta-e,\;y+r\Delta+e]. $$

This range follows from the assumptions \(|x(t_d)-x(t_s)|\leq r\Delta\) and \(|y-x(t_s)|\leq e\), where \(x(t)\) is the underlying value at time \(t\). Combining these inequalities gives

$$ |x(t_d)-y| \leq |x(t_d)-x(t_s)|+|x(t_s)-y| \leq r\Delta+e. $$

Thus the interval represents uncertainty under specified bounds; it is not a confidence interval, and it is only as credible as the assumptions that support \(r\) and \(e\). If the range includes states on both sides of a safety boundary, the old value does not establish that the patient is currently on the safe side. If no defensible change bound is available, this calculation cannot be used to certify current safety.

This leads to a useful policy principle: allow an automated action only when its safety conditions hold across the states the policy considers plausible, or when an approved clinical pathway explicitly permits a different response. If the available information cannot distinguish safe from unsafe states, the policy should not treat the favorable possibility as known fact. The appropriate response might be repeat measurement, clinician review, or a pre-specified interim plan; it is not automatically the same action for every drug or patient.

Worked Example: A Measurement Within Its Validity Window

Consider a wholly hypothetical dosing protocol. It permits a routine automated decision using a particular laboratory measurement only when the sample is no more than 24 hours old and the result passes the protocol’s quality checks. A result of 4.8 mmol/L was collected at 08:00 yesterday and is available at 18:00 today. The decision is being made at 18:00 today. Does the measurement meet the freshness rule?

The sample age is

$$ \Delta=18{:}00\text{ today}-08{:}00\text{ yesterday}=34\text{ hours}. $$

Since \(34>24\), the measurement is stale for this decision, even though the result is available and its reported value may look reassuring. The policy must not use 4.8 mmol/L as though it were a current result. It should follow its defined response for stale data, such as obtaining a new measurement or routing the case for review. This example does not prescribe an action for any real laboratory test.

Worked Example: Quantifying Uncertainty From a Stale Value

Suppose a separate hypothetical protocol reports a value \(y=4.8\) mmol/L from a sample 30 hours earlier. For illustration only, assume the protocol has established a maximum change rate of \(r=0.03\) mmol/L per hour and a measurement-error bound of \(e=0.1\) mmol/L. The protocol’s safety boundary is \(c=5.5\) mmol/L. Calculate the range allowed by these assumptions.

The maximum change over 30 hours is \(r\Delta=0.03\times30=0.9\) mmol/L. Including the error bound gives a total deviation from the old reported value of \(0.9+0.1=1.0\) mmol/L. Therefore,

$$ [4.8-1.0,\;4.8+1.0]=[3.8,\;5.8]\text{ mmol/L}. $$

This interval includes values above the hypothetical boundary of 5.5 mmol/L. Under the stated bounds, the old result does not establish that the current value is below the boundary. The correct conclusion is not that the current value is 5.8 mmol/L; it is that the available evidence leaves open values on either side of the boundary. If those change-rate and error bounds were not justified, even this range would not be a valid safety argument.

Specify Responses to Missing, Stale, and Pending Results

A safe policy makes the response explicit for each status. The response should distinguish what the system may do automatically from what requires a clinician, a repeat measurement, or an established fallback pathway. It should also specify how long an interim state may continue and how the case is closed once valid information becomes available.

Measurement statusWhat is knownPolicy requirement
MissingNo usable result is available for the decision.Do not infer a normal value; follow the predefined missing-data pathway.
PendingA test or report is in process, but no result can yet be used.Do not treat the expected result as observed; define an interim action and follow-up responsibility.
StaleA result exists, but its age exceeds the applicable validity window.Do not apply it as current; request updated information or use the specified escalation or fallback pathway.
Current but invalidA value is available and recent, but fails an identity, unit, quality, or context check.Reject it for the dosing rule and resolve the data-quality issue before relying on it.

The interim action is context-dependent. For one protocol, an unresolved result might block an automated dose increase while allowing a separately approved plan to continue. For another, the safe response may require prompt clinician review. A policy should not assume that “hold,” “continue,” or “repeat” is universally safest; each action has possible harms, and the approved pathway must address those trade-offs.

A pending result deserves particular care because its eventual value is unknown at the decision time. A system may record that a sample was collected and estimate when a result is expected, but neither fact supplies the result. If a dose is due before reporting is complete, the policy needs an explicit plan for that interval rather than an implicit assumption that the value will be acceptable.

Worked Example: A Result Expected After the Dose Decision

In a hypothetical protocol, a concentration measurement is usable for an automated decision for up to 12 hours after collection. A previous sample was collected at 09:00 yesterday. A new sample is collected at 07:00 today, but its expected reporting time is 15:00. The dosing decision is due at 13:00 today. Determine the status of each measurement at decision time.

The previous sample is \(28\) hours old: from 09:00 yesterday to 13:00 today is \(24+4=28\) hours. Since \(28>12\), its result is stale. The new sample is \(6\) hours old at 13:00, but it is still pending because no result is available; freshness of the specimen does not make an unreported value usable. The policy therefore has no usable concentration result at 13:00.

The system must not substitute the old result as current or treat the pending result as normal. It should apply the protocol’s predefined interim pathway—for example, preventing an automated change that requires the concentration until the report is reviewed, while arranging the specified clinical follow-up. The example does not determine which interim dose action is appropriate in real care.

Diagnostics, Failure Modes, and Alternatives

A policy should be tested not only with valid measurements but also with realistic failures in the measurement workflow. Useful checks include whether the system uses collection time rather than entry time, whether time zones and clock errors are handled consistently, and whether a corrected or rejected result can be mistaken for a final report. Test cases should include absent timestamps, duplicate results, mismatched units, delayed transmission, and a result that arrives after the decision has already been made.

Also inspect how often each status occurs and what happens next. Frequent missing or delayed results may indicate a workflow problem rather than an unusual patient pattern. If cases labelled “current” cluster around data-entry delays or missing sample times, the freshness logic may be ineffective. Review whether the policy reliably blocks unsupported automated decisions and whether escalation reaches an accountable person within the required timeframe. These are operational diagnostics, not evidence that a particular dosing action is clinically correct.

Several tempting alternatives are unsafe unless specifically justified and governed. Carrying the last observation forward makes an old value appear current. Replacing a missing result with a typical or population-average value hides individual uncertainty. Assuming a pending result will be in range turns an expectation into an observation. A validated model-based estimate may be considered only if the policy permits it, its inputs and uncertainty are appropriate for the decision, and its use has been evaluated for the relevant setting. It should be identified as an estimate, not presented as a measured result.

No freshness rule eliminates uncertainty. A result inside its time window can still be wrong, affected by a collection or processing problem, or inadequate for a patient whose condition changed rapidly. Conversely, a stale result may remain informative in some contexts, but it cannot be treated as current merely because it is the latest available value. Freshness criteria are one safety gate among the broader checks described in the earlier material on input validation, plausibility checks, contraindication screening, fallback dosing, and escalation.

Common Mistake

Wrong reasoning: “The last recorded laboratory value was acceptable, and there is no new result showing a problem, so the patient is probably still safe to dose automatically.”

Correction: The absence of a new adverse result is not evidence of a current acceptable value. Check the sample time, validity window, result status, and data quality. If current safety cannot be established under the policy’s rules, use the specified interim pathway instead of interpreting unknown information as reassuring.

Key takeaway: A dosing policy should preserve the distinction between measured, pending, stale, and unknown information. It should use only measurements that satisfy explicit validity criteria and define a safe, accountable response whenever those criteria are not met.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions below.

  1. A result is reported at 16:00 from a sample collected 30 hours earlier. The decision rule allows measurements no older than 24 hours. Is it current for that rule? Explain.
  2. A sample was collected one hour ago, but the laboratory has not reported a result. Is the measurement missing, pending, or usable?
  3. A hypothetical old value is 10 units, the maximum change rate is 0.2 units per hour, the sample is 5 hours old, and the error bound is 0.5 units. What range follows from the stated assumptions?
  4. Name two data or workflow checks that can reveal a false appearance of freshness.

Solutions. (1) It is stale: its age is 30 hours, and \(30>24\). The reporting time does not reset the sample’s age. (2) It is pending: a sample exists, but no reportable value is available, so it cannot be used as an observed result. (3) The maximum change is \(0.2\times5=1.0\) unit; adding the error bound gives \(1.5\) units, so the range is \([10-1.5,\;10+1.5]=[8.5,\;11.5]\) units. The range is conditional on the stated bounds. (4) Examples include verifying that sample time, not data-entry time, determines age; checking for missing timestamps or incorrect time zones; and confirming that a corrected or rejected result is not displayed as final.

Clinical Biostats