Tutorials › Joint Modeling of Longitudinal and Time-to-Event Data › Measurement Error in Last-Observed Biomarkers

Landmarking as an Alternative · Tutorial 645 of 697

Measurement Error in Last-Observed Biomarkers

Learn to distinguish assay error from an outdated biomarker value, quantify the effect of classical measurement error, and choose a practical response for landmark risk prediction.

Intermediate 12 min read

What You'll Learn

  • Define the latent biomarker value at a landmark and its noisy observed counterpart.
  • Derive the reliability-ratio result for a linear risk model under explicit classical-error assumptions.
  • Explain why that ratio does not generally correct a Cox-model coefficient or risk prediction.
  • Calculate how replicate measurements change reliability and attenuation.
  • Compare replicate assays, validation-based correction, and latent-trajectory modeling.
  • Recognize when a single observed value cannot diagnose measurement error.

Why the Latest Measurement May Not Be the Biomarker Value We Need

A landmark prediction uses information available for people who are still event-free at a specified time. Often, one of those predictors is the most recently recorded biomarker. But a laboratory result is not the patient’s exact underlying biomarker value: it can vary because of assay imprecision, sample handling, or other measurement conditions. Consequently, a model may estimate risk using a noisy proxy for the biomarker level relevant at the landmark.

There are two distinct discrepancies to keep separate. Measurement error is the difference between a recorded assay result and the underlying biomarker value at the time of that assay. Staleness is the difference between the underlying value at the assay time and the value at the landmark. If the latest measurement was taken before the landmark, both can matter. This tutorial focuses on measurement error; it does not model how visit timing is generated.

Definition: Let \(s\) be a landmark, and consider patients with \(T_i>s\), where \(T_i\) is patient \(i\)’s event time. Let \(X_i\) denote the underlying biomarker value at \(s\), and let \(W_i=X_i+\epsilon_i\) be the value used as a predictor. Here \(\epsilon_i\) is measurement error. A classical additive-error model assumes, within the landmark cohort and any relevant covariate strata, that \(\epsilon_i\) has mean zero and is independent of \(X_i\). To use the attenuation result below, also assume \(E(Y_i\mid X_i,\epsilon_i)=E(Y_i\mid X_i)=a+\beta X_i\), where \(Y_i\) is the outcome being modeled.

For a time-to-event application, \(Y_i\) could indicate whether the event occurs within a specified horizon after \(s\). The landmark risk is conditional on having survived event-free to \(s\), and is based on the available prediction information at that time. In practice, the outcome may instead be modeled using a survival regression. The linear result below clarifies one mechanism by which error can affect estimates; it is not a general correction formula for survival models.

What Classical Measurement Error Does in a Linear Risk Model

Suppose the target outcome is a fixed-horizon event indicator and, among landmark survivors, its conditional mean given the true biomarker is \(E(Y_i\mid X_i)=a+\beta X_i\). Assume the classical-error conditions in the definition, finite variances, and \(\operatorname{Var}(X_i)>0\). A linear regression using \(W_i\) instead of \(X_i\) has population slope equal to the linear-projection slope of \(Y_i\) on \(W_i\).

$$ \begin{aligned} \beta_W &=\frac{\operatorname{Cov}(W_i,Y_i)}{\operatorname{Var}(W_i)}\\ &=\frac{\operatorname{Cov}(X_i+\epsilon_i,Y_i)} {\operatorname{Var}(X_i)+\operatorname{Var}(\epsilon_i)}\\ &=\frac{\beta\,\operatorname{Var}(X_i)} {\operatorname{Var}(X_i)+\operatorname{Var}(\epsilon_i)} =\lambda\beta, \qquad \lambda=\frac{\operatorname{Var}(X_i)} {\operatorname{Var}(X_i)+\operatorname{Var}(\epsilon_i)}. \end{aligned} $$

The equalities require more than an error with overall mean zero. Independence of \(\epsilon_i\) and \(X_i\) gives \(\operatorname{Cov}(X_i,\epsilon_i)=0\). The conditional-mean assumption gives \(\operatorname{Cov}(\epsilon_i,Y_i)=0\): since \(E(Y_i\mid X_i,\epsilon_i)=a+\beta X_i\), the error carries no additional outcome information after \(X_i\) is known. Also, \(\operatorname{Cov}(X_i,Y_i)=\beta\operatorname{Var}(X_i)\). Substitution yields the displayed slope.

The quantity \(\lambda\), between zero and one when the error variance is positive, is the reliability ratio under this model. Thus, the linear-projection slope is pulled toward zero. This is often called regression dilution or attenuation. The result concerns the slope under these particular assumptions; it does not imply that every risk prediction is simply multiplied by \(\lambda\), or that an error-contaminated estimate is always closer to zero in a more complex model.

Worked Example: Calculating Attenuation in a Landmark Cohort

Suppose a hypothetical landmark cohort has a true biomarker \(X_i\), measured in mg/L, with variance \(24\;(\mathrm{mg/L})^2\). Assume the fixed-horizon event probability follows the linear mean model \(E(Y_i\mid X_i)=0.10+0.010X_i\) over the biomarker range in this cohort. An assay produces \(W_i=X_i+\epsilon_i\), where \(\epsilon_i\) is independent of \(X_i\), has mean zero, and has variance \(8\;(\mathrm{mg/L})^2\). Assume the assay error is also unrelated to the event outcome conditional on \(X_i\).

The reliability ratio is \(\lambda=24/(24+8)=24/32=0.75\). The true-model slope is \(0.010\) event-probability units per mg/L. Regressing the outcome on the noisy value has population slope \(\beta_W=0.75(0.010)=0.00750\) event-probability units per mg/L.

Thus the estimated linear association is 25% smaller in magnitude than the true-model slope in this setup. The calculation does not establish a 25% error in every patient’s predicted risk: that depends on the model, the biomarker distribution, and how predictions are constructed. The linear probability model is assumed to be an adequate mean description over the stated range.

Replicates and Validation Information

When independent replicate assays are available from the same sample or time point, averaging them can reduce technical measurement error. Suppose \(W_{ir}=X_i+\epsilon_{ir}\) for replicate \(r=1,\ldots,k\), with each error having mean zero and variance \(\sigma_\epsilon^2\). If the replicate errors are mutually independent and independent of \(X_i\), their average has error variance \(\sigma_\epsilon^2/k\). This gain does not apply to shared systematic error or to genuine short-term biological variation that is part of the target quantity.

Worked Example: How Replicate Assays Change Reliability

In a hypothetical landmark cohort, suppose \(\operatorname{Var}(X_i)=5\;(\mathrm{mg/L})^2\), and each technical assay error has variance \(5\;(\mathrm{mg/L})^2\). The error is independent of the true value and of the outcome conditional on that value. With one assay, reliability is \(5/(5+5)=0.50\). A true linear risk slope of \(0.040\) per mg/L would therefore have a noisy-value slope of \(0.50(0.040)=0.0200\) per mg/L.

Now average \(k=5\) independent replicate assays. The average error variance is \(5/5=1\;(\mathrm{mg/L})^2\), so reliability becomes \(5/(5+1)=5/6=0.8333\). The corresponding linear-projection slope is \((5/6)(0.040)=0.0333\) per mg/L. Replication reduces the attenuation, but does not eliminate it. The calculation is justified only if replicates measure the same underlying value and their errors meet the stated independence conditions.

Validation information can also help. For example, a subset of patients might have both the routine assay \(W_i\) and a more accurate reference measurement of \(X_i\). Such data can help estimate the error variance, reliability, or conditional distribution of \(X_i\) given \(W_i\). A correction then depends on the outcome model and the information collected; the reliability ratio alone is not a universal recipe for individual risk prediction.

Worked Example: Correcting a Linear Association Using Known Reliability

Consider hypothetical landmark data with true biomarker values \(X_i\) equally likely to be \(2,4,6,\) or \(8\) mg/L. Their mean is \((2+4+6+8)/4=5\) mg/L and their variance is \(\{(2-5)^2+(4-5)^2+(6-5)^2+(8-5)^2\}/4=20/4=5\;(\mathrm{mg/L})^2\). Suppose the fixed-horizon event probabilities are \(0.10+0.040X_i\), giving probabilities \(0.18,0.26,0.34,\) and \(0.42\). These are valid probabilities.

Let the assay error be independent of \(X_i\) and the outcome conditional on \(X_i\), with mean zero and variance \(1\;(\mathrm{mg/L})^2\). Then \(W_i=X_i+\epsilon_i\) has variance \(5+1=6\;(\mathrm{mg/L})^2\), and reliability is \(5/6\). The mean event probability is \((0.18+0.26+0.34+0.42)/4=0.30\). The true slope is \(0.040\), so \(\operatorname{Cov}(W_i,Y_i)=\operatorname{Cov}(X_i,Y_i)=0.040(5)=0.20\). The population linear-projection slope using \(W_i\) is therefore \(0.20/6=0.0333\) per mg/L.

If the reliability \(5/6\) is known from suitable validation information, the corrected slope is \(0.0333/(5/6)=0.0400\) per mg/L. The noisy-model intercept is \(0.30-(0.20/6)(5)\approx0.1333\); the structural intercept using \(X_i\) is \(0.30-(0.0400)(5)=0.1000\). This recovers the specified linear association under the assumptions. It does not by itself give the exact event probability conditional on a particular \(W_i\); that requires modeling how \(X_i\) is distributed given \(W_i\).

Why Survival-Model Effects Need More Care

A landmark Cox model might relate the post-landmark hazard to a noisy biomarker through a term such as \(h_i(t\mid T_i>s,W_i,Z_i)=h_{0,s}(t)\exp\{\gamma W_i+\theta^\mathsf{T}Z_i\}\), for \(t>s\). Here \(Z_i\) denotes other predictors and \(h_{0,s}\) is the landmark-specific baseline hazard. Replacing a true biomarker with a noisy one can weaken or otherwise distort its estimated association and alter predicted risks.

However, the reliability-ratio formula derived above is not generally the correction for \(\gamma\) in a Cox model. Survival probabilities involve a nonlinear transformation of the hazard, and averaging over uncertainty in \(X_i\) does not generally preserve the same proportional-hazards form. Consequently, there is no general rule that a Cox coefficient is attenuated by exactly \(\lambda\), or that a patient’s risk estimate can be corrected by dividing it by \(\lambda\). The appropriate method depends on the assumed error distribution, the survival model, and the prediction target.

One practical alternative is to use replicate or validation data to estimate the measurement process and incorporate that information into an error-adjusted analysis. Another is to model a latent biomarker trajectory and connect the event process to that underlying trajectory, rather than treating one assay as error-free. A latent-trajectory approach can represent measurement error and the time course jointly, but requires stronger modeling choices and adequate longitudinal data. It may be unnecessary when assay error is small or when the prediction target is deliberately defined using the routinely observed value.

Assumptions, Diagnostics, and Common Pitfalls

The classical-error calculation applies to the eligible landmark cohort, not automatically to the original study population. Its conditions must be credible among people with \(T_i>s\). For the simple derivation, the error must be centered and unrelated to the true biomarker, and the event outcome must not depend on the error once the true biomarker is known. If assay error varies with biomarker level, depends on batch or health status, or shares a cause with the outcome, the displayed reliability ratio need not describe the bias. Likewise, a biomarker measured before \(s\) is not converted into the value at \(s\) simply by correcting technical assay error.

A single assay per patient generally cannot separate the true between-patient variation from measurement-error variation. Useful diagnostics therefore rely on additional information: replicate assays, reference measurements, laboratory quality-control data, or comparison of error patterns across batches and biomarker ranges. Inspect whether replicate differences are centered near zero and whether their spread is roughly constant. Large or systematic differences, floor or ceiling effects, and evidence of shared replicate errors are warnings against the simplest model. Without replicates, validation data, or credible external assay information, a reliability estimate is not identified from the observed biomarker values alone.

A common mistake is to say, “The measurement error has mean zero, so the noisy biomarker is unbiased and its regression coefficient is unbiased.” Mean-zero error does not make the regression slope unbiased: under classical error, the denominator \(\operatorname{Var}(W_i)\) includes error variance, producing the reliability-ratio result. Worse, an overall mean of zero alone does not imply \(\operatorname{Cov}(X_i,\epsilon_i)=0\) or \(\operatorname{Cov}(\epsilon_i,Y_i)=0\). The correction is to state the independence and conditional-mean assumptions explicitly, and then apply the result only to the model for which it was derived.

The practical choice is therefore not simply “correct” versus “ignore.” Replicates reduce independent technical noise; validation data can identify features of the measurement process; a latent-trajectory model can represent the underlying biomarker over time; and a routine-value landmark model may be reasonable if the target is explicitly prediction from routinely available measurements. Each choice has limitations. Replicates may be costly or unavailable, validation measurements may be imperfect, and latent models can be sensitive to their trajectory and error assumptions. The analysis should state which biomarker quantity the prediction is intended to use.

Check Your Understanding

Answer each question using the stated assumptions. Brief solutions follow the questions.

  1. If \(\operatorname{Var}(X_i)=12\) and \(\operatorname{Var}(\epsilon_i)=4\), what is the reliability ratio under classical additive error?
  2. A linear fixed-horizon risk slope for the true biomarker is \(0.030\) per unit. If reliability is \(0.60\), what is the noisy-value linear-projection slope under the stated assumptions?
  3. Why is an overall mean-zero error insufficient, by itself, to justify the reliability-ratio result?
  4. Does averaging four replicates reduce the error variance to one quarter if all replicate errors share the same batch component? Explain.
  5. Can the reliability-ratio result be used without qualification to correct a landmark Cox coefficient? Why or why not?

Solutions. (1) \(\lambda=12/(12+4)=12/16=0.75\). (2) \(\beta_W=\lambda\beta=0.60(0.030)=0.0180\) risk-probability units per biomarker unit. (3) Mean zero does not ensure that error is uncorrelated with \(X_i\) or \(Y_i\); the derivation requires independence of error and the true value, plus no additional outcome dependence on error given \(X_i\). (4) No. The one-quarter reduction requires independent replicate errors. A shared batch component remains in the average and does not vanish as if it were independent noise. (5) No. The ratio was derived for a linear-projection slope under specific assumptions. Cox-model nonlinearity and survival-risk averaging mean that a coefficient is not generally corrected by multiplying or dividing by reliability.

Clinical Biostats