Tutorials › Joint Modeling of Longitudinal and Time-to-Event Data › Measurement Error And Marker Reliability

Multiple Longitudinal Markers · Tutorial 384 of 697

Measurement Error And Marker Reliability

You will learn to distinguish observed marker values from latent trajectories and see how residual noise changes estimated hazard associations and their uncertainty.

Advanced 12 min read

What You'll Learn

  • Define marker-specific residual variance and time-specific marker reliability.
  • Distinguish error in an observed marker from uncertainty about its latent trajectory.
  • Derive a simple reliability-based attenuation approximation and understand its limits.
  • Calculate how trajectory uncertainty propagates into a multimarker log hazard.
  • Identify assumptions, diagnostics, and limitations of joint-model correction for measurement error.

Why Marker Reliability Matters

A longitudinal marker is not observed without error. A laboratory result may vary because of assay noise, specimen handling, or short-term biological variation, even when the underlying disease trajectory has changed little. In a joint model, this distinction matters because the survival association is usually defined in terms of a subject’s latent marker trajectory, not a single noisy observation. Treating the observation as the trajectory can distort the estimated association and understate uncertainty.

The effect is marker-specific. In a panel with one noisy biomarker and one more reliable biomarker, the same observed departure from a population trajectory can provide very different evidence about each subject’s underlying marker level. The joint model represents this difference through each marker’s residual variance and the uncertainty remaining about its trajectory.

Measurement Error and Reliability in a Joint Model

For subject \(i\), marker \(k\), and visit \(j\), write the observed measurement as a latent trajectory plus a residual:

$$ Y_{ikj}=m_{ik}(t_{ij})+\epsilon_{ikj}, \qquad m_{ik}(t)=x_{ik}(t)^\top\beta_k+z_{ik}(t)^\top b_{ik}. $$

Here \(Y_{ikj}\) is the observed value, \(m_{ik}(t)\) is the underlying marker value at time \(t\), and \(b_{ik}\) contains subject-specific random effects. The marker-specific residual variance is \(\sigma_k^2\), so a larger \(\sigma_k^2\) means observations vary more around the latent trajectory. For clarity, examples below use independent, mean-zero residuals with \(\epsilon_{ikj}\sim N(0,\sigma_k^2)\). A model may instead allow residual covariance across markers or visits; that covariance must then be represented appropriately.

Suppose the hazard depends on the current latent marker values:

$$ h_i(t\mid b_i)=h_0(t)\exp\left\{\gamma^\top w_i+\sum_{k=1}^{K}\alpha_k m_{ik}(t)\right\}. $$

The coefficient \(\alpha_k\) is the log hazard ratio for a one-unit increase in marker \(k\), holding the other terms in the hazard fixed. This is an association conditional on the model; it is not, by itself, a causal effect. The model uses the latent \(m_{ik}(t)\), rather than substituting \(Y_{ikj}\) directly into the hazard.

Definition: At time \(t\), the marker-specific reliability is the proportion of the marker’s marginal variance attributable to variation in the latent trajectory rather than measurement residual. Under the independent-residual model, it is $$ R_k(t)=\frac{\operatorname{Var}\{m_{ik}(t)\}}{\operatorname{Var}\{m_{ik}(t)\}+\sigma_k^2}. $$ Reliability is between 0 and 1. It depends on the time-specific trajectory variance as well as the residual variance; it is not a permanent label attached to a biomarker.

This marginal reliability is useful for describing signal relative to noise, but it is not the same as the uncertainty about one person’s trajectory after observing their data. That subject-specific uncertainty is represented by a conditional variance such as \(\operatorname{Var}\{m_{ik}(t)\mid Y_i,T_i,\delta_i\}\), where \(T_i\) and \(\delta_i\) are the observed event or censoring time and event indicator. Survival information can affect this conditional distribution through the joint likelihood.

How Trajectory Uncertainty Enters the Survival Likelihood

A joint model does not generally estimate a hazard association by pretending that each latent trajectory is known exactly. For right-censored survival data, the subject’s contribution integrates over the random effects. In schematic form, under conditional independence of the longitudinal and event processes given the random effects and covariates, it is

$$ L_i=\int \left\{\prod_{k,j} f(Y_{ikj}\mid b_i)\right\} h_i(T_i\mid b_i)^{\delta_i} \exp\left\{-\int_0^{T_i}h_i(u\mid b_i)\,du\right\} f(b_i)\,db_i . $$

The longitudinal measurement model determines how plausible each trajectory is given the observed markers. The survival contribution also weights trajectories according to their compatibility with the observed event or censoring time. A larger marker residual variance makes a given measurement less precise about the latent trajectory. Consequently, it can broaden the distribution of plausible hazard values even when the observed marker values are unchanged.

This integration is the essential adjustment: measurement noise is represented in the model, and uncertainty about the latent trajectory is carried into estimation of the survival association. It does not guarantee that the association is well estimated. If the marker is very noisy, there may be little information to distinguish its trajectory from residual error, so estimates can be imprecise and sensitive to model assumptions.

A Simple Attenuation Derivation

A simple calculation explains why a naive analysis using observed values can weaken an association. Suppose, at a fixed time, the latent marker \(M\) has mean zero and variance \(\tau^2\), and the observation is \(Y=M+\epsilon\), where \(\epsilon\) has mean zero, variance \(\sigma^2\), and is independent of \(M\). If the true log hazard component is \(\alpha M\), the slope from the linear projection of this component on the noisy observation is

$$ \frac{\operatorname{Cov}(Y,\alpha M)}{\operatorname{Var}(Y)} = \frac{\alpha\,\operatorname{Cov}(M+\epsilon,M)} {\operatorname{Var}(M+\epsilon)} = \frac{\alpha\tau^2}{\tau^2+\sigma^2} = \alpha R. $$

The projection is attenuated toward zero when reliability \(R\) is below one. This derivation is a justification for the direction of a common problem, not an exact formula for the coefficient from every survival analysis. A proportional-hazards coefficient based on noisy observed markers need not equal \(\alpha R\): risk-set selection, time-varying trajectories, multiple markers, and the survival model’s nonlinear form can all matter. A correctly specified joint model instead estimates the association while accounting for the measurement model.

Worked Example: Updating a Noisy and a Reliable Marker

Consider a hypothetical subject at one visit. For either marker, suppose the prior latent value \(M\) has distribution \(N(0,1)\), and the observation is \(Y=M+\epsilon\). The observed value is \(Y=2\). For the noisy marker, let \(\sigma^2=4\); for the reliable marker, let \(\sigma^2=0.25\). Calculate the posterior mean and variance of \(M\) given \(Y\).

Under these normal assumptions, completing the square in the product of the prior density and the measurement density gives

$$ E(M\mid Y=y)=\frac{\tau^2}{\tau^2+\sigma^2}y, \qquad \operatorname{Var}(M\mid Y=y)=\frac{\tau^2\sigma^2}{\tau^2+\sigma^2}, $$

where \(\tau^2=1\). For the noisy marker, the reliability is \(1/(1+4)=0.20\). Thus the posterior mean is \(0.20(2)=0.40\), and the posterior variance is \(4/(1+4)=0.80\). The observation of 2 shifts the estimated latent value upward, but uncertainty remains substantial.

For the reliable marker, reliability is \(1/(1+0.25)=0.80\). The posterior mean is \(0.80(2)=1.60\), and the posterior variance is \(0.25/(1+0.25)=0.20\). The same observed value therefore implies a higher posterior latent value and less posterior uncertainty for the reliable marker. These calculations describe the marker model before using survival history to update the subject’s trajectory distribution.

Worked Example: Comparing Naive Association Attenuation

Suppose two hypothetical markers each have latent variance \(\tau^2=1\) and true log hazard association \(\alpha=0.70\) per one-unit increase in the latent marker. Their residual variances are 4 for the noisy marker and 0.25 for the reliable marker. Use the linear-projection approximation to compare the associations that would result from using observed marker values as if they were error-free.

For the noisy marker, \(R=1/(1+4)=0.20\), so the projected coefficient is \(0.70(0.20)=0.140\). Its corresponding hazard ratio per one-unit increase in the observed marker is \(\exp(0.140)=1.150\), approximately.

For the reliable marker, \(R=1/(1+0.25)=0.80\), so the projected coefficient is \(0.70(0.80)=0.560\). The corresponding approximate hazard ratio is \(\exp(0.560)=1.751\). In this illustrative calculation, the same underlying latent association appears much weaker for the noisier marker. These are projection-based approximations, not guaranteed estimates from a Cox model or from a joint model.

Worked Example: Propagating Uncertainty Into a Two-Marker Log Hazard

Suppose a hypothetical subject has independent posterior marker distributions at a specified time: the noisy marker has mean 0.40 and variance 0.80, while the reliable marker has mean 1.60 and variance 0.20. Suppose their hazard association coefficients are \(\alpha_1=0.70\) and \(\alpha_2=-0.40\), with no other covariate contribution. Calculate the posterior mean and standard deviation of the two-marker log hazard component \(\eta=0.70M_1-0.40M_2\).

The posterior mean is \(0.70(0.40)-0.40(1.60)=0.28-0.64=-0.360\). Under the stated independence assumption, its variance is

$$ \operatorname{Var}(\eta\mid\text{data}) =0.70^2(0.80)+(-0.40)^2(0.20) =0.392+0.032 =0.424. $$

The standard deviation is \(\sqrt{0.424}=0.651\). If the posterior distributions are normal, a central 95% posterior interval for this log hazard component is approximately \(-0.360\pm1.96(0.651)\), or \([-1.636,0.916]\). Exponentiating gives a corresponding interval of approximately \([0.195,2.499]\) for the hazard multiplier. This interval describes uncertainty about this subject’s latent log hazard component under the assumed model; it is not a confidence interval for either population association coefficient.

Assumptions, Diagnostics, and Alternatives

The interpretation above depends on a credible measurement model. In particular, the model must distinguish residual error from trajectory variation, and the assumed residual distribution and covariance structure must be adequate. In the examples, residuals are mean-zero, normally distributed, independent of the latent trajectory and survival process conditional on the model terms, and independent across observations. Those are simplifying assumptions, not universal facts. If measurement error depends on marker level, visit timing, laboratory batch, or health status, a constant independent residual variance may be inappropriate. Censoring is also assumed noninformative conditional on the modeled information.

Useful checks include examining marker-specific residuals against fitted values and time, comparing residual spread across markers, and checking whether repeated measurements show patterns inconsistent with the assumed within-marker or cross-marker covariance. A residual variance estimated near zero despite visibly noisy assays, unusually large changes in estimated associations under plausible residual-variance choices, or very wide uncertainty in a marker’s trajectory can signal poor calibration or weak information. A reliability calculation should use variance components on the same marker scale and at the relevant time.

The main alternative is to analyze observed marker values directly in a survival model, perhaps using a selected measurement or a constructed summary. That approach is simpler but treats the chosen values as known and may attenuate or otherwise distort associations when measurement error is appreciable. A joint model explicitly represents the latent trajectory and its residual error, but requires stronger modeling assumptions and more computation. Replicate assays or external reliability information can help estimate residual variation; they do not remove the need to specify how the latent trajectory relates to survival.

A final distinction is important: reliability concerns the signal-to-noise ratio in measurements, while precision of \(\hat{\alpha}_k\) concerns uncertainty in an estimated population association. Higher reliability often supplies more information about a trajectory, but coefficient precision also depends on sample size, event count, trajectory variation, follow-up, covariates, and dependence among markers. A high-reliability marker can still have an imprecise survival association if few events occur or the marker barely varies.

Common Mistakes and Limitations

  • Using observed values as if they were latent trajectories. A measured value includes residual error. The correction is to distinguish \(Y_{ikj}\) from \(m_{ik}(t_{ij})\) and represent the residual variance.
  • Calling reliability a fixed property of a biomarker. The defined reliability depends on latent trajectory variance, residual variance, and potentially time. Report its definition and scale.
  • Applying the attenuation formula as an exact survival-model correction. The formula follows for a linear projection under specific assumptions. It is not a universal conversion from an observed-marker hazard coefficient to a latent-marker coefficient.
  • Confusing trajectory uncertainty with uncertainty in the association coefficient. A subject-specific posterior variance for \(m_{ik}(t)\) and a standard error for \(\hat{\alpha}_k\) answer different questions.

Joint modeling cannot recover information that the measurements and event data do not contain. If residual error is misspecified, the latent trajectories and survival associations may be biased; if marker-specific measurement precision is weakly informed by the data, estimates can be sensitive to assumptions or external calibration. Reliability adjustment is therefore a modeling strategy, not an automatic guarantee of unbiased estimates.

Check Your Understanding

Answer each question using the definitions and assumptions in this tutorial. Brief solutions follow.

  1. A marker has latent variance 3 and residual variance 1. What is its reliability under the stated definition?
  2. With prior latent distribution \(N(0,1)\), residual variance 1, and observed value \(Y=1\), find the posterior mean and variance of the latent value.
  3. If \(\alpha=0.50\), latent variance is 1, and residual variance is 1, what is the linear-projection approximation to the coefficient using the observed marker?
  4. Does a joint model make the latent trajectory known exactly when the marker has high residual variance? Explain.
  5. Why is the variance of a subject-specific log hazard component not the same quantity as the standard error of an estimated population association?

Solutions. 1. \(R=3/(3+1)=0.75\). 2. The posterior mean is \(\{1/(1+1)\}(1)=0.50\); the posterior variance is \(1(1)/(1+1)=0.50\). 3. \(R=1/(1+1)=0.50\), so the projected coefficient is approximately \(0.50(0.50)=0.250\). 4. No. High residual variance makes each measurement less informative about the latent trajectory; the model carries remaining trajectory uncertainty into the survival calculation. 5. The subject-specific variance describes uncertainty about that individual’s latent marker combination under the model. The association’s standard error describes sampling uncertainty about a population coefficient and also depends on the number and distribution of subjects and events.

Clinical Biostats