Tutorials › Joint Modeling of Longitudinal and Time-to-Event Data › Why Plugging Observed Marker Values Into the Hazard Fails

The Basic Joint Model · Tutorial 157 of 697

Why Plugging Observed Marker Values Into the Hazard Fails

Learn how measurement error and gaps between visits distort hazards built from observed marker values, and why the hazard should be linked to the modeled latent trajectory instead.

Advanced 10 min read

What You'll Learn

  • Distinguish a hazard conditional on a latent marker trajectory from one using a recorded marker value.
  • Derive how exponential linking turns mean-zero measurement error into multiplicative bias.
  • Quantify how carrying forward an observed value can misrepresent a changing marker between visits.
  • Identify assumptions, diagnostics, and failure modes for observed-value plug-in hazards.
  • Compare naive plug-in hazards with approaches that model the latent marker process.

Why the Hazard Needs the Latent Trajectory

A marker measured over time is often intended to represent a subject’s changing health status. But the value recorded at a visit is not necessarily the subject’s underlying marker value: it may contain measurement error, and it says nothing directly about what the marker was between visits. These distinctions matter when the marker enters a time-to-event model through a nonlinear function such as an exponential hazard.

The central issue is not that observed measurements are useless. They provide information about the trajectory. The issue is treating one noisy, intermittent measurement as if it were the exact marker value governing the hazard at every time. In a joint model, the hazard is linked to the latent trajectory, while the longitudinal measurements are modeled as imperfect observations of that trajectory.

Definition: Let \(Y_{ij}\) be subject \(i\)'s marker measurement at visit time \(t_{ij}\). A standard longitudinal measurement model is \(Y_{ij}=m_i(t_{ij})+\epsilon_{ij}\), where \(m_i(t)\) is the subject's latent marker trajectory and \(\epsilon_{ij}\) is measurement error. A shared-random-effects hazard can be written $$ h_i(t\mid b_i)=h_0(t)\exp\{\gamma^\top w_i+\alpha m_i(t)\}, $$ where \(b_i\) denotes the subject-specific random effects determining the trajectory, \(w_i\) denotes covariates, \(h_0(t)\) is the baseline hazard, and \(\alpha\) is the marker association parameter.

The hazard is an instantaneous event rate, conditional here on the latent trajectory and covariates. If the marker is measured in points, \(\alpha\) has units of inverse points, so \(\alpha m_i(t)\) is dimensionless. A plug-in approach instead inserts a recorded value \(Y_{ij}\), or a value carried forward or interpolated from measurements, in place of \(m_i(t)\). That substitution changes the model: a recorded value contains error and is observed only at selected times.

A basic assumption behind the displayed measurement equation is that the error has mean zero conditional on the latent trajectory, and that the hazard model describes event risk conditional on that trajectory and the stated covariates. Often the measurement errors are also assumed independent across visits and independent of the event process conditional on the latent trajectory. Those assumptions are substantive, not automatic. For example, error that increases as a patient becomes sicker or a visit schedule driven by unrecorded deterioration may require additional modeling.

Measurement Error Inside an Exponential

Even mean-zero measurement error does not disappear when the measurement is put inside an exponential. For a simple calculation, suppose that at a particular time the true marker is \(m\), the observed value is \(Y=m+\epsilon\), and \(\epsilon\sim N(0,\sigma^2)\). Hold the baseline hazard and other covariates fixed, and write \(C=h_0(t)\exp(\gamma^\top w)\). The latent-trajectory hazard is \(C\exp(\alpha m)\); the observed-value plug-in hazard is \(C\exp\{\alpha(m+\epsilon)\}\).

The normal moment-generating function gives the average plug-in hazard over repeated measurement errors:

$$ \begin{aligned} E\!\left[C\exp\{\alpha(m+\epsilon)\}\mid m\right] &=C\exp(\alpha m)E\{\exp(\alpha\epsilon)\}\\ &=C\exp(\alpha m)\exp\!\left(\frac{\alpha^2\sigma^2}{2}\right). \end{aligned} $$

Thus, under these assumptions, the error-averaged plug-in hazard exceeds the latent-trajectory hazard by the factor \(\exp(\alpha^2\sigma^2/2)\) whenever \(\alpha\ne 0\) and \(\sigma^2>0\). This follows from the convexity of the exponential function: averaging exponentiated noisy values is not the same as exponentiating their average. The factor describes an average over measurement errors at a fixed latent value. It does not say that every observed value produces an overestimate; a particular error may be positive or negative.

Worked Example: A Single Noisy Measurement

Suppose the hazard component excluding the marker is \(0.08\) events per week, the latent marker is \(m=2.0\) points, and \(\alpha=0.40\) per point. At a visit, the recorded marker is \(Y=2.5\) points. Compare the hazard using the latent value with the plug-in hazard using the observation.

The latent-trajectory hazard is

$$ 0.08\exp(0.40\times2.0) =0.08\exp(0.80) =0.08\times2.2255 =0.1780\ \text{events per week}. $$

The plug-in hazard is

$$ 0.08\exp(0.40\times2.5) =0.08\exp(1.00) =0.08\times2.7183 =0.2175\ \text{events per week}. $$

For this particular measurement, the plug-in value is higher because the observation is \(0.5\) points above the latent value. Its ratio to the latent hazard is \(\exp\{0.40(2.5-2.0)\}=\exp(0.20)=1.221\). This one observation does not establish the average bias over repeated errors; it illustrates how the error is amplified by the exponential link.

Worked Example: The Error-Averaged Plug-In Hazard

Suppose the hazard component excluding the marker is \(0.20\) events per week, the latent marker is \(1.5\) points, \(\alpha=0.60\) per point, and independent normal measurement error has standard deviation \(0.50\) points. Find the latent hazard and the mean plug-in hazard over repeated measurements.

First, the latent-trajectory hazard is

$$ 0.20\exp(0.60\times1.5) =0.20\exp(0.90) =0.20\times2.4596 =0.4919\ \text{events per week}. $$

Here \(\sigma^2=0.50^2=0.25\) square points, so the multiplier from the normal-error calculation is

$$ \exp\!\left(\frac{0.60^2\times0.25}{2}\right) =\exp(0.045) =1.0460. $$

Therefore, the average plug-in hazard is \(0.4919\times1.0460\), using the displayed rounded values, which is approximately \(0.5145\) events per week. Using unrounded values gives approximately \(0.5146\) events per week. The error-averaged plug-in value is higher by about \(4.60\%\), in agreement with the multiplier. This result depends on the normal-error and fixed-latent-value assumptions; it is not a universal correction factor for arbitrary measurement processes.

Sparse Visits Add a Timing Problem

Even if measurement error were negligible, measurements are usually recorded at visits rather than continuously. A plug-in hazard needs a marker value at each time a subject is at risk. A common shortcut is to carry the last observation forward. Another is to interpolate between visits. Either can differ from the latent value at the time of risk, particularly when the trajectory changes quickly, has curvature, or varies substantially between subjects.

The time discrepancy has a direct effect on the hazard. If a value used in place of the latent marker differs by \(\delta\), then, holding other terms fixed, the ratio of the plug-in hazard to the latent hazard is \(\exp(\alpha\delta)\). This identity makes clear why the same marker discrepancy can have a larger impact when the association parameter has greater magnitude.

Worked Example: Carrying a Value Forward Between Visits

Suppose a subject's latent marker follows \(m(t)=1.0+0.40t\) points, where \(t\) is measured in weeks. The marker is measured at week 0 and again at week 4. Assume, for this example, that the week-0 observation is exactly \(1.0\) point. The hazard component excluding the marker is \(0.05\) events per week, and \(\alpha=0.50\) per point. Compare the hazard at week 2 using the latent marker with the hazard from carrying the week-0 observation forward.

At week 2, the latent marker is \(m(2)=1.0+0.40\times2=1.8\) points. Its hazard is

$$ 0.05\exp(0.50\times1.8) =0.05\exp(0.90) =0.05\times2.4596 =0.1230\ \text{events per week}. $$

Carrying the week-0 value forward uses \(1.0\) point, giving

$$ 0.05\exp(0.50\times1.0) =0.05\exp(0.50) =0.05\times1.6487 =0.08244\ \text{events per week}. $$

The carried-forward hazard is lower at this time because the marker is increasing. Its ratio to the latent hazard is \(\exp\{0.50(1.0-1.8)\}=\exp(-0.40)=0.6703\). The difference is not caused by measurement noise in this example; it arises because the last recorded value is stale. For a decreasing trajectory, carrying forward could instead yield a higher hazard.

What a Valid Comparison Requires

The latent-trajectory model and an observed-value plug-in model answer different modeling questions. In the joint model, longitudinal measurements inform \(m_i(t)\), while the event hazard is specified as a function of that latent trajectory. This is appropriate when the scientific target is the association of the underlying marker course with event risk and the measurement process is imperfect. The earlier material on the observed-data likelihood explains how marker records contribute when some measurements are missing; missingness and measurement error are distinct issues.

A plug-in analysis may be tempting because it can resemble an ordinary time-dependent survival model with a recorded marker as a covariate. But it treats the supplied marker value as if it were the relevant value at that risk time. If it is a noisy measurement, that ignores the error distribution; if it is carried forward, it additionally assumes the marker stays constant until the next visit. If it is interpolated, the result depends on the interpolation rule and does not automatically account for uncertainty in the trajectory.

A useful comparison is:

ApproachWhat enters the hazardMain concern
Latent-trajectory joint modelThe modeled \(m_i(t)\), informed by the longitudinal and event data under specified assumptionsDepends on adequate trajectory, error, hazard, and observation-process assumptions
Observed-value plug-inA recorded value or a value constructed from recorded measurementsCan confuse measurement error or visit timing with the latent marker relevant to risk
Last observation carried forwardThe latest recorded value over the interval until another measurementImposes a piecewise-constant proxy, which can poorly represent a changing trajectory

The joint model is not assumption-free. Its trajectory form may be too rigid, the error distribution may be misspecified, and the visit process may be informative. Sparse data can also leave substantial uncertainty about the latent marker between observations. Modeling the trajectory does not create information that was never collected; it makes explicit how the available information is being used.

Diagnostics and Common Pitfalls

Diagnostics should examine both the longitudinal fit and the event-model implications. Check whether fitted trajectories describe the observed marker patterns, including systematic residual trends, changing variability, and outlying measurements. Examine whether residual behavior differs over time or across risk groups; such patterns can signal that a simple independent, constant-variance error model is inadequate. For sparse visits, assess how much the inferred marker between visits depends on the assumed trajectory shape and compare predictions with observed values at later visits where possible.

For the hazard component, compare conclusions under plausible trajectory specifications and measurement-error assumptions. Large changes in the estimated association or fitted risk patterns are a warning that the data do not strongly determine the latent trajectory. Also consider whether visit timing is related to health status or impending events. If visits are scheduled more frequently when a subject worsens, treating the schedule as irrelevant can leave important information unmodeled.

  • Wrong reasoning: “The measurement errors have mean zero, so plugging in the observed marker gives the same hazard on average.”
  • Correction: The hazard is exponential in the marker. Even when \(E(\epsilon)=0\), generally \(E\{\exp(\alpha\epsilon)\}\ne1\); under normal error it equals \(\exp(\alpha^2\sigma^2/2)\).
  • Wrong reasoning: “The latest observation is the marker value for all times until the next visit.”
  • Correction: That is a piecewise-constant approximation, not a consequence of the measurement data. It can be especially misleading when the marker changes appreciably between visits.

A final caution is that the direction of distortion for an individual subject or an estimated association coefficient is not determined by the simple average-hazard calculation alone. Positive and negative errors occur, the visit pattern can be related to the trajectory, and fitting a survival model involves more than averaging hazards at a fixed latent value. The calculation establishes why the substitution is not generally justified; it does not supply a universal adjustment for every plug-in analysis.

Key takeaway: A recorded marker value is an imperfect, time-local observation of a latent trajectory. When that marker enters an exponential hazard, measurement error is transformed nonlinearly, and sparse visits create additional mismatch in time. Model the latent trajectory and its measurement process rather than treating a noisy or stale observation as the hazard-driving value.

Check Your Understanding

Answer each question, then compare with the brief solutions below.

  1. If the marker error is mean zero and normally distributed with variance \(\sigma^2\), what is the factor relating the mean plug-in hazard to the latent-trajectory hazard at a fixed latent marker?
  2. For \(\alpha=0.5\) per point and a marker discrepancy of \(0.4\) points, what is the plug-in-to-latent hazard ratio?
  3. Why can a value carried forward from a visit understate the hazard at a later time?
  4. Name two assumptions or features of the observation process that should be examined when using a latent-trajectory joint model.

Solutions. (1) The factor is \(\exp(\alpha^2\sigma^2/2)\), under the stated normal-error assumptions. (2) The ratio is \(\exp(0.5\times0.4)=\exp(0.20)=1.221\); the plug-in hazard is 22.1% higher for that discrepancy. (3) If the marker has increased since the visit and \(\alpha>0\), the carried-forward value is lower than the current latent value, so its exponentiated hazard is lower. (4) Examples include the trajectory form, the error distribution and variance, whether measurement errors are independent conditional on the trajectory, and whether visit timing depends on health status or impending events.

Clinical Biostats