Tutorials › Joint Modeling of Longitudinal and Time-to-Event Data › Missing Marker Measurements in the Observed-Data Likelihood

The Basic Joint Model · Tutorial 156 of 697

Missing Marker Measurements in the Observed-Data Likelihood

Build the longitudinal likelihood from observed marker values and determine when the missingness mechanism can be ignored without changing inference about the joint model.

Advanced 11 min read

What You'll Learn

  • Distinguish a missing scheduled measurement from a visit that was not due or occurred after follow-up ended.
  • Write the observed-data contribution using only observed marker densities and the subject’s event or censoring contribution.
  • Show why integrating over an unobserved marker value contributes one when the model and missingness assumptions permit it.
  • State the missing-at-random and parameter-distinctness conditions for ignoring the missingness process.
  • Recognize how informative missingness can alter the random-effects distribution represented in the likelihood.
  • Compare likelihood-based use of incomplete records with complete-case analysis and explicit missingness models.

Why Missing Marker Values Need Careful Treatment

Longitudinal follow-up rarely produces a complete row of marker measurements for every participant. A scheduled visit may be missed, a specimen may be unusable, or a measurement may not be recorded. In a joint model, the available marker values still inform the subject-specific trajectory and, through shared random effects, the event-time contribution. The central task is therefore not to discard every subject with an incomplete marker record, but to write the likelihood for what was actually observed and state when the process that produced the missing values can be left out.

A missing scheduled measurement is different from a measurement that was never due, or one scheduled after the subject’s event or censoring time. Only a scheduled measurement within the subject’s observation period is a candidate for being missing. The observation-schedule and risk-time conventions established earlier determine which occasions belong in the record; missingness concerns an eligible occasion whose marker value was not observed.

Observed Marker Densities in the Joint Likelihood

For subject \(i\), let \(b_i\) denote the shared random effects, with density \(p(b_i;\theta_b)\). At scheduled time \(t_{ij}\), let \(Y_{ij}\) be the marker and let \(R_{ij}=1\) indicate that its value was observed; \(R_{ij}=0\) indicates that the scheduled value is missing. Define \(\mathcal O_i=\{j:R_{ij}=1\}\), the set of observed scheduled marker occasions. Write \(T_i\) for the observed event or censoring time and \(\delta_i\) for the event indicator. Conditional on \(b_i\), the longitudinal model supplies marker densities \(f_Y(y_{ij}\mid b_i;\theta_y)\), and the survival model supplies the event or censoring contribution \(f_T(T_i,\delta_i\mid b_i;\theta_T)\).

Definition: Under an ignorable missingness process, the subject’s observed-data likelihood contribution is
$$ L_i(\theta)=\int \left\{\prod_{j\in\mathcal O_i} f_Y(y_{ij}\mid b_i;\theta_y)\right\} f_T(T_i,\delta_i\mid b_i;\theta_T) p(b_i;\theta_b)\,db_i. $$
Here \(\theta=(\theta_y,\theta_T,\theta_b)\). The product contains only observed marker values; the event or censoring contribution and random-effects density remain in the integral.

The expression is conditional on a set of assumptions. The marker and event models must be correctly specified, including their conditional structure given the shared random effects. The model must use the actual observed values and the applicable risk period. In particular, a marker value after the event is not a scheduled pre-event value with a missing observation. The formula also presumes that the missingness process is ignorable under the conditions stated below. If those conditions fail, the displayed likelihood alone may not represent the likelihood of the observed data.

For a right-censored subject, \(f_T\) is the survival-model contribution appropriate to the observed time and event indicator; for an observed event it includes the event density. Thus missingness changes the longitudinal product, not the rule for constructing the event contribution. The integral over \(b_i\) is still necessary: the observed markers and event record jointly contribute information about the shared latent effects.

Why an Unobserved Marker Density Disappears

The omission of a missing marker density is not an assumption that its value is zero, nor is it a substitution of a guessed value. It follows from integrating over the unobserved value under the longitudinal model. Conditional on \(b_i\), a properly normalized density integrates to one. If the missingness mechanism is ignorable, integrating over a missing marker contributes no additional factor to the likelihood for \(\theta\).

1
Write the complete marker product.
For a missing occasion \(k\), include \(f_Y(y_{ik}\mid b_i;\theta_y)\) temporarily, alongside the densities for the observed occasions.
2
Integrate the unobserved value.
Because the marker density is normalized, \(\int f_Y(y_{ik}\mid b_i;\theta_y)\,dy_{ik}=1\).
3
Retain the rest of the likelihood.
The remaining observed marker densities, event contribution, and random-effects density still depend on \(b_i\), so they remain inside the integral over \(b_i\).
Justification: With one missing marker value and an ignorable missingness process, its integration gives
$$ \int f_Y(y_{ik}\mid b_i;\theta_y) \left\{\prod_{j\in\mathcal O_i} f_Y(y_{ij}\mid b_i;\theta_y)\right\} f_T(T_i,\delta_i\mid b_i;\theta_T)p(b_i;\theta_b)\,dy_{ik} = \left\{\prod_{j\in\mathcal O_i} f_Y(y_{ij}\mid b_i;\theta_y)\right\} f_T(T_i,\delta_i\mid b_i;\theta_T)p(b_i;\theta_b). $$
This equality holds for each \(b_i\); integrating both sides over \(b_i\) gives the observed-data contribution.

Worked Example: One Missing Value Among Two Scheduled Visits

Suppose a subject has two scheduled, eligible marker visits. The first marker value \(y_{i1}\) is observed, while the second is missing. Conditional on a random intercept \(b_i\), assume the two marker values have independent normal errors with standard deviation \(\sigma\) and means \(\mu_{i1}(b_i)\) and \(\mu_{i2}(b_i)\). The subject has an observed event or censoring contribution \(f_T(T_i,\delta_i\mid b_i)\).

If both marker values were observed, the conditional marker part would be \(f_Y(y_{i1}\mid b_i)f_Y(y_{i2}\mid b_i)\). For the actual record, the second value is unknown, so integrate it:

$$ \int_{-\infty}^{\infty} f_Y(y_{i1}\mid b_i)f_Y(y_{i2}\mid b_i)\,dy_{i2} = f_Y(y_{i1}\mid b_i) \int_{-\infty}^{\infty}f_Y(y_{i2}\mid b_i)\,dy_{i2} = f_Y(y_{i1}\mid b_i). $$

The observed-data contribution is consequently \(\int f_Y(y_{i1}\mid b_i)f_T(T_i,\delta_i\mid b_i)p(b_i)\,db_i\). The missing visit does not supply a marker density evaluated at an invented value. It also does not remove the subject’s observed first marker or event information. The normalization argument requires an ignorable missingness mechanism; the next section makes that condition explicit.

When the Missingness Process Can Be Ignored

Let \(Y_{\mathrm{obs}}\) and \(Y_{\mathrm{mis}}\) denote all scheduled marker values that are observed and missing, respectively. Let \(R\) denote the full observation pattern, and let \(D\) denote other observed data used in the joint likelihood, including covariates and the event or censoring record. A standard sufficient condition for ignoring the missingness process is missing at random (MAR): conditional on the observed data, the probability of the observation pattern does not depend on the unobserved marker values. Formally, for missingness parameters \(\psi\), \(p(R\mid Y_{\mathrm{obs}},Y_{\mathrm{mis}},D;\psi)=p(R\mid Y_{\mathrm{obs}},D;\psi)\).

MAR alone is not enough. The parameters governing the data model, \(\theta\), and those governing missingness, \(\psi\), must be distinct, so the parameter space factors into separate components rather than imposing a shared constraint. Under MAR and parameter distinctness, the observed-data likelihood factors into a data-model likelihood and a missingness factor that depends on observed quantities and \(\psi\), not on \(\theta\). Inference about \(\theta\) can then use the observed-data likelihood above without modeling the missingness process.

The observed information relevant to MAR must be defined carefully. In this setting it includes the observed event or censoring history, not only the observed marker values. For example, missingness may depend on an already observed event status or on a previously recorded marker value and still satisfy MAR, provided it does not additionally depend on the unobserved marker value after conditioning on the observed data. A dependence on an unobserved current marker, or on a latent random effect that remains associated with that marker after conditioning on observed data, is not automatically ignorable.

Worked Example: Missingness Depending on an Observed History

At a scheduled visit, suppose the chance of obtaining a marker is higher when the subject’s previously observed marker was low. The current marker is missing for some subjects, but the previous marker and the event or censoring record are observed. If the observation probability depends only on those observed quantities and known covariates, then it does not depend on the current unobserved marker after conditioning on \(D\) and \(Y_{\mathrm{obs}}\). This is MAR for this observation pattern.

For example, define \(R=1\) for an observed current marker and suppose the observation probabilities are 0.8 for a previously observed low marker and 0.5 for a previously observed high marker. For a subject with a previously observed low marker and a missing current marker, the missingness factor is \(P(R=0\mid Y_{\mathrm{previous}},D)=1-0.8=0.2\). That factor is determined by observed data and missingness parameters; it is constant with respect to the current unobserved marker and the joint-model parameter \(\theta\). It therefore does not change the likelihood-based inference for \(\theta\) under parameter distinctness.

This conclusion is conditional on the stated model for the observation process. If the chance of observing the current marker also depends on its unobserved value, the example no longer satisfies MAR, even if the observed-history probabilities are modeled correctly.

Worked Example: How Informative Missingness Changes the Observed Record

Consider a simple binary marker \(Y\), taking values \(+1\) or \(-1\) with probability 0.5 each. Suppose the current marker is missing with probability 0.2 when \(Y=+1\), and with probability 0.8 when \(Y=-1\). The missingness depends directly on the marker value that is not observed, so it is not MAR.

The overall probability of a missing marker is \(P(R=0)=P(R=0\mid Y=+1)P(Y=+1)+P(R=0\mid Y=-1)P(Y=-1)\). Substitution gives \(0.2(0.5)+0.8(0.5)=0.50\). Among records with a missing marker, the probability the marker was \(+1\) is \(P(Y=+1\mid R=0)=P(R=0\mid Y=+1)P(Y=+1)/P(R=0)\). Thus \(P(Y=+1\mid R=0)=0.2(0.5)/0.50=0.20\), rather than the 0.50 probability in the original marker distribution.

The pattern of missingness has selected records with fewer \(+1\) values. Treating the missingness pattern as irrelevant would fail to represent this selection. A likelihood that accounts for it must model the observation process or use another justified approach to the nonignorable missingness. In a shared-random-effects model, informative missingness can similarly change how the observed records represent the latent effects.

Practical Checks, Alternatives, and Limits

Before fitting the likelihood, verify which visits were scheduled and eligible, distinguish missing values from visits after the terminal time, and check that every observed marker density corresponds to an actual recorded value. Inspect missingness rates by visit and compare them across observed covariates, prior marker values, and event or censoring histories. Such checks can reveal patterns inconsistent with a proposed observation model, but they cannot establish MAR: the dependence on the unobserved values is not directly testable from the observed data alone.

Likelihood-based use of incomplete records differs from complete-case analysis. Complete-case analysis discards subjects with any missing marker value; it can lose substantial information and may induce selection bias. The observed-data likelihood uses each subject’s available marker measurements and event record, while integrating over shared random effects. It is not a general cure for informative missingness: if the mechanism is nonignorable, omitting it can bias estimation even when the longitudinal and survival submodels are otherwise correctly specified.

Other approaches include explicitly modeling the missingness probability, or conducting sensitivity analyses using selection or pattern-mixture models. Multiple imputation is another possible strategy, but imputations must respect the longitudinal structure, event information, and dependence represented by the joint model. These approaches require additional modeling choices; none makes the missingness assumptions disappear. The appropriate analysis depends on the scientific context and on how plausible the proposed assumptions are.

Common Pitfall

A frequent error is to say, “The marker is missing, so its likelihood contribution is zero,” or to substitute a predicted marker value and treat it as observed. Both are incorrect. A missing value contributes no observed marker density under an ignorable mechanism because its density integrates to one, not because its value is zero. The subject’s other observed markers and event contribution remain in the likelihood, and uncertainty about the shared random effects is handled by integration. If missingness depends on the unobserved value, the missingness process may itself carry information and cannot simply be discarded.

Key takeaway: Use the product of marker densities for observed scheduled values, retain the subject’s survival contribution, and integrate over the shared random effects. Ignoring the observation process requires both MAR relative to the full observed data and distinct missingness and data-model parameters.

Check Your Understanding

Answer the questions, then compare your reasoning with the solutions.

  1. A subject has three eligible scheduled marker visits; the first and third values are observed. Which marker densities enter the longitudinal product?
  2. State the two standard conditions that permit the missingness process to be ignored in likelihood inference for the joint-model parameters.
  3. Why is a scheduled visit after a subject’s event not treated as a missing pre-event measurement?
  4. Suppose the probability of obtaining a marker depends only on a previously observed marker and recorded covariates. Is this compatible with MAR? Explain the condition that matters.
  5. A missingness probability depends on the current marker value even when that value is unobserved. What is the implication for the observed-data likelihood?

Solutions. (1) The product contains \(f_Y(y_{i1}\mid b_i)\) and \(f_Y(y_{i3}\mid b_i)\); it does not contain a density for the missing second value. (2) MAR conditional on all relevant observed data, together with parameter distinctness between the missingness and data models. (3) The subject was no longer under observation at that scheduled time, so there was no eligible measurement that could have been observed; this is not a missing scheduled value. (4) Yes, if the probability does not also depend on the current unobserved marker after conditioning on the observed history and other observed data. (5) The process is nonignorable under MAR; its contribution may need to be modeled or addressed through a justified sensitivity analysis.

Clinical Biostats