Tutorials › Multi-Omics Data Integration › Joint Models For Multiple Omics Trajectories

Clinical Outcomes: Survival and Longitudinal Data · Tutorial 463 of 597

Joint Models For Multiple Omics Trajectories

Learn how shared latent effects connect multiple omics trajectories while distinct association parameters describe how each trajectory relates to event risk.

Advanced 13 min read

What You'll Learn

  • Specify longitudinal submodels for multiple omics features using shared and modality-specific random effects.
  • Distinguish cross-omics dependence from each feature’s association with the event hazard.
  • Interpret modality-specific hazard associations in the features’ measurement units.
  • Derive the subject-level likelihood by integrating over latent random effects.
  • Identify identifiability concerns, model diagnostics, and alternatives to shared-parameter joint models.

Why Model Several Trajectories Together?

A patient’s molecular measurements may evolve together: a shared biological process can affect several omics features, while each feature may also have its own trajectory. If event risk is related to these evolving measurements, fitting separate longitudinal models and treating their fitted values as known predictors can discard uncertainty and cross-feature dependence. A joint model represents the trajectories and event time in one probability model.

The central distinction is between how the omics features depend on one another and how each feature is associated with event risk. Shared latent random effects describe dependence among trajectories. Modality-specific association parameters describe how the fitted trajectory for each feature enters the hazard. Correlated trajectories do not, by themselves, imply equal risk associations.

A Joint Model for Multiple Omics Trajectories

Let \(i\) index subjects, \(k=1,\ldots,K\) index omics features, and \(j\) index measurements. Let \(Y_{ikj}\) be feature \(k\)'s measured value for subject \(i\) at time \(t_{ikj}\). A useful model separates a latent effect shared across features from feature-specific random effects:

$$ Y_{ikj}=x_{ikj}^{T}\beta_k+\lambda_k^{T}U_i+z_{ikj}^{T}V_{ik}+\epsilon_{ikj}. $$

Here \(x_{ikj}\) and \(z_{ikj}\) are specified covariate and time-basis vectors; \(\beta_k\) is a feature-specific fixed-effect vector; \(U_i\) is a vector of shared latent effects; \(\lambda_k\) gives feature \(k\)'s loading on those effects; and \(V_{ik}\) is a feature-specific random effect. The subject-specific fitted trajectory, conditional on the latent effects, is

$$ m_{ik}(t\mid U_i,V_{ik})=x_{ik}(t)^T\beta_k+\lambda_k^TU_i+z_{ik}(t)^TV_{ik}. $$

A basic specification assumes \(U_i\sim N(0,G)\) and the stacked vector \(V_i=(V_{i1}^{T},\ldots,V_{iK}^{T})^{T}\sim N(0,D)\), independently of \(U_i\). It may allow dependence between the components of \(V_i\) through \(D\). For a simple Gaussian measurement model, \(\epsilon_{ikj}\sim N(0,\sigma_k^2)\), independently across measurements conditional on the random effects. More general residual covariance structures are possible when justified by the measurement design.

Definition: A shared latent effect is a subject-level random quantity that enters the trajectory models for more than one feature. A modality-specific event-risk association is a coefficient linking one feature’s fitted trajectory to the event hazard. The former models cross-feature dependence; the latter models the trajectory–event association.

For a single event time \(T_i\), let \(\Delta_i=1\) indicate an observed event and \(\Delta_i=0\) indicate right censoring. A current-value association model is

$$ h_i(t\mid U_i,V_i)=h_0(t)\exp\left\{\gamma^Tw_i+\sum_{k=1}^{K}\alpha_k m_{ik}(t\mid U_i,V_{ik})\right\}. $$

Here \(h_0(t)\) is the baseline hazard, \(w_i\) contains event-model covariates, \(\gamma\) is their coefficient vector, and \(\alpha_k\) is the association parameter for feature \(k\). The model assumes that, conditional on the latent effects and included covariates, the hazard depends on the specified current fitted trajectory values. It does not automatically establish a causal effect of an omics feature.

The shared effects influence the hazard through the trajectories they help determine. For example, if \(U_i\) is scalar, its contribution to the log hazard through these trajectories is \(\sum_k\alpha_k\lambda_k U_i\). Thus a shared latent effect can be associated with event risk even though the hazard has a separate \(\alpha_k\) for each feature. Adding an additional direct coefficient for \(U_i\) is a different, more elaborate model; it can be difficult to distinguish from the trajectory-mediated contribution and needs a clear scientific rationale and adequate information.

Interpreting the Association Parameters

Conditional on the latent effects and other covariates, increasing feature \(k\)'s fitted value by one unit while holding the other fitted values fixed multiplies the hazard by \(\exp(\alpha_k)\). The unit is the unit in which that feature enters the model. If a feature is standardized, the unit is one standard deviation; if it is log-transformed, it is one unit on the log scale. The interpretation is conditional association, not a comparison of two otherwise interchangeable patients.

When features are correlated, “holding the other fitted values fixed” may describe a contrast that is unusual or poorly supported by the data. The \(\alpha_k\) values are still parameters of the specified model, but their separate estimates can be imprecise. It is useful to report uncertainty intervals and to assess whether the data contain enough independent trajectory variation to distinguish the associations.

Worked Example: Combining Two Feature-Specific Associations

Suppose a hypothetical fitted model uses two standardized omics trajectories. At a particular time, one subject’s fitted value for feature 1 is 1 unit higher and feature 2 is 0.5 units higher than a comparison profile, with all other covariates equal. Let the estimated association parameters be \(\alpha_1=0.30\) and \(\alpha_2=-0.20\).

Model and assumptions. Use the current-value hazard above, with both features entered linearly and measured in standard-deviation units. The calculation is conditional on the fitted trajectories and other covariates; it assumes this specified hazard form is appropriate for the comparison.

The log hazard ratio is the sum of each coefficient times its trajectory difference:

$$ \log(HR)=0.30(1)+(-0.20)(0.5)=0.30-0.10=0.20. $$

Exponentiating gives

$$ HR=\exp(0.20)=1.221. $$

Under this model, the profile has an estimated hazard 1.221 times that of the comparison profile at that time, conditional on the other covariates and latent effects. The calculation does not mean that either feature causes the event. The negative contribution from feature 2 partially offsets the positive contribution from feature 1.

Shared Dependence Is Not the Same as Equal Risk Association

The shared random effect can induce correlation between measurements from different features. That dependence is governed by the latent-effect distribution and the feature loadings, not by the \(\alpha_k\) parameters. Conversely, the \(\alpha_k\) values can differ even when the trajectories are strongly correlated. This distinction is central to interpreting a multi-trajectory joint model.

Worked Example: Correlation From a Shared Latent Effect

Consider two hypothetical measurements at a fixed time, with a scalar shared effect \(U_i\) having variance \(0.25\). Let their shared-effect loadings be \(\lambda_1=0.8\) and \(\lambda_2=0.5\). Suppose the feature-specific random effects have variances \(0.36\) and \(0.49\), and the measurement-error variances are \(0.16\) and \(0.25\). Assume the feature-specific effects and measurement errors are mutually independent and independent of \(U_i\).

The shared component contributes \(\lambda_1\lambda_2\operatorname{Var}(U_i)\) to the covariance:

$$ \operatorname{Cov}(Y_{i1},Y_{i2})=(0.8)(0.5)(0.25)=0.100. $$

For feature 1, the total variance is

$$ \operatorname{Var}(Y_{i1})=(0.8)^2(0.25)+0.36+0.16=0.16+0.36+0.16=0.68. $$

For feature 2, it is

$$ \operatorname{Var}(Y_{i2})=(0.5)^2(0.25)+0.49+0.25=0.0625+0.49+0.25=0.8025. $$

Therefore the correlation is

$$ \operatorname{Corr}(Y_{i1},Y_{i2})=\frac{0.100}{\sqrt{(0.68)(0.8025)}}\approx 0.1353. $$

The shared effect creates positive dependence, but the resulting correlation is modest because the feature-specific and measurement variances also contribute. This calculation says nothing about whether \(\alpha_1\) and \(\alpha_2\) are equal: they belong to the event-risk model, not this covariance calculation.

Likelihood and a Justification for Joint Estimation

For a subject with event or censoring time \(T_i\), the event contribution conditional on the random effects is the hazard at \(T_i\), raised to \(\Delta_i\), multiplied by the survival probability through \(T_i\). If \(f_i(Y_i\mid U_i,V_i)\) denotes the joint density of that subject’s longitudinal measurements, the subject-level marginal likelihood contribution is

$$ L_i=\int f_i(Y_i\mid U_i,V_i)\, h_i(T_i\mid U_i,V_i)^{\Delta_i} \exp\left\{-\int_0^{T_i}h_i(s\mid U_i,V_i)\,ds\right\} \,p(U_i,V_i)\,dU_i\,dV_i. $$

The integral averages over the unobserved random effects. Its construction relies on a specified longitudinal measurement model, a specified conditional hazard, and a specified random-effects distribution. It also assumes that censoring is noninformative conditional on the modeled quantities, so the censoring mechanism does not require an additional likelihood component. The earlier material on likelihood construction for joint longitudinal-survival models gives the general event-time factor; here the longitudinal density and latent effects must cover all included features.

The reason for integrating rather than plugging in estimated trajectories can be seen directly from the conditional model. Given the random effects, the measurement density and event contribution are modeled together. But those effects are not observed, so the likelihood for the observed data is their probability-weighted average, not the likelihood evaluated at a single estimated value. In general, integrating a likelihood over random effects is not equivalent to substituting their estimated means. Joint estimation therefore carries uncertainty about the latent trajectories into estimation of the event associations.

1
Specify the trajectory structure.
Choose time bases, covariates, shared loadings, feature-specific random effects, and measurement-error distributions before interpreting fitted trajectories.
2
Specify the event association.
Choose the trajectory feature entering the hazard, such as current value, and state the conditional event model and censoring assumption.
3
Estimate jointly.
Construct each subject’s likelihood by combining all feature measurements with the event-time contribution and integrating over that subject’s latent effects.
4
Check both components.
Assess trajectory fit and the event model, then examine whether the estimated feature-specific associations are distinguishable given cross-feature dependence.

Worked Example: The Shared Effect’s Implied Hazard Contribution

Suppose a hypothetical model has a scalar shared effect \(U_i\), with loadings \(\lambda_1=0.8\) and \(\lambda_2=0.5\). The fitted hazard associations are \(\alpha_1=0.30\) and \(\alpha_2=-0.20\). Consider a one-unit increase in \(U_i\), holding feature-specific random effects and other covariates fixed.

Model and assumptions. Use the stated linear current-value hazard and assume the loadings and association parameters are identified under the chosen trajectory model. The calculation isolates the shared-effect contribution; it is not an estimate of a causal intervention on \(U_i\).

The change in the feature 1 fitted trajectory is \(0.8\) units and the change in feature 2 is \(0.5\) units. Hence the log hazard change due to both is

$$ \Delta\log h=\alpha_1\lambda_1+\alpha_2\lambda_2 =(0.30)(0.8)+(-0.20)(0.5)=0.24-0.10=0.14. $$

The corresponding hazard ratio is

$$ HR=\exp(0.14)=1.150. $$

Thus a one-unit increase in this shared latent effect corresponds to a 1.150-fold hazard, conditional on the stated model and other quantities. Its contribution combines both feature loadings and both feature-specific associations; it is not a third modality-specific association parameter.

Assumptions, Diagnostics, and Failure Modes

The interpretation and estimation depend on assumptions that should be checked against the study design and data:

  • Trajectory form: the chosen fixed and random time functions adequately describe the mean trajectories over observed times. If curvature remains in residuals, a linear time term may be inadequate; spline models are one possible choice.
  • Random-effects structure: the distribution and covariance restrictions for shared and feature-specific effects are plausible. Too few shared factors can miss dependence; too many can be weakly identified.
  • Measurement model: the conditional error distributions and residual dependence are adequate for each assay. Heavy tails, outliers, batch effects, or assay-specific heteroscedasticity can distort trajectory estimates.
  • Event model: the baseline hazard and chosen trajectory association form are adequate. A current-value link is not interchangeable with a slope or cumulative-exposure link.
  • Conditional censoring: censoring is noninformative given the modeled information. If dropout or visit timing depends on unmodeled health status, that assumption may fail.
  • Identifiability: enough subjects, repeated measurements, and independent variation exist to distinguish shared effects, feature-specific effects, and \(\alpha_k\) values.

Useful diagnostics include plotting observed measurements and fitted trajectories by feature, inspecting residual patterns against time and fitted values, checking convergence and sensitivity to starting values, and examining estimated random-effect variances and correlations. Very large standard errors, correlations near their parameter boundaries, unstable estimates across reasonable model specifications, or a nearly singular covariance matrix can indicate weak identification. For event associations, compare estimates and uncertainty intervals across defensible trajectory and hazard specifications rather than relying only on whether a coefficient crosses a significance threshold.

A frequent mistake is to interpret a strong correlation between two omics trajectories as evidence that their hazard associations must be the same. Correlation is represented in the random-effects and residual structure; equality of associations is a separate restriction such as \(\alpha_1=\alpha_2\), which must be justified and assessed rather than assumed. Another mistake is to treat fitted trajectories as error-free observed covariates in a survival model. They are estimated from noisy, incomplete measurements, and ignoring that estimation uncertainty can produce misleading association estimates.

Alternatives and Limitations

ApproachWhat it representsMain caution
Separate longitudinal models followed by a survival modelFits trajectories and then uses summaries or fitted values in an event model.May fail to carry trajectory uncertainty into event-association estimation.
Time-dependent Cox modelUses observed time-updated covariates in the event model.Does not, by itself, model latent trajectories or measurement error in the same way.
Multi-trajectory shared-parameter joint modelModels several measurement processes and event risk through specified shared latent effects and feature-specific associations.Can be computationally demanding and sensitive to covariance, trajectory, and hazard assumptions.

The joint model is not automatically superior: it trades a more explicit account of measurement and latent dependence for stronger distributional and structural assumptions. With sparse measurements or highly correlated features, separate \(\alpha_k\) estimates may be unstable. A common-factor specification also requires enough information to identify its scale and loadings; without suitable constraints, different parameter values can describe nearly the same trajectory distribution. The model’s conclusions should therefore be framed as conditional on its stated assumptions and measurement scale.

Key takeaway: Shared latent effects explain how multiple omics trajectories can co-vary. The parameters \(\alpha_k\) separately describe how each fitted trajectory enters the event hazard. Keep these roles distinct when specifying, diagnosing, and interpreting a multi-trajectory joint model.

Check Your Understanding

Answer each question, then compare with the solutions below.

  1. In the model, what does \(D\) describe, and how is that role different from \(\alpha_k\)?
  2. If \(\alpha_k=0.4\) for a feature measured in standard-deviation units, what hazard ratio corresponds to a one-unit increase in its fitted value, holding other terms fixed?
  3. Two features have correlated trajectories. Does that alone imply equal event-risk associations? Explain.
  4. For the shared-effect example, what is the log hazard change for a one-unit increase in \(U_i\) if \(\alpha_1=0.2,\lambda_1=0.6,\alpha_2=0.1,\lambda_2=0.4\)?
  5. Name one diagnostic sign that the shared and feature-specific random effects may be weakly identified.

Solutions. (1) \(D\) describes the covariance of feature-specific random effects; \(\alpha_k\) links feature \(k\)'s fitted trajectory to the hazard. (2) \(\exp(0.4)=1.492\), so the conditional hazard is estimated to be about 1.492 times as large. (3) No. Dependence is represented in the trajectory covariance structure; equality of the risk associations is a separate restriction. (4) The log hazard change is \((0.2)(0.6)+(0.1)(0.4)=0.16\). (5) Examples include very large association standard errors, unstable estimates across starting values, or a nearly singular estimated random-effects covariance matrix.

Clinical Biostats