Tutorials › Statistical Genetics › Bivariate Genomic Mixed Models For Two Traits

Genetic Correlation Across Traits · Tutorial 559 of 989

Bivariate Genomic Mixed Models For Two Traits

Learn to write the bivariate genomic mixed model and interpret the genetic, residual, and total covariance structures it implies.

Advanced 9 min read

What You'll Learn

  • Write the two trait equations with trait-specific fixed effects and genetic and residual random effects.
  • Specify the genetic and residual covariance matrices and the assumptions they encode.
  • Construct the covariance matrix for the two traits stacked across individuals.
  • Distinguish cross-trait genetic covariance from residual covariance and total phenotypic covariance.
  • Check whether proposed covariance components are mathematically admissible.

Why Model Two Traits Together?

When two traits are measured on related individuals, their observed association can reflect more than one source of covariance. Individuals can share genetic effects, and measurements on the same individual can also share residual influences. A bivariate genomic mixed model represents these sources separately while allowing each trait to have its own genetic and residual variance.

The model is a specification: it states how the expected values and covariance of the observations are represented. It does not, by itself, guarantee that the components can be estimated precisely in a particular study. Here the focus is the model and the meaning of its covariance blocks.

Definition: A bivariate genomic mixed model jointly models two traits measured on \(n\) individuals. It includes trait-specific fixed effects, a pair of genetic random effects whose covariance across individuals is structured by a genomic relationship matrix \(K\), and residual effects that may covary between traits on the same individual.

Model for the Two Trait Vectors

Let \(y_1\) and \(y_2\) be the \(n\)-vectors of observations for traits 1 and 2, in the same individual order. Let \(X_1\) and \(X_2\) be fixed-effect design matrices, and let \(\beta_1\) and \(\beta_2\) be their coefficient vectors. The model is

$$ y_1 = X_1\beta_1 + u_1 + e_1,\qquad y_2 = X_2\beta_2 + u_2 + e_2. $$

Here \(u_1,u_2\) are the genetic random-effect vectors, and \(e_1,e_2\) are residual vectors. The fixed effects may differ between traits; for example, their design matrices can include different covariates. The model assumes the fixed-effect means are \(X_1\beta_1\) and \(X_2\beta_2\), while the random effects have mean zero.

The genomic relationship matrix \(K\) is an \(n\)-by-\(n\), known, symmetric positive semidefinite matrix aligned to the individuals in both trait vectors. Its entries encode the genomic relationship structure used by the model. The covariance specification is

$$ \operatorname{Cov}(u_1)=\sigma^2_{g1}K,\qquad \operatorname{Cov}(u_2)=\sigma^2_{g2}K,\qquad \operatorname{Cov}(u_1,u_2)=\sigma_{g12}K, $$

and

$$ \operatorname{Cov}(e_1)=\sigma^2_{e1}I_n,\qquad \operatorname{Cov}(e_2)=\sigma^2_{e2}I_n,\qquad \operatorname{Cov}(e_1,e_2)=\sigma_{e12}I_n. $$

The \(g\) subscript denotes the genetic component and the \(e\) subscript the residual component. Each variance is trait-specific; \(\sigma_{g12}\) and \(\sigma_{e12}\) are cross-trait covariances. Covariance units are the product of the units of the two traits; a variance has the square of its trait's units.

Worked Example: Writing the Trait Equations

Suppose a hypothetical study measures a blood marker in milligrams per liter and a lung-function measure in liters on the same \(n\) individuals. The marker model includes an intercept and age, while the lung-function model includes an intercept, age, and sex.

Write \(X_1\) with columns for the intercept and age and \(X_2\) with columns for the intercept, age, and sex. The equations are

$$ y_1=X_1\beta_1+u_1+e_1,\qquad y_2=X_2\beta_2+u_2+e_2. $$

For example, \(u_1\) is measured in milligrams per liter and \(u_2\) in liters. Thus \(\sigma^2_{g1}\) has units \((\text{mg/L})^2\), \(\sigma^2_{g2}\) has units \(\text{L}^2\), and \(\sigma_{g12}\) has units \((\text{mg/L})\text{L}\). The same unit logic applies to residual components. Different fixed-effect designs are permitted; the covariance model still pairs the genetic effects and residuals for individuals in the shared ordering.

Covariance Blocks and Their Interpretation

For compactness, define the trait-level genetic and residual covariance matrices

$$ \Sigma_g= \begin{pmatrix} \sigma^2_{g1} & \sigma_{g12}\\ \sigma_{g12} & \sigma^2_{g2} \end{pmatrix}, \qquad \Sigma_e= \begin{pmatrix} \sigma^2_{e1} & \sigma_{e12}\\ \sigma_{e12} & \sigma^2_{e2} \end{pmatrix}. $$

The diagonal entries are the trait-specific variances. The off-diagonal entries are cross-trait covariances: \(\sigma_{g12}\) describes genetic covariance, while \(\sigma_{e12}\) describes residual covariance for the same individual. For the residual model, \(I_n\) means that residuals are uncorrelated across different individuals; the residual covariance between traits applies to the two measurements on the same individual.

Stack the observations by trait as \(y=(y_1^\mathsf{T},y_2^\mathsf{T})^\mathsf{T}\). Under the stated model, the covariance of \(y\) is

$$ \operatorname{Cov}(y)= \begin{pmatrix} \sigma^2_{g1}K+\sigma^2_{e1}I_n & \sigma_{g12}K+\sigma_{e12}I_n\\ \sigma_{g12}K+\sigma_{e12}I_n & \sigma^2_{g2}K+\sigma^2_{e2}I_n \end{pmatrix}. $$

The upper-left and lower-right blocks are the marginal covariance matrices within each trait. Each combines a genetic covariance structured by \(K\) and a residual variance on the diagonal. The off-diagonal block is the covariance between the two trait vectors. Its genetic part is proportional to \(K\); its residual part is proportional to \(I_n\). Thus the model distinguishes cross-trait covariance between different individuals, as represented through genomic relationships, from residual cross-trait covariance within the same individual.

This form follows by adding independent genetic and residual contributions. For example, the covariance between \(y_1\) and \(y_2\) is the sum of \(\operatorname{Cov}(u_1,u_2)=\sigma_{g12}K\) and \(\operatorname{Cov}(e_1,e_2)=\sigma_{e12}I_n\), because genetic effects and residuals are assumed independent. The same addition gives each diagonal block.

Worked Example: Constructing the Full Covariance Matrix

Consider a hypothetical two-individual example with

$$ K=\begin{pmatrix}1&0.25\\0.25&1\end{pmatrix},\quad \Sigma_g=\begin{pmatrix}0.40&0.12\\0.12&0.25\end{pmatrix},\quad \Sigma_e=\begin{pmatrix}0.60&0.18\\0.18&0.75\end{pmatrix}. $$

The trait 1 marginal block is \(\sigma^2_{g1}K+\sigma^2_{e1}I_2\):

$$ 0.40\begin{pmatrix}1&0.25\\0.25&1\end{pmatrix} +0.60\begin{pmatrix}1&0\\0&1\end{pmatrix} = \begin{pmatrix}1.00&0.10\\0.10&1.00\end{pmatrix}. $$

For trait 2, the corresponding calculation is

$$ 0.25K+0.75I_2 = \begin{pmatrix}0.25&0.0625\\0.0625&0.25\end{pmatrix} +\begin{pmatrix}0.75&0\\0&0.75\end{pmatrix} = \begin{pmatrix}1.00&0.0625\\0.0625&1.00\end{pmatrix}. $$

The cross-trait block is

$$ 0.12K+0.18I_2 = \begin{pmatrix}0.12&0.03\\0.03&0.12\end{pmatrix} +\begin{pmatrix}0.18&0\\0&0.18\end{pmatrix} = \begin{pmatrix}0.30&0.03\\0.03&0.30\end{pmatrix}. $$

Therefore, with observations ordered as \((y_{11},y_{21},y_{12},y_{22})\), meaning both individuals for trait 1 followed by both for trait 2, the full covariance matrix is

$$ \operatorname{Cov}(y)= \begin{pmatrix} 1&0.10&0.30&0.03\\ 0.10&1&0.03&0.30\\ 0.30&0.03&1&0.0625\\ 0.03&0.30&0.0625&1 \end{pmatrix}. $$

For the same individual, the cross-trait covariance is \(0.12(1)+0.18=0.30\). For the two distinct individuals, whose \(K\) entry is \(0.25\), it is \(0.12(0.25)+0=0.03\). The residual contribution is zero for that pair because the off-diagonal entries of \(I_2\) are zero.

Assumptions and Admissible Covariance Components

A covariance matrix must be positive semidefinite. Consequently, both \(\Sigma_g\) and \(\Sigma_e\) must be positive semidefinite, in addition to \(K\) being positive semidefinite. For a two-by-two covariance matrix with variances \(a\) and \(b\) and covariance \(c\), this requires \(a\geq0\), \(b\geq0\), and \(c^2\leq ab\). In the model, this gives

$$ \sigma_{g12}^2\leq \sigma^2_{g1}\sigma^2_{g2}, \qquad \sigma_{e12}^2\leq \sigma^2_{e1}\sigma^2_{e2}, $$

with nonnegative trait variances. These constraints prevent an impossible covariance specification. When both trait variances are positive, the corresponding covariance divided by the square root of their product is a correlation and must lie between \(-1\) and \(1\).

The basic specification also assumes that the genetic and residual vectors are mutually independent, that residuals are independent across individuals, and that the same \(K\) structure applies to both traits. The covariance structure can be stated using second moments alone. If a Gaussian linear mixed model is used for likelihood-based analysis, the joint random effects are additionally assumed to be normally distributed. That distributional assumption is distinct from the covariance-block definitions.

Worked Example: Checking Components and Interpreting the Cross-Trait Block

Use the components from the preceding hypothetical example. For the genetic matrix, the determinant is

$$ (0.40)(0.25)-(0.12)^2=0.1000-0.0144=0.0856>0. $$

Its diagonal entries are positive, so \(\Sigma_g\) is positive definite. For the residual matrix,

$$ (0.60)(0.75)-(0.18)^2=0.4500-0.0324=0.4176>0, $$

and its diagonal entries are also positive, so \(\Sigma_e\) is positive definite. The matrix \(K\) is positive definite: its eigenvalues are \(1.25\) and \(0.75\), both positive. These checks establish that the chosen component matrices are admissible.

For an individual with \(K_{ii}=1\), the genetic cross-trait covariance is \(0.12\), while the residual cross-trait covariance is \(0.18\). The total same-individual cross-trait covariance is \(0.30\). The marginal variances for both traits in this example are \(0.40+0.60=1.00\) and \(0.25+0.75=1.00\), so the same-individual phenotypic correlation is \(0.30/\sqrt{1.00(1.00)}=0.30\). This is not the genetic correlation: the genetic covariance alone gives \(0.12/\sqrt{0.40(0.25)}\approx0.3795\). These quantities differ because the total covariance includes the residual contribution as well.

Why the Block Structure Matters

The block representation makes the model's interpretation explicit. A nonzero cross-trait genetic covariance connects the traits through the genomic relationship structure, whereas a nonzero residual covariance connects the two measurements within an individual. Neither covariance alone states that one trait causes the other. They describe components of joint variation under the specified model.

The structure also clarifies what changes when data are incomplete. If one trait is unobserved for some individuals, the covariance for the observations that are actually available is the corresponding submatrix of the full covariance matrix. The underlying model still needs a common individual ordering and a clearly defined covariance structure.

A frequent mistake is to read the off-diagonal block as entirely genetic because the model is called a genomic mixed model. That is incorrect: the block is \(\sigma_{g12}K+\sigma_{e12}I_n\), so it contains both genetic and residual covariance. Another mistake is to treat \(\sigma_{g12}\) as the covariance of observed trait values for every pair of individuals. It is the trait-level genetic covariance multiplier; the genetic covariance for individuals \(i\) and \(j\) is \(\sigma_{g12}K_{ij}\), while the residual contribution is \(\sigma_{e12}\) only when \(i=j\).

Key takeaway: In a bivariate genomic mixed model, the genetic covariance block is \(\Sigma_g\) combined with \(K\), and the residual covariance block is \(\Sigma_e\) combined with \(I_n\). Their sum gives the covariance of the stacked trait observations.

Check Your Understanding

Use the model definitions above to answer the following questions.

  1. What does the off-diagonal element \(\sigma_{g12}K_{ij}\) represent for two traits measured on individuals \(i\) and \(j\)?
  2. Why does the residual cross-trait covariance block contain \(I_n\) rather than \(K\)?
  3. If \(\sigma_{e12}=0\), can the two observed traits still have nonzero covariance for the same individual? Explain using the model.
  4. State the positive-semidefinite constraint on \(\sigma_{g12}\) in terms of \(\sigma^2_{g1}\) and \(\sigma^2_{g2}\).
  5. Explain why the total same-individual phenotypic correlation need not equal the genetic correlation.
Clinical Biostats