Tutorials › Statistical Genetics › The Gaussian Likelihood for Family Phenotypes

Variance Components and Family QTLs · Tutorial 283 of 989

The Gaussian Likelihood for Family Phenotypes

Learn to write and interpret the Gaussian likelihood for correlated family phenotypes, including its quadratic form and log-likelihood.

Advanced 11 min read

What You'll Learn

  • Specify a Gaussian mean model and covariance matrix for phenotypes within a pedigree
  • Write the multivariate normal likelihood and identify its determinant and quadratic-form terms
  • Derive the log-likelihood from the density
  • Calculate likelihoods for hypothetical family phenotype data
  • Combine likelihood contributions from independent pedigrees
  • Recognize assumptions and common misinterpretations of a likelihood

Why a Family Likelihood Is Multivariate

In a pedigree, relatives’ quantitative phenotypes are generally correlated. A likelihood that treats each relative’s phenotype as an independent observation would therefore discard part of the model: the dependence encoded by the pedigree covariance matrix. The Gaussian likelihood puts the family’s phenotype vector, its modeled mean, and its covariance together in one probability density.

This tutorial derives that density and its log form. It assumes that the covariance matrices for the pedigree have already been specified, as in the earlier material on building pedigree covariance matrices. The task here is to translate a chosen mean and covariance model into a likelihood, not to estimate its parameters or derive a particular covariance matrix from genetic data.

Definition: For a pedigree with \(n\) observed phenotypes, write the phenotype vector as \(y=(y_1,\ldots,y_n)^\mathsf{T}\), its mean vector as \(\mu\), and its covariance matrix as \(V\). Under the multivariate Gaussian model, \(y\sim N(\mu,V)\), where \(V\) is symmetric and positive definite. The likelihood is the joint density of the observed vector, viewed as a function of the model parameters.

The mean vector specifies the expected phenotype for each person. A common fixed-effects model is \(\mu=X\beta\), where \(X\) is a known design matrix containing an intercept and any covariates, and \(\beta\) is a vector of unknown regression coefficients. A variance-components model expresses the covariance as a weighted sum of known pedigree matrices. For example,

$$ V(\theta)=\sum_{k=1}^{q}\tau_k A_k+\sigma_e^2 I_n. $$

Here \(A_k\) is a specified covariance-pattern matrix for component \(k\), \(\tau_k\) is its variance-component coefficient, \(I_n\) is the \(n\)-dimensional identity matrix, and \(\sigma_e^2\) is the residual variance. The parameter collection \(\theta\) includes the mean parameters and covariance parameters. The matrices and coefficients must yield a positive-definite \(V(\theta)\) for the ordinary nonsingular Gaussian density to apply. In particular, the residual term represents independent residual variation in this model; it does not mean the phenotypes themselves are independent.

The Multivariate Gaussian Likelihood

For an observed vector \(y\), define its residual vector relative to the modeled mean as \(r=y-\mu\). The multivariate normal density, and thus the likelihood as a function of the parameters, is

$$ L(\theta;y) = \frac{1}{(2\pi)^{n/2}|V(\theta)|^{1/2}} \exp\!\left\{ -\frac{1}{2} [y-\mu(\theta)]^\mathsf{T} V(\theta)^{-1} [y-\mu(\theta)] \right\}. $$

The determinant \(|V|\) describes the overall volume and scale of the modeled joint distribution. The quadratic form measures how far the observed phenotype vector lies from its mean, accounting for the covariance and hence the family relationships. It is a squared distance in covariance-scaled coordinates, not generally the sum of squared residuals divided by a common variance.

Interpretation: The likelihood is the joint density assigned to the observed phenotype vector by a particular parameter value. For continuous phenotypes, it is not the probability of observing those exact values, which is zero. Likelihood values compare how well different parameter values assign density to the same observed data; their numerical scale also depends on the measurement units.

Worked Example: A Two-Person Pedigree Likelihood

Consider two related individuals with hypothetical, standardized phenotypes \(y=(2,4)^\mathsf{T}\), and suppose their modeled means are both 3. Let the covariance matrix be

$$ V= \begin{pmatrix} 2&1\\ 1&2 \end{pmatrix}. $$

The assumptions for this calculation are that the two-person phenotype vector is jointly Gaussian with this mean and covariance, and that \(V\) is positive definite. Its determinant is \(2(2)-1(1)=3>0\), and its diagonal entries are positive, so this symmetric matrix is positive definite.

The residual vector is \(r=(-1,1)^\mathsf{T}\). The inverse covariance and quadratic form are

$$ V^{-1} = \frac{1}{3} \begin{pmatrix} 2&-1\\ -1&2 \end{pmatrix}, \qquad r^\mathsf{T}V^{-1}r=2. $$

Substituting \(n=2\), \(|V|=3\), and the quadratic form into the density gives

$$ L = \frac{1}{2\pi\sqrt{3}}\exp(-2/2) = \frac{e^{-1}}{2\pi\sqrt{3}} \approx 0.03380376. $$

This is the joint density at the two observed standardized phenotype values under the stated model. The off-diagonal covariance matters: the calculation uses the full inverse matrix, rather than multiplying two separate univariate densities.

From Density to Log-Likelihood

Taking the natural logarithm of the Gaussian likelihood turns its product and power terms into sums. Because the logarithm is strictly increasing, a parameter value that gives a larger likelihood also gives a larger log-likelihood. Applying the logarithm to each factor yields

$$ \ell(\theta;y) = -\frac{n}{2}\log(2\pi) -\frac{1}{2}\log|V(\theta)| -\frac{1}{2} [y-\mu(\theta)]^\mathsf{T} V(\theta)^{-1} [y-\mu(\theta)]. $$

The first term depends only on the number of phenotypes. The second penalizes covariance matrices with a large determinant, while the final term penalizes a poor fit of the observed vector to the modeled mean, measured relative to \(V\). Both covariance-dependent terms are essential: retaining only the quadratic form would reward some covariance choices simply for making residuals appear small, without accounting for the distribution’s scale.

The expression follows directly from the density: \(\log(a b)=\log(a)+\log(b)\), \(\log(|V|^{-1/2})=-\tfrac12\log|V|\), and \(\log(\exp(-Q/2))=-Q/2\), where \(Q=r^\mathsf{T}V^{-1}r\). Thus the log-likelihood is not a separate model; it is an equivalent representation of the same Gaussian likelihood.

Worked Example: Components Determine the Covariance and Density

Suppose two hypothetical siblings have a model with a shared familial component and independent residual variation:

$$ V=\sigma_g^2 \begin{pmatrix} 1&0.5\\ 0.5&1 \end{pmatrix} +\sigma_e^2 I_2, \qquad \sigma_g^2=1,\quad \sigma_e^2=1. $$

The first matrix is taken as given for this illustration; its entries encode the specified familial covariance pattern. Adding the two components gives

$$ V= \begin{pmatrix} 2&0.5\\ 0.5&2 \end{pmatrix}, \qquad |V|=4-0.25=3.75. $$

This covariance is positive definite because its diagonal entries are positive and its determinant is positive. Let the mean vector be \((0,0)^\mathsf{T}\), and let the hypothetical observed phenotypes be \(y=(1,0)^\mathsf{T}\). Then

$$ V^{-1} = \frac{1}{3.75} \begin{pmatrix} 2&-0.5\\ -0.5&2 \end{pmatrix}, \qquad y^\mathsf{T}V^{-1}y=\frac{2}{3.75}=0.5333. $$

Therefore the likelihood is

$$ L = \frac{1}{2\pi\sqrt{3.75}} \exp\!\left(-\frac{0.5333}{2}\right) = \frac{1}{2\pi\sqrt{3.75}}\exp(-0.2667) \approx 0.06295. $$

The nonzero off-diagonal entry comes from the shared component, while the residual component adds variance to each individual’s diagonal. The likelihood uses their sum as one joint covariance matrix.

Mean Models, Pedigree Blocks, and Independent Families

Covariates enter through the mean vector, not by changing the Gaussian formula. For example, if \(x_i\) is an individual’s age, a linear mean model might specify \(\mu_i=\beta_0+\beta_1 x_i\). The likelihood then compares each observed phenotype with its modeled mean while still using the pedigree covariance to account for dependence. A covariate in the mean does not by itself remove familial correlation.

When several pedigrees are sampled independently, their phenotype vectors are independent under the model conditional on their specified covariates and parameters. The overall likelihood is the product of their pedigree-specific likelihoods, and the overall log-likelihood is the sum. Equivalently, the full covariance matrix is block diagonal, with one covariance block per pedigree. Independence is across pedigrees in this setup, not among members of a pedigree.

Worked Example: Summing Log-Likelihoods Across Two Pedigrees

Suppose two independent hypothetical pedigrees each contain two observed phenotypes. In both, the mean vector is \((2,2)^\mathsf{T}\), and the covariance matrix is

$$ V= \begin{pmatrix} 1&0.25\\ 0.25&1 \end{pmatrix}, \qquad |V|=1-0.25^2=0.9375. $$

This matrix is positive definite because its diagonal entries are positive and its determinant is positive. Let the observed vectors be \(y_1=(2,3)^\mathsf{T}\) and \(y_2=(1,2)^\mathsf{T}\). Their residuals are \(r_1=(0,1)^\mathsf{T}\) and \(r_2=(-1,0)^\mathsf{T}\). The inverse is

$$ V^{-1} = \frac{1}{0.9375} \begin{pmatrix} 1&-0.25\\ -0.25&1 \end{pmatrix}. $$

For each pedigree, the quadratic form is \(r_j^\mathsf{T}V^{-1}r_j=1/0.9375=1.0667\). The two independent likelihood contributions multiply, so their log-likelihood contributions add:

$$ \begin{aligned} \ell_{\mathrm{total}} &= -2\log(2\pi) -\frac{1}{2}\{2\log(0.9375)\} -\frac{1}{2}(1.0667+1.0667)\\ &\approx -3.6758+0.06454-1.0667\\ &\approx -4.6779. \end{aligned} $$

The term \(-2\log(2\pi)\) occurs because there are four phenotype observations in total. The determinant contribution is positive here because each determinant is less than one, so \(-\tfrac12\log(0.9375)>0\). The two family contributions are added on the log scale; treating all four people as independent would instead use a different covariance matrix and a different likelihood.

Assumptions and a Common Pitfall

A Gaussian pedigree likelihood is appropriate only when its assumptions describe the data and sampling setup well enough for the intended analysis. In particular:

  • The phenotype vector is modeled as jointly multivariate normal with the stated mean and covariance. Marginal normality alone does not establish the required joint model.
  • The covariance matrix is symmetric, finite, and positive definite for the ordinary density written here. A singular covariance requires a different treatment and cannot be inserted into the displayed inverse-and-determinant formula.
  • The mean and covariance are correctly specified for the individuals and covariates included. Within-family dependence must be represented by the covariance rather than ignored.
  • For a product of pedigree likelihoods, distinct pedigrees are assumed independent under the model. If observations share modeled dependence across family units, the block-diagonal factorization is not justified.

A frequent mistake is to say, “There are two relatives, so multiply two univariate normal densities.” That reasoning assumes their phenotypes are independent. With covariance \(V\) having nonzero off-diagonal entries, the correct joint density includes \(V^{-1}\) and \(|V|\); it generally cannot be factored into the product of the two marginal densities. Another mistake is to interpret a larger likelihood as the probability that a model is true. A likelihood is a function of parameter values for observed data, not a probability distribution over competing models unless an additional probability framework is specified.

Key takeaway: Once a pedigree mean vector and a positive-definite covariance matrix are specified, the Gaussian likelihood is determined. The determinant term reflects covariance scale, and the covariance-weighted quadratic form reflects the observed family’s deviation from its modeled mean. For independent pedigrees, multiply their densities or, equivalently, add their log-likelihoods.

Check Your Understanding

Use the definitions and formulas above to answer the following.

  1. In a pedigree Gaussian likelihood, what information is represented by the off-diagonal entries of \(V\)?
  2. Why does the log-likelihood contain both \(\log|V|\) and a covariance-weighted quadratic form?
  3. For what reason does a nonzero covariance between relatives prevent the joint density from being treated as a product of their marginal densities?
  4. What additional independence assumption justifies adding log-likelihood contributions from separate pedigrees?
  5. Explain why a likelihood value is not the probability that the specified Gaussian model is true.
Clinical Biostats