Tutorials › Multivariate Statistics (Graduate) › Moments of the Multivariate Skew-Normal

Elliptical and Skew Distributions · Tutorial 695 of 975

Moments of the Multivariate Skew-Normal

Use the latent-normal construction to calculate skew-normal moments and see precisely how latent shape controls marginal asymmetry.

Intermediate 12 min read

What You'll Learn

  • State the latent-normal construction and its nondegeneracy condition
  • Derive the mean and covariance after conditioning on a positive latent normal variable
  • Calculate transformed means and covariances under a diagonal scale matrix
  • Derive the marginal standardized-skewness formula from half-normal moments
  • Interpret the direction and magnitude of marginal skewness from the shape parameter
  • Avoid confusing the latent covariance with the conditional covariance

Why the Latent Representation Is Useful

The skew-normal distribution introduces asymmetry through a selection step: a component of a jointly normal vector is required to be positive. That construction is more than a way to define the model. It makes its first two moments accessible by separating the selected latent variable from a normal residual. The resulting formulas also show why a parameter called “shape” affects both the mean and covariance, as well as the marginal skewness.

We derive these quantities directly, starting from the latent-normal representation used for Azzalini’s multivariate skew-normal distribution. Throughout, the shape vector describes association with the selected latent variable; it is not itself the vector of marginal skewnesses.

Definition: Let \(T\) be standard normal and let \(Z\) be a \(p\)-dimensional normal vector such that \[ \begin{pmatrix}T\\Z\end{pmatrix} \sim N_{p+1}\left( \begin{pmatrix}0\\0\end{pmatrix}, \begin{pmatrix}1&\delta^\top\\\delta&\Omega\end{pmatrix} \right). \] Here \(\Omega\) is positive definite and the block covariance matrix is positive definite; equivalently, \(\Omega-\delta\delta^\top\) is positive definite. For a location vector \(\xi\) and a diagonal matrix \(\Delta\) with positive diagonal entries, the multivariate skew-normal vector is \(X=\xi+\Delta Z\mid T>0\).

The conditioning notation means that we consider the conditional distribution of \(\xi+\Delta Z\) given the event \(T>0\). The block covariance condition ensures a nondegenerate joint normal distribution. In particular, it permits the decomposition \(Z=\delta T+\varepsilon\), where \(\varepsilon\) is normal, independent of \(T\), with covariance \(\Omega-\delta\delta^\top\).

Moments from the Selected Normal Variable

Conditioning a standard normal variable to be positive gives a half-normal variable. Write \(c=\sqrt{2/\pi}\). The moments needed below follow directly by symmetry and integration:

$$ E[T\mid T>0]=c,\qquad E[T^2\mid T>0]=1,\qquad E[T^3\mid T>0]=2c. $$

For example, \(E[T\mid T>0]=E[|T|]=\sqrt{2/\pi}\). The second moment is unchanged because \(T^2\) is even and the positive and negative half-lines contribute equally. For the third moment, \(E[T^3\mid T>0]=2\int_0^\infty t^3\phi(t)\,dt=2c\), where \(\phi\) is the standard normal density.

Theorem: Under the latent-normal construction, the conditional mean and covariance of \(X\) are \[ E[X\mid T>0]=\xi+c\Delta\delta,\qquad \operatorname{Cov}(X\mid T>0)=\Delta\bigl(\Omega-c^2\delta\delta^\top\bigr)\Delta. \] Since the model defines \(X\) under \(T>0\), these are its mean and covariance.

Proof. Joint normality gives \(Z=\delta T+\varepsilon\), where \(\varepsilon\) is independent of \(T\), has mean zero, and has covariance \(\Omega-\delta\delta^\top\). Independence is preserved when conditioning on \(T>0\): the event depends on \(T\), not on \(\varepsilon\). Thus

$$ E[Z\mid T>0]=\delta E[T\mid T>0]+E[\varepsilon] =c\delta. $$

For the covariance, the two terms \(\delta T\) and \(\varepsilon\) have zero conditional cross-covariance, by independence and \(E[\varepsilon]=0\). Therefore

$$ \begin{aligned} \operatorname{Cov}(Z\mid T>0) &=\delta\delta^\top\operatorname{Var}(T\mid T>0) +\operatorname{Cov}(\varepsilon)\\ &=(1-c^2)\delta\delta^\top+\Omega-\delta\delta^\top\\ &=\Omega-c^2\delta\delta^\top. \end{aligned} $$

The first equality uses \(\operatorname{Var}(T\mid T>0)=1-c^2\), from the first two half-normal moments. Applying the affine transformation \(X=\xi+\Delta Z\) gives the stated formulas. \(\square\)

Worked Examples: Applying the Mean and Covariance Formulas

Worked Example: A One-Dimensional Skew-Normal

Let \(\xi=0\), \(\Delta=1\), \(\Omega=1\), and \(\delta=1/\sqrt{2}\). The block covariance is positive definite because \(1-\delta^2=1/2>0\). Find the mean, variance, and standardized skewness.

The mean formula gives \(E[X]=c\delta=\sqrt{2/\pi}/\sqrt{2}=1/\sqrt{\pi}\). The variance is \(\operatorname{Var}(X)=1-c^2\delta^2=1-(2/\pi)(1/2)=1-1/\pi\).

For the standardized skewness, use the formula derived below: \[ \gamma_1=\frac{4-\pi}{2} \left(\frac{c\delta}{\sqrt{1-c^2\delta^2}}\right)^3 =\frac{4-\pi}{2(\pi-1)^{3/2}}. \] Indeed, \(c\delta=1/\sqrt{\pi}\), so the ratio inside the cube is \((1/\sqrt{\pi})/\sqrt{1-1/\pi}=1/\sqrt{\pi-1}\). The skewness is positive, consistent with a positive association between \(Z\) and the selected variable \(T\).

Worked Example: A Scaled Bivariate Model

Take \(\Omega=I_2\), \(\delta=(1/\sqrt{6},\sqrt{2/3})^\top\), \(\xi=0\), and \(\Delta=\operatorname{diag}(2,1)\). The block covariance is positive definite because \(\delta^\top\delta=1/6+2/3=5/6<1\). Calculate the mean and covariance of \(X\).

The mean is \(c\Delta\delta\). Its coordinates are \(2\sqrt{2/\pi}/\sqrt{6}=2/\sqrt{3\pi}\) and \(\sqrt{2/\pi}\sqrt{2/3}=2/\sqrt{3\pi}\). Hence \(E[X]=(2/\sqrt{3\pi},2/\sqrt{3\pi})^\top\).

Before scaling by \(\Delta\), the covariance is \(I_2-(2/\pi)\delta\delta^\top\). The entries of \(\delta\delta^\top\) are \(1/6\), \(1/3\), and \(2/3\), so

$$ \operatorname{Cov}(Z\mid T>0)= \begin{pmatrix} 1-\frac{1}{3\pi}&-\frac{2}{3\pi}\\[2pt] -\frac{2}{3\pi}&1-\frac{4}{3\pi} \end{pmatrix}. $$

Now multiply on the left and right by \(\operatorname{diag}(2,1)\). This multiplies the first diagonal entry by \(4\), the second by \(1\), and each off-diagonal entry by \(2\). Thus

$$ \operatorname{Cov}(X)= \begin{pmatrix} 4\left(1-\frac{1}{3\pi}\right)&-\frac{4}{3\pi}\\[2pt] -\frac{4}{3\pi}&1-\frac{4}{3\pi} \end{pmatrix}. $$

Marginal Standardized Skewness

Assume first that \(\Omega_{ii}=1\), as in the common correlation-matrix parameterization. The \(i\)th component has variance \(\Delta_{ii}^2(1-c^2\delta_i^2)\). Its standardized skewness is its third central moment divided by the variance to the power \(3/2\). To derive that third moment, the half-normal variable’s third central moment is

$$ E[(T-c)^3\mid T>0] =2c-3c(1)+2c^3 =c(2c^2-1) =\frac{4-\pi}{\pi}\,c. $$

Write \(Z_i=\delta_iT+\varepsilon_i\), with \(\varepsilon_i\) independent of \(T\), centered normal, and with variance \(1-\delta_i^2\). After centering \(Z_i\), expand the cube of \(\delta_i(T-c)+\varepsilon_i\). The term involving \((T-c)^3\) has expectation \(\delta_i^3 E[(T-c)^3\mid T>0]\). The mixed term with \((T-c)\varepsilon_i^2\) has expectation zero because \(E[T-c\mid T>0]=0\); the other mixed term and \(E[\varepsilon_i^3]\) are also zero. Therefore the third central moment of \(Z_i\) is \(\delta_i^3 c(4-\pi)/\pi\).

Result: If \(\Omega_{ii}=1\), the standardized skewness of \(X_i\) is \[ \gamma_{1,i} =\frac{4-\pi}{2} \left(\frac{c\delta_i}{\sqrt{1-c^2\delta_i^2}}\right)^3, \qquad c=\sqrt{\frac{2}{\pi}}. \] A positive diagonal scale \(\Delta_{ii}\) and a location shift \(\xi_i\) do not change standardized skewness.

To see the formula, divide the third central moment of \(Z_i\) by \((1-c^2\delta_i^2)^{3/2}\). The identity \(c(4-\pi)/\pi=c^3(4-\pi)/2\) then gives the displayed expression. The scale \(\Delta_{ii}\) multiplies the third central moment by \(\Delta_{ii}^3\) and the variance to the \(3/2\) power by the same factor, so it cancels.

For a general positive \(\Omega_{ii}\), replace \(\delta_i\) in the formula by \(\delta_i/\sqrt{\Omega_{ii}}\). This follows by applying the unit-variance result to \(Z_i/\sqrt{\Omega_{ii}}\). The block covariance condition ensures \(c^2\delta_i^2<\Omega_{ii}\), so the marginal variance is positive and the denominator is defined.

Worked Example: Checking a Marginal Skewness Calculation

Suppose \(\Omega_{22}=1\) and \(\delta_2=1/(2\sqrt{2})\). Find the second marginal’s standardized skewness and verify its approximate value.

First, \(c\delta_2=\sqrt{2/\pi}/(2\sqrt{2})=1/(2\sqrt{\pi})\), and \(c^2\delta_2^2=1/(4\pi)\). Consequently,

$$ \frac{c\delta_2}{\sqrt{1-c^2\delta_2^2}} = \frac{1/(2\sqrt{\pi})}{\sqrt{(4\pi-1)/(4\pi)}} =\frac{1}{\sqrt{4\pi-1}}. $$

Substituting into the skewness formula gives \[ \gamma_{1,2}=\frac{4-\pi}{2(4\pi-1)^{3/2}}. \] Using \(\pi\approx3.14159265\), the value is approximately \(0.01091\), which is positive. The small value is consistent with the modest latent shape in this marginal.

How Shape Changes Marginal Asymmetry

For unit marginal variance in \(\Omega\), the formula depends on \(\delta_i\) through the signed quantity \(c\delta_i/\sqrt{1-c^2\delta_i^2}\). Its denominator is positive, and the outer factor \((4-\pi)/2\) is positive. Thus the sign of marginal skewness is the sign of \(\delta_i\); when \(\delta_i=0\), the marginal is normal and its skewness is zero. As \(|\delta_i|\) approaches its admissible limit of \(1\), the variance \(1-c^2\delta_i^2\) remains positive, but the magnitude of the skewness increases.

This relationship is useful when interpreting a fitted shape vector: its component signs indicate the directions of marginal asymmetry, while its magnitudes affect both the conditional mean and variance. The covariance also contains off-diagonal terms \(-c^2\delta_i\delta_j\) before scaling. Consequently, selection can alter dependence as well as marginal locations and spreads.

Common Mistakes

  • Using the unconditioned covariance as the model covariance. The unconditioned \(Z\) has covariance \(\Omega\), but conditioning on \(T>0\) changes it to \(\Omega-c^2\delta\delta^\top\). The correction follows from subtracting the square of the shifted conditional mean.
  • Forgetting both scale factors on an off-diagonal covariance. Under \(X=\xi+\Delta Z\), entry \(i,j\) is multiplied by \(\Delta_{ii}\Delta_{jj}\), not just one of the two factors. In the bivariate example, the off-diagonal \(-2/(3\pi)\) becomes \(-4/(3\pi)\).
  • Calling \(\delta_i\) the marginal skewness. It is a latent association parameter. Standardized skewness is a nonlinear function of it, as shown above.
  • Dropping a square root or a factor when evaluating the skewness formula. For example, in the last worked example the ratio simplifies to \(1/\sqrt{4\pi-1}\); cubing it gives the power \(3/2\) in the denominator. The resulting value is approximately \(0.01091\), not \(0.01118\).
Key takeaway: The latent representation reduces moment calculations to half-normal moments. Conditioning shifts the mean by \(c\Delta\delta\) and changes the covariance by subtracting \(c^2\Delta\delta\delta^\top\Delta\); marginal skewness then follows from the third central moment of the half-normal variable.

Check Your Understanding

Use the latent-normal formulas and show the key steps in each calculation.

  1. For \(\Omega=I_2\), state the condition on \(\delta\) that makes the joint block covariance positive definite.
  2. If \(\delta_i=0\) and \(\Omega_{ii}=1\), what are the marginal mean shift and standardized skewness of \(X_i\)?
  3. Explain why the covariance correction has the form \(-c^2\Delta\delta\delta^\top\Delta\).
  4. For a positive diagonal scaling matrix, explain why marginal standardized skewness is unchanged by scaling.
  5. If \(\Omega_{ii}=1\), what determines the sign of the \(i\)th marginal’s standardized skewness?
Clinical Biostats