Tutorials › Multivariate Statistics (Graduate) › Moments and Tail Behavior of Skew-T Models

Elliptical and Skew Distributions · Tutorial 699 of 975

Moments and Tail Behavior of Skew-T Models

Use a scale-mixture representation to derive skew-\(t\) moments and marginal tail asymptotics, then calculate a bivariate mean and covariance.

Intermediate 12 min read

What You'll Learn

  • Define a skew-\(t\) vector through a skew-normal scale mixture.
  • Derive the degrees-of-freedom conditions for finite means and covariances.
  • Distinguish the mixture scale matrix from the resulting covariance matrix.
  • Prove the marginal power-tail rate and identify its side-specific constants.
  • Calculate the mean and covariance of an explicit bivariate skew-\(t\) model.

Why Moments and Tails Need Separate Attention

A skew-\(t\) model combines asymmetry with a random scale. These features affect different aspects of its distribution: the skewness parameter can shift the mean and make the two marginal tails unequal, while the degrees of freedom determine whether moments exist and how slowly the tails decay. A finite location parameter alone guarantees neither a finite mean nor a finite covariance.

We use the scale-mixture construction to make these distinctions precise. In particular, we will keep track of the scale matrix in the construction separately from the covariance matrix of the resulting vector.

Scale-Mixture Definition and Moment Formulas

Let \(\nu>0\), let \(\boldsymbol{\mu}\in\mathbb{R}^p\), let \(\boldsymbol{\delta}\in\mathbb{R}^p\), and let \(\boldsymbol{\Sigma}\) be a positive-definite matrix such that \(\boldsymbol{\Sigma}-\boldsymbol{\delta}\boldsymbol{\delta}'\) is positive definite. Choose a matrix \(A\) satisfying \(AA'=\boldsymbol{\Sigma}-\boldsymbol{\delta}\boldsymbol{\delta}'\). Let \(U_0\sim N(0,1)\), \(\mathbf{U}\sim N_p(\mathbf{0},I)\), and \(W\sim\chi^2_\nu\) be mutually independent. Define

$$ \mathbf{Z}=\boldsymbol{\delta}|U_0|+A\mathbf{U},\qquad T=\sqrt{\frac{\nu}{W}},\qquad \mathbf{Y}=\boldsymbol{\mu}+T\mathbf{Z}. $$

This tutorial uses this construction as the definition of the skew-\(t\) model. The vector \(\mathbf{Z}\) is skew-normal, and the independent positive scale \(T\) supplies the heavy tails. Write \(q=\sqrt{2/\pi}\). Since \(E[|U_0|]=q\) and \(\operatorname{Var}(|U_0|)=1-q^2\),

$$ E[\mathbf{Z}]=q\boldsymbol{\delta},\qquad \operatorname{Var}(\mathbf{Z})=\boldsymbol{\Sigma}-q^2\boldsymbol{\delta}\boldsymbol{\delta}',\qquad E[\mathbf{Z}\mathbf{Z}']=\boldsymbol{\Sigma}. $$

For the last identity, add the covariance matrix to the outer product of the mean: \(\boldsymbol{\Sigma}-q^2\boldsymbol{\delta}\boldsymbol{\delta}'+q^2\boldsymbol{\delta}\boldsymbol{\delta}'=\boldsymbol{\Sigma}\). Thus \(\boldsymbol{\Sigma}\) is the raw second-moment matrix of the skew-normal component, not its covariance.

Theorem: If \(\nu>1\), the mean exists and equals \(E[\mathbf{Y}]=\boldsymbol{\mu}+c_\nu q\boldsymbol{\delta}\), where \(c_\nu=\sqrt{\nu/2}\,\Gamma((\nu-1)/2)/\Gamma(\nu/2)\). If \(\nu>2\), the covariance exists and equals \(\operatorname{Var}(\mathbf{Y})=\frac{\nu}{\nu-2}\boldsymbol{\Sigma}-c_\nu^2q^2\boldsymbol{\delta}\boldsymbol{\delta}'\). For a nondegenerate model, a finite mean requires \(\nu>1\), and a finite covariance requires \(\nu>2\).

Proof. The chi-square density is \(f_W(w)=w^{\nu/2-1}e^{-w/2}/(2^{\nu/2}\Gamma(\nu/2))\) for \(w>0\). For \(r<\nu\), direct integration gives

$$ E[T^r] =\frac{\nu^{r/2}}{2^{\nu/2}\Gamma(\nu/2)} \int_0^\infty w^{(\nu-r)/2-1}e^{-w/2}\,dw =\left(\frac{\nu}{2}\right)^{r/2} \frac{\Gamma((\nu-r)/2)}{\Gamma(\nu/2)}. $$

The integral is finite exactly when \(\nu>r\). Independence of \(T\) and \(\mathbf{Z}\) therefore gives \(E[\mathbf{Y}]=\boldsymbol{\mu}+E[T]E[\mathbf{Z}]\) when \(\nu>1\), yielding the stated mean. For \(\nu>2\), \(E[T^2]=\nu/(\nu-2)\), so

$$ \operatorname{Var}(\mathbf{Y}) =E[\mathbf{Y}\mathbf{Y}']-E[\mathbf{Y}]E[\mathbf{Y}]' =E[T^2]\boldsymbol{\Sigma} -\big(E[T]\big)^2q^2\boldsymbol{\delta}\boldsymbol{\delta}'. $$

Substitution gives the covariance formula. For necessity of the thresholds, every nondegenerate marginal \(Z_j\) has a finite, strictly positive first absolute moment and a finite, strictly positive second moment. Independence and Tonelli's theorem give \(E[|TZ_j|]=E[T]E[|Z_j|]\) and \(E[T^2Z_j^2]=E[T^2]E[Z_j^2]\), including when the right-hand sides are infinite. The scale moments diverge when \(\nu\leq1\) and \(\nu\leq2\), respectively. Hence the stated thresholds are necessary as well as sufficient. \(\square\)

Worked Example: When Do the First Two Moments Exist?

Consider a nondegenerate skew-\(t\) model with \(\nu=1.6\). Since \(1.6>1\), its mean exists. Since \(1.6\) is not greater than \(2\), its covariance does not exist: at least the marginal second moments are infinite. A sample covariance can still be calculated from a finite data set, but it is not estimating a finite population covariance in this model.

If instead \(\nu=2.4\), both moments exist. The mean uses \(E[T]\), and the covariance uses \(E[T^2]\); neither conclusion depends on whether \(\boldsymbol{\delta}\) is zero. Setting \(\boldsymbol{\delta}=\mathbf{0}\) removes skewness but does not change the degrees-of-freedom thresholds.

Worked Bivariate Moment Calculation

The formula for the covariance combines a scale inflation term with a skewness correction. The correction is an outer product, so it affects diagonal and off-diagonal entries together.

Worked Example: Mean and Covariance for a Bivariate Model

Take \(\nu=5\), \(\boldsymbol{\mu}=(0,0)'\), \(\boldsymbol{\delta}=(0.3,0.5)'\), and \(\boldsymbol{\Sigma}=\begin{pmatrix}1&0.6\\0.6&2\end{pmatrix}\). The construction is valid because

$$ \boldsymbol{\Sigma}-\boldsymbol{\delta}\boldsymbol{\delta}' =\begin{pmatrix}0.91&0.45\\0.45&1.75\end{pmatrix}, \qquad 0.91(1.75)-(0.45)^2=1.39>0. $$

The first diagonal entry is positive and the determinant is positive, so this symmetric \(2\times2\) matrix is positive definite. For \(\nu=5\),

$$ c_5=\sqrt{\frac{5}{2}}\frac{\Gamma(2)}{\Gamma(5/2)} =\sqrt{\frac{5}{2}}\frac{4}{3\sqrt{\pi}} \approx 1.1894,\qquad c_5q=\frac{2\sqrt{10}}{3\pi}\approx0.6715. $$

Therefore the mean is \(\boldsymbol{\mu}+c_5q\boldsymbol{\delta}\approx(0.2014,0.3357)'\). For the covariance, the coefficient of \(\boldsymbol{\delta}\boldsymbol{\delta}'\) is

$$ c_5^2q^2=\frac{80}{9\pi^2}\approx0.9006338, \qquad \frac{\nu}{\nu-2}=\frac{5}{3}. $$

The outer product is \(\boldsymbol{\delta}\boldsymbol{\delta}'= \begin{pmatrix}0.09&0.15\\0.15&0.25\end{pmatrix}\). Thus

$$ \operatorname{Var}(\mathbf{Y}) =\frac{5}{3}\begin{pmatrix}1&0.6\\0.6&2\end{pmatrix} -\frac{80}{9\pi^2}\begin{pmatrix}0.09&0.15\\0.15&0.25\end{pmatrix} \approx \begin{pmatrix} 1.5856&0.8649\\ 0.8649&3.1082 \end{pmatrix}. $$

For instance, the upper-left entry is \(5/3-(80/(9\pi^2))(0.09)\approx1.5856097\), which rounds to \(1.5856\). The lower-right entry is \(10/3-(80/(9\pi^2))(0.25)\approx3.1081749\), and the off-diagonal entry is \(1-(80/(9\pi^2))(0.15)\approx0.8649049\). The covariance entries are not obtained by simply multiplying \(\boldsymbol{\Sigma}\) by \(5/3\); the subtraction matters.

Marginal Tail Rates and Skewness

The random scale also gives a direct way to describe marginal tail behavior. For a fixed coordinate \(j\), write \(Z_j\) for the corresponding component of \(\mathbf{Z}\), and let \(x_+=\max(x,0)\). The scale \(T=\sqrt{\nu/W}\) has a power tail. Indeed, as \(t\to\infty\),

$$ P(T>t)=P(W<\nu/t^2) \sim k_\nu t^{-\nu}, \qquad k_\nu=\frac{\nu^{\nu/2}}{2^{\nu/2}\Gamma(\nu/2+1)}. $$

To see the constant, integrate the chi-square density near zero: \(P(W\leq y)\sim y^{\nu/2}/(2^{\nu/2}\Gamma(\nu/2+1))\) as \(y\downarrow0\), and set \(y=\nu/t^2\). The resulting marginal tail constants depend on the positive and negative moments of the skew-normal component.

Theorem: For each nondegenerate marginal \(Y_j=\mu_j+TZ_j\), as \(x\to\infty\), \(P(Y_j-\mu_j>x)\sim k_\nu E[(Z_j)_+^\nu]x^{-\nu}\) and \(P(Y_j-\mu_j<-x)\sim k_\nu E[(-Z_j)_+^\nu]x^{-\nu}\). Both constants are positive and finite. Thus \(\nu\) sets the marginal power-tail exponent, while skewness can change the constants on the two sides.

Proof. The variable \(Z_j\) is independent of \(T\), and it has finite absolute moments of every positive order because it is a linear combination of a half-normal and a normal variable. Choose \(C<\infty\) such that \(P(T>t)\leq Ct^{-\nu}\) for every \(t>0\). Such a constant exists: the tail asymptotic supplies the bound for sufficiently large \(t\), and for \(t\) in a bounded interval the probability is at most \(1\), while \(t^{-\nu}\) is bounded below by a positive number. Conditioning on \(Z_j\) gives

$$ x^\nu P(TZ_j>x) =E\!\left[1_{\{Z_j>0\}}x^\nu P\!\left(T>\frac{x}{Z_j}\,\middle|\,Z_j\right)\right]. $$

For each fixed \(z>0\), the tail asymptotic implies \(x^\nu P(T>x/z)\to k_\nu z^\nu\). Also, for every \(x>0\) and \(z>0\), \(x^\nu P(T>x/z)\leq C z^\nu\). The bound is integrable when evaluated at \(Z_j\), since \(E[(Z_j)_+^\nu]<\infty\). Dominated convergence now yields

$$ \lim_{x\to\infty}x^\nu P(TZ_j>x) =k_\nu E[(Z_j)_+^\nu]. $$

Applying the same argument to \(-Z_j\) proves the lower-tail formula. The skew-normal marginal has positive probability on both sides of zero in a nondegenerate model, so both constants are positive. \(\square\)

Worked Example: Symmetric Marginal Tail Constants

Set \(\boldsymbol{\delta}=\mathbf{0}\), and suppose the marginal scale in \(\boldsymbol{\Sigma}\) is \(1\). Then \(Z_j=G\sim N(0,1)\), so both tail constants are equal. For \(\nu=4\), \(k_4=4^2/(2^2\Gamma(3))=2\). Also,

$$ E[(G)_+^4] =\frac{1}{\sqrt{2\pi}}\int_0^\infty z^4e^{-z^2/2}\,dz =\frac{1}{2}E[G^4] =\frac{3}{2}. $$

The equality to half the fourth moment follows from symmetry, and \(E[G^4]=3\). Therefore each side has tail constant \(2(3/2)=3\): \(P(TG>x)\sim3x^{-4}\) and \(P(TG<-x)\sim3x^{-4}\). If the skewness parameter is nonzero, the degrees-of-freedom exponent remains \(4\), but the two constants instead involve \(E[(Z_j)_+^4]\) and \(E[(-Z_j)_+^4]\), which need not be equal.

Interpretation and a Common Pitfall

The marginal tail result separates two effects that are easy to conflate. Lower degrees of freedom mean a smaller power exponent and hence slower polynomial tail decay. Skewness changes the allocation of tail mass between the positive and negative sides through the two positive-part moments. It does not change the exponent in this scale-mixture model.

Common mistake: It is tempting to call \(\boldsymbol{\Sigma}\) the covariance of \(\mathbf{Y}\), or to infer that the covariance is just \(\nu/(\nu-2)\) times \(\boldsymbol{\Sigma}\). The first claim ignores the random scale and skewness; the second ignores the centering term. The actual covariance, when it exists, is \(\nu\boldsymbol{\Sigma}/(\nu-2)-c_\nu^2q^2\boldsymbol{\delta}\boldsymbol{\delta}'\). Another error is to claim a finite covariance whenever the location and scale parameters are finite: the necessary condition is \(\nu>2\).

Key takeaway: In the scale-mixture skew-\(t\) model, \(\nu>1\) is required for a mean and \(\nu>2\) for a covariance. The degrees of freedom set the marginal tail exponent; skewness affects the mean, covariance correction, and the relative sizes of the two tail constants.

Check Your Understanding

Work through these questions using the scale-mixture definition above.

  1. For which values of \(\nu\) does the mean exist but the covariance fail to exist?
  2. Why is \(\boldsymbol{\Sigma}\) not the covariance matrix of the skew-normal component \(\mathbf{Z}\)?
  3. In the bivariate example, calculate the covariance correction in the off-diagonal entry before rounding.
  4. What determines the exponent in the two marginal tail probabilities, and what determines their constants?
  5. What part of the tail-asymptotic proof justifies exchanging the limit and expectation?
Clinical Biostats