Tutorials › Statistical Theory I - Probability and Distribution Theory › Recurrence for Standard Normal Moments

Normal and Tail Families · Tutorial 175 of 994

Recurrence for Standard Normal Moments

Learn how symmetry and integration by parts reduce standard normal moment calculations to a simple recurrence.

Intermediate 8 min read

What You'll Learn

  • Define raw moments of a standard normal random variable and verify they are finite.
  • Derive the recurrence for moments of order two and higher by integration by parts.
  • Use symmetry to show that all odd signed moments vanish.
  • Calculate the even moments through order eight.
  • Apply the moments to evaluate polynomial expectations and identify a common mistake about odd moments.

Why Standard Normal Moments Have a Simple Pattern

The standard normal distribution appears throughout statistical theory, so calculations involving its moments recur in many settings. Rather than integrating separately for every power, we can use a single recurrence to obtain each higher even moment from the moment two orders below it. Symmetry supplies the odd moments, and together these facts give all moments through any fixed integer order.

Let \(Z\sim N(0,1)\). Its density is \(\phi(x)=(2\pi)^{-1/2}\exp(-x^2/2)\), for \(x\in\mathbb{R}\). The density is symmetric about zero, and its derivative satisfies \(\phi'(x)=-x\phi(x)\). These two properties drive the calculations below.

Definition: For a nonnegative integer \(r\), the \(r\)th raw moment of \(Z\) is \(m_r=E[Z^r]=\int_{-\infty}^{\infty}x^r\phi(x)\,dx\), provided the expectation exists. In particular, \(m_0=1\), since the density integrates to one.

All the moments in this definition exist as finite expectations. Indeed, for each fixed nonnegative integer \(r\), the absolute-moment integral is proportional to \(\int_{-\infty}^{\infty}|x|^r e^{-x^2/2}\,dx\), which is finite: for sufficiently large \(|x|\), the polynomial factor is bounded by a constant times \(e^{x^2/4}\), leaving an integrable tail bounded by a constant times \(e^{-x^2/4}\). Thus the signed integrals used below converge absolutely. Also, for every fixed nonnegative integer \(q\), \(|x|^q\phi(x)\to0\) as \(|x|\to\infty\), because \(q\log|x|-x^2/2\to-\infty\). This will make the boundary term in integration by parts vanish.

Odd Moments Vanish by Symmetry

The density has the same value at \(x\) and \(-x\). When \(r\) is odd, the factor \(x^r\) changes sign under reflection, so contributions from opposite sides of zero cancel. Absolute integrability, established above, justifies the change of variable over the whole real line.

Result: If \(r\) is a positive odd integer, then \(E[Z^r]=0\).

To see this explicitly, substitute \(y=-x\) in the moment integral. Since \(\phi(-y)=\phi(y)\) and \((-y)^r=-y^r\) for odd \(r\),

$$ m_r=\int_{-\infty}^{\infty}x^r\phi(x)\,dx =\int_{-\infty}^{\infty}(-y)^r\phi(-y)\,dy =-\int_{-\infty}^{\infty}y^r\phi(y)\,dy =-m_r. $$

The moment is finite, so \(m_r=-m_r\) implies \(m_r=0\). In particular, \(E[Z]=0\), and every higher odd signed moment is zero as well.

Deriving the Moment Recurrence

For even moments, integration by parts reduces the order by two. The derivative identity \(\phi'(x)=-x\phi(x)\) lets us replace one factor of \(x\) in the integrand with a derivative of the density.

Theorem: For every integer \(r\geq2\), the standard normal moments satisfy \(m_r=(r-1)m_{r-2}\).

Proof. Fix an integer \(r\geq2\). Apply integration by parts on the finite interval \([-A,A]\), using \(u=x^{r-1}\) and \(dv=x\phi(x)\,dx=-\phi'(x)\,dx\). Then \(du=(r-1)x^{r-2}\,dx\) and \(v=-\phi(x)\), giving

$$ \int_{-A}^{A}x^r\phi(x)\,dx = \left[-x^{r-1}\phi(x)\right]_{-A}^{A} +(r-1)\int_{-A}^{A}x^{r-2}\phi(x)\,dx. $$

As \(A\to\infty\), the boundary term tends to zero: both \(A^{r-1}\phi(A)\) and \((-A)^{r-1}\phi(-A)\) tend to zero by the Gaussian exponential decay noted above. Both integrals converge to their corresponding whole-line integrals, since their integrands are absolutely integrable. Taking the limit therefore yields

$$ m_r=(r-1)m_{r-2}. $$

This proves the recurrence for every integer \(r\geq2\). \(\square\)

The recurrence applies to odd orders too, but it does not replace the symmetry argument: starting from \(m_1=0\), it gives \(m_3=2m_1=0\), \(m_5=4m_3=0\), and so on. For even orders, it starts from \(m_0=1\) and gives nonzero values.

Worked Example: Calculating the Eighth Moment

Let \(Z\sim N(0,1)\). Find \(E[Z^8]\) by repeatedly applying the recurrence, and show each step.

Start with the recurrence at order eight: \(m_8=(8-1)m_6=7m_6\). At order six, \(m_6=(6-1)m_4=5m_4\). At order four, \(m_4=(4-1)m_2=3m_2\). Finally, \(m_2=(2-1)m_0=1\), because \(m_0=1\). Combining the equalities,

$$ E[Z^8]=m_8=7\cdot5\cdot3\cdot1\cdot m_0 =7\cdot5\cdot3\cdot1 =105. $$

The factors are the odd integers from one through seven. Each recurrence step lowers the order by two until it reaches the known zeroth moment.

Even Moments Through Order Eight

Applying the recurrence from \(m_0=1\) gives the following values. The odd-order entries follow from symmetry, not from treating the recurrence as a formula that begins at \(m_0\).

Order \(r\)CalculationMoment \(m_r=E[Z^r]\)
0Density integrates to one1
1Symmetry0
2\(1m_0\)1
3Symmetry0
4\(3m_2=3\cdot1\)3
5Symmetry0
6\(5m_4=5\cdot3\)15
7Symmetry0
8\(7m_6=7\cdot15\)105

In compact form, the even moments through order eight are \(E[Z^2]=1\), \(E[Z^4]=3\), \(E[Z^6]=15\), and \(E[Z^8]=105\). Each is the product of the positive odd integers below its order. The recurrence also provides a direct check: multiplying each even moment by the next odd factor gives the next even moment.

Worked Example: A Polynomial Expectation

For \(Z\sim N(0,1)\), calculate \(E[(Z^2+Z)^2]\). First expand the square:

$$ (Z^2+Z)^2=Z^4+2Z^3+Z^2. $$

By linearity of expectation, the odd moment \(E[Z^3]\) is zero by symmetry, while \(E[Z^4]=3\) and \(E[Z^2]=1\). Therefore,

$$ E[(Z^2+Z)^2] =E[Z^4]+2E[Z^3]+E[Z^2] =3+2(0)+1 =4. $$

The calculation uses signed moments of the powers appearing in the expansion. In particular, the cubic term contributes zero because its expectation is a signed odd moment.

Worked Example: The Variance of the Squared Standard Normal

Let \(W=Z^2\), where \(Z\sim N(0,1)\). Find \(\operatorname{Var}(W)\) using the standard normal moments.

By definition, \(\operatorname{Var}(W)=E[W^2]-(E[W])^2\). Since \(W=Z^2\), we have \(E[W]=E[Z^2]=1\) and \(E[W^2]=E[Z^4]=3\). Thus,

$$ \operatorname{Var}(Z^2)=E[Z^4]-(E[Z^2])^2 =3-1^2 =2. $$

Equivalently, expanding the centered square gives the same answer: \(E[(Z^2-1)^2]=E[Z^4]-2E[Z^2]+1=3-2+1=2\). This check uses the fourth and second moments and confirms that variance is not the fourth raw moment itself.

Common Mistake: Confusing Signed and Absolute Moments

A frequent error is to conclude that an odd power contributes nothing in every calculation because its expectation is zero. That conclusion holds for the signed moment \(E[Z^r]\) when \(r\) is odd; it does not hold for \(E[|Z|^r]\), where the absolute value removes the sign cancellation.

For instance, \(E[Z^3]=0\), but \(E[|Z|^3]>0\). The integrand \(|x|^3\phi(x)\) is nonnegative and is positive except at \(x=0\), so its integral cannot vanish. The correction is to inspect the quantity actually being averaged: symmetry cancels positive and negative contributions only when the integrand retains the odd sign.

Another tempting shortcut is to use \(m_r=(r-1)m_{r-2}\) for \(r=1\). The integration-by-parts derivation requires \(r\geq2\); moreover, the recurrence at \(r=1\) would refer to \(m_{-1}\), which is outside the defined sequence. Obtain \(m_1=0\) directly from symmetry, and use the recurrence only at integer orders \(r\geq2\).

Why the Recurrence Is Useful

The recurrence replaces a sequence of separate integrals with a short calculation, and symmetry eliminates every odd signed moment without integration. Together they provide a reliable way to evaluate polynomial expectations under the standard normal distribution, check variance calculations, and recognize the fourth moment \(3\) that appears in standardized moment summaries. The key is to track the moment order carefully and distinguish signed powers from absolute powers.

Key takeaway: For \(Z\sim N(0,1)\), \(E[Z^r]=0\) for every positive odd integer \(r\), while \(E[Z^r]=(r-1)E[Z^{r-2}]\) for integers \(r\geq2\). In particular, the even moments of orders two, four, six, and eight are \(1,3,15,\) and \(105\).

Check Your Understanding

Use symmetry and the recurrence to answer each question.

  1. Starting from \(m_0=1\), calculate \(E[Z^6]\) one recurrence step at a time.
  2. Why does the integration-by-parts argument require the boundary term to vanish, and what Gaussian property ensures this?
  3. For \(Z\sim N(0,1)\), evaluate \(E[Z^5]\). State which fact justifies your answer.
  4. Explain why \(E[Z^3]=0\) does not imply \(E[|Z|^3]=0\).
  5. Use \(E[Z^2]=1\) and \(E[Z^4]=3\) to calculate \(E[(Z^2-1)^2]\).