Tutorials › Exam FAM - Fundamentals of Actuarial Mathematics › Frequency Moments From Probability Generating Functions

Exam FAM · Frequency Probabilities and Approximations · Tutorial 555 of 988

Frequency Moments From Probability Generating Functions

Learn how probability generating functions turn frequency distributions into a consistent method for finding and checking claim-count moments.

Intermediate 10 min read

What You'll Learn

  • Define a probability generating function and relate its derivatives to frequency moments
  • Derive the mean, variance, and second factorial moment for binomial counts
  • Use the generating function to obtain Poisson frequency moments
  • Work with the negative binomial failure-count parameterization
  • Convert between factorial moments, raw second moments, and variance
  • Detect the common error of confusing variance with a factorial moment

Why Use a Probability Generating Function?

A claim-frequency model describes the random number of claims \(N\) in a specified period. Once a model has been selected, the mean and variance summarize its central tendency and spread. A probability generating function (PGF) provides a systematic way to obtain these quantities, as well as factorial moments, directly from the probabilities of the count.

The method is especially useful because the same derivative rules apply to binomial, Poisson, and negative binomial counts. It also helps prevent a frequent calculation error: the second derivative at 1 is not the variance. It gives the second factorial moment, which must be converted to a variance using the mean.

Definition: For a nonnegative integer-valued random variable \(N\), its probability generating function is \(G_N(z)=E[z^N]=\sum_{k=0}^{\infty}P(N=k)z^k\), for values of \(z\) where the sum converges. When the relevant derivatives exist at \(z=1\), \(G_N'(1)=E[N]\) and \(G_N''(1)=E[N(N-1)]\). The latter is the second factorial moment.

The ordinary second moment and the variance can be recovered from these derivatives. Since \(N^2=N(N-1)+N\), the second raw moment is \(E[N^2]=G_N''(1)+G_N'(1)\). Therefore,

$$ \operatorname{Var}(N)=G_N''(1)+G_N'(1)-\bigl(G_N'(1)\bigr)^2. $$

These formulas require the stated moments to exist. The binomial, Poisson, and negative binomial models considered here have finite moments of every order for their usual parameter values.

Why the Derivative Rules Work

Write \(p_k=P(N=k)\). The PGF is the power series \(G_N(z)=\sum_{k=0}^{\infty}p_k z^k\). Differentiating term by term where the series and derivatives converge gives

$$ G_N'(z)=\sum_{k=1}^{\infty}k p_k z^{k-1}, \qquad G_N''(z)=\sum_{k=2}^{\infty}k(k-1)p_k z^{k-2}. $$

At \(z=1\), each factor \(z^{k-1}\) or \(z^{k-2}\) equals 1. Thus the first derivative sums \(kP(N=k)\), which is \(E[N]\), and the second sums \(k(k-1)P(N=k)\), which is \(E[N(N-1)]\). The variance formula then follows from \(N^2=N(N-1)+N\) and \(\operatorname{Var}(N)=E[N^2]-(E[N])^2\). This is why the second derivative alone cannot be reported as either the variance or the ordinary second moment.

Binomial Claim Counts

Suppose \(N\) is the number of claims among \(n\) independent exposures, each of which produces one claim with probability \(p\). Then \(N\sim\operatorname{Bin}(n,p)\), and its PGF is

$$ G_N(z)=(1-p+pz)^n. $$

Differentiating and evaluating at 1 gives

$$ G_N'(1)=np,\qquad G_N''(1)=n(n-1)p^2. $$

Consequently, \(E[N]=np\), \(E[N(N-1)]=n(n-1)p^2\), and \(\operatorname{Var}(N)=np(1-p)\). The second factorial moment counts ordered pairs of distinct claim-producing exposures in expectation; this explains why its factor is \(n(n-1)\), not \(n\).

Worked Example: Binomial Frequency and Its Factorial Moment

A hypothetical block of 10 independent exposures has probability \(0.30\) of producing a claim for each exposure. Let \(N\) be the number of claims in the period. Find its mean, variance, second factorial moment, and second raw moment. Method: use the binomial PGF and its first two derivatives. This avoids confusing the variance with the factorial moment.

The assumptions give \(N\sim\operatorname{Bin}(10,0.30)\). In the PGF, \(n=10\), \(p=0.30\), and \(1-p=0.70\):

$$ G_N(z)=(0.70+0.30z)^{10}. $$

The first derivative at 1 is the mean:

$$ E[N]=G_N'(1)=np=10(0.30)=3. $$

The variance is

$$ \operatorname{Var}(N)=np(1-p)=10(0.30)(0.70)=2.1. $$

The second derivative at 1 gives the second factorial moment:

$$ E[N(N-1)]=G_N''(1)=n(n-1)p^2 =10(9)(0.30)^2=90(0.09)=8.1. $$

Finally, \(N^2=N(N-1)+N\), so

$$ E[N^2]=8.1+3=11.1. $$

Check. The variance calculated from the moments is \(E[N^2]-(E[N])^2=11.1-3^2=2.1\), matching the binomial variance formula. The answers are mean \(3\), variance \(2.1\), second factorial moment \(8.1\), and second raw moment \(11.1\).

Poisson Claim Counts

For a Poisson count with parameter \(\lambda>0\), the probability of \(k\) claims is \(e^{-\lambda}\lambda^k/k!\), for \(k=0,1,2,\ldots\). Its PGF follows by summing the probability series:

$$ G_N(z)=\sum_{k=0}^{\infty}e^{-\lambda}\frac{\lambda^k}{k!}z^k =e^{-\lambda}e^{\lambda z} =e^{\lambda(z-1)}. $$

Differentiating gives \(G_N'(z)=\lambda e^{\lambda(z-1)}\) and \(G_N''(z)=\lambda^2e^{\lambda(z-1)}\). Thus \(E[N]=\lambda\), \(E[N(N-1)]=\lambda^2\), and

$$ \operatorname{Var}(N)=\lambda^2+\lambda-\lambda^2=\lambda. $$

The equality of the Poisson mean and variance is a feature of this model, not a general relationship between a count's mean and variance.

Worked Example: Recovering Poisson Moments

A hypothetical service unit models its number of weekly reports as \(N\sim\operatorname{Poisson}(2.5)\). Find \(E[N]\), \(\operatorname{Var}(N)\), \(E[N(N-1)]\), and \(E[N^2]\). Method: differentiate the Poisson PGF. This keeps the factorial and raw second moments distinct.

Here \(\lambda=2.5\), so \(G_N(z)=e^{2.5(z-1)}\). Its derivatives are

$$ G_N'(z)=2.5e^{2.5(z-1)},\qquad G_N''(z)=(2.5)^2e^{2.5(z-1)}. $$

Since both exponential factors equal 1 at \(z=1\),

$$ E[N]=G_N'(1)=2.5,\qquad E[N(N-1)]=G_N''(1)=6.25. $$

The variance is \(G_N''(1)+G_N'(1)-(G_N'(1))^2\), giving

$$ \operatorname{Var}(N)=6.25+2.5-(2.5)^2=8.75-6.25=2.5. $$

The second raw moment is \(E[N^2]=6.25+2.5=8.75\). Check. \(E[N^2]-(E[N])^2=8.75-6.25=2.5\), as required. The results are mean \(2.5\), variance \(2.5\), second factorial moment \(6.25\), and second raw moment \(8.75\).

Negative Binomial Claim Counts

Use the following parameterization throughout this section. Let \(N\) count failures before the \(r\)th success in independent Bernoulli trials, with success probability \(p\) and failure probability \(q=1-p\). For a positive integer \(r\), the PGF is

$$ G_N(z)=\left(\frac{p}{1-qz}\right)^r,\qquad 0<p<1. $$

This defines a count of failures, not a count of trials including the final success. Parameterizations of the negative binomial differ, so identifying what \(N\) counts is essential before using a formula.

Differentiating the PGF yields

$$ G_N'(z)=rqp^r(1-qz)^{-r-1}, \qquad G_N''(z)=r(r+1)q^2p^r(1-qz)^{-r-2}. $$

At \(z=1\), \(1-q=p\), so

$$ E[N]=\frac{rq}{p},\qquad E[N(N-1)]=\frac{r(r+1)q^2}{p^2}. $$

Using the derivative-to-variance identity gives \(\operatorname{Var}(N)=rq/p^2\). The second raw moment is \(r(r+1)q^2/p^2+rq/p\). These results also apply for the standard extension to positive real \(r\), when that negative binomial distribution is used.

Worked Example: Negative Binomial Moments With Explicit Parameters

In a hypothetical inspection process, each item independently passes with probability \(p=0.60\). Let \(N\) be the number of failed inspections before the third pass. Find the mean, variance, second factorial moment, and second raw moment. Method: use the failures-before-\(r\)th-success PGF. This avoids treating the final pass as an additional failure or count.

Here \(r=3\), \(p=0.60\), and \(q=1-p=0.40\). The mean is

$$ E[N]=\frac{rq}{p} =\frac{3(0.40)}{0.60} =\frac{1.20}{0.60}=2. $$

The variance is

$$ \operatorname{Var}(N)=\frac{rq}{p^2} =\frac{3(0.40)}{(0.60)^2} =\frac{1.20}{0.36} =\frac{10}{3}. $$

The second factorial moment is

$$ E[N(N-1)] =\frac{r(r+1)q^2}{p^2} =\frac{3(4)(0.40)^2}{(0.60)^2} =\frac{12(0.16)}{0.36} =\frac{1.92}{0.36} =\frac{16}{3}. $$

Therefore,

$$ E[N^2]=E[N(N-1)]+E[N] =\frac{16}{3}+2=\frac{22}{3}. $$

Check. The variance from the raw moments is \(\frac{22}{3}-2^2=\frac{22}{3}-\frac{12}{3}=\frac{10}{3}\), consistent with the direct formula. The results are mean \(2\), variance \(10/3\), second factorial moment \(16/3\), and second raw moment \(22/3\).

Moment Relationships and an Exam Trap

For any count with a finite second moment, the conversions to remember are

$$ E[N^2]=E[N(N-1)]+E[N], \qquad \operatorname{Var}(N)=E[N(N-1)]+E[N]-(E[N])^2. $$

The PGF makes the first two factorial moments convenient to obtain, while many questions ask for variance or the ordinary second moment. Keep the requested quantity visible at each step and convert only after identifying the derivatives.

Common mistake. In the binomial example with \(n=10\) and \(p=0.30\), an incorrect calculation might report \(E[N(N-1)]=np(1-p)=2.1\). That expression is the variance, not the second factorial moment. The correction is

$$ E[N(N-1)]=n(n-1)p^2=10(9)(0.30)^2=8.1. $$

A check using the variance identity confirms the correction: \(8.1+3-3^2=2.1\). Substituting \(2.1\) for the factorial moment instead would not reproduce the variance.

Key takeaway: For a frequency PGF \(G_N\), the first derivative at 1 gives the mean and the second derivative at 1 gives \(E[N(N-1)]\). Convert the factorial moment using \(E[N^2]=E[N(N-1)]+E[N]\) before calculating or reporting the variance.

Check Your Understanding

For each problem, use the stated frequency model and parameterization. Answers are supplied so you can check both the moment requested and the conversion used.

  1. A hypothetical portfolio has \(N\sim\operatorname{Bin}(8,0.25)\). Find \(E[N]\), \(\operatorname{Var}(N)\), \(E[N(N-1)]\), and \(E[N^2]\). (Answer: mean \(2\), variance \(1.5\), second factorial moment \(3.5\), second raw moment \(5.5\).)
  2. A count of weekly service calls follows \(\operatorname{Poisson}(2.4)\). Find the mean, variance, and second factorial moment. (Answer: mean \(2.4\), variance \(2.4\), second factorial moment \(5.76\).)
  3. Let \(N\) be the number of failures before the second success in independent trials with success probability \(p=0.50\). Find \(E[N]\), \(\operatorname{Var}(N)\), and \(E[N(N-1)]\). (Answer: mean \(2\), variance \(4\), second factorial moment \(6\).)
  4. A hypothetical group has 20 independent exposure units, each with claim probability \(0.10\). Find the second factorial moment and verify it using the mean and variance. (Answer: \(E[N(N-1)]=3.8\); verification: \(1.8+2^2-2=3.8\).)
  5. A negative binomial count records failures before the fifth success, with success probability \(p=0.80\). Find the mean, variance, and second factorial moment. (Answer: mean \(1.25\), variance \(1.5625\), second factorial moment \(1.875\).)
Clinical Biostats