Tutorials › Statistical Theory I - Probability and Distribution Theory › Compound Binomial and Geometric Sums

Mixtures, Compounding, and Truncation · Tutorial 658 of 994

Compound Binomial and Geometric Sums

Learn how binomial and geometric event counts shape the distribution, transform, mean, and variance of a sum of independent severities.

Advanced 9 min read

What You'll Learn

  • Define compound binomial and geometric sums, including the geometric-count convention used here
  • Derive their probability-generating functions for nonnegative integer severities
  • Derive their characteristic functions for general real-valued severities
  • Calculate means and variances using the count and severity moments
  • Apply the formulas to discrete and exponential severity models
  • Distinguish a geometric count of failures from a count that includes the terminating trial

Two Random Counts, Two Compound Laws

A compound sum adds a random number of independent severities. The count describes how many events occur; each severity describes the amount contributed by one event. This construction appears, for example, when a fixed number of opportunities can each produce a claim, or when events continue until a terminating success. The distribution of the total depends on both the count law and the severity law.

The earlier material on random sums gives the general conditioning framework. Here we specialize it to binomial and geometric counts, deriving the corresponding transforms and moments. We use independent, identically distributed severities \(X_1,X_2,\ldots\), independent of the count \(N\), and define \(S=0\) when \(N=0\).

Definition: A compound binomial sum has the form \(S=\sum_{i=1}^{N}X_i\), where \(N\sim\operatorname{Bin}(m,p)\) for a fixed positive integer \(m\) and \(0\le p\le1\). A compound geometric sum has the same form, with \(P(N=k)=r(1-r)^k\) for \(k=0,1,2,\ldots\) and \(0<r\le1\). In both definitions, the \(X_i\) are iid and independent of \(N\). For the geometric law, \(N\) counts failures before the first success; write \(q=1-r\) for the continuation probability.

The zero-based geometric convention is useful when each counted event occurs before an independent terminating event. Another common convention counts trials through and including the first success, giving support \(1,2,\ldots\). These are different counts: if \(N_0\) counts failures, the trials-including-success count is \(N_0+1\). In a compound sum, that extra trial would add an extra severity, so the convention must be stated.

For a general severity \(X\), let \(\phi_X(t)=E[e^{itX}]\) denote its characteristic function. When \(X\) is nonnegative and integer-valued, let \(G_X(z)=E[z^X]\), for \(|z|\le1\), denote its probability-generating function. The probability-generating-function formulas below require this integer-valued condition; the characteristic-function formulas do not.

Transform Formulas

Condition on the count. Given \(N=k\), the total is a sum of \(k\) independent severities, so its characteristic function is \(\phi_X(t)^k\). Averaging this quantity over the count distribution produces the compound characteristic function.

Theorem: For a compound binomial sum, \(\phi_S(t)=[1-p+p\phi_X(t)]^m\). If the severities are nonnegative integer-valued, then \(G_S(z)=[1-p+pG_X(z)]^m\). For a compound geometric sum under the zero-based convention, \(\phi_S(t)=r/[1-q\phi_X(t)]\), where \(q=1-r\). If the severities are nonnegative integer-valued, then \(G_S(z)=r/[1-qG_X(z)]\).

To derive the binomial formula, first condition on \(N\):

$$ \phi_S(t)=\sum_{k=0}^{m}P(N=k)\phi_X(t)^k =\sum_{k=0}^{m}\binom{m}{k}p^k(1-p)^{m-k}\phi_X(t)^k =[1-p+p\phi_X(t)]^m. $$

The last equality is the binomial theorem. Replacing \(\phi_X(t)\) by \(G_X(z)\) gives the probability-generating-function formula: given \(N=k\), independence gives \(E[z^S\mid N=k]=G_X(z)^k\), and the same finite sum applies.

For the geometric count, the corresponding sum is an infinite series. It converges for every real \(t\), since \(|q\phi_X(t)|\le q<1\). For the probability-generating function and \(|z|\le1\), \(|qG_X(z)|\le q<1\) as well. Thus the geometric series formula applies in each case:

$$ \phi_S(t)=\sum_{k=0}^{\infty}r q^k\phi_X(t)^k =r\sum_{k=0}^{\infty}[q\phi_X(t)]^k =\frac{r}{1-q\phi_X(t)}. $$

The same calculation with \(G_X(z)\) in place of \(\phi_X(t)\) proves the geometric probability-generating-function formula. The denominator is nonzero because the magnitude of the subtracted term is at most \(q<1\).

Worked Example: A Binomial Count With Bernoulli Severities

Suppose \(N\sim\operatorname{Bin}(4,0.3)\), and each severity is Bernoulli with success probability \(0.5\): \(P(X_i=1)=0.5\) and \(P(X_i=0)=0.5\). Find the distribution, mean, and variance of \(S\).

The severity generating function is \(G_X(z)=0.5+0.5z\). Therefore \(G_S(z)=[0.7+0.3(0.5+0.5z)]^4=(0.85+0.15z)^4\). This is the generating function of a \(\operatorname{Bin}(4,0.15)\) variable. The success probability is \(0.15\) because one opportunity contributes 1 only if the count includes that opportunity and its severity is 1, an event of probability \(0.3(0.5)\).

Expanding gives the probabilities: \(P(S=0)=0.85^4=0.52200625\); \(P(S=1)=4(0.15)(0.85)^3=0.368475\); \(P(S=2)=6(0.15)^2(0.85)^2=0.0975375\); \(P(S=3)=4(0.15)^3(0.85)=0.011475\); and \(P(S=4)=(0.15)^4=0.00050625\). They sum to 1.

Here \(E[X_i]=0.5\) and \(\operatorname{Var}(X_i)=0.25\). The compound-binomial moment formulas derived below give \(E[S]=4(0.3)(0.5)=0.6\), and \(\operatorname{Var}(S)=4[0.3(0.25)+0.3(0.7)(0.5)^2]=4(0.075+0.0525)=0.51\). These agree with the mean and variance of \(\operatorname{Bin}(4,0.15)\).

Worked Example: A Binomial Count With Two-Point Severities

Let \(N\sim\operatorname{Bin}(3,0.4)\), and let each severity equal 1 or 2 with probability \(0.5\) each. Find the generating function and the first two moments of the total.

The severity generating function is \(G_X(z)=(z+z^2)/2\). Substitution gives \(G_S(z)=[0.6+0.2z+0.2z^2]^3\). This expression encodes the full distribution; for example, its constant coefficient is \(0.6^3=0.216\), the probability that no counted event occurs.

The severity mean is \(\mu=E[X_i]=(1+2)/2=1.5\), and its variance is \(\sigma^2=[(1-1.5)^2+(2-1.5)^2]/2=0.25\). Thus \(E[S]=3(0.4)(1.5)=1.8\), while \(\operatorname{Var}(S)=3[0.4(0.25)+0.4(0.6)(1.5)^2] =3(0.1+0.54)=1.92\).

Means and Variances

Suppose \(E[X_i]=\mu\) and \(\operatorname{Var}(X_i)=\sigma^2<\infty\). Given \(N\), the conditional mean of the sum is \(N\mu\), and its conditional variance is \(N\sigma^2\). The law of total expectation and law of total variance therefore give \(E[S]=E[N]\mu\) and \(\operatorname{Var}(S)=E[N]\sigma^2+\operatorname{Var}(N)\mu^2\). For these uses, independence of \(N\) and the iid severities is essential.

The binomial count has \(E[N]=mp\) and \(\operatorname{Var}(N)=mp(1-p)\). For the zero-based geometric count, \(E[N]=q/r\) and \(\operatorname{Var}(N)=q/r^2\). Substituting yields:

Moment formulas: If the severity has finite mean \(\mu\) and finite variance \(\sigma^2\), then the compound binomial sum satisfies \(E[S]=mp\mu\) and \(\operatorname{Var}(S)=mp\sigma^2+mp(1-p)\mu^2\). The zero-based compound geometric sum satisfies \(E[S]=(q/r)\mu\) and \(\operatorname{Var}(S)=(q/r)\sigma^2+(q/r^2)\mu^2\), where \(q=1-r\).

For completeness, the geometric count moments follow directly from the probability-generating function \(G_N(z)=r/(1-qz)\). Differentiation gives \(G_N'(z)=rq/(1-qz)^2\) and \(G_N''(z)=2rq^2/(1-qz)^3\). Hence \(E[N]=G_N'(1)=q/r\) and \(E[N(N-1)]=G_N''(1)=2q^2/r^2\). Since \(N^2=N(N-1)+N\),

$$ \operatorname{Var}(N)=E[N^2]-(E[N])^2 =\frac{2q^2}{r^2}+\frac{q}{r}-\left(\frac{q}{r}\right)^2 =\frac{q}{r^2}. $$

To verify the random-sum variance formula, condition on \(N\). The law of total variance states \(\operatorname{Var}(S)=E[\operatorname{Var}(S\mid N)]+\operatorname{Var}(E[S\mid N])\). Conditional independence of the severities gives \(\operatorname{Var}(S\mid N)=N\sigma^2\), while \(E[S\mid N]=N\mu\). Therefore

$$ \operatorname{Var}(S)=E[N\sigma^2]+\operatorname{Var}(N\mu) =E[N]\sigma^2+\operatorname{Var}(N)\mu^2. $$

The expectation formula follows in the same way from \(E[S]=E[E[S\mid N]]=E[N\mu]=E[N]\mu\). Substituting the respective count moments proves both sets of compound moment formulas.

Worked Example: Geometric Count With Exponential Severities

Let \(N\) count failures before the first success, with success probability \(r=0.6\), so \(q=0.4\). Let the independent severities have an exponential distribution with rate \(\lambda=2\). Find the characteristic function, mean, and variance of \(S\).

An exponential severity with rate 2 has characteristic function \(\phi_X(t)=2/(2-it)\), mean \(\mu=1/2\), and variance \(\sigma^2=1/4\). The compound geometric characteristic function is

$$ \phi_S(t)=\frac{0.6}{1-0.4\{2/(2-it)\}} =\frac{0.6(2-it)}{1.2-it}. $$

The mean is \((q/r)\mu=(0.4/0.6)(1/2)=1/3\). The variance is \((q/r)\sigma^2+(q/r^2)\mu^2 =(0.4/0.6)(1/4)+(0.4/0.6^2)(1/4) =1/6+5/18=4/9\).

As a check on the transform, \(\phi_S(0)=0.6(2)/1.2=1\), as every characteristic function must. Its numerator includes the contribution of the possibility \(N=0\); omitting that contribution would give an incorrect transform.

Interpretation and Common Pitfalls

The two count models represent different event mechanisms. A binomial count is bounded by \(m\): there are \(m\) opportunities, each included with probability \(p\). Its transform is a finite power. A geometric count has no fixed upper bound: continuation occurs with probability \(q\) at each step until termination. Its transform is a convergent geometric series. In both cases, the count's variability contributes to the variance of the total through the term \(\operatorname{Var}(N)\mu^2\).

  • Using the wrong geometric convention. A count of failures before success has mean \(q/r\), not \(1/r\); the latter is the mean number of trials through success. Decide what is being counted before applying a formula.
  • Dropping count variability from the variance. The expression \(E[N]\sigma^2\) accounts only for severity variation at a fixed count. The additional \(\operatorname{Var}(N)\mu^2\) term accounts for variation in the number of summands.
  • Using a probability-generating function for noninteger severities. The generating-function formulas require nonnegative integer-valued severities. For continuous or general real-valued severities, use the characteristic-function formulas instead.
  • Assuming a zero total is impossible. Under the zero-based geometric convention, \(P(N=0)=r\), so the sum is zero whenever no events are counted. More generally, a zero total can also occur if included severities themselves can equal zero.
Key takeaway: A compound sum is controlled by both its count and severity laws. The transform is the count's generating function evaluated at the severity transform; its mean and variance follow by conditioning, with count variation contributing an additional variance term.

Check Your Understanding

Use the zero-based geometric convention unless a question states otherwise.

  1. For \(N\sim\operatorname{Bin}(5,0.2)\) and iid nonnegative integer severities with generating function \(G_X(z)\), write \(G_S(z)\).
  2. If \(N\) counts failures before success with success probability \(r\), what are \(E[N]\) and \(\operatorname{Var}(N)\)?
  3. For a compound binomial sum with \(m=6\), \(p=0.25\), severity mean 2, and severity variance 3, calculate \(E[S]\) and \(\operatorname{Var}(S)\).
  4. Why does a characteristic-function formula apply to continuous severities when the probability-generating-function formula does not?
  5. In the variance of a random sum, what does each of the two terms \(E[N]\sigma^2\) and \(\operatorname{Var}(N)\mu^2\) represent?