Tutorials › Stochastic Processes › Offspring Distributions and Probability Generating Functions

Galton-Watson Branching Processes · Tutorial 341 of 994

Offspring Distributions and Probability Generating Functions

Learn to read offspring probabilities and moment information directly from a probability generating function, and verify the calculations for finite-support laws.

Advanced 9 min read

What You'll Learn

  • Define the offspring probability generating function from a nonnegative integer-valued offspring count.
  • Recover finite-support probabilities from derivatives at zero.
  • Derive factorial moments by differentiating at one.
  • Express the mean, second moment, and variance using derivatives of the generating function.
  • Check each identity on explicit finite-support offspring laws.
  • Avoid the common error of omitting the factorial in coefficient extraction.

Encoding an Offspring Law

In a Galton–Watson branching process, the offspring count of one individual is a nonnegative integer-valued random variable. Its probability generating function packages the probabilities of all possible offspring counts into a single function. For finite-support laws, this function is a polynomial: its coefficients give the probabilities, while its derivatives give useful summaries such as the mean and variance. These relationships are algebraic, but careful attention to factorials is essential.

Let \(X\) be an offspring count on a probability space \((\Omega,\mathcal{F},\mathbb{P})\), with state space \(\mathbb{N}_0=\{0,1,2,\ldots\}\). Write \(p_j=\mathbb{P}(X=j)\). The probabilities satisfy \(p_j\ge0\) and \(\sum_{j=0}^{\infty}p_j=1\). The probability generating function, abbreviated pgf, is

Definition: The offspring probability generating function is \(f(s)=\mathbb{E}[s^X]=\sum_{j=0}^{\infty}p_js^j\) for \(0\le s\le1\). At \(s=0\), use the polynomial convention \(s^0=1\), including \(0^0=1\) in this sum. If the offspring law has finite support, then \(p_j=0\) for all sufficiently large \(j\), and \(f\) is a polynomial.

The definition immediately gives two useful endpoint identities. At \(s=1\), every term \(1^j\) equals \(1\), so \(f(1)=\sum_jp_j=1\). At \(s=0\), only the term for \(j=0\) remains, so \(f(0)=p_0\), the probability of no offspring. More generally, the coefficient of \(s^j\) in the pgf is the probability \(p_j\). Derivatives at zero recover those coefficients, but with a factorial multiplier.

Coefficients from Derivatives at Zero

Proposition: Suppose \(X\) has finite support and \(f(s)=\sum_{j=0}^{M}p_js^j\). For every integer \(k\) with \(0\le k\le M\), \(f^{(k)}(0)=k!p_k\), where \(f^{(0)}=f\). Thus \(p_k=f^{(k)}(0)/k!\).

Proof. Differentiate each monomial \(s^j\) exactly \(k\) times. If \(j<k\), its derivative is zero. If \(j=k\), its derivative is the constant \(k!\). If \(j>k\), its derivative is \(j(j-1)\cdots(j-k+1)s^{j-k}\), which is zero at \(s=0\) because \(j-k\ge1\). Therefore, in the finite sum defining \(f^{(k)}(0)\), all terms vanish except the term \(j=k\), which contributes \(k!p_k\). For \(k=0\), the same argument says \(f(0)=p_0\), since every positive power of zero vanishes. Dividing by \(k!\), which is nonzero, gives the coefficient formula. \(\square\)

For example, the coefficient of \(s^3\) is \(f'''(0)/3!\), not simply \(f'''(0)\). The denominator matters increasingly at higher orders. For a law with infinite support, the power series still determines its coefficients, and derivatives at zero can be used to extract them; derivatives at \(s=1\), however, require more care because the corresponding moments may be infinite.

Derivatives at One and Offspring Moments

For finite-support laws, every derivative exists at \(s=1\). Differentiating a monomial gives a factorial product. For \(r\ge1\), define the falling factorial \((j)_r=j(j-1)\cdots(j-r+1)\) when \(j\ge r\), and set \((j)_r=0\) when \(j<r\). Then

$$ f^{(r)}(1)=\sum_{j=r}^{M}j(j-1)\cdots(j-r+1)p_j =\mathbb{E}\big[X(X-1)\cdots(X-r+1)\big]. $$

These are factorial moments, rather than ordinary powers of \(X\). In particular, \(f'(1)=\mathbb{E}[X]\), the mean offspring count. Since \(X^2=X(X-1)+X\), the second ordinary moment is \(f''(1)+f'(1)\). Subtracting the square of the mean gives the variance.

Moment formulas for finite-support laws: \(f'(1)=\mathbb{E}[X]\), \(f''(1)=\mathbb{E}[X(X-1)]\), \(\mathbb{E}[X^2]=f''(1)+f'(1)\), and \(\operatorname{Var}(X)=f''(1)+f'(1)-[f'(1)]^2\).

Proof. Write \(f(s)=\sum_{j=0}^{M}p_js^j\). For \(j\ge r\), the \(r\)th derivative of \(s^j\) is \(j(j-1)\cdots(j-r+1)s^{j-r}\); for \(j<r\), it is zero. Substituting \(s=1\) into the finite sum therefore gives \(f^{(r)}(1)=\sum_{j=r}^{M}j(j-1)\cdots(j-r+1)p_j\). By the definition of expectation for a discrete random variable, this sum is the expectation of the falling factorial. Taking \(r=1\) gives the mean, and taking \(r=2\) gives \(\mathbb{E}[X(X-1)]\). The identity \(X^2=X(X-1)+X\) holds for every integer value of \(X\), so taking expectations gives \(\mathbb{E}[X^2]=f''(1)+f'(1)\). Finally, \(\operatorname{Var}(X)=\mathbb{E}[X^2]-(\mathbb{E}[X])^2\), yielding the stated variance formula. \(\square\)

For finite support, the formulas are finite sums and do not require separate moment assumptions. For an infinite-support law, the pgf is still defined on \([0,1]\), but a derivative at \(1\) need not be finite. One should not infer a finite mean or variance merely from the existence of \(f(s)\) for \(s<1\).

Worked Finite-Support Examples

Worked Example: Recovering Probabilities and Moments

Suppose an individual has \(0,1,\) or \(3\) offspring with probabilities \(1/4,1/2,\) and \(1/4\), respectively. The probabilities sum to \(1/4+1/2+1/4=1\), so they define a probability law. Find the pgf, recover the probabilities from derivatives at zero, and calculate the mean and variance.

The pgf is \(f(s)=\tfrac14+\tfrac12s+\tfrac14s^3\). Its first three derivatives are \(f'(s)=\tfrac12+\tfrac34s^2\), \(f''(s)=\tfrac32s\), and \(f'''(s)=\tfrac32\). At zero, \(f(0)=1/4=p_0\), \(f'(0)=1/2=1!p_1\), and \(f''(0)=0=2!p_2\). Also, \(f'''(0)=3/2=3!p_3\), so \(p_3=(3/2)/6=1/4\). The recovered probabilities agree with the stated law.

At one, \(f'(1)=1/2+3/4=5/4\), so the mean is \(5/4\). Also, \(f''(1)=3/2\), and hence \(\mathbb{E}[X^2]=3/2+5/4=6/4+5/4=11/4\). The variance is \(11/4-(5/4)^2=44/16-25/16=19/16\).

Check by direct expectation: \(\mathbb{E}[X]=0(1/4)+1(1/2)+3(1/4)=1/2+3/4=5/4\), and \(\mathbb{E}[X^2]=0^2(1/4)+1^2(1/2)+3^2(1/4)=1/2+9/4=11/4\). These give the same variance, \(11/4-25/16=19/16\).

Worked Example: A Law Supported on Even Counts

Suppose the offspring count is \(0,2,\) or \(4\), with probabilities \(1/2,1/3,\) and \(1/6\). The probability check is \(1/2+1/3+1/6=3/6+2/6+1/6=1\). Find the pgf, its first two derivatives at one, and the offspring variance.

The pgf is \(f(s)=\tfrac12+\tfrac13s^2+\tfrac16s^4\). Differentiating gives \(f'(s)=\tfrac23s+\tfrac23s^3\) and \(f''(s)=\tfrac23+2s^2\). Thus \(f'(1)=2/3+2/3=4/3\), the mean, and \(f''(1)=2/3+2=8/3\), the second factorial moment. Therefore \(\mathbb{E}[X^2]=8/3+4/3=4\), and \(\operatorname{Var}(X)=4-(4/3)^2=4-16/9=20/9\).

Check the coefficient extraction: \(f(0)=1/2\), \(f'(0)=0\), and \(f''(0)=2/3\), giving \(p_0=1/2\), \(p_1=0\), and \(p_2=(2/3)/2=1/3\). The fourth derivative is \(f^{(4)}(s)=4\), so \(p_4=f^{(4)}(0)/4!=4/24=1/6\). The coefficients sum to \(1/2+1/3+1/6=1\).

Check by direct expectation: \(\mathbb{E}[X]=0(1/2)+2(1/3)+4(1/6)=2/3+4/6=4/3\), and \(\mathbb{E}[X^2]=0+4(1/3)+16(1/6)=4/3+8/3=4\). Thus the direct calculation also gives variance \(4-16/9=20/9\).

Worked Example: Evaluating the PGF and Its Derivatives

Let the offspring probabilities at \(0,1,2,3\) be \(1/8,3/8,1/4,1/4\). They sum to \(1/8+3/8+2/8+2/8=8/8=1\). Calculate \(f(1/2)\), the mean, and the variance, then check the mean and pgf value directly from the law.

The pgf is \(f(s)=\tfrac18+\tfrac38s+\tfrac14s^2+\tfrac14s^3\). Substitution gives \(f(1/2)=1/8+3/16+1/16+1/32\). With denominator \(32\), this is \(4/32+6/32+2/32+1/32=13/32\). Differentiating, \(f'(s)=3/8+s/2+3s^2/4\) and \(f''(s)=1/2+3s/2\). Hence \(f'(1)=3/8+4/8+6/8=13/8\), and \(f''(1)=1/2+3/2=2\). It follows that \(\mathbb{E}[X^2]=2+13/8=29/8\), and \(\operatorname{Var}(X)=29/8-(13/8)^2=232/64-169/64=63/64\).

Check: Direct evaluation gives \(f(1/2)=\mathbb{E}[(1/2)^X]=1/8+3/16+1/16+1/32=13/32\), the same value. Directly, \(\mathbb{E}[X]=0(1/8)+1(3/8)+2(1/4)+3(1/4)=3/8+4/8+6/8=13/8\), agreeing with \(f'(1)\). Also \(0^2(1/8)+1^2(3/8)+2^2(1/4)+3^2(1/4)=3/8+1+9/4=29/8\), agreeing with the second-moment formula.

Reading a PGF Reliably

The pgf represents the entire offspring distribution, not just its mean. When the support is finite, its coefficients can be read off directly, and the derivatives at one provide moment summaries. These are different operations: derivatives at zero isolate individual probabilities, while derivatives at one combine probabilities across the support. A pgf can therefore be used both to check a proposed offspring law and to calculate quantities needed to describe it.

Common mistake: forgetting the factorial. In the first example, \(f'''(0)=3/2\). Setting \(p_3=3/2\) is wrong: it treats the third derivative as the coefficient itself and even gives a value greater than one. The correct calculation is \(p_3=f'''(0)/3!=(3/2)/6=1/4\). In general, the \(k\)th derivative at zero is \(k!p_k\), so coefficient recovery requires division by \(k!\).

A second useful check is normalization. For any proposed finite-support pgf, its coefficients must be nonnegative and sum to \(f(1)=1\). If either check fails, it cannot describe an offspring probability distribution. Likewise, when using the moment formulas, check the mean independently from \(\sum_j jp_j\) if the support is short enough to make that sum transparent.

QuantityFormula for finite supportInterpretation
Probability of zero offspring\(p_0=f(0)\)Constant coefficient of the pgf
Probability of \(k\) offspring\(p_k=f^{(k)}(0)/k!\)Coefficient of \(s^k\)
Mean offspring count\(\mathbb{E}[X]=f'(1)\)First ordinary moment
Second factorial moment\(\mathbb{E}[X(X-1)]=f''(1)\)Counts ordered pairs among offspring
Variance\(\operatorname{Var}(X)=f''(1)+f'(1)-[f'(1)]^2\)Second moment minus squared mean

Check Your Understanding

Use the coefficient and derivative identities to answer each question. For every proposed probability law, check that its probabilities sum to one.

  1. If \(f(s)=\tfrac13+\tfrac12s+\tfrac16s^2\), what are \(p_0,p_1,p_2\), and what is \(f(1)\)?
  2. For a finite-support offspring law with \(f'(1)=2\) and \(f''(1)=3\), find \(\mathbb{E}[X^2]\) and \(\operatorname{Var}(X)\).
  3. Suppose \(f'''(0)=12\). What is \(p_3\)? Explain why \(12\) itself is not the probability.
  4. For \(f(s)=\tfrac14+\tfrac12s+\tfrac14s^2\), calculate \(f'(1)\) and check it by summing \(jp_j\).
  5. Why does \(f(0)\) give the probability of zero offspring, whereas \(f(1)\) gives the sum of all offspring probabilities?