Encoding an Offspring Law
In a Galton–Watson branching process, the offspring count of one individual is a nonnegative integer-valued random variable. Its probability generating function packages the probabilities of all possible offspring counts into a single function. For finite-support laws, this function is a polynomial: its coefficients give the probabilities, while its derivatives give useful summaries such as the mean and variance. These relationships are algebraic, but careful attention to factorials is essential.
Let \(X\) be an offspring count on a probability space \((\Omega,\mathcal{F},\mathbb{P})\), with state space \(\mathbb{N}_0=\{0,1,2,\ldots\}\). Write \(p_j=\mathbb{P}(X=j)\). The probabilities satisfy \(p_j\ge0\) and \(\sum_{j=0}^{\infty}p_j=1\). The probability generating function, abbreviated pgf, is
The definition immediately gives two useful endpoint identities. At \(s=1\), every term \(1^j\) equals \(1\), so \(f(1)=\sum_jp_j=1\). At \(s=0\), only the term for \(j=0\) remains, so \(f(0)=p_0\), the probability of no offspring. More generally, the coefficient of \(s^j\) in the pgf is the probability \(p_j\). Derivatives at zero recover those coefficients, but with a factorial multiplier.
Coefficients from Derivatives at Zero
Proof. Differentiate each monomial \(s^j\) exactly \(k\) times. If \(j<k\), its derivative is zero. If \(j=k\), its derivative is the constant \(k!\). If \(j>k\), its derivative is \(j(j-1)\cdots(j-k+1)s^{j-k}\), which is zero at \(s=0\) because \(j-k\ge1\). Therefore, in the finite sum defining \(f^{(k)}(0)\), all terms vanish except the term \(j=k\), which contributes \(k!p_k\). For \(k=0\), the same argument says \(f(0)=p_0\), since every positive power of zero vanishes. Dividing by \(k!\), which is nonzero, gives the coefficient formula. \(\square\)
For example, the coefficient of \(s^3\) is \(f'''(0)/3!\), not simply \(f'''(0)\). The denominator matters increasingly at higher orders. For a law with infinite support, the power series still determines its coefficients, and derivatives at zero can be used to extract them; derivatives at \(s=1\), however, require more care because the corresponding moments may be infinite.
Derivatives at One and Offspring Moments
For finite-support laws, every derivative exists at \(s=1\). Differentiating a monomial gives a factorial product. For \(r\ge1\), define the falling factorial \((j)_r=j(j-1)\cdots(j-r+1)\) when \(j\ge r\), and set \((j)_r=0\) when \(j<r\). Then
These are factorial moments, rather than ordinary powers of \(X\). In particular, \(f'(1)=\mathbb{E}[X]\), the mean offspring count. Since \(X^2=X(X-1)+X\), the second ordinary moment is \(f''(1)+f'(1)\). Subtracting the square of the mean gives the variance.
Proof. Write \(f(s)=\sum_{j=0}^{M}p_js^j\). For \(j\ge r\), the \(r\)th derivative of \(s^j\) is \(j(j-1)\cdots(j-r+1)s^{j-r}\); for \(j<r\), it is zero. Substituting \(s=1\) into the finite sum therefore gives \(f^{(r)}(1)=\sum_{j=r}^{M}j(j-1)\cdots(j-r+1)p_j\). By the definition of expectation for a discrete random variable, this sum is the expectation of the falling factorial. Taking \(r=1\) gives the mean, and taking \(r=2\) gives \(\mathbb{E}[X(X-1)]\). The identity \(X^2=X(X-1)+X\) holds for every integer value of \(X\), so taking expectations gives \(\mathbb{E}[X^2]=f''(1)+f'(1)\). Finally, \(\operatorname{Var}(X)=\mathbb{E}[X^2]-(\mathbb{E}[X])^2\), yielding the stated variance formula. \(\square\)
For finite support, the formulas are finite sums and do not require separate moment assumptions. For an infinite-support law, the pgf is still defined on \([0,1]\), but a derivative at \(1\) need not be finite. One should not infer a finite mean or variance merely from the existence of \(f(s)\) for \(s<1\).
Worked Finite-Support Examples
Worked Example: Recovering Probabilities and Moments
Suppose an individual has \(0,1,\) or \(3\) offspring with probabilities \(1/4,1/2,\) and \(1/4\), respectively. The probabilities sum to \(1/4+1/2+1/4=1\), so they define a probability law. Find the pgf, recover the probabilities from derivatives at zero, and calculate the mean and variance.
The pgf is \(f(s)=\tfrac14+\tfrac12s+\tfrac14s^3\). Its first three derivatives are \(f'(s)=\tfrac12+\tfrac34s^2\), \(f''(s)=\tfrac32s\), and \(f'''(s)=\tfrac32\). At zero, \(f(0)=1/4=p_0\), \(f'(0)=1/2=1!p_1\), and \(f''(0)=0=2!p_2\). Also, \(f'''(0)=3/2=3!p_3\), so \(p_3=(3/2)/6=1/4\). The recovered probabilities agree with the stated law.
At one, \(f'(1)=1/2+3/4=5/4\), so the mean is \(5/4\). Also, \(f''(1)=3/2\), and hence \(\mathbb{E}[X^2]=3/2+5/4=6/4+5/4=11/4\). The variance is \(11/4-(5/4)^2=44/16-25/16=19/16\).
Check by direct expectation: \(\mathbb{E}[X]=0(1/4)+1(1/2)+3(1/4)=1/2+3/4=5/4\), and \(\mathbb{E}[X^2]=0^2(1/4)+1^2(1/2)+3^2(1/4)=1/2+9/4=11/4\). These give the same variance, \(11/4-25/16=19/16\).
Worked Example: A Law Supported on Even Counts
Suppose the offspring count is \(0,2,\) or \(4\), with probabilities \(1/2,1/3,\) and \(1/6\). The probability check is \(1/2+1/3+1/6=3/6+2/6+1/6=1\). Find the pgf, its first two derivatives at one, and the offspring variance.
The pgf is \(f(s)=\tfrac12+\tfrac13s^2+\tfrac16s^4\). Differentiating gives \(f'(s)=\tfrac23s+\tfrac23s^3\) and \(f''(s)=\tfrac23+2s^2\). Thus \(f'(1)=2/3+2/3=4/3\), the mean, and \(f''(1)=2/3+2=8/3\), the second factorial moment. Therefore \(\mathbb{E}[X^2]=8/3+4/3=4\), and \(\operatorname{Var}(X)=4-(4/3)^2=4-16/9=20/9\).
Check the coefficient extraction: \(f(0)=1/2\), \(f'(0)=0\), and \(f''(0)=2/3\), giving \(p_0=1/2\), \(p_1=0\), and \(p_2=(2/3)/2=1/3\). The fourth derivative is \(f^{(4)}(s)=4\), so \(p_4=f^{(4)}(0)/4!=4/24=1/6\). The coefficients sum to \(1/2+1/3+1/6=1\).
Check by direct expectation: \(\mathbb{E}[X]=0(1/2)+2(1/3)+4(1/6)=2/3+4/6=4/3\), and \(\mathbb{E}[X^2]=0+4(1/3)+16(1/6)=4/3+8/3=4\). Thus the direct calculation also gives variance \(4-16/9=20/9\).
Worked Example: Evaluating the PGF and Its Derivatives
Let the offspring probabilities at \(0,1,2,3\) be \(1/8,3/8,1/4,1/4\). They sum to \(1/8+3/8+2/8+2/8=8/8=1\). Calculate \(f(1/2)\), the mean, and the variance, then check the mean and pgf value directly from the law.
The pgf is \(f(s)=\tfrac18+\tfrac38s+\tfrac14s^2+\tfrac14s^3\). Substitution gives \(f(1/2)=1/8+3/16+1/16+1/32\). With denominator \(32\), this is \(4/32+6/32+2/32+1/32=13/32\). Differentiating, \(f'(s)=3/8+s/2+3s^2/4\) and \(f''(s)=1/2+3s/2\). Hence \(f'(1)=3/8+4/8+6/8=13/8\), and \(f''(1)=1/2+3/2=2\). It follows that \(\mathbb{E}[X^2]=2+13/8=29/8\), and \(\operatorname{Var}(X)=29/8-(13/8)^2=232/64-169/64=63/64\).
Check: Direct evaluation gives \(f(1/2)=\mathbb{E}[(1/2)^X]=1/8+3/16+1/16+1/32=13/32\), the same value. Directly, \(\mathbb{E}[X]=0(1/8)+1(3/8)+2(1/4)+3(1/4)=3/8+4/8+6/8=13/8\), agreeing with \(f'(1)\). Also \(0^2(1/8)+1^2(3/8)+2^2(1/4)+3^2(1/4)=3/8+1+9/4=29/8\), agreeing with the second-moment formula.
Reading a PGF Reliably
The pgf represents the entire offspring distribution, not just its mean. When the support is finite, its coefficients can be read off directly, and the derivatives at one provide moment summaries. These are different operations: derivatives at zero isolate individual probabilities, while derivatives at one combine probabilities across the support. A pgf can therefore be used both to check a proposed offspring law and to calculate quantities needed to describe it.
Common mistake: forgetting the factorial. In the first example, \(f'''(0)=3/2\). Setting \(p_3=3/2\) is wrong: it treats the third derivative as the coefficient itself and even gives a value greater than one. The correct calculation is \(p_3=f'''(0)/3!=(3/2)/6=1/4\). In general, the \(k\)th derivative at zero is \(k!p_k\), so coefficient recovery requires division by \(k!\).
A second useful check is normalization. For any proposed finite-support pgf, its coefficients must be nonnegative and sum to \(f(1)=1\). If either check fails, it cannot describe an offspring probability distribution. Likewise, when using the moment formulas, check the mean independently from \(\sum_j jp_j\) if the support is short enough to make that sum transparent.
| Quantity | Formula for finite support | Interpretation |
|---|---|---|
| Probability of zero offspring | \(p_0=f(0)\) | Constant coefficient of the pgf |
| Probability of \(k\) offspring | \(p_k=f^{(k)}(0)/k!\) | Coefficient of \(s^k\) |
| Mean offspring count | \(\mathbb{E}[X]=f'(1)\) | First ordinary moment |
| Second factorial moment | \(\mathbb{E}[X(X-1)]=f''(1)\) | Counts ordered pairs among offspring |
| Variance | \(\operatorname{Var}(X)=f''(1)+f'(1)-[f'(1)]^2\) | Second moment minus squared mean |
Check Your Understanding
Use the coefficient and derivative identities to answer each question. For every proposed probability law, check that its probabilities sum to one.
- If \(f(s)=\tfrac13+\tfrac12s+\tfrac16s^2\), what are \(p_0,p_1,p_2\), and what is \(f(1)\)?
- For a finite-support offspring law with \(f'(1)=2\) and \(f''(1)=3\), find \(\mathbb{E}[X^2]\) and \(\operatorname{Var}(X)\).
- Suppose \(f'''(0)=12\). What is \(p_3\)? Explain why \(12\) itself is not the probability.
- For \(f(s)=\tfrac14+\tfrac12s+\tfrac14s^2\), calculate \(f'(1)\) and check it by summing \(jp_j\).
- Why does \(f(0)\) give the probability of zero offspring, whereas \(f(1)\) gives the sum of all offspring probabilities?