Tutorials › Stochastic Processes › Deriving the Variance Recursion

Galton-Watson Branching Processes · Tutorial 350 of 994

Deriving the Variance Recursion

Learn how conditioning on the current generation yields the variance recursion, and why finite offspring variance and independent reproduction are essential.

Advanced 11 min read

What You'll Learn

  • State the assumptions needed for the generation-size variance recursion
  • Compute conditional means, variances, and second moments of offspring sums
  • Prove square-integrability before applying total variance
  • Use the recursion in exact finite-generation calculations
  • Identify how dependence among offspring changes the conditional variance

Why Condition on the Current Generation?

In a Galton–Watson process, each individual produces a random number of children, and the next generation is the sum of those offspring counts. The size \(Z_n\) of the current generation therefore controls both the expected size and the variability of the next one. Conditioning on the current generation makes that relationship precise: the conditional variance accumulates across individuals, while variation already present in \(Z_n\) is carried forward through the offspring mean.

Let \((\Omega,\mathcal{F},\mathbb{P})\) be a probability space. For this tutorial, take \(Z_0=z_0\) to be a fixed finite nonnegative integer. Let \(\xi_{n,r}\), for \(n\ge 0\) and \(r\ge 1\), be independent, identically distributed, nonnegative integer-valued random variables. The variable \(\xi_{n,r}\) is the number of children of the \(r\)-th individual in generation \(n\). Assume that the offspring distribution has finite second moment, and write

$$ m=\mathbb{E}[\xi_{n,r}],\qquad \sigma^2=\operatorname{Var}(\xi_{n,r})<\infty. $$

The generation sizes are defined recursively by \(Z_{n+1}=\sum_{r=1}^{Z_n}\xi_{n,r}\), with an empty sum equal to zero. Let \(\mathcal{F}_n\) be the information from the process through generation \(n\), before the offspring of generation \(n\) are used. In particular, \(Z_n\) is \(\mathcal{F}_n\)-measurable, and the offspring variables \(\xi_{n,r}\) are independent of \(\mathcal{F}_n\).

Definition: A Galton–Watson process has independent offspring if, conditional on the present generation, each individual’s offspring count is an independent copy of the same offspring variable \(\xi\). The assumptions here are that \(\mathbb{E}[\xi^2]<\infty\), \(m=\mathbb{E}[\xi]\), and \(\sigma^2=\operatorname{Var}(\xi)\). Independence is needed for the conditional variance of a sum to be the sum of the individual variances.

The Conditional Moment Calculation

For any fixed integer \(k\ge 0\), the sum of \(k\) independent offspring counts has mean \(km\) and variance \(k\sigma^2\). Its second moment is the sum of its variance and the square of its mean. This also holds when \(k=0\), since the sum is then zero.

Proposition: Under the assumptions above, for every \(n\ge0\), \(\mathbb{E}[Z_{n+1}\mid\mathcal{F}_n]=mZ_n\), \(\operatorname{Var}(Z_{n+1}\mid\mathcal{F}_n)=\sigma^2Z_n\), and \(\mathbb{E}[Z_{n+1}^2\mid\mathcal{F}_n]=\sigma^2Z_n+m^2Z_n^2\). These conditional identities hold even before square-integrability of \(Z_{n+1}\) has been established.

Proof. Conditional on \(\mathcal{F}_n\), the value \(Z_n=k\) is fixed, and the offspring variables \(\xi_{n,1},\ldots,\xi_{n,k}\) are independent, each with mean \(m\) and variance \(\sigma^2\). Thus the conditional mean of their sum is \(km\), and its conditional variance is \(k\sigma^2\). Its conditional second moment is \(k\sigma^2+(km)^2\). These expressions apply at \(k=0\) as well: each is zero. Replacing \(k\) by the \(\mathcal{F}_n\)-measurable variable \(Z_n\) gives the three stated conditional identities. \(\square\)

The conditional second-moment identity is important for the order of the proof. The law of total variance is used for square-integrable random variables. We first use the conditional second moment to show that \(Z_{n+1}\) is square-integrable; only then do we apply total variance.

The Variance Recursion

Theorem: Suppose \(Z_0=z_0\) is a fixed finite nonnegative integer and offspring counts are independent and identically distributed with finite mean \(m\) and finite variance \(\sigma^2\). Then every \(Z_n\) has finite second moment, and for each \(n\ge0\), \[ \operatorname{Var}(Z_{n+1}) =m^2\operatorname{Var}(Z_n)+\sigma^2\mathbb{E}[Z_n]. \] The two terms represent, respectively, the variation inherited from the current generation and the variation contributed by the offspring counts of its individuals.

Proof. We first establish that \(\mathbb{E}[Z_n^2]<\infty\) for every \(n\). It holds at \(n=0\), because \(Z_0=z_0\) is fixed. Suppose it holds at some \(n\). Since \(Z_n\) is nonnegative and \(Z_n\le 1+Z_n^2\), \(\mathbb{E}[Z_n]\) is finite. Taking expectations of the conditional second-moment identity gives \(\mathbb{E}[Z_{n+1}^2]=\sigma^2\mathbb{E}[Z_n]+m^2\mathbb{E}[Z_n^2]<\infty\). This proves the required square-integrability by induction.

Now \(Z_n\) and \(Z_{n+1}\) are square-integrable, so total variance applies. Using the conditional variance and conditional mean from the proposition, \(\operatorname{Var}(Z_{n+1})=\mathbb{E}[\operatorname{Var}(Z_{n+1}\mid\mathcal{F}_n)]+\operatorname{Var}(\mathbb{E}[Z_{n+1}\mid\mathcal{F}_n])=\sigma^2\mathbb{E}[Z_n]+\operatorname{Var}(mZ_n)\). Since \(m\) is a constant, \(\operatorname{Var}(mZ_n)=m^2\operatorname{Var}(Z_n)\). Substitution proves the recursion. \(\square\)

The same conditional-mean calculation gives \(\mathbb{E}[Z_{n+1}]=m\mathbb{E}[Z_n]\). The variance recursion uses this expected generation size as an input, but it does not require solving the recursion across generations.

Worked Example: Offspring Are Either Zero or Two

Suppose each individual has zero offspring with probability \(\tfrac12\) and two offspring with probability \(\tfrac12\), independently, and \(Z_0=1\). Find the mean and variance of \(Z_1\) and \(Z_2\), then check the variance at generation 2 directly.

The offspring mean is \(m=0\cdot\tfrac12+2\cdot\tfrac12=1\). Its second moment is \(\mathbb{E}[\xi^2]=0^2\cdot\tfrac12+2^2\cdot\tfrac12=2\), so \(\sigma^2=2-1^2=1\). At generation 0, \(\mathbb{E}[Z_0]=1\) and \(\operatorname{Var}(Z_0)=0\). The recursion gives \(\mathbb{E}[Z_1]=1\) and \(\operatorname{Var}(Z_1)=1^2\cdot0+1\cdot1=1\).

For generation 2, \(\mathbb{E}[Z_2]=1\cdot1=1\) and \(\operatorname{Var}(Z_2)=1^2\cdot1+1\cdot1=2\). To check directly, \(Z_1=0\) with probability \(\tfrac12\) and \(Z_1=2\) with probability \(\tfrac12\). If \(Z_1=0\), then \(Z_2=0\). If \(Z_1=2\), the two independent offspring counts sum to 0, 2, or 4, each with conditional probabilities \(\tfrac14,\tfrac12,\tfrac14\). Therefore \(\mathbb{P}(Z_2=0)=\tfrac12+\tfrac12\cdot\tfrac14=\tfrac58\), \(\mathbb{P}(Z_2=2)=\tfrac12\cdot\tfrac12=\tfrac14\), and \(\mathbb{P}(Z_2=4)=\tfrac12\cdot\tfrac14=\tfrac18\). The mean is \(0\cdot\tfrac58+2\cdot\tfrac14+4\cdot\tfrac18=1\), and the second moment is \(0^2\cdot\tfrac58+2^2\cdot\tfrac14+4^2\cdot\tfrac18=3\). Thus \(\operatorname{Var}(Z_2)=3-1^2=2\), as given by the recursion.

Worked Example: Poisson Offspring

Suppose offspring counts have a Poisson distribution with parameter \(\tfrac32\), independently, and \(Z_0=2\). Compute the means and variances through generation 2, and verify the second moment at generation 2.

A Poisson variable with parameter \(\tfrac32\) has mean \(m=\tfrac32\) and variance \(\sigma^2=\tfrac32\). Initially, \(\mathbb{E}[Z_0]=2\) and \(\operatorname{Var}(Z_0)=0\). The mean recursion gives \(\mathbb{E}[Z_1]=\tfrac32\cdot2=3\), and the variance recursion gives \(\operatorname{Var}(Z_1)=(\tfrac32)^2\cdot0+\tfrac32\cdot2=3\).

Next, \(\mathbb{E}[Z_2]=\tfrac32\cdot3=\tfrac92\). The variance is \(\operatorname{Var}(Z_2)=(\tfrac32)^2\cdot3+\tfrac32\cdot3=\tfrac{27}{4}+\tfrac{18}{4}=\tfrac{45}{4}\). For an independent check, \(\mathbb{E}[Z_1^2]=\operatorname{Var}(Z_1)+(\mathbb{E}[Z_1])^2=3+3^2=12\). The conditional second-moment identity therefore gives \(\mathbb{E}[Z_2^2]=\tfrac32\cdot3+(\tfrac32)^2\cdot12=\tfrac92+27=\tfrac{63}{2}\). Meanwhile, the mean and variance just computed give \(\operatorname{Var}(Z_2)+(\mathbb{E}[Z_2])^2=\tfrac{45}{4}+(\tfrac92)^2=\tfrac{45}{4}+\tfrac{81}{4}=\tfrac{63}{2}\). The two calculations agree.

Why Independent Offspring Matter

Conditional on \(Z_n=k\), the next generation is a sum of \(k\) offspring counts. If those counts are independent, the conditional variance is \(k\sigma^2\). If they are dependent, the variance of the sum also contains covariance terms. The formula for a Galton–Watson process cannot be transferred unchanged to a model with shared or correlated reproduction.

Worked Example: Perfectly Correlated Offspring

Consider two individuals, each with a marginal offspring count that is zero or two with probability \(\tfrac12\). Suppose, contrary to the Galton–Watson independence assumption, that both individuals always have the same offspring count. Compute the variance of the total offspring and compare it with the independent-offspring formula.

Let their common offspring count be \(Y\). Its mean is \(0\cdot\tfrac12+2\cdot\tfrac12=1\), and its variance is \(0^2\cdot\tfrac12+2^2\cdot\tfrac12-1^2=1\). The total offspring is \(Y+Y=2Y\), so its variance is \(2^2\operatorname{Var}(Y)=4\). If one incorrectly applied the independent-offspring conditional variance formula with \(k=2\), it would give \(2\cdot1=2\), not 4. The discrepancy comes from the covariance: \(\operatorname{Var}(Y+Y)=\operatorname{Var}(Y)+\operatorname{Var}(Y)+2\operatorname{Cov}(Y,Y)=1+1+2=4\). Under independence the covariance term between distinct individuals would be zero; here it is 1.

Common pitfall. Applying total variance before establishing that \(Z_{n+1}\) is square-integrable leaves a gap: the induction hypothesis may give \(\mathbb{E}[Z_n^2]<\infty\), but that alone does not yet state that \(\mathbb{E}[Z_{n+1}^2]<\infty\). The repair is to first take expectations in \(\mathbb{E}[Z_{n+1}^2\mid\mathcal{F}_n]=\sigma^2Z_n+m^2Z_n^2\). The resulting finite value proves square-integrability of \(Z_{n+1}\); total variance can then be applied without circularity.

The recursion also makes the roles of the assumptions visible. Finite offspring variance ensures that the conditional second moment is finite when \(Z_n\) has finite second moment. Independent reproduction gives the term \(\sigma^2Z_n\), rather than a sum containing covariance contributions. If \(Z_n=0\), both terms on the right-hand side of the variance recursion are zero, consistent with \(Z_{n+1}=0\) with certainty.

Check Your Understanding

For each question, state any moment or independence assumptions you use, and check numerical calculations by substitution.

  1. If the offspring mean is \(m=2\), the offspring variance is \(\sigma^2=3\), and \(\mathbb{E}[Z_n]=4\), \(\operatorname{Var}(Z_n)=5\), what does the variance recursion give for \(\operatorname{Var}(Z_{n+1})\)?
  2. Why is the conditional second-moment identity used before total variance in the proof?
  3. Suppose \(Z_n=0\) with probability one. What do the conditional mean, conditional variance, and next-generation size equal?
  4. For \(k\) independent offspring counts with mean \(m\) and variance \(\sigma^2\), derive the sum’s second moment from its mean and variance.
  5. In the perfectly correlated example, which covariance term makes the independent-offspring calculation incorrect?