Tutorials › Stochastic Processes › Yule Process Moments And Growth

Birth-Death Processes · Tutorial 523 of 994

Yule Process Moments And Growth

Use the Yule population law to calculate its mean, variance, and relative variability, and distinguish growth in expectation from deterministic population growth.

Intermediate 9 min read

What You'll Learn

  • State the Yule process and its one-ancestor population distribution.
  • Derive the mean and variance of a geometric population law.
  • Extend the moment formulas to any positive integer initial population.
  • Compute population moments and probabilities in exact examples.
  • Interpret exponential expected growth and persistent relative variability.
  • Avoid confusing the geometric variance or expected growth with a deterministic trajectory.

From the Population Law to Its Moments

The Yule process models a population in which each individual gives birth independently at a constant rate. Its population distribution at a fixed time is geometric when the process begins with one individual. That simple distribution gives more than a description of the probabilities: it gives exact formulas for the expected population size and its variability. Those formulas also clarify what exponential growth in expectation does—and does not—say about an individual population path.

Work on a probability space \((\Omega,\mathcal{F},\mathbb{P})\), with expectation \(\mathbb{E}\). Let \((X_t)_{t\ge0}\) be the Yule process with state space \(S=\{0,1,2,\ldots\}\), continuous time \(t\ge0\), and per-individual birth rate \(\lambda>0\). When the population is \(i\ge1\), the total birth rate is \(\lambda i\), and each birth increases the population by one. State \(0\) is absorbing. Take the filtration \((\mathcal{F}_t)_{t\ge0}\) to represent the information in the process up to time \(t\). We use the standard non-explosive Yule process. Write \(\mathbb{P}_m\) and \(\mathbb{E}_m\) when \(X_0=m\).

For one initial individual, the population law is geometric on the positive integers. In the parameterization used here, its probability of success is \(p=e^{-\lambda t}\): for \(t>0\) and \(k\ge1\), \(\mathbb{P}_1(X_t=k)=p(1-p)^{k-1}\). At \(t=0\), \(X_0=1\) with probability one. The support starts at one because the original individual remains in the population: the Yule process has births but no deaths.

Result (Yule moments): If \(X_0=m\), where \(m\ge1\) is an integer, then for every \(t\ge0\), $$ \mathbb{E}_m[X_t]=m e^{\lambda t}, \qquad \operatorname{Var}_m(X_t)=m e^{\lambda t}\bigl(e^{\lambda t}-1\bigr). $$ For \(m=0\), both moments are zero because state \(0\) is absorbing.

Deriving the Geometric Moments

First take \(X_0=1\) and \(t>0\). Set \(p=e^{-\lambda t}\) and \(r=1-p\), so \(0<p<1\), \(0<r<1\), and \(\mathbb{P}_1(X_t=k)=p r^{k-1}\). The geometric-series identities needed below follow by differentiating \(\sum_{k=0}^{\infty}r^k=(1-r)^{-1}\) for \(0<r<1\). The series and its differentiated series converge in that range.

Proof. Since \(1-r=p\), differentiating the geometric series gives \(\sum_{k\ge1}k r^{k-1}=1/(1-r)^2=1/p^2\). Therefore $$ \mathbb{E}_1[X_t] =p\sum_{k\ge1} k r^{k-1} =p\frac{1}{p^2} =\frac{1}{p}. $$ Differentiating twice also gives \(\sum_{k\ge1} k(k-1)r^{k-1}=2r/(1-r)^3=2r/p^3\). Thus \(\mathbb{E}_1[X_t(X_t-1)]=2r/p^2\). Using \(X_t^2=X_t(X_t-1)+X_t\), we obtain $$ \operatorname{Var}_1(X_t) =\mathbb{E}_1[X_t(X_t-1)]+\mathbb{E}_1[X_t]-(\mathbb{E}_1[X_t])^2 =\frac{2r}{p^2}+\frac{1}{p}-\frac{1}{p^2} =\frac{r}{p^2}. $$ Substituting \(p=e^{-\lambda t}\) and \(r=1-e^{-\lambda t}\) yields \(\mathbb{E}_1[X_t]=e^{\lambda t}\) and \(\operatorname{Var}_1(X_t)=e^{\lambda t}(e^{\lambda t}-1)\). At \(t=0\), \(X_0=1\) deterministically, so its mean is \(1=e^0\) and its variance is \(0=e^0(e^0-1)\). \(\square\)

For \(m\ge1\), the branching construction gives another useful description. Start \(m\) independent family processes, each begun from one individual, and add their population sizes. Their sum has the Yule process law begun from \(m\): when the total population is \(i\), its \(i\) individuals each give birth at rate \(\lambda\), so the total birth rate is \(\lambda i\). Independence means expectations and variances add. Equivalently, the probability generating function, the function \(G(s)=\mathbb{E}_m[s^{X_t}]\) for \(0\le s\le1\), is the \(m\)th power of the one-family generating function.

Proof. Let \(Y_1,\ldots,Y_m\) denote the independent family sizes at time \(t\), so \(X_t\) has the distribution of \(\sum_{\ell=1}^m Y_\ell\), with each \(Y_\ell\) having the one-ancestor Yule law. Linearity of expectation gives \(\mathbb{E}_m[X_t]=\sum_{\ell=1}^m\mathbb{E}[Y_\ell]=m e^{\lambda t}\). Independence gives \(\operatorname{Var}_m(X_t)=\sum_{\ell=1}^m\operatorname{Var}(Y_\ell)=m e^{\lambda t}(e^{\lambda t}-1)\), since the covariance between distinct family sizes is zero. When \(t=0\), every family has size one, and these same formulas give mean \(m\) and variance zero. \(\square\)

The distribution for \(m\) initial individuals can also be written explicitly. For \(t>0\), it is the sum of \(m\) independent geometric variables with common success probability \(p=e^{-\lambda t}\). Its probability generating function is $$ G(s)=\left(\frac{ps}{1-(1-p)s}\right)^m, $$ and its probability at \(k\ge m\) is \(\binom{k-1}{m-1}p^m(1-p)^{k-m}\). This is a negative binomial distribution. The moment result above does not require summing this probability formula term by term; independence reduces it to the one-ancestor calculation.

Worked Example: One Ancestor After One Time Unit

Suppose \(X_0=1\), \(\lambda=\ln 2\), and \(t=1\). Then \(\lambda t=\ln 2\), so \(p=e^{-(\ln 2)}=1/2\) and \(r=1-p=1/2\). The population probabilities are \(\mathbb{P}_1(X_1=k)=2^{-k}\) for \(k\ge1\).

Substituting the parameters into the mean formula gives $$ \mathbb{E}_1[X_1]=e^{(\ln 2)1}=2. $$ For the variance, \(e^{\lambda t}=2\), so $$ \operatorname{Var}_1(X_1)=2(2-1)=2. $$ The same calculation from the geometric parameter gives \(1/p=1/(1/2)=2\) and \(r/p^2=(1/2)/(1/2)^2=(1/2)/(1/4)=2\).

Check: From the probability series, \(\mathbb{E}_1[X_1]=(1/2)\sum_{k\ge1}k(1/2)^{k-1}=(1/2)(4)=2\). The factorial second moment is \(\mathbb{E}_1[X_1(X_1-1)]=(1/2)\sum_{k\ge1}k(k-1)(1/2)^{k-1}=(1/2)(8)=4\). Hence the variance is \(4+2-2^2=2\), matching the formula.

Several Initial Individuals

When there is more than one initial individual, the mean and variance both scale linearly with the initial population \(m\), not quadratically. The mean adds across families. For the variance, independence is essential: it makes the variance of the sum equal to the sum of the family variances. The distribution’s support also shifts: starting from \(m\ge1\), the population cannot be less than \(m\).

Worked Example: Three Initial Individuals

Let \(X_0=3\), \(\lambda=\ln 2\), and \(t=1\). The one-ancestor probability is \(p=e^{-(\ln 2)}=1/2\), and \(1-p=1/2\). The three independent family sizes therefore have a sum with probabilities $$ \mathbb{P}_3(X_1=k)=\binom{k-1}{2}\left(\frac12\right)^3\left(\frac12\right)^{k-3} =\binom{k-1}{2}\left(\frac12\right)^k,\qquad k\ge3. $$ For example, at \(k=3\) this is \(\binom{2}{2}/2^3=1/8\), and at \(k=4\) it is \(\binom{3}{2}/2^4=3/16\).

The mean is $$ \mathbb{E}_3[X_1]=3e^{(\ln 2)1}=3\cdot2=6. $$ The variance is $$ \operatorname{Var}_3(X_1)=3\cdot2\cdot(2-1)=6. $$ To check by independence, each of the three family sizes has mean \(2\) and variance \(2\), so their sum has mean \(2+2+2=6\) and variance \(2+2+2=6\).

Check from the generating function: Here \(G(s)=(s/(2-s))^3\), with \(G(1)=1\). Logarithmic differentiation gives \(G'(1)=6\) and \(G''(1)=36\). Since \(G''(1)=\mathbb{E}_3[X_1(X_1-1)]\), the variance is \(36+6-6^2=6\), agreeing with the family calculation.

Expected Growth and Relative Fluctuations

The mean \(m e^{\lambda t}\) grows exponentially in time, at rate \(\lambda\). This is growth of the expected population size across the process’s probability distribution; it does not say that \(X_t\) equals \(m e^{\lambda t}\), or even that an individual realization follows a smooth curve. The variance records the spread around the mean. For \(m\ge1\) and \(t\ge0\), the squared coefficient of variation—variance divided by the squared mean—is $$ \frac{\operatorname{Var}_m(X_t)}{(\mathbb{E}_m[X_t])^2} =\frac{m e^{\lambda t}(e^{\lambda t}-1)}{m^2e^{2\lambda t}} =\frac{1}{m}(1-e^{-\lambda t}). $$ For fixed \(m\ge1\) and \(\lambda>0\), this ratio increases from zero at \(t=0\) toward \(1/m\) as \(t\) grows. Thus the standard deviation becomes large in absolute terms as the mean grows, while the relative standard deviation, obtained by taking the square root of this ratio, remains bounded and approaches \(1/\sqrt{m}\). In particular, starting from one individual does not make relative variability disappear as time increases.

Worked Example: Relative Variability from Two Ancestors

Suppose \(X_0=2\) and \(\lambda t=\ln 4\), so \(e^{\lambda t}=4\), \(p=e^{-\lambda t}=1/4\), and \(1-p=3/4\). The mean is $$ \mathbb{E}_2[X_t]=2\cdot4=8. $$ The variance is $$ \operatorname{Var}_2(X_t)=2\cdot4\cdot(4-1)=24. $$ The squared coefficient of variation is \(24/8^2=24/64=3/8\), and the coefficient of variation is \(\sqrt{24}/8=\sqrt{6}/4\).

The corresponding population probabilities are \(\mathbb{P}_2(X_t=k)=(k-1)(1/4)^2(3/4)^{k-2}\) for \(k\ge2\). For instance, \(\mathbb{P}_2(X_t=2)=1/16\), and \(\mathbb{P}_2(X_t=3)=2(1/16)(3/4)=3/32\).

Check: The generating function is \(G(s)=(s/(4-3s))^2\). Its logarithmic derivative at \(s=1\) is \(G'(1)=8\), and its second derivative there is \(G''(1)=80\). Therefore \(\operatorname{Var}_2(X_t)=G''(1)+G'(1)-(G'(1))^2=80+8-64=24\), and division by the squared mean gives \(24/64=3/8\).

A Common Parameterization Pitfall

A common error is to use the variance formula for a geometric random variable on \(\{1,2,\ldots\}\) as though it were \((1-p)/p\). That expression belongs to a different geometric convention: the number of failures before the first success, supported on \(\{0,1,2,\ldots\}\). For the Yule population, the support begins at one and the law is \(\mathbb{P}_1(X_t=k)=p(1-p)^{k-1}\); its variance is \((1-p)/p^2\).

Wrong calculation: In the one-ancestor example with \(p=1/2\), using \((1-p)/p\) gives \((1/2)/(1/2)=1\). Correction: The support-\(\{1,2,\ldots\}\) formula gives \((1-p)/p^2=(1/2)/(1/4)=2\), consistent with the direct check \(4+2-2^2=2\). Check the support and the probability formula before selecting a geometric-moment identity.

The case \(t=0\) is also worth checking separately when using a geometric series: then \(p=1\) and \(r=0\), so the distribution is degenerate at \(1\), not a nondegenerate geometric distribution. The moment formulas remain valid at \(t=0\) by direct substitution or by observing \(X_0=1\) deterministically. If \(X_0=0\), the absorbing state gives \(X_t=0\) for all \(t\), so formulas for positive initial populations should not be applied without this separate case.

Check Your Understanding

Use the stated Yule law and verify each moment calculation by substituting the parameters into the formulas.

  1. For one initial individual, \(\lambda t=\ln 3\). Find the mean and variance, and state the geometric probability parameter \(p\).
  2. For four initial individuals, \(\lambda t=\ln 2\). Find the mean, variance, and squared coefficient of variation.
  3. Explain why the variance of the population from \(m\) initial individuals is \(m\) times the one-ancestor variance rather than \(m^2\) times that variance.
  4. For one initial individual at time \(t>0\), derive the variance from \(\mathbb{E}[X_t(X_t-1)]\) and \(\mathbb{E}[X_t]\).
  5. What changes in the population law and moments when the initial population is zero?