The Immigration-Death Model
Suppose individuals enter a population at a constant rate, and each individual dies independently at a constant rate. The total death rate then depends on the current population: with \(n\) individuals present, any one of the \(n\) can die. This simple difference between a per-individual rate and a total rate leads to a stationary law that is Poisson, rather than the geometric law associated with constant birth and death rates.
Work on a probability space \((\Omega,\mathcal{F},\mathbb{P})\). The state space is \(S=\{0,1,2,\ldots\}\), and \((X_t)_{t\ge0}\) is a continuous-time Markov chain with its natural filtration \((\mathcal{F}_t)_{t\ge0}\). Immigration occurs at rate \(\nu>0\); each individual has an independent exponential lifetime with rate \(\mu>0\). Thus the process has a transition from \(n\) to \(n+1\) at rate \(\nu\), and from \(n\) to \(n-1\) at rate \(n\mu\) when \(n\ge1\). There are no other transitions.
This rate description defines a nonexplosive process. Starting from any state \(n<\infty\), there are only finitely many immigrants on every bounded time interval, almost surely, because immigration is a Poisson process. Each individual present initially or arriving during that interval can die at most once. Consequently, the total number of jumps on that interval is finite almost surely.
Detailed Balance Gives the Weights
For a birth-death process, detailed balance across neighboring states means that the stationary probability flow from \(n\) to \(n+1\) equals the flow back from \(n+1\) to \(n\). Write \(\pi_n\) for the proposed stationary probability of state \(n\). The equations are \(\pi_n q_{n,n+1}=\pi_{n+1}q_{n+1,n}\). Here they become \(\pi_n\nu=\pi_{n+1}(n+1)\mu\). The factor \(n+1\) is essential: each of the \(n+1\) individuals can die.
Proof. The detailed-balance equation at \(n\) gives \(\pi_{n+1}=\pi_n\frac{\nu}{(n+1)\mu}\). Starting from \(\pi_0\) and applying this recurrence successively yields \(\pi_n=\pi_0\frac{(\nu/\mu)^n}{n!}\) for every \(n\ge0\). This includes \(n=0\), and the recurrence determines every later term. Put \(a=\nu/\mu\). The exponential series gives \(\sum_{n=0}^{\infty}a^n/n!=e^a\), so normalization requires \(1=\sum_n\pi_n=\pi_0e^a\), or \(\pi_0=e^{-a}\). This proves the displayed formula and its normalization. It also proves uniqueness among normalized sequences satisfying these detailed-balance equations. To see that this law is stationary, use the individual-lifetime construction. If \(X_0\) has this Poisson law, each initial individual survives until time \(t\) with probability \(p=e^{-\mu t}\), independently. Thinning a Poisson count of mean \(a\) by independent survival probability \(p\) gives a Poisson count of mean \(ap\): its probability generating function is \(\exp(a((1-p+pz)-1))=\exp(ap(z-1))\). Immigrants arriving by time \(t\) survive to time \(t\) independently, with survival probability \(e^{-\mu(t-s)}\) for an arrival at time \(s\). Their surviving count is Poisson with mean \(\nu\int_0^t e^{-\mu(t-s)}\,ds=a(1-e^{-\mu t})\). For completeness, the Poisson marking calculation follows by conditioning on the number of arrivals: given \(m\) arrivals, their times are independent uniform points in \([0,t]\); averaging the product of their survival generating functions and then averaging over a Poisson number with mean \(\nu t\) gives the generating function \(\exp(\nu\int_0^t e^{-\mu(t-s)}(z-1)\,ds)\). Initial survivors and surviving immigrants are independent. Their sum therefore has generating function \(\exp(ap(z-1))\exp(a(1-p)(z-1))=\exp(a(z-1))\), the generating function of the original Poisson law. Thus the distribution of \(X_t\) is \(\pi\) whenever \(X_0\) has distribution \(\pi\), for every \(t\ge0\). \(\square\)
The proposition identifies an invariant law: when the process starts with this distribution, its one-time marginal distribution remains unchanged. This does not mean that the population stays fixed along each sample path; births and deaths continue to occur. The stationary mean and variance can be read from the Poisson probabilities, as shown below.
Worked Example: Detailed Balance with Immigration Rate Three
Take \(\nu=3\) and \(\mu=2\). The generator rows at states \(0,1,2,3\), respectively, have nonzero entries \((-3,3)\) in columns \(0,1\); \((2,-5,3)\) in columns \(0,1,2\); \((4,-7,3)\) in columns \(1,2,3\); and \((6,-9,3)\) in columns \(2,3,4\). Each row sums to zero: \(-3+3=0\), \(2-5+3=0\), \(4-7+3=0\), and \(6-9+3=0\).
Here \(a=\nu/\mu=3/2\). The recurrence and normalization give \(\pi_n=e^{-3/2}(3/2)^n/n!\). In particular, \(\pi_0=e^{-3/2}\), \(\pi_1=(3/2)e^{-3/2}\), \(\pi_2=(9/8)e^{-3/2}\), and \(\pi_3=(9/16)e^{-3/2}\). Check detailed balance on the first two edges: \(\pi_0\nu=3e^{-3/2}=\pi_1\mu\), and \(\pi_1\nu=(9/2)e^{-3/2}=\pi_2(2\mu)\).
Check: the full sequence sums to \(e^{-3/2}\sum_{n=0}^{\infty}(3/2)^n/n!=e^{-3/2}e^{3/2}=1\). The displayed probabilities are terms of that normalized sequence, not a separate truncated distribution.
Mean and Variance
Let \(X\) have the stationary distribution just derived, so \(X\) is Poisson with parameter \(a=\nu/\mu\). For \(a>0\), its expectation follows by shifting the index in the defining series: \(\mathbb{E}[X]=e^{-a}\sum_{n=1}^{\infty}n a^n/n!=ae^{-a}\sum_{m=0}^{\infty}a^m/m!=a\). Likewise, \(n(n-1)/n!=1/(n-2)!\) for \(n\ge2\), so \(\mathbb{E}[X(X-1)]=a^2\). Since \(X^2=X(X-1)+X\), it follows that \(\mathbb{E}[X^2]=a^2+a\), and hence \(\operatorname{Var}(X)=\mathbb{E}[X^2]-(\mathbb{E}[X])^2=a\).
Worked Example: Verifying Both Moments
Let \(\nu=2\) and \(\mu=1\), so the stationary parameter is \(a=2\). The generator rows at states \(0,1,2\) have nonzero entries \((-2,2)\), \((1,-3,2)\), and \((2,-4,2)\), respectively. Their row sums are \(-2+2=0\), \(1-3+2=0\), and \(2-4+2=0\). Detailed balance gives \(\pi_n=e^{-2}2^n/n!\), whose total mass is \(e^{-2}e^2=1\).
Substituting into the mean formula gives \(\mathbb{E}[X]=e^{-2}\sum_{n=1}^{\infty}n2^n/n!=e^{-2}\,2\sum_{m=0}^{\infty}2^m/m!=e^{-2}\,2e^2=2\). For the second factorial moment, \(\mathbb{E}[X(X-1)]=e^{-2}\sum_{n=2}^{\infty}n(n-1)2^n/n!=e^{-2}\,4\sum_{m=0}^{\infty}2^m/m!=4\). Therefore \(\mathbb{E}[X^2]=4+2=6\), and \(\operatorname{Var}(X)=6-2^2=2\).
Check: the general formulas give \(\nu/\mu=2\) for both the mean and the variance, matching the two series calculations.
A Finite-Time Calculation
Stationarity concerns the distribution when the process starts in equilibrium. From a fixed initial population, the distribution at a later time is generally different. The same survival argument gives a direct calculation: each of the \(X_0\) initial individuals survives independently with probability \(e^{-\mu t}\), and surviving immigrants form an independent Poisson count with mean \((\nu/\mu)(1-e^{-\mu t})\).
Worked Example: Two Initial Individuals at a Fixed Time
Let \(X_0=2\), \(\nu=1\), \(\mu=1\), and \(t=\log 2\). At states \(0,1,2\), the generator rows have nonzero entries \((-1,1)\), \((1,-2,1)\), and \((2,-3,1)\), respectively. The row sums are \(-1+1=0\), \(1-2+1=0\), and \(2-3+1=0\). At time \(t\), each initial individual survives with probability \(e^{-t}=1/2\), so the number of initial survivors is binomial with parameters \(2,1/2\). The number of surviving immigrants is independent and Poisson with mean \(1-e^{-t}=1/2\).
To have \(X_t=2\), the possible initial survivor counts are \(0,1,2\). The corresponding contributions are, in order, \(\frac14\left(e^{-1/2}\frac{(1/2)^2}{2!}\right)=\frac1{32}e^{-1/2}\), \(\frac12\left(e^{-1/2}\frac{(1/2)^1}{1!}\right)=\frac14e^{-1/2}\), and \(\frac14\left(e^{-1/2}\frac{(1/2)^0}{0!}\right)=\frac14e^{-1/2}\). Their sum is \(\mathbb{P}(X_t=2)=(1/32+8/32+8/32)e^{-1/2}=\frac{17}{32}e^{-1/2}\). In particular, when two initial individuals survive, the immigrant count must be zero, whose probability is \(e^{-1/2}\), not \(e^{-1/2}/2\).
Check by generating functions: the initial survivors have generating function \((1/2+z/2)^2\), and the surviving immigrants have generating function \(\exp((z-1)/2)\). Thus the probability of two individuals is the coefficient of \(z^2\) in \(e^{-1/2}(1+2z+z^2)e^{z/2}/4\). The coefficient inside the factor \(e^{-1/2}\) is \(1/32+1/4+1/4=17/32\), confirming the result.
Common Mistakes and Boundary Cases
A common mistake is to use \(\mu\), rather than \(n\mu\), as the total death rate from state \(n\). For a concrete check, take \(\nu=\mu=1\). The correct detailed-balance equation between states 1 and 2 is \(\pi_1\cdot1=\pi_2\cdot2\), so it requires \(\pi_2=\pi_1/2\). If one incorrectly uses a constant death rate of 1, one obtains \(\pi_2=\pi_1\), which fails the actual balance equation. The per-individual death rate is \(\mu\); the total rate is \(n\mu\).
The assumption \(\mu>0\) matters for the Poisson parameter \(\nu/\mu\). If \(\nu=0\) and \(\mu>0\), state 0 is absorbing, and the Poisson law with parameter zero is interpreted as unit mass at 0. If both rates vanish, every state is absorbing. The main derivation assumes \(\nu,\mu>0\), so it does not divide by zero. In all cases, verify the rates at the boundary state 0: there is no transition to state \(-1\).
Finally, a stationary distribution is a probability law preserved by the transition dynamics when used as the initial law. The Poisson calculation proves this preservation for the immigration-death process; it does not say that every initial condition already has that law, or that the population path is constant.
Check Your Understanding
Use the rate description and the detailed-balance recurrence to justify each answer.
- For \(\nu=4\) and \(\mu=2\), write \(\pi_0,\pi_1,\pi_2\) in terms of \(e^{-2}\) and verify detailed balance across the edge from state 1 to state 2.
- Explain why the total death rate at population size \(n\) is \(n\mu\), and state the generator row-sum check at \(n=0\).
- For a Poisson random variable with parameter \(a\), derive \(\mathbb{E}[X(X-1)]\) from its probability mass function and use it to obtain the variance.
- If \(X_0=1\), what is the distribution of the number of initial individuals still alive at time \(t\)? What is the mean number of surviving immigrants?
- For the finite-time example with two initial individuals, why does the case of two initial survivors require zero surviving immigrants?