Tutorials › Stochastic Processes › Boundary States: Absorption, Reflection, And Immigration

Birth-Death Processes · Tutorial 517 of 994

Boundary States: Absorption, Reflection, And Immigration

Learn how the rate at zero determines whether the boundary traps the chain or allows it to leave, and how to encode each choice correctly in a generator.

Intermediate 11 min read

What You'll Learn

  • Define absorbing and reflecting behavior at zero for a birth–death chain on the nonnegative integers.
  • Distinguish suppression of downward jumps from the presence of upward immigration.
  • Construct generator rows at zero and at a finite upper boundary.
  • Compute holding rates and jump probabilities from birth and death rates.
  • Identify when a zero-rate boundary is absorbing and when it is not.
  • Check generator entries and avoid confusing a boundary with an absorbing state.

What Can Happen at Zero?

In a birth–death process, the state records a nonnegative integer quantity, such as a population size. From a positive state, the process may increase by one through a birth or decrease by one through a death. At zero, a downward jump would leave the state space. The boundary rule therefore determines whether zero traps the process or whether an upward transition can take it away from zero. Immigration is one common mechanism for that upward transition.

Let \((X_t)_{t\ge0}\) be a continuous-time Markov chain on a probability space \((\Omega,\mathcal{F},\mathbb{P})\), with state space \(S=\{0,1,2,\ldots\}\) or a finite interval of nonnegative integers. Its natural filtration is \(\mathcal{F}_t=\sigma(X_s:0\le s\le t)\). We assume the chain is well-defined and non-explosive, so it makes only finitely many jumps on each bounded time interval. Write \(Q=(q_{ij})\) for its generator: for \(j\ne i\), \(q_{ij}\) is the instantaneous rate of a jump from \(i\) to \(j\), and \(q_{ii}=-\sum_{j\ne i}q_{ij}\). Thus each generator row sums to zero.

Definition: A birth–death chain has birth rates \(\lambda_i\ge0\) for jumps from \(i\) to \(i+1\), and death rates \(\mu_i\ge0\) for jumps from \(i\) to \(i-1\), when those destinations belong to \(S\). At the lower boundary \(0\), a downward jump is not an allowed transition, so \(\mu_0=0\) in the generator. On a finite state space with upper endpoint \(N\), there is no transition to \(N+1\), so \(\lambda_N=0\).

At zero, there is only one possible outgoing transition in this model: \(0\to1\). If its rate \(\lambda_0\) is zero, the chain cannot leave zero, so zero is absorbing. If \(\lambda_0>0\), the chain leaves zero for state \(1\); this positive boundary birth rate can represent immigration. The term reflecting refers to suppressing a move below zero, not to adding a jump to a different state. A reflecting boundary can still be absorbing if no upward transition is allowed. In many population models, the boundary is called reflecting and has \(\lambda_0>0\), so the process can leave zero.

Generator Rules at the Boundary

Theorem (Boundary and holding-rate rules): For a birth–death chain on \(S=\{0,1,2,\ldots\}\), the generator row at zero is \(q_{00}=-\lambda_0\), \(q_{01}=\lambda_0\), and \(q_{0j}=0\) for \(j\notin\{0,1\}\). Consequently, zero is absorbing if and only if \(\lambda_0=0\). At a state \(i\ge1\), the total exit rate is \(r_i=\lambda_i+\mu_i\), with \(q_{ii}=-r_i\), \(q_{i,i+1}=\lambda_i\), and \(q_{i,i-1}=\mu_i\). If \(r_i>0\), the holding time at \(i\) is exponential with rate \(r_i\), and the probabilities of the next jump being upward or downward are \(\lambda_i/r_i\) and \(\mu_i/r_i\). If \(r_i=0\), the chain stays at \(i\).

Proof. By the birth–death definition, a jump from zero to a negative state is not allowed, and the only possible destination different from zero is state \(1\), with rate \(\lambda_0\). The diagonal generator entry is the negative sum of outgoing rates, so \(q_{00}=-\lambda_0\). If \(\lambda_0=0\), every off-diagonal entry in row zero is zero, and the chain cannot leave zero. If \(\lambda_0>0\), then \(q_{01}>0\), so zero is not absorbing. This proves the boundary statement in both directions.

For \(i\ge1\), the two possible destinations have rates \(\lambda_i\) and \(\mu_i\), so their sum is \(r_i\), and the diagonal entry is \(-r_i\). When \(r_i>0\), the usual competing-exponential-clock construction gives independent waiting times with rates \(\lambda_i\) and \(\mu_i\) for the two types of jump. The probability that neither clock rings by time \(t\) is \(e^{-\lambda_i t}e^{-\mu_i t}=e^{-r_i t}\), which is the survival probability of an exponential holding time with rate \(r_i\). The probability that the birth clock rings first is \(\int_0^\infty \lambda_i e^{-\lambda_i t}e^{-\mu_i t}\,dt=\lambda_i/r_i\); interchanging the two rates gives \(\mu_i/r_i\) for a death first. If \(r_i=0\), both rates are zero, so there is no outgoing jump. \(\square\)

This rule uses the actual outgoing transitions, not a label attached to the boundary. In particular, \(\lambda_0>0\) does not create a downward transition at zero; it only permits the upward transition. At a finite upper boundary, \(\lambda_N=0\) prevents upward jumps from \(N\), but it does not prevent a downward jump if \(\mu_N>0\).

Worked Example: Zero Is Absorbing, but the Upper Boundary Is Not

Consider \(S=\{0,1,2\}\), with rates \(\lambda_0=0\), \(\lambda_1=2\), \(\mu_1=3\), \(\lambda_2=0\), and \(\mu_2=1\). State \(0\) has no birth, and state \(2\) has no upward birth. Construct the generator and classify both boundaries.

At state \(0\), the only possible outgoing rate is \(\lambda_0=0\), so its entire row is zero. At state \(1\), the outgoing rates are \(3\) to state \(0\) and \(2\) to state \(2\), giving diagonal entry \(-(3+2)=-5\). At state \(2\), the only outgoing rate is \(\mu_2=1\) to state \(1\), giving diagonal entry \(-1\). Thus

$$ Q= \begin{bmatrix} 0&0&0\\ 3&-5&2\\ 0&1&-1 \end{bmatrix}. $$

Check: the row sums are \(0+0+0=0\), \(3-5+2=0\), and \(0+1-1=0\). State \(0\) is absorbing because its row has no outgoing rates. State \(2\) is an upper boundary with no upward births, but it is not absorbing: it leaves for state \(1\) at rate \(1\). Its holding time is exponential with rate \(1\), and its next jump is downward with probability \(1/1=1\).

Worked Example: Reflection at Zero with Immigration

Now use \(S=\{0,1,2\}\) with \(\lambda_0=4\), \(\lambda_1=2\), \(\mu_1=3\), \(\lambda_2=0\), and \(\mu_2=1\). The positive rate \(\lambda_0=4\) represents immigration when the population is zero. Find the generator, the holding rate at each state, and the next-jump probabilities.

At zero, the only outgoing rate is \(4\), so the diagonal entry is \(-4\). At state \(1\), the total exit rate is \(2+3=5\), so its diagonal is \(-5\). At state \(2\), the only outgoing rate is \(1\), so its diagonal is \(-1\). The generator is

$$ Q= \begin{bmatrix} -4&4&0\\ 3&-5&2\\ 0&1&-1 \end{bmatrix}. $$

Check: its row sums are \(-4+4+0=0\), \(3-5+2=0\), and \(0+1-1=0\). At state \(0\), the holding rate is \(4\); the only next jump is to \(1\), with probability \(4/4=1\). At state \(1\), the holding rate is \(5\), the downward-jump probability is \(3/5\), and the upward-jump probability is \(2/5\). These add to \(3/5+2/5=1\). At state \(2\), the holding rate is \(1\), and the next jump is to \(1\) with probability \(1/1=1\). Immigration changes the boundary row from the zero row in the preceding example to \((-4,4,0)\), so zero is no longer absorbing.

Immigration Rates and Finite Upper Boundaries

In a population model, immigration may be represented by a constant arrival rate \(\alpha>0\) that contributes to births at every population size. If per-individual births also occur at rate \(\beta\), a typical birth rate is \(\lambda_i=\alpha+\beta i\). At zero this gives \(\lambda_0=\alpha\), which is precisely the rate of leaving zero by immigration. This rate convention does not alter the set of possible jumps: from any state the only birth destination remains the next state, and the only death destination remains the previous state when it exists.

Worked Example: Immigration in a Capacity-Limited Model

Consider a population with capacity \(3\), so \(S=\{0,1,2,3\}\). Below capacity let \(\lambda_i=2+i\), corresponding to immigration rate \(2\) plus a birth contribution \(i\); set \(\lambda_3=0\) because the population cannot increase beyond capacity. Let \(\mu_i=3i\), including \(\mu_0=0\). Write and check the generator, then find the holding and jump probabilities at state \(2\).

The rates at states \(0,1,2,3\) are respectively: \((\lambda_0,\mu_0)=(2,0)\), \((\lambda_1,\mu_1)=(3,3)\), \((\lambda_2,\mu_2)=(4,6)\), and \((\lambda_3,\mu_3)=(0,9)\). Therefore the diagonal entries are \(-2\), \(-(3+3)=-6\), \(-(4+6)=-10\), and \(-9\). The generator is

$$ Q= \begin{bmatrix} -2&2&0&0\\ 3&-6&3&0\\ 0&6&-10&4\\ 0&0&9&-9 \end{bmatrix}. $$

Check: the row sums are \(-2+2+0+0=0\), \(3-6+3+0=0\), \(0+6-10+4=0\), and \(0+0+9-9=0\). At state \(2\), the total exit rate is \(4+6=10\), so the holding time has rate \(10\). The next-jump probabilities are upward \(4/10=2/5\) and downward \(6/10=3/5\), and \(2/5+3/5=1\). At the upper boundary \(3\), \(\lambda_3=0\) only removes the upward transition; the downward transition remains, since \(\mu_3=9\). Thus state \(3\) is not absorbing.

Common Boundary Errors

A common mistake is to set the birth rate at a finite upper boundary to zero and then call that state absorbing. For the first example, the incorrect argument would be: “\(\lambda_2=0\), so state \(2\) is absorbing.” But the displayed row is \((0,1,-1)\), whose off-diagonal entry \(q_{2,1}=1\) allows a jump away from \(2\). The correct conclusion is that state \(2\) has no upward births but can die to state \(1\). To make state \(2\) absorbing in that example, one must also set \(\mu_2=0\). Its row then becomes \((0,0,0)\).

Another error is to interpret reflection as a jump from zero to a negative state followed by an automatic return. That is not the birth–death generator on the nonnegative integers: the negative state is outside \(S\), so no such transition is listed. Reflection here means that the downward move is suppressed. Whether zero is absorbing then depends on the upward rate \(\lambda_0\): it is absorbing when that rate is zero and permits departure when that rate is positive.

These distinctions matter whenever a model is translated into a generator. Each off-diagonal entry must correspond to an allowed transition and a nonnegative rate; the diagonal is then fixed as minus the sum of those outgoing rates. Checking the row sums catches arithmetic errors, while checking each boundary row catches modeling errors that row sums alone cannot identify.

Check Your Understanding

For each question, distinguish the set of allowed transitions from the numerical rates assigned to them.

  1. On \(S=\{0,1,2\}\), suppose \(\lambda_2=0\) and \(\mu_2=5\). Is state \(2\) absorbing? Give its generator row.
  2. At zero, suppose \(\lambda_0=0\) and no downward transition is allowed. State the complete generator row and explain why zero is absorbing.
  3. At state \(1\), let \(\lambda_1=4\) and \(\mu_1=2\). Find the total exit rate and the probabilities of an upward and a downward next jump.
  4. For a capacity-limited chain with upper state \(N\), what rate must be zero to prevent a jump from \(N\) to \(N+1\)? Does that condition alone make \(N\) absorbing?
  5. Explain how a positive immigration rate changes the generator row at zero and why it does not create a downward transition.