Tutorials › Stochastic Processes › Lazy Walks and Recurrence Classification

Random Walks in Higher Dimensions · Tutorial 335 of 994

Lazy Walks and Recurrence Classification

Learn how to relate a lazy walk to its embedded simple walk and use that relation to classify recurrence in each lattice dimension.

Advanced 11 min read

What You'll Learn

  • Define a lazy simple symmetric walk on the integer lattice and verify its transition probabilities.
  • Express the lazy walk’s return probability at time n as a binomial mixture of simple-walk return probabilities.
  • Derive the exact scaling relation between the two Green functions.
  • Prove that the lazy and simple walks have the same recurrence or transience classification.
  • Determine how holding changes the first-return probability and the period.
  • Apply the results in one, two, and three or more dimensions.

Holding Changes the Clock, Not the Classification

A simple symmetric walk on a lattice moves at every step. A lazy version sometimes stays where it is and otherwise takes an ordinary simple symmetric step. The holding creates extra returns at short times and changes how many time steps elapse between moves. To decide whether the walk is recurrent or transient, however, it is useful to look at the sequence of actual moves: after the holding steps are removed, that sequence is just the original simple symmetric walk.

Let \(d\ge1\), let \(S=\mathbb{Z}^d\), and fix a holding probability \(a\) with \(0<a<1\). Write \(b=1-a\) for the probability of moving. On a probability space \((\Omega,\mathcal{F},\mathbb{P})\), let \((Y_m)_{m\ge0}\) be a simple symmetric walk on \(\mathbb{Z}^d\), started at \(0\), and let \((B_n)_{n\ge1}\) be independent Bernoulli random variables, independent of \(Y\), with \(\mathbb{P}(B_n=1)=b\). Set \(K_0=0\), \(K_n=\sum_{\ell=1}^n B_\ell\), and \(X_n=Y_{K_n}\). Thus \(X_n\) is a discrete-time Markov chain on \(S\), with transition matrix \(P=(p_{ij})\). From each \(i\), it stays at \(i\) with probability \(a\) and moves to each of its \(2d\) lattice neighbors with probability \(b/(2d)\). Every row sums to \(a+2d\cdot b/(2d)=a+b=1\).

Definition: A state \(i\) is recurrent if \(\mathbb{P}_i(T_i^+<\infty)=1\), where \(T_i^+=\inf\{n\ge1:X_n=i\}\); it is transient if this probability is less than \(1\). For a walk started at \(0\), write \(u_m=\mathbb{P}(Y_m=0)\) for the simple-walk return probability at time \(m\), and \(q_n=\mathbb{P}(X_n=0)\) for the lazy-walk return probability at time \(n\). Their Green functions at \(0\) are \(G_{\mathrm{s}}=\sum_{m=0}^{\infty}u_m\) and \(G_{\mathrm{l}}=\sum_{n=0}^{\infty}q_n\), respectively; either sum may be infinite.

Return Probabilities and Green Functions

By time \(n\), the lazy walk has made \(m\) actual moves with probability \(\binom{n}{m}b^m a^{n-m}\). Conditional on that number of moves, its location has the distribution of \(Y_m\). The possible values of \(m\) are disjoint, so for every \(n\ge0\),

$$ q_n=\sum_{m=0}^n \binom{n}{m}a^{n-m}b^m u_m. $$

This formula also covers \(m=0\): if the walk makes no moves in \(n\) steps, it is still at its starting point. Summing over all times gives a particularly simple relation.

Theorem: For \(0<a<1\) and \(b=1-a\), the Green functions satisfy \(G_{\mathrm{l}}=G_{\mathrm{s}}/b\), with the convention that a positive finite multiple of \(+\infty\) is \(+\infty\). Consequently, the lazy and simple symmetric walks have the same recurrence or transience classification.

Proof. All terms in the formula for \(q_n\) are nonnegative. Therefore the two sums can be rearranged, including when their value is infinite. Group the terms contributing to a fixed \(u_m\):

$$ G_{\mathrm{l}} =\sum_{n=0}^{\infty}\sum_{m=0}^n\binom{n}{m}a^{n-m}b^m u_m =\sum_{m=0}^{\infty}u_m b^m\sum_{n=m}^{\infty}\binom{n}{m}a^{n-m}. $$

For fixed \(m\), put \(r=n-m\). The inner sum is \(\sum_{r=0}^{\infty}\binom{r+m}{m}a^r=(1-a)^{-m-1}=b^{-m-1}\), by the power-series identity for \((1-a)^{-m-1}\), valid because \(0<a<1\). Hence \(b^m\) times that sum is \(1/b\), and \(G_{\mathrm{l}}=(1/b)\sum_{m=0}^{\infty}u_m=G_{\mathrm{s}}/b\).

To connect this calculation to recurrence, let \(f=\mathbb{P}_0(T_0^+<\infty)\) for either walk, and let \(v_n\) be its return probability at time \(n\), with \(v_0=1\). The number of visits to \(0\), including the visit at time \(0\), has expectation \(\sum_{n\ge0}v_n\): write that number as \(\sum_{n\ge0}\mathbf{1}_{\{X_n=0\}}\) and use monotone convergence. By the Markov property at successive returns, the probability of at least \(k\) returns after time \(0\) is \(f^k\) for every integer \(k\ge0\). Thus the expected number of visits is \(\sum_{k\ge0}f^k\): it is \(1/(1-f)\) if \(f<1\), and infinite if \(f=1\). In particular, the Green function is infinite exactly when the state is recurrent. Since \(G_{\mathrm{l}}=G_{\mathrm{s}}/b\) with \(0<b<1\), one is infinite exactly when the other is. This proves the classification claim. \(\square\)

For these walks, the standard lattice classification established in the earlier material on Green functions and Pólya’s theorem is that the simple symmetric walk is recurrent in dimensions \(1\) and \(2\), and transient in dimensions \(d\ge3\). The theorem therefore gives the same classification for every \(0<a<1\): the lazy walk is recurrent in dimensions \(1\) and \(2\), and transient in dimensions \(d\ge3\). The dimension-dependent conclusion comes from the simple walk’s Green function; the effect of laziness is the exact factor \(1/b\).

Worked Example: Short-Time Returns on the Integer Line

Take \(d=1\) and \(a=b=\tfrac12\), with the walk started at \(0\). From each integer it stays with probability \(\tfrac12\) and moves to each of its two neighbors with probability \(\tfrac14\). Each row sums to \(\tfrac12+\tfrac14+\tfrac14=1\).

At time \(1\), the walk returns to \(0\) exactly when it holds, so \(q_1=\tfrac12\). At time \(2\), it returns either by holding twice or by moving twice and taking opposite steps. The respective probabilities are \((\tfrac12)^2=\tfrac14\) and \((\tfrac12)^2\cdot\tfrac12=\tfrac18\), since a two-step simple walk on the line returns with probability \(\tfrac12\). Thus \(q_2=\tfrac14+\tfrac18=\tfrac38\).

At time \(3\), the walk returns if it makes zero moves, or if it makes two moves that cancel and holds once. The first event has probability \((\tfrac12)^3=\tfrac18\). There are \(\binom{3}{2}=3\) choices for which two times contain moves; for each choice, the probability of that move/hold pattern is \((\tfrac12)^2(\tfrac12)=\tfrac18\), and the two moves cancel with probability \(\tfrac12\). Therefore \(q_3=\tfrac18+3\cdot\tfrac18\cdot\tfrac12=\tfrac{5}{16}\).

Check: The mixture formula gives \(q_2=\binom20a^2u_0+\binom22b^2u_2=\tfrac14+\tfrac14\cdot\tfrac12=\tfrac38\), as computed directly. In contrast, the non-lazy walk has zero return probability at times \(1\) and \(3\). Holding changes the individual return probabilities, while the Green-function theorem shows it does not change recurrence.

Worked Example: Recurrence in Two Dimensions with Holding

Take \(d=2\), \(a=\tfrac13\), and \(b=\tfrac23\). From each lattice point, the chain holds with probability \(\tfrac13\) and moves to each of its four neighbors with probability \(b/4=(\tfrac23)/4=\tfrac16\). Each row sums to \(\tfrac13+4\cdot\tfrac16=1\).

The one-step return probability is \(q_1=\tfrac13\). For two steps, the walk either holds twice, with probability \((\tfrac13)^2=\tfrac19\), or moves twice and reverses direction. The probability that two simple symmetric steps return is \(\tfrac14\), one reversing choice among four possible second steps after the first move. The latter contribution is \((\tfrac23)^2\cdot\tfrac14=\tfrac19\). Consequently \(q_2=\tfrac19+\tfrac19=\tfrac29\).

The simple symmetric walk in two dimensions has infinite Green function, by the earlier result on the logarithmic Green-function divergence in two dimensions. Here \(G_{\mathrm{l}}=G_{\mathrm{s}}/(\tfrac23)=\tfrac32G_{\mathrm{s}}=\infty\), so the lazy walk is recurrent. This conclusion does not depend on the short-time values alone; it follows from the full Green-function relation.

Check: Substituting the computed two-step simple return probability into the mixture gives \(q_2=a^2+b^2u_2=\tfrac19+(\tfrac23)^2\cdot\tfrac14=\tfrac19+\tfrac19=\tfrac29\), agreeing with the direct calculation.

Worked Example: Green-Function Scaling in Three Dimensions

Take \(d=3\), \(a=\tfrac14\), and \(b=\tfrac34\). From each point the chain holds with probability \(\tfrac14\) and moves to each of its six neighbors with probability \(b/6=(\tfrac34)/6=\tfrac18\). The row sum is \(\tfrac14+6\cdot\tfrac18=1\).

The simple symmetric walk in three dimensions has a finite Green function \(G_{\mathrm{s}}\), by the earlier Green-function integrability result for dimensions three and above. The lazy walk’s Green function is therefore \(G_{\mathrm{l}}=G_{\mathrm{s}}/(\tfrac34)=\tfrac43G_{\mathrm{s}}\), which is still finite. Hence the lazy walk is transient. The factor \(\tfrac43\) describes the increase in expected total visits, including the visit at time \(0\); it does not turn a finite expectation into an infinite one.

One can also express the eventual return probability in terms of the simple walk’s return probability \(f_{\mathrm{s}}\). The Green-function identity and the first-return formula give \(G_{\mathrm{s}}=1/(1-f_{\mathrm{s}})\) and \(G_{\mathrm{l}}=1/(1-f_{\mathrm{l}})\), where \(f_{\mathrm{l}}\) is the lazy walk’s eventual return probability. Thus \(1-f_{\mathrm{l}}=b(1-f_{\mathrm{s}})\), or \(f_{\mathrm{l}}=a+bf_{\mathrm{s}}\). In this example, \(f_{\mathrm{l}}=\tfrac14+\tfrac34 f_{\mathrm{s}}\).

Check: Since \(G_{\mathrm{s}}=1/(1-f_{\mathrm{s}})\), the expression \(\tfrac43G_{\mathrm{s}}\) equals \(1/[\tfrac34(1-f_{\mathrm{s}})]\). The formula \(f_{\mathrm{l}}=\tfrac14+\tfrac34f_{\mathrm{s}}\) gives \(1-f_{\mathrm{l}}=\tfrac34(1-f_{\mathrm{s}})\), so \(1/(1-f_{\mathrm{l}})=\tfrac43G_{\mathrm{s}}\), consistent with the Green-function scaling.

Period and a Common Pitfall

Holding also changes the period. For a state \(i\), its period is the greatest common divisor of the positive integers \(n\) for which \(p_{ii}^{(n)}>0\). In the non-lazy simple symmetric lattice walk, every return takes an even number of steps, so its period is \(2\). In the lazy walk, \(p_{ii}=a>0\), so a return in one step is possible and the period is \(1\). This change in period is not a change in recurrence: period concerns which times can have positive return probability, while recurrence concerns whether a return eventually occurs with probability \(1\).

Common mistake. A tempting but incorrect calculation is to say that a lazy walk has the same return probabilities as the simple walk because deleting holds leaves a simple walk. Deleting holds preserves the sequence of visited positions, but it changes the time index. For example, in one dimension with \(a=\tfrac12\), the simple walk has \(u_1=0\), whereas the lazy walk has \(q_1=\tfrac12\). The correct calculation conditions on the number \(m\) of moves by time \(n\), giving \(q_n=\sum_{m=0}^n\binom{n}{m}a^{n-m}b^m u_m\). Summing that formula over all \(n\) yields the factor \(1/b\), not equality of the return probabilities.

The condition \(0<a<1\) matters. If \(a=1\), the walk never moves and its transition matrix is not an irreducible lattice-walk kernel; if \(a=0\), there is no holding and the relation \(G_{\mathrm{l}}=G_{\mathrm{s}}/b\) reduces to the identity. For positive holding probability and positive move probability, laziness lengthens the clock and permits returns at additional times, but it leaves the embedded sequence of lattice moves unchanged. The exact Green-function identity makes that distinction precise.

Check Your Understanding

Use the mixture formula and Green-function relation to answer the following. When checking a return event, distinguish a return at time \(n\) from an eventual return.

  1. For \(d=1\) and \(a=\tfrac13\), verify that each transition row sums to \(1\), then compute \(q_1\) and \(q_2\).
  2. For a lazy walk with holding probability \(a\), write the formula for \(q_n\) in terms of \(u_m\). What does \(m\) count?
  3. If the simple walk’s Green function is finite, what is the lazy walk’s Green function, and what does this imply about recurrence?
  4. Explain why a positive holding probability makes the lazy walk have period \(1\), even when the simple walk has period \(2\).
  5. In which dimensions is the lazy simple symmetric walk recurrent, and in which dimensions is it transient, when \(0<a<1\)?