Tutorials › Stochastic Calculus › Exit Probabilities and Mean Exit Times on Bounded Intervals

Explosion, Comparison Theorems and Boundary Classification · Tutorial 287 of 600

Exit Probabilities and Mean Exit Times on Bounded Intervals

Use scale and speed to compute endpoint hitting probabilities and mean exit times, and verify the formulas for Brownian motion with drift.

Advanced 10 min read

What You'll Learn

  • Define the first exit time from a bounded interval and state assumptions ensuring the formulas apply.
  • Derive the upper-endpoint exit probability from the scale function.
  • Construct the Green kernel and speed density for the expected exit time.
  • Prove that the Green-kernel integral is finite and equals the mean exit time.
  • Compute exit probabilities and mean exit times for Brownian motion with drift.
  • Check drifted Brownian-motion calculations by verifying the associated boundary-value equation.

Exit from a Bounded Interval

Consider a one-dimensional diffusion started inside a finite interval. Two basic questions are: which endpoint will it reach first, and how long will it take to reach either endpoint? Scale measures the relative tendency of the diffusion to move toward the endpoints; the speed density weights positions according to how long the diffusion spends there. Together they give explicit formulas for both quantities.

Work on a filtered probability space \((\Omega,\mathcal{F},(\mathcal{F}_t)_{t\ge0},\mathbb{P})\) carrying a standard Brownian motion \(B_t\). On an open interval containing \([a,b]\), where \(a<b\), suppose \(X_t\) is a continuous solution of \(dX_t=\mu(X_t)\,dt+\sigma(X_t)\,dB_t\), with \(X_0=x\in(a,b)\). Assume that \(\mu\) and \(\sigma\) are continuous, that \(\sigma\) is continuously differentiable, and that \(\sigma(y)\ne0\) for \(y\in[a,b]\). Assume also that the solution exists up to its first exit from \([a,b]\). These conditions ensure that the coefficients are bounded on the interval and that the scale and speed densities below are well-defined. Define the exit time \(\tau=\inf\{t\ge0:X_t\notin(a,b)\}\).

The generator acting on twice continuously differentiable functions is \(\mathcal{L}f(y)=\mu(y)f'(y)+\tfrac12\sigma^2(y)f''(y)\). The scale density and a corresponding scale function are \(s'(y)=\exp\!\left(-\int_{y_0}^{y}\frac{2\mu(z)}{\sigma^2(z)}\,dz\right)\) and \(s(y)=\int_{y_0}^{y}s'(z)\,dz\), where \(y_0\) is any fixed reference point. Changing the reference point or multiplying the scale function by a positive constant does not alter the formulas. The speed density in this convention is \(m'(y)=2/(\sigma^2(y)s'(y))\).

Definition: The Green kernel for exit from \((a,b)\), with respect to the speed density \(m'(y)\,dy\), is \(G(x,y)=\dfrac{(s(x\wedge y)-s(a))(s(b)-s(x\vee y))}{s(b)-s(a)}\), for \(x,y\in[a,b]\). The minimum and maximum in this expression select the appropriate branch on either side of \(x=y\).

Exit Probabilities from Scale

Theorem: Under the assumptions above, \(\tau\) is finite almost surely, and \(\mathbb{P}_x(X_\tau=b)=\dfrac{s(x)-s(a)}{s(b)-s(a)}\), while \(\mathbb{P}_x(X_\tau=a)=\dfrac{s(b)-s(x)}{s(b)-s(a)}\). Here \(\mathbb{P}_x\) denotes probability for the solution started at \(x\).

Proof. The finiteness of \(\tau\) will follow from the mean-exit-time argument below, which proves \(\mathbb{E}_x[\tau]<\infty\). Define \(v(y)=(s(y)-s(a))/(s(b)-s(a))\). Differentiating the scale density gives \(s''(y)=-(2\mu(y)/\sigma^2(y))s'(y)\); hence \(\mathcal{L}s(y)=\mu(y)s'(y)+\tfrac12\sigma^2(y)s''(y)=0\), and therefore \(\mathcal{L}v=0\). The derivatives of \(v\) are bounded on \([a,b]\). For each finite \(t\), Itô’s formula applied to \(v(X_{t\wedge\tau})\) gives \(v(X_{t\wedge\tau})=v(x)+\int_0^{t\wedge\tau}v'(X_r)\sigma(X_r)\,dB_r\). This is an Ito integral with progressively measurable integrand \(H_r=\mathbf{1}_{\{r\le\tau\}}v'(X_r)\sigma(X_r)\). It belongs to \(\mathcal{L}^2\) on \([0,t]\), since \(v'\) and \(\sigma\) are bounded there and \(\mathbb{E}\int_0^t H_r^2\,dr\le t\sup_{[a,b]}|v'\sigma|^2<\infty\). The Ito integral is consequently a martingale with mean zero, so \(\mathbb{E}_x[v(X_{t\wedge\tau})]=v(x)\). Since \(\tau<\infty\) almost surely, continuity gives \(X_{t\wedge\tau}\to X_\tau\) almost surely. The function \(v\) is bounded, so bounded convergence yields \(\mathbb{E}_x[v(X_\tau)]=v(x)\). At exit the continuous path is at \(a\) or \(b\), and \(v(a)=0,\ v(b)=1\). Thus \(v(X_\tau)=\mathbf{1}_{\{X_\tau=b\}}\), proving the upper-endpoint formula. The lower-endpoint formula follows because the two endpoint events are disjoint and exhaust the possibilities. \(\square\)

Mean Exit Time and the Green Kernel

Theorem: Under the same assumptions, \(\mathbb{E}_x[\tau]=\int_a^b G(x,y)m'(y)\,dy\).

Proof. Fix \(x\in(a,b)\) and define \(u(x)=\int_a^b G(x,y)m'(y)\,dy\). The integrand is nonnegative, and the coefficients, scale density and speed density are bounded on \([a,b]\); hence this integral is finite. We verify its differential equation. For fixed \(y\), as a function of its first argument \(z\), \(G(z,y)\) is a constant multiple of \(s(z)\) on each of \(z<y\) and \(z>y\). Thus \(\mathcal{L}_zG(z,y)=0\) away from \(z=y\). Its derivative with respect to \(z\) has jump \[ \partial_zG(y+,y)-\partial_zG(y-,y) =-\frac{s'(y)(s(y)-s(a))+(s(b)-s(y))s'(y)}{s(b)-s(a)} =-s'(y). \] Consequently, differentiating the integral on its two branches gives the second-derivative contribution \(-s'(x)m'(x)=-2/\sigma^2(x)\) at the join. The remaining terms are annihilated by \(\mathcal{L}\), because each branch is proportional to \(s\). Therefore \(\mathcal{L}u(x)=\tfrac12\sigma^2(x)(-2/\sigma^2(x))=-1\). Also \(u(a)=u(b)=0\), since the kernel vanishes at either endpoint, and \(u\ge0\), since \(G\ge0\) and \(m'\gt0\).

Apply Ito’s formula to \(u(X_{t\wedge\tau})\). The resulting Ito integral has integrand \(H_r=\mathbf{1}_{\{r\le\tau\}}u'(X_r)\sigma(X_r)\), which is progressively measurable and satisfies \(\mathbb{E}\int_0^t H_r^2\,dr<\infty\) because \(u'\) and \(\sigma\) are bounded on the compact interval. Its expectation is zero. Thus \(\mathbb{E}_x[u(X_{t\wedge\tau})]=u(x)-\mathbb{E}_x[t\wedge\tau]\). Since \(u\ge0\), \(\mathbb{E}_x[t\wedge\tau]\le u(x)\) for every \(t\). Monotone convergence gives \(\mathbb{E}_x[\tau]\le u(x)<\infty\), so \(\tau\) is finite almost surely. Now \(u(X_{t\wedge\tau})\to u(X_\tau)=0\) almost surely; bounded convergence applies because \(u\) is bounded on \([a,b]\). Taking \(t\to\infty\) in the identity gives \(\mathbb{E}_x[\tau]=u(x)\), as claimed. \(\square\)

This proof also justifies the finiteness needed for the exit-probability theorem. The Green kernel is piecewise linear in scale, not generally linear in the spatial coordinate. Its denominator \(s(b)-s(a)\) is essential: it normalizes the two branches so that their slopes have the derivative jump required by \(\mathcal{L}u=-1\).

Worked Calculations for Brownian Motion with Drift

Worked Example: Standard Brownian Motion on an Asymmetric Interval

Let \(dX_t=dB_t\), with \(X_0=0\), and take \((a,b)=(-1,2)\). Compute the probability of exiting at \(2\) and the mean exit time.

Here \(\mu=0,\ \sigma=1\), so we may take \(s(y)=y\) and \(m'(y)=2\). The upper-exit probability is \((0-(-1))/(2-(-1))=1/3\); the lower-exit probability is \(2/3\).

For \(y\le0\), the Green kernel is \(G(0,y)=((y+1)(2-0))/3=2(y+1)/3\). For \(y\ge0\), it is \(G(0,y)=((0+1)(2-y))/3=(2-y)/3\). Therefore the mean exit time is \[ \int_{-1}^{0}\frac{2(y+1)}{3}\cdot2\,dy +\int_{0}^{2}\frac{2-y}{3}\cdot2\,dy =\frac{4}{3}\cdot\frac12+\frac{2}{3}\cdot2 =\frac23+\frac43=2. \] Check: the function \(u(y)=(y+1)(2-y)\) vanishes at \(-1\) and \(2\), has \(u(0)=2\), and satisfies \(\tfrac12u''=-1\), since \(u''=-2\). This independently verifies the computed mean.

Worked Example: The Green Kernel for Positive Drift

Let \(dX_t=\tfrac12\,dt+dB_t\), start at \(x=\ln2\), and exit from \((0,\ln4)\). Compute the probability of exiting at the upper endpoint and the mean exit time.

The scale density is \(s'(y)=e^{-y}\), so choose \(s(y)=1-e^{-y}\). Then \(s(0)=0,\ s(\ln2)=1/2,\ s(\ln4)=3/4\), and \(m'(y)=2e^y\). The upper-exit probability is \((1/2)/(3/4)=2/3\); the lower-exit probability is \(1/3\).

For \(0\le y\le\ln2\), the kernel is \(G(\ln2,y)=(s(y)-s(0))(s(\ln4)-s(\ln2))/(s(\ln4)-s(0)) =\tfrac13(1-e^{-y})\). For \(\ln2\le y\le\ln4\), it is \(G(\ln2,y)=(s(\ln2)-s(0))(s(\ln4)-s(y))/(s(\ln4)-s(0)) =\tfrac23(e^{-y}-\tfrac14)\). Multiplying each branch by the speed density gives \[ \begin{aligned} \mathbb{E}_{\ln2}[\tau] &=\frac23\int_0^{\ln2}(e^y-1)\,dy +\frac43\int_{\ln2}^{\ln4}(1-\tfrac14e^y)\,dy\\ &=\frac23(1-\ln2)+\frac43(\ln2-\tfrac12) =\frac23\ln2. \end{aligned} \] Check: the first integral is \(\frac23[(e^y-y)]_0^{\ln2}=\frac23(1-\ln2)\). The second is \(\frac43[y-\frac14e^y]_{\ln2}^{\ln4}=\frac43(\ln2-\frac12)\). Adding them cancels the constant terms and gives \(\frac23\ln2\), approximately \(0.4621\). In particular, the first branch includes the factor \(1/3\) from the Green-kernel denominator; omitting it would give an incorrect mean.

Worked Example: Unit Drift on a Symmetric Interval

Let \(dX_t=dt+dB_t\), start at \(x=1\), and exit from \((0,2)\). Find the upper-exit probability and the mean exit time.

Use \(s(y)=1-e^{-2y}\), which follows by integrating \(s'(y)=e^{-2y}\) and multiplying the scale function by a positive constant. The probability of exiting at \(2\) is \[ \frac{1-e^{-2}}{1-e^{-4}}=\frac{1}{1+e^{-2}}, \] where the equality follows from \(1-e^{-4}=(1-e^{-2})(1+e^{-2})\). The lower-exit probability is \(e^{-2}/(1+e^{-2})\).

To verify the mean, solve \(\tfrac12u''+u'=-1\) with \(u(0)=u(2)=0\). The function \(u(y)=2(1-e^{-2y})/(1-e^{-4})-y\) has those boundary values. Its derivatives are \(u'(y)=4e^{-2y}/(1-e^{-4})-1\) and \(u''(y)=-8e^{-2y}/(1-e^{-4})\), so \(\tfrac12u''(y)+u'(y)=-4e^{-2y}/(1-e^{-4})+4e^{-2y}/(1-e^{-4})-1=-1\). Thus the proved mean-exit-time formula identifies \(u(1)\) as the mean, giving \[ \mathbb{E}_1[\tau]=\frac{2(1-e^{-2})}{1-e^{-4}}-1 =\frac{2}{1+e^{-2}}-1 =\frac{1-e^{-2}}{1+e^{-2}}. \] Check: \(u(0)=0\), and \(u(2)=2(1-e^{-4})/(1-e^{-4})-2=0\). The differential equation check above confirms the interior equation, so the boundary-value calculation agrees with the Green-kernel result.

Common Pitfall: Dropping the Scale Denominator

On the interval in the second example, for \(y\le x=\ln2\), using only \(s(y)-s(0)=1-e^{-y}\) as the kernel is wrong. The branch must also include \((s(\ln4)-s(\ln2))/(s(\ln4)-s(0))=(1/4)/(3/4)=1/3\). The correct branch is therefore \(\tfrac13(1-e^{-y})\), not \(1-e^{-y}\). After multiplying by \(m'(y)=2e^y\), its contribution to the mean is \(\tfrac23(1-\ln2)\). The other branch contributes \(\tfrac43(\ln2-\tfrac12)\); their sum is \(\tfrac23\ln2\). Keeping the kernel normalization and recomputing each integral prevents both a branch error and a later arithmetic error.

The formulas rely on the diffusion staying within a bounded interval until it hits an endpoint, with a nonzero diffusion coefficient throughout that interval. The bounded-interval argument establishes finite mean exit time under the stated assumptions; questions about reaching or escaping an unbounded boundary require additional analysis.

Check Your Understanding

Use the scale and Green-kernel formulas, stating which branch of the kernel applies in each integral.

  1. For standard Brownian motion started at \(1\) in \((0,3)\), what are the two endpoint exit probabilities?
  2. For standard Brownian motion started at \(1\) in \((0,3)\), compute the mean exit time from the two Green-kernel branches.
  3. For \(dX_t=\mu\,dt+\sigma\,dB_t\) with constant \(\mu\ne0\) and \(\sigma\ne0\), write a scale function and the upper-exit probability from \((a,b)\).
  4. Explain why the Green-kernel denominator \(s(b)-s(a)\) cannot be omitted when computing a mean exit time.
  5. For the unit-drift example on \((0,2)\), verify the lower-exit probability by subtracting the upper-exit probability from \(1\).