Tutorials › Stochastic Calculus › Brownian Interval Problems with Boundary Values

The Feynman-Kac Formula · Tutorial 399 of 600

Brownian Interval Problems with Boundary Values

Learn how discounted Brownian exit rewards determine the unique boundary-value solution, and how to verify it directly from the associated ordinary differential equation.

Advanced 12 min read

What You'll Learn

  • Express endpoint rewards as a discounted expectation at Brownian exit.
  • Derive the boundary-value ODE from the stopped Ito process.
  • Solve the interval problem explicitly for zero and positive killing.
  • Prove uniqueness of the solution with fixed endpoint values.
  • Check how killing changes the linear interpolation formula.

From Boundary Rewards to an Interval Equation

Consider Brownian motion started at \(x\) inside a bounded interval. It eventually exits through one of the two endpoints. If a reward is paid at exit and discounted at a constant rate, its expected value depends on the starting point. The central question is to calculate that function and verify which boundary-value problem it solves.

Work on a filtered probability space \((\Omega,\mathcal{F},(\mathcal{F}_t)_{t\ge0},\mathbb{P})\) carrying a standard Brownian motion \(B_t\) relative to the filtration. Fix \(a<b\), let \(B_0=x\in[a,b]\) (equivalently, use Brownian motion started at zero and the process \(x+B_t\)), and define the first exit time \(\tau=\inf\{t\ge0:B_t\notin(a,b)\}\). For \(x\in(a,b)\), continuity of Brownian paths implies \(B_\tau\in\{a,b\}\) whenever \(\tau\) is finite. The rewards at the two endpoints are fixed real numbers \(A\) and \(C\). The constant killing rate \(\lambda\) will be assumed nonnegative.

Definition: The discounted boundary-reward function is \(u(x)=\mathbb{E}_x[e^{-\lambda\tau}g(B_\tau)]\) for \(x\in(a,b)\), where \(g(a)=A\), \(g(b)=C\), and \(\mathbb{E}_x\) denotes expectation for Brownian motion started at \(x\). For \(\lambda=0\), the factor \(e^{-\lambda\tau}\) is \(1\); for \(\lambda>0\), later exit times receive smaller weight.

This expectation is well defined: Brownian motion exits every bounded interval in finite time almost surely. For completeness, write \(L=b-a\) and choose time blocks of length \(L^2\). If the process is still inside the interval at the start of a block, an increment greater than \(L\) during that block forces it to exit by the block's end. The probability of such an increment is \(p=\mathbb{P}(N(0,L^2)>L)=\mathbb{P}(N(0,1)>1)>0\), independently of the past. Thus \(\mathbb{P}_x(\tau>(n+1)L^2)\le(1-p)\mathbb{P}_x(\tau>nL^2)\). Iterating gives \(\mathbb{P}_x(\tau>nL^2)\le(1-p)^n\), which tends to zero.

The Exit Representation and Its ODE

Theorem: Suppose \(v\in C^2((a,b))\cap C([a,b])\) is bounded on \([a,b]\) and satisfies \(\tfrac12v''(x)-\lambda v(x)=0\) for \(a<x<b\), with \(v(a)=A\) and \(v(b)=C\), where \(\lambda\ge0\). Then \(v(x)=\mathbb{E}_x[e^{-\lambda\tau}g(B_\tau)]\).

Proof. Fix \(x\in(a,b)\). For a finite time horizon \(T\), apply Ito's formula to \(f(t,y)=e^{-\lambda t}v(y)\) and the stopped process \(B_{t\wedge\tau}\). Its derivatives are \(f_t=-\lambda e^{-\lambda t}v(y)\), \(f_y=e^{-\lambda t}v'(y)\), and \(f_{yy}=e^{-\lambda t}v''(y)\). The Ito correction is \(\tfrac12 f_{yy}\,dt\), so the drift is \(e^{-\lambda t}(\tfrac12v''-\lambda v)\,dt=0\). In differential form, up to exit, \(d(e^{-\lambda t}v(B_t))=e^{-\lambda t}v'(B_t)\,dB_t\). More precisely, the stopped integral has integrand \(H_s=\mathbf{1}_{\{s<\tau\}}e^{-\lambda s}v'(B_s)\). For each finite \(T\), this integrand is progressively measurable and belongs to \(\mathcal{L}^2\), since \(v'\) is bounded on the compact interval after continuous extension (or, equivalently, first stop inside \((a,b)\) and pass to the boundary). In the latter formulation, one may stop at \(\tau_n=\inf\{t:B_t\notin(a+1/n,b-1/n)\}\) for sufficiently large \(n\); the stopped integrands are bounded, and continuity gives the boundary limit. The Ito integral is therefore a true martingale on each finite horizon, not merely a local martingale: its increments have conditional expectation zero by the defining \(L^2\) construction and the Ito isometry. Consequently \(\mathbb{E}_x[e^{-\lambda(T\wedge\tau)}v(B_{T\wedge\tau})]=v(x)\). As \(T\to\infty\), \(\tau<\infty\) almost surely, so the random variable inside the expectation converges to \(e^{-\lambda\tau}g(B_\tau)\). It is bounded in absolute value by \(\sup_{[a,b]}|v|\), because \(\lambda\ge0\). Dominated convergence proves the asserted representation. \(\square\)

The ODE is the one-dimensional generator equation with killing: Brownian motion has generator \(\tfrac12\,d^2/dx^2\), and discounting contributes the term \(-\lambda v\). The equation says that these two contributions balance in the interior. Its boundary values specify the rewards; they are not additional source terms.

Explicit Solution and Uniqueness

Theorem: For \(a<b\), endpoint values \(A,C\in\mathbb{R}\), and \(\lambda\ge0\), the boundary-value problem \(\tfrac12u''-\lambda u=0\) on \((a,b)\), \(u(a)=A\), \(u(b)=C\), has exactly one solution in \(C^2((a,b))\cap C([a,b])\). If \(\lambda=0\), then \(u(x)=A\dfrac{b-x}{b-a}+C\dfrac{x-a}{b-a}\). If \(\lambda>0\), put \(k=\sqrt{2\lambda}\). Then \(u(x)=A\dfrac{\sinh(k(b-x))}{\sinh(k(b-a))}+C\dfrac{\sinh(k(x-a))}{\sinh(k(b-a))}\).

Proof. When \(\lambda=0\), the equation is \(u''=0\), so \(u(x)=m x+n\). Solving \(ma+n=A\) and \(mb+n=C\) gives the displayed linear interpolation. When \(\lambda>0\), the equation is \(u''=k^2u\). Its general solution is \(c_1e^{kx}+c_2e^{-kx}\), or equivalently a linear combination of \(\sinh(kx)\) and \(\cosh(kx)\). The displayed formula satisfies the ODE because each hyperbolic-sine term has second derivative \(k^2\) times itself. At \(x=a\), its first coefficient is \(A\) and its second is zero; at \(x=b\), its first is zero and its second is \(C\). The denominators are nonzero since \(k(b-a)>0\) and \(\sinh\) is positive on positive arguments.

To prove uniqueness, let \(w\) be the difference of two solutions. Then \(w(a)=w(b)=0\) and \(w''=2\lambda w\). If \(\lambda=0\), \(w\) is linear and its two zero endpoint values force \(w=0\). If \(\lambda>0\), a positive value of \(w\) would imply a positive interior maximum, where \(w''\le0\); but at that maximum \(w''=2\lambda w>0\), a contradiction. A negative value would imply a negative interior minimum, where \(w''\ge0\), contradicting \(w''=2\lambda w<0\). Thus \(w=0\) throughout. This proves existence and uniqueness. Applying the exit-representation theorem to this solution identifies it with the discounted boundary-reward expectation. \(\square\)

When \(\lambda\) decreases to zero, the hyperbolic formula tends to the linear one: \(\sinh(z)/z\to1\) as \(z\to0\). Thus the zero-killing case is also the continuous limit of the discounted problem.

Worked Example: Zero Killing and Exit Probabilities

Brownian motion starts at \(x=1\) in \((0,4)\). The reward is \(2\) at \(0\) and \(6\) at \(4\), with \(\lambda=0\). Compute the expected exit reward.

Here \(a=0\), \(b=4\), \(A=2\), \(C=6\), and \(x=1\). The zero-killing formula gives \(u(1)=2\dfrac{4-1}{4-0}+6\dfrac{1-0}{4-0}=2\cdot\dfrac34+6\cdot\dfrac14=\dfrac32+\dfrac32=3\). For zero killing, the coefficients are the exit-side probabilities: the probability of exiting at \(4\) is \(x/(b-a)=1/4\), and the probability of exiting at \(0\) is \(3/4\).

Check: the probabilities sum to \(3/4+1/4=1\), and the reward expectation recomputes as \(2(3/4)+6(1/4)=3\). The result lies between the two endpoint rewards, as any average of them must.

Worked Example: Symmetric Interval with Positive Killing

Brownian motion starts at \(0\) in \((-1,1)\), receives reward \(1\) at either endpoint, and has killing rate \(\lambda=\tfrac12\). Find its discounted expected exit reward.

Here \(k=\sqrt{2\lambda}=\sqrt{1}=1\), \(a=-1\), \(b=1\), \(A=C=1\), and \(x=0\). The formula gives \(u(0)=\dfrac{\sinh(1)}{\sinh(2)}+\dfrac{\sinh(1)}{\sinh(2)} =\dfrac{2\sinh(1)}{\sinh(2)}\). Using \(\sinh(2)=2\sinh(1)\cosh(1)\), this simplifies to \(u(0)=1/\cosh(1)\).

Check: the candidate is \(u(x)=\cosh(x)/\cosh(1)\). Its derivatives are \(u'(x)=\sinh(x)/\cosh(1)\) and \(u''(x)=\cosh(x)/\cosh(1)=u(x)\). Therefore \(\tfrac12u''-\tfrac12u=0\), and \(u(-1)=u(1)=1\). Since \(\cosh(1)>1\), the starting value \(1/\cosh(1)\) is strictly between zero and one, as required for a positive discount factor applied to a unit reward.

Worked Example: Unequal Boundary Rewards

Brownian motion starts at \(x=\tfrac12\) in \((0,2)\). The reward is \(0\) at \(0\), \(1\) at \(2\), and the killing rate is \(\lambda=2\). Find the discounted reward.

Now \(k=\sqrt{2\lambda}=\sqrt4=2\), \(a=0\), \(b=2\), \(A=0\), and \(C=1\). Substitution into the positive-killing formula yields \(u(\tfrac12)=0\cdot\dfrac{\sinh(2(2-\tfrac12))}{\sinh(2\cdot2)}+1\cdot\dfrac{\sinh(2(\tfrac12-0))}{\sinh(2\cdot2)}=\dfrac{\sinh(1)}{\sinh(4)}\).

Check: the full candidate is \(u(x)=\sinh(2x)/\sinh(4)\). Its derivatives are \(u'(x)=2\cosh(2x)/\sinh(4)\) and \(u''(x)=4\sinh(2x)/\sinh(4)=4u(x)\). Hence \(\tfrac12u''-2u=2u-2u=0\); also \(u(0)=0\) and \(u(2)=\sinh(4)/\sinh(4)=1\). Since \(0<1<4\) and \(\sinh\) is strictly increasing on positive arguments, \(0<\sinh(1)/\sinh(4)<1\), consistent with a discounted unit reward.

Why the Discount Changes the Interpolation

With no killing, the expected reward is the linear interpolation of the endpoint values, because it is determined by the probabilities of exiting on each side. Positive killing weights exit rewards by the additional factor \(e^{-\lambda\tau}\). Since this factor is at most one and decreases with exit time, the discounted expectation is generally smaller than the undiscounted expected reward when the boundary rewards are nonnegative. The ODE records this change through the term \(-\lambda u\), and the hyperbolic functions replace the linear weights.

A common mistake is to keep using linear interpolation when \(\lambda>0\). In the symmetric example, that would give \(u(0)=1\) for unit endpoint rewards. But a constant candidate \(u(x)=1\) has \(u''=0\), so its ODE residual is \(\tfrac12u''-\tfrac12u=-\tfrac12\), not zero. The correct value is \(1/\cosh(1)<1\). The missing term is the killing contribution, not a change in the Brownian exit probabilities alone.

The interval setting makes the boundary representation particularly direct: exit occurs at one of two known points, the reward is bounded, and the ODE has an explicit solution. These calculations provide a useful test of the general principle that stopped, discounted diffusion expectations solve boundary-value equations. The argument relies on the bounded domain and nonnegative killing used here; other domains or additional drift and running costs require their own hypotheses and analysis.

Check Your Understanding

For each question, assume Brownian motion starts inside the stated bounded interval and that the exit time is the first time it reaches either endpoint.

  1. For zero killing on \((a,b)\), why are the coefficients of the endpoint rewards \((b-x)/(b-a)\) and \((x-a)/(b-a)\)?
  2. Write the ODE and boundary conditions for endpoint rewards \(A,C\) and a constant killing rate \(\lambda>0\).
  3. For \((-1,1)\), equal unit endpoint rewards, and \(\lambda=\tfrac12\), verify the value at \(x=0\) directly from the hyperbolic formula.
  4. In the stopped Ito argument, which term supplies the \(\tfrac12v''\) contribution, and why is the stochastic integral a true martingale on a finite time horizon?
  5. Why does the linear interpolation candidate fail for positive killing, even though it has the correct endpoint values?