Tutorials › Stochastic Calculus › Exit-Time Boundary Problems via Feynman-Kac

Cumulative Problem Sets and Mixed Proofs · Tutorial 581 of 600

Exit-Time Boundary Problems via Feynman-Kac

Learn to turn an exit-payoff expectation into a boundary-value problem and verify a candidate solution using the diffusion generator.

Advanced 11 min read

What You'll Learn

  • Formulate the exit-time payoff and its discount factor
  • Derive the boundary equation from the diffusion generator
  • Prove a verification result for bounded intervals
  • Solve boundary problems for three explicit diffusions
  • Check solutions and identify the error caused by omitting Ito’s correction

From an Exit Payoff to a Boundary Equation

Let a diffusion move inside a bounded interval until it first reaches an endpoint. Its payoff is then determined by the endpoint it reaches, possibly discounted according to the time spent inside. The corresponding boundary-value problem translates that expectation into an ordinary differential equation: the drift and diffusion coefficients enter through the generator, while the endpoint payoffs become boundary conditions.

Work on a filtered probability space \((\Omega,\mathcal{F},(\mathcal{F}_t)_{t\ge0},\mathbb{P})\) carrying a Brownian motion \(B_t\). Consider a strong solution of \(dX_t=\mu(X_t)\,dt+\sigma(X_t)\,dB_t\), starting at \(X_0=x\in(a,b)\), and define the exit time \(\tau=\inf\{t\ge0:X_t\notin(a,b)\}\). A strong solution is constructed on the given probability space using its Brownian motion; a weak solution may instead use a probability space chosen as part of the construction. Assume here that the strong solution has continuous paths and that \(\tau<\infty\) almost surely. Take \(\mu,\sigma\) bounded and Lipschitz on \([a,b]\), with \(\sigma\) bounded there. These hypotheses ensure the SDE is well posed up to exit; the separate assumption on \(\tau\) makes the exit payoff well defined.

For a twice continuously differentiable function \(f\), the generator on \((a,b)\) is \(\mathcal{L}f(x)=\mu(x)f'(x)+\tfrac12\sigma(x)^2f''(x)\). The drift \(\mu\) determines the first-derivative term, and the diffusion coefficient \(\sigma\) determines the second-derivative term. The factor \(\tfrac12\) is the Ito correction arising from \(dB_t\,dB_t=dt\), while \(dB_t\,dt=0\) and \(dt\,dt=0\).

Definition: Let \(g\) be a bounded payoff specified at the endpoints, and let \(q:[a,b]\to[0,\infty)\) be bounded and continuous. The discounted exit value is \(u(x)=\mathbb{E}_x[e^{-\int_0^\tau q(X_s)\,ds}g(X_\tau)]\). Here \(\mathbb{E}_x\) denotes expectation for the solution started at \(X_0=x\). The function \(q\) is the discount rate; when it is constant, the discount factor is \(e^{-q\tau}\).

The boundary equation associated with this value is \(\mathcal{L}u-qu=0\) on \((a,b)\), with \(u(a)=g(a)\) and \(u(b)=g(b)\). The equation says that the generator’s local change in value balances the discount. The boundary data specify the payoff once the diffusion exits.

A Verification Result

Theorem: Suppose the diffusion and exit time satisfy the assumptions above. If \(v\in C^2((a,b))\cap C([a,b])\) is bounded, its first two derivatives extend continuously and boundedly to \([a,b]\), and \(\mathcal{L}v-qv=0\) on \((a,b)\), \(v(a)=g(a)\), and \(v(b)=g(b)\), then \(v(x)=\mathbb{E}_x[e^{-\int_0^\tau q(X_s)\,ds}g(X_\tau)]\). Consequently, there is at most one such classical solution.

Proof. Set \(A_t=\int_0^t q(X_s)\,ds\) and \(Y_t=e^{-A_t}v(X_t)\). Ito’s formula applied to \(v\) gives \(v'(x)\) as the first derivative and \(v''(x)\) as the second derivative, including the correction \(\tfrac12\sigma(x)^2v''(x)\,dt\): \(dv(X_t)=v'(X_t)\sigma(X_t)\,dB_t+\mathcal{L}v(X_t)\,dt\). Since \(d(e^{-A_t})=-e^{-A_t}q(X_t)\,dt\), the product rule has no quadratic-covariation term with this finite-variation factor. Therefore, before exit, \(dY_t=e^{-A_t}\sigma(X_t)v'(X_t)\,dB_t+e^{-A_t}(\mathcal{L}v-qv)(X_t)\,dt\). The assumed equation makes the drift zero. For each deterministic \(t<\infty\), stopping at \(\tau\) yields \(Y_{t\wedge\tau}=v(x)+\int_0^t\mathbf{1}_{\{s<\tau\}}e^{-A_s}\sigma(X_s)v'(X_s)\,dB_s\).

The integrand is progressively measurable. Because \(q\ge0\), \(e^{-A_s}\le1\); because \(\sigma\) and \(v'\) are bounded on the interval, its squared integral has finite expectation on \([0,t]\). Thus it belongs to \(\mathcal{L}^2\) on this time horizon. The Ito integral is a true martingale: it is square-integrable by the Ito isometry, and its conditional increments have mean zero, so its conditional expectation at an earlier time equals its present value. In particular its expectation is zero, giving \(v(x)=\mathbb{E}_x[e^{-A_{t\wedge\tau}}v(X_{t\wedge\tau})]\).

As \(t\to\infty\), \(\tau<\infty\) almost surely, so \(t\wedge\tau\to\tau\) and \(X_{t\wedge\tau}\to X_\tau\) almost surely by path continuity. The integrand inside the expectation is bounded in absolute value by \(\sup_{[a,b]}|v|\), since \(q\ge0\). Dominated convergence therefore gives \(v(x)=\mathbb{E}_x[e^{-A_\tau}v(X_\tau)]\). At exit, \(X_\tau\) is an endpoint, and the boundary conditions give \(v(X_\tau)=g(X_\tau)\). This proves the representation. If \(v_1,v_2\) are two solutions, their difference \(w=v_1-v_2\) satisfies the same equation and zero boundary values. The representation just proved gives \(w(x)=\mathbb{E}_x[e^{-A_\tau}0]=0\) for every \(x\in(a,b)\); the boundary values are also zero. Hence the solution is unique. \(\square\)

This is a verification result: it proves that a sufficiently regular solution of the boundary equation has the desired probabilistic meaning. It does not assert, without further hypotheses, that every exit-payoff expectation is a classical solution. In the examples below, the exit time is almost surely finite; for bounded intervals and the uniformly nondegenerate diffusions used here, this is the standard one-dimensional exit-time property.

Worked Boundary Problems

Worked Example: Brownian Motion with Discounting

Let \(dX_t=dB_t\) on \((0,1)\), with \(X_0=x\), discount rate \(q=2\), and boundary payoff \(g(0)=0,\ g(1)=1\). Find and verify the discounted exit value.

Here \(\mu=0\) and \(\sigma=1\), so the equation is \(\tfrac12u''-2u=0\), or \(u''-4u=0\). Its general solution is \(u(x)=C_1e^{2x}+C_2e^{-2x}\). The condition \(u(0)=0\) gives \(C_1+C_2=0\), so \(u(x)=C_1(e^{2x}-e^{-2x})=2C_1\sinh(2x)\). The condition \(u(1)=1\) gives \(2C_1\sinh2=1\). Thus \(u(x)=\sinh(2x)/\sinh2\).

For verification, \(u'(x)=2\cosh(2x)/\sinh2\) and \(u''(x)=4\sinh(2x)/\sinh2=4u(x)\). The generator calculation, including its Ito correction, is \(\mathcal{L}u-qu=\tfrac12u''-2u=\tfrac12(4u)-2u=0\). Also \(u(0)=0\) and \(u(1)=1\). The theorem identifies this solution with the expected discounted payoff. As a check at \(x=\tfrac12\), the formula gives \(\sinh1/\sinh2=1/(2\cosh1)\), using \(\sinh2=2\sinh1\cosh1\).

Worked Example: Drift Changes the Exit Probability

Let \(dX_t=dt+dB_t\) on \((0,1)\), with no discount and boundary payoff \(g(0)=0,\ g(1)=1\). Find the probability-weighted value, which in this case is the probability of exiting at \(1\).

The generator is \(\mathcal{L}u=u'+\tfrac12u''\), and the boundary equation is \(u'+\tfrac12u''=0\), or \(u''+2u'=0\). Writing \(z=u'\), the equation \(z'+2z=0\) gives \(z=Ce^{-2x}\). Integration yields \(u(x)=D-\tfrac C2e^{-2x}\). The condition \(u(0)=0\) gives \(D=C/2\), so \(u(x)=\tfrac C2(1-e^{-2x})\). The condition \(u(1)=1\) gives \(\tfrac C2(1-e^{-2})=1\), hence \(u(x)=(1-e^{-2x})/(1-e^{-2})\).

For the generator check, \(u'(x)=2e^{-2x}/(1-e^{-2})\) and \(u''(x)=-4e^{-2x}/(1-e^{-2})\). Thus \(\mathcal{L}u=u'+\tfrac12u''=2e^{-2x}/(1-e^{-2})-2e^{-2x}/(1-e^{-2})=0\). The endpoint values are \(u(0)=0\) and \(u(1)=(1-e^{-2})/(1-e^{-2})=1\). With no discount, the representation is \(u(x)=\mathbb{P}_x(X_\tau=1)\): the payoff is one at the upper endpoint and zero at the lower endpoint.

Worked Example: A State-Dependent Diffusion Coefficient

On \((0,1)\), let \(dX_t=(1+X_t)\,dB_t\), use discount rate \(q=1\), and set \(g(0)=0,\ g(1)=1\). Find the discounted exit value.

Here \(\mathcal{L}u(x)=\tfrac12(1+x)^2u''(x)\), so the equation is \(\tfrac12(1+x)^2u''-u=0\). Put \(y=1+x\). The functions \(y^2\) and \(y^{-1}\) solve the equation: their second derivatives with respect to \(y\) are \(2\) and \(2y^{-3}\), respectively, and substitution gives zero in each case. Therefore write \(u(x)=C_1(1+x)^2+C_2(1+x)^{-1}\). At \(x=0\), \(C_1+C_2=0\), so \(C_2=-C_1\). At \(x=1\), \(4C_1+C_2/2=1\), hence \(4C_1-C_1/2=1\), \(7C_1/2=1\), and \(C_1=2/7\). The answer is \(u(x)=\tfrac27((1+x)^2-(1+x)^{-1})\).

Differentiate explicitly: \(u'(x)=\tfrac27(2(1+x)+(1+x)^{-2})\) and \(u''(x)=\tfrac27(2-2(1+x)^{-3})\). The second-order Ito term in the generator is \(\tfrac12(1+x)^2u''(x)=\tfrac17(1+x)^2(2-2(1+x)^{-3}) =\tfrac27((1+x)^2-(1+x)^{-1})=u(x)\). Thus \(\mathcal{L}u-u=0\). At the endpoints the formula gives \(u(0)=\tfrac27(1-1)=0\) and \(u(1)=\tfrac27(4-\tfrac12)=\tfrac27\cdot\tfrac72=1\). The verification theorem gives the required expectation.

Why the Generator Check Matters

The generator converts the diffusion’s local behavior into a deterministic equation. Once a candidate has been found, its boundary values alone are not enough: it must also satisfy the interior equation with the correct drift, diffusion coefficient, and discount term. The verification proof explains why these checks suffice. The discounted candidate evaluated along the stopped diffusion has zero drift; its remaining stochastic integral is a true martingale on each finite time interval; and bounded convergence passes from finite stopping times to the exit time.

Common pitfall: omitting Ito’s factor of one half. In the first example, replacing the correct equation \(\tfrac12u''-2u=0\) by \(u''-2u=0\) produces the boundary-matching candidate \(\widetilde u(x)=\sinh(\sqrt{2}x)/\sinh(\sqrt{2})\). But \(\widetilde u''=2\widetilde u\), so the actual generator gives \(\tfrac12\widetilde u''-2\widetilde u=\widetilde u-2\widetilde u=-\widetilde u\), which is not zero in the interval. The endpoint values are correct, but the function does not solve the required boundary problem and therefore cannot be verified by the theorem.

Check Your Understanding

For each question, distinguish the generator equation from the endpoint conditions.

  1. For standard Brownian motion on \((0,2)\), discount rate \(q=1\), and boundary values \(g(0)=2,\ g(2)=0\), write the boundary-value problem without solving it.
  2. For \(dX_t=\mu\,dt+\sigma\,dB_t\), with constant \(\mu\) and nonzero constant \(\sigma\), write \(\mathcal{L}u-qu=0\) explicitly.
  3. Why does the verification proof first stop at \(t\wedge\tau\), rather than immediately take expectations of an integral up to \(\tau\)?
  4. For the drifted Brownian example, check directly that the displayed function has endpoint values zero and one.
  5. What part of the generator calculation changes if the discount rate is replaced by a bounded function \(q(x)\ge0\)?