Tutorials › Stochastic Calculus › From Weak SDEs to Martingale Problems

Weak Solutions and the Martingale Problem · Tutorial 266 of 600

From Weak SDEs to Martingale Problems

Use localization and Itô’s formula to prove that weak SDE solutions satisfy the martingale problem for their diffusion generator.

Advanced 10 min read

What You'll Learn

  • Define the martingale problem associated with a diffusion generator.
  • Identify the regularity and integrability assumptions used in the weak-SDE-to-martingale-problem implication.
  • Apply Itô’s formula with the full second-order correction term.
  • Use localization and boundedness to establish a true martingale, not merely a local martingale.
  • Compute the generator and martingale terms for Brownian motion and an Ornstein–Uhlenbeck process.
  • Distinguish this implication from the converse direction and from claims of uniqueness.

From an SDE to Its Generator

A weak solution of an SDE consists of a process and a Brownian motion on a filtered probability space; the probability space need not be fixed in advance. Itô’s formula converts the SDE into an evolution formula for a smooth function of the process. The drift in that formula is the generator applied to the function, while the remaining stochastic integral supplies the martingale term. The key point is to justify that this term is a true martingale for the test functions used in the martingale problem.

Let \((\Omega,\mathcal{F},(\mathcal{F}_t),\mathbb{P})\) be a filtered probability space carrying an \(m\)-dimensional Brownian motion \(\mathbf{B}_t\) relative to this filtration. Let \(X_t\) take values in \(\mathbb{R}^d\), and consider coefficients \(b:\mathbb{R}^d\to\mathbb{R}^d\) and \(\sigma:\mathbb{R}^d\to\mathbb{R}^{d\times m}\). Assume both coefficients are locally bounded. A weak solution with initial value \(X_0\), which is \(\mathcal{F}_0\)-measurable, is a continuous adapted process satisfying, almost surely, for every \(t\ge 0\),

$$ X_t=X_0+\int_0^t b(X_s)\,ds+\int_0^t \sigma(X_s)\,d\mathbf{B}_s. $$

The drift integral is understood pathwise and is assumed finite on each bounded time interval. The stochastic integral is an Itô integral, locally square-integrable: after stopping when \(X\) exits a bounded region, its progressively measurable matrix integrand has finite expected time-integrated squared Frobenius norm. When the integrand itself satisfies \(\mathbb{E}\int_0^T\|\sigma(X_s)\|^2\,ds<\infty\), the unstopped integral is in the usual \(L^2\) class. These assumptions give meaning to the SDE without requiring global moment bounds on \(X\).

Set \(a(x)=\sigma(x)\sigma(x)^{\mathsf T}\). For a twice continuously differentiable function \(f:\mathbb{R}^d\to\mathbb{R}\), the diffusion generator is

$$ \mathcal{L}f(x) = \sum_{i=1}^d b_i(x)\,\partial_i f(x) +\frac12\sum_{i,j=1}^d a_{ij}(x)\,\partial_{ij}f(x). $$

Equivalently, the second-order term is \(\tfrac12\operatorname{tr}(a(x)D^2f(x))\). The factor \(\tfrac12\) is the Itô correction: it comes from quadratic covariation, not from the ordinary chain rule.

Definition: For a specified initial law of \(X_0\), the diffusion martingale problem for \(\mathcal{L}\), with test-function domain \(C_c^2(\mathbb{R}^d)\), requires that for every \(f\in C_c^2(\mathbb{R}^d)\), $$ M_t^f=f(X_t)-f(X_0)-\int_0^t\mathcal{L}f(X_s)\,ds $$ is a martingale relative to \((\mathcal{F}_t)\). Here \(C_c^2\) denotes twice continuously differentiable functions with compact support. A martingale is an integrable adapted process satisfying \(\mathbb{E}[M_t^f\mid\mathcal{F}_s]=M_s^f\) for \(s\le t\).

The Weak-SDE-to-Martingale-Problem Result

Theorem: Suppose \(X\) is a weak solution of the SDE above, and \(b,\sigma\) are locally bounded. Then for every \(f\in C_c^2(\mathbb{R}^d)\), the process \(M^f\) is a true martingale on every bounded time interval. Thus the law of \(X\), with its initial law, solves the martingale problem for \(\mathcal{L}\).

Proof. Fix \(f\in C_c^2(\mathbb{R}^d)\) and a finite time horizon \(T\). Itô’s formula gives, up to localization,

$$ \begin{aligned} f(X_t) ={}&f(X_0) +\int_0^t\sum_{i=1}^d \partial_i f(X_s)b_i(X_s)\,ds\\ &+\int_0^t\sum_{i=1}^d\sum_{k=1}^m \partial_i f(X_s)\sigma_{ik}(X_s)\,dB_s^k\\ &+\frac12\int_0^t\sum_{i,j=1}^d \partial_{ij}f(X_s)a_{ij}(X_s)\,ds. \end{aligned} $$

In particular, the Hessian contribution is explicitly the \(\tfrac12\partial_{ij}f\,a_{ij}\) term; it arises from \(dB_t^k\,dB_t^\ell=\delta_{k\ell}\,dt\), while \(dB_t^k\,dt=0\) and \(dt\,dt=0\). Combining the two drift terms gives \(\int_0^t\mathcal{L}f(X_s)\,ds\). The remaining term has integrand \(\sigma(X_s)^{\mathsf T}\nabla f(X_s)\) against \(\mathbf{B}\).

To justify the martingale claim, let \(\tau_n=\inf\{t\ge0:|X_t|\ge n\}\), with the infimum of the empty set defined as \(+\infty\). On \([0,T\wedge\tau_n]\), local boundedness of \(\sigma\) and boundedness of \(\nabla f\) imply that the stopped stochastic integrand is square-integrable in expectation. Indeed, on the event \(|X_0|<n\), its squared norm is bounded by a finite constant depending on \(n\) and \(f\), times \(T\); if \(|X_0|\ge n\), the stopped interval has length zero. The stopped Itô integral is therefore a square-integrable martingale by the Itô isometry and the martingale property of the Itô integral. It follows that \(M^f_{t\wedge\tau_n}\) is a martingale.

Compact support and local boundedness also imply that \(\mathcal{L}f\) is bounded on all of \(\mathbb{R}^d\): its derivatives vanish outside a compact set, and the coefficients are bounded on that set. Thus, for \(0\le t\le T\),

$$ |M^f_{t\wedge\tau_n}| \le 2\|f\|_\infty+T\|\mathcal{L}f\|_\infty. $$

Every continuous path is bounded on \([0,T]\), so \(t\wedge\tau_n\to t\) almost surely for each \(t\le T\). For \(0\le s\le t\le T\), the stopped martingale property gives \(\mathbb{E}[M^f_{t\wedge\tau_n}\mid\mathcal{F}_s]=M^f_{s\wedge\tau_n}\). The displayed uniform bound permits dominated convergence in \(L^1\), including conditional expectations. Passing to the limit yields \(\mathbb{E}[M^f_t\mid\mathcal{F}_s]=M^f_s\). The same bound gives integrability. Since \(T\) was arbitrary, \(M^f\) is a true martingale on every bounded time interval. \(\square\)

The localization is important even though the final conclusion is stronger than a local martingale statement. In general, Itô’s formula first produces a local martingale. Here the compactly supported test function makes both \(f\) and \(\mathcal{L}f\) bounded, which gives the uniform bound needed to pass from stopped martingales to a true martingale. No uniqueness in law or pathwise uniqueness is asserted: the result only says that the law of a weak SDE solution satisfies the associated martingale problem.

Worked Examples

Worked Example: Brownian Motion Tested with Cosine

Let \(X_t=B_t\) be one-dimensional Brownian motion starting at \(0\), and use \(f(x)=\cos x\). This function is not compactly supported, so this calculation illustrates the same Itô argument for a bounded smooth test function; its bounded derivatives make the stochastic integral square-integrable on every finite horizon. For Brownian motion, \(b=0\), \(\sigma=1\), and \(\mathcal{L}f=\tfrac12 f''\). The derivatives are \(f'(x)=-\sin x\) and \(f''(x)=-\cos x\), so

$$ \mathcal{L}f(x)=-\frac12\cos x,\qquad d(\cos B_t)=-\sin B_t\,dB_t-\frac12\cos B_t\,dt. $$

Consequently \(M_t=\cos B_t+\tfrac12\int_0^t\cos B_s\,ds\). The stochastic integrand \(-\sin B_s\) is progressively measurable and has \(\mathbb{E}\int_0^T\sin^2(B_s)\,ds\le T\), so the Itô integral is a true square-integrable martingale. As an independent expectation check, \(B_s\sim N(0,s)\) gives \(\mathbb{E}[\cos B_s]=e^{-s/2}\). Therefore

$$ \mathbb{E}[M_t] =e^{-t/2}+\frac12\int_0^t e^{-s/2}\,ds =e^{-t/2}+(1-e^{-t/2})=1=M_0. $$

This expectation check is consistent with the martingale property; the Itô-integral argument establishes the full conditional-expectation property, not just constancy of the mean.

Worked Example: Brownian Motion and the Unbounded Test Function \(x^2\)

For \(f(x)=x^2\), the derivatives are \(f'(x)=2x\) and \(f''(x)=2\), so Brownian motion has \(\mathcal{L}f=1\). Itô’s formula, initially applied after stopping at \(\tau_n=\inf\{t:|B_t|\ge n\}\), gives \(B_{t\wedge\tau_n}^2-(t\wedge\tau_n)\) as a stopped local martingale. In this case the unstopped candidate is \(M_t=B_t^2-t\). It is in fact a true martingale: for \(s\le t\), write \(B_t=B_s+(B_t-B_s)\). The increment is independent of \(\mathcal{F}_s\), has mean \(0\), and has second moment \(t-s\). Thus

$$ \mathbb{E}[B_t^2-t\mid\mathcal{F}_s] =B_s^2+(t-s)-t =B_s^2-s. $$

Integrability follows from \(\mathbb{E}[B_t^2]=t<\infty\). As a check at \(s=0\), \(\mathbb{E}[M_t]=t-t=0=M_0\). This example lies outside the compactly supported test domain in the definition; it shows that unbounded tests can also work when their martingale and integrability properties are verified separately.

Worked Example: An Ornstein–Uhlenbeck Generator

Consider the Ornstein–Uhlenbeck SDE \(dX_t=-X_t\,dt+2\,dB_t\), \(X_0=1\), and again take \(f(x)=x^2\). Here \(b(x)=-x\), \(\sigma(x)=2\), \(f'(x)=2x\), and \(f''(x)=2\). Substitution into the generator gives

$$ \mathcal{L}f(x)=(-x)(2x)+\frac12(2^2)(2)=-2x^2+4. $$

Itô’s formula displays both the drift and correction explicitly:

$$ d(X_t^2)=2X_t(-X_t)\,dt+4X_t\,dB_t+\frac12(2^2)(2)\,dt =(-2X_t^2+4)\,dt+4X_t\,dB_t. $$

The candidate martingale is \(M_t=X_t^2-1-\int_0^t(-2X_s^2+4)\,ds\). To check square-integrability of its stochastic-integral term on \([0,T]\), solve the linear SDE by multiplying by \(e^t\): \(X_t=e^{-t}+2\int_0^t e^{-(t-s)}\,dB_s\). The Itô isometry gives \(\mathbb{E}[X_t^2]=e^{-2t}+4\int_0^t e^{-2(t-s)}ds=2-e^{-2t}\). Hence \(\mathbb{E}\int_0^T(4X_s)^2ds=16\int_0^T(2-e^{-2s})ds<\infty\), and the stochastic integral is a true square-integrable martingale.

Finally, the mean of the candidate is zero. Indeed, \(\mathbb{E}[X_t^2]=2-e^{-2t}\), and \(\mathbb{E}[-2X_s^2+4]=2e^{-2s}\), so

$$ \mathbb{E}[M_t] =(2-e^{-2t})-1-\int_0^t2e^{-2s}\,ds =(2-e^{-2t})-1-(1-e^{-2t})=0=M_0. $$

The Itô-integral verification establishes the martingale property; the mean calculation is an independent check of the drift and the second-order correction. Since \(x^2\) is not compactly supported, this example is again an explicitly verified extension beyond the defining test domain.

Common Pitfall: A Local Martingale Is Not Automatically a Martingale

A frequent error is to apply Itô’s formula and stop at the phrase “the stochastic term is a local martingale,” then conclude that the martingale problem is solved. A local martingale need not be a true martingale: without additional integrability or boundedness, its conditional expectations need not be preserved. For compactly supported \(f\), the proof above supplies the missing argument: localization gives stopped martingales, and boundedness of \(f\) and \(\mathcal{L}f\) gives a uniform integrable bound so the stopping can be removed.

Another error is to omit the second-order term and use the ordinary chain rule. For \(f(x)=x^2\) and Brownian motion, that would give zero drift and incorrectly suggest that \(B_t^2\) is a martingale. The actual calculation has \(f''=2\) and correction \(\tfrac12 f''\,dt=dt\), so \(B_t^2-t\), not \(B_t^2\), is the martingale. The generator records precisely this correction.

ObjectRole in the calculationWhat must be checked
\(\mathcal{L}f\)Drift in Itô’s formulaIts integral is well-defined; for compactly supported \(f\), it is bounded under local boundedness of the coefficients.
Itô integralCandidate martingale termSquare-integrability after stopping; then use boundedness or another valid integrability argument to obtain a true martingale.
\(M_t^f\)Process required by the martingale problemAdaptedness, integrability, and the conditional-expectation identity.

Check Your Understanding

For each question, state the assumptions that make the claimed integral or conditional expectation meaningful.

  1. For \(dX_t=b(X_t)\,dt+\sigma(X_t)\,dB_t\), write the one-dimensional generator and the martingale candidate for \(f\in C_c^2(\mathbb{R})\).
  2. For \(f(x)=x^3\), compute the drift term in Itô’s formula for standard Brownian motion and identify the second-order correction.
  3. Why does local boundedness of \(b,\sigma\) suffice to make \(\mathcal{L}f\) bounded when \(f\in C_c^2(\mathbb{R}^d)\)?
  4. In the Ornstein–Uhlenbeck example, verify directly from the displayed second moment that \(\mathbb{E}\int_0^T(4X_s)^2ds\) is finite.
  5. Explain why constancy of \(\mathbb{E}[M_t]\) alone does not establish the martingale property.