Tutorials › Stochastic Calculus › The Markov Property at Deterministic Times

Brownian Motion Essentials · Tutorial 44 of 600

The Markov Property at Deterministic Times

Learn how Brownian motion’s independent increments yield its Markov property at deterministic times and how to compute conditional expectations with its transition semigroup.

Advanced 12 min read

What You'll Learn

  • Express conditional independence of future Brownian increments from the filtration at a fixed time.
  • Extend the result from finitely many increments to the future process on a bounded interval.
  • Define the Brownian transition kernel and its semigroup.
  • Prove the deterministic-time Markov formula for bounded measurable functions.
  • Compute conditional distributions, moments, and trigonometric expectations.
  • Identify and correct the mistake of treating the future Brownian position as independent of the past.

Past Information and Future Increments

At a fixed time \(s\), Brownian motion’s future position combines two parts: its current value \(B_s\), which is already known from the past, and a fresh increment \(B_t-B_s\). The increment is independent of the past, but \(B_t\) itself is generally not. The Markov property makes this distinction precise and turns conditional expectations of functions of \(B_t\) into a transition-semigroup calculation.

Work on a filtered probability space \((\Omega,\mathcal{F},(\mathcal{F}_t)_{t\ge0},\mathbb{P})\) carrying a standard Brownian motion \(B_t\) relative to the filtration: in particular, for \(0\le s<t\), \(B_t-B_s\) is independent of \(\mathcal{F}_s\) and has distribution \(N(0,t-s)\). The past through time \(s\) is represented by \(\mathcal{F}_s\). Equalities between conditional expectations below are understood almost surely.

Definition: The process of future increments after time \(s\) is \(X^{(s)}_u=B_{s+u}-B_s\), \(u\ge0\). It is independent of \(\mathcal{F}_s\) if, for every event \(A\in\mathcal{F}_s\) and every event \(C\) determined by this process, \(\mathbb{P}(A\cap C)=\mathbb{P}(A)\mathbb{P}(C)\).

Independence of the Future-Increment Process

The defining independent-increment property first gives the desired conclusion for any finite collection of future times. The same conclusion applies to the entire continuous future-increment path on a fixed bounded interval.

Theorem: Fix \(s\ge0\) and \(T>0\). The random path \((B_{s+u}-B_s)_{0\le u\le T}\) is independent of \(\mathcal{F}_s\). Equivalently, for any \(0\le u_1<\cdots<u_n\le T\), the vector \((B_{s+u_1}-B_s,\ldots,B_{s+u_n}-B_s)\) is independent of \(\mathcal{F}_s\). Its coordinates are not generally independent of one another.

Proof. For a finite collection of future times, write the vector of values as sums of increments over the successive disjoint intervals with endpoints \(s,s+u_1,\ldots,s+u_n\). Brownian independent increments imply that this vector is independent of \(\mathcal{F}_s\); the first coordinate at \(u_1=0\), if present, is the constant zero and does not affect independence. In particular, for every Borel set \(D\subseteq\mathbb{R}^n\) and \(A\in\mathcal{F}_s\), the probability that \(A\) occurs and the vector lies in \(D\) is the product of their probabilities. To pass to paths, use that the Borel sigma-field of \(C([0,T])\), with its uniform norm, is generated by evaluation at rational times in \([0,T]\). Events restricting finitely many such evaluations form a pi-system generating that sigma-field. For each fixed \(A\in\mathcal{F}_s\), the events \(C\) satisfying \(\mathbb{P}(A\cap\{X^{(s)}\in C\})=\mathbb{P}(A)\mathbb{P}(X^{(s)}\in C)\) form a lambda-system. The pi-lambda theorem therefore extends the finite-evaluation identity to every Borel path event. This proves independence of the future path from \(\mathcal{F}_s\). \(\square\)

In conditional-distribution language, for every bounded Borel function \(g:\mathbb{R}^n\to\mathbb{R}\), the theorem says \(\mathbb{E}[g(B_{s+u_1}-B_s,\ldots,B_{s+u_n}-B_s)\mid\mathcal{F}_s]\) equals the unconditional expectation of that same function. This is a statement about the future increments. Their joint law can have dependence across different future times.

Worked Example: Two Future Increments Given the Past

Take \(s=1\), and set \(X=B_2-B_1\) and \(Y=B_3-B_1\). Find their conditional means, variances, and covariance given \(\mathcal{F}_1\).

Write \(Z=B_3-B_2\). The increments \(X\) and \(Z\) are independent \(N(0,1)\) random variables, and both are independent of \(\mathcal{F}_1\). Since \(Y=X+Z\), we obtain \(\mathbb{E}[X\mid\mathcal{F}_1]=0\) and \(\mathbb{E}[Y\mid\mathcal{F}_1]=0+0=0\). The conditional variances are \(\operatorname{Var}(X\mid\mathcal{F}_1)=1\) and \(\operatorname{Var}(Y\mid\mathcal{F}_1)=1+1=2\). Finally, \(\operatorname{Cov}(X,Y\mid\mathcal{F}_1)=\mathbb{E}[X(X+Z)\mid\mathcal{F}_1]=1+0=1\).

$$ \mathcal{L}\big((X,Y)\mid\mathcal{F}_1\big) = N\!\left( \begin{pmatrix}0\\0\end{pmatrix}, \begin{pmatrix}1&1\\1&2\end{pmatrix} \right). $$

Check: The unconditional means are also zero, and the unconditional covariance entries are \(\mathbb{E}[X^2]=1\), \(\mathbb{E}[XY]=\mathbb{E}[X^2]+\mathbb{E}[XZ]=1+0=1\), and \(\mathbb{E}[Y^2]=1+1=2\). These agree with the conditional parameters, as expected from independence of \((X,Y)\) from \(\mathcal{F}_1\). The nonzero covariance \(1\) also confirms that \(X\) and \(Y\) are not independent of each other.

The Transition Semigroup and the Markov Formula

For \(h>0\), Brownian motion’s transition density from \(x\) to \(y\) in time \(h\) is \(p_h(x,y)=(2\pi h)^{-1/2}\exp(-(y-x)^2/(2h))\). For a bounded Borel function \(f:\mathbb{R}\to\mathbb{R}\), define the transition operators \(P_h\) by integrating against this density. Set \(P_0f=f\).

$$ P_hf(x)=\int_{\mathbb{R}}f(y)p_h(x,y)\,dy =\mathbb{E}[f(x+B_h)],\qquad h>0. $$

The integral here is an ordinary Lebesgue integral. It is finite for bounded \(f\). These operators are called a semigroup because applying one transition and then another is the same as applying a single transition for the combined time.

Theorem: For bounded Borel \(f\) and \(u,v\ge0\), \(P_u(P_vf)=P_{u+v}f\). Moreover, for \(0\le s\le t\), \(\mathbb{E}[f(B_t)\mid\mathcal{F}_s]=P_{t-s}f(B_s)\). This conditional-expectation identity is the Markov property of Brownian motion at deterministic times.

Proof. For \(u,v>0\), let \(Z_1,Z_2\) be independent standard normal random variables. By the definition of \(P\), \(P_u(P_vf)(x)=\mathbb{E}[f(x+\sqrt{u}Z_1+\sqrt{v}Z_2)]\). The sum \(\sqrt{u}Z_1+\sqrt{v}Z_2\) is normal with mean zero and variance \(u+v\), so this expectation is \(P_{u+v}f(x)\). If \(u=0\) or \(v=0\), the identity follows from \(P_0f=f\). For the conditional formula, put \(h=t-s\). When \(h>0\), \(B_t=B_s+(B_t-B_s)\), and \(B_t-B_s\) is independent of \(\mathcal{F}_s\) with distribution \(N(0,h)\). Thus the conditional expectation of \(f(B_s+(B_t-B_s))\) is the Gaussian average \(P_hf(B_s)\). This conditional-expectation statement can be verified by integrating both sides over each event \(A\in\mathcal{F}_s\), using independence of the increment and the definition of its normal distribution. When \(h=0\), \(B_t=B_s\) and \(P_0f(B_s)=f(B_s)\), so the identity holds as well. \(\square\)

The theorem also holds for nonnegative Borel \(f\), with possibly infinite expectations, by applying the bounded result to \(f\wedge n\) and taking increasing limits. For a signed Borel function \(f\), it holds whenever \(\mathbb{E}|f(B_t)|<\infty\), by applying the result to its positive and negative parts. The bounded version suffices for the examples below.

Worked Example: Conditional Distribution of the Brownian Position

Find the conditional distribution of \(B_2\) given \(\mathcal{F}_1\), and compute the conditional probability that \(B_2-B_1\) lies strictly between \(-1\) and \(1\).

Here \(B_2=B_1+(B_2-B_1)\), where the increment is independent of \(\mathcal{F}_1\) and has distribution \(N(0,1)\). Therefore, conditionally on \(\mathcal{F}_1\), \(B_2\) has a normal distribution with mean \(B_1\) and variance \(1\), and its conditional density at \(y\) is \(p_1(B_1,y)\). For the increment event, let \(\Phi\) be the standard normal CDF. The endpoints are excluded, but a normal distribution assigns probability zero to either endpoint, so \(\mathbb{P}(-1<B_2-B_1<1\mid\mathcal{F}_1)=\Phi(1)-\Phi(-1)=2\Phi(1)-1\).

Check: The conditional mean of \(B_2-B_1\) is \(0\), and its conditional variance is \(1\), matching its \(N(0,1)\) distribution. The conditional probability is independent of \(B_1\), as it must be for an event involving only the future increment.

Worked Example: A Conditional Second Moment

Compute \(\mathbb{E}[B_3^2\mid\mathcal{F}_1]\), then check the answer by taking expectations.

Use the transition operator with \(f(x)=x^2\) and \(h=3-1=2\). If \(Z\sim N(0,1)\), then \(P_2f(x)=\mathbb{E}[(x+\sqrt{2}Z)^2]\). Expanding gives \(x^2+2\sqrt{2}x\mathbb{E}[Z]+2\mathbb{E}[Z^2]=x^2+0+2=x^2+2\). Consequently, \(\mathbb{E}[B_3^2\mid\mathcal{F}_1]=B_1^2+2\).

Check: Taking expectations gives \(\mathbb{E}[B_1^2+2]=1+2=3\). Since \(B_3\sim N(0,3)\), its second moment is \(3\), which agrees. The calculation uses the second-moment function, which is integrable here; the bounded-function form of the theorem extends to it by truncation.

Worked Example: A Trigonometric Semigroup Calculation

For \(f(x)=\cos x\), compute \(\mathbb{E}[\cos(B_3)\mid\mathcal{F}_1]\) and verify its unconditional expectation.

Write \(B_3=B_1+\sqrt{2}Z\), where \(Z\) is standard normal and independent of \(\mathcal{F}_1\). The normal characteristic function gives \(\mathbb{E}[\cos(\sqrt{2}Z)]=e^{-1}\) and \(\mathbb{E}[\sin(\sqrt{2}Z)]=0\). Expanding the cosine of a sum yields \(\mathbb{E}[\cos(B_3)\mid\mathcal{F}_1]=e^{-1}\cos(B_1)\).

Check: Since \(B_1\sim N(0,1)\), \(\mathbb{E}[\cos(B_1)]=e^{-1/2}\). Therefore the expectation of the conditional answer is \(e^{-1}e^{-1/2}=e^{-3/2}\). Directly, \(B_3\sim N(0,3)\), so \(\mathbb{E}[\cos(B_3)]=e^{-3/2}\), confirming the result.

A Common Mistake: Confusing Position with Increment

A tempting but incorrect calculation is \(\mathbb{E}[B_t\mid\mathcal{F}_s]=0\), on the grounds that the Brownian motion has mean zero. That uses the unconditional mean of \(B_t\) where a conditional mean is required. For \(s\le t\), the correct decomposition is \(B_t=B_s+(B_t-B_s)\): the first term is known at time \(s\), and the second has conditional mean zero. Hence \(\mathbb{E}[B_t\mid\mathcal{F}_s]=B_s\). For example, at \(s=1,t=2\), the incorrect answer \(0\) fails because taking expectations conditionally must preserve the known value \(B_1\); the corrected answer \(B_1\) does so.

The Markov formula concerns the conditional expectation of a function of the future position, given the present information. It does not say that future positions are independent of the past. The transition semigroup accounts for the current position \(B_s\); the fresh randomness enters only through the increment over the time interval \(t-s\).

Check Your Understanding

Use the independence of future increments and the transition-semigroup formula to answer the following.

  1. For \(s<t\), state the conditional distribution of \(B_t-B_s\) given \(\mathcal{F}_s\), including its mean and variance.
  2. For \(0\le s\le t\), compute \(\mathbb{E}[B_t\mid\mathcal{F}_s]\) using \(P_{t-s}\).
  3. Explain why the increments \(B_{s+1}-B_s\) and \(B_{s+2}-B_s\) are not independent of each other, even though their vector is independent of \(\mathcal{F}_s\).
  4. Verify \(P_u(P_vf)=P_{u+v}f\) for \(f(x)=x^2\), where the Gaussian expectations are finite.
  5. For \(s<t\), compute \(\mathbb{E}[\sin(B_t)\mid\mathcal{F}_s]\) using the normal characteristic function.