Tutorials › Stochastic Processes › Submartingales and Supermartingales from Conditional Drift

Martingales: Definitions and Examples · Tutorial 696 of 994

Submartingales and Supermartingales from Conditional Drift

Use conditional drift to classify an adapted, integrable process and determine when its expectations increase or decrease.

Advanced 10 min read

What You'll Learn

  • Define conditional drift relative to a filtration and state the integrability assumptions it requires.
  • Prove the conditional-increment criteria for submartingales and supermartingales.
  • Classify processes with zero, positive, negative, or state-dependent conditional drift.
  • Relate conditional drift to changes in unconditional expectations.
  • Identify why a positive average increment alone does not establish the submartingale property.

Conditional Drift and the Direction of a Process

A martingale has zero conditional expected increment: given the information available now, its expected next value equals its current value. Submartingales and supermartingales relax that equality in one direction. Their conditional expected increments are, respectively, nonnegative and nonpositive. The distinction is conditional: an increment that averages upward across all outcomes can still have a negative conditional expectation for some information already observed.

Work on a probability space \((\Omega,\mathcal{F},\mathbb{P})\), in discrete time \(n\ge0\), with filtration \((\mathcal{F}_n)_{n\ge0}\). A process \((X_n)_{n\ge0}\) is adapted if \(X_n\) is \(\mathcal{F}_n\)-measurable for every \(n\). Assume throughout that each \(X_n\) is integrable, meaning \(\mathbb{E}[|X_n|]<\infty\). These assumptions make the conditional expectations below well-defined. Define the conditional drift at time \(n\) by

$$ \Delta_n=\mathbb{E}[X_{n+1}-X_n\mid\mathcal{F}_n]. $$

Because \(X_n\) is \(\mathcal{F}_n\)-measurable, the conditional-increment criterion for martingales gives the equality condition \(\mathbb{E}[X_{n+1}\mid\mathcal{F}_n]=X_n\) almost surely. The same decomposition identifies the one-sided versions.

Definition: An adapted integrable process is a submartingale if \(\mathbb{E}[X_{n+1}\mid\mathcal{F}_n]\ge X_n\) almost surely for every \(n\). It is a supermartingale if \(\mathbb{E}[X_{n+1}\mid\mathcal{F}_n]\le X_n\) almost surely for every \(n\). Equivalently, the conditional drift satisfies \(\Delta_n\ge0\) for a submartingale and \(\Delta_n\le0\) for a supermartingale. A martingale has \(\Delta_n=0\) almost surely for every \(n\).

Why the Drift Criterion Is Equivalent

The inequalities in the definition compare the next conditional value with the current value. Conditional drift instead describes the expected change. Under adaptation and integrability, these are two forms of the same condition.

Proof. Fix any \(n\). Linearity of conditional expectation and the \(\mathcal{F}_n\)-measurability of \(X_n\) give \(\Delta_n=\mathbb{E}[X_{n+1}\mid\mathcal{F}_n]-\mathbb{E}[X_n\mid\mathcal{F}_n]=\mathbb{E}[X_{n+1}\mid\mathcal{F}_n]-X_n\) almost surely. Thus \(\Delta_n\ge0\) almost surely if and only if \(\mathbb{E}[X_{n+1}\mid\mathcal{F}_n]\ge X_n\) almost surely. Replacing both inequalities by \(\le\) proves the supermartingale equivalence; replacing them by equality proves the martingale equivalence. Applying these equivalences at every \(n\) establishes the criteria for the whole process. \(\square\)

The sign condition is required at every time and almost surely. A conditional expectation is defined only up to changes on probability-zero events, so its inequality is interpreted almost surely, not as a pointwise claim for every \(\omega\). The drift may vary with both time and the information in \(\mathcal{F}_n\); it need not be a fixed number.

Theorem: For an adapted integrable process, \(\mathbb{E}[X_{n+1}]-\mathbb{E}[X_n]=\mathbb{E}[\Delta_n]\). In particular, a submartingale has nondecreasing expectations, and a supermartingale has nonincreasing expectations. If \(\Delta_n>0\) almost surely, then \(\mathbb{E}[X_{n+1}]>\mathbb{E}[X_n]\); if \(\Delta_n<0\) almost surely, then \(\mathbb{E}[X_{n+1}]<\mathbb{E}[X_n]\).

Proof. By the defining property of conditional expectation, \(\mathbb{E}[\Delta_n]=\mathbb{E}[X_{n+1}-X_n]\), which is the stated identity. If \(\Delta_n\ge0\) almost surely, its expectation is nonnegative, so the expected value cannot decrease; the nonpositive case gives the reverse conclusion. For strictness, suppose \(\Delta_n>0\) almost surely. The events \(\{\Delta_n\ge 1/k\}\), for positive integers \(k\), have union \(\{\Delta_n>0\}\). Since this union has probability one, at least one of these events has positive probability. For that \(k\), \(\mathbb{E}[\Delta_n]\ge \mathbb{P}(\Delta_n\ge1/k)/k>0\). The negative case follows by applying the same argument to \(-\Delta_n\). \(\square\)

Thus a nonnegative conditional drift gives a submartingale, but the expected value increases strictly only if the drift is positive on a set of positive probability. If the drift is zero almost surely, the expected value is unchanged at that step. Equality of unconditional expectations alone does not imply zero conditional drift: positive and negative conditional changes can cancel when averaged.

Constant and State-Dependent Drift

A particularly direct case is a constant conditional drift \(c\), meaning \(\Delta_n=c\) almost surely at each time under consideration. If \(c>0\), the process is a submartingale and its expectation rises by \(c\) per step. If \(c<0\), it is a supermartingale and its expectation falls by \(|c|\) per step. If \(c=0\), it is a martingale. The classification follows directly from the drift criterion; it does not require the realized increment \(X_{n+1}-X_n\) itself to equal \(c\).

Worked Example: Positive Drift with Both Upward and Downward Steps

Let \(B_1,B_2,\ldots\) be independent Bernoulli random variables with \(\mathbb{P}(B_k=1)=\tfrac23\) and \(\mathbb{P}(B_k=0)=\tfrac13\). On their product probability space, let \(\mathcal{F}_0=\{\varnothing,\Omega\}\), let \(\mathcal{F}_n=\sigma(B_1,\ldots,B_n)\) for \(n\ge1\), and define \(X_0=0\) and \(X_n=\sum_{k=1}^n(2B_k-1)\). This process is adapted and integrable.

The next increment is \(+1\) when \(B_{n+1}=1\) and \(-1\) when \(B_{n+1}=0\). Independence gives \(\mathbb{E}[2B_{n+1}-1\mid\mathcal{F}_n]=2(\tfrac23)-1=\tfrac13\). Hence \(\Delta_n=\tfrac13>0\) at every time, so the process is a submartingale, even though a downward step occurs with probability \(\tfrac13\). The expectation identity gives \(\mathbb{E}[X_n]=n/3\).

Check at two steps. The four possible pairs \((B_1,B_2)\) have probabilities \(\tfrac49,\tfrac29,\tfrac29,\tfrac19\) for \((1,1),(1,0),(0,1),(0,0)\), respectively. The corresponding \(X_2\) values are \(2,0,0,-2\). Therefore \(\mathbb{E}[X_2]=2(\tfrac49)+0(\tfrac29)+0(\tfrac29)-2(\tfrac19)=\tfrac{8}{9}-\tfrac{2}{9}=\tfrac23\), which equals \(2/3\) from the drift formula.

Conditional drift can depend on the observed state. For a supermartingale, it is enough that every such conditional drift be nonpositive; the values need not be equal across states or times.

Worked Example: Negative Drift That Depends on the Observed Branch

Let \(\Omega=\{(u,v):u\in\{-1,1\},\ v\in\{-1,1\}\}\), with each outcome having probability \(\tfrac14\). Set \(U(u,v)=u\) and \(V(u,v)=v\). Use \(\mathcal{F}_0=\{\varnothing,\Omega\}\), \(\mathcal{F}_1=\sigma(U)\), and \(\mathcal{F}_n=\sigma(U,V)\) for \(n\ge2\). Define \(X_0=0\), \(X_1=U\), and set \(D=X_2-X_1\) by \(D=V-1\) if \(U=1\), and \(D=-2+V\) if \(U=-1\). Let \(X_2=X_1+D\), and \(X_n=X_2\) for \(n\ge2\).

At time \(0\), \(\Delta_0=\mathbb{E}[U]=0\). Given \(U=1\), \(V\) is equally likely to be \(1\) or \(-1\), so \(D\) is \(0\) or \(-2\), each with conditional probability \(\tfrac12\), and \(\mathbb{E}[D\mid\mathcal{F}_1]=-1\). Given \(U=-1\), \(D=-2+V\) is \(-1\) or \(-3\), each with conditional probability \(\tfrac12\), and \(\mathbb{E}[D\mid\mathcal{F}_1]=-2\). After time \(2\), the process is constant, so \(\Delta_n=0\) for \(n\ge2\). All conditional drifts are nonpositive; therefore \(X_n\) is a supermartingale.

Check the expectations. \(X_0=0\), and \(X_1=U\) has mean \(\tfrac12(1)+\tfrac12(-1)=0\). If \(U=1\), \(X_2\) is \(1\) or \(-1\), with conditional mean \(0\); if \(U=-1\), \(X_2\) is \(-2\) or \(-4\), with conditional mean \(-3\). Thus \(\mathbb{E}[X_2]=\tfrac12(0)+\tfrac12(-3)=-\tfrac32\), matching the total expected drift \(0+\tfrac12(-1)+\tfrac12(-2)=-\tfrac32\). The process stays at this expectation thereafter.

A Common Mistake: Using Unconditional Drift

The mean of an increment averages over all outcomes, including outcomes distinguished by information already available at time \(n\). The submartingale condition instead tests the expected increment given that information. These can have different signs on different branches.

Worked Example: A Positive Average Increment Does Not Ensure a Submartingale

Let \(\Omega=\{a,b\}\) with each outcome having probability \(\tfrac12\). Set \(U(a)=1\), \(U(b)=-1\), take \(\mathcal{F}_0=\{\varnothing,\Omega\}\), \(\mathcal{F}_1=\mathcal{F}_n=\sigma(U)\) for \(n\ge1\), and define \(X_0=0\), \(X_1=U\). Set \(X_2=X_1+D\), where \(D(a)=-2\) and \(D(b)=4\), and keep \(X_n=X_2\) for \(n\ge2\).

At time \(0\), \(\Delta_0=\mathbb{E}[U]=0\). At time \(1\), the outcome is already known: \(\Delta_1=-2\) on \(a\) and \(\Delta_1=4\) on \(b\). The unconditional mean increment is \(\mathbb{E}[D]=\tfrac12(-2)+\tfrac12(4)=1>0\), but \(\Delta_1\ge0\) fails on \(a\), which has positive probability. Therefore the process is not a submartingale. It is not a supermartingale either, since its conditional drift is positive on \(b\).

Check by the values of \(X_2\). On \(a\), \(X_2=1-2=-1\); on \(b\), \(X_2=-1+4=3\). Hence \(\mathbb{E}[X_2]=\tfrac12(-1)+\tfrac12(3)=1\). The overall expectation has risen from \(\mathbb{E}[X_1]=0\), but the conditional value on branch \(a\) falls from \(1\) to \(-1\). The incorrect calculation is to infer “submartingale” from \(\mathbb{E}[X_2-X_1]=1>0\); the correction is to check \(\mathbb{E}[X_2-X_1\mid\mathcal{F}_1]\) on each branch.

Using the Classification Carefully

To classify a process from conditional drift, first specify the filtration: it determines what is known when the increment is evaluated. Then verify adaptation and integrability, compute \(\mathbb{E}[X_{n+1}-X_n\mid\mathcal{F}_n]\), and establish its sign almost surely for every relevant \(n\). A drift that is nonnegative at some times and nonpositive at others does not by itself give either classification; the required sign must hold throughout the time range.

The actual increments may fluctuate in either direction. What matters is their conditional mean given the present information. Conversely, a process with increasing unconditional expectations need not be a submartingale, as the two-branch example shows. These distinctions are useful whenever a process is built from evolving information: conditional drift gives a local criterion, while expected-value monotonicity is a consequence of that criterion rather than a replacement for it.

Check Your Understanding

For each question, identify the conditional drift and state any required almost-sure qualification.

  1. If an adapted integrable process has \(\Delta_n=0\) almost surely for every \(n\), what classification does it satisfy?
  2. Suppose \(\Delta_n=\tfrac25\) almost surely at every \(n\). By how much does \(\mathbb{E}[X_n]\) increase in one step, and which classification applies?
  3. Can a process have some negative realized increments and still be a submartingale? Explain using the conditional drift criterion.
  4. Why is a positive value of \(\mathbb{E}[X_{n+1}-X_n]\) alone insufficient to establish the submartingale property?
  5. If \(\Delta_n\le0\) almost surely at every time, what can be said about \(\mathbb{E}[X_n]\) as \(n\) increases?