Tutorials › Stochastic Processes › Drift-Corrected Biased Random Walks

Martingales: Definitions and Examples · Tutorial 703 of 994

Drift-Corrected Biased Random Walks

Learn how to identify and verify the drift correction that makes a biased random walk a martingale.

Advanced 9 min read

What You'll Learn

  • Define a biased random walk and its natural filtration.
  • Prove that subtracting the mean drift at each step gives a martingale.
  • Check the corrected process along exact biased-coin paths.
  • Identify the unique constant linear correction that works.
  • Extend the correction to independent steps with different means.
  • Recognize why a single observed path cannot establish the martingale property.

Why Remove the Drift?

A biased random walk has a systematic tendency to move in one direction. For example, if each step is more likely to be \(+1\) than \(-1\), the walk has positive mean displacement per step. Subtracting the expected displacement accumulated so far removes this systematic trend. The result is not generally constant along a path; rather, its next increment has conditional mean zero given the information already observed. That is the feature that makes it a martingale.

Work on a probability space \((\Omega,\mathcal{F},\mathbb{P})\). Let \((\xi_n)_{n\ge1}\) be independent random variables taking values \(+1\) and \(-1\), with \(\mathbb{P}(\xi_n=+1)=p\) and \(\mathbb{P}(\xi_n=-1)=q\), where \(p,q\ge0\) and \(p+q=1\). The walk starts at a fixed \(x_0\in\mathbb{R}\) and is \(X_0=x_0\), \(X_n=x_0+\sum_{k=1}^n\xi_k\) for \(n\ge1\). Its information filtration is \(\mathcal{F}_0=\{\varnothing,\Omega\}\) and \(\mathcal{F}_n=\sigma(\xi_1,\ldots,\xi_n)\). The drift per step is \(\mathbb{E}[\xi_n]=p-q\).

Definition: The drift-corrected walk is \(M_n=X_n-n(p-q)\), for \(n\ge0\). A process \((M_n)\) is a martingale with respect to \((\mathcal{F}_n)\) if each \(M_n\) is integrable and \(\mathcal{F}_n\)-measurable, and \(\mathbb{E}[M_{n+1}\mid\mathcal{F}_n]=M_n\) almost surely for every \(n\ge0\).

Here the filtration records the steps already taken, but not the next step. Independence is what ensures that learning the past does not change the conditional probabilities of the next step. The theorem below uses that fact directly. It includes the extreme cases \(p=1,q=0\) and \(p=0,q=1\): in those cases the walk is deterministic and the corrected process is constant.

Theorem: Under the assumptions above, \(M_n=X_n-n(p-q)\) is an integrable martingale with respect to \((\mathcal{F}_n)\).

Proof. Each \(\xi_k\) is bounded, so \(X_n\) and \(M_n\), being finite sums of bounded variables and constants, are integrable. The variable \(M_n\) is a function of \(\xi_1,\ldots,\xi_n\), so it is \(\mathcal{F}_n\)-measurable. Also, \(M_{n+1}-M_n=\xi_{n+1}-(p-q)\). By independence, \(\xi_{n+1}\) is independent of \(\mathcal{F}_n\), and its probabilities of \(+1\) and \(-1\) are \(p\) and \(q\). Therefore, \(\mathbb{E}[\xi_{n+1}\mid\mathcal{F}_n]=p(1)+q(-1)=p-q\) almost surely. Taking conditional expectations in the increment identity gives \(\mathbb{E}[M_{n+1}-M_n\mid\mathcal{F}_n]=0\), hence \(\mathbb{E}[M_{n+1}\mid\mathcal{F}_n]=M_n\) almost surely. These are all the martingale conditions. \(\square\)

The proof depends on the conditional mean of the next step, not on any claim that a realized corrected path is flat. The path can go up or down substantially. The martingale property says that, given the observed past, the average of the next corrected value over the possible next steps is the current value.

Biased-Coin Examples

Worked Example: A Coin with Three-Quarter Probability of Heads

Let heads produce a step \(+1\), tails a step \(-1\), and suppose \(p=\tfrac34\), \(q=\tfrac14\). Start at \(X_0=0\), and consider the observed path heads, tails, heads, heads, tails. Verify the corrected values along this path, and check the one-step conditional mean.

The drift is \(p-q=\tfrac34-\tfrac14=\tfrac12\). The successive uncorrected positions are \(X_0=0\), \(X_1=1\), \(X_2=0\), \(X_3=1\), \(X_4=2\), and \(X_5=1\). Subtracting \(n/2\) at each time gives

$$ (M_0,M_1,M_2,M_3,M_4,M_5) =\left(0,\tfrac12,-1,-\tfrac12,0,-\tfrac32\right). $$

For example, \(M_2=X_2-2(\tfrac12)=0-1=-1\), and \(M_5=X_5-5(\tfrac12)=1-\tfrac52=-\tfrac32\). The corrected increments for heads and tails are respectively \(1-\tfrac12=\tfrac12\) and \(-1-\tfrac12=-\tfrac32\). Given any past, their conditional mean is \(\tfrac34(\tfrac12)+\tfrac14(-\tfrac32)=\tfrac38-\tfrac38=0\). Thus the correction has the required conditional-increment property, and the displayed path values also agree with \(M_n=X_n-n/2\) at every listed time.

Check: On the observed path, the increment from \(M_4=0\) to \(M_5=-\tfrac32\) is the tails increment \(-\tfrac32\), as expected. This realized negative increment does not contradict the martingale property: that property concerns the conditional average over both possible next tosses, not the outcome of a particular toss.

Worked Example: A More Heavily Biased Coin

Now take \(p=\tfrac23\), \(q=\tfrac13\), and start at \(0\). For the path tails, heads, tails, tails, compute the corrected walk and verify its conditional increment mean.

The mean step is \(\tfrac23-\tfrac13=\tfrac13\). The uncorrected positions along the path are \(X_0=0\), \(X_1=-1\), \(X_2=0\), \(X_3=-1\), and \(X_4=-2\). The correction at time \(n\) is \(n/3\), so

$$ M_0=0,\quad M_1=-1-\tfrac13=-\tfrac43,\quad M_2=0-\tfrac23=-\tfrac23,\quad M_3=-1-1=-2,\quad M_4=-2-\tfrac43=-\tfrac{10}3. $$

The corrected next increment is \(1-\tfrac13=\tfrac23\) for heads and \(-1-\tfrac13=-\tfrac43\) for tails. Given the past, its conditional mean is \(\tfrac23(\tfrac23)+\tfrac13(-\tfrac43)=\tfrac49-\tfrac49=0\). For a direct path check, the actual increments are tails \(-\tfrac43\), heads \(\tfrac23\), tails \(-\tfrac43\), tails \(-\tfrac43\). Adding these successively to \(M_0=0\) gives \(-\tfrac43,-\tfrac23,-2,-\tfrac{10}3\), matching the formula at each time.

These computations illustrate two different checks. Substitution into \(M_n=X_n-n(p-q)\) checks the arithmetic on the selected path. Computing the conditional mean of the next corrected increment checks the probabilistic reason the process is a martingale. A single path can verify the first, but not the second: it does not show what would have happened under the other possible next toss.

Which Linear Correction Works?

The drift correction is not an arbitrary choice of slope. For a walk with constant mean step \(p-q\), it is the unique constant linear correction that makes the result a martingale.

Proposition: For a fixed real number \(c\), the process \(Y_n=X_n-cn\) is a martingale with respect to \((\mathcal{F}_n)\) if and only if \(c=p-q\).

Proof. The increments satisfy \(Y_{n+1}-Y_n=\xi_{n+1}-c\). If \(Y_n\) is a martingale, its conditional increments have conditional mean zero, so \(0=\mathbb{E}[Y_{n+1}-Y_n\mid\mathcal{F}_n]=\mathbb{E}[\xi_{n+1}\mid\mathcal{F}_n]-c=p-q-c\) almost surely. Thus \(c=p-q\). Conversely, if \(c=p-q\), the theorem's conditional-increment calculation gives \(\mathbb{E}[Y_{n+1}-Y_n\mid\mathcal{F}_n]=0\) for each \(n\). The variables are integrable and adapted, since they differ from \(X_n\) by deterministic constants. Therefore \(Y_n\) is a martingale. This proves both directions. \(\square\)

Worked Example: Detecting the Wrong Drift

For \(p=\tfrac34\), \(q=\tfrac14\), a common error is to subtract \(np\) instead of \(n(p-q)\). Test the proposed process \(Y_n=X_n-\tfrac34n\) at its first step, starting from \(X_0=0\).

At time \(0\), \(Y_0=0\). At time \(1\), heads gives \(Y_1=1-\tfrac34=\tfrac14\), while tails gives \(Y_1=-1-\tfrac34=-\tfrac74\). Consequently, \(\mathbb{E}[Y_1\mid\mathcal{F}_0]=\tfrac34(\tfrac14)+\tfrac14(-\tfrac74)=\tfrac3{16}-\tfrac7{16}=-\tfrac14\), which is not \(Y_0=0\). So this proposed correction fails the martingale condition already between times \(0\) and \(1\).

The correct slope is \(\tfrac34-\tfrac14=\tfrac12\), not \(\tfrac34\). With that correction, the first corrected value is \(\tfrac12\) for heads and \(-\tfrac32\) for tails, and its expectation is \(\tfrac34(\tfrac12)+\tfrac14(-\tfrac32)=\tfrac38-\tfrac38=0= M_0\). The error comes from confusing the probability of a positive step with the mean of the signed step.

Independent Steps with Different Drifts

The same conditional-mean reasoning applies when the step probabilities change with time. Suppose the \(\xi_n\) remain independent and take values \(+1\) and \(-1\), but \(\mathbb{P}(\xi_n=+1)=p_n\) and \(\mathbb{P}(\xi_n=-1)=q_n=1-p_n\). Define the deterministic mean \(d_n=p_n-q_n\) of step \(n\). Then the accumulated drift through time \(n\) is \(\sum_{k=1}^n d_k\), rather than \(n\) times a single constant.

Proposition: Under these assumptions, \(M_n=X_n-\sum_{k=1}^n d_k\), with the empty sum equal to \(0\) at \(n=0\), is an integrable martingale with respect to \(\mathcal{F}_n=\sigma(\xi_1,\ldots,\xi_n)\).

Proof. The process is adapted and integrable because each \(X_n\) is a finite sum of bounded steps and each \(d_k\) is deterministic. Its increment is \(M_{n+1}-M_n=\xi_{n+1}-d_{n+1}\). Independence of the steps implies that \(\xi_{n+1}\) is independent of \(\mathcal{F}_n\). Therefore, \(\mathbb{E}[\xi_{n+1}\mid\mathcal{F}_n]=p_{n+1}-q_{n+1}=d_{n+1}\) almost surely. It follows that the conditional expectation of \(M_{n+1}-M_n\) given \(\mathcal{F}_n\) is zero. Hence \(\mathbb{E}[M_{n+1}\mid\mathcal{F}_n]=M_n\) almost surely for every \(n\), proving the proposition. \(\square\)

Worked Example: Alternating Step Biases

Let the probabilities of a positive step at times \(1,2,3,4\) be \(p_1=\tfrac34\), \(p_2=\tfrac14\), \(p_3=\tfrac12\), and \(p_4=1\). Consider the path heads, tails, heads, heads, starting at \(0\). Find its drift-corrected values and check each step's conditional mean.

The step means are \(d_1=\tfrac34-\tfrac14=\tfrac12\), \(d_2=\tfrac14-\tfrac34=-\tfrac12\), \(d_3=\tfrac12-\tfrac12=0\), and \(d_4=1-0=1\). The cumulative drifts are \(\tfrac12,0,0,1\) at times \(1,2,3,4\). The uncorrected positions on the chosen path are \(1,0,1,2\). Therefore the corrected positions are \(M_1=1-\tfrac12=\tfrac12\), \(M_2=0-0=0\), \(M_3=1-0=1\), and \(M_4=2-1=1\), with \(M_0=0\).

At step \(1\), the corrected increment has possible values \(1-\tfrac12=\tfrac12\) and \(-1-\tfrac12=-\tfrac32\), whose mean is \(\tfrac34(\tfrac12)+\tfrac14(-\tfrac32)=0\). At step \(2\), the possible corrected increments are \(1-(-\tfrac12)=\tfrac32\) and \(-1-(-\tfrac12)=-\tfrac12\), whose mean is \(\tfrac14(\tfrac32)+\tfrac34(-\tfrac12)=\tfrac38-\tfrac38=0\). At step \(3\), the possible increments are \(1\) and \(-1\), with mean \(\tfrac12(1)+\tfrac12(-1)=0\). At step \(4\), the step is certainly \(+1\), and its corrected increment is \(1-d_4=1-1=0\). Thus each step has conditional mean zero, including the deterministic fourth step. The actual corrected increments along the path are \(\tfrac12,-\tfrac12,1,0\); their successive sums reproduce \(\tfrac12,0,1,1\), as calculated.

Interpretation and Common Pitfalls

Drift correction isolates the unpredictable part of the walk's change. At each time, the raw increment has a conditional mean determined by the step distribution; subtracting that mean makes the corrected increment conditionally mean zero. With constant step probabilities, that accumulated subtraction is \(n(p-q)\). With changing probabilities, it is the sum of the individual step means. The path itself need not have zero displacement, and its corrected value need not equal zero.

Common mistake. Do not replace the signed mean \(p-q\) by \(p\), or test the martingale condition using only the values along one observed path. For a martingale, the relevant test is \(\mathbb{E}[M_{n+1}\mid\mathcal{F}_n]=M_n\), not \(M_{n+1}=M_n\) on every outcome. The wrong-drift example fails because its first conditional expectation is \(-\tfrac14\), while its current value is \(0\). Conversely, an individual corrected increment may be nonzero—as in the coin-toss paths—while its conditional mean remains zero.

Check Your Understanding

For each question, identify the relevant conditional mean and distinguish a path calculation from a martingale check.

  1. If \(p=\tfrac58\) and \(q=\tfrac38\), what is the drift per step, and what process should be subtracted from \(X_n\)?
  2. For \(p=\tfrac23\), calculate the two possible corrected increments and verify their conditional mean is zero.
  3. For a walk whose step means are \(d_1,d_2,\ldots\), what deterministic quantity should be subtracted at time \(n\)?
  4. Why does observing one path with a downward corrected step not disprove the martingale property?
  5. For a fixed \(c\), what must \(c\) equal for \(X_n-cn\) to be a martingale when the step probabilities are constant?