Tutorials › Stochastic Processes › The Central Limit Theorem at Fixed Brownian Times

Brownian Motion: Definition and Construction · Tutorial 811 of 994

The Central Limit Theorem at Fixed Brownian Times

Learn how the ordinary central limit theorem yields the Brownian normal law at any one fixed time for a diffusively scaled symmetric random walk.

Advanced 12 min read

What You'll Learn

  • Define the diffusively rescaled simple symmetric random walk at a fixed time.
  • Reduce its limit to the iid central limit theorem with an explicit scale factor.
  • Handle positive times and time zero separately.
  • Verify the exact finite-step mean, variance, and a small-step distribution.
  • Distinguish convergence in distribution from equality with a Brownian marginal at finite step.
  • Identify how dependence or nonzero drift can invalidate the conclusion.

From a Random Walk to One Brownian Marginal

A symmetric random walk takes steps of size \(1\) or \(-1\) with equal probability. After \(m\) steps, its typical displacement is of order \(\sqrt m\), not \(m\). Diffusive scaling uses this square-root growth for space and scales the number of steps in proportion to elapsed time. At one fixed time, the central limit theorem then identifies the limiting distribution of the displacement. This is a statement about a single marginal distribution; it does not assert convergence of an entire path.

Let \((\Omega,\mathcal{F},\mathbb{P})\) be a probability space, and let \((\xi_k)_{k\ge1}\) be independent random variables with \(\mathbb{P}(\xi_k=1)=\mathbb{P}(\xi_k=-1)=\tfrac12\). Define \(S_0=0\) and \(S_m=\sum_{k=1}^m\xi_k\) for integers \(m\ge1\). For each positive integer \(n\), define the rescaled walk \((X_n(t))_{t\ge0}\), with state space \(\mathbb{R}\) and continuous time index \(t\ge0\), by

$$ X_n(t)=\frac{S_{\lfloor nt\rfloor}}{\sqrt n}. $$

Here \(\lfloor nt\rfloor\) is the greatest integer not exceeding \(nt\). Thus at time \(t\), the walk has taken \(m_n=\lfloor nt\rfloor\) steps. For \(t>0\), \(m_n\) grows without bound and \(m_n/n\) approaches \(t\). At \(t=0\), the walk has taken no steps and \(X_n(0)=0\).

Theorem (Fixed-time central limit theorem for the symmetric walk): For each fixed \(t\ge0\), \(X_n(t)\) converges in distribution as \(n\to\infty\) to a centered normal random variable with variance \(t\). At \(t=0\), this means the constant zero. If \((B_t)_{t\ge0}\) is standard Brownian motion, then this limiting law is the law of \(B_t\).

The standard iid central limit theorem used here says that if the summands are independent and identically distributed with mean \(0\), variance \(1\), and finite variance, then their sum divided by the square root of the number of summands converges in distribution to a standard normal random variable. This is the classical central limit theorem; its general proof is a standard result of probability theory. The work here is to apply it with the correct number of steps and spatial scaling. Convergence in distribution means convergence of distribution functions at every continuity point of the limiting distribution function.

Proof and Scaling Details

Proof. Fix \(t>0\), and write \(m_n=\lfloor nt\rfloor\). Since \(t>0\), \(m_n\to\infty\), and for all sufficiently large \(n\), \(m_n\ge1\). The increments \(\xi_k\) have mean \(0\), variance \(1\), and are iid. The iid central limit theorem therefore gives \(S_{m_n}/\sqrt{m_n}\) converging in distribution to a standard normal variable. For these \(n\), set \(c_n=\sqrt{m_n/n}\). Then

$$ X_n(t)=c_n\frac{S_{m_n}}{\sqrt{m_n}}, \qquad \frac{m_n}{n}\longrightarrow t, \qquad c_n\longrightarrow\sqrt t. $$

For completeness, the deterministic scale change preserves the stated limit as follows. Let \(F_n\) be the distribution function of \(S_{m_n}/\sqrt{m_n}\), and let \(\Phi\) be the standard normal distribution function. For any real \(x\), \(c_n>0\) and

$$ \mathbb{P}(X_n(t)\le x)=F_n(x/c_n). $$

Because \(c_n\to\sqrt t>0\), \(x/c_n\to x/\sqrt t\). Given \(\varepsilon>0\), for all sufficiently large \(n\), \(x/\sqrt t-\varepsilon < x/c_n < x/\sqrt t+\varepsilon\). Monotonicity of distribution functions bounds \(F_n(x/c_n)\) between \(F_n(x/\sqrt t-\varepsilon)\) and \(F_n(x/\sqrt t+\varepsilon)\). The central limit theorem gives limits \(\Phi(x/\sqrt t-\varepsilon)\) and \(\Phi(x/\sqrt t+\varepsilon)\) for those bounds. Letting \(\varepsilon\) decrease to zero and using continuity of \(\Phi\), we obtain \(F_n(x/c_n)\to\Phi(x/\sqrt t)\). This is the distribution function of a centered normal variable with variance \(t\). At \(t=0\), \(X_n(0)=S_0/\sqrt n=0\) for every \(n\), so the limit is the constant zero. By the defining marginal law of standard Brownian motion, \(B_t\) is centered normal with variance \(t\) for \(t>0\), and \(B_0=0\). Thus the limiting law agrees with that of \(B_t\). \(\square\)

The distinction between \(m_n\) and \(nt\) is important: the walk takes an integer number of steps, while \(nt\) need not be an integer. The floor causes no change in the limiting variance because \(0\le nt-\lfloor nt\rfloor<1\), and hence \(0\le t-m_n/n<1/n\). The proof does not require the floor to vanish; it requires only that \(m_n/n\to t\) and, for positive \(t\), that \(m_n\to\infty\).

Moment check: For every \(n\) and \(t\ge0\), the rescaled walk has mean \(0\) and variance \(\lfloor nt\rfloor/n\). Consequently its variance converges to \(t\), the variance of the limiting Brownian marginal. Matching means and variances supports the scaling calculation, but by itself does not prove convergence in distribution.

Proof. Put \(m=\lfloor nt\rfloor\). Each increment has \(\mathbb{E}[\xi_k]=\tfrac12(1)+\tfrac12(-1)=0\) and \(\operatorname{Var}(\xi_k)=\mathbb{E}[\xi_k^2]-(\mathbb{E}[\xi_k])^2=1-0=1\). Linearity of expectation gives \(\mathbb{E}[S_m]=0\). Independence makes the covariances between distinct increments zero, so \(\operatorname{Var}(S_m)=\sum_{k=1}^m\operatorname{Var}(\xi_k)=m\), including \(m=0\), when the empty sum is zero. Scaling by \(1/\sqrt n\) gives \(\mathbb{E}[X_n(t)]=0\) and \(\operatorname{Var}(X_n(t))=m/n=\lfloor nt\rfloor/n\). The bound on the floor gives \(\lfloor nt\rfloor/n\to t\). \(\square\)

Worked Fixed-Time Calculations

Worked Example: The Fixed Time \(t=1\)

At time \(t=1\), \(X_n(1)=S_n/\sqrt n\). The number of steps is exactly \(n\), so \(m_n/n=n/n=1\) and the scale factor in the proof is \(c_n=\sqrt{n/n}=1\). The increments are iid with mean \(0\) and variance \(1\), so the central limit theorem applies directly:

$$ \frac{S_n}{\sqrt n}\ \xrightarrow{\ d\ }\ N(0,1). $$

Check: The exact mean is \(\mathbb{E}[S_n/\sqrt n]=0/\sqrt n=0\), and the exact variance is \(\operatorname{Var}(S_n/\sqrt n)=n/n=1\). These agree with the mean and variance of the limiting standard normal law. The distribution is not generally normal for finite \(n\); the conclusion concerns its limit.

Worked Example: The Fixed Time \(t=\tfrac12\)

Here \(m_n=\lfloor n/2\rfloor\), so \(X_n(\tfrac12)=S_{\lfloor n/2\rfloor}/\sqrt n\). For every \(n\), the exact variance is \(\lfloor n/2\rfloor/n\). Since \(0\le n/2-\lfloor n/2\rfloor<1\), division by \(n\) shows that this variance tends to \(1/2\). Also \(m_n\to\infty\), so the central limit theorem applies to the standardized sum.

For a concrete check at \(n=8\), \(m_8=\lfloor8/2\rfloor=4\), and \(X_8(\tfrac12)=S_4/\sqrt8\). The variance is \(4/8=1/2\). The scale-factor calculation is \(c_8=\sqrt{4/8}=1/\sqrt2\). In general, \(c_n=\sqrt{\lfloor n/2\rfloor/n}\to1/\sqrt2\), while \(S_{\lfloor n/2\rfloor}/\sqrt{\lfloor n/2\rfloor}\) converges to \(N(0,1)\). Therefore the limit is \(N(0,1/2)\).

Check: A centered normal variable with variance \(1/2\) has standard deviation \(\sqrt{1/2}\), which is exactly the limiting multiplier \(1/\sqrt2\) applied to a standard normal variable. The finite-\(n\) variance \(4/8=1/2\) at \(n=8\) is an exact value, not an assertion that the finite-step distribution is normal.

Worked Example: The Fixed Time \(t=\tfrac32\)

Now \(m_n=\lfloor3n/2\rfloor\), and the number of steps is asymptotic to \(3n/2\). For instance, at \(n=4\), \(m_4=\lfloor 3\cdot4/2\rfloor=6\), so \(X_4(\tfrac32)=S_6/2\). Its exact mean is \(0\), and its variance is \(6/4=3/2\). More generally, \(m_n/n\to3/2\), and \(m_n\to\infty\). Thus

$$ X_n\left(\tfrac32\right) = \sqrt{\frac{\lfloor3n/2\rfloor}{n}}\, \frac{S_{\lfloor3n/2\rfloor}}{\sqrt{\lfloor3n/2\rfloor}} \ \xrightarrow{\ d\ }\ N\left(0,\tfrac32\right). $$

Check: The multiplier tends to \(\sqrt{3/2}\); multiplying a standard normal variable by this constant gives variance \((\sqrt{3/2})^2=3/2\). At \(n=4\), the computed variance \(6/4=3/2\) agrees with the limiting variance, though the finite-step distribution is still discrete.

Worked Example: Exact Distribution at Four Steps

At \(t=1\) and \(n=4\), \(X_4(1)=S_4/2\). Among the \(2^4=16\) equally likely sequences of four increments, the number with \(r\) positive increments is \(\binom4r\), and the sum is \(2r-4\). For \(r=0,1,2,3,4\), the sums are \(-4,-2,0,2,4\), and the counts are \(1,4,6,4,1\). Thus the values of \(X_4(1)\) are \(-2,-1,0,1,2\), with probabilities \(1/16,4/16,6/16,4/16,1/16\). These probabilities sum to \((1+4+6+4+1)/16=16/16=1\).

The mean is \((-2)(1/16)+(-1)(4/16)+0(6/16)+(1)(4/16)+(2)(1/16)=(-2-4+0+4+2)/16=0\). The second moment, and therefore the variance, is \(4(1/16)+1(4/16)+0(6/16)+1(4/16)+4(1/16)=(4+4+0+4+4)/16=16/16=1\). The mass at zero is \(6/16=3/8\); a standard normal variable has no point mass there. This finite-\(n\) calculation checks the moments and illustrates why convergence in distribution must not be mistaken for equality of distributions at every \(n\).

Why the Hypotheses Matter

The iid assumptions are substantive. For example, let \(\xi_k=Z\) for every \(k\), where \(Z\) is a single random variable with \(\mathbb{P}(Z=1)=\mathbb{P}(Z=-1)=\tfrac12\). Each increment separately is centered with variance \(1\), but the increments are dependent. At \(t=1\), the rescaled sum is \(X_n(1)=\sqrt n\,Z\). For every fixed \(K>0\), \(\mathbb{P}(|X_n(1)|>K)=1\) whenever \(n>K^2\). The distributions therefore do not converge to a finite normal law. Having the right one-step mean and variance does not replace independence.

Centering matters as well. If instead the iid steps have mean \(a\ne0\) and finite variance, then the mean of their uncentered rescaled sum at fixed \(t>0\) is \(a\lfloor nt\rfloor/\sqrt n\), which grows in magnitude like \(|a|t\sqrt n\). This is not the centered Brownian scaling in the theorem. A different centering and, depending on the question, a different scaling would be needed.

Common mistake. A frequent error is to replace \(\sqrt n\) by \(\sqrt{\lfloor nt\rfloor}\) and then report a standard normal limit without accounting for the change of scale. That normalization gives a standard normal limit for \(t>0\), but it is not the process \(X_n(t)=S_{\lfloor nt\rfloor}/\sqrt n\). For the latter, the multiplier is \(\sqrt{\lfloor nt\rfloor/n}\), which tends to \(\sqrt t\); omitting it incorrectly predicts variance \(1\) at every positive time. For example, at \(t=\tfrac12\), the exact variance is \(\lfloor n/2\rfloor/n\to1/2\), not \(1\).

The result is deliberately limited to one fixed time at a time. It identifies the limiting law of \(X_n(t)\) with the Brownian marginal \(B_t\); it does not establish the joint law at multiple times or control fluctuations of the paths between times. Those require additional arguments beyond the ordinary one-dimensional central limit theorem.

Check Your Understanding

Use the fixed-time scaling and the exact variance calculation to answer these questions.

  1. For fixed \(t>0\), what is the number of random-walk steps in \(X_n(t)\), and why does it tend to infinity?
  2. At \(t=2\), determine the limiting distribution and its variance.
  3. At \(t=0\), what is \(X_n(0)\) for every \(n\), and what is its limiting law?
  4. Why does the exact variance alone not prove convergence in distribution?
  5. In the dependent-increment example, calculate \(\mathbb{P}(|X_n(1)|>K)\) for fixed \(K>0\) once \(n>K^2\), and explain what this shows.