Tutorials › Real Analysis › Proof of the Uniform Cauchy Criterion

Sequences of Functions · Tutorial 583 of 1000

Proof of the Uniform Cauchy Criterion

See why uniform Cauchy sequences of real-valued functions converge uniformly, and how the proof relies on completeness of the real numbers.

Advanced 11 min read

What You'll Learn

  • State the uniform Cauchy condition with its quantifiers in the correct order
  • Prove that uniform convergence implies uniform Cauchy behavior
  • Construct a pointwise limit from a uniformly Cauchy sequence using completeness of the real numbers
  • Turn a tail estimate into a uniform error bound against that limit
  • Apply the criterion to a uniformly Cauchy sequence and to a pointwise Cauchy sequence that is not uniformly Cauchy
  • Prove that the space of bounded functions is complete in the supremum norm

What the Criterion Must Establish

The Uniform Cauchy Criterion, stated earlier in this course, says that a sequence of real-valued functions on a nonempty set is uniformly convergent if and only if it is uniformly Cauchy. This tutorial proves both directions. The central issue in the converse is existence: pairwise closeness in late tails must produce an actual function that the sequence approaches.

For real numbers, the ordinary Cauchy criterion gives that existence because the real numbers are complete: every Cauchy sequence of real numbers converges to a real limit. For functions, we apply that fact separately at each input to construct a candidate limit. The uniform part then comes from using the same tail index for every input.

Definition: A sequence \(f_n:E\to\mathbb{R}\) is uniformly Cauchy on \(E\) if for every \(\varepsilon>0\), there is an integer \(N\) such that, whenever \(m,n\geq N\) and \(x\in E\), \[ |f_m(x)-f_n(x)|<\varepsilon. \] The index \(N\) may depend on \(\varepsilon\), but it must not depend on \(x\).

The order of these requirements matters. First choose an accuracy \(\varepsilon\); then choose one tail index \(N\); after that, the estimate must work for every pair of indices in the tail and every input in the domain. If the required index changes with \(x\), the condition is only pointwise Cauchy behavior, not uniform Cauchy behavior.

Uniform Convergence Implies Uniform Cauchy Behavior

Suppose \(f_n\) converges uniformly to a function \(f\). Then every sufficiently late function is uniformly close to \(f\). Two late functions are close to one another by the triangle inequality, since each is close to the same \(f\).

Proposition (Uniform Convergence Implies Uniform Cauchy Behavior): Let \(E\) be nonempty. If \(f_n:E\to\mathbb{R}\) converges uniformly on \(E\), then \((f_n)\) is uniformly Cauchy on \(E\).

Proof. Let \(\varepsilon>0\). Uniform convergence gives an integer \(N\) such that for every \(n\geq N\) and every \(x\in E\),

$$ |f_n(x)-f(x)|<\frac{\varepsilon}{2}. $$

If \(m,n\geq N\), then for every \(x\in E\), the triangle inequality gives

$$ |f_m(x)-f_n(x)| \leq |f_m(x)-f(x)|+|f_n(x)-f(x)| <\frac{\varepsilon}{2}+\frac{\varepsilon}{2} =\varepsilon. $$

The same \(N\) works for every \(x\), so the sequence is uniformly Cauchy. \(\square\)

This direction uses no completeness assumption: it only uses the existence of a uniform limit and the triangle inequality. The converse is where completeness of \(\mathbb{R}\) becomes essential.

Constructing the Limit from the Uniform Cauchy Condition

Now suppose \((f_n)\) is uniformly Cauchy on \(E\). Fix any \(x\in E\). The uniform Cauchy condition implies that the real sequence \(f_n(x)\) is Cauchy: for each positive accuracy, the same tail index works at this particular input. Completeness of \(\mathbb{R}\) therefore gives a real limit. Define \(f(x)\) to be that limit.

This construction defines a function \(f:E\to\mathbb{R}\), because for each \(x\) the limit exists and is unique. To prove uniform convergence, we must do more than know that each \(f_n(x)\) tends to \(f(x)\). We must use one index that controls the error simultaneously at every input.

Theorem (Uniform Cauchy Criterion): Let \(E\) be nonempty and let \(f_n:E\to\mathbb{R}\). The sequence \((f_n)\) converges uniformly on \(E\) to a function \(f:E\to\mathbb{R}\) if and only if \((f_n)\) is uniformly Cauchy on \(E\).

Proof. The forward direction is the proposition just proved. For the converse, assume \((f_n)\) is uniformly Cauchy on \(E\).

Fix \(x\in E\). Given \(\varepsilon>0\), choose \(N\) from the uniform Cauchy condition. For \(m,n\geq N\), we then have

$$ |f_m(x)-f_n(x)|<\varepsilon. $$

Thus \((f_n(x))\) is a Cauchy sequence of real numbers. By completeness of \(\mathbb{R}\), it converges. Define

$$ f(x)=\lim_{n\to\infty}f_n(x) \qquad\text{for every }x\in E. $$

It remains to prove uniform convergence to \(f\). Let \(\varepsilon>0\). Since \((f_n)\) is uniformly Cauchy, there is one \(N\) such that for every \(m,n\geq N\) and every \(x\in E\),

$$ |f_n(x)-f_m(x)|<\frac{\varepsilon}{2}. $$

Fix any \(n\geq N\) and any \(x\in E\). In this inequality, let \(m\) tend to infinity. By the definition of \(f(x)\), \(f_m(x)\to f(x)\). Continuity of the absolute value gives

$$ |f_n(x)-f(x)|\leq\frac{\varepsilon}{2}<\varepsilon. $$

The index \(N\) was chosen independently of \(x\), and the last estimate holds for every \(n\geq N\) and every \(x\in E\). This is uniform convergence of \(f_n\) to \(f\). \(\square\)

The limit step may change the strict pairwise inequality into a non-strict inequality: a sequence of numbers all less than \(\varepsilon/2\) can converge to \(\varepsilon/2\). That causes no difficulty, because \(\varepsilon/2\) is still strictly less than the requested accuracy \(\varepsilon\).

Worked Examples Using the Criterion

Worked Example: Geometric Partial Sums on a Closed Interval

For \(n\geq0\), define \(s_n:[-2,2]\to\mathbb{R}\) by \[ s_n(x)=\sum_{k=0}^{n}\left(\frac{x}{5}\right)^k. \] We verify the uniform Cauchy condition directly. If \(m\geq n\geq N\), then

$$ |s_m(x)-s_n(x)| =\left|\sum_{k=n+1}^{m}\left(\frac{x}{5}\right)^k\right| \leq\sum_{k=n+1}^{m}\left|\frac{x}{5}\right|^k \leq\sum_{k=N+1}^{\infty}\left(\frac{2}{5}\right)^k. $$

The final geometric series has sum

$$ \sum_{k=N+1}^{\infty}\left(\frac{2}{5}\right)^k =\frac{(2/5)^{N+1}}{1-2/5} =\frac{5}{3}\left(\frac{2}{5}\right)^{N+1}. $$

If \(n\geq m\geq N\), interchanging the roles of \(m\) and \(n\) gives the same bound. Since \(\frac{5}{3}(\frac{2}{5})^{N+1}\) tends to zero, for every \(\varepsilon>0\) we can choose \(N\) so this bound is less than \(\varepsilon\). The sequence is uniformly Cauchy, and the Uniform Cauchy Criterion guarantees a uniform limit on \([-2,2]\).

Worked Example: A Uniformly Cauchy Sequence with a Simple Limit

For \(n\geq1\), define \(g_n:[0,\infty)\to\mathbb{R}\) by \[ g_n(x)=\sqrt{x^2+\frac{1}{n}}. \] The inequality \(\sqrt{a+b}\leq\sqrt a+\sqrt b\), valid for \(a,b\geq0\), follows by squaring the nonnegative right-hand side. It gives

$$ 0\leq g_n(x)-x \leq \frac{1}{\sqrt n} \qquad(x\geq0). $$

Indeed, \(g_n(x)\geq x\), and \[ g_n(x)=\sqrt{x^2+\frac{1}{n}}\leq \sqrt{x^2}+\sqrt{\frac{1}{n}}=x+\frac{1}{\sqrt n}. \] Thus \(g_n\) converges uniformly to \(g(x)=x\). We can also see uniform Cauchy behavior directly. For \(m,n\geq N\), the triangle inequality gives

$$ |g_m(x)-g_n(x)| \leq |g_m(x)-x|+|g_n(x)-x| \leq\frac{1}{\sqrt m}+\frac{1}{\sqrt n} \leq\frac{2}{\sqrt N}. $$

Given \(\varepsilon>0\), choose \(N\) large enough that \(2/\sqrt N<\varepsilon\). This bound holds for every \(x\geq0\), proving that the sequence is uniformly Cauchy. The example also illustrates that the domain need not be bounded for the criterion to apply.

Worked Example: Pointwise Cauchy but Not Uniformly Cauchy

For \(n\geq1\), define \(h_n:[0,\infty)\to\mathbb{R}\) by \[ h_n(x)=\frac{nx}{(1+nx)^2}. \] At \(x=0\), \(h_n(0)=0\) for every \(n\). If \(x>0\), then

$$ 0\leq h_n(x)=\frac{nx}{(1+nx)^2} \leq\frac{nx}{n^2x^2} =\frac{1}{nx}. $$

Consequently, \(h_n(x)\to0\) at every fixed \(x\geq0\), so the sequence is pointwise Cauchy. But for every positive integer \(N\), choose \(x=1/N\) and compare indices \(N\) and \(2N\). Substitution gives

$$ h_N(1/N)=\frac{1}{(1+1)^2}=\frac14, \qquad h_{2N}(1/N)=\frac{2}{(1+2)^2}=\frac29, \qquad |h_N(1/N)-h_{2N}(1/N)|=\frac{1}{36}. $$

Both indices are at least \(N\), but their values at this input differ by \(1/36\). For example, the uniform Cauchy condition with \(\varepsilon=1/72\) fails for every possible tail index. The input used in the comparison changes with \(N\), which is allowed when testing uniform behavior. Pointwise Cauchy behavior alone therefore does not imply uniform Cauchy behavior.

A Consequence: Bounded Functions Form a Complete Space

The criterion also proves a useful completeness result for the supremum norm. Recall that \(B(E)\) is the set of bounded real-valued functions on \(E\), with \(\|u\|_\infty=\sup_{x\in E}|u(x)|\). A Cauchy sequence in this norm is exactly a uniformly Cauchy sequence, because \[ \|f_m-f_n\|_\infty<\varepsilon \] means that \(|f_m(x)-f_n(x)|<\varepsilon\) for every \(x\in E\).

Theorem (Completeness of the Bounded Functions): If \(E\) is nonempty, every Cauchy sequence in \(B(E)\), with the supremum norm, converges in that norm to a function in \(B(E)\).

Proof. Let \((f_n)\) be Cauchy in \(B(E)\). It is uniformly Cauchy, so the Uniform Cauchy Criterion gives a function \(f:E\to\mathbb{R}\) such that \(f_n\to f\) uniformly. We must check that \(f\) is bounded; uniform convergence alone does not make this automatic without an additional argument.

Choose an index \(N\) such that \[ |f_n(x)-f_N(x)|<1 \] for every \(n\geq N\) and every \(x\in E\). Fix \(x\) and let \(n\) tend to infinity. Since \(f_n(x)\to f(x)\), continuity of absolute value gives

$$ |f(x)-f_N(x)|\leq1. $$

Therefore, for every \(x\in E\),

$$ |f(x)|\leq |f_N(x)|+1\leq \|f_N\|_\infty+1. $$

The right-hand side is finite because \(f_N\in B(E)\). Hence \(f\in B(E)\). Uniform convergence is convergence in the supremum norm, so \((f_n)\) converges in \(B(E)\), as required. \(\square\)

The boundedness check is an important final step: the pointwise limit produced by the criterion is initially just a real-valued function. To conclude convergence within \(B(E)\), we must show that this limit also belongs to \(B(E)\).

Reading the Proof as a Quantifier Argument

The key distinction between the two halves of the criterion is where the limit comes from. If uniform convergence is already known, the triangle inequality compares two terms through that limit. If uniform Cauchy behavior is known instead, completeness of \(\mathbb{R}\) first produces a limit at each point, and the uniform tail estimate then controls the error to it.

1
Fix an input to construct the limit.
The uniform Cauchy condition implies that the real sequence of values at this input is Cauchy, so completeness of \(\mathbb{R}\) gives its limit.
2
Define the candidate function.
Assign to each input the limit of the corresponding sequence of real values.
3
Keep the tail index fixed across the domain.
Use the uniform Cauchy condition to bound the difference between a late term and every later term, then pass the later index to infinity.

A common pitfall is to prove only that \(f_n(x)\) is Cauchy for each fixed \(x\). That establishes pointwise convergence, but says nothing by itself about one index working over the whole domain. In the converse proof, the same index \(N\) controls all inputs because it was chosen from the uniform Cauchy condition before the input \(x\) was fixed. This is the step that upgrades pointwise convergence to uniform convergence.

Takeaway: Uniform Cauchy behavior supplies one tail estimate for every input. Completeness of the real numbers turns the pointwise Cauchy sequences into a function, and passing one index to its limit converts the tail estimate into uniform convergence.

Check Your Understanding

Use the proof and examples above to answer the following questions.

  1. In the forward direction, why is it useful to compare two late functions through their common uniform limit?
  2. Where does completeness of the real numbers enter the converse proof?
  3. Why does the limit step in the converse yield a non-strict bound, and why is that enough?
  4. For the functions \(h_n(x)=nx/(1+nx)^2\), which inputs and indices give a persistent difference in every tail?
  5. When proving completeness of \(B(E)\), why must the pointwise limit be shown to be bounded?