Tutorials › Topology (Undergraduate) › Arzela-Ascoli Theorem For Compact Metric Domains

Compactness and Function Spaces · Tutorial 568 of 799

Arzela-Ascoli Theorem For Compact Metric Domains

Learn how uniform equicontinuity and pointwise relative compactness together characterize relative compactness in the uniform metric.

Advanced 12 min read

What You'll Learn

  • Define relative compactness and the uniform metric on \(C(K,Y)\)
  • State the Arzelà–Ascoli criterion for compact metric domains and complete metric targets
  • Prove why relative compactness implies equicontinuity and pointwise relative compactness
  • Prove how equicontinuity and pointwise relative compactness yield total boundedness
  • Apply the criterion to bounded families of affine and constant functions
  • Identify how pointwise compactness can hold while equicontinuity fails

Compactness for Families of Functions

A family of continuous functions can have bounded values at every point and still fail to be compact in a metric that measures uniform error. The missing ingredient is control of how rapidly the functions can change as the input varies. The Arzelà–Ascoli theorem makes this distinction precise: on a compact metric domain, equicontinuity together with pointwise relative compactness is exactly the condition for relative compactness in the uniform metric, provided the target is complete.

Let \((K,d_K)\) be a compact metric space and \((Y,d_Y)\) a metric space. Write \(C(K,Y)\) for the set of continuous functions from \(K\) to \(Y\). For \(f,g\in C(K,Y)\), define the uniform metric by \[ d_\infty(f,g)=\sup_{x\in K}d_Y(f(x),g(x)). \] The supremum is finite: \(f(K)\) and \(g(K)\) are compact, hence bounded in \(Y\). If \(K\) is empty, there is just one function from \(K\) to \(Y\), and \(C(K,Y)\) is a one-point metric space with distance zero.

Definition: A family \(F\subseteq C(K,Y)\) is equicontinuous if for every \(\varepsilon>0\) there is a \(\delta>0\) such that, for every \(f\in F\) and every \(x,y\in K\), \(d_K(x,y)<\delta\) implies \(d_Y(f(x),f(y))<\varepsilon\). It is pointwise relatively compact if, for every \(x\in K\), the set \(F(x)=\{f(x):f\in F\}\) has compact closure in \(Y\). A family is relatively compact in \(C(K,Y)\) if its closure in the uniform metric is compact.

Equicontinuity requires one \(\delta\) to work for every function in the family. Pointwise relative compactness, by contrast, concerns the values at one fixed input at a time. The theorem combines these different kinds of control.

Theorem (Arzelà–Ascoli for compact metric domains): Let \(K\) be a compact metric space and \(Y\) a complete metric space. A family \(F\subseteq C(K,Y)\) is relatively compact in the uniform metric if and only if it is equicontinuous and pointwise relatively compact.

Why Relative Compactness Gives the Two Conditions

We first prove the forward direction. Suppose the uniform closure \(H=\overline{F}\) is compact. Fix \(x\in K\). The evaluation map \(e_x:C(K,Y)\to Y\), defined by \(e_x(f)=f(x)\), is continuous, because \[ d_Y(e_x(f),e_x(g))=d_Y(f(x),g(x))\leq d_\infty(f,g). \] Thus \(e_x(H)\) is compact. It contains \(F(x)\), so the closure of \(F(x)\) is a closed subset of the compact set \(e_x(H)\), and is compact. Here we use the standard fact that compact subsets of a metric space are closed.

To show equicontinuity, fix \(\varepsilon>0\). Compactness of \(H\) gives finitely many functions \(g_1,\ldots,g_m\in H\) such that every \(f\in H\) satisfies \(d_\infty(f,g_i)<\varepsilon/3\) for some \(i\). Each \(g_i\) is uniformly continuous on the compact metric space \(K\). Taking the minimum of the finitely many resulting positive distance thresholds gives a single \(\delta>0\) such that \(d_K(x,y)<\delta\) implies \(d_Y(g_i(x),g_i(y))<\varepsilon/3\) for every \(i\). For \(f\in H\), choose a corresponding \(g_i\). Then \[ d_Y(f(x),f(y)) \leq d_Y(f(x),g_i(x))+d_Y(g_i(x),g_i(y))+d_Y(g_i(y),f(y)) <\varepsilon. \] This proves equicontinuity of \(H\), and hence of \(F\).

Why the Two Conditions Give Relative Compactness

For the converse, we build finite uniform approximations to \(F\). A subset of a metric space is called totally bounded if, for every positive radius, finitely many open balls of that radius cover it. We will show that \(F\) is totally bounded, then use completeness.

Assume \(F\) is equicontinuous and pointwise relatively compact, and fix \(\varepsilon>0\). Choose \(\delta>0\) from equicontinuity for the error \(\varepsilon/3\). Compactness of \(K\) gives points \(x_1,\ldots,x_m\in K\) such that the balls \(B(x_i,\delta)\) cover \(K\). For each \(i\), pointwise relative compactness implies that \(F(x_i)\) has a finite \(\varepsilon/6\)-net: finitely many points of \(Y\) such that every element of \(F(x_i)\) is within distance \(\varepsilon/6\) of one of them.

Assign to each \(f\in F\), at each \(x_i\), one of the finitely many net points within \(\varepsilon/6\) of \(f(x_i)\). There are only finitely many possible lists of assignments. For each list that occurs, choose one function \(g\in F\) with that list. If \(f\) and \(g\) have the same list, then at every \(x_i\), \(d_Y(f(x_i),g(x_i))<2(\varepsilon/6)=\varepsilon/3\). For any \(x\in K\), choose \(i\) with \(d_K(x,x_i)<\delta\). Equicontinuity applies to both functions, so \[ d_Y(f(x),g(x)) \leq d_Y(f(x),f(x_i))+d_Y(f(x_i),g(x_i))+d_Y(g(x_i),g(x)) <\frac{\varepsilon}{3}+\frac{\varepsilon}{3}+\frac{\varepsilon}{3} =\varepsilon. \] Thus these finitely many chosen functions give an \(\varepsilon\)-cover of \(F\). The family \(F\) is totally bounded.

The closure of a totally bounded set is totally bounded: cover \(F\) by finitely many balls of radius \(\varepsilon/2\); the corresponding closed balls of radius \(\varepsilon/2\) contain its closure, and are contained in the open balls with the same centers and radius \(\varepsilon\). It remains to verify completeness and the metric compactness fact needed here.

Lemma: If \(Y\) is complete and \(K\) is compact, then \(C(K,Y)\) with the uniform metric is complete.

Proof. Let \((f_n)\) be Cauchy in \(d_\infty\). For each \(x\in K\), the inequality \(d_Y(f_n(x),f_m(x))\leq d_\infty(f_n,f_m)\) shows that \((f_n(x))\) is Cauchy in \(Y\). Completeness of \(Y\) gives a limit \(f(x)\in Y\). To prove uniform convergence, let \(\varepsilon>0\). There is \(N\) such that \(d_\infty(f_n,f_m)<\varepsilon/2\) whenever \(n,m\geq N\). Fix \(n\geq N\) and \(x\in K\), and let \(m\) tend to infinity in \(d_Y(f_n(x),f_m(x))<\varepsilon/2\). Continuity of the metric gives \(d_Y(f_n(x),f(x))\leq\varepsilon/2\). This bound holds for every \(x\), so \(d_\infty(f_n,f)\leq\varepsilon/2<\varepsilon\). Thus \(f_n\) converges uniformly to \(f\).

It remains to check that \(f\) is continuous. Fix \(x\in K\) and \(\varepsilon>0\). Choose \(n\) with \(d_\infty(f_n,f)<\varepsilon/3\). Continuity of \(f_n\) at \(x\) gives \(\delta>0\) such that \(d_K(x,y)<\delta\) implies \(d_Y(f_n(x),f_n(y))<\varepsilon/3\). Then \(d_Y(f(x),f(y))<\varepsilon/3+\varepsilon/3+\varepsilon/3=\varepsilon\). So \(f\) is continuous and belongs to \(C(K,Y)\). Every Cauchy sequence therefore converges in \(C(K,Y)\). \(\square\)

We also use the metric-space fact that a complete, totally bounded metric space is compact. One direct proof is as follows. Given an open cover with no finite subcover, cover the space by finitely many closed balls of radius \(1/4\). At least one intersection of such a ball with the space cannot be covered by finitely many members of the open cover. Repeat inside that intersection, using finite covers by closed balls with radii tending to zero, and each time retain an intersection that still has no finite subcover. This gives nested nonempty closed sets with diameters tending to zero. Choose one point from each set; the nested property and shrinking diameters make the chosen points Cauchy. Completeness gives a limit, which belongs to every closed set. Some member of the original open cover contains a ball about that limit, so a sufficiently small one of the nested sets lies inside that member. That set then has a finite subcover, a contradiction.

Now \(C(K,Y)\) is complete by the lemma, so its closed subset \(\overline{F}\) is complete. We have shown \(\overline{F}\) is totally bounded, and the metric-space fact makes it compact. Hence \(F\) is relatively compact. If \(K\) is empty, \(C(K,Y)\) is a singleton, and both conditions and the conclusion hold directly. This completes the theorem.

Using the Criterion

Worked Example: A Bounded Family of Affine Functions

Let \(K=[0,1]\) with its usual metric, \(Y=\mathbb{R}\) with its usual metric, and \(F=\{f_a:a\in[0,2]\}\), where \(f_a(x)=ax\). We verify the two conditions.

For \(x,y\in[0,1]\) and \(a\in[0,2]\), \[ |f_a(x)-f_a(y)|=|a||x-y|\leq 2|x-y|. \] Given \(\varepsilon>0\), take \(\delta=\varepsilon/2\). If \(|x-y|<\delta\), then \(|f_a(x)-f_a(y)|\leq2|x-y|<\varepsilon\) for every \(a\). Thus \(F\) is equicontinuous.

At a fixed \(x\in[0,1]\), the set of values is \(F(x)=\{ax:0\leq a\leq2\}=[0,2x]\). This includes the case \(x=0\), when \(F(0)=\{0\}\). In every case it is a closed bounded interval and hence compact in \(\mathbb{R}\). The theorem shows that \(F\) is relatively compact in \(C([0,1],\mathbb{R})\).

Check: at \(x=1/2\), \(F(x)=[0,1]\), since \(a/2\) ranges from \(0\) to \(1\). Also, when \(|x-y|=1/10\), the displayed estimate gives \(|f_a(x)-f_a(y)|\leq2(1/10)=1/5\), uniformly for all \(a\in[0,2]\).

Worked Example: Constant Functions

Let \(K=[0,1]\), \(Y=\mathbb{R}\), and let \(F\) consist of all constant functions \(f_c(x)=c\) with \(c\in[-1,1]\). For any \(x,y\in K\) and any \(c\in[-1,1]\), \[ |f_c(x)-f_c(y)|=|c-c|=0. \] Thus the equicontinuity condition holds for every \(\varepsilon>0\) and any \(\delta>0\).

For each fixed \(x\), \(F(x)=[-1,1]\), which is compact in \(\mathbb{R}\). Arzelà–Ascoli therefore gives relative compactness. In fact this family is compact: for \(c,d\in[-1,1]\), \[ d_\infty(f_c,f_d)=\sup_{x\in[0,1]}|c-d|=|c-d|. \] The map taking \(c\) to \(f_c\) preserves distances, so it identifies the compact interval \([-1,1]\) with this family.

Check: with \(c=-1/2\) and \(d=1/4\), the distance is \(|-1/2-1/4|=3/4\) at every \(x\); consequently its supremum is also \(3/4\).

Worked Example: Pointwise Compactness Without Equicontinuity

Let \(K=[0,1]\), \(Y=\mathbb{R}\), and \(F=\{f_n:n\in\mathbb{N}\}\), where \(f_n(x)=x^n\). For each fixed \(x\in[0,1]\), every value \(x^n\) lies in \([0,1]\). Hence \(F(x)\subseteq[0,1]\), and its closure is a closed subset of the compact interval \([0,1]\). The family is pointwise relatively compact.

It is not equicontinuous at \(x=1\). For each \(n\in\mathbb{N}\), set \(y_n=2^{-1/n}\). Then \(y_n\in[0,1]\), \(y_n\to1\), and \[ |f_n(1)-f_n(y_n)|=|1-(2^{-1/n})^n|=|1-1/2|=1/2. \] For \(\varepsilon=1/3\), any proposed \(\delta>0\) fails: choose \(n\) large enough that \(1-y_n<\delta\); the corresponding function still changes by \(1/2>1/3\). Thus the family is not equicontinuous and, by the theorem, is not relatively compact.

Check: the input distance is \(1-2^{-1/n}\), which tends to \(0\), while the output difference is exactly \(1/2\) for every \(n\). The fixed positive output difference verifies the failure of the uniform equicontinuity requirement.

A Common Pitfall

Pointwise relative compactness is not a substitute for equicontinuity. In the last example, every fixed input produces values in the compact interval \([0,1]\); that fact alone does not control the functions uniformly as the input changes. A related error is to allow the distance threshold \(\delta\) to depend on the function. Equicontinuity requires one \(\delta\) for all members of \(F\) at the chosen error tolerance. The calculation with \(f_n(x)=x^n\) shows why that shared threshold matters: the functions can change by \(1/2\) across input distances tending to zero.

The assumptions have distinct roles. Compactness of \(K\) supplies finitely many input locations that control all of the domain. Completeness of \(Y\) ensures that uniform Cauchy limits take values in \(Y\), so the closure remains complete. The conclusion concerns compactness in the uniform metric, not merely compactness of each set of values \(F(x)\).

Check Your Understanding

For each question, identify which hypothesis or part of the criterion is being tested.

  1. For \(F=\{f_a(x)=ax:a\in[-3,1]\}\) on \([0,1]\) with target \(\mathbb{R}\), give a \(\delta\) that works for a prescribed \(\varepsilon>0\) in the equicontinuity test.
  2. For the family of constant functions \(f_c(x)=c\) with \(c\in[2,5]\), determine \(F(x)\) at an arbitrary fixed \(x\), and state whether it is compact.
  3. Explain why pointwise relative compactness alone does not imply relative compactness for \(f_n(x)=x^n\) on \([0,1]\).
  4. In the proof of sufficiency, why are finitely many points \(x_i\) enough to control function values throughout \(K\)?
  5. Which step in the theorem's proof uses completeness of \(Y\), and which step uses compactness of \(K\)?