Tutorials › Real Analysis › Sequences in Finite-Dimensional Spaces

Function Spaces · Tutorial 624 of 1000

Sequences in Finite-Dimensional Spaces

Finite-dimensional sequences can be understood through coordinates: norm convergence is coordinate convergence, and bounded sequences always have convergent subsequences.

Advanced 10 min read

What You'll Learn

  • Translate norm convergence into convergence of each coordinate in a fixed basis
  • Use equivalence of norms to compare coordinate bounds with norm bounds
  • Prove the finite-dimensional Bolzano–Weierstrass theorem by successive subsequence extraction
  • Distinguish a convergent sequence from a bounded sequence with convergent subsequences
  • Apply the results to vectors, matrices, and finite-dimensional polynomial spaces

Sequences Through Coordinates

In a finite-dimensional space, a basis represents every vector by finitely many real coordinates. This makes sequences easier to analyze: convergence of vectors can be tested coordinate by coordinate, and bounded sequences can be handled by applying the Bolzano–Weierstrass Theorem to those coordinates. The previous tutorial proved that all norms on a finite-dimensional space are equivalent. We now use that result to study sequences without requiring a special formula for the norm.

Fix a real vector space \(V\) of dimension \(d\geq1\), a basis \(e_1,\ldots,e_d\), and a norm \(N\) on \(V\). Write each vector \(x\in V\) uniquely as \(x=\sum_{i=1}^d a_i e_i\), and define its coordinate Euclidean norm by

$$ |x|_2=\left(\sum_{i=1}^d a_i^2\right)^{1/2}. $$

The Proposition (A Norm Is Comparable to a Coordinate Norm) from the previous tutorial gives constants \(m,C>0\) such that

$$ m|x|_2\leq N(x)\leq C|x|_2 \qquad\text{for every }x\in V. $$

These two inequalities connect the norm used in the problem to the coordinates supplied by the basis. In particular, they allow us to characterize convergence exactly.

Theorem (Coordinate Characterization of Norm Convergence): Let \(x_n=\sum_{i=1}^d a_{n,i}e_i\) and \(x=\sum_{i=1}^d a_i e_i\). Then \(x_n\to x\) in the norm \(N\) if and only if \(a_{n,i}\to a_i\) in \(\mathbb{R}\) for every \(i=1,\ldots,d\).

Proof. Suppose first that \(x_n\to x\) in \(N\). The lower comparison bound gives

$$ |x_n-x|_2\leq \frac{1}{m}N(x_n-x)\longrightarrow 0. $$

For each coordinate, \(|a_{n,i}-a_i|\leq |x_n-x|_2\), since the square of the Euclidean norm is the sum of the squares of all coordinate differences. Therefore \(a_{n,i}\to a_i\) for every \(i\).

Conversely, suppose that every coordinate sequence converges to its corresponding coordinate. Given \(\varepsilon>0\), for each \(i\) there is an index \(n_i\) such that \(|a_{n,i}-a_i|<\varepsilon/(C\sqrt d)\) whenever \(n\geq n_i\). Since there are only finitely many coordinates, \(n_0=\max\{n_1,\ldots,n_d\}\) is defined. For \(n\geq n_0\), the upper comparison bound yields

$$ N(x_n-x)\leq C|x_n-x|_2 =C\left(\sum_{i=1}^d |a_{n,i}-a_i|^2\right)^{1/2} < C\left(d\frac{\varepsilon^2}{C^2d}\right)^{1/2} =\varepsilon. $$

Thus \(x_n\to x\) in \(N\). \(\square\)

The proof uses finite dimension in an important way: we take the maximum of finitely many coordinate thresholds. Coordinatewise convergence in an infinite list of coordinates does not automatically provide one threshold that works for every coordinate at once. Here the number of coordinates is fixed and finite.

Worked Example: Convergence in a Weighted Norm on \(\mathbb{R}^2\)

On \(\mathbb{R}^2\), let \(N(x,y)=|x|+3|y|\), and consider \(z_n=(1/n,(-1)^n/n)\). Both coordinates tend to zero, so the Coordinate Characterization of Norm Convergence implies that \(z_n\to(0,0)\) in \(N\). Directly, the norm error is

$$ N(z_n-(0,0))=\left|\frac1n\right|+3\left|\frac{(-1)^n}{n}\right| =\frac1n+\frac3n=\frac4n\longrightarrow0. $$

This calculation also verifies the conclusion without relying on the characterization. The sign alternation in the second coordinate does not prevent convergence because its magnitude still tends to zero.

Bounded Sequences Have Convergent Subsequences

A sequence \((x_n)\) in a normed space is bounded if there is a finite \(M\geq0\) such that \(N(x_n)\leq M\) for every \(n\). In finite dimensions, this condition bounds every coordinate. Indeed, the lower comparison bound gives \(m|x_n|_2\leq M\), and each coordinate has absolute value at most \(|x_n|_2\). The Bolzano–Weierstrass Theorem for real sequences can then be applied repeatedly, one coordinate at a time.

Theorem (Bolzano–Weierstrass Theorem in Finite Dimensions): Every bounded sequence in a finite-dimensional normed space has a convergent subsequence.

Proof. If \(V=\{0\}\), every term is zero, so the sequence itself converges. Otherwise, let \(d\geq1\), choose a basis, and write \(x_n=\sum_{i=1}^d a_{n,i}e_i\). Let \(m>0\) be the lower comparison constant for \(N\) and the coordinate Euclidean norm. If \(N(x_n)\leq M\) for every \(n\), then

$$ |a_{n,i}|\leq |x_n|_2\leq \frac{M}{m} \qquad\text{for every }n\text{ and }i. $$

Thus the first coordinate sequence is bounded in \(\mathbb{R}\). By the Bolzano–Weierstrass Theorem, it has a convergent subsequence. Denote the corresponding indices by \(n^{(1)}_1<n^{(1)}_2<\cdots\). Along these indices, the second coordinate remains a bounded real sequence, so it has a convergent subsequence. This gives indices \(n^{(2)}_1<n^{(2)}_2<\cdots\), each drawn from the first subsequence, along which both the first and second coordinates converge. Continue in this way through the finite list of \(d\) coordinates. After the \(d\)-th extraction, there are increasing indices \(k_1<k_2<\cdots\) such that every coordinate of \(x_{k_j}\) converges as \(j\to\infty\).

Let \(a_i\) be the limit of the \(i\)-th coordinate along this final subsequence, and set \(x=\sum_{i=1}^d a_i e_i\in V\). The Coordinate Characterization of Norm Convergence now gives \(x_{k_j}\to x\) in \(N\). Hence the original bounded sequence has a convergent subsequence. \(\square\)

The repeated extraction is a finite process, not an infinite one: one extraction is made for each of the \(d\) coordinates. A subsequence of a convergent real sequence still converges to the same limit, so later extractions do not undo convergence already obtained for earlier coordinates.

Worked Example: A Bounded Matrix Sequence with Two Subsequence Limits

Regard the \(2\)-by-\(2\) real matrices as a four-dimensional vector space, with Frobenius norm \(\|A\|_F=(\sum_{i,j=1}^2 A_{ij}^2)^{1/2}\). Define

$$ A_n= \begin{pmatrix} 1+\frac1n & (-1)^n\\ 0 & 2-\frac1n \end{pmatrix}. $$

The entries are bounded: \(1\leq1+1/n\leq2\), \(|(-1)^n|=1\), and \(1\leq2-1/n<2\). Consequently,

$$ \|A_n\|_F^2 =\left(1+\frac1n\right)^2+1+\left(2-\frac1n\right)^2 \leq 4+1+4=9. $$

So the sequence is bounded, but its upper-right entry alternates between \(1\) and \(-1\), and therefore the whole sequence does not converge. The even-indexed terms converge entry by entry to

$$ \begin{pmatrix}1&1\\0&2\end{pmatrix}, \qquad \text{while the odd-indexed terms converge to } \begin{pmatrix}1&-1\\0&2\end{pmatrix}. $$

Each entry has the stated limit: \(1/n\to0\), \(2-1/n\to2\), and the upper-right entry is constantly \(1\) on even indices and constantly \(-1\) on odd indices. The Coordinate Characterization gives convergence in the Frobenius norm along each of these subsequences. This example shows why the theorem guarantees a convergent subsequence, not convergence of the whole sequence.

Worked Example: Convergence of Polynomials from Their Coefficients

Let \(V=\mathcal{P}_2\), the space of polynomials of degree at most two, equipped with the supremum norm on \([0,1]\). Consider

$$ p_n(t)=\left(2+\frac1n\right)+\left(1-\frac2n\right)t+\frac{(-1)^n}{n}t^2. $$

In the basis \(1,t,t^2\), the three coefficients converge respectively to \(2\), \(1\), and \(0\). The Coordinate Characterization therefore gives convergence in the supremum norm to \(p(t)=2+t\). To verify the norm estimate directly, for \(0\leq t\leq1\),

$$ |p_n(t)-p(t)| =\left|\frac1n-\frac{2t}{n}+\frac{(-1)^nt^2}{n}\right| \leq\frac{1+2t+t^2}{n} \leq\frac4n. $$

Taking the supremum over \(t\in[0,1]\) gives \(\|p_n-p\|_\infty\leq4/n\to0\). The example illustrates why finite-dimensional function spaces behave like coordinate spaces even when their elements are functions: once a basis is fixed, only finitely many scalar coefficients must be controlled.

What These Sequence Results Do—and Do Not—Say

The bounded-subsequence theorem is a central compactness principle. In finite dimensions, boundedness prevents coordinates from escaping to infinity, while successive applications of the real Bolzano–Weierstrass Theorem produce a subsequence whose coordinates all settle to limits. The coordinate characterization then turns those scalar limits into convergence in the norm on \(V\).

The exact numerical norm is not essential. The Sequential and Boundedness Invariance theorem from the previous tutorial states that equivalent norms give the same convergent sequences and bounded sequences. Alternatively, the comparison constants above show directly why the coordinate argument works for any norm on \(V\). A bound in \(N\) bounds the coordinates, and coordinate convergence implies convergence in \(N\).

Do not confuse boundedness with convergence. The matrix example is bounded but does not converge; its different subsequences have different limits. Nor does the theorem say that every sequence has a convergent subsequence: boundedness is a necessary hypothesis. For example, the sequence \(x_n=ne_1\), where \(e_1\neq0\), is unbounded because \(N(x_n)=nN(e_1)\to\infty\).

The theorem also identifies the role of finite dimension. There are only finitely many coordinates to control, so successive extraction ends after finitely many steps. In an infinite-dimensional space, bounded sequences need not have convergent subsequences. For instance, in the space of square-summable sequences with its usual norm, the unit vectors \(u_n\) satisfy \(\|u_n-u_k\|_2=\sqrt2\) whenever \(n\neq k\). No subsequence can converge, since every convergent sequence is Cauchy.

Takeaway: In a finite-dimensional normed space, convergence is exactly coordinatewise convergence in any fixed basis, and every bounded sequence has a convergent subsequence. The proof combines norm equivalence with finitely many applications of the real Bolzano–Weierstrass Theorem.

Check Your Understanding

Use the coordinate characterization and the bounded-subsequence theorem to answer the following questions.

  1. Why does convergence in a norm imply convergence of every coordinate in a fixed basis?
  2. Where does finite dimension enter the proof that coordinate convergence implies norm convergence?
  3. How does a norm bound give a bound on every coordinate of a sequence?
  4. Why does successive subsequence extraction produce convergence in all coordinates after finitely many steps?
  5. What does the matrix example show about the difference between a bounded sequence and a convergent sequence?
  6. Why can the bounded-subsequence theorem fail in infinite-dimensional spaces?