Tutorials › Measure Theory › Completeness Of The Trigonometric System

Hilbert Space L^2 · Tutorial 594 of 798

Completeness Of The Trigonometric System

See how the positivity and concentration of Fejér kernels yield density of trigonometric polynomials in L2 of the circle, and hence completeness of the trigonometric system.

Advanced 11 min read

What You'll Learn

  • Define the normalized measure and trigonometric orthonormal system on the circle.
  • Derive the Fejér kernel and verify its positivity and normalization.
  • Prove concentration of Fejér kernels near zero.
  • Establish L2 convergence of Fejér means using continuity of translations.
  • Deduce density of trigonometric polynomials and completeness of the system.
  • Distinguish L2 approximation from uniform approximation for discontinuous functions.

The Circle and Its Trigonometric System

We identify the circle with \(\mathbb{T}=\mathbb{R}/2\pi\mathbb{Z}\), and use normalized Lebesgue measure \(dm(x)=dx/(2\pi)\) on a period. Thus \(m(\mathbb{T})=1\). The space \(L^2(\mathbb{T},m)\) consists of complex-valued measurable functions with finite \(\int_{\mathbb{T}}|f|^2\,dm\), identified when they agree \(m\)-a.e.; its inner product is \(\langle f,g\rangle=\int_{\mathbb{T}}f\overline g\,dm\). All equalities between \(L^2\) functions below are understood a.e. A trigonometric polynomial is a finite linear combination of the functions \(e_n(x)=e^{inx}\), \(n\in\mathbb{Z}\).

Direct integration gives \(\langle e_j,e_k\rangle=\int_{\mathbb{T}}e^{i(j-k)x}\,dm(x)\), which is \(1\) if \(j=k\) and \(0\) otherwise. Hence \((e_n)_{n\in\mathbb{Z}}\) is an orthonormal system. To prove it is complete, it suffices to show that its finite linear span is dense in \(L^2(\mathbb{T},m)\). We will construct approximations using Fejér kernels: nonnegative trigonometric polynomials whose mass concentrates near \(0\).

Fejér Kernels

Definition: For an integer \(N\ge0\), the Fejér kernel on \(\mathbb{T}\) is \(K_N(t)=\dfrac{1}{N+1}\left|\sum_{j=0}^{N}e^{ijt}\right|^2\). It is nonnegative and has the finite Fourier expansion \(K_N(t)=\sum_{|k|\le N}\left(1-\dfrac{|k|}{N+1}\right)e^{ikt}\).

To obtain the expansion, multiply \(\sum_{j=0}^N e^{ijt}\) by its complex conjugate. For each integer \(k\) with \(|k|\le N\), there are exactly \(N+1-|k|\) pairs of indices \(j,\ell\in\{0,\ldots,N\}\) with \(j-\ell=k\). Dividing by \(N+1\) gives the stated coefficient. The constant coefficient is \(1\), while every nonconstant exponential integrates to \(0\) over \(\mathbb{T}\). Consequently, \(\int_{\mathbb{T}}K_N\,dm=1\).

The kernels concentrate near the origin in the following precise sense: for every \(\delta\in(0,\pi)\), their integral over \(\{t:\delta\le |t|\le\pi\}\) tends to zero. Indeed, the finite geometric sum gives, when \(t\not\equiv0\) modulo \(2\pi\),

$$ K_N(t)=\frac{1}{N+1} \left|\frac{\sin((N+1)t/2)}{\sin(t/2)}\right|^2. $$

For \(\delta\le |t|\le\pi\), \(|\sin(t/2)|\ge\sin(\delta/2)>0\) and \(|\sin((N+1)t/2)|\le1\). Therefore \(K_N(t)\le ((N+1)\sin^2(\delta/2))^{-1}\), so

$$ \int_{\delta\le |t|\le\pi}K_N(t)\,dm(t) \le \frac{1}{(N+1)\sin^2(\delta/2)} \longrightarrow 0. $$

Worked Example: The First Nonconstant Fejér Kernel

For \(N=1\), the definition gives \(K_1(t)=\frac12|1+e^{it}|^2\). Since \(|1+e^{it}|^2=(1+e^{it})(1+e^{-it})=2+e^{it}+e^{-it}=2+2\cos t\), we obtain \(K_1(t)=1+\cos t\). This is nonnegative because \(\cos t\ge-1\).

Its normalized integral is \(\int_{\mathbb{T}}(1+\cos t)\,dm(t)=1+0=1\), as required. At \(t=0\), its value is \(1+\cos0=2\); at \(t=\pi\), its value is \(1+\cos\pi=0\). These checks agree with the formula and illustrate that the kernel is largest near \(0\), not constant across the circle.

Approximation in \(L^2\)

For \(f\in L^2(\mathbb{T},m)\), define its \(N\)-th Fejér mean by convolution, \(\sigma_N f(x)=\int_{\mathbb{T}}K_N(t)f(x-t)\,dm(t)\). This is well-defined for a.e. \(x\); the finite expansion below also gives a trigonometric-polynomial representative. Write \(\widehat f(k)=\int_{\mathbb{T}}f(y)e^{-iky}\,dm(y)\). This coefficient is finite: Cauchy–Schwarz and \(m(\mathbb{T})=1\) give \(\int|f|\,dm\le\|f\|_2\). Substituting the finite expansion of \(K_N\) and changing variables \(y=x-t\) yields \(\sigma_N f(x)=\sum_{|k|\le N}(1-|k|/(N+1))\widehat f(k)e^{ikx}\). In particular, each Fejér mean is a trigonometric polynomial.

Theorem: For every complex-valued \(f\in L^2(\mathbb{T},m)\), the Fejér means satisfy \(\|\sigma_N f-f\|_2\to0\). Thus trigonometric polynomials are dense in \(L^2(\mathbb{T},m)\).

Proof. We first establish continuity of translations in \(L^2\): if \((\tau_t f)(x)=f(x-t)\), then \(\|\tau_t f-f\|_2\to0\) as \(t\to0\) on the circle. Continuous functions are dense in \(L^2(\mathbb{T},m)\). To recall why, simple functions are dense by the construction of the Lebesgue integral. For a measurable set \(E\), regularity of Lebesgue measure on the compact circle gives a compact \(C\) and an open \(U\) with \(C\subseteq E\subseteq U\) up to null-set changes and \(m(U\setminus C)\) arbitrarily small. A continuous function taking values in \([0,1]\), equal to \(1\) on \(C\) and \(0\) outside \(U\), approximates \(\chi_E\) in \(L^2\): its squared error is at most \(1\) and is supported, up to a null set, in \(U\setminus C\). Such a function exists on the circle, for example by separating the disjoint closed sets \(C\) and \(\mathbb{T}\setminus U\) with the distance functions. Approximating the finitely many indicator functions in a simple function proves the density claim.

Given \(f\in L^2\) and \(\varepsilon>0\), choose a continuous \(g\) with \(\|f-g\|_2<\varepsilon\). Translation preserves \(m\), so \(\|\tau_t(f-g)\|_2=\|f-g\|_2\). Uniform continuity of \(g\) on the compact circle gives \(\|\tau_t g-g\|_2\le\|\tau_t g-g\|_\infty\to0\). The triangle inequality then gives \(\|\tau_t f-f\|_2\le2\varepsilon+\|\tau_t g-g\|_2\). Since \(\varepsilon\) is arbitrary, translation continuity follows.

Because \(K_N\,dm\) is a probability measure, the integral form of Cauchy–Schwarz gives, for a.e. \(x\), \(|\sigma_N f(x)-f(x)|^2\le\int_{\mathbb{T}}K_N(t)|f(x-t)-f(x)|^2\,dm(t)\). Integrating in \(x\) and applying Tonelli's theorem to this nonnegative measurable integrand gives \(\|\sigma_N f-f\|_2^2\le\int_{\mathbb{T}}K_N(t)\|\tau_t f-f\|_2^2\,dm(t)\). The integrand is measurable; the inner norm is bounded by \(4\|f\|_2^2\), since \(\|\tau_t f-f\|_2\le2\|f\|_2\).

Let \(\varepsilon>0\). Translation continuity provides \(\delta\in(0,\pi)\) such that \(\|\tau_t f-f\|_2^2<\varepsilon\) whenever \(|t|<\delta\). Split the last integral into \(|t|<\delta\) and \(\delta\le|t|\le\pi\). Since \(K_N\) has integral \(1\), and by the concentration estimate already proved,

$$ \|\sigma_N f-f\|_2^2 \le \varepsilon+ 4\|f\|_2^2\int_{\delta\le|t|\le\pi}K_N(t)\,dm(t) \longrightarrow \text{ a value at most }\varepsilon $$

in the sense that the limit superior is at most \(\varepsilon\). This holds for every \(\varepsilon>0\), so the squared norms tend to zero. Each \(\sigma_N f\) is a trigonometric polynomial, proving density. \(\square\)

Worked Example: Fejér Means of a Single Exponential

Take \(f(x)=e^{i2x}\) and \(N=2\). Its Fourier coefficient is \(\widehat f(k)=\int_{\mathbb{T}}e^{i(2-k)x}\,dm(x)\), which equals \(1\) when \(k=2\) and \(0\) for \(k=-2,-1,0,1\). The coefficient multiplying \(e^{i2x}\) in \(\sigma_2 f\) is \(1-|2|/3=1/3\); all other terms vanish. Hence \(\sigma_2f(x)=\frac13e^{i2x}\).

The error is \(\sigma_2f-f=-\frac23e^{i2x}\), so \(\|\sigma_2f-f\|_2^2=\int_{\mathbb{T}}\frac49|e^{i2x}|^2\,dm(x)=\frac49\), and \(\|\sigma_2f-f\|_2=\frac23\). More generally, for \(N\ge2\), the same computation gives \(\sigma_Nf=(1-2/(N+1))e^{i2x}\) and error norm \(2/(N+1)\), which tends to zero.

Check: at \(N=2\), the general error formula gives \(2/(2+1)=2/3\), agreeing with the direct norm calculation.

Worked Example: The Fejér Mean of a Half-Circle Indicator

Let \(f=\chi_{[0,\pi)}\) on \(\mathbb{T}\). The endpoint convention affects only a null set. Its constant coefficient is \(\widehat f(0)=m([0,\pi))=\pi/(2\pi)=1/2\). For \(k=1\), direct integration gives \(\widehat f(1)=\frac1{2\pi}\int_0^\pi e^{-ix}\,dx=\frac{1-e^{-i\pi}}{2\pi i}=\frac1{\pi i}=-i/\pi\). Likewise, \(\widehat f(-1)=i/\pi\).

For \(N=1\), the two nonconstant coefficients are each multiplied by \(1/2\), so \(\sigma_1f(x)=\frac12+\frac12(-\frac{i}{\pi}e^{ix}+\frac{i}{\pi}e^{-ix})=\frac12+\frac{\sin x}{\pi}\). Here we used \(e^{-ix}-e^{ix}=-2i\sin x\). Its integral is \(1/2\), since the sine term integrates to zero. This matches \(\int f\,dm=m([0,\pi))=1/2\).

The polynomial is continuous, while \(f\) has a jump at the endpoints of the half-circle. The theorem asserts convergence in \(L^2\) as \(N\) grows, not equality at every point or uniform convergence.

Completeness and a Common Pitfall

Corollary: The orthonormal system \((e_n)_{n\in\mathbb{Z}}\) is complete in the complex Hilbert space \(L^2(\mathbb{T},m)\). Equivalently, the only \(f\in L^2(\mathbb{T},m)\) satisfying \(\langle f,e_n\rangle=0\) for every \(n\in\mathbb{Z}\) is the zero element of \(L^2\).

Proof. Suppose \(\langle f,e_n\rangle=0\) for every integer \(n\). Then \(\widehat f(n)=\langle f,e_n\rangle=0\) for every \(n\), so the finite formula for \(\sigma_N f\) gives \(\sigma_N f=0\) a.e. for every \(N\). The theorem gives \(\|f\|_2=\|f-\sigma_N f\|_2\to0\), hence \(\|f\|_2=0\) and \(f=0\) a.e. Conversely, the zero element is orthogonal to every \(e_n\). This proves the stated criterion for completeness. \(\square\)

Pitfall: confusing \(L^2\) density with uniform approximation. The half-circle indicator cannot be approximated by continuous functions with arbitrarily small essential uniform error. In fact, let \(g\) be any continuous complex-valued function and suppose its essential uniform error \(c=\|g-f\|_\infty\) were less than \(1/2\). Choose \(c'\) with \(c<c'<1/2\); then \(|g-f|\le c'\) a.e. On the interior of \([0,\pi)\), this gives \(|g-1|\le c'\) a.e., and continuity extends this bound to the boundary point \(0\). On the interior of the complementary half-circle, it gives \(|g|\le c'\) a.e., and continuity extends that bound to \(0\) as well. The triangle inequality would imply \(1=|1-0|\le|1-g(0)|+|g(0)|\le2c'<1\), a contradiction. The argument works for complex-valued \(g\); it uses absolute values, not an order on complex numbers. This obstruction to small uniform error does not prevent \(L^2\) approximation, which is the conclusion proved using Fejér kernels.

Check Your Understanding

Use the normalization \(dm(x)=dx/(2\pi)\) on \(\mathbb{T}\) in each question.

  1. Expand \(K_2(t)\) as a finite sum of exponentials and verify from the expansion that its integral is \(1\).
  2. For \(f(x)=e^{-ix}\), compute \(\sigma_1f\) and \(\|\sigma_1f-f\|_2\).
  3. Explain where nonnegativity and normalization of \(K_N\) enter the proof of \(L^2\) convergence.
  4. Why does orthogonality of \(f\) to every \(e_n\), together with convergence of \(\sigma_Nf\), imply \(f=0\) a.e.?
  5. For the half-circle indicator, why does the essential-uniform-error argument apply to complex-valued continuous approximants?