Tutorials › Measure Theory › Why L2 Is A Hilbert Space

Hilbert Space L^2 · Tutorial 587 of 798

Why L2 Is A Hilbert Space

See why the L2 norm and inner product fit together, and how a summable-subsequence argument proves that L2 is complete.

Advanced 11 min read

What You'll Learn

  • Define complex L2 as equivalence classes of measurable functions equal almost everywhere.
  • Verify that the L2 inner product is well defined and positive definite.
  • Derive the norm axioms from the inner product and the Cauchy–Schwarz inequality.
  • Prove the parallelogram identity by expanding both squared norms.
  • Prove completeness of L2 without assuming the measure space is finite or sigma-finite.
  • Recognize why pointwise representatives and cross terms matter in L2 calculations.

What It Means for L2 to Be a Hilbert Space

An inner product gives more structure than a norm: it records angles and makes orthogonality meaningful. For \(L^2\), the natural candidate is obtained by integrating the product of one function with the complex conjugate of another. To call \(L^2\) a Hilbert space, however, we must verify two separate facts: this inner product induces the usual \(L^2\) norm, and the resulting normed space is complete.

Throughout, \((X,\mathcal{M},\mu)\) is an arbitrary measure space; it is not assumed finite, sigma-finite, or complete. Functions are complex-valued and measurable. Two such functions are identified when they agree \(\mu\)-a.e. The space \(L^2(\mu)\) consists of the resulting equivalence classes \([f]\) for which \(\int_X |f|^2\,d\mu<\infty\). We write \(f\) for its equivalence class when no confusion can arise. Define

$$ \langle f,g\rangle=\int_X f\overline{g}\,d\mu, \qquad \|f\|_2=\left(\int_X|f|^2\,d\mu\right)^{1/2}. $$

The integral defining the inner product is finite: the Cauchy–Schwarz inequality for integrals gives \(\int_X|f\overline g|\,d\mu\le \|f\|_2\|g\|_2\). This inequality applies to \(f,g\in L^2(\mu)\), without requiring \(\mu(X)<\infty\). If representatives are changed on null sets, the integrands change only on a null set, so the inner product and norm do not depend on the chosen representatives. We use the convention that the inner product is linear in its first argument and conjugate-linear in its second.

Definition: A complex Hilbert space is a complex vector space with an inner product whose induced norm makes the space complete: every Cauchy sequence in that norm has a limit in the space.

The Inner Product Induces the L2 Norm

We first verify the norm properties. The integral Cauchy–Schwarz inequality used below follows directly from nonnegativity: if \(\|g\|_2>0\), expand \(\|f-cg\|_2^2\ge0\) with \(c=\langle f,g\rangle/\|g\|_2^2\). The expansion gives \(\|f\|_2^2-|\langle f,g\rangle|^2/\|g\|_2^2\ge0\), hence \(|\langle f,g\rangle|\le\|f\|_2\|g\|_2\). If \(\|g\|_2=0\), then \(g=0\) \(\mu\)-a.e., and the same inequality holds because \(\langle f,g\rangle=0\).

Proposition: On \(L^2(\mu)\), \(\langle\cdot,\cdot\rangle\) is an inner product and its induced norm is exactly \(\|f\|_2=(\langle f,f\rangle)^{1/2}\). In particular, \(\|f\|_2=0\) if and only if \(f=0\) as an equivalence class.

Proof. Linearity in the first argument and conjugate symmetry follow from the corresponding properties of the integral: \(\langle af+bh,g\rangle=a\langle f,g\rangle+b\langle h,g\rangle\) and \(\langle f,g\rangle=\overline{\langle g,f\rangle}\), for \(a,b\in\mathbb{C}\). Also, \(\langle f,f\rangle=\int_X|f|^2\,d\mu\ge0\). This integral is zero exactly when \(f=0\) \(\mu\)-a.e.: for the nontrivial direction, each set \(E_n=\{|f|>1/n\}\) satisfies \(\mu(E_n)/n^2\le\int_X|f|^2\,d\mu=0\), so \(\mu(E_n)=0\); since \(\{|f|>0\}=\bigcup_{n\ge1}E_n\), that set is null. Thus the inner product is positive definite on equivalence classes. Finally, its induced norm is \((\langle f,f\rangle)^{1/2}=(\int_X|f|^2\,d\mu)^{1/2}\), as claimed. \(\square\)

For completeness, the norm axioms follow from this identity. Nonnegativity and definiteness have just been shown, and \(\|af\|_2=|a|\|f\|_2\). For the triangle inequality, expand the square and apply Cauchy–Schwarz:

$$ \|f+g\|_2^2 =\|f\|_2^2+\|g\|_2^2+2\operatorname{Re}\langle f,g\rangle \le \|f\|_2^2+\|g\|_2^2+2\|f\|_2\|g\|_2 =(\|f\|_2+\|g\|_2)^2. $$

Taking nonnegative square roots proves \(\|f+g\|_2\le\|f\|_2+\|g\|_2\). Thus the inner product induces a norm, not merely a nonnegative quadratic expression.

Worked Example: A Complex Inner Product on the Unit Interval

Take \(X=[0,1]\), \(\mathcal{M}=\mathcal{L}|_{[0,1]}\), and \(\mu=m\), Lebesgue measure restricted to the interval. Let \(f(x)=1+ix\) and \(g(x)=1-ix\). Both functions are complex-valued and in \(L^2(m)\). Compute their norms, their inner product, and check the parallelogram identity.

Since \(|f(x)|^2=|g(x)|^2=1+x^2\), each squared norm is \(\int_0^1(1+x^2)\,dx=1+\tfrac13=\tfrac43\), so \(\|f\|_2=\|g\|_2=\tfrac{2}{\sqrt3}\). With the stated convention, \(\overline{g(x)}=1+ix\), and therefore

$$ \langle f,g\rangle=\int_0^1(1+ix)^2\,dx =\int_0^1(1+2ix-x^2)\,dx =\frac23+i. $$

Its absolute value is \(\sqrt{(2/3)^2+1^2}=\sqrt{13}/3\), which is at most \(\|f\|_2\|g\|_2=4/3\), as Cauchy–Schwarz requires. Also \(f+g=2\), so \(\|f+g\|_2^2=4\). Since \(f-g=2ix\), \(\|f-g\|_2^2=\int_0^1 4x^2\,dx=4/3\). The two sides of the parallelogram identity are \(4+4/3=16/3\) and \(2(4/3+4/3)=16/3\), respectively. This verifies the identity for these functions.

The Parallelogram Identity

Theorem (Parallelogram Identity): For any \(f,g\in L^2(\mu)\), where \((X,\mathcal{M},\mu)\) is any measure space and the functions are complex-valued, \(\|f+g\|_2^2+\|f-g\|_2^2=2\|f\|_2^2+2\|g\|_2^2\).

Proof. Expand both squared norms using the inner product. Conjugate symmetry gives \(\langle g,f\rangle=\overline{\langle f,g\rangle}\), and so \(\langle f,g\rangle+\langle g,f\rangle=2\operatorname{Re}\langle f,g\rangle\). Hence

$$ \begin{aligned} \|f+g\|_2^2&=\|f\|_2^2+\|g\|_2^2+2\operatorname{Re}\langle f,g\rangle,\\ \|f-g\|_2^2&=\|f\|_2^2+\|g\|_2^2-2\operatorname{Re}\langle f,g\rangle. \end{aligned} $$

Adding the equalities cancels the two real-part terms and leaves \(2\|f\|_2^2+2\|g\|_2^2\). The expansions are valid because \(f+g\) and \(f-g\) belong to \(L^2(\mu)\), by the triangle inequality already proved. \(\square\)

Worked Example: The Parallelogram Identity for Counting Measure

Let \(X=\{1,2\}\) with the power-set sigma-algebra and counting measure \(\mu\), so \(\int_X h\,d\mu=h(1)+h(2)\) for nonnegative \(h\). Regard \(f=(1,2)\) and \(g=(3,-1)\) as real-valued elements of complex \(L^2(\mu)\). Compute both sides.

The norms squared are \(\|f\|_2^2=1^2+2^2=5\) and \(\|g\|_2^2=3^2+(-1)^2=10\). The pointwise sums and differences are \(f+g=(4,1)\) and \(f-g=(-2,3)\); thus \(\|f+g\|_2^2=4^2+1^2=17\) and \(\|f-g\|_2^2=(-2)^2+3^2=13\). The left side is \(17+13=30\), while the right side is \(2(5)+2(10)=30\). Directly, the cross term is \(\langle f,g\rangle=1\cdot3+2\cdot(-1)=1\), so the two squared norms are \(5+10+2=17\) and \(5+10-2=13\). Both computations agree.

Completeness: Every L2-Cauchy Sequence Has a Limit

The key point in the completeness proof is to extract from a Cauchy sequence a subsequence whose successive differences have summable \(L^2\) norms. The pointwise sum of their absolute values is then finite almost everywhere. We use the Monotone Convergence Theorem and Fatou's lemma for nonnegative measurable functions on \((X,\mathcal{M},\mu)\); neither result requires finite or sigma-finite measure. We also use the \(L^2\) triangle inequality proved above.

Theorem: For every measure space \((X,\mathcal{M},\mu)\), the complex inner product space \(L^2(\mu)\) is complete in its induced norm. Consequently, \(L^2(\mu)\) is a Hilbert space.

Proof. Let \((f_n)\) be a Cauchy sequence in \(L^2(\mu)\). Choose a subsequence \((f_{n_j})\) such that \(\|f_{n_{j+1}}-f_{n_j}\|_2\le 2^{-j}\) for every \(j\ge1\). This choice is possible by the Cauchy property: for each \(j\), all sufficiently late pairs have distance at most \(2^{-j}\), and the indices can be selected successively beyond those thresholds. Choose measurable representatives and put \(u_j=f_{n_{j+1}}-f_{n_j}\) and \(S_N=\sum_{j=1}^N|u_j|\). The triangle inequality gives \(\|S_N\|_2\le\sum_{j=1}^N\|u_j\|_2\le\sum_{j=1}^N2^{-j}\le1\).

The nonnegative functions \(S_N^2\) increase pointwise to \(S^2\), where \(S=\sum_{j=1}^{\infty}|u_j|\), with \(+\infty\) allowed. By the Monotone Convergence Theorem, \(\int_X S^2\,d\mu=\lim_N\int_X S_N^2\,d\mu\le1\). Therefore \(S<\infty\) \(\mu\)-a.e.; otherwise its square would have infinite integral on the measurable set where it is infinite, unless that set were null. On the measurable set \(S<\infty\), the series of successive differences \(\sum_j u_j(x)\) converges absolutely. Thus \(f_{n_j}(x)\) converges there to a finite limit. Define \(f\) to be that limit on \(\{S<\infty\}\) and zero on \(\{S=\infty\}\). It is measurable, since it is defined by a pointwise limit on a measurable set and by a constant on its measurable complement.

For a fixed \(k\), as \(r\to\infty\), \(f_{n_r}-f_{n_k}\to f-f_{n_k}\) \(\mu\)-a.e. For every \(r>k\), the triangle inequality gives \(\|f_{n_r}-f_{n_k}\|_2\le\sum_{j=k}^{r-1}2^{-j}\le 2^{1-k}\). Apply Fatou's lemma to the nonnegative functions \(|f_{n_r}-f_{n_k}|^2\); their a.e. limit is \(|f-f_{n_k}|^2\). It follows that \(\int_X|f-f_{n_k}|^2\,d\mu\le\liminf_{r\to\infty}\|f_{n_r}-f_{n_k}\|_2^2\le 2^{2-2k}\). In particular, \(f-f_{n_1}\in L^2(\mu)\), and \(f=f_{n_1}+(f-f_{n_1})\in L^2(\mu)\) by the triangle inequality. The same bound shows \(\|f-f_{n_k}\|_2\to0\).

Finally, let \(\varepsilon>0\). Since \((f_n)\) is Cauchy, there is \(N\) such that \(\|f_n-f_m\|_2<\varepsilon/2\) whenever \(n,m\ge N\). Choose \(k\) large enough that \(n_k\ge N\) and \(\|f_{n_k}-f\|_2<\varepsilon/2\). For every \(n\ge N\), the triangle inequality now gives \(\|f_n-f\|_2\le\|f_n-f_{n_k}\|_2+\|f_{n_k}-f\|_2<\varepsilon\). Hence \(f_n\to f\) in \(L^2(\mu)\), proving completeness. Combined with the inner product and norm properties, this proves that \(L^2(\mu)\) is a Hilbert space. \(\square\)

Worked Example: A Cauchy Sequence on the Real Line

On \((\mathbb{R},\mathcal{L},m)\), define \(f_n=\sum_{k=1}^n2^{-k}\chi_{[k,k+1)}\). These are real-valued measurable functions. The intervals are disjoint and each has Lebesgue measure \(1\). For \(m>n\),

$$ \|f_m-f_n\|_2^2=\sum_{k=n+1}^{m}4^{-k} =\frac{4^{-n}}{3}\left(1-4^{-(m-n)}\right) \le\frac{4^{-n}}{3}. $$

The final bound tends to zero as \(n\to\infty\), so the sequence is Cauchy. Its pointwise limit is \(f=\sum_{k=1}^{\infty}2^{-k}\chi_{[k,k+1)}\), and \(\int_{\mathbb{R}}|f|^2\,dm=\sum_{k=1}^{\infty}4^{-k}=\tfrac13\), so \(f\in L^2(m)\). The tail gives the exact error \(\|f-f_n\|_2^2=\sum_{k=n+1}^{\infty}4^{-k}=4^{-n}/3\). For example, at \(n=2\) this squared error is \(4^{-2}/3=1/48\). This agrees with the finite-tail formula as \(m\to\infty\), and directly checks convergence in \(L^2\).

A Common Mistake: Dropping the Cross Term

It is incorrect to calculate \(\|f+g\|_2^2\) as \(\|f\|_2^2+\|g\|_2^2\) in general. For a concrete check on \([0,1]\) with Lebesgue measure, take \(f=g=1\). Then \(\|f\|_2^2=\|g\|_2^2=1\), but \(\|f+g\|_2^2=\int_0^1 2^2\,dx=4\), not \(1+1=2\). The correction is the cross term: \(\|f+g\|_2^2=\|f\|_2^2+\|g\|_2^2+2\operatorname{Re}\langle f,g\rangle=1+1+2=4\). The same care with almost-everywhere equivalence is essential: functions that differ only on a null set represent the same element of \(L^2(\mu)\), and positive definiteness holds for these equivalence classes, not for pointwise representatives.

Check Your Understanding

Use the definitions and proofs above to answer the following.

  1. On \([0,1]\) with Lebesgue measure, compute \(\langle 1,x\rangle\), \(\|1+x\|_2^2\), and verify the cross-term expansion.
  2. Why does \(\int_X|f|^2\,d\mu=0\) imply that \(f\) and the zero function represent the same element of \(L^2(\mu)\)?
  3. In the completeness proof, why is the Monotone Convergence Theorem applicable to \(S_N^2\), and what bound does it give for \(\int_X S^2\,d\mu\)?
  4. For the sequence in the real-line example, calculate \(\|f-f_3\|_2^2\) exactly.
  5. Does the completeness theorem require \(\mu(X)<\infty\) or that \((X,\mathcal{M},\mu)\) be complete? Identify where the proof uses either condition, if at all.