Tutorials › Measure Theory › Inner Products And Norms In L2

Hilbert Space L^2 · Tutorial 586 of 798

Inner Products And Norms In L2

Learn how the \(L^2\) inner product is defined on equivalence classes and why it yields the usual norm in both real and complex spaces.

Advanced 10 min read

What You'll Learn

  • Define real and complex \(L^2\) inner products using the appropriate scalar product.
  • Check that the product in the inner product is integrable on an arbitrary measure space.
  • Show that changing representatives on null sets leaves the inner product unchanged.
  • Prove Cauchy–Schwarz, including the zero-vector case.
  • Derive the norm axioms and identify the induced norm with the usual \(L^2\) norm.
  • Recognize why omitting complex conjugation gives the wrong inner product.

From Square-Integrable Functions to an Inner Product

On a Euclidean space, the dot product turns vectors into a geometry: it gives lengths, angles, and orthogonality. The same idea works for square-integrable functions, but there are two points to address. First, the product of two \(L^2\) functions must be integrable before its integral can define an inner product. Second, elements of \(L^2\) are equivalence classes: functions that agree almost everywhere represent the same element, so the inner product must not depend on the chosen representatives.

Let \((X,\mathcal{M},\mu)\) be any measure space. No assumption that \(\mu\) is finite, sigma-finite, or complete is needed here. For \(\mathbb{F}=\mathbb{R}\) or \(\mathbb{C}\), take measurable, finite-valued functions \(f:X\to\mathbb{F}\) such that \(\int |f|^2\,d\mu<\infty\). Identify two such functions when they agree \(\mu\)-almost everywhere. The resulting space of equivalence classes is \(L^2(\mu;\mathbb{F})\); we write \(f\) for either a representative or its class when the meaning is clear. The usual \(L^2\) norm is \(\|f\|_2=(\int |f|^2\,d\mu)^{1/2}\).

Definition: On the real space \(L^2(\mu;\mathbb{R})\), set \(\langle f,g\rangle=\int f g\,d\mu\). On the complex space \(L^2(\mu;\mathbb{C})\), set \(\langle f,g\rangle=\int f\overline{g}\,d\mu\). This convention is linear in the first argument and conjugate-linear in the second. In both cases, the integral is finite, and the definition is made on almost-everywhere equivalence classes.

The complex conjugate is essential: with this convention, \(\langle f,f\rangle=\int |f|^2\,d\mu\), a nonnegative real number. We first establish that the integral defining the inner product exists. For real numbers \(a,b\), and also for complex numbers by applying the inequality to their absolute values, \(2|ab|\le |a|^2+|b|^2\). Thus, for \(f,g\in L^2(\mu;\mathbb{F})\),

$$ |f\overline g|=|f||g|\le \frac{|f|^2+|g|^2}{2} \quad\text{and hence}\quad \int |f\overline g|\,d\mu \le \frac{\|f\|_2^2+\|g\|_2^2}{2}<\infty. $$

For real-valued functions, the same estimate applies to \(|fg|\). Therefore each proposed inner product is an integral of an integrable function. This argument also shows that no finite-measure assumption on \(X\) is required.

Independence of Representatives and Inner Product Properties

Proposition. For either choice \(\mathbb{F}=\mathbb{R}\) or \(\mathbb{C}\), the formula above defines an inner product on \(L^2(\mu;\mathbb{F})\). In particular, it is independent of representatives, linear in its first argument, conjugate-symmetric, and positive definite.

Proof. Suppose \(f=f'\) \(\mu\)-a.e. and \(g=g'\) \(\mu\)-a.e. There are measurable null sets outside which the respective equalities hold. Outside their union, \(f\overline g=f'\overline{g'}\). The two products are integrable by the estimate above, and integrable functions equal almost everywhere have equal integrals. Thus \(\int f\overline g\,d\mu=\int f'\overline{g'}\,d\mu\). In the real case this is the same argument with \(fg\) in place of \(f\overline g\); the inner product is well defined on equivalence classes.

Linearity of the Lebesgue integral gives \(\langle af_1+bf_2,g\rangle=a\langle f_1,g\rangle+b\langle f_2,g\rangle\) for scalars \(a,b\in\mathbb{F}\). In the complex case, conjugating the integral gives \(\langle f,g\rangle=\overline{\langle g,f\rangle}\); in the real case this says \(\langle f,g\rangle=\langle g,f\rangle\). Finally, \(\langle f,f\rangle=\int |f|^2\,d\mu\ge0\). This integral is zero exactly when \(f=0\) \(\mu\)-a.e.: indeed, if it is zero, then for each positive integer \(n\), the set \(E_n=\{|f|>1/n\}\) satisfies \(\mu(E_n)/n^2\le\int |f|^2\,d\mu=0\). Thus each \(E_n\) is null, and \(\{|f|>0\}=\bigcup_{n=1}^{\infty}E_n\) is null. Conversely, if \(f=0\) a.e., then \(\int |f|^2\,d\mu=0\). This proves positive definiteness on equivalence classes. \(\square\)

Worked Example: A Real Inner Product on a Finite Space

Let \(X=\{1,2,3\}\), let \(\mathcal{M}\) be its power set, and let \(\mu\) be counting measure. Define \(f(1)=1,\ f(2)=2,\ f(3)=-1\) and \(g(1)=2,\ g(2)=-1,\ g(3)=3\). All subsets are measurable, and the measure of each singleton is \(1\). The real inner product is

$$ \langle f,g\rangle =\sum_{j=1}^3 f(j)g(j) =(1)(2)+(2)(-1)+(-1)(3) =2-2-3=-3. $$

The squared norms are \(\|f\|_2^2=1^2+2^2+(-1)^2=1+4+1=6\) and \(\|g\|_2^2=2^2+(-1)^2+3^2=4+1+9=14\). Therefore \(\|f\|_2=\sqrt6\) and \(\|g\|_2=\sqrt{14}\). Check: the computed inner product satisfies \(|\langle f,g\rangle|^2=(-3)^2=9\le 6\cdot14=84=\|f\|_2^2\|g\|_2^2\), as Cauchy–Schwarz will require.

Cauchy–Schwarz and the Induced Norm

Theorem (Cauchy–Schwarz): For \(f,g\in L^2(\mu;\mathbb{F})\), where \((X,\mathcal{M},\mu)\) is any measure space and \(\mathbb{F}=\mathbb{R}\) or \(\mathbb{C}\), \(|\langle f,g\rangle|\le\|f\|_2\|g\|_2\).

Proof. If \(\|g\|_2=0\), positive definiteness shows that \(g=0\) a.e., so \(\langle f,g\rangle=0\) and the inequality holds. Now suppose \(\|g\|_2>0\), and set \(c=\langle f,g\rangle/\|g\|_2^2\). Nonnegativity of the squared norm gives \(0\le\|f-cg\|_2^2\). Expanding by linearity in the first argument and conjugate-linearity in the second gives

$$ \begin{aligned} 0 &\le \langle f-cg,f-cg\rangle\\ &=\|f\|_2^2-\overline c\,\langle f,g\rangle -c\,\langle g,f\rangle+|c|^2\|g\|_2^2\\ &=\|f\|_2^2-\frac{|\langle f,g\rangle|^2}{\|g\|_2^2}. \end{aligned} $$

For the last equality, \(\langle g,f\rangle=\overline{\langle f,g\rangle}\) and \(c=\langle f,g\rangle/\|g\|_2^2\), so each of the two subtracted terms is \(|\langle f,g\rangle|^2/\|g\|_2^2\), while the final term is one copy of that quantity. Multiplying by the positive number \(\|g\|_2^2\) gives \(|\langle f,g\rangle|^2\le\|f\|_2^2\|g\|_2^2\). Taking nonnegative square roots proves the result, including the case \(g=0\). \(\square\)

Corollary: The inner product induces the usual \(L^2\) norm: \(\|f\|_2=\sqrt{\langle f,f\rangle}\). This quantity is a norm on \(L^2(\mu;\mathbb{F})\).

Proof. The identity follows from \(\langle f,f\rangle=\int|f|^2\,d\mu\). Nonnegativity and definiteness were proved above. For a scalar \(a\), \(\|af\|_2^2=\int|a|^2|f|^2\,d\mu=|a|^2\|f\|_2^2\), so \(\|af\|_2=|a|\|f\|_2\). For the triangle inequality, expand the square and use conjugate symmetry and Cauchy–Schwarz:

$$ \begin{aligned} \|f+g\|_2^2 &=\|f\|_2^2+2\operatorname{Re}\langle f,g\rangle+\|g\|_2^2\\ &\le \|f\|_2^2+2|\langle f,g\rangle|+\|g\|_2^2\\ &\le \bigl(\|f\|_2+\|g\|_2\bigr)^2. \end{aligned} $$

Both sides are nonnegative, so taking square roots yields \(\|f+g\|_2\le\|f\|_2+\|g\|_2\). Hence the induced quantity is a norm and agrees with the usual \(L^2\) norm. \(\square\)

Worked Example: A Complex Inner Product on the Unit Interval

On \(([0,1],\mathcal{L},m)\), with Lebesgue measure, let \(f(x)=1+ix\) and \(g(x)=x+i\), where \(i^2=-1\). Both functions are measurable and square-integrable, since \(|f(x)|^2=1+x^2\) and \(|g(x)|^2=x^2+1\), whose integrals on \([0,1]\) are finite. With the convention linear in the first argument,

$$ \begin{aligned} \langle f,g\rangle &=\int_0^1(1+ix)\overline{(x+i)}\,dx\\ &=\int_0^1(1+ix)(x-i)\,dx\\ &=\int_0^1(2x-i+ix^2)\,dx\\ &=\left[x^2-ix+\frac{i x^3}{3}\right]_0^1 =1-\frac{2i}{3}. \end{aligned} $$

For each function, the squared norm is \(\int_0^1(1+x^2)\,dx=[x+x^3/3]_0^1=4/3\). Thus \(\|f\|_2=\|g\|_2=\sqrt{4/3}\). Check: \(|\langle f,g\rangle|^2=|1-2i/3|^2=1^2+(2/3)^2=13/9\), while \(\|f\|_2^2\|g\|_2^2=(4/3)(4/3)=16/9\). Hence \(13/9\le16/9\), as required.

Worked Example: Changing a Representative on a Null Set

On \(([0,1],\mathcal{L},m)\), define \(f=\chi_{[0,1/2]}\), and let \(f'\) equal \(f\) except that \(f'(1/4)=5\). Set \(g=2\chi_{[0,1/2]}\). The functions are measurable; \(f\) and \(f'\) differ only on the singleton \(\{1/4\}\), which has Lebesgue measure zero. Thus they represent the same element of \(L^2(m;\mathbb{R})\).

Using \(f\), the inner product is \(\langle f,g\rangle=\int_0^{1/2}2\,dx=2(1/2)=1\). Using \(f'\), the integrand differs only at \(x=1/4\), so its integral is still \(1\). Also, \(\|f\|_2^2=\int_0^{1/2}1\,dx=1/2\). For \(f'\), the integrand \(|f'|^2\) differs from \(|f|^2\) only at that same singleton, so \(\|f'\|_2^2=1/2\). Finally, \(\|g\|_2^2=\int_0^{1/2}4\,dx=2\). Check: either representative gives \(|\langle f,g\rangle|^2=1\), and the product of squared norms is \((1/2)(2)=1\). The inner product and norm calculations are unchanged by the null-set modification.

A Complex-Valued Pitfall

For complex functions, omitting the conjugate is not a harmless change of notation. On the one-point space \(X=\{a\}\) with counting measure, take \(f(a)=1\) and \(g(a)=i\). The prescribed inner product is \(\langle f,g\rangle=1\cdot\overline{i}=-i\), whereas \(\langle g,f\rangle=i\cdot\overline{1}=i\), so \(\langle f,g\rangle=\overline{\langle g,f\rangle}\). A wrong calculation using \(\int fg\,d\mu\) gives \(i\) for both orders, which violates conjugate symmetry because \(i\ne\overline{i}=-i\). The correction is to conjugate the second factor: \(\langle f,g\rangle=\int f\overline g\,d\mu\). Then \(\|f\|_2^2=\|g\|_2^2=1\), and the inner product has the required properties.

The inner product therefore gives \(L^2\) its familiar geometric structure while respecting the fact that its elements are equivalence classes, not individual pointwise representatives. Cauchy–Schwarz is the key estimate: it controls pairings by the \(L^2\) norms and supplies the triangle inequality for the induced norm. The completeness of this normed space is a separate property; identifying that additional property is the next step in understanding why \(L^2\) is a Hilbert space.

Check Your Understanding

Use the convention that the complex inner product is linear in its first argument.

  1. For \(f,g\in L^2(\mu;\mathbb{C})\), explain why \(\int f\overline g\,d\mu\) is finite even when \(\mu(X)=\infty\).
  2. On a finite set with counting measure, calculate the inner product of \(f=(1,-1)\) and \(g=(2,3)\), and check Cauchy–Schwarz.
  3. Why does changing a measurable representative on a null set leave its \(L^2\) norm unchanged?
  4. Expand \(\|f-cg\|_2^2\) for \(c=\langle f,g\rangle/\|g\|_2^2\), assuming \(\|g\|_2>0\), to obtain Cauchy–Schwarz.
  5. For \(f(a)=1,\ g(a)=i\) on a one-point counting-measure space, compare \(\int f\overline g\,d\mu\) and \(\int fg\,d\mu\). Which expression satisfies conjugate symmetry?