Tutorials › Linear Algebra › Induced Norms And Basic Computations

Inner Products and Norms · Tutorial 606 of 1000

Induced Norms And Basic Computations

Use the inner product in each setting to calculate the induced norm, keeping track of conjugation, sums of squares, and integrals.

Intermediate 9 min read

What You'll Learn

  • Define the quantity induced by an inner product and identify what is placed in its two slots.
  • Compute induced lengths from the standard real dot product and the standard complex inner product.
  • Calculate a matrix length using its Frobenius inner product.
  • Find a function length from an integral inner product by integrating its squared magnitude.
  • Check nonnegativity, zero length, scalar scaling, and common conjugation errors.

From an Inner Product to a Length

An inner product compares two vectors and returns a scalar. If the same vector is placed in both slots, the resulting scalar measures its size in a way that depends on the chosen inner product. Taking the nonnegative square root gives the length induced by that inner product. The definition is short; accurate computations depend on knowing the inner product formula and, over \(\mathbb{C}\), using conjugation in the correct slot.

Let \(V\) be a vector space over \(\mathbb{F}\), where \(\mathbb{F}\) is \(\mathbb{R}\) or \(\mathbb{C}\). We use the convention that an inner product is linear in its first slot and conjugate-linear in its second slot. Thus, for \(a,b\in\mathbb{F}\) and \(\mathbf{u},\mathbf{v},\mathbf{w}\in V\), it satisfies \(\langle a\mathbf{u}+b\mathbf{v},\mathbf{w}\rangle=a\langle\mathbf{u},\mathbf{w}\rangle+b\langle\mathbf{v},\mathbf{w}\rangle\) and \(\langle\mathbf{u},a\mathbf{v}+b\mathbf{w}\rangle=\overline{a}\langle\mathbf{u},\mathbf{v}\rangle+\overline{b}\langle\mathbf{u},\mathbf{w}\rangle\). It also satisfies conjugate symmetry, \(\langle\mathbf{u},\mathbf{v}\rangle=\overline{\langle\mathbf{v},\mathbf{u}\rangle}\), and positive definiteness: \(\langle\mathbf{v},\mathbf{v}\rangle\) is a nonnegative real number, and it equals zero exactly when \(\mathbf{v}=\mathbf{0}\). Over \(\mathbb{R}\), conjugation has no effect, so the inner product is symmetric and linear in both slots.

Definition: The norm induced by an inner product on \(V\) is the function \(\|\cdot\|:V\to\mathbb{R}\) defined by \(\|\mathbf{v}\|=\sqrt{\langle\mathbf{v},\mathbf{v}\rangle}\). The square root is the nonnegative real square root. In particular, the expression under it is real and nonnegative by positive definiteness.

The repeated vector is important: to find the length of \(\mathbf{v}\), calculate \(\langle\mathbf{v},\mathbf{v}\rangle\), not an inner product with some other vector. The inner product chosen for the space determines the calculation. In ordinary real coordinates it leads to a sum of squares; with complex coordinates it leads to squared magnitudes; for matrices and functions it leads to sums or integrals.

Two Basic Checks from the Definition

Before calculating examples, it is useful to establish two facts that follow directly from the inner product axioms. They justify the square root and show how the induced quantity responds to scaling. These facts do not require the triangle inequality or any other norm inequalities.

Proposition: For every \(\mathbf{v}\in V\), \(\|\mathbf{v}\|\) is a nonnegative real number, and \(\|\mathbf{v}\|=0\) if and only if \(\mathbf{v}=\mathbf{0}\).

Proof. Positive definiteness says that \(\langle\mathbf{v},\mathbf{v}\rangle\) is a nonnegative real number. Its nonnegative square root therefore exists and is a nonnegative real number, so \(\|\mathbf{v}\|\geq 0\). If \(\mathbf{v}=\mathbf{0}\), then \(\langle\mathbf{0},\mathbf{0}\rangle=0\) by linearity, and hence \(\|\mathbf{v}\|=0\). Conversely, if \(\|\mathbf{v}\|=0\), then \(\langle\mathbf{v},\mathbf{v}\rangle=\|\mathbf{v}\|^2=0\). Positive definiteness then gives \(\mathbf{v}=\mathbf{0}\). \(\square\)

Proposition: For every scalar \(c\in\mathbb{F}\) and vector \(\mathbf{v}\in V\), \(\|c\mathbf{v}\|=|c|\,\|\mathbf{v}\|\), where \(|c|\) denotes absolute value over \(\mathbb{R}\) and complex modulus over \(\mathbb{C}\).

Proof. By linearity in the first slot and conjugate-linearity in the second, \(\langle c\mathbf{v},c\mathbf{v}\rangle=c\overline{c}\langle\mathbf{v},\mathbf{v}\rangle=|c|^2\|\mathbf{v}\|^2\). Both \(|c|\) and \(\|\mathbf{v}\|\) are nonnegative, so taking the nonnegative square root of both sides gives \(\|c\mathbf{v}\|=|c|\,\|\mathbf{v}\|\). This also covers \(c=0\), since both sides are then zero. \(\square\)

Coordinate Computations

For columns \(\mathbf{x},\mathbf{y}\in\mathbb{R}^n\), the standard dot product is \(\langle\mathbf{x},\mathbf{y}\rangle=\mathbf{x}^{\top}\mathbf{y}\). Thus the induced norm is the square root of the sum of the squares of the coordinates. In \(\mathbb{C}^n\), with the convention used here, the standard inner product is \(\langle\mathbf{x},\mathbf{y}\rangle=\sum_{j=1}^{n}x_j\overline{y_j}\). Setting \(\mathbf{y}=\mathbf{x}\) gives \(\sum_{j=1}^{n}x_j\overline{x_j}=\sum_{j=1}^{n}|x_j|^2\).

Worked Example: A Real Coordinate Vector

Find the norm of \(\mathbf{x}=\begin{bmatrix}3\\-4\\12\end{bmatrix}\) under the standard dot product on \(\mathbb{R}^3\).

Place \(\mathbf{x}\) in both slots, or multiply its transpose by the column:

$$ \langle\mathbf{x},\mathbf{x}\rangle =\mathbf{x}^{\top}\mathbf{x} =\begin{bmatrix}3&-4&12\end{bmatrix} \begin{bmatrix}3\\-4\\12\end{bmatrix} =3^2+(-4)^2+12^2 =9+16+144 =169. $$

Taking the nonnegative square root gives \(\|\mathbf{x}\|=\sqrt{169}=13\). As a check, squaring the proposed length recovers the inner product value: \(13^2=169=\langle\mathbf{x},\mathbf{x}\rangle\). The negative second coordinate contributes \(16\), not \(-16\), because it is multiplied by itself.

Worked Example: A Complex Coordinate Vector

Find the induced norm of \(\mathbf{z}=\begin{bmatrix}1+2i\\2-i\end{bmatrix}\) using the standard inner product on \(\mathbb{C}^2\).

Conjugate the entries in the second slot. The calculation is

$$ \begin{aligned} \langle\mathbf{z},\mathbf{z}\rangle &=(1+2i)(1-2i)+(2-i)(2+i)\\ &=(1+4)+(4+1)\\ &=5+5\\ &=10. \end{aligned} $$

Therefore \(\|\mathbf{z}\|=\sqrt{10}\). Equivalently, the two terms are \(|1+2i|^2=1^2+2^2=5\) and \(|2-i|^2=2^2+(-1)^2=5\). The check is \((\sqrt{10})^2=10=\langle\mathbf{z},\mathbf{z}\rangle\), and the result is a nonnegative real number as required.

Matrices and Functions

The same definition applies when the vectors are matrices or functions, provided the space has an inner product. For real matrices, the Frobenius inner product of matrices of the same size is the sum of the products of corresponding entries. For complex matrices, the entry in the second matrix is conjugated. Consequently, placing a matrix in both slots gives the sum of the squared absolute values of all its entries. For functions with an integral inner product, placing a function in both slots gives the integral of its squared value in the real case, or its squared magnitude in the complex case.

Worked Example: A Matrix

Use the Frobenius inner product to find the induced norm of \(\mathbf{A}=\begin{bmatrix}1&-2\\2&0\end{bmatrix}\).

For real matrices, the Frobenius inner product is \(\langle\mathbf{A},\mathbf{B}\rangle=\sum_{i,j}a_{ij}b_{ij}\). With \(\mathbf{B}=\mathbf{A}\), each entry is multiplied by itself:

$$ \begin{aligned} \langle\mathbf{A},\mathbf{A}\rangle &=1\cdot1+(-2)(-2)+2\cdot2+0\cdot0\\ &=1+4+4+0\\ &=9. \end{aligned} $$

It follows that the induced norm is \(\|\mathbf{A}\|=\sqrt{9}=3\). Checking by listing the entry squares gives \(1^2+(-2)^2+2^2+0^2=1+4+4+0=9\), the same inner product value. This calculation concerns the Frobenius inner product; it is not a calculation of a matrix operator norm.

Worked Example: A Function on an Interval

On the real-valued continuous functions on \([0,1]\), use the integral inner product \(\langle f,g\rangle=\int_0^1 f(x)g(x)\,dx\). Find the induced norm of \(f(x)=1+2x\).

Put the function in both slots, expand its square, and integrate term by term:

$$ \begin{aligned} \langle f,f\rangle &=\int_0^1(1+2x)(1+2x)\,dx\\ &=\int_0^1(1+4x+4x^2)\,dx\\ &=\left[x+2x^2+\frac{4}{3}x^3\right]_{0}^{1}\\ &=1+2+\frac{4}{3}-0\\ &=\frac{13}{3}. \end{aligned} $$

Hence \(\|f\|=\sqrt{\frac{13}{3}}\). The check is to square this value: \(\left(\sqrt{\frac{13}{3}}\right)^2=\frac{13}{3}\), exactly the integral just computed. The lower endpoint contributes zero because each term in the antiderivative vanishes at \(x=0\).

A Reliable Computation Routine

Although the arithmetic differs across spaces, the sequence of decisions is the same. First identify the inner product that belongs to the space. Next substitute the same object in both slots. Then simplify the resulting scalar, taking care with conjugates or integration limits. Finally take the nonnegative square root, and check by squaring the result. The definition itself justifies this routine: the quantity to be square-rooted is exactly \(\langle\mathbf{v},\mathbf{v}\rangle\), and the positive-definiteness axiom guarantees that it is a nonnegative real number.

1
Identify the inner product.
Check whether the object is a real or complex coordinate vector, a matrix, or a function, and use the corresponding formula.
2
Use the same object twice.
Write \(\langle\mathbf{v},\mathbf{v}\rangle\), or the matching expression for a matrix or function.
3
Evaluate the scalar carefully.
Conjugate the second slot over \(\mathbb{C}\); for functions, expand the integrand and evaluate it at both endpoints.
4
Take and check the root.
Choose the nonnegative square root and verify that its square equals the inner product value.

Common Mistakes

Forgetting complex conjugation can produce a value that is not even real. For the one-entry vector \(z=1+i\), a wrong calculation would use \(z^2=(1+i)^2=1+2i+i^2=2i\), then attempt to take \(\sqrt{2i}\) as though that were the squared length. The correction is to use the inner product with conjugation in the second slot: \(\langle z,z\rangle=z\overline{z}=(1+i)(1-i)=1-i+i-i^2=2\). Thus the induced norm is \(\sqrt{2}\), and \((\sqrt{2})^2=2\).

Do not stop at the squared length. In the function example, \(\frac{13}{3}\) is \(\langle f,f\rangle=\|f\|^2\), not the norm itself. The norm is \(\sqrt{\frac{13}{3}}\). Likewise, the matrix example gives squared length \(9\), while its induced norm is \(3\).

These computations also show why the particular inner product matters. A coordinate formula, a matrix formula, and an integral formula may look different, but each follows the same instruction: evaluate the chosen inner product on the object paired with itself, then take the nonnegative square root. Beyond these calculations, additional properties are needed to establish all the defining conditions of a norm.

Check Your Understanding

For each question, write the self-inner-product first, then take the nonnegative square root and check your result by squaring it.

  1. Find the induced norm of \(\begin{bmatrix}-5\\12\end{bmatrix}\) under the standard dot product on \(\mathbb{R}^2\).
  2. For \(\mathbf{z}=\begin{bmatrix}3+i\\1-2i\end{bmatrix}\), calculate \(\langle\mathbf{z},\mathbf{z}\rangle\) in the standard inner product on \(\mathbb{C}^2\), and then find \(\|\mathbf{z}\|\).
  3. Using the Frobenius inner product, find the induced norm of \(\begin{bmatrix}2&1\\-1&2\end{bmatrix}\).
  4. For \(f(x)=x\) on \([0,1]\), use \(\langle f,g\rangle=\int_0^1 f(x)g(x)\,dx\) to calculate \(\|f\|\).
  5. Explain why using \((1+i)^2\) instead of \((1+i)(1-i)\) does not calculate the standard induced norm of \(1+i\) in \(\mathbb{C}\).

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon