Tutorials › Linear Algebra › Why Induced Norms Are Norms

Inner Products and Norms · Tutorial 607 of 1000

Why Induced Norms Are Norms

Learn how the inner product axioms guarantee three defining properties of the induced length, including why complex scalars require their modulus.

Intermediate 9 min read

What You'll Learn

  • Define the length induced by a real or complex inner product
  • Prove that the induced quantity is real and nonnegative
  • Show that it vanishes exactly at the zero vector
  • Derive absolute homogeneity for real and complex scalars
  • Apply the proofs to real and complex coordinate examples
  • Spot the error in scaling complex lengths by a scalar rather than its modulus

From an Inner Product to a Length

An inner product assigns a scalar to a pair of vectors. When both inputs are the same vector, the result can be interpreted as the square of its length. This interpretation is not automatic: it relies on the positivity and scalar rules in the inner product axioms. In particular, for a complex vector space the scalar \(\langle\mathbf{v},\mathbf{v}\rangle\) must be real and nonnegative, even though inner products of two different vectors can be complex.

We work over \(\mathbb{F}=\mathbb{R}\) or \(\mathbb{F}=\mathbb{C}\). An inner product on a vector space \(V\) over \(\mathbb{F}\) is a function \(\langle\cdot,\cdot\rangle:V\times V\to\mathbb{F}\) that is linear in its first slot, conjugate-symmetric, and positive definite. Linearity in the first slot means, in particular, \(\langle a\mathbf{u},\mathbf{v}\rangle=a\langle\mathbf{u},\mathbf{v}\rangle\) and \(\langle\mathbf{u}+\mathbf{w},\mathbf{v}\rangle=\langle\mathbf{u},\mathbf{v}\rangle+\langle\mathbf{w},\mathbf{v}\rangle\). Conjugate symmetry means \(\langle\mathbf{u},\mathbf{v}\rangle=\overline{\langle\mathbf{v},\mathbf{u}\rangle}\); over \(\mathbb{R}\), this is ordinary symmetry. Positive definiteness means \(\langle\mathbf{v},\mathbf{v}\rangle\) is real and nonnegative for every \(\mathbf{v}\), and equals zero exactly when \(\mathbf{v}=\mathbf{0}\). For a real scalar, its modulus is its absolute value; for a complex scalar \(a\), \(|a|=\sqrt{a\overline a}\).

Definition: For an inner product space \(V\), the induced norm is the function defined by \(\|\mathbf{v}\|=\sqrt{\langle\mathbf{v},\mathbf{v}\rangle}\), where the square root is the nonnegative real square root. A norm must be nonnegative, vanish exactly at \(\mathbf{0}\), satisfy \(\|a\mathbf{v}\|=|a|\|\mathbf{v}\|\), and satisfy the triangle inequality \(\|\mathbf{u}+\mathbf{v}\|\leq\|\mathbf{u}\|+\|\mathbf{v}\|\). This tutorial proves the first three properties; the triangle inequality requires an additional estimate and is treated separately.

The definition of an inner product already tells us that the quantity under the square root is a nonnegative real number. The other properties need attention too. In particular, definiteness uses the “exactly when” part of positive definiteness, while absolute homogeneity uses both slots of the inner product: scaling the first slot contributes \(a\), and scaling the second contributes \(\overline a\).

The Three Properties from the Axioms

Theorem: Let \(V\) be an inner product space over \(\mathbb{F}=\mathbb{R}\) or \(\mathbb{C}\), with inner product linear in its first slot. The induced quantity \(\|\mathbf{v}\|=\sqrt{\langle\mathbf{v},\mathbf{v}\rangle}\) is real and nonnegative, satisfies \(\|\mathbf{v}\|=0\) if and only if \(\mathbf{v}=\mathbf{0}\), and satisfies \(\|a\mathbf{v}\|=|a|\|\mathbf{v}\|\) for every \(a\in\mathbb{F}\) and \(\mathbf{v}\in V\).

Proof. Fix \(\mathbf{v}\in V\). By positive definiteness, \(\langle\mathbf{v},\mathbf{v}\rangle\) is a real number greater than or equal to zero. Its nonnegative square root is therefore real and nonnegative, so \(\|\mathbf{v}\|\geq0\). Also, a nonnegative real number has square root zero exactly when it is zero. Thus \(\|\mathbf{v}\|=0\) if and only if \(\langle\mathbf{v},\mathbf{v}\rangle=0\), which by positive definiteness holds if and only if \(\mathbf{v}=\mathbf{0}\).

Now fix \(a\in\mathbb{F}\). Conjugate symmetry and linearity in the first slot imply conjugate-linearity in the second slot: \(\langle\mathbf{u},a\mathbf{w}\rangle=\overline a\langle\mathbf{u},\mathbf{w}\rangle\). Indeed, \(\langle\mathbf{u},a\mathbf{w}\rangle=\overline{\langle a\mathbf{w},\mathbf{u}\rangle}=\overline{a\langle\mathbf{w},\mathbf{u}\rangle}=\overline a\langle\mathbf{u},\mathbf{w}\rangle\). Consequently, \(\langle a\mathbf{v},a\mathbf{v}\rangle=a\overline a\langle\mathbf{v},\mathbf{v}\rangle=|a|^2\langle\mathbf{v},\mathbf{v}\rangle\). Both sides are nonnegative real numbers. Taking their nonnegative square roots gives \(\|a\mathbf{v}\|=|a|\|\mathbf{v}\|\), since \(|a|\geq0\) and \(\|\mathbf{v}\|\geq0\). This also covers \(a=0\): both sides are zero. \(\square\)

The proof shows why the scalar modulus, rather than the scalar itself, appears in the homogeneity rule. A length cannot acquire a negative or nonreal factor when a vector is rescaled. The product \(a\overline a=|a|^2\) is what ensures that the squared length is multiplied by a nonnegative real number.

Consequence: The zero vector has induced norm zero, and no other vector does. Moreover, for a nonzero scalar \(a\), multiplying a vector by \(a\) multiplies its induced norm by the positive number \(|a|\). For \(a=0\), the scaled vector is \(\mathbf{0}\), whose norm is zero.

For completeness, the zero-vector case also follows directly from the axioms. Linearity gives \(\langle\mathbf{0},\mathbf{0}\rangle=\langle\mathbf{0}+\mathbf{0},\mathbf{0}\rangle=2\langle\mathbf{0},\mathbf{0}\rangle\), so \(\langle\mathbf{0},\mathbf{0}\rangle=0\), and hence \(\|\mathbf{0}\|=0\). This agrees with the theorem’s definiteness statement.

Worked Examples in Real and Complex Spaces

Worked Example: Scaling a Real Vector

Use the standard dot product on \(\mathbb{R}^2\) to find the induced norm of \(\mathbf{v}=(3,4)^\top\) and of \(-2\mathbf{v}\), then check absolute homogeneity.

For the standard dot product, \(\langle\mathbf{v},\mathbf{v}\rangle=3^2+4^2=9+16=25\). Therefore \(\|\mathbf{v}\|=\sqrt{25}=5\). Scaling the vector gives \(-2\mathbf{v}=(-6,-8)^\top\), so

$$ \|-2\mathbf{v}\| =\sqrt{(-6)^2+(-8)^2} =\sqrt{36+64} =\sqrt{100} =10. $$

The homogeneity rule predicts \(|-2|\|\mathbf{v}\|=2\cdot5=10\), which agrees with the direct calculation. The negative scalar reverses the direction of the vector but does not make its length negative.

Worked Example: Scaling a Complex Vector

Use the standard inner product on \(\mathbb{C}^2\), linear in the first slot, to find the norm of \(\mathbf{z}=(1+i,2-i)^\top\) and of \((1-i)\mathbf{z}\).

For a vector \((z_1,z_2)^\top\), this inner product gives \(\langle\mathbf{z},\mathbf{z}\rangle=z_1\overline{z_1}+z_2\overline{z_2}\). Thus

$$ \langle\mathbf{z},\mathbf{z}\rangle =(1+i)(1-i)+(2-i)(2+i) =2+5 =7, \qquad \|\mathbf{z}\|=\sqrt{7}. $$

Now multiply each coordinate by \(1-i\):

$$ (1-i)\mathbf{z} = \begin{bmatrix} (1-i)(1+i)\\ (1-i)(2-i) \end{bmatrix} = \begin{bmatrix} 2\\ 1-3i \end{bmatrix}. $$

The squared norm of this scaled vector is \(2\overline{2}+(1-3i)(1+3i)=4+10=14\). Its norm is therefore \(\sqrt{14}\). Separately, \(|1-i|=\sqrt{(1-i)(1+i)}=\sqrt2\), so the homogeneity rule gives \(|1-i|\|\mathbf{z}\|=\sqrt2\sqrt7=\sqrt{14}\). The direct calculation and the rule agree.

Worked Example: A Zero Scalar and a Nonzero Vector

In \(\mathbb{R}^3\) with the standard dot product, take \(\mathbf{u}=(1,-2,2)^\top\) and \(a=-\tfrac32\). Compute the norm before and after scaling, and check the formula.

First, \(\langle\mathbf{u},\mathbf{u}\rangle=1^2+(-2)^2+2^2=1+4+4=9\), so \(\|\mathbf{u}\|=3\). The scaled vector is

$$ -\frac32\mathbf{u} = \begin{bmatrix} -\frac32\\ 3\\ -3 \end{bmatrix}. $$

Its squared norm is \((-\tfrac32)^2+3^2+(-3)^2=\tfrac94+9+9=\tfrac{81}{4}\). Hence its norm is \(\sqrt{\tfrac{81}{4}}=\tfrac92\). Since \(|-\tfrac32|=\tfrac32\), the homogeneity rule gives \(\tfrac32\cdot3=\tfrac92\), as required. If instead \(a=0\), then \(a\mathbf{u}=\mathbf{0}\) and \(\|a\mathbf{u}\|=0=|a|\|\mathbf{u}\|\); the formula includes this case without an exception.

A Common Mistake with Complex Scalars

Pitfall: multiplying a complex vector’s norm by the scalar itself. Let \(\mathbf{z}=(1,0)^\top\in\mathbb{C}^2\), with the standard complex inner product, and take \(a=i\). Since \(\|\mathbf{z}\|=1\), an incorrect use of homogeneity might claim \(\|i\mathbf{z}\|=i\|\mathbf{z}\|=i\). This cannot be a norm value: it is not even real.

The correction is to use the modulus. Here \(i\mathbf{z}=(i,0)^\top\), and its squared norm is \(i\overline{i}+0=1\), so \(\|i\mathbf{z}\|=1\). Also, \(|i|=\sqrt{i\overline{i}}=1\), and the correct formula gives \(|i|\|\mathbf{z}\|=1\cdot1=1\). The inner product calculation explains the correction: scaling both slots produces \(i\overline i\), not \(i\) alone.

A second error is to infer definiteness from nonnegativity alone. A nonnegative function could still be zero at a nonzero vector. For the induced quantity, the “zero only at \(\mathbf{0}\)” conclusion comes specifically from positive definiteness of the inner product. Both parts of that axiom are needed: nonnegativity makes the square root meaningful, and its zero condition establishes definiteness.

What Has Been Established

The calculations in the examples illustrate the general proof, but the result does not depend on coordinates or on a particular formula for an inner product. It applies to every inner product space over \(\mathbb{R}\) or \(\mathbb{C}\), whether finite-dimensional or not. Only the inner product axioms were used: positivity for nonnegativity and definiteness, and linearity together with conjugate symmetry for scalar homogeneity.

These three properties justify treating \(\sqrt{\langle\mathbf{v},\mathbf{v}\rangle}\) as a candidate length. They do not, by themselves, establish every norm axiom: the triangle inequality is a separate requirement. Its proof for induced norms uses a bound on inner products and is developed separately. Keeping these logical steps distinct prevents the mistake of treating a verified subset of the norm properties as a complete proof.

Check Your Understanding

Use the inner product axioms in your reasoning, and distinguish the real and complex scalar cases where needed.

  1. Why does positive definiteness ensure that \(\sqrt{\langle\mathbf{v},\mathbf{v}\rangle}\) is a real number?
  2. For \(\mathbf{v}=(5,12)^\top\in\mathbb{R}^2\), compute \(\|\mathbf{v}\|\) and \(\|-3\mathbf{v}\|\), then verify absolute homogeneity.
  3. For a complex scalar \(a\), explain why scaling both slots gives \(a\overline a\), rather than \(a^2\), as the factor on \(\langle\mathbf{v},\mathbf{v}\rangle\).
  4. If \(\|\mathbf{v}\|=0\), which inner product axiom lets you conclude \(\mathbf{v}=\mathbf{0}\)?
  5. For \(\mathbf{z}=(1,i)^\top\in\mathbb{C}^2\) and \(a=-i\), calculate \(\|\mathbf{z}\|\), \(|a|\), and \(\|a\mathbf{z}\|\).

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon