Tutorials › Linear Algebra › Unit Vectors And Normalization

Inner Products and Norms · Tutorial 623 of 1000

Unit Vectors And Normalization

Normalize nonzero vectors and check the result in real, complex, matrix, and function inner product spaces.

Intermediate 8 min read

What You'll Learn

  • Define unit vectors and normalization using an inner product norm.
  • Prove how scalar multiplication changes a vector’s norm over the real or complex field.
  • Normalize real and complex coordinate vectors and verify their lengths.
  • Normalize a matrix using the Frobenius inner product and norm.
  • Normalize a continuous function using an integral inner product.
  • Recognize why zero vectors cannot be normalized and correct a common denominator error.

Unit Length and the Normalization Idea

A nonzero vector can be rescaled to have length \(1\) without changing its direction in a real vector space. The same basic operation works over the complex field, with one important detail: multiplying by a complex scalar changes the norm by the scalar’s absolute value. Normalization is useful whenever a vector’s direction or relative components matter more than its original size. It also gives a standard way to prepare individual vectors for later work with orthogonality, without requiring that we study lists of vectors here.

Let \(V\) be an inner product space over \(\mathbb{F}\), where \(\mathbb{F}\) is either \(\mathbb{R}\) or \(\mathbb{C}\). The norm induced by the inner product is \(\|\mathbf{v}\|=\sqrt{\langle\mathbf{v},\mathbf{v}\rangle}\). Positive definiteness of the inner product means that \(\langle\mathbf{v},\mathbf{v}\rangle\) is a nonnegative real number and is zero exactly when \(\mathbf{v}=\mathbf{0}\). In particular, every nonzero vector has a strictly positive norm.

Definition: A unit vector in an inner product space is a vector \(\mathbf{u}\) satisfying \(\|\mathbf{u}\|=1\). If \(\mathbf{v}\ne\mathbf{0}\), its normalization is the vector \(\dfrac{\mathbf{v}}{\|\mathbf{v}\|}\). This is defined only for nonzero \(\mathbf{v}\), since \(\|\mathbf{0}\|=0\).

The denominator is the length of the original vector, not its squared length. Dividing by that positive real number rescales the vector to length \(1\). This works in both real and complex spaces; in the complex case, the inner product convention used here is linear in the first slot and conjugate-linear in the second. The next result justifies the scaling calculation behind normalization.

Theorem (Norm of a scalar multiple): If \(V\) is an inner product space over \(\mathbb{F}=\mathbb{R}\) or \(\mathbb{C}\), \(c\in\mathbb{F}\), and \(\mathbf{v}\in V\), then \(\|c\mathbf{v}\|=|c|\,\|\mathbf{v}\|\).

Proof. By the inner product’s linearity in the first slot and conjugate-linearity in the second, \(\langle c\mathbf{v},c\mathbf{v}\rangle=c\overline{c}\langle\mathbf{v},\mathbf{v}\rangle=|c|^2\|\mathbf{v}\|^2\). Taking nonnegative square roots gives \(\|c\mathbf{v}\|=|c|\,\|\mathbf{v}\|\), since both factors on the right are nonnegative. This also covers \(c=0\) and \(\mathbf{v}=\mathbf{0}\). \(\square\)

For a nonzero vector, take \(c=1/\|\mathbf{v}\|\), which is a positive real scalar whether the underlying field is real or complex. The theorem gives \(\|c\mathbf{v}\|=(1/\|\mathbf{v}\|)\|\mathbf{v}\|=1\). Thus division by the norm always produces a unit vector.

Theorem (Normalization gives unit length): For every nonzero vector \(\mathbf{v}\) in an inner product space over \(\mathbb{R}\) or \(\mathbb{C}\), the vector \(\mathbf{u}=\dfrac{\mathbf{v}}{\|\mathbf{v}\|}\) is a unit vector.

Proof. Positive definiteness gives \(\|\mathbf{v}\|>0\), so the quotient is defined. Applying the scalar-multiple result with \(c=1/\|\mathbf{v}\|\) gives \(\|\mathbf{u}\|=\left|1/\|\mathbf{v}\|\right|\|\mathbf{v}\|=1\). Here the absolute value equals \(1/\|\mathbf{v}\|\) because the norm is positive. \(\square\)

Real and Complex Coordinate Vectors

In \(\mathbb{R}^n\) with the standard inner product, \(\|\mathbf{x}\|=\sqrt{x_1^2+\cdots+x_n^2}\). In \(\mathbb{C}^n\) with the standard inner product, the squared norm is \(\|\mathbf{x}\|^2=|x_1|^2+\cdots+|x_n|^2\). The absolute values in the complex formula are essential: they ensure the squared norm is a nonnegative real number. In either setting, first compute the norm, then divide every coordinate by that same norm.

Worked Example: Normalizing a Real Coordinate Vector

Normalize \(\mathbf{x}=\begin{bmatrix}3\\-4\\12\end{bmatrix}\) in \(\mathbb{R}^3\) with its standard inner product.

Compute the squared norm by squaring each coordinate and adding:

$$ \|\mathbf{x}\|^2=3^2+(-4)^2+12^2=9+16+144=169. $$

Therefore \(\|\mathbf{x}\|=\sqrt{169}=13\), and the normalized vector is

$$ \mathbf{u}=\frac{\mathbf{x}}{\|\mathbf{x}\|} =\begin{bmatrix}3/13\\-4/13\\12/13\end{bmatrix}. $$

Check: Its squared norm is \((3/13)^2+(-4/13)^2+(12/13)^2=(9+16+144)/169=169/169=1\). Thus \(\|\mathbf{u}\|=1\), as required.

Worked Example: Normalizing a Complex Coordinate Vector

Normalize \(\mathbf{z}=\begin{bmatrix}1+i\\2i\end{bmatrix}\) in \(\mathbb{C}^2\) with its standard inner product.

For each entry, take its complex absolute value before squaring. Since \(|1+i|^2=1^2+1^2=2\) and \(|2i|^2=2^2=4\),

$$ \|\mathbf{z}\|^2=|1+i|^2+|2i|^2=2+4=6, \qquad \|\mathbf{z}\|=\sqrt{6}. $$

Dividing both entries by \(\sqrt{6}\) gives

$$ \mathbf{w}=\frac{\mathbf{z}}{\|\mathbf{z}\|} =\begin{bmatrix}(1+i)/\sqrt{6}\\2i/\sqrt{6}\end{bmatrix}. $$

Check: The squared absolute values of the new entries are \(2/6\) and \(4/6\), respectively. Hence \(\|\mathbf{w}\|^2=2/6+4/6=1\), so \(\|\mathbf{w}\|=1\). The calculation uses absolute values; treating \(1+i\) as if its squared length were \((1+i)^2\) would not compute the norm.

Normalization in Matrix and Function Spaces

Normalization is not limited to coordinate vectors. In a matrix space with the Frobenius inner product, the squared norm is the sum of the squared absolute values of all entries. For real matrices, this is simply the sum of the squares of the entries. A matrix can therefore be treated as one vector in that inner product space: compute its norm and divide every entry by it.

Worked Example: Normalizing a Real Matrix

Normalize \(\mathbf{A}=\begin{bmatrix}1&2\\-2&1\end{bmatrix}\) using the Frobenius inner product.

The squared Frobenius norm is the sum of the squares of the four entries:

$$ \|\mathbf{A}\|^2=1^2+2^2+(-2)^2+1^2=1+4+4+1=10, \qquad \|\mathbf{A}\|=\sqrt{10}. $$

Thus the normalized matrix is

$$ \mathbf{B}=\frac{\mathbf{A}}{\|\mathbf{A}\|} =\begin{bmatrix}1/\sqrt{10}&2/\sqrt{10}\\-2/\sqrt{10}&1/\sqrt{10}\end{bmatrix}. $$

Check: The squared Frobenius norm of \(\mathbf{B}\) is \(1/10+4/10+4/10+1/10=10/10=1\). Therefore \(\|\mathbf{B}\|=1\).

For functions, an integral formula must be used on a space where it really defines an inner product. For example, on the real vector space \(C([a,b])\) of continuous real-valued functions on a closed interval with \(a<b\), the formula \(\langle f,g\rangle=\int_a^b f(x)g(x)\,dx\) is an inner product. Each integral exists because the product of continuous functions is continuous on a closed bounded interval. For positive definiteness, if \(f\) is continuous and not the zero function, then \(f(x_0)\ne0\) at some \(x_0\in[a,b]\). Continuity implies that \(f(x)^2\) is bounded below by a positive number on a small interval around \(x_0\), using a one-sided interval if \(x_0\) is an endpoint. That interval has positive length, so \(\int_a^b f(x)^2\,dx>0\). This is why the continuity condition matters.

Worked Example: Normalizing a Continuous Function

On \(C([0,1])\) with the integral inner product, normalize \(f(x)=1+x\).

First compute the squared norm. Expand the square and integrate each term:

$$ \|f\|^2=\int_0^1(1+x)^2\,dx =\int_0^1(1+2x+x^2)\,dx =\left[x+x^2+\frac{x^3}{3}\right]_0^1 =1+1+\frac13=\frac73. $$

Therefore \(\|f\|=\sqrt{7/3}\), and dividing \(f\) by this positive number gives the normalized function \(u(x)=\sqrt{3/7}(1+x)\). To verify the result, calculate its squared norm:

$$ \|u\|^2 =\int_0^1\left(\sqrt{\frac37}(1+x)\right)^2\,dx =\frac37\int_0^1(1+x)^2\,dx =\frac37\cdot\frac73=1. $$

Thus \(\|u\|=1\). The integral calculation uses a continuous function on the closed interval, so it is valid in the stated inner product space.

Common Mistake: Dividing by the Squared Norm

A frequent error is to divide by \(\|\mathbf{v}\|^2\) instead of by \(\|\mathbf{v}\|\). For example, take \(\mathbf{v}=\begin{bmatrix}3\\4\end{bmatrix}\). Its norm is \(\sqrt{3^2+4^2}=5\), so dividing by the squared norm would give the incorrect candidate \(\widetilde{\mathbf{u}}=\begin{bmatrix}3/25\\4/25\end{bmatrix}\). Its norm is \(\sqrt{(3/25)^2+(4/25)^2}=\sqrt{25/625}=1/5\), not \(1\). The correction is to divide by \(5\), giving \(\mathbf{u}=\begin{bmatrix}3/5\\4/5\end{bmatrix}\). The check is \(\|\mathbf{u}\|^2=9/25+16/25=1\).

Two conditions keep the operation well-defined and correct. First, the original vector, matrix, or function must be nonzero in the stated inner product space, so its norm is positive. Second, divide by the norm itself. For complex vectors the denominator is still a positive real number; the complex entries are divided by it exactly as written. A zero vector has norm \(0\), so the quotient is undefined, and there is no normalization of the zero vector by this procedure.

There is also a useful distinction between a normalized vector and every unit vector pointing along the same real line or complex line. The normalized vector \(\mathbf{v}/\|\mathbf{v}\|\) uses a fixed positive denominator. If \(|c|=1\), then \(c\mathbf{v}/\|\mathbf{v}\|\) is also a unit vector, because its norm is \(|c|\|\mathbf{v}/\|\mathbf{v}\|\|=1\). In the real case, such scalars are \(1\) and \(-1\); in the complex case there are more. This does not change the normalization rule: the canonical result from a given \(\mathbf{v}\) is still obtained by dividing by its norm.

Check Your Understanding

For each problem, compute the norm before normalizing, then verify that the result has norm \(1\).

  1. Normalize \(\begin{bmatrix}5\\12\end{bmatrix}\) in \(\mathbb{R}^2\).
  2. Normalize \(\begin{bmatrix}2i\\1-i\end{bmatrix}\) in \(\mathbb{C}^2\), using squared absolute values.
  3. Using the Frobenius norm, normalize \(\begin{bmatrix}1&0\\0&-1\end{bmatrix}\).
  4. On \(C([0,1])\) with the integral inner product, find the normalization of \(f(x)=x\) and check it by integration.
  5. Explain why the zero vector cannot be normalized by division by its norm.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon