Tutorials › Linear Algebra › Orthogonal Changes of Coordinates in Orthonormal Bases

Orthogonal Matrices and Isometries · Tutorial 711 of 1000

Orthogonal Changes of Coordinates in Orthonormal Bases

Use an orthogonal matrix to convert coordinates between orthonormal bases, and use its transpose to reverse the conversion.

Intermediate 10 min read

What You'll Learn

  • Identify the direction of a change-of-coordinates matrix from its source and target bases.
  • Build the matrix from the coordinates of the source basis vectors in the target basis.
  • Prove that a change-of-coordinates matrix between orthonormal bases is orthogonal.
  • Convert coordinate columns and check the result by reconstructing the vector.
  • Reverse a coordinate change by multiplying by the transpose matrix.

One Vector, Different Coordinate Columns

A vector does not change when we describe it in a different basis, but its coordinate column usually does. For orthonormal bases, the conversion between these coordinate columns is especially structured: it is multiplication by an orthogonal matrix. The direction of that multiplication matters. We will use \(Q_{\mathcal{C}\leftarrow\mathcal{B}}\) for the matrix that takes coordinates in \(\mathcal{B}\) to coordinates in \(\mathcal{C}\).

Throughout, the vector space is \(\mathbb{R}^n\) with the dot product \(\mathbf{u}\cdot\mathbf{v}=\mathbf{u}^{\top}\mathbf{v}\). An ordered basis \(\mathcal{B}=(\mathbf{b}_1,\dots,\mathbf{b}_n)\) is orthonormal if \(\mathbf{b}_i\cdot\mathbf{b}_j=1\) when \(i=j\), and \(\mathbf{b}_i\cdot\mathbf{b}_j=0\) when \(i\ne j\). For any basis \(\mathcal{B}\), the coordinate vector \([\mathbf{v}]_{\mathcal{B}}\) is the column of scalars satisfying \(\mathbf{v}=c_1\mathbf{b}_1+\cdots+c_n\mathbf{b}_n\), where \(c_i\) is its \(i\)th entry. The basis property guarantees that this column exists and is unique.

Definition: Given ordered bases \(\mathcal{B}\) and \(\mathcal{C}\) of \(\mathbb{R}^n\), the change-of-coordinates matrix \(Q_{\mathcal{C}\leftarrow\mathcal{B}}\) is the matrix satisfying \([\mathbf{v}]_{\mathcal{C}}=Q_{\mathcal{C}\leftarrow\mathcal{B}}[\mathbf{v}]_{\mathcal{B}}\) for every \(\mathbf{v}\in\mathbb{R}^n\). Its \(j\)th column is \([\mathbf{b}_j]_{\mathcal{C}}\), the coordinates in the target basis \(\mathcal{C}\) of the \(j\)th source basis vector.

To see why the columns have this form, let \(\mathbf{x}=[\mathbf{v}]_{\mathcal{B}}\). Then \(\mathbf{v}=\sum_{j=1}^{n}x_j\mathbf{b}_j\). Expressing each \(\mathbf{b}_j\) in \(\mathcal{C}\) and collecting the coefficients gives the \(\mathcal{C}\)-coordinate column as the same linear combination of the columns \([\mathbf{b}_j]_{\mathcal{C}}\). This fixes the matrix direction: the columns are source basis vectors expressed in the target basis.

Why the Change Matrix Is Orthogonal

A square real matrix \(Q\) is orthogonal if \(Q^{\top}Q=I_n\). Equivalently, its columns form an orthonormal basis of \(\mathbb{R}^n\). The next theorem explains why orthonormal coordinate systems lead exactly to such matrices.

Theorem: Let \(\mathcal{B}=(\mathbf{b}_1,\dots,\mathbf{b}_n)\) and \(\mathcal{C}=(\mathbf{c}_1,\dots,\mathbf{c}_n)\) be orthonormal bases of \(\mathbb{R}^n\). Then \(Q_{\mathcal{C}\leftarrow\mathcal{B}}\) is orthogonal, and for every \(\mathbf{v}\in\mathbb{R}^n\), \([\mathbf{v}]_{\mathcal{C}}=Q_{\mathcal{C}\leftarrow\mathcal{B}}[\mathbf{v}]_{\mathcal{B}}\).

Proof. Write \(Q=Q_{\mathcal{C}\leftarrow\mathcal{B}}\). Its \(j\)th column is \([\mathbf{b}_j]_{\mathcal{C}}\). For any vectors \(\mathbf{u}\) and \(\mathbf{w}\), their coordinates \(\mathbf{a}=[\mathbf{u}]_{\mathcal{C}}\) and \(\mathbf{d}=[\mathbf{w}]_{\mathcal{C}}\) satisfy \(\mathbf{u}=\sum_i a_i\mathbf{c}_i\) and \(\mathbf{w}=\sum_k d_k\mathbf{c}_k\). Therefore \(\mathbf{u}\cdot\mathbf{w}=\sum_i\sum_k a_i d_k(\mathbf{c}_i\cdot\mathbf{c}_k)=\sum_i a_i d_i=\mathbf{a}^{\top}\mathbf{d}\), since the vectors in \(\mathcal{C}\) are orthonormal. Applying this to \(\mathbf{b}_i,\mathbf{b}_j\), the dot product of columns \(i\) and \(j\) of \(Q\) is \(\mathbf{b}_i\cdot\mathbf{b}_j\). That equals \(1\) if \(i=j\) and \(0\) otherwise, because \(\mathcal{B}\) is orthonormal. Thus \(Q^{\top}Q=I_n\), so \(Q\) is orthogonal. Finally, the definition of its columns gives the stated coordinate conversion: if \(\mathbf{v}=\sum_j x_j\mathbf{b}_j\), then its \(\mathcal{C}\)-coordinates are \(\sum_j x_j[\mathbf{b}_j]_{\mathcal{C}}=Q\mathbf{x}\), where \(\mathbf{x}=[\mathbf{v}]_{\mathcal{B}}\). \(\square\)

The transpose reverses the conversion. This follows from the orthogonality just proved and the standard fact that an orthogonal matrix has inverse equal to its transpose. In coordinate language, this means that once the \(\mathcal{C}\)-coordinates are known, multiplying by \(Q^{\top}\) recovers the \(\mathcal{B}\)-coordinates.

Corollary: For orthonormal bases \(\mathcal{B}\) and \(\mathcal{C}\), \([\mathbf{v}]_{\mathcal{B}}=Q_{\mathcal{C}\leftarrow\mathcal{B}}^{\top}[\mathbf{v}]_{\mathcal{C}}\) for every \(\mathbf{v}\in\mathbb{R}^n\). In particular, \(Q_{\mathcal{B}\leftarrow\mathcal{C}}=Q_{\mathcal{C}\leftarrow\mathcal{B}}^{\top}\).

Proof. The theorem gives \([\mathbf{v}]_{\mathcal{C}}=Q_{\mathcal{C}\leftarrow\mathcal{B}}[\mathbf{v}]_{\mathcal{B}}\), and \(Q_{\mathcal{C}\leftarrow\mathcal{B}}^{\top}Q_{\mathcal{C}\leftarrow\mathcal{B}}=I_n\). Multiply the coordinate equation on the left by \(Q_{\mathcal{C}\leftarrow\mathcal{B}}^{\top}\). The result is \([\mathbf{v}]_{\mathcal{B}}=Q_{\mathcal{C}\leftarrow\mathcal{B}}^{\top}[\mathbf{v}]_{\mathcal{C}}\). Since this holds for every coordinate column in \(\mathcal{C}\), the matrix that converts from \(\mathcal{C}\) to \(\mathcal{B}\) is the transpose. \(\square\)

Calculating a Change of Coordinates

Worked Example: Standard Coordinates to a Rotated Orthonormal Basis

Let \(\mathcal{B}=(\mathbf{e}_1,\mathbf{e}_2)\) be the standard basis of \(\mathbb{R}^2\), and let \(\mathcal{C}=(\mathbf{c}_1,\mathbf{c}_2)\), where \(\mathbf{c}_1=(3/5,4/5)^{\top}\) and \(\mathbf{c}_2=(-4/5,3/5)^{\top}\). Convert the vector with \(\mathcal{B}\)-coordinates \((2,-1)^{\top}\) to \(\mathcal{C}\)-coordinates.

First check the target basis is orthonormal. Each vector has squared length \(9/25+16/25=1\), and their dot product is \(-12/25+12/25=0\). The columns of the conversion matrix are the \(\mathcal{C}\)-coordinates of \(\mathbf{e}_1\) and \(\mathbf{e}_2\). Since \(\mathcal{C}\) is orthonormal, those coordinates are the dot products with \(\mathbf{c}_1,\mathbf{c}_2\), so

$$ Q_{\mathcal{C}\leftarrow\mathcal{B}} = \begin{bmatrix} 3/5 & 4/5\\ -4/5 & 3/5 \end{bmatrix}. $$

Multiply by the given coordinate column:

$$ [\mathbf{v}]_{\mathcal{C}} = \begin{bmatrix} 3/5 & 4/5\\ -4/5 & 3/5 \end{bmatrix} \begin{bmatrix}2\\-1\end{bmatrix} = \begin{bmatrix} 6/5-4/5\\ -8/5-3/5 \end{bmatrix} = \begin{bmatrix}2/5\\-11/5\end{bmatrix}. $$

Check: Reconstructing the vector in \(\mathcal{C}\) gives \((2/5)\mathbf{c}_1-(11/5)\mathbf{c}_2=(6/25+44/25,\;8/25-33/25)^{\top}=(2,-1)^{\top}\). This is the original vector, whose standard-coordinate column was \((2,-1)^{\top}\).

For an orthonormal basis \(\mathcal{C}\), there is a useful direct formula: the \(i\)th coordinate of \(\mathbf{v}\) is \(\mathbf{v}\cdot\mathbf{c}_i\). Indeed, if \(\mathbf{v}=\sum_j d_j\mathbf{c}_j\), then \(\mathbf{v}\cdot\mathbf{c}_i=\sum_j d_j(\mathbf{c}_j\cdot\mathbf{c}_i)=d_i\). This is why dot products can produce the columns of a change matrix without solving a system.

Worked Example: Converting Between Two Nonstandard Bases

Let \(\mathcal{B}\) have basis columns \(\mathbf{b}_1=(3/5,4/5)^{\top}\), \(\mathbf{b}_2=(-4/5,3/5)^{\top}\), and let \(\mathcal{C}\) have basis columns \(\mathbf{c}_1=(5/13,12/13)^{\top}\), \(\mathbf{c}_2=(-12/13,5/13)^{\top}\). Convert \([\mathbf{v}]_{\mathcal{B}}=(1,2)^{\top}\) to \(\mathcal{C}\)-coordinates.

Both lists are orthonormal: each vector has length \(1\), and within each pair the dot product is \(0\). The columns of \(Q_{\mathcal{C}\leftarrow\mathcal{B}}\) are obtained by taking dot products of each \(\mathbf{b}_j\) with \(\mathbf{c}_1,\mathbf{c}_2\):

$$ Q_{\mathcal{C}\leftarrow\mathcal{B}} = \begin{bmatrix} (15+48)/65 & (-20+36)/65\\ (-36+20)/65 & (48+15)/65 \end{bmatrix} = \begin{bmatrix} 63/65 & 16/65\\ -16/65 & 63/65 \end{bmatrix}. $$

Thus

$$ [\mathbf{v}]_{\mathcal{C}} = \begin{bmatrix}63/65&16/65\\-16/65&63/65\end{bmatrix} \begin{bmatrix}1\\2\end{bmatrix} = \begin{bmatrix}95/65\\110/65\end{bmatrix} = \begin{bmatrix}19/13\\22/13\end{bmatrix}. $$

Check: In the source basis, the vector is \(\mathbf{b}_1+2\mathbf{b}_2=(-1,2)^{\top}\). In the target basis, the computed coordinates reconstruct it: \((19/13)\mathbf{c}_1+(22/13)\mathbf{c}_2=((95-264)/169,\;(228+110)/169)^{\top}=(-1,2)^{\top}\).

Using the Transpose to Reverse the Change

Worked Example: Recovering the Original Coordinates

Use the change matrix from the previous example to recover the \(\mathcal{B}\)-coordinates from \([\mathbf{v}]_{\mathcal{C}}=(19/13,22/13)^{\top}\). The reverse matrix is the transpose, so

$$ Q_{\mathcal{C}\leftarrow\mathcal{B}}^{\top} = \begin{bmatrix}63/65&-16/65\\16/65&63/65\end{bmatrix}. $$

Multiplying gives

$$ [\mathbf{v}]_{\mathcal{B}} = \begin{bmatrix}63/65&-16/65\\16/65&63/65\end{bmatrix} \begin{bmatrix}19/13\\22/13\end{bmatrix} = \begin{bmatrix}(1197-352)/845\\(304+1386)/845\end{bmatrix} = \begin{bmatrix}1\\2\end{bmatrix}. $$

Check: This matches the original source coordinate column. The reverse multiplication works because \(Q^{\top}Q=I_2\); explicitly, the diagonal numerator in \(Q^{\top}Q\) is \(63^2+16^2=4225=65^2\), while its off-diagonal numerator is \(63(16)-16(63)=0\).

A Three-Dimensional Calculation

Worked Example: Standard Coordinates to an Orthonormal Basis in R³

Let \(\mathcal{B}\) be the standard basis and let \(\mathcal{C}=(\mathbf{c}_1,\mathbf{c}_2,\mathbf{c}_3)\), with \(\mathbf{c}_1=(1,2,2)^{\top}/3\), \(\mathbf{c}_2=(2,1,-2)^{\top}/3\), and \(\mathbf{c}_3=(-2,2,-1)^{\top}/3\). Convert \(\mathbf{v}=(1,0,2)^{\top}\) to \(\mathcal{C}\)-coordinates.

Each vector has squared length \(9/9=1\). Their pairwise dot-product numerators are \(2+2-4=0\), \(-2+4-2=0\), and \(-4+2+2=0\), so the basis is orthonormal. The coordinates are the dot products:

$$ [\mathbf{v}]_{\mathcal{C}} = \begin{bmatrix} \mathbf{v}\cdot\mathbf{c}_1\\ \mathbf{v}\cdot\mathbf{c}_2\\ \mathbf{v}\cdot\mathbf{c}_3 \end{bmatrix} = \begin{bmatrix}5/3\\-2/3\\-4/3\end{bmatrix}. $$

Check: Reconstructing gives \((5/3)\mathbf{c}_1-(2/3)\mathbf{c}_2-(4/3)\mathbf{c}_3=(5/9,10/9,10/9)^{\top}+(-4/9,-2/9,4/9)^{\top}+(8/9,-8/9,4/9)^{\top}=(1,0,2)^{\top}\).

Common Mistakes and Why the Structure Matters

Reversing the matrix direction. In the second example, the matrix \(Q_{\mathcal{C}\leftarrow\mathcal{B}}\) sends \((1,2)^{\top}\) to \((19/13,22/13)^{\top}\). A common error is to use \(Q^{\top}\) for that same forward conversion. But \(Q^{\top}(1,2)^{\top}=(31/65,142/65)^{\top}\), not \((19/13,22/13)^{\top}\). The correction is to track the arrow: \(Q_{\mathcal{C}\leftarrow\mathcal{B}}\) acts on \(\mathcal{B}\)-coordinates; its transpose acts on \(\mathcal{C}\)-coordinates to return to \(\mathcal{B}\).

Do not confuse coordinates with the vector itself. A coordinate column depends on its basis. The entries \((1,2)^{\top}\) in the second example mean \(\mathbf{b}_1+2\mathbf{b}_2\), not the standard-coordinate vector \((1,2)^{\top}\). The reconstruction check is a reliable way to catch this distinction.

Orthogonal coordinate changes are useful because they preserve dot products and lengths of coordinate columns. If \(\mathbf{x}=[\mathbf{u}]_{\mathcal{B}}\), \(\mathbf{y}=[\mathbf{w}]_{\mathcal{B}}\), and \(Q=Q_{\mathcal{C}\leftarrow\mathcal{B}}\), then \((Q\mathbf{x})^{\top}(Q\mathbf{y})=\mathbf{x}^{\top}Q^{\top}Q\mathbf{y}=\mathbf{x}^{\top}\mathbf{y}\). Thus changing between orthonormal coordinate systems does not alter the geometry encoded by the coordinates. The matrix changes the description, not the vectors or their relationships.

Check Your Understanding

For each question, keep the source and target bases explicit; when possible, verify by reconstructing the vector.

  1. For orthonormal bases \(\mathcal{B}\) and \(\mathcal{C}\), what do the columns of \(Q_{\mathcal{C}\leftarrow\mathcal{B}}\) represent?
  2. If \(Q_{\mathcal{C}\leftarrow\mathcal{B}}=\begin{bmatrix}0&1\\-1&0\end{bmatrix}\) and \([\mathbf{v}]_{\mathcal{B}}=(3,2)^{\top}\), find \([\mathbf{v}]_{\mathcal{C}}\).
  3. Using the matrix and coordinates in question 2, recover \([\mathbf{v}]_{\mathcal{B}}\) from \([\mathbf{v}]_{\mathcal{C}}\) with the transpose.
  4. Explain why \(Q_{\mathcal{C}\leftarrow\mathcal{B}}^{\top}Q_{\mathcal{C}\leftarrow\mathcal{B}}=I_n\) when both bases are orthonormal.
  5. A student uses \(Q^{\top}\) to convert from \(\mathcal{B}\)-coordinates to \(\mathcal{C}\)-coordinates. State the direction error and the correct multiplication.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon