Tutorials › Linear Algebra › Transition Matrices and Coordinate Direction

Similarity and Change of Basis for Operators · Tutorial 467 of 1000

Transition Matrices and Coordinate Direction

Build transition matrices from basis vectors and use the correct matrix to translate coordinates in either direction.

Intermediate 9 min read

What You'll Learn

  • Construct a transition matrix by placing the new basis vectors’ old coordinates in its columns.
  • Read the direction of a transition matrix from its subscripts.
  • Convert coordinate vectors from one basis to another and check the result by reconstruction.
  • Reverse a coordinate conversion using the inverse transition matrix.
  • Compose successive coordinate changes in the correct order.
  • Recognize and correct common direction and multiplication errors.

Coordinates Depend on the Basis

A vector does not change when we describe it using a different basis, but its coordinate column generally does. A transition matrix records how to translate between these descriptions. The key to using one correctly is to keep track of its direction: the columns of the matrix from a new basis to an old basis are the new basis vectors written in old coordinates.

Let \(V\) be a finite-dimensional vector space over \(\mathbb{R}\), and let \(\mathcal{B}=(\mathbf{b}_1,\dots,\mathbf{b}_n)\) and \(\mathcal{C}=(\mathbf{c}_1,\dots,\mathbf{c}_n)\) be ordered bases of \(V\). The coordinate vector \([\mathbf{v}]_{\mathcal{B}}\) is the column of coefficients in the unique expression \(\mathbf{v}=a_1\mathbf{b}_1+\cdots+a_n\mathbf{b}_n\). The ordering matters: changing the order of a basis changes the coordinate columns and the transition matrix.

Definition: The transition matrix \(\mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}}\) converts \(\mathcal{C}\)-coordinates into \(\mathcal{B}\)-coordinates. Its \(j\)th column is \([\mathbf{c}_j]_{\mathcal{B}}\), so \[ \mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}} = \begin{bmatrix} [\mathbf{c}_1]_{\mathcal{B}}&\cdots&[\mathbf{c}_n]_{\mathcal{B}} \end{bmatrix}. \] The arrow points toward the basis whose coordinates are produced.

For example, \(\mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}}\) takes a coordinate column with subscript \(\mathcal{C}\) as input and produces one with subscript \(\mathcal{B}\). The reverse conversion is \(\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}\). The subscripts are a useful safeguard against treating a coordinate vector as though it were the vector itself.

Building and Using a Transition Matrix

Theorem: For ordered bases \(\mathcal{B}\) and \(\mathcal{C}\) of the same finite-dimensional real vector space \(V\), and every \(\mathbf{v}\in V\), \[ [\mathbf{v}]_{\mathcal{B}} =\mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}}[\mathbf{v}]_{\mathcal{C}}. \] Moreover, \(\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}=\bigl(\mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}}\bigr)^{-1}\).

Proof. Write \([\mathbf{v}]_{\mathcal{C}}=(d_1,\dots,d_n)^{\top}\). By the definition of coordinates, \(\mathbf{v}=\sum_{j=1}^{n}d_j\mathbf{c}_j\). Write each basis vector \(\mathbf{c}_j\) in the basis \(\mathcal{B}\); its coefficient column is \([\mathbf{c}_j]_{\mathcal{B}}\), the \(j\)th column of \(\mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}}\). Therefore the \(\mathcal{B}\)-coordinate column of \(\sum_{j=1}^{n}d_j\mathbf{c}_j\) is \(\sum_{j=1}^{n}d_j[\mathbf{c}_j]_{\mathcal{B}}=\mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}}[\mathbf{v}]_{\mathcal{C}}\), proving the conversion formula. Applying the same formula in the reverse direction gives \([\mathbf{v}]_{\mathcal{C}}=\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}[\mathbf{v}]_{\mathcal{B}}\). Substitution of the first formula into the second yields \([\mathbf{v}]_{\mathcal{C}}=\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}\mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}}[\mathbf{v}]_{\mathcal{C}}\). This holds for every coordinate column, including each standard coordinate column, so the product is \(\mathbf{I}_n\). Reversing the roles of the bases gives the product in the opposite order as \(\mathbf{I}_n\) as well. Thus the two transition matrices are inverses. \(\square\)

Worked Example: Convert Coordinates in Both Directions

In \(V=\mathbb{R}^3\), let \(\mathcal{B}=(\mathbf{e}_1,\mathbf{e}_2,\mathbf{e}_3)\) be the standard basis and let \(\mathcal{C}=(\mathbf{c}_1,\mathbf{c}_2,\mathbf{c}_3)\), where \(\mathbf{c}_1=(1,0,0)^{\top}\), \(\mathbf{c}_2=(1,1,0)^{\top}\), and \(\mathbf{c}_3=(0,1,1)^{\top}\). Find the \(\mathcal{B}\)-coordinates of the vector whose \(\mathcal{C}\)-coordinates are \((2,-1,3)^{\top}\), then convert back.

Since \(\mathcal{B}\) is the standard basis, the columns of \(\mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}}\) are the displayed entries of the \(\mathbf{c}_j\):

$$ \mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}} = \begin{bmatrix} 1&1&0\\ 0&1&1\\ 0&0&1 \end{bmatrix}. $$

Multiply this matrix by the given \(\mathcal{C}\)-coordinate column:

$$ \begin{bmatrix} 1&1&0\\ 0&1&1\\ 0&0&1 \end{bmatrix} \begin{bmatrix}2\\-1\\3\end{bmatrix} = \begin{bmatrix} 2-1\\ -1+3\\ 3 \end{bmatrix} = \begin{bmatrix}1\\2\\3\end{bmatrix}. $$

Thus \([\mathbf{v}]_{\mathcal{B}}=(1,2,3)^{\top}\). To convert back, solve from the transition formula, or use the inverse matrix. Here the inverse is \[ \mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}} = \begin{bmatrix} 1&-1&1\\ 0&1&-1\\ 0&0&1 \end{bmatrix}, \] as multiplication with \(\mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}}\) in either order gives \(\mathbf{I}_3\). Applying it gives \[ \begin{bmatrix} 1&-1&1\\ 0&1&-1\\ 0&0&1 \end{bmatrix} \begin{bmatrix}1\\2\\3\end{bmatrix} = \begin{bmatrix}1-2+3\\2-3\\3\end{bmatrix} = \begin{bmatrix}2\\-1\\3\end{bmatrix}. \]

Check by reconstruction: the original vector is \(2\mathbf{c}_1-\mathbf{c}_2+3\mathbf{c}_3=(2,0,0)^{\top}-(1,1,0)^{\top}+(0,3,3)^{\top}=(1,2,3)^{\top}\), exactly the \(\mathcal{B}\)-coordinate column because \(\mathcal{B}\) is standard. Converting back recovers the given coordinates.

The inverse relationship is not an extra computational trick: it follows because both coordinate systems describe the same vector, and each basis gives a unique coordinate column. In a calculation, however, it is often faster to solve a small system than to compute an inverse explicitly.

Changing Coordinates Through an Intermediate Basis

Suppose there are three ordered bases \(\mathcal{B},\mathcal{C},\mathcal{D}\). To convert from \(\mathcal{D}\)-coordinates to \(\mathcal{B}\)-coordinates, first convert from \(\mathcal{D}\) to \(\mathcal{C}\), then from \(\mathcal{C}\) to \(\mathcal{B}\). Matrix multiplication acts right to left, so the matrix for the first conversion appears on the right.

Theorem: For ordered bases \(\mathcal{B},\mathcal{C},\mathcal{D}\) of the same finite-dimensional real vector space, \[ \mathbf{P}_{\mathcal{B}\leftarrow\mathcal{D}} = \mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}} \mathbf{P}_{\mathcal{C}\leftarrow\mathcal{D}}. \]

Proof. Let \(\mathbf{v}\) be any vector in the space. The transition formula gives \([\mathbf{v}]_{\mathcal{C}}=\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{D}}[\mathbf{v}]_{\mathcal{D}}\), and then \([\mathbf{v}]_{\mathcal{B}}=\mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}}[\mathbf{v}]_{\mathcal{C}}\). Substituting the first equality into the second gives \([\mathbf{v}]_{\mathcal{B}}=\mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}}\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{D}}[\mathbf{v}]_{\mathcal{D}}\). This holds for every \(\mathbf{v}\), and in particular for vectors whose \(\mathcal{D}\)-coordinate columns are the standard coordinate columns. The columns of the product are therefore exactly the \(\mathcal{B}\)-coordinates of the \(\mathcal{D}\) basis vectors, which define \(\mathbf{P}_{\mathcal{B}\leftarrow\mathcal{D}}\). \(\square\)

Worked Example: Compose Two Coordinate Changes

Suppose the columns of the following matrices give the indicated basis coordinates: \[ \mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}} = \begin{bmatrix}1&1&0\\0&1&1\\0&0&1\end{bmatrix}, \qquad \mathbf{P}_{\mathcal{C}\leftarrow\mathcal{D}} = \begin{bmatrix}1&0&1\\0&1&0\\0&0&1\end{bmatrix}. \] Find the direct conversion from \(\mathcal{D}\)-coordinates to \(\mathcal{B}\)-coordinates and apply it to \((2,-1,1)^{\top}\).

By the composition theorem, multiply in the order that applies the \(\mathcal{D}\)-to-\(\mathcal{C}\) conversion first:

$$ \begin{aligned} \mathbf{P}_{\mathcal{B}\leftarrow\mathcal{D}} &= \begin{bmatrix}1&1&0\\0&1&1\\0&0&1\end{bmatrix} \begin{bmatrix}1&0&1\\0&1&0\\0&0&1\end{bmatrix}\\ &= \begin{bmatrix} 1&1&1\\ 0&1&1\\ 0&0&1 \end{bmatrix}. \end{aligned} $$

For instance, the third column is the first column plus the third column of the left factor: \((1,0,0)^{\top}+(0,1,1)^{\top}=(1,1,1)^{\top}\). This agrees with the displayed product. Apply the two conversions in sequence:

$$ \begin{bmatrix}1&0&1\\0&1&0\\0&0&1\end{bmatrix} \begin{bmatrix}2\\-1\\1\end{bmatrix} = \begin{bmatrix}3\\-1\\1\end{bmatrix}, \qquad \begin{bmatrix}1&1&0\\0&1&1\\0&0&1\end{bmatrix} \begin{bmatrix}3\\-1\\1\end{bmatrix} = \begin{bmatrix}2\\0\\1\end{bmatrix}. $$

The direct product gives the same answer: \[ \begin{bmatrix}1&1&1\\0&1&1\\0&0&1\end{bmatrix} \begin{bmatrix}2\\-1\\1\end{bmatrix} = \begin{bmatrix}2-1+1\\-1+1\\1\end{bmatrix} = \begin{bmatrix}2\\0\\1\end{bmatrix}. \] Check: the \(\mathcal{D}\)-coordinate column \((2,-1,1)^{\top}\) represents the vector \(2\mathbf{d}_1-\mathbf{d}_2+\mathbf{d}_3\). The product’s columns give \([\mathbf{d}_1]_{\mathcal{B}}=(1,0,0)^{\top}\), \([\mathbf{d}_2]_{\mathcal{B}}=(1,1,0)^{\top}\), and \([\mathbf{d}_3]_{\mathcal{B}}=(1,1,1)^{\top}\). Combining them gives \((2,0,1)^{\top}\), as calculated.

A Basis Change in a Polynomial Space

Worked Example: Convert Polynomial Coordinates

In the real vector space \(P_2\) of polynomials of degree at most \(2\), use the ordered bases \(\mathcal{B}=(1,x,x^2)\) and \(\mathcal{C}=(1,x+1,(x+1)^2)\). Find the \(\mathcal{C}\)-coordinates of \(p(x)=3+2x+x^2\), and verify the conversion back to \(\mathcal{B}\).

Expand the new basis vectors in the old basis: \[ 1=1+0x+0x^2,\qquad x+1=1+x+0x^2,\qquad (x+1)^2=1+2x+x^2. \] Thus their \(\mathcal{B}\)-coordinate columns give \[ \mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}} = \begin{bmatrix}1&1&1\\0&1&2\\0&0&1\end{bmatrix}. \] The polynomial’s old coordinate column is \([p]_{\mathcal{B}}=(3,2,1)^{\top}\). To find its new coordinates, solve \[ \begin{bmatrix}1&1&1\\0&1&2\\0&0&1\end{bmatrix} \begin{bmatrix}a\\b\\c\end{bmatrix} = \begin{bmatrix}3\\2\\1\end{bmatrix}. \] The third row gives \(c=1\); the second gives \(b+2c=2\), hence \(b=0\); and the first gives \(a+b+c=3\), hence \(a=2\). Therefore \([p]_{\mathcal{C}}=(2,0,1)^{\top}\).

Check by converting back: \[ \begin{bmatrix}1&1&1\\0&1&2\\0&0&1\end{bmatrix} \begin{bmatrix}2\\0\\1\end{bmatrix} = \begin{bmatrix}3\\2\\1\end{bmatrix} =[p]_{\mathcal{B}}. \] The new coordinates also reconstruct the polynomial directly: \[ 2\cdot1+0\cdot(x+1)+1\cdot(x+1)^2 =2+(x^2+2x+1)=3+2x+x^2=p(x). \]

Common Direction and Multiplication Errors

Using the forward matrix for the reverse conversion is not valid. In the first example, \(\mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}}\) converts \(\mathcal{C}\)-coordinates to \(\mathcal{B}\)-coordinates. If \([\mathbf{v}]_{\mathcal{B}}=(1,2,3)^{\top}\), applying that same matrix again gives \[ \begin{bmatrix}1&1&0\\0&1&1\\0&0&1\end{bmatrix} \begin{bmatrix}1\\2\\3\end{bmatrix} = \begin{bmatrix}3\\5\\3\end{bmatrix}, \] which is not the desired \(\mathcal{C}\)-coordinate column. The correction is to use the inverse transition matrix: \[ \begin{bmatrix}1&-1&1\\0&1&-1\\0&0&1\end{bmatrix} \begin{bmatrix}1\\2\\3\end{bmatrix} = \begin{bmatrix}2\\-1\\3\end{bmatrix}. \] Multiplying this result by \(\mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}}\) recovers \((1,2,3)^{\top}\).

Do not reverse the order in a composition. In the second example, the input has \(\mathcal{D}\)-coordinates. The rightmost matrix must therefore be \(\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{D}}\), because that is the first conversion performed. Writing \(\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{D}}\mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}}\) would try to apply a matrix expecting \(\mathcal{C}\)-coordinates directly to a \(\mathcal{D}\)-coordinate column. Checking the subscripts at each multiplication catches this mismatch before any arithmetic is done.

When constructing a transition matrix, write the destination and source bases first, then place the source basis vectors’ coordinates in the destination basis as columns. When converting back, use the reverse transition matrix—or the inverse—and confirm the answer by converting it back or reconstructing the vector.

Check Your Understanding

For each question, identify the coordinate direction before multiplying, and check any computed coordinate column by conversion or reconstruction.

  1. If \([\mathbf{c}_j]_{\mathcal{B}}\) are the columns of a matrix, which coordinate conversion does that matrix perform?
  2. Suppose \(\mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}}=\begin{bmatrix}1&2\\0&1\end{bmatrix}\). Find \(\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}\) and verify the product in both orders.
  3. Given \(\mathbf{P}_{\mathcal{B}\leftarrow\mathcal{C}}=\begin{bmatrix}1&1\\0&1\end{bmatrix}\) and \([\mathbf{v}]_{\mathcal{C}}=(2,3)^{\top}\), find \([\mathbf{v}]_{\mathcal{B}}\) and check by reversing the conversion.
  4. For three bases \(\mathcal{B},\mathcal{C},\mathcal{D}\), write the ordered product that converts \(\mathcal{D}\)-coordinates directly to \(\mathcal{B}\)-coordinates.
  5. In the polynomial example, verify directly that the \(\mathcal{C}\)-coordinate column \((2,0,1)^{\top}\) represents \(3+2x+x^2\).

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon