Tutorials › Linear Algebra › Why Transition Matrix Columns Are Basis Coordinates

Coordinates and Change of Basis · Tutorial 379 of 1000

Why Transition Matrix Columns Are Basis Coordinates

Learn to interpret each transition-matrix column as the target-basis coordinates of one source-basis vector.

Intermediate 10 min read

What You'll Learn

  • Define the coordinate conversion represented by a transition matrix.
  • Prove the formula for its \(j\)th column by applying conversion to \(\mathbf{b}_j\).
  • Relate all transition-matrix columns to the source and target ordered bases.
  • Compute and check transition matrices in \(\mathbb{R}^2\), \(\mathbb{R}^3\), and a polynomial space.
  • Identify and correct the error of placing basis-coordinate vectors in rows instead of columns.

What a Transition-Matrix Column Records

A transition matrix packages a change in coordinates into a single matrix multiplication. Its columns are not arbitrary entries assembled from the two bases: each one records how a particular vector in the source basis is written using the target basis. The key is to apply the coordinate conversion to the source basis vectors one at a time. For the \(j\)th source vector, its source-coordinate vector is especially simple: it is the \(j\)th standard unit vector.

Work over \(\mathbb{R}\), and let \(V\) be a finite-dimensional vector space of dimension \(n\). Let \(\mathcal{B}=(\mathbf{b}_1,\dots,\mathbf{b}_n)\) and \(\mathcal{C}=(\mathbf{c}_1,\dots,\mathbf{c}_n)\) be ordered bases of \(V\). For \(\mathbf{v}\in V\), the coordinate vector \([\mathbf{v}]_{\mathcal{B}}\in\mathbb{R}^n\) is the column of coefficients in the unique expression of \(\mathbf{v}\) as a linear combination of the vectors in \(\mathcal{B}\). The definition of \([\mathbf{v}]_{\mathcal{C}}\) is the same, using \(\mathcal{C}\).

Definition: The coordinate conversion from \(\mathcal{B}\)-coordinates to \(\mathcal{C}\)-coordinates is the map that takes \([\mathbf{v}]_{\mathcal{B}}\) to \([\mathbf{v}]_{\mathcal{C}}\) for every \(\mathbf{v}\in V\). Its matrix is denoted \(\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}\), so that \([\mathbf{v}]_{\mathcal{C}}=\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}[\mathbf{v}]_{\mathcal{B}}\). This \(n\times n\) matrix is the transition matrix from \(\mathcal{B}\) to \(\mathcal{C}\).

For \(j\in\{1,\dots,n\}\), let \(\mathbf{e}_j\in\mathbb{R}^n\) denote the column with a \(1\) in position \(j\) and zeroes elsewhere. Since \(\mathbf{b}_j\) has coefficient \(1\) on itself and coefficient \(0\) on every other vector in \(\mathcal{B}\), its coordinate vector in that basis is \([\mathbf{b}_j]_{\mathcal{B}}=\mathbf{e}_j\). Multiplying any matrix by \(\mathbf{e}_j\) selects its \(j\)th column. These two facts give the column formula.

Theorem (Columns of a transition matrix): For the ordered bases \(\mathcal{B}\) and \(\mathcal{C}\) above, the \(j\)th column of \(\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}\) is \([\mathbf{b}_j]_{\mathcal{C}}\), for each \(j=1,\dots,n\). Equivalently, \(\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}=\begin{bmatrix}[\mathbf{b}_1]_{\mathcal{C}}&\cdots&[\mathbf{b}_n]_{\mathcal{C}}\end{bmatrix}\).

Proof. Fix an index \(j\) with \(1\le j\le n\). By the definition of the transition matrix, applying it to the \(\mathcal{B}\)-coordinate vector of \(\mathbf{b}_j\) gives the \(\mathcal{C}\)-coordinate vector of that same vector: \(\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}[\mathbf{b}_j]_{\mathcal{B}}=[\mathbf{b}_j]_{\mathcal{C}}\). The source coordinates are \([\mathbf{b}_j]_{\mathcal{B}}=\mathbf{e}_j\). For any matrix \(\mathbf{P}\), the product \(\mathbf{P}\mathbf{e}_j\) is its \(j\)th column, because the \(j\)th column is multiplied by \(1\) and every other column by \(0\). Therefore the \(j\)th column of \(\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}\) is \([\mathbf{b}_j]_{\mathcal{C}}\). This holds for every \(j\), proving the displayed matrix formula. \(\square\)

This argument is also a practical construction rule: find the target-basis coordinates of each source-basis vector, then put those coordinate columns in the same order as the source basis. The order matters. Column \(j\) belongs to \(\mathbf{b}_j\), not to \(\mathbf{c}_j\) unless the bases happen to align in a special way.

Why the Columns Give the Conversion for Every Vector

The column formula explains more than what happens to the basis vectors. Every \(\mathbf{v}\in V\) has a unique source-basis expression \(\mathbf{v}=x_1\mathbf{b}_1+\cdots+x_n\mathbf{b}_n\), where \(x_j\in\mathbb{R}\). Its source-coordinate vector is \((x_1,\dots,x_n)^{\top}\). Because the target-coordinate map is linear, the target coordinates of this sum are the same linear combination of the target-coordinate vectors of the \(\mathbf{b}_j\). The matrix product by the column matrix performs exactly that combination.

Proposition: If \(\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}\) has columns \([\mathbf{b}_1]_{\mathcal{C}},\dots,[\mathbf{b}_n]_{\mathcal{C}}\), then for every \(\mathbf{v}\in V\), \(\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}[\mathbf{v}]_{\mathcal{B}}=[\mathbf{v}]_{\mathcal{C}}\).

Proof. Write \([\mathbf{v}]_{\mathcal{B}}=(x_1,\dots,x_n)^{\top}\). By the definition of coordinates, \(\mathbf{v}=\sum_{j=1}^{n}x_j\mathbf{b}_j\). By the definition of the matrix whose columns are \([\mathbf{b}_j]_{\mathcal{C}}\), its product with this coordinate vector is \(\sum_{j=1}^{n}x_j[\mathbf{b}_j]_{\mathcal{C}}\). Each vector \(\mathbf{b}_j\) is the linear combination of the \(\mathcal{C}\)-basis vectors specified by \([\mathbf{b}_j]_{\mathcal{C}}\). Substituting those expressions into \(\sum_{j=1}^{n}x_j\mathbf{b}_j\) shows that its \(\mathcal{C}\)-coordinates are precisely \(\sum_{j=1}^{n}x_j[\mathbf{b}_j]_{\mathcal{C}}\). Thus the matrix product equals \([\mathbf{v}]_{\mathcal{C}}\), as required. \(\square\)

In this proposition, the columns do the work of carrying each source-basis vector into target coordinates; the entries of \([\mathbf{v}]_{\mathcal{B}}\) specify how much of each column to use. We can see both steps explicitly in examples.

Computing the Columns in \(\mathbb{R}^2\)

Worked Example: Standard Coordinates to a Nonstandard Basis

Let \(V=\mathbb{R}^2\), let \(\mathcal{B}=(\mathbf{e}_1,\mathbf{e}_2)\) be the standard ordered basis, and let \(\mathcal{C}=(\mathbf{c}_1,\mathbf{c}_2)\), where \(\mathbf{c}_1=(1,1)^{\top}\) and \(\mathbf{c}_2=(1,-1)^{\top}\). Find \(\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}\).

The vectors \(\mathbf{c}_1,\mathbf{c}_2\) form a basis: if \(a\mathbf{c}_1+b\mathbf{c}_2=\mathbf{0}\), the two coordinates give \(a+b=0\) and \(a-b=0\), so \(a=b=0\); and for any \((r,s)^{\top}\), the choice \(a=(r+s)/2\), \(b=(r-s)/2\) gives \(a\mathbf{c}_1+b\mathbf{c}_2=(r,s)^{\top}\). To find the first column, express the first source vector in the target basis: \(\mathbf{e}_1=\tfrac12\mathbf{c}_1+\tfrac12\mathbf{c}_2\). Therefore \([\mathbf{e}_1]_{\mathcal{C}}=(\tfrac12,\tfrac12)^{\top}\). Similarly, \(\mathbf{e}_2=\tfrac12\mathbf{c}_1-\tfrac12\mathbf{c}_2\), so \([\mathbf{e}_2]_{\mathcal{C}}=(\tfrac12,-\tfrac12)^{\top}\).

Place these coordinate vectors in order as columns:

$$ \mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}} = \begin{bmatrix} \frac12 & \frac12\\ \frac12 & -\frac12 \end{bmatrix}. $$

Check: Reconstructing the two columns gives \(\tfrac12(1,1)^{\top}+\tfrac12(1,-1)^{\top}=(1,0)^{\top}=\mathbf{e}_1\) and \(\tfrac12(1,1)^{\top}-\tfrac12(1,-1)^{\top}=(0,1)^{\top}=\mathbf{e}_2\). For a further check, the vector with \(\mathcal{B}\)-coordinates \((2,-1)^{\top}\) has \(\mathcal{C}\)-coordinates \(\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}(2,-1)^{\top}=(\tfrac12,\tfrac32)^{\top}\). Reconstructing gives \(\tfrac12(1,1)^{\top}+\tfrac32(1,-1)^{\top}=(2,-1)^{\top}\), which is the original vector.

Computing the Columns in \(\mathbb{R}^3\)

Worked Example: Two Nonstandard Bases

In \(V=\mathbb{R}^3\), let \(\mathcal{C}=(\mathbf{c}_1,\mathbf{c}_2,\mathbf{c}_3)\), where \(\mathbf{c}_1=(1,0,1)^{\top}\), \(\mathbf{c}_2=(0,1,1)^{\top}\), and \(\mathbf{c}_3=(1,1,0)^{\top}\). Let \(\mathcal{B}=(\mathbf{b}_1,\mathbf{b}_2,\mathbf{b}_3)\), where \(\mathbf{b}_1=(1,1,2)^{\top}\), \(\mathbf{b}_2=(1,2,3)^{\top}\), and \(\mathbf{b}_3=(1,2,1)^{\top}\). Find the transition matrix from \(\mathcal{B}\) to \(\mathcal{C}\).

First, \(\mathcal{C}\) is a basis: for any \((r,s,t)^{\top}\), the unique coefficients giving \(a\mathbf{c}_1+b\mathbf{c}_2+c\mathbf{c}_3=(r,s,t)^{\top}\) are \(a=(r-s+t)/2\), \(b=(-r+s+t)/2\), and \(c=(r+s-t)/2\). Now express the source vectors using \(\mathcal{C}\): \(\mathbf{b}_1=\mathbf{c}_1+\mathbf{c}_2\), \(\mathbf{b}_2=\mathbf{c}_1+2\mathbf{c}_2\), and \(\mathbf{b}_3=\mathbf{c}_2+\mathbf{c}_3\). Their target coordinates are therefore \((1,1,0)^{\top}\), \((1,2,0)^{\top}\), and \((0,1,1)^{\top}\), respectively.

These vectors are a valid source basis as well. Indeed, if \(d_1\mathbf{b}_1+d_2\mathbf{b}_2+d_3\mathbf{b}_3\) has \(\mathcal{C}\)-coordinates \((q_1,q_2,q_3)^{\top}\), then \(d_1+d_2=q_1\), \(d_1+2d_2+d_3=q_2\), and \(d_3=q_3\). These equations have the unique solution \(d_3=q_3\), \(d_2=q_2-q_1-q_3\), and \(d_1=2q_1-q_2+q_3\). Thus every vector has a unique expression using \(\mathcal{B}\).

The three target-coordinate columns give

$$ \mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}} = \begin{bmatrix} 1 & 1 & 0\\ 1 & 2 & 1\\ 0 & 0 & 1 \end{bmatrix}. $$

Check: The columns reconstruct the source vectors: \(\mathbf{c}_1+\mathbf{c}_2=(1,1,2)^{\top}=\mathbf{b}_1\), \(\mathbf{c}_1+2\mathbf{c}_2=(1,2,3)^{\top}=\mathbf{b}_2\), and \(\mathbf{c}_2+\mathbf{c}_3=(1,2,1)^{\top}=\mathbf{b}_3\). For \([\mathbf{v}]_{\mathcal{B}}=(2,-1,3)^{\top}\), matrix multiplication gives \(\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}[\mathbf{v}]_{\mathcal{B}}=(1,3,3)^{\top}\). Reconstructing in \(\mathcal{C}\) gives \(\mathbf{c}_1+3\mathbf{c}_2+3\mathbf{c}_3=(4,6,4)^{\top}\). The source expression gives \(2\mathbf{b}_1-\mathbf{b}_2+3\mathbf{b}_3=(4,6,4)^{\top}\) as well.

The Same Column Rule for Polynomial Bases

The argument does not depend on vectors being lists of real numbers. A polynomial space has vectors too: its elements are polynomials, and coordinates still mean coefficients in an ordered basis. The unit-vector reasoning is unchanged, so the same column formula applies.

Worked Example: A Transition Matrix in \(\mathcal{P}_2\)

In the real vector space \(\mathcal{P}_2\) of polynomials of degree at most \(2\), take \(\mathcal{B}=(1,x,x^2)\) and \(\mathcal{C}=(1,1+x,1+x+x^2)\). The list \(\mathcal{C}\) is a basis: for any \(a+bx+cx^2\), its expression \(\alpha\cdot1+\beta(1+x)+\gamma(1+x+x^2)\) requires \(\gamma=c\), \(\beta=b-c\), and \(\alpha=a-b\), which gives a unique choice of coefficients.

Express each source-basis polynomial in \(\mathcal{C}\): \(1=1\), \(x=(1+x)-1\), and \(x^2=(1+x+x^2)-(1+x)\). Hence \([1]_{\mathcal{C}}=(1,0,0)^{\top}\), \([x]_{\mathcal{C}}=(-1,1,0)^{\top}\), and \([x^2]_{\mathcal{C}}=(0,-1,1)^{\top}\). Using these as columns gives

$$ \mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}} = \begin{bmatrix} 1 & -1 & 0\\ 0 & 1 & -1\\ 0 & 0 & 1 \end{bmatrix}. $$

Check: Reconstructing the columns gives \(1\), \(-1+(1+x)=x\), and \(-(1+x)+(1+x+x^2)=x^2\). For \(p(x)=2+3x-x^2\), the source coordinates are \((2,3,-1)^{\top}\), and the matrix product is \(\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}(2,3,-1)^{\top}=(-1,4,-1)^{\top}\). Reconstructing, \(-1\cdot1+4(1+x)-1(1+x+x^2)=2+3x-x^2\), as required.

A Common Mistake: Putting the Coordinates in Rows

The column rule is easy to reverse when writing a matrix by inspection. A common incorrect calculation is to write each \([\mathbf{b}_j]_{\mathcal{C}}\) as a row. In the polynomial example, that would give the transpose of the correct matrix: \(\begin{bmatrix}1&0&0\\-1&1&0\\0&-1&1\end{bmatrix}\). But applying this incorrect matrix to \([1]_{\mathcal{B}}=(1,0,0)^{\top}\) gives \((1,-1,0)^{\top}\), which is not \([1]_{\mathcal{C}}=(1,0,0)^{\top}\). The correction is to place the coordinate vectors as columns. Then multiplication by \(\mathbf{e}_j\) selects exactly the target coordinates of \(\mathbf{b}_j\).

A reliable check is to multiply the proposed transition matrix by each standard unit vector. The result in position \(j\) must be \([\mathbf{b}_j]_{\mathcal{C}}\). A second check is to use each resulting coordinate column to reconstruct \(\mathbf{b}_j\) from \(\mathcal{C}\). These checks test both the placement of entries and the meaning of the coordinates.

Check Your Understanding

For each problem, keep the source and target bases ordered, and use the column rule before checking by reconstruction.

  1. For bases \(\mathcal{B}\) and \(\mathcal{C}\), explain why \([\mathbf{b}_j]_{\mathcal{B}}=\mathbf{e}_j\).
  2. If \([\mathbf{b}_2]_{\mathcal{C}}=(3,-1,0)^{\top}\), what must the second column of \(\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}\) be?
  3. In \(\mathcal{P}_2\), use \(\mathcal{B}=(1,x,x^2)\) and \(\mathcal{C}=(1,x,1+x^2)\). Find the columns of \(\mathbf{P}_{\mathcal{C}\leftarrow\mathcal{B}}\).
  4. Why does multiplying a matrix by \(\mathbf{e}_j\) select its \(j\)th column?
  5. Describe a reconstruction check that can detect whether coordinate vectors were mistakenly written as rows.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon