Tutorials › Linear Algebra › Matrix Units as a Basis for Linear Maps

Matrix Representations of Linear Maps · Tutorial 447 of 1000

Matrix Units as a Basis for Linear Maps

Learn to build and use a basis for linear maps from pairs of domain and codomain bases.

Intermediate 10 min read

What You'll Learn

  • Define the map that sends one selected domain basis vector to one selected codomain basis vector and vanishes on the others.
  • Prove that these maps span the space of linear maps and are linearly independent.
  • Read the coefficient of each map from the image of a domain basis vector.
  • Relate each map to a matrix with a single nonzero entry.
  • Expand linear maps between coordinate spaces and polynomial or matrix spaces.
  • Avoid reversing the domain and codomain indices.

Building Maps One Basis Vector at a Time

A linear map is determined by what it does to a basis of its domain. This gives a direct way to build a basis for the space of all linear maps: make one map for each pair consisting of a domain basis vector and a codomain basis vector. Each such map sends its selected domain vector to its selected codomain vector and sends every other domain basis vector to zero. These maps are the matrix units for linear maps.

Let \(V\) and \(W\) be finite-dimensional vector spaces over a field \(\mathbb{F}\), where \(\mathbb{F}\) is \(\mathbb{R}\) or \(\mathbb{C}\). Fix ordered bases \(\mathcal{B}=(\mathbf{v}_1,\dots,\mathbf{v}_n)\) for \(V\) and \(\mathcal{C}=(\mathbf{w}_1,\dots,\mathbf{w}_m)\) for \(W\). The space \(L(V,W)\) consists of all linear maps from \(V\) to \(W\). We use the usual pointwise addition and scalar multiplication of maps.

Definition: For \(1\le i\le m\) and \(1\le j\le n\), define the map \(\mathcal{E}_{ij}:V\to W\) by $$ \mathcal{E}_{ij}(\mathbf{v}_k)= \begin{cases} \mathbf{w}_i,&k=j,\\ \mathbf{0},&k\ne j. \end{cases} $$ For a general vector \(\mathbf{v}=\sum_{k=1}^{n}c_k\mathbf{v}_k\), extend this rule linearly: \(\mathcal{E}_{ij}(\mathbf{v})=c_j\mathbf{w}_i\). The map is well-defined because a basis representation is unique.

The two indices have distinct roles. The first index \(i\) selects the output basis vector in \(W\); the second index \(j\) selects the input basis vector in \(V\). In coordinates relative to \(\mathcal{B}\) and \(\mathcal{C}\), the matrix of \(\mathcal{E}_{ij}\) has a \(1\) in row \(i\), column \(j\), and zeros elsewhere. Thus these maps generalize the single-entry matrices often called matrix units.

$$ [\mathcal{E}_{ij}]_{\mathcal{C}\leftarrow\mathcal{B}} =\mathbf{M}_{ij}, \qquad (\mathbf{M}_{ij})_{rs}= \begin{cases} 1,&(r,s)=(i,j),\\ 0,&(r,s)\ne(i,j). \end{cases} $$

Every Linear Map Has a Unique Expansion

To find the coefficients of a map \(T\in L(V,W)\), evaluate it on each domain basis vector. Since \(\mathcal{C}\) is a basis, each value \(T(\mathbf{v}_j)\) has a unique expansion in the vectors \(\mathbf{w}_1,\dots,\mathbf{w}_m\). The coefficient of \(\mathbf{w}_i\) in that expansion is exactly the coefficient of \(\mathcal{E}_{ij}\) in the expansion of \(T\).

Theorem: The maps \(\mathcal{E}_{ij}\), for \(1\le i\le m\) and \(1\le j\le n\), form a basis for \(L(V,W)\). More precisely, every \(T\in L(V,W)\) has the unique expansion $$ T=\sum_{j=1}^{n}\sum_{i=1}^{m}a_{ij}\mathcal{E}_{ij}, \qquad T(\mathbf{v}_j)=\sum_{i=1}^{m}a_{ij}\mathbf{w}_i. $$

Proof. Let \(T\in L(V,W)\). For each \(j\), the vector \(T(\mathbf{v}_j)\in W\) has unique coordinates \(a_{1j},\dots,a_{mj}\) in the basis \(\mathcal{C}\), so \(T(\mathbf{v}_j)=\sum_{i=1}^{m}a_{ij}\mathbf{w}_i\). Define \(S=\sum_{j=1}^{n}\sum_{i=1}^{m}a_{ij}\mathcal{E}_{ij}\). For a fixed \(k\), the definition of the maps gives \(\mathcal{E}_{ij}(\mathbf{v}_k)=\mathbf{0}\) unless \(j=k\), in which case it gives \(\mathbf{w}_i\). Therefore \(S(\mathbf{v}_k)=\sum_{i=1}^{m}a_{ik}\mathbf{w}_i=T(\mathbf{v}_k)\). Every \(\mathbf{v}\in V\) is a linear combination of the \(\mathbf{v}_k\), so linearity gives \(S(\mathbf{v})=T(\mathbf{v})\). Hence the maps span \(L(V,W)\). To prove independence, suppose \(\sum_{j=1}^{n}\sum_{i=1}^{m}c_{ij}\mathcal{E}_{ij}\) is the zero map. Fix \(k\) and apply this map to \(\mathbf{v}_k\). All terms with \(j\ne k\) vanish, leaving \(\sum_{i=1}^{m}c_{ik}\mathbf{w}_i=\mathbf{0}\). The vectors in \(\mathcal{C}\) are linearly independent, so \(c_{ik}=0\) for every \(i\). This holds for each \(k\), and thus every coefficient \(c_{ij}\) is zero. The maps are linearly independent as well as spanning, so they form a basis. The same argument shows that the coefficients in the displayed expansion must be the coordinates of each \(T(\mathbf{v}_j)\), and hence are unique. \(\square\)

This proof also covers zero-dimensional cases. If \(V\) or \(W\) is the zero space, there is only the zero map in \(L(V,W)\), and there are no index pairs \((i,j)\). The resulting empty list spans the zero space and is linearly independent, so it is a basis under the usual convention for the zero space.

Proposition: A linear map \(T:V\to W\) is determined by its values on the basis \(\mathcal{B}\). In coordinates, the coefficient \(a_{ij}\) of \(\mathcal{E}_{ij}\) is the coefficient of \(\mathbf{w}_i\) in \(T(\mathbf{v}_j)\).

Proof. If \(T\) and \(S\) agree on every \(\mathbf{v}_j\), take any \(\mathbf{v}\in V\) and write \(\mathbf{v}=\sum_{j=1}^{n}c_j\mathbf{v}_j\). Linearity gives \(T(\mathbf{v})=\sum_{j=1}^{n}c_jT(\mathbf{v}_j)=\sum_{j=1}^{n}c_jS(\mathbf{v}_j)=S(\mathbf{v})\). Thus \(T=S\). For the coefficient statement, expand each \(T(\mathbf{v}_j)\) in the basis \(\mathcal{C}\); the theorem identifies its coefficient of \(\mathbf{w}_i\) with the coefficient of \(\mathcal{E}_{ij}\). \(\square\)

Worked Examples

Worked Example: A Map from R² to R³

Use the standard bases \(\mathcal{B}=(\mathbf{e}_1,\mathbf{e}_2)\) of \(\mathbb{R}^2\) and \(\mathcal{C}=(\mathbf{e}_1,\mathbf{e}_2,\mathbf{e}_3)\) of \(\mathbb{R}^3\). Suppose \(T(x,y)=(2x-y,\ x+3y,\ -2x+4y)\). Find its matrix-unit expansion.

First evaluate at the domain basis vectors: \(T(\mathbf{e}_1)=T(1,0)=(2,1,-2)\) and \(T(\mathbf{e}_2)=T(0,1)=(-1,3,4)\). The first output gives the coefficients of \(\mathcal{E}_{i1}\); the second gives the coefficients of \(\mathcal{E}_{i2}\). Therefore

$$ T=2\mathcal{E}_{11}+\mathcal{E}_{21}-2\mathcal{E}_{31} -\mathcal{E}_{12}+3\mathcal{E}_{22}+4\mathcal{E}_{32}. $$

The corresponding coordinate matrix has the same coefficients arranged with output coordinates as rows and input basis vectors as columns:

$$ [T]_{\mathcal{C}\leftarrow\mathcal{B}} =\begin{bmatrix}2&-1\\1&3\\-2&4\end{bmatrix}. $$

Check: For \((x,y)=x\mathbf{e}_1+y\mathbf{e}_2\), the expansion gives \(x(2,1,-2)+y(-1,3,4)=(2x-y,\ x+3y,\ -2x+4y)\), which is the given map. Each column also agrees with the corresponding basis-vector image.

Worked Example: Nonstandard Bases Change the Coefficients

Let \(V=P_1\), the real polynomials of degree at most one, with basis \(\mathcal{B}=(1+x,1-x)\). Let \(W=\mathbb{R}^2\) with basis \(\mathcal{C}=((1,1),(1,-1))\). For \(p(x)=a+bx\), define \(T(p)=(a+2b,3a-b)\). Find the matrix-unit expansion relative to these bases.

Write the domain basis vectors in the form \(a+bx\). For \(1+x\), \(a=1,b=1\), so \(T(1+x)=(3,2)\). To express \((r,s)\) in \(\mathcal{C}\), solve \((r,s)=\alpha(1,1)+\beta(1,-1)=(\alpha+\beta,\alpha-\beta)\). Thus \(\alpha=(r+s)/2\) and \(\beta=(r-s)/2\). For \((3,2)\), these coordinates are \(5/2\) and \(1/2\).

For \(1-x\), \(a=1,b=-1\), so \(T(1-x)=(-1,4)\). Its coordinates in \(\mathcal{C}\) are \(\alpha=(-1+4)/2=3/2\) and \(\beta=(-1-4)/2=-5/2\). The first column of the coordinate matrix is therefore \((5/2,1/2)\), and the second is \((3/2,-5/2)\). Hence

$$ T=\frac52\mathcal{E}_{11}+\frac12\mathcal{E}_{21} +\frac32\mathcal{E}_{12}-\frac52\mathcal{E}_{22}, \qquad [T]_{\mathcal{C}\leftarrow\mathcal{B}} =\begin{bmatrix}\frac52&\frac32\\[2pt]\frac12&-\frac52\end{bmatrix}. $$

Check: The first matrix column reconstructs \(T(1+x)=\frac52(1,1)+\frac12(1,-1)=(3,2)\). The second reconstructs \(T(1-x)=\frac32(1,1)-\frac52(1,-1)=(-1,4)\). Since these are the images of a basis of \(V\), they verify the map on every polynomial in \(P_1\).

Worked Example: A Map from Matrices to R²

Let \(V=M_{2\times2}(\mathbb{R})\) with ordered basis \(\mathcal{B}=(\mathbf{F}_{11},\mathbf{F}_{12},\mathbf{F}_{21},\mathbf{F}_{22})\), where \(\mathbf{F}_{rs}\) has a \(1\) in position \((r,s)\) and zeros elsewhere. Let \(W=\mathbb{R}^2\) have its standard basis \((\mathbf{e}_1,\mathbf{e}_2)\). For \(\mathbf{X}=\begin{bmatrix}a&b\\c&d\end{bmatrix}\), define \(T(\mathbf{X})=(a+d,b-c)\). Find the matrix-unit expansion.

Evaluate on the four domain basis vectors: \(T(\mathbf{F}_{11})=\mathbf{e}_1\), \(T(\mathbf{F}_{12})=\mathbf{e}_2\), \(T(\mathbf{F}_{21})=-\mathbf{e}_2\), and \(T(\mathbf{F}_{22})=\mathbf{e}_1\). The coefficients in these four outputs give, in order, the four columns of the coordinate matrix.

$$ T=\mathcal{E}_{11}+\mathcal{E}_{22}-\mathcal{E}_{23}+\mathcal{E}_{14}, \qquad [T]_{\mathcal{C}\leftarrow\mathcal{B}} =\begin{bmatrix}1&0&0&1\\0&1&-1&0\end{bmatrix}. $$

Check: The matrix product is \(\begin{bmatrix}1&0&0&1\\0&1&-1&0\end{bmatrix} \begin{bmatrix}a\\b\\c\\d\end{bmatrix} =\begin{bmatrix}a+d\\b-c\end{bmatrix}\), which reproduces \(T(\mathbf{X})\).

Why the Basis Depends on Both Choices

The map units are built from the selected bases, so changing either basis changes the individual maps. Their defining roles do not change: one domain basis vector is selected, one codomain basis vector is selected, and all other domain basis vectors are sent to zero. The coefficient array is precisely the matrix of the map relative to the chosen domain and codomain bases. In particular, the row index refers to the codomain coordinate and the column index refers to the domain basis vector.

This construction is useful whenever the task is to describe a linear map by its action on basis vectors. Instead of trying to guess a formula for the whole map, specify one output for each domain basis vector, express each output in the codomain basis, and read off the coefficients. The resulting matrix-unit expansion both records those values and verifies that they determine one and only one linear map.

Common Indexing Pitfall

A frequent mistake is to reverse the indices and treat \(\mathcal{E}_{ij}\) as the map sending \(\mathbf{v}_i\) to \(\mathbf{w}_j\). That reverses the roles of domain and codomain. For example, with \(V=\mathbb{R}^2\), \(W=\mathbb{R}^3\), and standard bases, \(\mathcal{E}_{21}\) sends the first domain vector to the second codomain vector. Its matrix is

$$ [\mathcal{E}_{21}] =\begin{bmatrix}0&0\\1&0\\0&0\end{bmatrix}. $$

The incorrect reversed interpretation would place its \(1\) in row \(1\), column \(2\), which would give a \(3\times2\) matrix with the wrong action: it would send the second domain basis vector to the first codomain basis vector. Check the definition before placing the nonzero entry: the column identifies the selected input, and the row identifies the output.

Check Your Understanding

Use the stated domain and codomain bases when identifying each coefficient.

  1. For \(V=\mathbb{R}^2\) and \(W=\mathbb{R}^3\) with standard bases, describe the action and matrix of \(\mathcal{E}_{32}\).
  2. If \(T(\mathbf{v}_1)=2\mathbf{w}_1-\mathbf{w}_2\) and \(T(\mathbf{v}_2)=\mathbf{w}_1+3\mathbf{w}_2\), write its expansion using the maps \(\mathcal{E}_{ij}\).
  3. For the map in the previous question, write \([T]_{\mathcal{C}\leftarrow\mathcal{B}}\).
  4. Explain why evaluating a linear combination of the maps \(\mathcal{E}_{ij}\) on \(\mathbf{v}_k\) isolates precisely the terms whose second index is \(k\).
  5. Why does the empty list of map units form a basis for \(L(V,W)\) if \(V\) or \(W\) is the zero space?

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon