Tutorials › Linear Algebra › Invariant Subspaces and First Examples

Invariant Subspaces and Cayley-Hamilton · Tutorial 566 of 1000

Invariant Subspaces and First Examples

Learn to check whether a subspace is preserved by a linear map, using examples from matrices and differentiation.

Advanced 10 min read

What You'll Learn

  • Define invariance using the image of a subspace under a linear map
  • Test a concrete eigenspace by applying the map to its vectors
  • Determine when kernels and images are invariant, including for commuting maps
  • Check whether a coordinate subspace is preserved by a matrix
  • Test polynomial subspaces under differentiation
  • Recognize common errors when checking invariance

What It Means for a Subspace to Be Invariant

A linear map may send some parts of a vector space back into themselves while sending other vectors elsewhere. Those preserved parts are useful because the map can be studied on them separately. The central question is whether applying the map to every vector in a chosen subspace keeps the result inside that same subspace.

Let \(V\) be a vector space over \(\mathbb{R}\), and let \(T:V\to V\) be linear. A subspace \(W\) of \(V\) is a subset containing \(\mathbf{0}\) that is closed under addition and scalar multiplication. The image of \(W\) under \(T\) is the set \(T(W)=\{T(\mathbf{w}):\mathbf{w}\in W\}\). Invariance is a containment condition: the image need not equal \(W\).

Definition: A subspace \(W\subseteq V\) is invariant under \(T\) if \(T(W)\subseteq W\). Equivalently, \(W\) is invariant under \(T\) if \(T(\mathbf{w})\in W\) for every \(\mathbf{w}\in W\).

The quantifier “every” matters. Checking one vector in \(W\) is not enough; a successful test must establish that the image of an arbitrary vector in \(W\) remains in \(W\). The zero subspace \(\{\mathbf{0}\}\) and the whole space \(V\) are always invariant: linearity gives \(T(\mathbf{0})=\mathbf{0}\), and \(T\) maps into \(V\) by definition.

A First Example: An Eigenspace

An eigenvector of \(T\) is a nonzero vector \(\mathbf{v}\) for which \(T(\mathbf{v})=\lambda\mathbf{v}\) for some scalar \(\lambda\), called its eigenvalue. The line spanned by an eigenvector is a natural candidate for an invariant subspace: multiplying that vector by a scalar still gives a vector on the same line.

Worked Example: An Invariant Eigenspace

Consider the linear map on \(\mathbb{R}^2\) with matrix \(\mathbf{A}=\begin{bmatrix}2&0\\0&3\end{bmatrix}\). Let \(T(\mathbf{x})=\mathbf{A}\mathbf{x}\), and consider the eigenspace \(E_2=\operatorname{span}\{(1,0)^{\top}\}\).

An arbitrary vector in \(E_2\) has the form \(\mathbf{w}=(a,0)^{\top}\), where \(a\in\mathbb{R}\). Applying \(T\) gives

$$ T(\mathbf{w}) = \begin{bmatrix}2&0\\0&3\end{bmatrix} \begin{bmatrix}a\\0\end{bmatrix} = \begin{bmatrix}2a\\0\end{bmatrix} = 2\begin{bmatrix}a\\0\end{bmatrix}. $$

The result has second coordinate zero, so \(T(\mathbf{w})\in E_2\). Since this holds for every \(a\), \(E_2\) is invariant under \(T\). As a check, \(T((1,0)^{\top})=(2,0)^{\top}\), which lies in the same line.

This calculation illustrates the definition directly: start with an arbitrary vector in the proposed subspace, apply the map, and check that the result still belongs to it. In this example, the map scales every vector on the eigenspace by \(2\).

Kernels and Images

The kernel and image of a linear map are subspaces. For a linear map \(S:V\to V\), the kernel is \(\ker S=\{\mathbf{v}\in V:S(\mathbf{v})=\mathbf{0}\}\), and the image is \(\operatorname{im}S=\{S(\mathbf{v}):\mathbf{v}\in V\}\). These spaces are sometimes preserved by a second map \(T\); commutation of the maps gives a useful condition.

Theorem: Let \(S,T:V\to V\) be linear maps on a vector space \(V\) over \(\mathbb{R}\). If \(ST=TS\), then both \(\ker S\) and \(\operatorname{im}S\) are invariant under \(T\).

Proof. Suppose \(\mathbf{w}\in\ker S\). Then \(S(\mathbf{w})=\mathbf{0}\), and commutation gives \(S(T(\mathbf{w}))=T(S(\mathbf{w}))=T(\mathbf{0})=\mathbf{0}\). Hence \(T(\mathbf{w})\in\ker S\), proving \(T(\ker S)\subseteq\ker S\). Next, suppose \(\mathbf{y}\in\operatorname{im}S\). By the definition of image, there is some \(\mathbf{x}\in V\) with \(\mathbf{y}=S(\mathbf{x})\). Therefore \(T(\mathbf{y})=T(S(\mathbf{x}))=S(T(\mathbf{x}))\), which belongs to \(\operatorname{im}S\). Thus \(T(\operatorname{im}S)\subseteq\operatorname{im}S\), as required. \(\square\)

Taking \(S=T\) meets the commutation condition because \(TT=TT\). Therefore, the kernel and image of \(T\) itself are invariant under \(T\). The general statement also explains why kernels and images of a different map need not be invariant unless there is a suitable relationship between the maps.

Worked Example: The Kernel and Image of One Map

Let \(T:\mathbb{R}^2\to\mathbb{R}^2\) have matrix \(\mathbf{A}=\begin{bmatrix}1&1\\0&0\end{bmatrix}\). For \(\mathbf{x}=(x,y)^{\top}\),

$$ T(\mathbf{x}) = \begin{bmatrix}1&1\\0&0\end{bmatrix} \begin{bmatrix}x\\y\end{bmatrix} = \begin{bmatrix}x+y\\0\end{bmatrix}. $$

The kernel consists of the vectors satisfying \(x+y=0\), so \(\ker T=\{(a,-a)^{\top}:a\in\mathbb{R}\}\). For any such vector,

$$ T\begin{bmatrix}a\\-a\end{bmatrix} = \begin{bmatrix}a-a\\0\end{bmatrix} = \begin{bmatrix}0\\0\end{bmatrix}\in\ker T. $$

The image is \(\operatorname{im}T=\{(b,0)^{\top}:b\in\mathbb{R}\}\), because the output has second coordinate zero and every \(b\) occurs by taking \((x,y)=(b,0)\). For any vector in this image,

$$ T\begin{bmatrix}b\\0\end{bmatrix} = \begin{bmatrix}b\\0\end{bmatrix} \in\operatorname{im}T. $$

Both spaces pass the invariance test. These computations also check the descriptions: \(\mathbf{A}(a,-a)^{\top}=(0,0)^{\top}\), while \(\mathbf{A}(b,0)^{\top}=(b,0)^{\top}\).

Coordinate Subspaces

A coordinate subspace is formed by requiring selected coordinates to be zero. Such a subspace is not automatically invariant: the matrix may move a vector into a coordinate that was required to vanish. The test is to apply the matrix to a general vector satisfying the coordinate restrictions.

Worked Example: A Coordinate Plane in R³

Let \(W=\{(x,y,0)^{\top}:x,y\in\mathbb{R}\}\), the coordinate plane where the third coordinate is zero. First consider

$$ \mathbf{A}= \begin{bmatrix} 1&2&0\\ 0&1&3\\ 0&0&4 \end{bmatrix}. $$

For an arbitrary vector \(\mathbf{w}=(x,y,0)^{\top}\in W\), multiplication gives

$$ \mathbf{A}\mathbf{w} = \begin{bmatrix} x+2y\\ y\\ 0 \end{bmatrix} \in W. $$

Thus \(W\) is invariant under this matrix. By contrast, consider \(\mathbf{B}=\begin{bmatrix}1&0&0\\0&1&0\\1&0&1\end{bmatrix}\). The vector \(\mathbf{e}_1=(1,0,0)^{\top}\) belongs to \(W\), but

$$ \mathbf{B}\mathbf{e}_1 = \begin{bmatrix}1\\0\\1\end{bmatrix} \notin W. $$

This single vector is enough to show that \(W\) is not invariant under \(\mathbf{B}\). The first matrix preserves the zero third coordinate for all vectors in \(W\); the second does not.

For the plane \(W=\{(x,y,0)^{\top}\}\) and a general \(3\times3\) matrix \(\mathbf{C}=[c_{ij}]\), the third coordinate of \(\mathbf{C}(x,y,0)^{\top}\) is \(c_{31}x+c_{32}y\). This vanishes for every real \(x,y\) exactly when \(c_{31}=c_{32}=0\): necessity follows by taking \((x,y)=(1,0)\) and \((0,1)\), and sufficiency follows by substitution. This criterion is specific to this coordinate plane and makes the “every vector” requirement explicit.

Polynomial Subspaces Under Differentiation

Invariance is not limited to matrices acting on coordinate vectors. Let \(V=\mathbb{R}[x]\), the vector space of real polynomials, and let \(D:V\to V\) be differentiation, defined by \(D(p)=p'\). For a nonnegative integer \(k\), let \(P_{\leq k}\) be the subspace of polynomials of degree at most \(k\), including the zero polynomial.

Worked Example: Polynomials of Degree at Most Two

Take \(W=P_{\leq2}\). An arbitrary polynomial in \(W\) is \(p(x)=a+bx+cx^2\), where \(a,b,c\in\mathbb{R}\). Differentiating yields

$$ D(p)=p'(x)=b+2cx\in P_{\leq2}. $$

Since the derivative remains in \(W\) for every choice of \(a,b,c\), this space is invariant under \(D\). For a concrete check, if \(p(x)=3-2x+5x^2\), then \(D(p)=-2+10x\), which still has degree at most two.

In fact, \(P_{\leq k}\) is invariant under differentiation for every nonnegative integer \(k\). If \(p(x)=\sum_{j=0}^{k}a_jx^j\), then \(p'(x)=\sum_{j=1}^{k}ja_jx^{j-1}\), whose degree is at most \(k-1\) when the derivative is nonzero; if the derivative is zero, it is also in \(P_{\leq k}\). Thus every element of \(P_{\leq k}\) maps back into that space.

A subspace of polynomials can fail the test. For example, \(U=\operatorname{span}\{1+x\}\) contains \(1+x\), but \(D(1+x)=1\). The polynomial \(1\) is not a scalar multiple of \(1+x\), so \(D(1+x)\notin U\); consequently \(U\) is not invariant. The relevant question is not whether differentiation produces another polynomial, but whether it produces one in the particular subspace \(U\).

Common Pitfalls

Confusing containment with equality. Invariance requires \(T(W)\subseteq W\); it does not require \(T(W)=W\). For instance, the zero map on \(\mathbb{R}^2\) sends every subspace to \(\{\mathbf{0}\}\). That image is contained in each subspace, even when it is strictly smaller.

Checking too few vectors. A calculation on one vector generally cannot establish invariance. For the coordinate plane in the example, checking only \(\mathbf{e}_1\) and \(\mathbf{e}_2\) would not be a complete argument unless the effect on their linear combinations were also justified. The direct calculation with arbitrary \(x,y\) does that.

Using an output that leaves the space as if it passed. A mistaken calculation might claim that \(W=\{(x,y,0)^{\top}\}\) is invariant under \(\mathbf{B}\) because \(\mathbf{B}\mathbf{e}_1=(1,0,1)^{\top}\) is still a vector in \(\mathbb{R}^3\). But membership in the ambient space is not enough: its third coordinate is \(1\), so it is not in \(W\). The correction is to check membership in the proposed subspace itself.

Check Your Understanding

For each question, apply the definition to arbitrary vectors where needed, and give a reason for your conclusion.

  1. For \(T(x,y)=(2x,3y)\), is \(\operatorname{span}\{(1,0)^{\top}\}\) invariant?
  2. Let \(S,T:V\to V\) be linear and suppose \(ST=TS\). Which of \(\ker S\) and \(\operatorname{im}S\) must be invariant under \(T\)?
  3. Is \(W=\{(x,y,0)^{\top}:x,y\in\mathbb{R}\}\) invariant under the matrix \(\begin{bmatrix}1&0&0\\0&1&0\\0&1&1\end{bmatrix}\)?
  4. Is \(P_{\leq3}\) invariant under differentiation? State what happens to the degree of a nonzero derivative.
  5. Give a vector that shows \(\operatorname{span}\{1+x\}\) is not invariant under differentiation.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon