Tutorials › Linear Algebra › Eigenpairs Of Small Integer Matrices

Eigenvalues and Eigenvectors · Tutorial 510 of 1000

Eigenpairs Of Small Integer Matrices

Practise a complete eigenpair workflow on small integer matrices, from the characteristic polynomial to checked eigenspace bases and multiplicities.

Intermediate 10 min read

What You'll Learn

  • Find and factor characteristic polynomials for two-by-two and three-by-three matrices
  • Solve the homogeneous systems that define eigenspaces
  • Report a basis for each eigenspace
  • Distinguish algebraic multiplicity from geometric multiplicity
  • Check proposed eigenvectors by direct multiplication
  • Recognise and correct common sign and eigenspace errors

A Complete Eigenpair Calculation

An eigenpair calculation is more than finding numbers that make a characteristic polynomial vanish. For each eigenvalue, we must solve a homogeneous system to describe every corresponding eigenvector, give a basis for the eigenspace, and report the two multiplicities that measure different aspects of the eigenvalue. Small integer matrices are useful practice because their arithmetic can be checked exactly, while still requiring care with signs, repeated roots, and free variables.

Unless specified otherwise, the matrices and eigenvectors in this tutorial are over \(\mathbb{R}\). For a matrix \(\mathbf{A}\in\mathbb{R}^{n\times n}\), a real number \(\lambda\) is an eigenvalue if there is a nonzero vector \(\mathbf{v}\in\mathbb{R}^n\) such that \(\mathbf{A}\mathbf{v}=\lambda\mathbf{v}\). Such a vector \(\mathbf{v}\) is an eigenvector for \(\lambda\). The requirement \(\mathbf{v}\ne\mathbf{0}\) matters: the zero vector satisfies \(\mathbf{A}\mathbf{0}=\lambda\mathbf{0}\) for every \(\lambda\), but is never an eigenvector.

Definition: The characteristic polynomial of \(\mathbf{A}\) is \(p_{\mathbf{A}}(\lambda)=\det(\mathbf{A}-\lambda\mathbf{I}_n)\). The eigenspace for an eigenvalue \(\lambda\) is \(E_{\lambda}=\{\mathbf{v}\in\mathbb{R}^n:\mathbf{A}\mathbf{v}=\lambda\mathbf{v}\}\). The algebraic multiplicity \(\operatorname{am}(\lambda)\) is the multiplicity of \(\lambda\) as a root of the characteristic polynomial. The geometric multiplicity \(\operatorname{gm}(\lambda)\) is \(\dim E_{\lambda}\).

A basis for an eigenspace is an ordered list of independent vectors that spans the whole eigenspace. To find one, rearrange the eigenvector equation as \((\mathbf{A}-\lambda\mathbf{I}_n)\mathbf{v}=\mathbf{0}\), then solve this homogeneous system. A basis must describe all solutions, not just one eigenvector. In the examples, a displayed basis will be followed by a direct multiplication check.

Theorem: For \(\mathbf{A}\in\mathbb{R}^{n\times n}\), a real number \(\lambda\) is an eigenvalue if and only if \(p_{\mathbf{A}}(\lambda)=0\).

Proof. The equation \(\mathbf{A}\mathbf{v}=\lambda\mathbf{v}\) is equivalent to \((\mathbf{A}-\lambda\mathbf{I}_n)\mathbf{v}=\mathbf{0}\). Thus \(\lambda\) is an eigenvalue exactly when this homogeneous system has a nonzero solution. By the standard determinant criterion for invertibility, a square matrix has a nonzero vector in its null space exactly when its determinant is zero. Applying that criterion to \(\mathbf{A}-\lambda\mathbf{I}_n\) gives the equivalence with \(\det(\mathbf{A}-\lambda\mathbf{I}_n)=0\), which is \(p_{\mathbf{A}}(\lambda)=0\). \(\square\)

This criterion identifies the eigenvalues, but does not give eigenspace bases or geometric multiplicities. Those require solving the homogeneous system for each root separately.

Two-by-Two Matrices: Distinct Eigenvalues

Worked Example: Two Distinct Eigenvalues

Find the characteristic polynomial, eigenvalues, eigenspace bases, and multiplicities of \(\mathbf{A}=\begin{bmatrix}4&2\\1&3\end{bmatrix}\).

First compute the characteristic polynomial, keeping the prescribed order \(\mathbf{A}-\lambda\mathbf{I}_2\):

$$ p_{\mathbf{A}}(\lambda) =\det\begin{bmatrix}4-\lambda&2\\1&3-\lambda\end{bmatrix} =(4-\lambda)(3-\lambda)-2 =\lambda^2-7\lambda+10 =(\lambda-5)(\lambda-2). $$

The roots are \(\lambda=5\) and \(\lambda=2\), each with algebraic multiplicity \(1\). For \(\lambda=5\), solve \((\mathbf{A}-5\mathbf{I}_2)\mathbf{v}=\mathbf{0}\). Row reduction gives

$$ \begin{bmatrix}-1&2\\1&-2\end{bmatrix} \sim \begin{bmatrix}1&-2\\0&0\end{bmatrix}. $$

The equation is \(x-2y=0\), so \(x=2y\). Taking \(y=1\) gives a basis \(\{(2,1)^{\top}\}\) for \(E_5\), and \(\operatorname{gm}(5)=1\). Check the vector directly: \(\mathbf{A}(2,1)^{\top}=(10,5)^{\top}=5(2,1)^{\top}\).

For \(\lambda=2\),

$$ \begin{bmatrix}2&2\\1&1\end{bmatrix} \sim \begin{bmatrix}1&1\\0&0\end{bmatrix}. $$

Now \(x+y=0\), so \(x=-y\). A basis for \(E_2\) is \(\{(-1,1)^{\top}\}\), and \(\operatorname{gm}(2)=1\). The check is \(\mathbf{A}(-1,1)^{\top}=(-2,2)^{\top}=2(-1,1)^{\top}\). Thus for each eigenvalue the algebraic and geometric multiplicities are both \(1\).

For a two-by-two matrix with distinct characteristic roots, each root has algebraic multiplicity \(1\). Its eigenspace is nonzero by the eigenvalue criterion and is contained in \(\mathbb{R}^2\); in this example the row reduction makes its one-dimensional form explicit. Do not infer an eigenspace basis from the root alone: the homogeneous equations show which vectors actually belong to it.

Repeated Roots Require a Separate Eigenspace Calculation

Worked Example: A Repeated Eigenvalue

Find all eigenpair information for \(\mathbf{B}=\begin{bmatrix}3&1\\0&3\end{bmatrix}\).

The characteristic polynomial is

$$ p_{\mathbf{B}}(\lambda) =\det\begin{bmatrix}3-\lambda&1\\0&3-\lambda\end{bmatrix} =(3-\lambda)^2. $$

There is one eigenvalue, \(\lambda=3\), with \(\operatorname{am}(3)=2\). To find its eigenspace, solve the system for \(\mathbf{B}-3\mathbf{I}_2\):

$$ \begin{bmatrix}0&1\\0&0\end{bmatrix} \begin{bmatrix}x\\y\end{bmatrix} =\begin{bmatrix}0\\0\end{bmatrix}. $$

The first row gives \(y=0\), while \(x\) is free. Therefore \(E_3=\{(x,0)^{\top}:x\in\mathbb{R}\}\), a basis is \(\{(1,0)^{\top}\}\), and \(\operatorname{gm}(3)=1\). The check is \(\mathbf{B}(1,0)^{\top}=(3,0)^{\top}=3(1,0)^{\top}\). The characteristic root is repeated, but the eigenspace basis still comes from solving the system; the multiplicity \(2\) does not mean that this eigenspace has dimension \(2\).

This example illustrates why the algebraic and geometric multiplicities must be reported separately. Algebraic multiplicity counts how often a root occurs in a polynomial. Geometric multiplicity counts the number of independent directions in the eigenspace, measured by its dimension. They answer different questions, so one cannot be substituted for the other.

Theorem: If \(\lambda\) is an eigenvalue of \(\mathbf{A}\in\mathbb{R}^{n\times n}\), then \(E_{\lambda}=\operatorname{Nul}(\mathbf{A}-\lambda\mathbf{I}_n)\). Consequently, \(\operatorname{gm}(\lambda)=\operatorname{nullity}(\mathbf{A}-\lambda\mathbf{I}_n)\).

Proof. By definition, \(\mathbf{v}\in E_{\lambda}\) exactly when \(\mathbf{A}\mathbf{v}=\lambda\mathbf{v}\). Subtracting \(\lambda\mathbf{v}\) from both sides gives \((\mathbf{A}-\lambda\mathbf{I}_n)\mathbf{v}=\mathbf{0}\), which is exactly the condition \(\mathbf{v}\in\operatorname{Nul}(\mathbf{A}-\lambda\mathbf{I}_n)\). The two sets are therefore equal. The geometric multiplicity is the dimension of \(E_{\lambda}\), and the nullity is the dimension of the null space, so the equality of spaces gives the stated equality of dimensions. \(\square\)

A Three-by-Three Calculation

Worked Example: Three Distinct Eigenvalues

For \(\mathbf{C}=\begin{bmatrix}3&1&-1\\-1&5&1\\-2&2&4\end{bmatrix}\), find the factored characteristic polynomial, eigenvalues, eigenspace bases, and multiplicities.

Expand the determinant along the first row. Writing \(\lambda\) for the variable gives

$$ \begin{aligned} p_{\mathbf{C}}(\lambda) &=(3-\lambda)\big((5-\lambda)(4-\lambda)-2\big)\\ &\quad-\big((-1)(4-\lambda)-(-2)\big) -\big((-1)(2)-(5-\lambda)(-2)\big)\\ &=(3-\lambda)(\lambda^2-9\lambda+18)-( \lambda-2)+(2\lambda-8)\\ &=-\lambda^3+12\lambda^2-44\lambda+48\\ &=(2-\lambda)(4-\lambda)(6-\lambda). \end{aligned} $$

Thus the eigenvalues are \(2,4,6\), each with algebraic multiplicity \(1\). For \(\lambda=2\), row-reducing \(\mathbf{C}-2\mathbf{I}_3\) gives

$$ \begin{bmatrix}1&1&-1\\-1&3&1\\-2&2&2\end{bmatrix} \sim \begin{bmatrix}1&1&-1\\0&4&0\\0&4&0\end{bmatrix} \sim \begin{bmatrix}1&0&-1\\0&1&0\\0&0&0\end{bmatrix}. $$

Hence \(x=z\) and \(y=0\), so a basis is \(\{(1,0,1)^{\top}\}\) and \(\operatorname{gm}(2)=1\). Directly, \(\mathbf{C}(1,0,1)^{\top}=(2,0,2)^{\top}=2(1,0,1)^{\top}\).

For \(\lambda=4\), row-reduction gives

$$ \begin{bmatrix}-1&1&-1\\-1&1&1\\-2&2&0\end{bmatrix} \sim \begin{bmatrix}1&-1&1\\0&0&2\\0&0&2\end{bmatrix} \sim \begin{bmatrix}1&-1&0\\0&0&1\\0&0&0\end{bmatrix}. $$

Thus \(x=y\) and \(z=0\). A basis is \(\{(1,1,0)^{\top}\}\), with \(\operatorname{gm}(4)=1\). The check is \(\mathbf{C}(1,1,0)^{\top}=(4,4,0)^{\top}=4(1,1,0)^{\top}\).

For \(\lambda=6\),

$$ \begin{bmatrix}-3&1&-1\\-1&-1&1\\-2&2&-2\end{bmatrix} \sim \begin{bmatrix}1&1&-1\\0&1&-1\\0&0&0\end{bmatrix} \sim \begin{bmatrix}1&0&0\\0&1&-1\\0&0&0\end{bmatrix}. $$

So \(x=0\) and \(y=z\). A basis is \(\{(0,1,1)^{\top}\}\), and \(\operatorname{gm}(6)=1\). The multiplication check is \(\mathbf{C}(0,1,1)^{\top}=(0,6,6)^{\top}=6(0,1,1)^{\top}\). All three eigenvalues have algebraic and geometric multiplicity \(1\).

A Reliable Workflow and a Common Error

For a small integer matrix, keep the calculation in a fixed order. This separates the polynomial calculation from the linear-system calculations and makes it easier to notice an error before it affects every reported result.

1
Form the characteristic polynomial.
Compute \(\det(\mathbf{A}-\lambda\mathbf{I}_n)\) carefully, keeping track of signs in every cofactor.
2
Factor and list the roots.
Each real root is an eigenvalue. Its exponent in the factored polynomial gives its algebraic multiplicity.
3
Solve once for each eigenvalue.
Row-reduce \(\mathbf{A}-\lambda\mathbf{I}_n\), express the solutions using free variables, and extract a basis for the null space.
4
Report and check.
The number of vectors in an eigenspace basis is its geometric multiplicity. Multiply \(\mathbf{A}\) by each basis vector to check that the result is \(\lambda\) times that vector.

Common mistake: using \(\mathbf{A}+\lambda\mathbf{I}\) instead of \(\mathbf{A}-\lambda\mathbf{I}\). For the first matrix above, an incorrect setup would produce \(\det(\mathbf{A}+\lambda\mathbf{I}_2)=(4+\lambda)(3+\lambda)-2=\lambda^2+7\lambda+10\), with roots \(-5\) and \(-2\). Those are not the eigenvalues of \(\mathbf{A}\). The correction is to start from \(\mathbf{A}\mathbf{v}=\lambda\mathbf{v}\), move the right-hand side to the left, and obtain \((\mathbf{A}-\lambda\mathbf{I}_2)\mathbf{v}=\mathbf{0}\). Its determinant is \(\lambda^2-7\lambda+10=(\lambda-5)(\lambda-2)\), matching the directly checked eigenpairs.

Another useful check is to count basis vectors, not just to display a nonzero solution. In the repeated-root example, \((1,0)^{\top}\) is an eigenvector, but it does not by itself prove that the eigenspace is one-dimensional. The row-reduced system shows that every solution has the form \(x(1,0)^{\top}\), which establishes both spanning and the claimed geometric multiplicity.

Check Your Understanding

For each question, report enough information to distinguish the characteristic roots from the eigenspaces they determine.

  1. For \(\begin{bmatrix}2&1\\1&2\end{bmatrix}\), find the factored characteristic polynomial and a basis for each eigenspace.
  2. For \(\begin{bmatrix}4&0\\1&4\end{bmatrix}\), find the algebraic and geometric multiplicities of its eigenvalue.
  3. Explain why a root of \(p_{\mathbf{A}}(\lambda)\) gives a nonzero solution of \((\mathbf{A}-\lambda\mathbf{I})\mathbf{v}=\mathbf{0}\).
  4. For \(\begin{bmatrix}2&0&0\\0&3&1\\0&1&3\end{bmatrix}\), find the eigenvalues and one basis vector for each eigenspace.
  5. State the difference between algebraic multiplicity and geometric multiplicity.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon