Tutorials › Linear Algebra › Why Geometric Multiplicity Cannot Exceed Algebraic Multiplicity

Eigenvalues and Eigenvectors · Tutorial 492 of 1000

Why Geometric Multiplicity Cannot Exceed Algebraic Multiplicity

Learn why an eigenspace basis forces a matching factor in the characteristic polynomial, and how this bounds geometric multiplicity by algebraic multiplicity.

Intermediate 9 min read

What You'll Learn

  • Define geometric and algebraic multiplicity for an eigenvalue
  • Choose and extend a basis adapted to an eigenspace
  • Derive the block form of a matrix in that basis
  • Prove the characteristic polynomial contains a factor of the required degree
  • Compare examples where geometric and algebraic multiplicities are equal or different
  • Identify a common error about repeated eigenvalues

Two Ways to Measure an Eigenvalue

An eigenvalue can be counted in two different ways. Its eigenspace records how many linearly independent directions are eigenvector directions. Its characteristic polynomial records how many times the eigenvalue occurs as a root. These counts need not be equal, but one cannot exceed the other. The reason is structural: putting a basis of the eigenspace first in a basis for the whole space forces a block form, and that block form forces a corresponding factor in the characteristic polynomial.

Let \(\mathbb{F}\) be \(\mathbb{R}\) or \(\mathbb{C}\), and let \(\mathbf{A}\in\mathbb{F}^{n\times n}\). For this tutorial, take an eigenvalue \(\lambda\in\mathbb{F}\). Its eigenspace is \(E_{\lambda}=\{\mathbf{x}\in\mathbb{F}^n:\mathbf{A}\mathbf{x}=\lambda\mathbf{x}\}\). An eigenvalue has a nonzero eigenvector, so its eigenspace has positive dimension. The characteristic polynomial, with the course convention, is \(p_{\mathbf{A}}(t)=\det(\mathbf{A}-t\mathbf{I}_n)\).

Definition: The geometric multiplicity of \(\lambda\) is \(\operatorname{gm}(\lambda)=\dim E_{\lambda}\). The algebraic multiplicity of \(\lambda\), denoted \(\operatorname{am}(\lambda)\), is the largest integer \(r\) such that \((t-\lambda)^r\) divides \(p_{\mathbf{A}}(t)\). The sign convention in \(p_{\mathbf{A}}(t)\) does not affect this root multiplicity.

The eigenspace is a subspace of the finite-dimensional space \(\mathbb{F}^n\), so it has a basis. Write \(k=\dim E_{\lambda}\), and choose a basis \(\mathbf{v}_1,\dots,\mathbf{v}_k\) for it. Extend that list to a basis \(\mathbf{v}_1,\dots,\mathbf{v}_k,\mathbf{w}_{k+1},\dots,\mathbf{w}_n\) for \(\mathbb{F}^n\). This extension is possible by appending vectors from any spanning list for \(\mathbb{F}^n\) whenever they are not already in the span; when the list spans the space, the resulting independent list is a basis.

What the Adapted Basis Reveals

Let \(\mathbf{P}\) be the matrix whose columns are this extended basis. The matrix of the same linear map in the adapted basis is \(\mathbf{B}=\mathbf{P}^{-1}\mathbf{A}\mathbf{P}\). For each \(i\leq k\), the eigenvector equation gives \(\mathbf{A}\mathbf{v}_i=\lambda\mathbf{v}_i\). Thus the first \(k\) columns of \(\mathbf{B}\) have \(\lambda\) in their corresponding positions and zeros elsewhere. In block form, this says

$$ \mathbf{B}= \begin{bmatrix} \lambda\mathbf{I}_k & \mathbf{D}\\ \mathbf{O} & \mathbf{C} \end{bmatrix}, $$

where the lower-left block is zero. The block \(\mathbf{D}\) need not be zero: the remaining basis vectors may be mapped partly into the eigenspace. What matters for the argument is that the eigenvector basis vectors themselves map into the eigenspace, which makes the lower-left block zero.

Changing basis does not change the characteristic polynomial. In fact, \(\mathbf{B}-t\mathbf{I}_n=\mathbf{P}^{-1}(\mathbf{A}-t\mathbf{I}_n)\mathbf{P}\). By the determinant product rule \(\det(\mathbf{X}\mathbf{Y})=\det(\mathbf{X})\det(\mathbf{Y})\), and \(\det(\mathbf{P}^{-1})\det(\mathbf{P})=1\), so \(\det(\mathbf{B}-t\mathbf{I}_n)=\det(\mathbf{A}-t\mathbf{I}_n)\).

Theorem: For every eigenvalue \(\lambda\) of \(\mathbf{A}\in\mathbb{F}^{n\times n}\), with \(\mathbb{F}=\mathbb{R}\) or \(\mathbb{C}\), the multiplicities satisfy \(1\leq\operatorname{gm}(\lambda)\leq\operatorname{am}(\lambda)\leq n\).

Proof. Set \(k=\operatorname{gm}(\lambda)\), and use the adapted basis above. Since \(\lambda\) is an eigenvalue, \(k\geq1\). If \(k=n\), every basis vector is an eigenvector, so \(\mathbf{B}=\lambda\mathbf{I}_n\) and \(p_{\mathbf{A}}(t)=\det(\lambda\mathbf{I}_n-t\mathbf{I}_n)=(\lambda-t)^n\). Hence \(\operatorname{am}(\lambda)=n=k\).

Now suppose \(k<n\). Then \(\mathbf{B}-t\mathbf{I}_n\) is block upper triangular:

$$ \mathbf{B}-t\mathbf{I}_n= \begin{bmatrix} (\lambda-t)\mathbf{I}_k & \mathbf{D}\\ \mathbf{O} & \mathbf{C}-t\mathbf{I}_{n-k} \end{bmatrix}. $$

For a block upper triangular matrix \(\begin{bmatrix}\mathbf{X}&\mathbf{Y}\\\mathbf{O}&\mathbf{Z}\end{bmatrix}\), its determinant is \(\det(\mathbf{X})\det(\mathbf{Z})\). To see why, use the permutation expansion of the determinant: a nonzero term must assign the rows of the lower block to columns of the right block, since the entries in the lower-left block are zero. The remaining rows must then use columns of the left block. The surviving terms split into the determinant expansions of \(\mathbf{X}\) and \(\mathbf{Z}\), with their signs and products, giving the stated product. Applying this fact and the equality of characteristic polynomials under change of basis gives

$$ p_{\mathbf{A}}(t) =\det(\mathbf{B}-t\mathbf{I}_n) =(\lambda-t)^k\det(\mathbf{C}-t\mathbf{I}_{n-k}). $$

Since \((\lambda-t)^k=(-1)^k(t-\lambda)^k\), the polynomial \(p_{\mathbf{A}}(t)\) is divisible by \((t-\lambda)^k\). Therefore \(\operatorname{am}(\lambda)\geq k=\operatorname{gm}(\lambda)\). Finally, \(p_{\mathbf{A}}\) has degree \(n\), so no root can have multiplicity greater than \(n\). This proves all the claimed inequalities. \(\square\)

Worked Examples

Worked Example: A Repeated Root with a One-Dimensional Eigenspace

Let \(\mathbf{A}=\begin{bmatrix}2&1\\0&2\end{bmatrix}\). Find the geometric and algebraic multiplicities of \(\lambda=2\).

First compute the eigenspace by solving \((\mathbf{A}-2\mathbf{I}_2)\mathbf{x}=\mathbf{0}\). The matrix and equations are

$$ \mathbf{A}-2\mathbf{I}_2= \begin{bmatrix}0&1\\0&0\end{bmatrix}, \qquad \begin{bmatrix}0&1\\0&0\end{bmatrix} \begin{bmatrix}x_1\\x_2\end{bmatrix} =\begin{bmatrix}0\\0\end{bmatrix}, \qquad x_2=0. $$

Thus \(E_2=\operatorname{span}\{\begin{bmatrix}1\\0\end{bmatrix}\}\) and \(\operatorname{gm}(2)=1\). For the characteristic polynomial,

$$ p_{\mathbf{A}}(t)=\det\begin{bmatrix}2-t&1\\0&2-t\end{bmatrix}=(2-t)^2=(t-2)^2. $$

So \(\operatorname{am}(2)=2\). The standard basis is already adapted to the eigenspace: its first vector is an eigenvector, and the matrix is upper triangular with diagonal entries \(2,2\). Check: \(\mathbf{A}\begin{bmatrix}1\\0\end{bmatrix}=\begin{bmatrix}2\\0\end{bmatrix}=2\begin{bmatrix}1\\0\end{bmatrix}\), so the displayed basis vector is indeed an eigenvector.

Worked Example: Equal Multiplicities

Let \(\mathbf{A}=\begin{bmatrix}3&0&0\\0&3&0\\0&0&1\end{bmatrix}\). Find both multiplicities for \(\lambda=3\).

The eigenvector equation is \((\mathbf{A}-3\mathbf{I}_3)\mathbf{x}=\mathbf{0}\), or

$$ \begin{bmatrix}0&0&0\\0&0&0\\0&0&-2\end{bmatrix} \begin{bmatrix}x_1\\x_2\\x_3\end{bmatrix} =\begin{bmatrix}0\\0\\0\end{bmatrix}. $$

The only condition is \(-2x_3=0\), so \(x_3=0\), while \(x_1\) and \(x_2\) are free. Hence \(E_3=\operatorname{span}\{\begin{bmatrix}1\\0\\0\end{bmatrix},\begin{bmatrix}0\\1\\0\end{bmatrix}\}\), and \(\operatorname{gm}(3)=2\). The characteristic polynomial is

$$ p_{\mathbf{A}}(t)=(3-t)(3-t)(1-t)=(3-t)^2(1-t). $$

It follows that \(\operatorname{am}(3)=2\). Check: multiplying the first two standard basis vectors by \(\mathbf{A}\) gives \(3\begin{bmatrix}1\\0\\0\end{bmatrix}\) and \(3\begin{bmatrix}0\\1\\0\end{bmatrix}\), respectively. They are independent, so they form the claimed two-dimensional eigenspace basis.

Worked Example: Using an Eigenspace Basis That Is Not the Standard Basis

Consider \(\mathbf{A}=\begin{bmatrix}1&1&0\\-1&3&0\\0&0&5\end{bmatrix}\) and \(\lambda=2\). The eigenspace equation is

$$ (\mathbf{A}-2\mathbf{I}_3)\mathbf{x} = \begin{bmatrix}-1&1&0\\-1&1&0\\0&0&3\end{bmatrix} \begin{bmatrix}x_1\\x_2\\x_3\end{bmatrix} =\begin{bmatrix}0\\0\\0\end{bmatrix}. $$

The equations give \(x_2=x_1\) and \(x_3=0\), so \(E_2=\operatorname{span}\{\mathbf{v}_1\}\) with \(\mathbf{v}_1=\begin{bmatrix}1\\1\\0\end{bmatrix}\). Thus \(\operatorname{gm}(2)=1\). Extend this eigenspace basis with \(\mathbf{v}_2=\begin{bmatrix}0\\1\\0\end{bmatrix}\) and \(\mathbf{v}_3=\begin{bmatrix}0\\0\\1\end{bmatrix}\). The basis matrix and the matrix of the map in this basis are

$$ \mathbf{P}= \begin{bmatrix}1&0&0\\1&1&0\\0&0&1\end{bmatrix}, \qquad \mathbf{B}= \begin{bmatrix}2&1&0\\0&2&0\\0&0&5\end{bmatrix}. $$

To verify the representation, \(\mathbf{A}\mathbf{v}_1=\begin{bmatrix}2\\2\\0\end{bmatrix}=2\mathbf{v}_1\), \(\mathbf{A}\mathbf{v}_2=\begin{bmatrix}1\\3\\0\end{bmatrix}=\mathbf{v}_1+2\mathbf{v}_2\), and \(\mathbf{A}\mathbf{v}_3=\begin{bmatrix}0\\0\\5\end{bmatrix}=5\mathbf{v}_3\). These are exactly the columns of \(\mathbf{B}\) in the chosen basis. Therefore

$$ p_{\mathbf{A}}(t)=\det(\mathbf{B}-t\mathbf{I}_3)=(2-t)^2(5-t). $$

Consequently \(\operatorname{am}(2)=2\), which exceeds \(\operatorname{gm}(2)=1\). Check: the eigenvector calculation gives \(\mathbf{A}\begin{bmatrix}1\\1\\0\end{bmatrix}=\begin{bmatrix}2\\2\\0\end{bmatrix}=2\begin{bmatrix}1\\1\\0\end{bmatrix}\), and the determinant calculation in the adapted basis exhibits the required squared factor.

Why the Inequality Matters

The inequality is a constraint, not a claim that the two multiplicities are always equal. A root of multiplicity \(r\) has room for at most \(r\) independent eigenvector directions. If the eigenspace has dimension \(r\), the bound is sharp; if its dimension is smaller, the characteristic polynomial counts more copies of the root than there are independent eigenvectors. The adapted-basis argument identifies the source of the bound: each basis vector in the eigenspace contributes a diagonal \(\lambda\) block, and those \(k\) entries force at least \(k\) copies of the root.

Common mistake: assuming a repeated root automatically gives many independent eigenvectors. For the first example, the characteristic polynomial is \((t-2)^2\). A mistaken calculation might conclude that there must be two independent eigenvectors for \(\lambda=2\), and therefore set \(\operatorname{gm}(2)=2\). But solving the eigenvector equation gives \(x_2=0\), so every eigenvector is a multiple of \(\begin{bmatrix}1\\0\end{bmatrix}\), and \(\operatorname{gm}(2)=1\). The correct conclusion is \(1\leq2\), not equality. Root multiplicity counts a polynomial factor; geometric multiplicity counts independent vectors.

This comparison is a useful diagnostic whenever a characteristic polynomial has a repeated root. Compute the dimension of the eigenspace independently from the characteristic polynomial, then check that it is positive and no larger than the root multiplicity. The inequality itself does not decide whether there are enough eigenvectors to form a basis; it establishes the necessary bound without claiming more.

Check Your Understanding

Use the definitions and the adapted-basis argument to answer the following.

  1. For \(\mathbf{A}=\begin{bmatrix}4&0\\0&4\end{bmatrix}\), find \(\operatorname{gm}(4)\) and \(\operatorname{am}(4)\).
  2. For \(\mathbf{A}=\begin{bmatrix}1&1\\0&1\end{bmatrix}\), find the eigenspace for \(\lambda=1\) and compare the two multiplicities.
  3. In the proof, why is the lower-left block zero when the first basis vectors form a basis of \(E_{\lambda}\)?
  4. If \(\operatorname{gm}(\lambda)=3\), what factor must divide \(p_{\mathbf{A}}(t)\)? Explain why the sign convention does not change the root multiplicity.
  5. Explain why the upper-right block \(\mathbf{D}\) in the adapted-basis matrix need not be zero.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon