Tutorials › Linear Algebra › Jordan Form with Multiple Eigenvalues

Generalized Eigenvectors and Jordan Form · Tutorial 844 of 1000

Jordan Form with Multiple Eigenvalues

Separate a matrix into its generalized eigenspaces, find the Jordan blocks on each invariant subspace, and combine them into one Jordan form.

Advanced 10 min read

What You'll Learn

  • Define generalized eigenspaces for each distinct eigenvalue over the complex numbers
  • Use primary decomposition to separate the matrix into invariant summands
  • Determine Jordan block sizes from successive kernel dimensions on each summand
  • Assemble local Jordan forms into a global Jordan form
  • Check a proposed Jordan form by verifying its basis and the matrix action

One Eigenvalue at a Time

When a matrix has several distinct eigenvalues, its Jordan form is built by treating each eigenvalue separately. The vectors associated with one eigenvalue form a generalized eigenspace, an invariant subspace on which the matrix differs from a scalar multiple of the identity by a nilpotent map. Jordan chains can be found inside each such subspace; their lengths determine the Jordan blocks for that eigenvalue. The final Jordan matrix places all these local blocks together.

We work over \(\mathbb{C}\), so every eigenvalue of the matrix is included. If a matrix has real entries but nonreal eigenvalues, its Jordan form in this tutorial is understood over \(\mathbb{C}\). Let \(\mathbf{A}\in\mathbb{C}^{n\times n}\), and let \(\lambda\) be an eigenvalue. The generalized eigenspace for \(\lambda\) is the set of vectors killed by a sufficiently high power of \(\mathbf{A}-\lambda\mathbf{I}_n\). Using the exponent \(n\) is always sufficient.

Definition: For an eigenvalue \(\lambda\) of \(\mathbf{A}\in\mathbb{C}^{n\times n}\), its generalized eigenspace is \(G_{\lambda}=\ker(\mathbf{A}-\lambda\mathbf{I}_n)^n\). It is invariant under \(\mathbf{A}\): if \(\mathbf{x}\in G_{\lambda}\), then \((\mathbf{A}-\lambda\mathbf{I}_n)^n\mathbf{A}\mathbf{x}=\mathbf{A}(\mathbf{A}-\lambda\mathbf{I}_n)^n\mathbf{x}=\mathbf{0}\), so \(\mathbf{A}\mathbf{x}\in G_{\lambda}\).

On \(G_{\lambda}\), the map \(\mathbf{A}-\lambda\mathbf{I}_n\) is nilpotent, meaning that some power of it is the zero map. This is why the repeated-eigenvalue case applies to each summand. The key separation result is the Primary Decomposition Theorem: if the distinct eigenvalues of \(\mathbf{A}\) are \(\lambda_1,\dots,\lambda_r\), then \(\mathbb{C}^n=G_{\lambda_1}\oplus\cdots\oplus G_{\lambda_r}\). Here a direct sum means every vector has a unique expression as a sum of vectors from the listed subspaces. This standard result was established in the earlier material on primary decomposition.

Assembling the Local Jordan Forms

For a single eigenvalue \(\lambda_i\), the restriction of \(\mathbf{A}-\lambda_i\mathbf{I}_n\) to \(G_{\lambda_i}\) is nilpotent. The Jordan Form Existence Theorem for nilpotent maps, established earlier, supplies a basis of Jordan chains for this restriction. Adding \(\lambda_i\) to the diagonal of each nilpotent block gives Jordan blocks with eigenvalue \(\lambda_i\). The following result explains why doing this separately gives the Jordan form of the whole matrix.

Theorem (Assembly of Jordan forms): Let \(\mathbf{A}\in\mathbb{C}^{n\times n}\) have distinct eigenvalues \(\lambda_1,\dots,\lambda_r\), and let \(G_{\lambda_i}\) be their generalized eigenspaces. Choose a Jordan chain basis for the restriction of \(\mathbf{A}\) to each \(G_{\lambda_i}\). Concatenating these bases gives a basis of \(\mathbb{C}^n\), and the matrix of \(\mathbf{A}\) in that basis is block diagonal, with the Jordan blocks for each \(\lambda_i\) grouped together.

Proof. By the Primary Decomposition Theorem, each vector of \(\mathbb{C}^n\) has a unique expression as a sum of vectors from \(G_{\lambda_1},\dots,G_{\lambda_r}\). A basis of each summand therefore combines to form a basis of the whole space: it spans by existence of the expressions, and is independent because any linear combination equal to \(\mathbf{0}\) gives a sum of vectors from the separate summands equal to \(\mathbf{0}\), so uniqueness forces each summand’s combination to be \(\mathbf{0}\). In the chosen basis, vectors from a chain in \(G_{\lambda_i}\) are mapped to linear combinations of vectors in that same chain. Thus no basis vector from one generalized eigenspace maps to a vector in another. The matrix is block diagonal across the summands, and within each summand its blocks are the Jordan blocks supplied by the chain basis. \(\square

This theorem gives a useful practical rule: do not try to build chains that mix eigenvalues. First identify each generalized eigenspace; then find its block sizes and chains; finally put the resulting blocks in any order. The order of the blocks does not change the similarity class, provided the basis vectors are ordered to match the chosen block order.

Finding Block Sizes Within a Summand

Fix an eigenvalue \(\lambda\), and write \(N=(\mathbf{A}-\lambda\mathbf{I}_n)|_{G_{\lambda}}\), the restriction to \(G_{\lambda}\). Define \(d_k=\dim\ker(N^k)\) for \(k\geq 0\), taking \(d_0=0\). The successive differences reveal how many blocks are present. A block of size \(s\) contributes \(\min(k,s)\) to \(d_k\): in a nilpotent Jordan block, the \(k\)th power kills the first \(\min(k,s)\) chain vectors and no others. Summing over the blocks gives the count formulas below.

Block-count formula: For the Jordan blocks belonging to \(\lambda\), \(d_k-d_{k-1}\) is the number of blocks of size at least \(k\). Consequently, the number of blocks of size exactly \(k\) is \(2d_k-d_{k-1}-d_{k+1}\).

Proof. Consider one nilpotent Jordan block of size \(s\), with chain basis \(\mathbf{v}_1,\dots,\mathbf{v}_s\) satisfying \(N\mathbf{v}_1=\mathbf{0}\) and \(N\mathbf{v}_j=\mathbf{v}_{j-1}\) for \(j\geq2\). Then \(N^k\mathbf{v}_j=\mathbf{0}\) exactly when \(j\leq k\), so the kernel on this block has dimension \(\min(k,s)\). Its contribution to \(d_k-d_{k-1}\) is \(1\) if \(s\geq k\), and \(0\) if \(s<k\). Adding these contributions over the blocks proves the first formula. The blocks of size exactly \(k\) are those of size at least \(k\) minus those of size at least \(k+1\). Substituting the first formula gives \((d_k-d_{k-1})-(d_{k+1}-d_k)=2d_k-d_{k-1}-d_{k+1}\). \(\square

Worked Example: Two Eigenvalues and a Nonstandard Chain Basis

Consider

$$ \mathbf{A}= \begin{bmatrix} \frac52&-\frac12&\frac12\\ 2&0&-1\\ \frac32&-\frac32&\frac12 \end{bmatrix}. $$

We will identify its generalized eigenspaces and construct its Jordan form by checking a chain basis. Let \(\mathbf{p}_1=(1,1,0)^{\top}\), \(\mathbf{p}_2=(1,0,1)^{\top}\), and \(\mathbf{p}_3=(0,1,1)^{\top}\), and set \(\mathbf{P}=[\mathbf{p}_1\ \mathbf{p}_2\ \mathbf{p}_3]\). Its determinant is \(-2\), so these vectors form a basis. Direct multiplication gives

$$ \mathbf{A}\mathbf{p}_1= \begin{bmatrix}2\\2\\0\end{bmatrix}=2\mathbf{p}_1,\qquad \mathbf{A}\mathbf{p}_2= \begin{bmatrix}3\\1\\2\end{bmatrix}=\mathbf{p}_1+2\mathbf{p}_2,\qquad \mathbf{A}\mathbf{p}_3= \begin{bmatrix}0\\-1\\-1\end{bmatrix}=-\mathbf{p}_3. $$

Thus \(\mathbf{A}\mathbf{P}=\mathbf{P}\mathbf{J}\), where

$$ \mathbf{J}= \begin{bmatrix} 2&1&0\\ 0&2&0\\ 0&0&-1 \end{bmatrix}. $$

Since \(\mathbf{P}\) is invertible, \(\mathbf{P}^{-1}\mathbf{A}\mathbf{P}=\mathbf{J}\). In these coordinates, \((\mathbf{A}-2\mathbf{I}_3)\) acts as \(\mathbf{J}-2\mathbf{I}_3\), which has a nilpotent \(2\times2\) block on the first two coordinates and acts by \(-3\) on the third. Therefore \(G_2=\operatorname{span}\{\mathbf{p}_1,\mathbf{p}_2\}\), and \(G_{-1}=\operatorname{span}\{\mathbf{p}_3\}\). For example, \((\mathbf{A}-2\mathbf{I}_3)\mathbf{p}_2=\mathbf{p}_1\) and \((\mathbf{A}-2\mathbf{I}_3)\mathbf{p}_1=\mathbf{0}\). The Jordan form has one block of size \(2\) for eigenvalue \(2\) and one block of size \(1\) for eigenvalue \(-1\).

Check: The three displayed images give the columns of \(\mathbf{A}\mathbf{P}\), and they equal the columns of \(\mathbf{P}\mathbf{J}\). Thus the proposed change-of-basis matrix really does produce the stated Jordan form.

Worked Example: Reading Two Block Sizes from Kernel Growth

Let

$$ \mathbf{A}= \begin{bmatrix} 1&1&0&0\\ 0&1&0&0\\ 0&0&1&0\\ 0&0&0&-2 \end{bmatrix}. $$

For eigenvalue \(1\), put \(\mathbf{N}=\mathbf{A}-\mathbf{I}_4\). Then

$$ \mathbf{N}= \begin{bmatrix} 0&1&0&0\\ 0&0&0&0\\ 0&0&0&0\\ 0&0&0&-3 \end{bmatrix}, \qquad \mathbf{N}^2= \begin{bmatrix} 0&0&0&0\\ 0&0&0&0\\ 0&0&0&0\\ 0&0&0&9 \end{bmatrix}. $$

The equation \(\mathbf{N}\mathbf{x}=\mathbf{0}\) forces \(x_2=x_4=0\), leaving \(x_1,x_3\) free, so \(d_1=2\). The equation \(\mathbf{N}^2\mathbf{x}=\mathbf{0}\) forces only \(x_4=0\), leaving \(x_1,x_2,x_3\) free, so \(d_2=3\). Also \(\mathbf{N}^3=\mathbf{N}^2\mathbf{N}\) has last diagonal entry \(-27\) and all other entries zero, so \(d_3=3\). The block-count formula gives \(d_1-d_0=2\) blocks of size at least \(1\), \(d_2-d_1=1\) block of size at least \(2\), and \(d_3-d_2=0\) blocks of size at least \(3\). Hence the blocks for \(1\) have sizes \(2\) and \(1\).

For eigenvalue \(-2\), \(\mathbf{A}+2\mathbf{I}_4\) has a \(3\times3\) upper block \(\begin{bmatrix}3&1&0\\0&3&0\\0&0&3\end{bmatrix}\) and a final zero entry. The upper block is invertible (its determinant is \(27\)), so its kernel is zero; the generalized eigenspace is \(\operatorname{span}\{\mathbf{e}_4\}\). The Jordan form is therefore the displayed matrix itself, with a size-\(2\) block and a size-\(1\) block for \(1\), and a size-\(1\) block for \(-2\).

Check: The first three standard basis vectors form the indicated Jordan chains for eigenvalue \(1\): \((\mathbf{A}-\mathbf{I}_4)\mathbf{e}_2=\mathbf{e}_1\), while \(\mathbf{e}_1\) and \(\mathbf{e}_3\) are killed. Also \(\mathbf{A}\mathbf{e}_4=-2\mathbf{e}_4\). These four vectors are the standard basis, so the block description accounts for the entire space.

Worked Example: Three Distinct Eigenvalues with No Longer Chains

Consider the upper-triangular matrix

$$ \mathbf{B}= \begin{bmatrix} 1&1&0\\ 0&2&1\\ 0&0&3 \end{bmatrix}. $$

Its characteristic polynomial is \((1-\lambda)(2-\lambda)(3-\lambda)\), so its distinct eigenvalues are \(1,2,3\). Solving \((\mathbf{B}-\lambda\mathbf{I}_3)\mathbf{x}=\mathbf{0}\) gives eigenvectors \(\mathbf{q}_1=(1,0,0)^{\top}\) for \(1\), \(\mathbf{q}_2=(1,1,0)^{\top}\) for \(2\), and \(\mathbf{q}_3=(1,2,2)^{\top}\) for \(3\). For the last vector, multiplication gives \(\mathbf{B}\mathbf{q}_3=(3,6,6)^{\top}=3\mathbf{q}_3\); for the first two, \(\mathbf{B}\mathbf{q}_1=\mathbf{q}_1\) and \(\mathbf{B}\mathbf{q}_2=2\mathbf{q}_2\).

The matrix \(\mathbf{Q}=[\mathbf{q}_1\ \mathbf{q}_2\ \mathbf{q}_3]\) is upper triangular with determinant \(2\), so its columns form a basis. In this basis, each generalized eigenspace is one-dimensional and already consists of eigenvectors. Thus

$$ \mathbf{Q}^{-1}\mathbf{B}\mathbf{Q}= \begin{bmatrix} 1&0&0\\ 0&2&0\\ 0&0&3 \end{bmatrix}. $$

Check: The three verified equations combine to \(\mathbf{B}\mathbf{Q}=\mathbf{Q}\operatorname{diag}(1,2,3)\). Since \(\mathbf{Q}\) is invertible, this confirms the diagonal Jordan form.

A Common Mistake: Using Only Eigenvectors

A generalized eigenspace is not necessarily the ordinary eigenspace. In the first example, a tempting but incorrect calculation is to set \(G_2=\ker(\mathbf{A}-2\mathbf{I}_3)\). That kernel contains \(\mathbf{p}_1\), but it does not contain \(\mathbf{p}_2\), since \((\mathbf{A}-2\mathbf{I}_3)\mathbf{p}_2=\mathbf{p}_1\ne\mathbf{0}\). The mistaken conclusion would be that the eigenvalue \(2\) contributes only a size-\(1\) block. The correction is to use the generalized eigenspace: \((\mathbf{A}-2\mathbf{I}_3)^2\mathbf{p}_2=\mathbf{0}\), so \(\mathbf{p}_2\in G_2\), and the chain \(\mathbf{p}_2\mapsto\mathbf{p}_1\mapsto\mathbf{0}\) gives a size-\(2\) block.

Another useful check is that powers for one eigenvalue must remove the other generalized eigenspaces. In the first example, \((\mathbf{A}-2\mathbf{I}_3)\mathbf{p}_3=-3\mathbf{p}_3\), so \((\mathbf{A}-2\mathbf{I}_3)^k\mathbf{p}_3=(-3)^k\mathbf{p}_3\ne\mathbf{0}\) for every \(k\). The \(-1\) component therefore does not belong to \(G_2\). Once each summand has been isolated, kernel growth is measured on that summand, not by mixing vectors from different eigenvalues.

In practice, the work has three checks: the generalized eigenspaces must account for the full dimension; the Jordan block sizes on each summand must add to its dimension; and the concatenated chain vectors must form a basis in which the matrix acts as claimed. These checks catch both missing chains and incorrect assignments of blocks to eigenvalues.

Check Your Understanding

For each problem, keep the generalized eigenspaces separate before assembling the blocks.

  1. For the matrix in the first worked example, compute \(\dim\ker((\mathbf{A}-2\mathbf{I}_3)^k)\) for \(k=1,2\), and infer the block size for eigenvalue \(2\).
  2. In the second worked example, how many blocks for eigenvalue \(1\) have size at least \(2\)? Which kernel dimensions give the answer?
  3. Explain why a vector in \(G_{-1}\) from the first example cannot also be a nonzero vector in \(G_2\).
  4. For the third worked example, verify directly that \(\mathbf{Q}\) has nonzero determinant and that \(\mathbf{B}\mathbf{Q}=\mathbf{Q}\operatorname{diag}(1,2,3)\).
  5. If \(d_1=3\), \(d_2=5\), and \(d_3=6\) on one generalized eigenspace, how many Jordan blocks have size at least \(2\), and how many have size exactly \(2\)?

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon