Tutorials › Linear Algebra › Eigenspaces of Symmetric Matrices

Symmetric Matrices and the Spectral Theorem · Tutorial 725 of 1000

Eigenspaces of Symmetric Matrices

Find an eigenspace by row-reducing \(\mathbf{A}-\lambda\mathbf{I}\), expressing its solutions as a basis, and checking the result by multiplication.

Advanced 10 min read

What You'll Learn

  • Translate an eigenvalue problem into the homogeneous system \((\mathbf{A}-\lambda\mathbf{I})\mathbf{x}=\mathbf{0}\).
  • Distinguish an eigenspace, which includes the zero vector, from its nonzero eigenvectors.
  • Use free variables in an RREF system to construct an eigenspace basis.
  • Handle an eigenspace with dimension greater than one.
  • Verify a proposed basis by substitution and check its spanning and independence.
  • Catch a sign error in a row-reduced eigenvector calculation.

From an Eigenvalue to an Eigenspace

An eigenvalue identifies a particular way that a matrix acts by scaling: for a scalar \(\lambda\), a nonzero vector \(\mathbf{x}\) is an eigenvector when \(\mathbf{A}\mathbf{x}=\lambda\mathbf{x}\). Often there is more than one such vector, and the collection of all solutions—including the zero vector—is the eigenspace. To find it, move all terms to one side and solve a homogeneous system. This turns an eigenvector question into a familiar task with a precise goal: find a basis for the null space of \(\mathbf{A}-\lambda\mathbf{I}\).

Here we work over \(\mathbb{R}\), with \(\mathbf{A}\in\mathbb{R}^{n\times n}\). A matrix is symmetric if \(\mathbf{A}^{\top}=\mathbf{A}\). We will use the method for specified real eigenvalues of symmetric matrices. The computation below does not require a result about whether every eigenvalue of a symmetric matrix is real: whenever an eigenvalue is used here, it is real and either given or verified by finding a nonzero solution.

Definition: For a real \(n\times n\) matrix \(\mathbf{A}\) and a real scalar \(\lambda\), the eigenspace associated with \(\lambda\) is $$ E_{\lambda}=\{\mathbf{x}\in\mathbb{R}^n:\mathbf{A}\mathbf{x}=\lambda\mathbf{x}\} =\operatorname{Nul}(\mathbf{A}-\lambda\mathbf{I}_n). $$ A scalar \(\lambda\) is an eigenvalue precisely when \(E_{\lambda}\) contains a nonzero vector. The zero vector belongs to every eigenspace, but is not an eigenvector.

The equality in the definition follows by subtracting \(\lambda\mathbf{x}\) from both sides of \(\mathbf{A}\mathbf{x}=\lambda\mathbf{x}\). This translation is useful because row reduction preserves the solution set of a homogeneous system. In practice, form \(\mathbf{A}-\lambda\mathbf{I}_n\), row-reduce it, and express every solution using free variables. The vectors multiplying those free parameters are candidates for a basis.

Theorem: If \(\lambda\) is a real eigenvalue of \(\mathbf{A}\in\mathbb{R}^{n\times n}\), then \(E_{\lambda}\) is a subspace of \(\mathbb{R}^n\).

Proof. By definition, \(E_{\lambda}\) consists of the vectors \(\mathbf{x}\) satisfying \(\mathbf{A}\mathbf{x}=\lambda\mathbf{x}\). The zero vector satisfies this equation because \(\mathbf{A}\mathbf{0}=\mathbf{0}=\lambda\mathbf{0}\), so \(E_{\lambda}\) is nonempty. If \(\mathbf{u},\mathbf{v}\in E_{\lambda}\) and \(a,b\in\mathbb{R}\), then linearity of matrix multiplication gives \(\mathbf{A}(a\mathbf{u}+b\mathbf{v})=a\mathbf{A}\mathbf{u}+b\mathbf{A}\mathbf{v}=a\lambda\mathbf{u}+b\lambda\mathbf{v}=\lambda(a\mathbf{u}+b\mathbf{v})\). Thus \(a\mathbf{u}+b\mathbf{v}\in E_{\lambda}\). The set contains zero and is closed under linear combinations, so it is a subspace. \(\square\)

How Row Reduction Produces a Basis

Recall that a basis is an ordered list of vectors that is both linearly independent and spans the space. In a homogeneous system in RREF, each free variable can be assigned independently; the pivot variables are then determined by the equations. Grouping the resulting solution by free parameters gives a spanning list. The positions of the free variables also show that this list is independent.

Theorem: Let \(\mathbf{M}\in\mathbb{R}^{n\times n}\). Row-reduce \(\mathbf{M}\) to RREF, and let its free-variable columns be \(j_1,\dots,j_q\). If the solutions of \(\mathbf{M}\mathbf{x}=\mathbf{0}\), written in terms of free variables \(t_1,\dots,t_q\), are \(\mathbf{x}=t_1\mathbf{v}_1+\cdots+t_q\mathbf{v}_q\), then \((\mathbf{v}_1,\dots,\mathbf{v}_q)\) is a basis for \(\operatorname{Nul}\mathbf{M}\). If there are no free variables, the null space is \(\{\mathbf{0}\}\) and the empty list is its basis.

Proof. Row operations preserve the solutions of a homogeneous system, so it is enough to consider the RREF system. Every solution is obtained by assigning values \(t_1,\dots,t_q\) to its free variables and then using the equations to determine its pivot variables. By hypothesis, this gives \(\mathbf{x}=\sum_{k=1}^{q}t_k\mathbf{v}_k\). Therefore every solution is a linear combination of the listed vectors, and each listed vector is itself a solution by setting its parameter to \(1\) and all other parameters to \(0\). The list spans the null space. To prove independence, suppose \(\sum_{k=1}^{q}c_k\mathbf{v}_k=\mathbf{0}\). In free-variable position \(j_k\), the vector \(\mathbf{v}_k\) has entry \(1\), while every \(\mathbf{v}_{\ell}\) for \(\ell\ne k\) has entry \(0\): each vector was formed by setting one free variable to \(1\) and the others to \(0\). Thus the \(j_k\)-th entry of the sum is \(c_k\), and it must equal zero. This holds for every \(k\), so all coefficients vanish and the list is independent. If \(q=0\), there are no free variables, every variable is a pivot variable, and the homogeneous equations force every variable to be zero. The null space is then \(\{\mathbf{0}\}\). \(\square\)

For an eigenspace, apply this result to \(\mathbf{M}=\mathbf{A}-\lambda\mathbf{I}_n\). The result gives a basis, not just a collection of eigenvectors: it certifies that all vectors in the eigenspace can be built from the basis vectors and that none of those vectors is redundant.

Worked Eigenspace Calculations

Worked Example: A One-Dimensional Eigenspace in R²

Find a basis for the eigenspace of the symmetric matrix \(\mathbf{A}=\begin{bmatrix}2&1\\1&2\end{bmatrix}\) associated with \(\lambda=3\).

Subtract \(3\) from each diagonal entry to form \(\mathbf{A}-3\mathbf{I}_2\). Row-reduce, first multiplying row 1 by \(-1\), then replacing row 2 by \(R_2-R_1\):

$$ \begin{bmatrix}-1&1\\1&-1\end{bmatrix} \sim \begin{bmatrix}1&-1\\1&-1\end{bmatrix} \sim \begin{bmatrix}1&-1\\0&0\end{bmatrix}. $$

The equation is \(x_1-x_2=0\), so \(x_1=x_2\). With \(x_2=t\), every solution is \(\mathbf{x}=t\begin{bmatrix}1\\1\end{bmatrix}\). The eigenspace is therefore one-dimensional and a basis is \(\left(\begin{bmatrix}1\\1\end{bmatrix}\right)\).

Check: Multiplying the proposed basis vector by \(\mathbf{A}\) gives \(\begin{bmatrix}2&1\\1&2\end{bmatrix}\begin{bmatrix}1\\1\end{bmatrix} =\begin{bmatrix}3\\3\end{bmatrix} =3\begin{bmatrix}1\\1\end{bmatrix}\). It is a nonzero eigenvector with the stated eigenvalue. The row-reduced equation also shows that every eigenspace vector is its scalar multiple.

Worked Example: A Two-Dimensional Eigenspace in R³

Find a basis for the eigenspace associated with \(\lambda=2\) for the symmetric matrix \(\mathbf{A}=\begin{bmatrix}3&1&1\\1&3&1\\1&1&3\end{bmatrix}\).

Subtract \(2\) from the diagonal entries. Then replace \(R_2\) and \(R_3\) by their differences with \(R_1\):

$$ \begin{bmatrix}1&1&1\\1&1&1\\1&1&1\end{bmatrix} \sim \begin{bmatrix}1&1&1\\0&0&0\\0&0&0\end{bmatrix}. $$

The only equation is \(x_1+x_2+x_3=0\). Let \(x_2=s\) and \(x_3=t\). Then \(x_1=-s-t\), so \(\mathbf{x}=s\begin{bmatrix}-1\\1\\0\end{bmatrix} +t\begin{bmatrix}-1\\0\\1\end{bmatrix}\). A basis is \(\left(\begin{bmatrix}-1\\1\\0\end{bmatrix},\begin{bmatrix}-1\\0\\1\end{bmatrix}\right)\). The two free variables give two basis vectors; the single equation does not restrict the eigenspace to a line.

Check: For the first vector, \(\mathbf{A}\begin{bmatrix}-1\\1\\0\end{bmatrix} =\begin{bmatrix}-2\\2\\0\end{bmatrix} =2\begin{bmatrix}-1\\1\\0\end{bmatrix}\). For the second, \(\mathbf{A}\begin{bmatrix}-1\\0\\1\end{bmatrix} =\begin{bmatrix}-2\\0\\2\end{bmatrix} =2\begin{bmatrix}-1\\0\\1\end{bmatrix}\). Both are eigenvectors. Moreover, the solution formula shows they span the full eigenspace, and their distinct free-variable choices make them independent.

Worked Example: A Different Free Variable Pattern

Find a basis for the eigenspace associated with \(\lambda=2\) for \(\mathbf{A}=\begin{bmatrix}3&2&0\\2&6&0\\0&0&2\end{bmatrix}\).

The matrix is symmetric. Subtract \(2\mathbf{I}_3\); then replace row 2 by \(R_2-2R_1\):

$$ \begin{bmatrix}1&2&0\\2&4&0\\0&0&0\end{bmatrix} \sim \begin{bmatrix}1&2&0\\0&0&0\\0&0&0\end{bmatrix}. $$

The equation is \(x_1+2x_2=0\). Set \(x_2=s\) and \(x_3=t\); then \(x_1=-2s\). Thus \(\mathbf{x}=s\begin{bmatrix}-2\\1\\0\end{bmatrix} +t\begin{bmatrix}0\\0\\1\end{bmatrix}\), and a basis is \(\left(\begin{bmatrix}-2\\1\\0\end{bmatrix},\begin{bmatrix}0\\0\\1\end{bmatrix}\right)\).

Check: Direct multiplication gives \(\mathbf{A}\begin{bmatrix}-2\\1\\0\end{bmatrix} =\begin{bmatrix}-6+2\\-4+6\\0\end{bmatrix} =\begin{bmatrix}-4\\2\\0\end{bmatrix} =2\begin{bmatrix}-2\\1\\0\end{bmatrix}\), and \(\mathbf{A}\begin{bmatrix}0\\0\\1\end{bmatrix} =\begin{bmatrix}0\\0\\2\end{bmatrix} =2\begin{bmatrix}0\\0\\1\end{bmatrix}\). The parameter expression proves that their linear combinations give every solution.

Checking the Whole Answer

Substitution confirms that each proposed basis vector is an eigenvector, but a successful substitution alone does not prove that the list is a basis for the entire eigenspace. A list might contain valid eigenvectors while missing other solutions, or it might contain redundant vectors. The row-reduced system addresses both issues: its free variables produce a formula for every solution, while the independent free-variable choices produce an independent list.

It is also useful to distinguish the eigenspace from a basis for it. The eigenspace is a subspace and contains infinitely many vectors whenever it contains a nonzero vector over \(\mathbb{R}\), since every scalar multiple of a nonzero eigenvector is still in the eigenspace. A basis is a finite list that represents all those vectors without redundancy. For the second example, neither displayed basis vector is the whole eigenspace; each is one member of a two-vector list whose span gives the whole plane of solutions.

Common Sign Error

In the third example the equation is \(x_1+2x_2=0\). A common mistake is to write \(x_1=2x_2\), losing the minus sign, and then report \(\begin{bmatrix}2\\1\\0\end{bmatrix}\) as an eigenvector. Substitution exposes the error: \(\mathbf{A}\begin{bmatrix}2\\1\\0\end{bmatrix} =\begin{bmatrix}8\\10\\0\end{bmatrix}\), whereas \(2\begin{bmatrix}2\\1\\0\end{bmatrix} =\begin{bmatrix}4\\2\\0\end{bmatrix}\). These are not equal. The correct equation gives \(x_1=-2x_2\), and the corrected vector \(\begin{bmatrix}-2\\1\\0\end{bmatrix}\) satisfies the eigenvector equation. Checking by multiplication is a direct way to catch sign errors before accepting a computed basis.

1
Form the shifted matrix.
For the specified eigenvalue \(\lambda\), compute \(\mathbf{A}-\lambda\mathbf{I}_n\).
2
Reduce and solve.
Row-reduce the shifted matrix and write the homogeneous solutions using one parameter for each free variable.
3
Read off the basis.
Separate the solution into the vectors multiplying its free parameters.
4
Verify.
Multiply each proposed basis vector by \(\mathbf{A}\) and check that the result is \(\lambda\) times that vector.

Check Your Understanding

For each computation, use the homogeneous system and confirm the proposed vectors by substitution.

  1. For \(\mathbf{A}=\begin{bmatrix}4&1\\1&4\end{bmatrix}\), find a basis for \(E_5\).
  2. For \(\mathbf{A}=\begin{bmatrix}2&0&0\\0&2&0\\0&0&5\end{bmatrix}\), find a basis for \(E_2\). How many free variables appear?
  3. For \(\mathbf{A}=\begin{bmatrix}3&-1\\-1&3\end{bmatrix}\), find a basis for \(E_2\).
  4. Why does a list of valid eigenvectors not automatically give a basis for the eigenspace?
  5. In an RREF homogeneous system, how does the free-variable form establish both spanning and independence of the vectors it produces?

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon