Tutorials › Linear Algebra › Linear Independence Of Eigenvectors For Distinct Eigenvalues

Eigenvalues and Eigenvectors · Tutorial 508 of 1000

Linear Independence Of Eigenvectors For Distinct Eigenvalues

Learn why distinct eigenvalues force their corresponding eigenvectors to be independent, and how the eigenvalue equations make the induction proof work.

Intermediate 9 min read

What You'll Learn

  • State the distinct-eigenvalue independence theorem with its hypotheses
  • Follow the induction step that removes one eigenvector from a dependence relation
  • Explain why distinct eigenspaces share only the zero vector
  • Verify eigenpairs and independence in real and complex examples
  • Recognize why the theorem does not apply when eigenvalues repeat

The Claim and Its Hypotheses

Eigenvectors are connected to one another through the action of the same matrix: each is multiplied by its own eigenvalue. When those eigenvalues are different, this shared structure prevents the eigenvectors from cancelling in a nontrivial linear combination. The key is to use the eigenvalue equations to create a new relation involving fewer vectors, which makes induction possible.

Let \(\mathbb{F}\) be either \(\mathbb{R}\) or \(\mathbb{C}\), let \(\mathbf{A}\in\mathbb{F}^{n\times n}\), and view \(\mathbf{A}\) as acting on column vectors in \(\mathbb{F}^n\). A scalar \(\lambda\in\mathbb{F}\) is an eigenvalue of \(\mathbf{A}\) if there is a nonzero vector \(\mathbf{v}\in\mathbb{F}^n\) such that \(\mathbf{A}\mathbf{v}=\lambda\mathbf{v}\). Such a nonzero vector is an eigenvector associated with \(\lambda\). The requirement \(\mathbf{v}\ne\mathbf{0}\) is part of the definition.

Theorem (Linear independence for distinct eigenvalues): Let \(\mathbf{A}\in\mathbb{F}^{n\times n}\), where \(\mathbb{F}=\mathbb{R}\) or \(\mathbb{C}\). If \(\lambda_1,\dots,\lambda_p\in\mathbb{F}\) are pairwise distinct eigenvalues of \(\mathbf{A}\), and \(\mathbf{v}_i\ne\mathbf{0}\) satisfies \(\mathbf{A}\mathbf{v}_i=\lambda_i\mathbf{v}_i\) for each \(i=1,\dots,p\), then the list \(\mathbf{v}_1,\dots,\mathbf{v}_p\) is linearly independent.

Pairwise distinct means \(\lambda_i\ne\lambda_j\) whenever \(i\ne j\). The theorem does not require the eigenvectors to have any particular length or form, and the eigenspace for one eigenvalue can contain many different nonzero eigenvectors. It does require that the eigenvalues assigned to the selected vectors be distinct. The proof uses this condition when it divides out the scalar difference between two eigenvalues.

A Useful Fact About Eigenspaces

For a fixed eigenvalue \(\lambda\), its eigenspace is the set of all vectors satisfying \(\mathbf{A}\mathbf{v}=\lambda\mathbf{v}\), including the zero vector. Before proving the theorem, it is useful to see how the eigenvalue equation restricts vectors that could belong to two different eigenspaces.

Lemma: If \(\lambda\) and \(\mu\) are distinct eigenvalues of \(\mathbf{A}\), then the only vector that satisfies both \(\mathbf{A}\mathbf{v}=\lambda\mathbf{v}\) and \(\mathbf{A}\mathbf{v}=\mu\mathbf{v}\) is \(\mathbf{0}\).

Proof. Suppose that \(\mathbf{v}\) satisfies both equations. Their left sides are equal, so \(\lambda\mathbf{v}=\mu\mathbf{v}\), and therefore \((\lambda-\mu)\mathbf{v}=\mathbf{0}\). Since \(\lambda\ne\mu\), the scalar \(\lambda-\mu\) is nonzero and has a multiplicative inverse in \(\mathbb{F}\). Multiplying by that inverse gives \(\mathbf{v}=\mathbf{0}\). Conversely, \(\mathbf{0}\) satisfies both equations, so it is indeed the only common vector. \(\square\)

This lemma concerns a vector that belongs to both eigenspaces. The independence theorem is stronger: it rules out a nontrivial linear combination involving one eigenvector from each of several distinct eigenspaces. The induction proof extends the same basic idea—using different eigenvalues to produce a nonzero scalar factor—to a relation with any finite number of terms.

Proof by Induction

We prove the theorem for every positive integer \(p\), the number of selected eigenvectors. The induction step starts by assuming there is a linear relation. Applying \(\mathbf{A}\) to it gives another relation, with the coefficient of each eigenvector multiplied by its eigenvalue. Subtracting a suitable multiple of the first relation eliminates one term. The induction hypothesis then forces all the remaining coefficients to vanish.

Proof. We use induction on \(p\). For \(p=1\), suppose \(c_1\mathbf{v}_1=\mathbf{0}\). Since \(\mathbf{v}_1\ne\mathbf{0}\), some coordinate of \(\mathbf{v}_1\) is nonzero. The corresponding coordinate of \(c_1\mathbf{v}_1\) can be zero only if \(c_1=0\). Thus the one-vector list is independent.

Now let \(p\ge2\), and assume the theorem holds for lists of \(p-1\) eigenvectors with pairwise distinct eigenvalues. Consider a relation among the \(p\) vectors: \[ c_1\mathbf{v}_1+\cdots+c_p\mathbf{v}_p=\mathbf{0}. \] Apply the matrix \(\mathbf{A}\) to both sides. Matrix multiplication is linear, and \(\mathbf{A}\mathbf{v}_i=\lambda_i\mathbf{v}_i\), so \[ c_1\lambda_1\mathbf{v}_1+\cdots+c_p\lambda_p\mathbf{v}_p=\mathbf{0}. \] Multiply the original relation by \(\lambda_p\) and subtract it from this new relation. The \(\mathbf{v}_p\) term cancels, leaving \[ c_1(\lambda_1-\lambda_p)\mathbf{v}_1+\cdots+ c_{p-1}(\lambda_{p-1}-\lambda_p)\mathbf{v}_{p-1}=\mathbf{0}. \] The first \(p-1\) eigenvalues are pairwise distinct, so the induction hypothesis says that \(\mathbf{v}_1,\dots,\mathbf{v}_{p-1}\) are linearly independent. Consequently, each coefficient in this last relation is zero: \[ c_i(\lambda_i-\lambda_p)=0\qquad (i=1,\dots,p-1). \] For each such \(i\), pairwise distinctness gives \(\lambda_i-\lambda_p\ne0\). Therefore \(c_i=0\) for every \(i=1,\dots,p-1\). Substituting these values into the original relation gives \(c_p\mathbf{v}_p=\mathbf{0}\). Since \(\mathbf{v}_p\ne\mathbf{0}\), it follows that \(c_p=0\). Every coefficient is zero, as required. This proves the statement for \(p\), and induction proves it for every positive integer \(p\). \(\square\)

Worked Examples

Worked Example: Two Eigenvectors of a Triangular Matrix

Consider \(\mathbf{A}=\begin{bmatrix}2&1\\0&3\end{bmatrix}\). Find an eigenvector for each of the eigenvalues \(2\) and \(3\), verify the eigenvalue equations, and explain why the resulting vectors are independent.

For \(\lambda_1=2\), try \(\mathbf{v}_1=\begin{bmatrix}1\\0\end{bmatrix}\). Multiplication gives \[ \mathbf{A}\mathbf{v}_1= \begin{bmatrix}2&1\\0&3\end{bmatrix} \begin{bmatrix}1\\0\end{bmatrix} = \begin{bmatrix}2\\0\end{bmatrix} =2\begin{bmatrix}1\\0\end{bmatrix} =2\mathbf{v}_1. \] The vector is nonzero, so it is an eigenvector for \(2\).

For \(\lambda_2=3\), take \(\mathbf{v}_2=\begin{bmatrix}1\\1\end{bmatrix}\). Then \[ \mathbf{A}\mathbf{v}_2= \begin{bmatrix}2&1\\0&3\end{bmatrix} \begin{bmatrix}1\\1\end{bmatrix} = \begin{bmatrix}3\\3\end{bmatrix} =3\begin{bmatrix}1\\1\end{bmatrix} =3\mathbf{v}_2. \] Again, the vector is nonzero. Since \(2\ne3\), the theorem gives independence. Directly, if \(c_1\mathbf{v}_1+c_2\mathbf{v}_2=\mathbf{0}\), then \[ \begin{bmatrix}c_1+c_2\\c_2\end{bmatrix} =\begin{bmatrix}0\\0\end{bmatrix}. \] The second coordinate gives \(c_2=0\), and the first then gives \(c_1=0\), confirming the conclusion.

Worked Example: Three Eigenvectors of One Matrix

Let \(\mathbf{B}=\begin{bmatrix}1&1&0\\0&2&1\\0&0&3\end{bmatrix}\). Verify eigenvectors for three distinct eigenvalues and use the theorem to determine whether the vectors are independent.

For \(\lambda_1=1\), use \(\mathbf{w}_1=\begin{bmatrix}1\\0\\0\end{bmatrix}\). The multiplication is \[ \mathbf{B}\mathbf{w}_1= \begin{bmatrix}1\\0\\0\end{bmatrix} =1\mathbf{w}_1. \] For \(\lambda_2=2\), use \(\mathbf{w}_2=\begin{bmatrix}1\\1\\0\end{bmatrix}\). Then \[ \mathbf{B}\mathbf{w}_2= \begin{bmatrix}1+1\\2\\0\end{bmatrix} =\begin{bmatrix}2\\2\\0\end{bmatrix} =2\mathbf{w}_2. \] For \(\lambda_3=3\), use \(\mathbf{w}_3=\begin{bmatrix}1\\2\\2\end{bmatrix}\). Multiplying row by row gives \[ \mathbf{B}\mathbf{w}_3 =\begin{bmatrix}1+2\\4+2\\6\end{bmatrix} =\begin{bmatrix}3\\6\\6\end{bmatrix} =3\mathbf{w}_3. \] Each vector is nonzero, and \(1,2,3\) are pairwise distinct. The theorem therefore says that \(\mathbf{w}_1,\mathbf{w}_2,\mathbf{w}_3\) are linearly independent. As a direct check, a zero combination has coordinates \[ c_1+c_2+c_3=0,\qquad c_2+2c_3=0,\qquad 2c_3=0. \] The third equation gives \(c_3=0\), the second gives \(c_2=0\), and the first gives \(c_1=0\).

Worked Example: Complex Eigenvalues and Eigenvectors

Over \(\mathbb{C}\), consider \(\mathbf{C}=\begin{bmatrix}0&-1\\1&0\end{bmatrix}\). Verify eigenvectors for \(i\) and \(-i\), then check their independence over \(\mathbb{C}\).

For \(\lambda_1=i\), choose \(\mathbf{z}_1=\begin{bmatrix}1\\-i\end{bmatrix}\). Since \(i^2=-1\), \[ \mathbf{C}\mathbf{z}_1= \begin{bmatrix}i\\1\end{bmatrix}, \qquad i\mathbf{z}_1= \begin{bmatrix}i\\-i^2\end{bmatrix} =\begin{bmatrix}i\\1\end{bmatrix}. \] Thus \(\mathbf{C}\mathbf{z}_1=i\mathbf{z}_1\). For \(\lambda_2=-i\), choose \(\mathbf{z}_2=\begin{bmatrix}1\\i\end{bmatrix}\). We have \[ \mathbf{C}\mathbf{z}_2= \begin{bmatrix}-i\\1\end{bmatrix}, \qquad (-i)\mathbf{z}_2= \begin{bmatrix}-i\\(-i)i\end{bmatrix} =\begin{bmatrix}-i\\1\end{bmatrix}. \] So \(\mathbf{C}\mathbf{z}_2=-i\mathbf{z}_2\). Both vectors are nonzero and \(i\ne-i\), so they are independent over \(\mathbb{C}\). Indeed, a relation \(a\mathbf{z}_1+b\mathbf{z}_2=\mathbf{0}\) gives \(a+b=0\) and \(-ia+ib=0\). The latter equation implies \(b=a\); together the equations give \(2a=0\), hence \(a=b=0\).

What the Distinctness Condition Does—and Does Not—Say

The theorem is about a list containing one nonzero eigenvector for each of several distinct eigenvalues. It does not say that every collection of eigenvectors of one matrix is independent. If two selected vectors have the same eigenvalue, the theorem's hypothesis fails, even if the vectors happen to be independent. Nor does it say that vectors for distinct eigenvalues must be orthogonal; independence and orthogonality are different properties.

A common mistake is to infer orthogonality from distinct eigenvalues. For a concrete counterexample, use the first worked example. Its eigenvectors satisfy \[ \mathbf{v}_1^{\top}\mathbf{v}_2 =\begin{bmatrix}1&0\end{bmatrix} \begin{bmatrix}1\\1\end{bmatrix} =1. \] The eigenvalues are distinct, but the dot product is \(1\), not \(0\). The correct conclusion is that these eigenvectors are linearly independent, as the theorem states—not that they are orthogonal.

Another error is to omit the nonzero condition. The zero vector satisfies \(\mathbf{A}\mathbf{0}=\lambda\mathbf{0}\) for every scalar \(\lambda\), but it is not an eigenvector. Including it would immediately produce a dependent list: the coefficient \(1\) on \(\mathbf{0}\), with zero coefficients on the other vectors, gives a nontrivial relation equal to \(\mathbf{0}\). The theorem avoids this issue by requiring each selected vector to be nonzero.

Finally, repeated eigenvalues do not invalidate independence in every case; they simply make this theorem unavailable. For instance, the identity matrix \(\mathbf{I}_2\) has eigenvalue \(1\), and \(\begin{bmatrix}1\\0\end{bmatrix}\) and \(\begin{bmatrix}0\\1\end{bmatrix}\) are independent eigenvectors for that same eigenvalue. By contrast, choosing \(\begin{bmatrix}1\\0\end{bmatrix}\) twice gives a dependent list. Both choices have a repeated eigenvalue, so independence must be checked by other reasoning.

Check Your Understanding

For each question, use the nonzero condition and the eigenvalue equations carefully.

  1. In the induction proof, which term is eliminated when \(\lambda_p\) times the original relation is subtracted from the relation obtained by applying \(\mathbf{A}\)?
  2. Why does \(c_i(\lambda_i-\lambda_p)=0\) imply \(c_i=0\) for \(i<p\)?
  3. For \(\mathbf{A}=\begin{bmatrix}4&1\\0&2\end{bmatrix}\), verify that \(\begin{bmatrix}1\\0\end{bmatrix}\) and \(\begin{bmatrix}1\\-2\end{bmatrix}\) are eigenvectors for distinct eigenvalues, and state the theorem's conclusion.
  4. Can a zero vector be included among the eigenvectors in the theorem? Explain using the definition of eigenvector.
  5. Does the theorem imply that eigenvectors for distinct eigenvalues are orthogonal? Give the relevant distinction between the two conclusions.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon