Tutorials › Linear Algebra › Testing Equivalent Conditions in the Invertible Matrix Theorem

Fundamental Subspaces and Rank · Tutorial 360 of 1000

Testing Equivalent Conditions in the Invertible Matrix Theorem

Learn to test square-matrix invertibility through equivalent pivot and subspace conditions, and to interpret the results of row reduction.

Intermediate 11 min read

What You'll Learn

  • Identify invertibility from the pivots and rank of a square matrix.
  • Connect full column independence with a trivial null space.
  • Test the left null space using the transpose and rank.
  • Apply the equivalent conditions to invertible, singular, and parameterized matrices.
  • Distinguish the null space from the left null space.

One Question, Several Tests

For a square matrix, invertibility can be checked in several ways. Row reduction counts pivots; rank records that count; column independence asks whether the columns contain redundancy; and the null spaces test whether the matrix or its transpose has a nonzero vector that it sends to zero. These are not separate coincidences. For an \(n\times n\) matrix, each test gives the same answer, and the connections explain how to interpret a computation rather than merely read off a yes-or-no result.

Throughout, matrices and vectors have real entries. The rank of \(\mathbf{A}\in\mathbb{R}^{n\times n}\) is the dimension of its column space, the space spanned by its columns. The null space is \(\operatorname{Nul}\mathbf{A}=\{\mathbf{x}\in\mathbb{R}^n:\mathbf{A}\mathbf{x}=\mathbf{0}\}\). The left null space is \(\operatorname{Nul}\mathbf{A}^{\top}=\{\mathbf{y}\in\mathbb{R}^n:\mathbf{A}^{\top}\mathbf{y}=\mathbf{0}\}\). A matrix is invertible if there is a matrix \(\mathbf{B}\) such that \(\mathbf{A}\mathbf{B}=\mathbf{B}\mathbf{A}=\mathbf{I}_n\).

In row reduction, a pivot is a leading entry in the reduced row echelon form (RREF). The rank equals the number of pivots. For an \(n\times n\) matrix, having \(n\) pivots means that every column is a pivot column and the RREF is \(\mathbf{I}_n\). We will also use the Matrix Rank-Nullity Theorem, which states that \(\operatorname{rank}\mathbf{A}+\operatorname{nullity}\mathbf{A}=n\), and the standard result that row rank equals column rank, so \(\operatorname{rank}\mathbf{A}^{\top}=\operatorname{rank}\mathbf{A}\).

Lemma: A square matrix \(\mathbf{A}\in\mathbb{R}^{n\times n}\) is invertible if and only if \(\operatorname{Nul}\mathbf{A}=\{\mathbf{0}\}\).

Proof. Suppose first that \(\mathbf{A}\) is invertible and \(\mathbf{A}\mathbf{x}=\mathbf{0}\). Multiplying by \(\mathbf{A}^{-1}\) gives \(\mathbf{x}=\mathbf{A}^{-1}\mathbf{0}=\mathbf{0}\). Thus the null space contains only the zero vector. Conversely, suppose \(\operatorname{Nul}\mathbf{A}=\{\mathbf{0}\}\). Its nullity is zero, so rank-nullity gives \(\operatorname{rank}\mathbf{A}=n\). Its RREF therefore has \(n\) pivots and is \(\mathbf{I}_n\). Each row operation is multiplication on the left by an invertible elementary matrix, so the sequence of row operations gives an invertible matrix \(\mathbf{E}\) with \(\mathbf{E}\mathbf{A}=\mathbf{I}_n\). Hence \(\mathbf{A}=\mathbf{E}^{-1}\), which is invertible. \(\square\)

The Equivalent Tests

Theorem (Invertible Matrix Theorem conditions): For \(\mathbf{A}\in\mathbb{R}^{n\times n}\), the following conditions are equivalent:
  • \(\mathbf{A}\) is invertible.
  • The RREF of \(\mathbf{A}\) has a pivot in every column (equivalently, in every row).
  • \(\operatorname{rank}\mathbf{A}=n\).
  • The columns of \(\mathbf{A}\) are linearly independent.
  • \(\operatorname{Nul}\mathbf{A}=\{\mathbf{0}\}\).
  • \(\operatorname{Nul}\mathbf{A}^{\top}=\{\mathbf{0}\}\).

Proof. The lemma gives equivalence between invertibility and a trivial null space. By rank-nullity, \(\operatorname{Nul}\mathbf{A}=\{\mathbf{0}\}\) if and only if \(\operatorname{rank}\mathbf{A}=n\). Rank is the number of pivots, so rank \(n\) is equivalent to having \(n\) pivots in the \(n\) columns; in an \(n\times n\) matrix this is also a pivot in every row. The columns are linearly independent exactly when the equation \(\mathbf{A}\mathbf{x}=\mathbf{0}\), whose coefficients are the column weights, has only the solution \(\mathbf{x}=\mathbf{0}\). This is precisely the trivial-null-space condition. Finally, rank-nullity applied to \(\mathbf{A}^{\top}\) gives \(\operatorname{Nul}\mathbf{A}^{\top}=\{\mathbf{0}\}\) if and only if \(\operatorname{rank}\mathbf{A}^{\top}=n\). Since row rank equals column rank, \(\operatorname{rank}\mathbf{A}^{\top}=\operatorname{rank}\mathbf{A}\), so this is equivalent to \(\operatorname{rank}\mathbf{A}=n\). All six conditions are therefore equivalent. \(\square\)

The square-matrix hypothesis matters. For a rectangular matrix, having a pivot in every column and having a pivot in every row are different requirements, and the matrix cannot be invertible in the two-sided sense defined above. Here, the same number \(n\) of rows and columns allows full rank to mean both full column rank and full row rank.

Worked Tests

Worked Example: An Invertible Matrix

Test \(\mathbf{A}=\begin{bmatrix}1&1&0\\0&1&1\\1&0&1\end{bmatrix}\) using pivots, rank, column independence, and both null spaces.

Subtract row 1 from row 3, add row 2 to the new row 3, scale row 3 by \(\tfrac12\), then clear the entries above the third and second pivots:

$$ \begin{bmatrix}1&1&0\\0&1&1\\1&0&1\end{bmatrix} \xrightarrow{R_3\to R_3-R_1} \begin{bmatrix}1&1&0\\0&1&1\\0&-1&1\end{bmatrix} \xrightarrow{R_3\to R_3+R_2} \begin{bmatrix}1&1&0\\0&1&1\\0&0&2\end{bmatrix} $$
$$ \xrightarrow{R_3\to \frac12R_3} \begin{bmatrix}1&1&0\\0&1&1\\0&0&1\end{bmatrix} \xrightarrow{R_2\to R_2-R_3,\ R_1\to R_1-R_2} \begin{bmatrix}1&0&0\\0&1&0\\0&0&1\end{bmatrix}. $$

There are three pivots, so \(\operatorname{rank}\mathbf{A}=3\). Every column is a pivot column, and the columns are independent. The homogeneous system has only the zero solution, and the theorem also gives a trivial left null space. To check the invertibility directly, take

$$ \mathbf{B}=\frac12\begin{bmatrix}1&-1&1\\1&1&-1\\-1&1&1\end{bmatrix}. $$

Multiplying row by row gives

$$ \mathbf{A}\mathbf{B} =\frac12\begin{bmatrix} 1+1&-1+1&1-1\\ 1-1&1+1&-1+1\\ 1-1&-1+1&1+1 \end{bmatrix} =\mathbf{I}_3. $$

Check: A left inverse of a square matrix is its inverse: in this case, the row reduction already showed that \(\mathbf{A}\) is invertible, and the displayed product verifies that the stated \(\mathbf{B}\) is its inverse. The null-space tests are also consistent: the RREF gives \(\mathbf{A}\mathbf{x}=\mathbf{0}\) only \(\mathbf{x}=\mathbf{0}\); the transpose has rank \(3\), so rank-nullity gives \(\operatorname{Nul}\mathbf{A}^{\top}=\{\mathbf{0}\}\).

Worked Example: A Singular Matrix and Its Two Null Spaces

Consider \(\mathbf{C}=\begin{bmatrix}1&2&3\\2&4&6\\0&1&1\end{bmatrix}\). Row reduction gives

$$ \begin{bmatrix}1&2&3\\2&4&6\\0&1&1\end{bmatrix} \xrightarrow{R_2\to R_2-2R_1} \begin{bmatrix}1&2&3\\0&0&0\\0&1&1\end{bmatrix} \xrightarrow{R_2\leftrightarrow R_3} \begin{bmatrix}1&2&3\\0&1&1\\0&0&0\end{bmatrix} \xrightarrow{R_1\to R_1-2R_2} \begin{bmatrix}1&0&1\\0&1&1\\0&0&0\end{bmatrix}. $$

There are two pivots, so the rank is \(2\), not \(3\), and column 3 is not a pivot column. The RREF system gives \(x_1=-x_3\) and \(x_2=-x_3\). Taking \(x_3=1\) produces \(\mathbf{x}=(-1,-1,1)^{\top}\) in the null space. Substitution checks it:

$$ \mathbf{C}\begin{bmatrix}-1\\-1\\1\end{bmatrix} =\begin{bmatrix}-1-2+3\\-2-4+6\\-1+1\end{bmatrix} =\begin{bmatrix}0\\0\\0\end{bmatrix}. $$

For the left null space, reduce the transpose, not \(\mathbf{C}\):

$$ \mathbf{C}^{\top} =\begin{bmatrix}1&2&0\\2&4&1\\3&6&1\end{bmatrix} \xrightarrow{R_2\to R_2-2R_1,\ R_3\to R_3-3R_1} \begin{bmatrix}1&2&0\\0&0&1\\0&0&1\end{bmatrix} \xrightarrow{R_3\to R_3-R_2} \begin{bmatrix}1&2&0\\0&0&1\\0&0&0\end{bmatrix}. $$

The equations are \(y_1+2y_2=0\) and \(y_3=0\). Setting \(y_2=1\) gives \(\mathbf{y}=(-2,1,0)^{\top}\). Indeed,

$$ \mathbf{C}^{\top}\begin{bmatrix}-2\\1\\0\end{bmatrix} =\begin{bmatrix}-2+2\\-4+4\\-6+6\end{bmatrix} =\begin{bmatrix}0\\0\\0\end{bmatrix}. $$

Thus both null spaces contain nonzero vectors, and the matrix is singular. Rank-nullity also confirms that each null space has dimension \(3-2=1\), using \(\operatorname{rank}\mathbf{C}^{\top}=\operatorname{rank}\mathbf{C}=2\).

Worked Example: A Parameter Changes the Test

For which real values of \(s\) is \(\mathbf{A}_s=\begin{bmatrix}1&1\\1&s\end{bmatrix}\) invertible?

Subtract row 1 from row 2:

$$ \begin{bmatrix}1&1\\1&s\end{bmatrix} \xrightarrow{R_2\to R_2-R_1} \begin{bmatrix}1&1\\0&s-1\end{bmatrix}. $$

If \(s\ne1\), the second row has a pivot. Scaling that row by \(1/(s-1)\) and subtracting the new row 2 from row 1 gives

$$ \begin{bmatrix}1&1\\0&s-1\end{bmatrix} \xrightarrow{R_2\to \frac{1}{s-1}R_2} \begin{bmatrix}1&1\\0&1\end{bmatrix} \xrightarrow{R_1\to R_1-R_2} \begin{bmatrix}1&0\\0&1\end{bmatrix}. $$

Thus there are two pivots and the matrix is invertible. If \(s=1\), the reduced matrix is \(\begin{bmatrix}1&1\\0&0\end{bmatrix}\), which has rank \(1\), so it is singular. In that case, the equation gives \(x_1=-x_2\); choosing \(x_2=1\) gives the nonzero null vector \((-1,1)^{\top}\), and \(\mathbf{A}_1(-1,1)^{\top}=(0,0)^{\top}\).

Check: For \(s\ne1\), the claimed inverse is \(\frac{1}{s-1}\begin{bmatrix}s&-1\\-1&1\end{bmatrix}\). Multiplication yields

$$ \mathbf{A}_s\frac{1}{s-1}\begin{bmatrix}s&-1\\-1&1\end{bmatrix} =\frac{1}{s-1}\begin{bmatrix}s-1&0\\s-s&s-1\end{bmatrix} =\mathbf{I}_2. $$

A Common Mistake: Confusing the Two Null Spaces

The null space and left null space answer different questions. A vector \(\mathbf{x}\) belongs to \(\operatorname{Nul}\mathbf{A}\) when it gives a dependence relation among the columns of \(\mathbf{A}\). A vector \(\mathbf{y}\) belongs to \(\operatorname{Nul}\mathbf{A}^{\top}\) when it gives a dependence relation among the rows of \(\mathbf{A}\), because \(\mathbf{A}^{\top}\mathbf{y}=\mathbf{0}\) is equivalent to \(\mathbf{y}^{\top}\mathbf{A}=\mathbf{0}^{\top}\).

A tempting but wrong calculation for the matrix \(\mathbf{C}\) above is to solve \(\mathbf{C}\mathbf{x}=\mathbf{0}\), obtain \((-1,-1,1)^{\top}\), and call it a left-null vector. It is not: direct substitution gives

$$ \mathbf{C}^{\top}\begin{bmatrix}-1\\-1\\1\end{bmatrix} =\begin{bmatrix}-3\\-5\\-8\end{bmatrix}\ne\mathbf{0}. $$

The correction is to solve the transposed system. Its left-null vector \((-2,1,0)^{\top}\) does satisfy \(\mathbf{C}^{\top}(-2,1,0)^{\top}=\mathbf{0}\), as checked above. Invertibility makes both null spaces trivial, but for a singular matrix their vectors need not be the same.

Using the Tests Efficiently

For a square matrix, choose the test that best matches the information available. If the matrix is already reduced, count pivots. If the question concerns whether columns are redundant, solve the homogeneous system. If a nonzero null vector is easy to spot, it immediately proves singularity. To test the left null space, work with the transpose or use rank equality and rank-nullity. A single failed condition is enough to conclude that the matrix is not invertible; the theorem says all the others fail as well.

Keep the hypotheses in view: the equivalence here concerns square matrices. For a rectangular matrix, a trivial null space means its columns are independent, but does not by itself make the matrix invertible. The square setting is what lets full column rank, full row rank, and an inverse coincide.

Check Your Understanding

For each question, connect the computation to the equivalent conditions rather than relying on a single label.

  1. A \(4\times4\) matrix has three pivots. What are its rank and nullity, and can it be invertible?
  2. If the columns of a square matrix are linearly independent, what does rank-nullity imply about its null space?
  3. For a square matrix of rank \(n-1\), what is the dimension of its left null space?
  4. Explain why row-reducing \(\mathbf{A}\) tests \(\operatorname{Nul}\mathbf{A}\), while row-reducing \(\mathbf{A}^{\top}\) tests \(\operatorname{Nul}\mathbf{A}^{\top}\).
  5. For \(\begin{bmatrix}1&1\\1&s\end{bmatrix}\), identify the parameter value at which the second pivot disappears and give a nonzero null vector there.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon