Tutorials › Linear Algebra › Why Every Column Must Have a Pivot

Linear Independence · Tutorial 168 of 1000

Why Every Column Must Have a Pivot

Learn why a missing pivot creates a nonzero solution to the homogeneous system, and why pivots in every column force the zero solution only.

Beginner 10 min read

What You'll Learn

  • Connect column independence to solutions of a homogeneous matrix equation.
  • Explain why elementary row operations preserve those solutions.
  • Identify pivot and free-variable columns in reduced row echelon form.
  • Prove both directions of the pivot test for independence.
  • Check the test on rectangular matrices and verify solutions by multiplication.
  • Avoid confusing a pivot in every row with a pivot in every column.

From Independence to Pivots

Row reduction turns a matrix into a form where the equations in a homogeneous system are easier to read. The pivot test for independence is not merely a visual shortcut: it works because a missing pivot leaves a variable free, and that free variable can be used to produce a nonzero solution. Conversely, if every column has a pivot, there are no free variables and the homogeneous system has only the zero solution.

Let \(\mathbf{A}\in\mathbb{R}^{m\times n}\), with columns \(\mathbf{a}_1,\dots,\mathbf{a}_n\). A list of columns is linearly independent when the equation \(x_1\mathbf{a}_1+\cdots+x_n\mathbf{a}_n=\mathbf{0}\) forces all coefficients \(x_1,\dots,x_n\) to be zero. Writing \(\mathbf{x}=(x_1,\dots,x_n)^{\top}\), the same equation is \(\mathbf{A}\mathbf{x}=\mathbf{0}\). Thus, independence asks whether this homogeneous system has any solution besides \(\mathbf{x}=\mathbf{0}\).

After reducing \(\mathbf{A}\), we use its reduced row echelon form, or RREF. In this form, every nonzero row begins with a leading \(1\); each leading \(1\) is the only nonzero entry in its column; and leading \(1\)s move strictly to the right as we move down the nonzero rows. A column containing a leading \(1\) is a pivot column. A column without a pivot is a free-variable column when we solve the associated system.

Theorem (Pivot test for independence): Let \(\mathbf{A}\in\mathbb{R}^{m\times n}\), where \(m,n\ge 1\). Its columns are linearly independent if and only if \(\operatorname{rref}(\mathbf{A})\) has a pivot in every column.

The theorem depends on two facts: row operations preserve the solutions of a homogeneous system, and the pivot structure of the RREF determines whether free variables are present. We establish both carefully.

Why Row Reduction Keeps the Same Solutions

An elementary row operation replaces one equation of a system by an equivalent equation. For a homogeneous system, the three allowed operations are swapping two equations, multiplying an equation by a nonzero scalar, and adding a multiple of one equation to another. Each operation can be undone by another allowed operation, so a vector satisfies the equations before the operation exactly when it satisfies them afterward.

Proposition: If \(\mathbf{B}\) is obtained from \(\mathbf{A}\) by a finite sequence of elementary row operations, then \(\mathbf{A}\mathbf{x}=\mathbf{0}\) and \(\mathbf{B}\mathbf{x}=\mathbf{0}\) have exactly the same solutions.

Proof. It is enough to check one row operation, because a finite sequence applies this fact repeatedly. Swapping two rows swaps two equations, without changing which vectors satisfy all the equations. Multiplying a row by a nonzero scalar \(c\) replaces an equation \(L(\mathbf{x})=0\) by \(cL(\mathbf{x})=0\); these are equivalent because \(cL(\mathbf{x})=0\) implies \(L(\mathbf{x})=0\) after division by \(c\), and the reverse implication follows by multiplication. Replacing row \(i\) by row \(i\) plus \(c\) times row \(j\) also preserves the solutions: a vector satisfying the original equations satisfies the new one, and a vector satisfying the new equation and the unchanged row \(j\) satisfies the original row \(i\) after subtracting \(c\) times row \(j\). Each operation therefore preserves the solution set. \(\square\)

Consequently, if \(\mathbf{R}=\operatorname{rref}(\mathbf{A})\), then \(\mathbf{A}\mathbf{x}=\mathbf{0}\) and \(\mathbf{R}\mathbf{x}=\mathbf{0}\) have the same solutions. We can decide independence by reading the simpler system \(\mathbf{R}\mathbf{x}=\mathbf{0}\), without changing the answer to the original question.

How Free Variables Control the Solution

In \(\mathbf{R}\mathbf{x}=\mathbf{0}\), a variable corresponding to a nonpivot column is free: it may be assigned any real value. Each pivot variable is then determined by its pivot equation. More precisely, a pivot equation has the form \(x_j+\sum_{k\in F}r_{ik}x_k=0\), where \(x_j\) is its pivot variable and \(F\) is the set of free-variable indices. There are no other pivot variables in that equation, because every pivot column has zeros outside its leading \(1\). A zero row contributes no equation.

If every column has a pivot, there are no free variables. Every pivot equation is then simply \(x_j=0\), so the only solution is the zero vector. If a column has no pivot, assign \(1\) to the variable in that column and \(0\) to every other free variable. Each pivot equation then determines its pivot variable, so the system has a solution. That solution is nonzero because its assigned free variable is \(1\).

This reasoning proves both directions of the pivot test; it is not necessary to guess whether a free variable will happen to produce a nonzero solution. Its assigned value already guarantees that it does.

Worked Example: A Pivot in Every Column

Determine whether the columns of \(\mathbf{A}=\begin{bmatrix}1&2\\2&5\\1&3\end{bmatrix}\) are independent.

Subtract \(2R_1\) from \(R_2\) and \(R_1\) from \(R_3\). Then subtract the new \(R_2\) from \(R_3\), and subtract \(2R_2\) from \(R_1\):

$$ \begin{bmatrix}1&2\\2&5\\1&3\end{bmatrix} \sim \begin{bmatrix}1&2\\0&1\\0&1\end{bmatrix} \sim \begin{bmatrix}1&2\\0&1\\0&0\end{bmatrix} \sim \begin{bmatrix}1&0\\0&1\\0&0\end{bmatrix}. $$

The last matrix has a pivot in each of its two columns. By the pivot test, the columns of \(\mathbf{A}\) are independent. In equation form, the RREF system says \(x_1=0\) and \(x_2=0\), so it has only the zero solution.

Check: The zero coefficient vector gives \(\mathbf{A}\begin{bmatrix}0\\0\end{bmatrix}=\begin{bmatrix}0\\0\\0\end{bmatrix}\). The row-operation proposition shows that no other solution to the original homogeneous system was lost during reduction.

Worked Example: A Missing Pivot and a Nonzero Solution

Determine whether the columns of \(\mathbf{B}=\begin{bmatrix}1&2&3\\2&4&6\end{bmatrix}\) are independent.

Subtract \(2R_1\) from \(R_2\):

$$ \begin{bmatrix}1&2&3\\2&4&6\end{bmatrix} \sim \begin{bmatrix}1&2&3\\0&0&0\end{bmatrix}. $$

There is a pivot in column 1, but columns 2 and 3 have no pivot. The reduced system has the single equation \(x_1+2x_2+3x_3=0\). Set the free variables \(x_2=1\) and \(x_3=0\); then \(x_1=-2\). Thus \(\mathbf{x}=(-2,1,0)^{\top}\) is a nonzero solution, and the columns are dependent.

Check: Multiply by the original matrix, not just its RREF:

$$ \begin{bmatrix}1&2&3\\2&4&6\end{bmatrix} \begin{bmatrix}-2\\1\\0\end{bmatrix} = \begin{bmatrix}-2+2+0\\-4+4+0\end{bmatrix} = \begin{bmatrix}0\\0\end{bmatrix}. $$

The nonzero solution verifies dependence directly from the definition.

Worked Example: A Free Variable Between Pivot Variables

Consider \(\mathbf{C}=\begin{bmatrix}1&2&3\\0&0&1\\2&4&7\end{bmatrix}\). Determine whether its columns are independent and find a nonzero solution if they are dependent.

First replace \(R_3\) by \(R_3-2R_1\). Then replace the new \(R_3\) by \(R_3-R_2\), and replace \(R_1\) by \(R_1-3R_2\):

$$ \begin{bmatrix}1&2&3\\0&0&1\\2&4&7\end{bmatrix} \sim \begin{bmatrix}1&2&3\\0&0&1\\0&0&1\end{bmatrix} \sim \begin{bmatrix}1&2&3\\0&0&1\\0&0&0\end{bmatrix} \sim \begin{bmatrix}1&2&0\\0&0&1\\0&0&0\end{bmatrix}. $$

Columns 1 and 3 are pivot columns; column 2 is free. The equations are \(x_1+2x_2=0\) and \(x_3=0\). Set \(x_2=1\), giving \(x_1=-2\) and \(x_3=0\). Therefore \(\mathbf{x}=(-2,1,0)^{\top}\) is nonzero and the columns are dependent.

Check:

$$ \begin{bmatrix}1&2&3\\0&0&1\\2&4&7\end{bmatrix} \begin{bmatrix}-2\\1\\0\end{bmatrix} = \begin{bmatrix}-2+2+0\\0\\-4+4+0\end{bmatrix} = \begin{bmatrix}0\\0\\0\end{bmatrix}. $$

This example shows that the free variable need not be in the last column. What matters is whether any column lacks a pivot.

Proof of the Pivot Test

Proof. Let \(\mathbf{R}=\operatorname{rref}(\mathbf{A})\). By the proposition on row operations, \(\mathbf{A}\mathbf{x}=\mathbf{0}\) and \(\mathbf{R}\mathbf{x}=\mathbf{0}\) have the same solutions. By the definition of linear independence, the columns of \(\mathbf{A}\) are independent exactly when the first system has only the zero solution. It remains to determine when the RREF system has only that solution.

If every column of \(\mathbf{R}\) has a pivot, every variable is a pivot variable. Each pivot equation has its pivot variable as its only variable, so each equation sets that variable to zero. Hence \(\mathbf{R}\mathbf{x}=\mathbf{0}\) has only \(\mathbf{x}=\mathbf{0}\), and the columns of \(\mathbf{A}\) are independent.

Conversely, suppose some column of \(\mathbf{R}\) has no pivot. Assign \(1\) to the variable in that column and \(0\) to every other free variable. In every pivot row, solve for its pivot variable using the equation described above. This produces a solution to every nonzero row, and zero rows are satisfied automatically. The resulting solution is nonzero because one of its free-variable entries equals \(1\). Thus \(\mathbf{R}\mathbf{x}=\mathbf{0}\), and therefore \(\mathbf{A}\mathbf{x}=\mathbf{0}\), has a nonzero solution. The columns of \(\mathbf{A}\) are dependent. Both implications hold, proving the equivalence. \(\square\)

Common Pitfall: Counting Rows Instead of Columns

A frequent mistake is to conclude that the columns are independent when there is a pivot in every row. The test asks for a pivot in every column. For example, \(\mathbf{D}=\begin{bmatrix}1&0&1\\0&1&1\end{bmatrix}\) already is in RREF and has a pivot in each of its two rows. But it has three columns, and column 3 has no pivot. The row-pivot count alone does not establish independence.

To correct the conclusion, solve the homogeneous system. It gives \(x_1+x_3=0\) and \(x_2+x_3=0\). Setting \(x_3=1\) gives \(x_1=-1\) and \(x_2=-1\), so \(\mathbf{x}=(-1,-1,1)^{\top}\) is a nonzero solution. Indeed,

$$ \begin{bmatrix}1&0&1\\0&1&1\end{bmatrix} \begin{bmatrix}-1\\-1\\1\end{bmatrix} = \begin{bmatrix}-1+1\\-1+1\end{bmatrix} = \begin{bmatrix}0\\0\end{bmatrix}. $$

The missing column pivot identifies the free variable, and the free variable supplies the nonzero solution. A pivot in every row is not a substitute for a pivot in every column.

Using the Test Reliably

For a matrix with \(n\) columns, independence is decided by whether all \(n\) columns are pivot columns after row reduction. The number of rows does not change the wording of the test. A matrix may have zero rows in its RREF; those rows simply add no equations. If some column lacks a pivot, the corresponding variable is free even if the RREF has a pivot in every nonzero row.

The underlying logic is useful beyond a yes-or-no test: it explains precisely why row reduction can decide independence. Reduction preserves the homogeneous solution set, while the RREF exposes whether any variable can be chosen freely. When no variable is free, every coefficient in a zero combination must vanish. When a variable is free, choosing a nonzero value for it guarantees a nontrivial zero combination. The pivot test is therefore a direct translation of the definition into a computation.

Check Your Understanding

For each question, use the homogeneous system and the pivot columns to justify your answer.

  1. A matrix has five columns and its RREF has pivots in columns 1, 2, 4, and 5. What does the missing pivot imply about its columns?
  2. Explain why row operations can be used to test whether the columns of a matrix are independent.
  3. For \(\begin{bmatrix}1&2&0\\0&1&1\end{bmatrix}\), identify the pivot and free-variable columns. Is there a nonzero solution to the homogeneous system?
  4. State the two directions of the pivot test: what follows if every column has a pivot, and what follows if at least one column does not?
  5. Give a concrete reason that a pivot in every row does not by itself prove column independence.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon