Tutorials › Linear Algebra › Reducing a Spanning List in Practice

Basis and Dimension · Tutorial 329 of 1000

Reducing a Spanning List in Practice

Use pivot columns to keep an independent spanning list, and verify what each removed member contributes.

Intermediate 9 min read

What You'll Learn

  • Turn a list of vectors into a matrix by placing the vectors in its columns.
  • Use RREF to identify which original vectors to retain.
  • Explain why the pivot columns give a basis for the span of the list.
  • Remove redundant vectors while keeping the span unchanged.
  • Apply the same coefficient-matrix method to bounded-degree polynomials.
  • Check a proposed reduction by expressing every omitted member using the retained ones.

From a Spanning List to a Basis

A list may span a space even when some members contribute nothing new. For example, one vector might be a combination of the others, or the list might contain a repeated vector. Reducing a spanning list means removing such redundancy without changing what the list can produce. The aim is to finish with a list that still spans the same space and is linearly independent.

For vectors in \(\mathbb{R}^n\), the practical tool is a matrix whose columns are the listed vectors. Row reduction identifies which original columns to keep. The columns to keep are not, in general, the columns of the reduced matrix: they are the columns of the original matrix in the pivot positions.

Definition: A list \((\mathbf{v}_1,\dots,\mathbf{v}_p)\) spans a vector space \(V\) if every vector in \(V\) is a linear combination of the listed vectors. A list is a basis for \(V\) if it spans \(V\) and is linearly independent, meaning that the only coefficients satisfying \(c_1\mathbf{v}_1+\cdots+c_p\mathbf{v}_p=\mathbf{0}\) are \(c_1=\cdots=c_p=0\).

Here is the key deletion test. It applies to any vector space over \(\mathbb{R}\): removing a member preserves the span exactly when that member can already be made from the members left behind.

Proposition: Let \((\mathbf{v}_1,\dots,\mathbf{v}_p)\) be a list in a vector space \(V\), and fix an index \(k\). The list with \(\mathbf{v}_k\) removed spans the same subspace as the original list if and only if \(\mathbf{v}_k\) is a linear combination of the other members.

Proof. Write \(S\) for the span of the full list and \(S_k\) for the span after removing \(\mathbf{v}_k\). If \(\mathbf{v}_k\in S_k\), then every linear combination using \(\mathbf{v}_k\) can be rewritten using only the other vectors. Thus \(S\subseteq S_k\); also \(S_k\subseteq S\) because every remaining vector was in the original list. Hence \(S=S_k\). Conversely, if \(S=S_k\), then \(\mathbf{v}_k\in S=S_k\), so \(\mathbf{v}_k\) is a linear combination of the other members. \(\square\)

The Pivot-Column Method

Given a spanning list \((\mathbf{v}_1,\dots,\mathbf{v}_p)\) in \(\mathbb{R}^n\), form \(\mathbf{A}=\begin{bmatrix}\mathbf{v}_1&\cdots&\mathbf{v}_p\end{bmatrix}\). Row-reduce \(\mathbf{A}\) to reduced row echelon form (RREF). Keep the columns of the original \(\mathbf{A}\) whose positions contain pivots in \(\operatorname{rref}(\mathbf{A})\). The resulting list is a basis for the span of the original list.

Theorem (Pivot-column basis test): For any matrix \(\mathbf{A}\in\mathbb{R}^{n\times p}\), the columns of \(\mathbf{A}\) in the pivot positions of \(\operatorname{rref}(\mathbf{A})\) form a basis for the span of all columns of \(\mathbf{A}\).

Proof. Let \(\mathbf{R}=\operatorname{rref}(\mathbf{A})\). Row reduction consists of elementary row operations, each of which is invertible, so \(\mathbf{R}=\mathbf{E}\mathbf{A}\) for an invertible matrix \(\mathbf{E}\). A linear relation among columns of \(\mathbf{A}\) therefore holds among the corresponding columns of \(\mathbf{R}\), and conversely: multiplying a relation by \(\mathbf{E}\), or by \(\mathbf{E}^{-1}\), preserves it. In \(\mathbf{R}\), the pivot columns are linearly independent: each has a \(1\) in its own pivot row and \(0\) in the other pivot rows, so a combination of them equal to zero must have every coefficient zero. Every nonpivot column of \(\mathbf{R}\) is a combination of its pivot columns: its entries in the pivot rows give the coefficients, and the RREF form gives zero in the remaining rows. These same coefficients express the corresponding column of \(\mathbf{A}\) as a combination of the pivot columns of \(\mathbf{A}\), because \(\mathbf{E}\) is invertible. Thus the selected original columns are independent and span all columns of \(\mathbf{A}\), as required. \(\square\)

So the method gives both properties required of a basis. It also tells you how to check the result in practice: each omitted vector must be expressible using the retained vectors. When the original list is known to span a space \(V\), the retained list spans \(V\) as well.

1
Make the column matrix.
Put the vectors in their original order as columns of \(\mathbf{A}\).
2
Reduce to RREF.
Record the pivot-column positions in the reduced matrix.
3
Retain original columns.
Take those columns from \(\mathbf{A}\), not from \(\operatorname{rref}(\mathbf{A})\).
4
Check the reduction.
Express each omitted vector as a combination of the retained vectors.

Worked Reductions in \(\mathbb{R}^n\)

Worked Example: Four Vectors in \(\mathbb{R}^3\)

Reduce the spanning list \((\mathbf{v}_1,\mathbf{v}_2,\mathbf{v}_3,\mathbf{v}_4)\), where \(\mathbf{v}_1=(1,0,1)^\top\), \(\mathbf{v}_2=(0,1,1)^\top\), \(\mathbf{v}_3=(1,1,2)^\top\), and \(\mathbf{v}_4=(2,-1,1)^\top\), to a basis for its span.

Place the vectors in columns. Subtract row 1 from row 3, then subtract row 2 from row 3:

$$ \begin{bmatrix} 1&0&1&2\\ 0&1&1&-1\\ 1&1&2&1 \end{bmatrix} \underset{R_3\to R_3-R_1}{\sim} \begin{bmatrix} 1&0&1&2\\ 0&1&1&-1\\ 0&1&1&-1 \end{bmatrix} \underset{R_3\to R_3-R_2}{\sim} \begin{bmatrix} 1&0&1&2\\ 0&1&1&-1\\ 0&0&0&0 \end{bmatrix}. $$

The pivots are in columns 1 and 2, so keep \(\mathbf{v}_1,\mathbf{v}_2\). The reduced matrix shows how to express the other columns: column 3 is column 1 plus column 2, and column 4 is twice column 1 minus column 2. Thus \(\mathbf{v}_3=\mathbf{v}_1+\mathbf{v}_2\) and \(\mathbf{v}_4=2\mathbf{v}_1-\mathbf{v}_2\).

Check: \((1,0,1)^\top+(0,1,1)^\top=(1,1,2)^\top\), and \(2(1,0,1)^\top-(0,1,1)^\top=(2,-1,1)^\top\). Both omitted vectors are accounted for, and the pivot-column theorem guarantees that the retained vectors are independent. Therefore \((\mathbf{v}_1,\mathbf{v}_2)\) is a basis for the span of the list.

Worked Example: Pivot Positions Need Not Be the First Columns

Reduce the list \((\mathbf{w}_1,\mathbf{w}_2,\mathbf{w}_3,\mathbf{w}_4)\) in \(\mathbb{R}^3\), where \(\mathbf{w}_1=(1,2,0)^\top\), \(\mathbf{w}_2=(2,4,0)^\top\), \(\mathbf{w}_3=(0,1,1)^\top\), and \(\mathbf{w}_4=(1,3,1)^\top\).

Subtract twice row 1 from row 2, then subtract row 3 from the new row 2:

$$ \begin{bmatrix} 1&2&0&1\\ 2&4&1&3\\ 0&0&1&1 \end{bmatrix} \underset{R_2\to R_2-2R_1}{\sim} \begin{bmatrix} 1&2&0&1\\ 0&0&1&1\\ 0&0&1&1 \end{bmatrix} \underset{R_2\to R_2-R_3}{\sim} \begin{bmatrix} 1&2&0&1\\ 0&0&0&0\\ 0&0&1&1 \end{bmatrix}. $$

The pivots are in columns 1 and 3, not columns 1 and 2. Keep the corresponding original vectors, \(\mathbf{w}_1\) and \(\mathbf{w}_3\). The reduced matrix gives column 2 as twice column 1 and column 4 as column 1 plus column 3. Hence \(\mathbf{w}_2=2\mathbf{w}_1\) and \(\mathbf{w}_4=\mathbf{w}_1+\mathbf{w}_3\).

Check: \(2(1,2,0)^\top=(2,4,0)^\top\), and \((1,2,0)^\top+(0,1,1)^\top=(1,3,1)^\top\). The retained pair is independent by the pivot-column theorem and spans all four vectors, so it is a basis for their span.

Applying the Method to Polynomials

The same procedure works for polynomials of bounded degree. For \(d\geq 0\), let \(P_d(\mathbb{R})\) be the vector space of real polynomials of degree at most \(d\), together with the zero polynomial. Its standard basis is \((1,x,\dots,x^d)\). Represent a polynomial by the column of its coefficients in this order, including zero coefficients for missing powers. Then a list of polynomials becomes a list of coordinate columns, and the pivot-column method applies without change.

Worked Example: Reducing a List in \(P_2(\mathbb{R})\)

Find a basis for the span of \(p_1=1+x\), \(p_2=x+x^2\), \(p_3=1+2x+x^2\), and \(p_4=2+x-x^2\). Relative to \((1,x,x^2)\), their coefficient columns are \((1,1,0)^\top\), \((0,1,1)^\top\), \((1,2,1)^\top\), and \((2,1,-1)^\top\). Reduce the coefficient matrix:

$$ \begin{bmatrix} 1&0&1&2\\ 1&1&2&1\\ 0&1&1&-1 \end{bmatrix} \underset{R_2\to R_2-R_1}{\sim} \begin{bmatrix} 1&0&1&2\\ 0&1&1&-1\\ 0&1&1&-1 \end{bmatrix} \underset{R_3\to R_3-R_2}{\sim} \begin{bmatrix} 1&0&1&2\\ 0&1&1&-1\\ 0&0&0&0 \end{bmatrix}. $$

The pivots are in columns 1 and 2, so retain \(p_1,p_2\). Column 3 is the sum of columns 1 and 2, while column 4 is twice column 1 minus column 2. Therefore \(p_3=p_1+p_2\) and \(p_4=2p_1-p_2\).

Check: \((1+x)+(x+x^2)=1+2x+x^2=p_3\), and \(2(1+x)-(x+x^2)=2+x-x^2=p_4\). The retained polynomials are independent because their coefficient columns are pivot columns, and they span the full list. Thus \((p_1,p_2)\) is a basis for the polynomials spanned by the four given polynomials.

Common Mistake: Keeping Reduced Columns

A frequent error is to use the pivot columns of the reduced matrix as the proposed basis vectors. Row operations change the columns, so those columns need not be members of the original list. In the first example, the RREF has first two columns \((1,0,0)^\top\) and \((0,1,0)^\top\). Claiming these are the basis vectors would be wrong: they are not the original vectors \(\mathbf{v}_1=(1,0,1)^\top\) and \(\mathbf{v}_2=(0,1,1)^\top\).

The correction is to use the RREF only to find the pivot positions, then select the original columns in those positions. Here the pivot positions are 1 and 2, so the correct basis is \((\mathbf{v}_1,\mathbf{v}_2)\). A second check is to verify that each omitted original column is a combination of the selected original columns, as shown in the example.

Another tempting but incorrect shortcut is to delete a vector because its entries look similar to another vector’s entries. Redundancy means being a linear combination of the remaining vectors, not merely resembling them. The coefficient matrix and its pivots provide a systematic test.

Check Your Understanding

For each reduction, identify which original members to keep and verify at least one omitted member by substitution.

  1. Reduce \((1,0)^\top,(2,0)^\top,(1,1)^\top\) to a basis for their span. Which columns are pivot columns?
  2. For the list \((1+x,\;1-x,\;2)\) in \(P_1(\mathbb{R})\), form the coefficient matrix and identify a basis for its span.
  3. Explain why a nonpivot column in RREF can be used to find coefficients expressing the corresponding original vector using the original pivot columns.
  4. A student says to keep the pivot columns of \(\operatorname{rref}(\mathbf{A})\) as the basis vectors. State the error and the correction.
  5. What two properties must the retained list have to be a basis for the span of the original list?

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon