From a Spanning List to a Basis
A list may span a space even when some members contribute nothing new. For example, one vector might be a combination of the others, or the list might contain a repeated vector. Reducing a spanning list means removing such redundancy without changing what the list can produce. The aim is to finish with a list that still spans the same space and is linearly independent.
For vectors in \(\mathbb{R}^n\), the practical tool is a matrix whose columns are the listed vectors. Row reduction identifies which original columns to keep. The columns to keep are not, in general, the columns of the reduced matrix: they are the columns of the original matrix in the pivot positions.
Here is the key deletion test. It applies to any vector space over \(\mathbb{R}\): removing a member preserves the span exactly when that member can already be made from the members left behind.
Proof. Write \(S\) for the span of the full list and \(S_k\) for the span after removing \(\mathbf{v}_k\). If \(\mathbf{v}_k\in S_k\), then every linear combination using \(\mathbf{v}_k\) can be rewritten using only the other vectors. Thus \(S\subseteq S_k\); also \(S_k\subseteq S\) because every remaining vector was in the original list. Hence \(S=S_k\). Conversely, if \(S=S_k\), then \(\mathbf{v}_k\in S=S_k\), so \(\mathbf{v}_k\) is a linear combination of the other members. \(\square\)
The Pivot-Column Method
Given a spanning list \((\mathbf{v}_1,\dots,\mathbf{v}_p)\) in \(\mathbb{R}^n\), form \(\mathbf{A}=\begin{bmatrix}\mathbf{v}_1&\cdots&\mathbf{v}_p\end{bmatrix}\). Row-reduce \(\mathbf{A}\) to reduced row echelon form (RREF). Keep the columns of the original \(\mathbf{A}\) whose positions contain pivots in \(\operatorname{rref}(\mathbf{A})\). The resulting list is a basis for the span of the original list.
Proof. Let \(\mathbf{R}=\operatorname{rref}(\mathbf{A})\). Row reduction consists of elementary row operations, each of which is invertible, so \(\mathbf{R}=\mathbf{E}\mathbf{A}\) for an invertible matrix \(\mathbf{E}\). A linear relation among columns of \(\mathbf{A}\) therefore holds among the corresponding columns of \(\mathbf{R}\), and conversely: multiplying a relation by \(\mathbf{E}\), or by \(\mathbf{E}^{-1}\), preserves it. In \(\mathbf{R}\), the pivot columns are linearly independent: each has a \(1\) in its own pivot row and \(0\) in the other pivot rows, so a combination of them equal to zero must have every coefficient zero. Every nonpivot column of \(\mathbf{R}\) is a combination of its pivot columns: its entries in the pivot rows give the coefficients, and the RREF form gives zero in the remaining rows. These same coefficients express the corresponding column of \(\mathbf{A}\) as a combination of the pivot columns of \(\mathbf{A}\), because \(\mathbf{E}\) is invertible. Thus the selected original columns are independent and span all columns of \(\mathbf{A}\), as required. \(\square\)
So the method gives both properties required of a basis. It also tells you how to check the result in practice: each omitted vector must be expressible using the retained vectors. When the original list is known to span a space \(V\), the retained list spans \(V\) as well.
Put the vectors in their original order as columns of \(\mathbf{A}\).
Record the pivot-column positions in the reduced matrix.
Take those columns from \(\mathbf{A}\), not from \(\operatorname{rref}(\mathbf{A})\).
Express each omitted vector as a combination of the retained vectors.
Worked Reductions in \(\mathbb{R}^n\)
Worked Example: Four Vectors in \(\mathbb{R}^3\)
Reduce the spanning list \((\mathbf{v}_1,\mathbf{v}_2,\mathbf{v}_3,\mathbf{v}_4)\), where \(\mathbf{v}_1=(1,0,1)^\top\), \(\mathbf{v}_2=(0,1,1)^\top\), \(\mathbf{v}_3=(1,1,2)^\top\), and \(\mathbf{v}_4=(2,-1,1)^\top\), to a basis for its span.
Place the vectors in columns. Subtract row 1 from row 3, then subtract row 2 from row 3:
The pivots are in columns 1 and 2, so keep \(\mathbf{v}_1,\mathbf{v}_2\). The reduced matrix shows how to express the other columns: column 3 is column 1 plus column 2, and column 4 is twice column 1 minus column 2. Thus \(\mathbf{v}_3=\mathbf{v}_1+\mathbf{v}_2\) and \(\mathbf{v}_4=2\mathbf{v}_1-\mathbf{v}_2\).
Check: \((1,0,1)^\top+(0,1,1)^\top=(1,1,2)^\top\), and \(2(1,0,1)^\top-(0,1,1)^\top=(2,-1,1)^\top\). Both omitted vectors are accounted for, and the pivot-column theorem guarantees that the retained vectors are independent. Therefore \((\mathbf{v}_1,\mathbf{v}_2)\) is a basis for the span of the list.
Worked Example: Pivot Positions Need Not Be the First Columns
Reduce the list \((\mathbf{w}_1,\mathbf{w}_2,\mathbf{w}_3,\mathbf{w}_4)\) in \(\mathbb{R}^3\), where \(\mathbf{w}_1=(1,2,0)^\top\), \(\mathbf{w}_2=(2,4,0)^\top\), \(\mathbf{w}_3=(0,1,1)^\top\), and \(\mathbf{w}_4=(1,3,1)^\top\).
Subtract twice row 1 from row 2, then subtract row 3 from the new row 2:
The pivots are in columns 1 and 3, not columns 1 and 2. Keep the corresponding original vectors, \(\mathbf{w}_1\) and \(\mathbf{w}_3\). The reduced matrix gives column 2 as twice column 1 and column 4 as column 1 plus column 3. Hence \(\mathbf{w}_2=2\mathbf{w}_1\) and \(\mathbf{w}_4=\mathbf{w}_1+\mathbf{w}_3\).
Check: \(2(1,2,0)^\top=(2,4,0)^\top\), and \((1,2,0)^\top+(0,1,1)^\top=(1,3,1)^\top\). The retained pair is independent by the pivot-column theorem and spans all four vectors, so it is a basis for their span.
Applying the Method to Polynomials
The same procedure works for polynomials of bounded degree. For \(d\geq 0\), let \(P_d(\mathbb{R})\) be the vector space of real polynomials of degree at most \(d\), together with the zero polynomial. Its standard basis is \((1,x,\dots,x^d)\). Represent a polynomial by the column of its coefficients in this order, including zero coefficients for missing powers. Then a list of polynomials becomes a list of coordinate columns, and the pivot-column method applies without change.
Worked Example: Reducing a List in \(P_2(\mathbb{R})\)
Find a basis for the span of \(p_1=1+x\), \(p_2=x+x^2\), \(p_3=1+2x+x^2\), and \(p_4=2+x-x^2\). Relative to \((1,x,x^2)\), their coefficient columns are \((1,1,0)^\top\), \((0,1,1)^\top\), \((1,2,1)^\top\), and \((2,1,-1)^\top\). Reduce the coefficient matrix:
The pivots are in columns 1 and 2, so retain \(p_1,p_2\). Column 3 is the sum of columns 1 and 2, while column 4 is twice column 1 minus column 2. Therefore \(p_3=p_1+p_2\) and \(p_4=2p_1-p_2\).
Check: \((1+x)+(x+x^2)=1+2x+x^2=p_3\), and \(2(1+x)-(x+x^2)=2+x-x^2=p_4\). The retained polynomials are independent because their coefficient columns are pivot columns, and they span the full list. Thus \((p_1,p_2)\) is a basis for the polynomials spanned by the four given polynomials.
Common Mistake: Keeping Reduced Columns
A frequent error is to use the pivot columns of the reduced matrix as the proposed basis vectors. Row operations change the columns, so those columns need not be members of the original list. In the first example, the RREF has first two columns \((1,0,0)^\top\) and \((0,1,0)^\top\). Claiming these are the basis vectors would be wrong: they are not the original vectors \(\mathbf{v}_1=(1,0,1)^\top\) and \(\mathbf{v}_2=(0,1,1)^\top\).
The correction is to use the RREF only to find the pivot positions, then select the original columns in those positions. Here the pivot positions are 1 and 2, so the correct basis is \((\mathbf{v}_1,\mathbf{v}_2)\). A second check is to verify that each omitted original column is a combination of the selected original columns, as shown in the example.
Another tempting but incorrect shortcut is to delete a vector because its entries look similar to another vector’s entries. Redundancy means being a linear combination of the remaining vectors, not merely resembling them. The coefficient matrix and its pivots provide a systematic test.
Check Your Understanding
For each reduction, identify which original members to keep and verify at least one omitted member by substitution.
- Reduce \((1,0)^\top,(2,0)^\top,(1,1)^\top\) to a basis for their span. Which columns are pivot columns?
- For the list \((1+x,\;1-x,\;2)\) in \(P_1(\mathbb{R})\), form the coefficient matrix and identify a basis for its span.
- Explain why a nonpivot column in RREF can be used to find coefficients expressing the corresponding original vector using the original pivot columns.
- A student says to keep the pivot columns of \(\operatorname{rref}(\mathbf{A})\) as the basis vectors. State the error and the correction.
- What two properties must the retained list have to be a basis for the span of the original list?