Tutorials › Linear Algebra › Common Errors in Span and Column-Space Problems

Span and the Column Space View · Tutorial 160 of 1000

Common Errors in Span and Column-Space Problems

Learn how to set up span tests correctly, distinguish membership from spanning a whole space, and interpret row reduction without changing the original generators.

Beginner 9 min read

What You'll Learn

  • Set up a span-membership test by appending the target vector to the generator matrix.
  • Explain why one consistent target does not show that the columns span the whole space.
  • Test whether columns span \(\mathbb{R}^m\) by checking the standard basis vectors.
  • Distinguish the original columns from the columns of a row-reduced matrix.
  • Check span conclusions by substituting coefficients into the original matrix equation.

Three Questions That Must Not Be Confused

Span problems often begin with the same objects—a list of vectors and a matrix—but ask different questions. Is one particular vector generated by the list? Do the vectors generate every vector in the ambient space? Or what vectors are the columns of a row-reduced matrix generating? Confusing these questions can produce a plausible computation and an incorrect conclusion.

Throughout, scalars are real, and vectors in \(\mathbb{R}^m\) are columns. For vectors \(\mathbf{a}_1,\dots,\mathbf{a}_n\), their span is the set of all linear combinations \(x_1\mathbf{a}_1+\cdots+x_n\mathbf{a}_n\), where \(x_1,\dots,x_n\in\mathbb{R}\). If \(\mathbf{A}=[\mathbf{a}_1\ \cdots\ \mathbf{a}_n]\), its column space \(\operatorname{Col}\mathbf{A}\) is precisely the span of its columns. The product \(\mathbf{A}\mathbf{x}\) is the combination of those columns with coefficients from \(\mathbf{x}\).

Definition: A target \(\mathbf{b}\in\mathbb{R}^m\) belongs to \(\operatorname{Col}\mathbf{A}\) exactly when there is a coefficient vector \(\mathbf{x}\in\mathbb{R}^n\) such that \(\mathbf{A}\mathbf{x}=\mathbf{b}\). The columns of \(\mathbf{A}\) span \(\mathbb{R}^m\) exactly when every \(\mathbf{b}\in\mathbb{R}^m\) belongs to \(\operatorname{Col}\mathbf{A}\).

These definitions suggest two different tests. For one target, solve one system, \(\mathbf{A}\mathbf{x}=\mathbf{b}\). For a claim that the columns span the whole space, the claim concerns every possible target, not just one chosen vector.

Test the Target You Were Given

Theorem: For \(\mathbf{A}\in\mathbb{R}^{m\times n}\) and \(\mathbf{b}\in\mathbb{R}^m\), \(\mathbf{b}\in\operatorname{Col}\mathbf{A}\) if and only if the system \(\mathbf{A}\mathbf{x}=\mathbf{b}\) is consistent.

Proof. Suppose \(\mathbf{b}\in\operatorname{Col}\mathbf{A}\). By the definition of column space, \(\mathbf{b}\) is a linear combination of the columns \(\mathbf{a}_1,\dots,\mathbf{a}_n\). Thus there are scalars \(x_1,\dots,x_n\) such that \(\mathbf{b}=x_1\mathbf{a}_1+\cdots+x_n\mathbf{a}_n\). With \(\mathbf{x}=(x_1,\dots,x_n)^\top\), this equation is \(\mathbf{A}\mathbf{x}=\mathbf{b}\), so the system is consistent. Conversely, if the system is consistent, it has a solution \(\mathbf{x}\). The matrix product \(\mathbf{A}\mathbf{x}\) is a linear combination of the columns of \(\mathbf{A}\), and \(\mathbf{A}\mathbf{x}=\mathbf{b}\); therefore \(\mathbf{b}\in\operatorname{Col}\mathbf{A}\). \(\square\)

To test membership, place the target in the augmented column: row-reduce \([\mathbf{A}\mid\mathbf{b}]\) and check whether the resulting system is consistent. Row operations on an augmented matrix preserve its solution set, provided they are applied to the whole augmented matrix. Omitting \(\mathbf{b}\) removes the information that the membership question is about.

Worked Example: The Target Column Cannot Be Omitted

Decide whether \(\mathbf{b}=(1,0)^\top\) is in the span of \(\mathbf{a}_1=(1,1)^\top\) and \(\mathbf{a}_2=(2,2)^\top\).

Put the generators in the columns of \(\mathbf{A}\), and append the target:

$$ \left[\begin{array}{cc|c} 1&2&1\\ 1&2&0 \end{array}\right] \xrightarrow{R_2\to R_2-R_1} \left[\begin{array}{cc|c} 1&2&1\\ 0&0&-1 \end{array}\right]. $$

The last row says \(0x_1+0x_2=-1\), or \(0=-1\). The system is inconsistent, so the target is not in the span. Directly, the equations would require both \(x_1+2x_2=1\) and \(x_1+2x_2=0\), which cannot hold simultaneously.

Check: the two generators are multiples of \((1,1)^\top\), so every combination has equal coordinates. The target \((1,0)^\top\) does not, confirming the conclusion.

A wrong calculation would omit the target and reduce only \(\mathbf{A}\):

$$ \begin{bmatrix}1&2\\1&2\end{bmatrix} \xrightarrow{R_2\to R_2-R_1} \begin{bmatrix}1&2\\0&0\end{bmatrix}. $$

Seeing a pivot and concluding that the target is generated is an error: this reduction has not tested the target at all. The correction is to reduce the augmented matrix, where the contradiction appears.

One Successful Target Is Not a Whole-Space Test

If a system is consistent for one target, that establishes membership for that target only. To establish that columns span \(\mathbb{R}^m\), every target in \(\mathbb{R}^m\) must be obtainable. It is enough to check the standard basis vectors, because every vector in \(\mathbb{R}^m\) is a linear combination of them.

Theorem: Let \(\mathbf{A}\in\mathbb{R}^{m\times n}\). Its columns span \(\mathbb{R}^m\) if and only if each standard basis vector \(\mathbf{e}_1,\dots,\mathbf{e}_m\) belongs to \(\operatorname{Col}\mathbf{A}\).

Proof. If the columns span \(\mathbb{R}^m\), then every vector in \(\mathbb{R}^m\), including each \(\mathbf{e}_i\), belongs to their span. For the reverse direction, suppose each \(\mathbf{e}_i\) belongs to \(\operatorname{Col}\mathbf{A}\). Take any \(\mathbf{b}=(b_1,\dots,b_m)^\top\in\mathbb{R}^m\). By the definition of the standard basis, \(\mathbf{b}=b_1\mathbf{e}_1+\cdots+b_m\mathbf{e}_m\). Each \(\mathbf{e}_i\) is a combination of the columns of \(\mathbf{A}\); substituting those combinations into this expression shows that \(\mathbf{b}\) is also a combination of those columns. Since \(\mathbf{b}\) was arbitrary, the columns span \(\mathbb{R}^m\). \(\square\)

This criterion does not say that a single successful test suffices. It gives \(m\) particular membership tests that together certify all targets. Alternatively, a general row reduction can expose a row of zeros in the coefficient matrix, which can prevent some targets from being reached. The next example shows the distinction directly.

Worked Example: A Consistent System but Not a Spanning Set

Let \(\mathbf{A}=\begin{bmatrix}1&2\\0&0\end{bmatrix}\), with columns \((1,0)^\top\) and \((2,0)^\top\). The target \(\mathbf{b}=(5,0)^\top\) is reached by \(\mathbf{x}=(5,0)^\top\), since

$$ \mathbf{A}\mathbf{x} = \begin{bmatrix}1&2\\0&0\end{bmatrix} \begin{bmatrix}5\\0\end{bmatrix} = \begin{bmatrix}5\\0\end{bmatrix} =\mathbf{b}. $$

This verifies membership of this particular target, but does not verify that the columns span \(\mathbb{R}^2\). Test the standard basis vector \(\mathbf{e}_2=(0,1)^\top\):

$$ \left[\begin{array}{cc|c} 1&2&0\\ 0&0&1 \end{array}\right]. $$

The second row requires \(0=1\), so \(\mathbf{e}_2\notin\operatorname{Col}\mathbf{A}\). The columns therefore do not span \(\mathbb{R}^2\). In fact, \(\mathbf{A}(x_1,x_2)^\top=(x_1+2x_2,0)^\top\), so every generated vector has second coordinate \(0\).

Check: the coefficient choice \((5,0)^\top\) works for the stated target, while no coefficients can make the second coordinate of the product equal to \(1\). The two conclusions agree: one target is reached, but the whole space is not spanned.

Row-Reduced Columns Are Not the Original Generators

Row operations are useful for solving a system, but they change the entries of the matrix. In particular, the columns after row reduction are not automatically the original vectors whose span is being tested. When reducing \([\mathbf{A}\mid\mathbf{b}]\), the question is whether the transformed system has the same solutions as the original system. When someone instead reads the columns of the reduced coefficient matrix as new original generators, they have changed the question.

A row operation acts on every column of the matrix. So it can move the generators, and therefore change the set of vectors they generate. The following small example makes the distinction visible: the original column lies on a diagonal line, whereas its row-reduced version lies on a coordinate axis.

Worked Example: A Row Operation Changes the Column Span

Consider the single generator \(\mathbf{a}=(1,1)^\top\). Its span consists of vectors \((t,t)^\top\), where \(t\in\mathbb{R}\). The target \(\mathbf{b}=(1,0)^\top\) is not in that span. Indeed, the original membership system is

$$ \left[\begin{array}{c|c} 1&1\\ 1&0 \end{array}\right] \xrightarrow{R_2\to R_2-R_1} \left[\begin{array}{c|c} 1&1\\ 0&-1 \end{array}\right]. $$

The second row gives \(0x=-1\), so the system is inconsistent. The row operation correctly preserves that inconsistency because it was applied to the right-hand side as well as the coefficient column.

Now reduce the coefficient column alone:

$$ \begin{bmatrix}1\\1\end{bmatrix} \xrightarrow{R_2\to R_2-R_1} \begin{bmatrix}1\\0\end{bmatrix}. $$

The reduced column does generate \((1,0)^\top\), but it is not the original generator. Using it to answer the original question would give the wrong conclusion.

Check: if the original generator could produce \((1,0)^\top\), some scalar \(x\) would satisfy \(x(1,1)^\top=(1,0)^\top\). The first coordinate forces \(x=1\), while the second forces \(x=0\), a contradiction. The augmented reduction gives the same contradiction.

A Reliable Routine and Common Pitfalls

Before computing, identify whether the question concerns one target or all of the ambient space. Then keep the target visible throughout a membership calculation. A short routine helps prevent the three errors discussed above:

1
Write the generators as columns.
Form \(\mathbf{A}=[\mathbf{a}_1\ \cdots\ \mathbf{a}_n]\). Do not place them as rows when the question is about their span.
2
Keep the target in the system.
For a particular \(\mathbf{b}\), solve \(\mathbf{A}\mathbf{x}=\mathbf{b}\) by row-reducing \([\mathbf{A}\mid\mathbf{b}]\).
3
Match the conclusion to the tests.
Consistency proves membership of the chosen target. A claim of spanning \(\mathbb{R}^m\) requires that every target be reachable; checking \(\mathbf{e}_1,\dots,\mathbf{e}_m\) is sufficient.
4
Check with the original columns.
If coefficients are found, multiply the original \(\mathbf{A}\) by them. Do not substitute columns of a row-reduced matrix for the original generators.

Common mistake: “There is a pivot, so the target is in the span.” A pivot in the coefficient matrix alone says nothing about whether the particular right-hand side is compatible. In the first example, the coefficient matrix has a pivot, but the augmented row \(0=-1\) proves that the target is not generated. The correction is to include the target column and inspect the complete system.

Common mistake: “One target worked, so the columns span the space.” In the second example, \((5,0)^\top\) is generated, but \((0,1)^\top\) is not. The correction is to state the limited conclusion—membership of the tested target—or perform the whole-space test.

Common mistake: “The reduced matrix has these columns, so they are the generators.” In the third example, row reduction changes \((1,1)^\top\) into \((1,0)^\top\). The correction is to use row operations to solve the augmented system, while checking any proposed coefficients against the original matrix.

In short, keep three objects distinct: the original list of generators, the particular target, and the matrix produced during row reduction. The original columns define the span; the augmented system tests membership; and row reduction is a way to solve that system without changing its solution set.

Check Your Understanding

For each question, identify whether it asks for membership of one target or for spanning the whole space.

  1. What matrix should be row-reduced to test whether \((2,1)^\top\) is in the span of \((1,0)^\top\) and \((0,1)^\top\)?
  2. A system \(\mathbf{A}\mathbf{x}=\mathbf{b}\) is consistent for one \(\mathbf{b}\in\mathbb{R}^3\). What has been proved, and what has not?
  3. For a matrix with three rows, which three membership tests are sufficient to establish that its columns span \(\mathbb{R}^3\)?
  4. Why can the columns of a row-reduced coefficient matrix not automatically replace the original generators in a span problem?
  5. Suppose \(\mathbf{A}\mathbf{x}=\mathbf{b}\) has solution \(\mathbf{x}\). What multiplication checks the answer using the original generators?

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon