Tutorials › Linear Algebra › Proving Column-Space Membership Is Solvability

Span and the Column Space View · Tutorial 139 of 1000

Proving Column-Space Membership Is Solvability

Prove that a vector belongs to the column space of a matrix exactly when the corresponding matrix equation has a solution.

Beginner 9 min read

What You'll Learn

  • Define the column space of a matrix using its columns.
  • Match the coefficients in a column combination with the entries of a vector.
  • Prove both directions of the column-space membership criterion.
  • Check membership by verifying a solution or deriving a contradiction.
  • Distinguish a target vector from the coefficient vector used to build it.

From Column Combinations to Equations

A matrix equation \(\mathbf{A}\mathbf{x}=\mathbf{b}\) asks whether some combination of the columns of \(\mathbf{A}\) produces \(\mathbf{b}\). The equation is not a separate question from column-space membership: its unknown entries are precisely the coefficients in that combination. Making this connection explicit lets us move between a geometric description of a set of vectors and a solvability question about a system of equations.

Let \(\mathbf{A}\in\mathbb{R}^{m\times n}\), with columns \(\mathbf{a}_1,\dots,\mathbf{a}_n\in\mathbb{R}^m\). The column space consists of all linear combinations of those columns. The target vector \(\mathbf{b}\) must have \(m\) entries, while the coefficient vector \(\mathbf{x}\) must have \(n\) entries. These dimensions matter: \(\mathbf{A}\mathbf{x}\) is defined for \(\mathbf{x}\in\mathbb{R}^n\), and its result lies in \(\mathbb{R}^m\).

Definition: The column space of \(\mathbf{A}\), written \(\operatorname{Col}\mathbf{A}\), is the set of all linear combinations of its columns: \(\operatorname{Col}\mathbf{A}=\{c_1\mathbf{a}_1+\cdots+c_n\mathbf{a}_n:c_1,\dots,c_n\in\mathbb{R}\}\). The equation \(\mathbf{A}\mathbf{x}=\mathbf{b}\) is solvable if at least one vector \(\mathbf{x}\in\mathbb{R}^n\) satisfies it.

If \(\mathbf{x}=(x_1,\dots,x_n)^{\top}\), the column formula for matrix-vector multiplication gives \(\mathbf{A}\mathbf{x}=x_1\mathbf{a}_1+\cdots+x_n\mathbf{a}_n\). Thus, a proposed coefficient list \(c_1,\dots,c_n\) can be placed, in the same order, into \(\mathbf{x}\). Then the column combination and the matrix product are the same vector.

The Column-Space Membership Criterion

Theorem: Let \(\mathbf{A}\in\mathbb{R}^{m\times n}\) and \(\mathbf{b}\in\mathbb{R}^m\). Then \(\mathbf{b}\in\operatorname{Col}\mathbf{A}\) if and only if the equation \(\mathbf{A}\mathbf{x}=\mathbf{b}\) has a solution \(\mathbf{x}\in\mathbb{R}^n\).

Proof. First suppose \(\mathbf{b}\in\operatorname{Col}\mathbf{A}\). By the definition of column space, there are real numbers \(c_1,\dots,c_n\) such that \(\mathbf{b}=c_1\mathbf{a}_1+\cdots+c_n\mathbf{a}_n\). Define \(\mathbf{x}=(c_1,\dots,c_n)^{\top}\). By the column formula for matrix-vector multiplication, \(\mathbf{A}\mathbf{x}=c_1\mathbf{a}_1+\cdots+c_n\mathbf{a}_n=\mathbf{b}\), so the equation has a solution. Conversely, suppose \(\mathbf{A}\mathbf{x}=\mathbf{b}\) for some \(\mathbf{x}=(x_1,\dots,x_n)^{\top}\). The same formula gives \(\mathbf{b}=\mathbf{A}\mathbf{x}=x_1\mathbf{a}_1+\cdots+x_n\mathbf{a}_n\), which is a linear combination of the columns. Hence \(\mathbf{b}\in\operatorname{Col}\mathbf{A}\). Both implications hold, proving the equivalence. \(\square\)

The proof relies on matching coefficients in order. The coefficient of \(\mathbf{a}_1\) becomes the first entry of \(\mathbf{x}\), the coefficient of \(\mathbf{a}_2\) becomes its second entry, and so on. The entries of \(\mathbf{b}\), in contrast, are the coordinates of the resulting vector; they are not generally the coefficients used to form it.

Worked Example: A Target Produced by Two Columns

Let \(\mathbf{A}=\begin{bmatrix}1&0\\0&1\\1&1\end{bmatrix}\) and \(\mathbf{b}=\begin{bmatrix}2\\-1\\1\end{bmatrix}\). Decide whether \(\mathbf{b}\) belongs to \(\operatorname{Col}\mathbf{A}\), and find a solution if one exists.

The columns are \(\mathbf{a}_1=(1,0,1)^{\top}\) and \(\mathbf{a}_2=(0,1,1)^{\top}\). Matching the coefficients in \(c_1\mathbf{a}_1+c_2\mathbf{a}_2=\mathbf{b}\) with the entries of \(\mathbf{x}\) gives the system \(\mathbf{A}\mathbf{x}=\mathbf{b}\). Taking \(x_1=2\) and \(x_2=-1\) gives

$$ \mathbf{A}\mathbf{x} = \begin{bmatrix}1&0\\0&1\\1&1\end{bmatrix} \begin{bmatrix}2\\-1\end{bmatrix} = \begin{bmatrix} 1(2)+0(-1)\\ 0(2)+1(-1)\\ 1(2)+1(-1) \end{bmatrix} = \begin{bmatrix}2\\-1\\1\end{bmatrix} =\mathbf{b}. $$

Therefore \(\mathbf{b}\in\operatorname{Col}\mathbf{A}\). In column-combination form, the same calculation is \(2\mathbf{a}_1-\mathbf{a}_2=(2,-1,1)^{\top}\). Check: multiplying the proposed solution back gives exactly the target, so it verifies both solvability and membership.

When No Coefficients Can Produce the Target

The theorem also turns failure of membership into a statement about equations: if no coefficient vector can produce \(\mathbf{b}\), then \(\mathbf{A}\mathbf{x}=\mathbf{b}\) has no solution. A contradiction among the coordinate equations is enough to prove that no such coefficients exist.

Worked Example: A Target Outside the Column Space

Let \(\mathbf{A}=\begin{bmatrix}1&2\\2&4\end{bmatrix}\) and \(\mathbf{b}=\begin{bmatrix}3\\7\end{bmatrix}\). Determine whether \(\mathbf{b}\in\operatorname{Col}\mathbf{A}\).

Write \(\mathbf{x}=(x_1,x_2)^{\top}\). The equation \(\mathbf{A}\mathbf{x}=\mathbf{b}\) means \[ x_1+2x_2=3,\qquad 2x_1+4x_2=7. \] The left side of the second equation is twice the left side of the first. If the first equation holds, doubling it gives \(2x_1+4x_2=6\), not \(7\). The two equations therefore cannot both hold, so there is no solution.

By the criterion, \(\mathbf{b}\notin\operatorname{Col}\mathbf{A}\). To see the same obstruction as a column-combination question, the columns are \((1,2)^{\top}\) and \((2,4)^{\top}\). Any combination \(x_1(1,2)^{\top}+x_2(2,4)^{\top}\) has second coordinate twice its first, whereas \(\mathbf{b}\) has coordinates \(3\) and \(7\), and \(7\ne2(3)\). Check: the coordinate relation required of every column combination fails for \(\mathbf{b}\), agreeing with the inconsistent equations.

One Target Can Have More Than One Coefficient List

Membership asks whether at least one coefficient list exists. It does not, by itself, say that the list is unique. When columns can combine redundantly, different coefficient vectors can give the same target. The next example displays two solutions directly, so each can be checked by multiplication.

Worked Example: Two Solutions for the Same Target

Let \(\mathbf{A}=\begin{bmatrix}1&0&1\\0&1&1\end{bmatrix}\) and \(\mathbf{b}=\begin{bmatrix}4\\5\end{bmatrix}\). Find two coefficient vectors showing that \(\mathbf{b}\in\operatorname{Col}\mathbf{A}\).

First try \(\mathbf{x}=(4,5,0)^{\top}\). The product is \[ \mathbf{A}\mathbf{x} = \begin{bmatrix} 1(4)+0(5)+1(0)\\ 0(4)+1(5)+1(0) \end{bmatrix} = \begin{bmatrix}4\\5\end{bmatrix} =\mathbf{b}. \] Now take a different coefficient vector, \(\mathbf{x}=(3,4,1)^{\top}\). Then \[ \mathbf{A}\mathbf{x} = \begin{bmatrix} 1(3)+0(4)+1(1)\\ 0(3)+1(4)+1(1) \end{bmatrix} = \begin{bmatrix}4\\5\end{bmatrix} =\mathbf{b}. \] Thus both vectors solve the equation, and the target has two column-combination descriptions: \(4\mathbf{a}_1+5\mathbf{a}_2\) and \(3\mathbf{a}_1+4\mathbf{a}_2+\mathbf{a}_3\). Check: each proposed coefficient vector has three entries, matching the three columns, and each multiplication gives the target with two entries.

There is a simple general fact behind the canonical solutions obtained by choosing one coefficient to be \(1\) and the others \(0\).

Proposition: If \(\mathbf{A}\in\mathbb{R}^{m\times n}\), then every column \(\mathbf{a}_j\) of \(\mathbf{A}\) belongs to \(\operatorname{Col}\mathbf{A}\). In particular, \(\mathbf{A}\mathbf{e}_j=\mathbf{a}_j\) for each \(j\in\{1,\dots,n\}\), where \(\mathbf{e}_j\in\mathbb{R}^n\) has entry \(1\) in position \(j\) and \(0\) in every other position.

Proof. By the column formula, \(\mathbf{A}\mathbf{e}_j\) is the combination of the columns of \(\mathbf{A}\) whose coefficient on \(\mathbf{a}_j\) is \(1\) and whose other coefficients are \(0\). This combination equals \(\mathbf{a}_j\), so \(\mathbf{A}\mathbf{e}_j=\mathbf{a}_j\). The equation exhibits \(\mathbf{a}_j\) as a column combination, and therefore \(\mathbf{a}_j\in\operatorname{Col}\mathbf{A}\). \(\square\)

A Common Coefficient-Vector Mistake

Do not use the target’s coordinates as the column coefficients automatically. For example, take \(\mathbf{A}=\begin{bmatrix}1&1\\0&1\end{bmatrix}\) and \(\mathbf{b}=(3,2)^{\top}\). A mistaken calculation uses the entries of \(\mathbf{b}\) as the coefficient vector and claims \(\mathbf{A}(3,2)^{\top}=\mathbf{b}\). In fact,

$$ \begin{bmatrix}1&1\\0&1\end{bmatrix} \begin{bmatrix}3\\2\end{bmatrix} = \begin{bmatrix}1(3)+1(2)\\0(3)+1(2)\end{bmatrix} = \begin{bmatrix}5\\2\end{bmatrix} \ne \begin{bmatrix}3\\2\end{bmatrix}. $$

The corrected coefficient vector is \(\mathbf{x}=(1,2)^{\top}\), since \[ \begin{bmatrix}1&1\\0&1\end{bmatrix} \begin{bmatrix}1\\2\end{bmatrix} = \begin{bmatrix}1(1)+1(2)\\0(1)+1(2)\end{bmatrix} = \begin{bmatrix}3\\2\end{bmatrix} =\mathbf{b}. \] The entries of \(\mathbf{x}\) weight the columns; the entries of \(\mathbf{b}\) describe the resulting vector. They have different roles, even when both vectors happen to have the same number of entries.

Using the Equivalence

The criterion gives two equivalent ways to describe the same question. To show that a target belongs to the column space, provide coefficients and check the resulting combination, or provide a solution and check \(\mathbf{A}\mathbf{x}=\mathbf{b}\). To show that it does not belong, show that no coefficient list can work, often by finding incompatible coordinate equations. In every case, the number of coefficients is determined by the number of columns, while the number of coordinates in the target is determined by the number of rows.

The important scope of the conclusion is existence. A verified solution proves membership, but the theorem does not claim that the solution is unique. The example with two different coefficient vectors shows why that distinction matters: both vectors produce the same \(\mathbf{b}\), so the target is in the column space even though its representation is not unique.

Check Your Understanding

For each question, keep the target vector and the coefficient vector in their distinct roles, and verify any proposed solution by multiplication.

  1. State the number of entries in \(\mathbf{x}\) and in \(\mathbf{b}\) when \(\mathbf{A}\in\mathbb{R}^{4\times 3}\) and \(\mathbf{A}\mathbf{x}=\mathbf{b}\).
  2. For \(\mathbf{A}=\begin{bmatrix}1&0\\1&1\end{bmatrix}\), write \(\mathbf{A}\mathbf{x}=\mathbf{b}\) as a column combination.
  3. Does \(\mathbf{b}=(2,3)^{\top}\) belong to the column space of \(\begin{bmatrix}1&1\\0&1\end{bmatrix}\)? Find a solution or explain why none exists.
  4. Give a proof, using the definition of column space, that any solution of \(\mathbf{A}\mathbf{x}=\mathbf{b}\) implies \(\mathbf{b}\in\operatorname{Col}\mathbf{A}\).
  5. For an \(m\times n\) matrix, how many entries does a coefficient vector have, and what determines that number?

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon