From Column Combinations to Equations
A matrix equation \(\mathbf{A}\mathbf{x}=\mathbf{b}\) asks whether some combination of the columns of \(\mathbf{A}\) produces \(\mathbf{b}\). The equation is not a separate question from column-space membership: its unknown entries are precisely the coefficients in that combination. Making this connection explicit lets us move between a geometric description of a set of vectors and a solvability question about a system of equations.
Let \(\mathbf{A}\in\mathbb{R}^{m\times n}\), with columns \(\mathbf{a}_1,\dots,\mathbf{a}_n\in\mathbb{R}^m\). The column space consists of all linear combinations of those columns. The target vector \(\mathbf{b}\) must have \(m\) entries, while the coefficient vector \(\mathbf{x}\) must have \(n\) entries. These dimensions matter: \(\mathbf{A}\mathbf{x}\) is defined for \(\mathbf{x}\in\mathbb{R}^n\), and its result lies in \(\mathbb{R}^m\).
If \(\mathbf{x}=(x_1,\dots,x_n)^{\top}\), the column formula for matrix-vector multiplication gives \(\mathbf{A}\mathbf{x}=x_1\mathbf{a}_1+\cdots+x_n\mathbf{a}_n\). Thus, a proposed coefficient list \(c_1,\dots,c_n\) can be placed, in the same order, into \(\mathbf{x}\). Then the column combination and the matrix product are the same vector.
The Column-Space Membership Criterion
Proof. First suppose \(\mathbf{b}\in\operatorname{Col}\mathbf{A}\). By the definition of column space, there are real numbers \(c_1,\dots,c_n\) such that \(\mathbf{b}=c_1\mathbf{a}_1+\cdots+c_n\mathbf{a}_n\). Define \(\mathbf{x}=(c_1,\dots,c_n)^{\top}\). By the column formula for matrix-vector multiplication, \(\mathbf{A}\mathbf{x}=c_1\mathbf{a}_1+\cdots+c_n\mathbf{a}_n=\mathbf{b}\), so the equation has a solution. Conversely, suppose \(\mathbf{A}\mathbf{x}=\mathbf{b}\) for some \(\mathbf{x}=(x_1,\dots,x_n)^{\top}\). The same formula gives \(\mathbf{b}=\mathbf{A}\mathbf{x}=x_1\mathbf{a}_1+\cdots+x_n\mathbf{a}_n\), which is a linear combination of the columns. Hence \(\mathbf{b}\in\operatorname{Col}\mathbf{A}\). Both implications hold, proving the equivalence. \(\square\)
The proof relies on matching coefficients in order. The coefficient of \(\mathbf{a}_1\) becomes the first entry of \(\mathbf{x}\), the coefficient of \(\mathbf{a}_2\) becomes its second entry, and so on. The entries of \(\mathbf{b}\), in contrast, are the coordinates of the resulting vector; they are not generally the coefficients used to form it.
Worked Example: A Target Produced by Two Columns
Let \(\mathbf{A}=\begin{bmatrix}1&0\\0&1\\1&1\end{bmatrix}\) and \(\mathbf{b}=\begin{bmatrix}2\\-1\\1\end{bmatrix}\). Decide whether \(\mathbf{b}\) belongs to \(\operatorname{Col}\mathbf{A}\), and find a solution if one exists.
The columns are \(\mathbf{a}_1=(1,0,1)^{\top}\) and \(\mathbf{a}_2=(0,1,1)^{\top}\). Matching the coefficients in \(c_1\mathbf{a}_1+c_2\mathbf{a}_2=\mathbf{b}\) with the entries of \(\mathbf{x}\) gives the system \(\mathbf{A}\mathbf{x}=\mathbf{b}\). Taking \(x_1=2\) and \(x_2=-1\) gives
Therefore \(\mathbf{b}\in\operatorname{Col}\mathbf{A}\). In column-combination form, the same calculation is \(2\mathbf{a}_1-\mathbf{a}_2=(2,-1,1)^{\top}\). Check: multiplying the proposed solution back gives exactly the target, so it verifies both solvability and membership.
When No Coefficients Can Produce the Target
The theorem also turns failure of membership into a statement about equations: if no coefficient vector can produce \(\mathbf{b}\), then \(\mathbf{A}\mathbf{x}=\mathbf{b}\) has no solution. A contradiction among the coordinate equations is enough to prove that no such coefficients exist.
Worked Example: A Target Outside the Column Space
Let \(\mathbf{A}=\begin{bmatrix}1&2\\2&4\end{bmatrix}\) and \(\mathbf{b}=\begin{bmatrix}3\\7\end{bmatrix}\). Determine whether \(\mathbf{b}\in\operatorname{Col}\mathbf{A}\).
Write \(\mathbf{x}=(x_1,x_2)^{\top}\). The equation \(\mathbf{A}\mathbf{x}=\mathbf{b}\) means \[ x_1+2x_2=3,\qquad 2x_1+4x_2=7. \] The left side of the second equation is twice the left side of the first. If the first equation holds, doubling it gives \(2x_1+4x_2=6\), not \(7\). The two equations therefore cannot both hold, so there is no solution.
By the criterion, \(\mathbf{b}\notin\operatorname{Col}\mathbf{A}\). To see the same obstruction as a column-combination question, the columns are \((1,2)^{\top}\) and \((2,4)^{\top}\). Any combination \(x_1(1,2)^{\top}+x_2(2,4)^{\top}\) has second coordinate twice its first, whereas \(\mathbf{b}\) has coordinates \(3\) and \(7\), and \(7\ne2(3)\). Check: the coordinate relation required of every column combination fails for \(\mathbf{b}\), agreeing with the inconsistent equations.
One Target Can Have More Than One Coefficient List
Membership asks whether at least one coefficient list exists. It does not, by itself, say that the list is unique. When columns can combine redundantly, different coefficient vectors can give the same target. The next example displays two solutions directly, so each can be checked by multiplication.
Worked Example: Two Solutions for the Same Target
Let \(\mathbf{A}=\begin{bmatrix}1&0&1\\0&1&1\end{bmatrix}\) and \(\mathbf{b}=\begin{bmatrix}4\\5\end{bmatrix}\). Find two coefficient vectors showing that \(\mathbf{b}\in\operatorname{Col}\mathbf{A}\).
First try \(\mathbf{x}=(4,5,0)^{\top}\). The product is \[ \mathbf{A}\mathbf{x} = \begin{bmatrix} 1(4)+0(5)+1(0)\\ 0(4)+1(5)+1(0) \end{bmatrix} = \begin{bmatrix}4\\5\end{bmatrix} =\mathbf{b}. \] Now take a different coefficient vector, \(\mathbf{x}=(3,4,1)^{\top}\). Then \[ \mathbf{A}\mathbf{x} = \begin{bmatrix} 1(3)+0(4)+1(1)\\ 0(3)+1(4)+1(1) \end{bmatrix} = \begin{bmatrix}4\\5\end{bmatrix} =\mathbf{b}. \] Thus both vectors solve the equation, and the target has two column-combination descriptions: \(4\mathbf{a}_1+5\mathbf{a}_2\) and \(3\mathbf{a}_1+4\mathbf{a}_2+\mathbf{a}_3\). Check: each proposed coefficient vector has three entries, matching the three columns, and each multiplication gives the target with two entries.
There is a simple general fact behind the canonical solutions obtained by choosing one coefficient to be \(1\) and the others \(0\).
Proof. By the column formula, \(\mathbf{A}\mathbf{e}_j\) is the combination of the columns of \(\mathbf{A}\) whose coefficient on \(\mathbf{a}_j\) is \(1\) and whose other coefficients are \(0\). This combination equals \(\mathbf{a}_j\), so \(\mathbf{A}\mathbf{e}_j=\mathbf{a}_j\). The equation exhibits \(\mathbf{a}_j\) as a column combination, and therefore \(\mathbf{a}_j\in\operatorname{Col}\mathbf{A}\). \(\square\)
A Common Coefficient-Vector Mistake
Do not use the target’s coordinates as the column coefficients automatically. For example, take \(\mathbf{A}=\begin{bmatrix}1&1\\0&1\end{bmatrix}\) and \(\mathbf{b}=(3,2)^{\top}\). A mistaken calculation uses the entries of \(\mathbf{b}\) as the coefficient vector and claims \(\mathbf{A}(3,2)^{\top}=\mathbf{b}\). In fact,
The corrected coefficient vector is \(\mathbf{x}=(1,2)^{\top}\), since \[ \begin{bmatrix}1&1\\0&1\end{bmatrix} \begin{bmatrix}1\\2\end{bmatrix} = \begin{bmatrix}1(1)+1(2)\\0(1)+1(2)\end{bmatrix} = \begin{bmatrix}3\\2\end{bmatrix} =\mathbf{b}. \] The entries of \(\mathbf{x}\) weight the columns; the entries of \(\mathbf{b}\) describe the resulting vector. They have different roles, even when both vectors happen to have the same number of entries.
Using the Equivalence
The criterion gives two equivalent ways to describe the same question. To show that a target belongs to the column space, provide coefficients and check the resulting combination, or provide a solution and check \(\mathbf{A}\mathbf{x}=\mathbf{b}\). To show that it does not belong, show that no coefficient list can work, often by finding incompatible coordinate equations. In every case, the number of coefficients is determined by the number of columns, while the number of coordinates in the target is determined by the number of rows.
The important scope of the conclusion is existence. A verified solution proves membership, but the theorem does not claim that the solution is unique. The example with two different coefficient vectors shows why that distinction matters: both vectors produce the same \(\mathbf{b}\), so the target is in the column space even though its representation is not unique.
Check Your Understanding
For each question, keep the target vector and the coefficient vector in their distinct roles, and verify any proposed solution by multiplication.
- State the number of entries in \(\mathbf{x}\) and in \(\mathbf{b}\) when \(\mathbf{A}\in\mathbb{R}^{4\times 3}\) and \(\mathbf{A}\mathbf{x}=\mathbf{b}\).
- For \(\mathbf{A}=\begin{bmatrix}1&0\\1&1\end{bmatrix}\), write \(\mathbf{A}\mathbf{x}=\mathbf{b}\) as a column combination.
- Does \(\mathbf{b}=(2,3)^{\top}\) belong to the column space of \(\begin{bmatrix}1&1\\0&1\end{bmatrix}\)? Find a solution or explain why none exists.
- Give a proof, using the definition of column space, that any solution of \(\mathbf{A}\mathbf{x}=\mathbf{b}\) implies \(\mathbf{b}\in\operatorname{Col}\mathbf{A}\).
- For an \(m\times n\) matrix, how many entries does a coefficient vector have, and what determines that number?