Tutorials › Linear Algebra › Reducing Systems With Several Right-Hand Sides

Row Reduction and Echelon Forms · Tutorial 47 of 1000

Reducing Systems With Several Right-Hand Sides

Use one shared row reduction to solve several systems with the same coefficient matrix and identify any inconsistent right-hand sides.

Beginner 9 min read

What You'll Learn

  • Arrange several right-hand sides as columns beside one coefficient matrix.
  • Apply each row operation to every column in the augmented matrix.
  • Read consistency from rows with zero coefficients and nonzero right-hand entries.
  • Extract and check solutions for each right-hand-side column.
  • Avoid changing only some of the right-hand sides during a reduction.

One Reduction for Several Systems

Suppose several linear systems have the same coefficients but different right-hand sides. Reducing each system separately repeats the same work on the coefficient matrix. Instead, place all the right-hand sides beside that matrix and perform one shared row reduction. Each row operation must be applied across the entire matrix, including every right-hand-side column. The resulting columns then show which systems are consistent and, when they are, what their solutions are.

Throughout, scalars are in \(\mathbb{R}\). Let \(\mathbf{A}\in\mathbb{R}^{m\times n}\) be a coefficient matrix and let \(\mathbf{b}_1,\dots,\mathbf{b}_q\in\mathbb{R}^m\) be right-hand-side columns. The \(j\)th system is \(\mathbf{A}\mathbf{x}=\mathbf{b}_j\). We collect the right-hand sides into \(\mathbf{B}=\begin{bmatrix}\mathbf{b}_1&\cdots&\mathbf{b}_q\end{bmatrix}\), and write the combined augmented matrix as \(\begin{bmatrix}\mathbf{A}&\vert&\mathbf{B}\end{bmatrix}\). A system is consistent if it has at least one solution; otherwise it is inconsistent.

Definition: In a combined augmented matrix \(\begin{bmatrix}\mathbf{A}&\vert&\mathbf{B}\end{bmatrix}\), each column of \(\mathbf{B}\) represents a separate system with the same coefficient matrix \(\mathbf{A}\). A row operation on the combined matrix acts on every entry in that row, including all right-hand-side columns.

The shared reduction does not combine the unknown vectors of the different systems. Each right-hand-side column is still read separately: the entries in that column determine the corresponding system’s equations after reduction. What is shared is the sequence of row operations, not the solution or the consistency outcome.

Why the Shared Reduction Works

A row operation is reversible: a row swap undoes itself, scaling a row by a nonzero scalar is undone by scaling by its reciprocal, and adding a multiple of one row to another is undone by subtracting that multiple. Therefore, applying one row operation to an augmented matrix preserves the solution set of each represented system, provided it acts on the coefficient entries and on that system’s right-hand-side entry in the same row. Repeating this reasoning shows that a complete row-reduction sequence preserves every system’s solution set.

Theorem (Consistency test for several right-hand sides): Row-reduce \(\begin{bmatrix}\mathbf{A}&\vert&\mathbf{B}\end{bmatrix}\) using the same row operations across the entire matrix. For any particular right-hand-side column, its system is consistent if and only if there is no row in which all entries in the coefficient part are zero but the entry in that right-hand-side column is nonzero.

Proof. Fix one right-hand-side column and consider the corresponding system. Since each row operation is reversible and is applied to the coefficient entries and this right-hand-side column together, the original system and its reduced system have exactly the same solutions. In the reduced system, a row with all zero coefficients and a nonzero right-hand entry asserts \(0=c\) for some \(c\ne0\), which no vector can satisfy. Thus the system is inconsistent if such a row occurs. Conversely, suppose no such row occurs. In echelon form, any row with no nonzero coefficient has right-hand entry zero, so it imposes only \(0=0\). Assign zero to each free variable. Starting at the last pivot row and proceeding upward, choose the pivot variable to satisfy that row; each choice is possible because its pivot coefficient is nonzero and the variables to its right have already been assigned. This constructs a solution. Therefore the system is consistent. The argument applies separately to each right-hand-side column, proving the test for all columns. \(\square\)

This criterion makes the final consistency check column-specific. A row may contain zero coefficients and a nonzero entry in one right-hand-side column, but zero in another. The first system is inconsistent, while that row causes no contradiction for the second. A single reduction can therefore reveal different outcomes among systems that share the same coefficients.

Reading Several Outcomes from One Reduction

Worked Example: Two Consistent Systems and One Inconsistent System

Use one reduction to classify the systems with coefficient matrix \(\mathbf{A}=\begin{bmatrix}1&1\\2&2\\1&-1\end{bmatrix}\) and right-hand sides \(\mathbf{b}_1=\begin{bmatrix}3\\6\\2\end{bmatrix}\), \(\mathbf{b}_2=\begin{bmatrix}1\\2\\0\end{bmatrix}\), and \(\mathbf{b}_3=\begin{bmatrix}1\\3\\1\end{bmatrix}\).

Place the three right-hand sides together. First apply \(R_2\to R_2-2R_1\) and \(R_3\to R_3-R_1\):

$$ \begin{bmatrix} 1&1&\vert&3&1&1\\ 2&2&\vert&6&2&3\\ 1&-1&\vert&2&0&1 \end{bmatrix} \sim \begin{bmatrix} 1&1&\vert&3&1&1\\ 0&0&\vert&0&0&1\\ 0&-2&\vert&-1&-1&0 \end{bmatrix}. $$

Swap rows 2 and 3, scale the new row 2 by \(-\tfrac12\), and then apply \(R_1\to R_1-R_2\):

$$ \begin{bmatrix} 1&1&\vert&3&1&1\\ 0&0&\vert&0&0&1\\ 0&-2&\vert&-1&-1&0 \end{bmatrix} \sim \begin{bmatrix} 1&1&\vert&3&1&1\\ 0&-2&\vert&-1&-1&0\\ 0&0&\vert&0&0&1 \end{bmatrix} \sim \begin{bmatrix} 1&1&\vert&3&1&1\\ 0&1&\vert&\tfrac12&\tfrac12&0\\ 0&0&\vert&0&0&1 \end{bmatrix} \sim \begin{bmatrix} 1&0&\vert&\tfrac52&\tfrac12&1\\ 0&1&\vert&\tfrac12&\tfrac12&0\\ 0&0&\vert&0&0&1 \end{bmatrix}. $$

The last row has zero coefficients. Its right-hand entries are \(0,0,1\), respectively. The first two systems are consistent, and the third is inconsistent. For the first system the reduced equations give \(\mathbf{x}=\begin{bmatrix}\tfrac52\\\tfrac12\end{bmatrix}\); for the second they give \(\mathbf{x}=\begin{bmatrix}\tfrac12\\\tfrac12\end{bmatrix}\).

Check. For the first system, \(\mathbf{A}\begin{bmatrix}\tfrac52\\\tfrac12\end{bmatrix} =\begin{bmatrix}3\\6\\2\end{bmatrix}\), since the rows give \(\tfrac52+\tfrac12=3\), \(2(\tfrac52)+2(\tfrac12)=6\), and \(\tfrac52-\tfrac12=2\). For the second, \(\mathbf{A}\begin{bmatrix}\tfrac12\\\tfrac12\end{bmatrix} =\begin{bmatrix}1\\2\\0\end{bmatrix}\), since the row products are \(1,2,0\). The third system’s reduced last row asserts \(0=1\), confirming inconsistency.

The example illustrates the main efficiency: the coefficient part is reduced only once, but the right-hand-side columns retain their distinct information. In particular, do not decide that every system is inconsistent just because one column produces a contradiction. Check each right-hand-side entry in every zero-coefficient row.

Consistent Systems Can Have Free Variables

The consistency test tells whether solutions exist; it does not by itself say whether a solution is unique. If a reduced system has free variables, a consistent right-hand side can give infinitely many solutions. The same coefficient pattern is used for every right-hand side, while the constants in the pivot equations change from column to column.

Worked Example: Two Consistent Systems with Free Variables

Consider \(\mathbf{A}=\begin{bmatrix}1&2&1\\2&4&2\end{bmatrix}\) and two right-hand sides \(\mathbf{b}_1=\begin{bmatrix}3\\6\end{bmatrix}\) and \(\mathbf{b}_2=\begin{bmatrix}2\\4\end{bmatrix}\). Reduce the combined augmented matrix using \(R_2\to R_2-2R_1\):

$$ \begin{bmatrix} 1&2&1&\vert&3&2\\ 2&4&2&\vert&6&4 \end{bmatrix} \sim \begin{bmatrix} 1&2&1&\vert&3&2\\ 0&0&0&\vert&0&0 \end{bmatrix}. $$

Neither right-hand-side column has a nonzero entry in the zero-coefficient row, so both systems are consistent. In each, \(x_2\) and \(x_3\) are free. Write \(x_2=s\) and \(x_3=t\). For the first right-hand side, the equation \(x_1+2x_2+x_3=3\) gives \(x_1=3-2s-t\). For the second, \(x_1+2x_2+x_3=2\) gives \(x_1=2-2s-t\). Thus their solution sets are

$$ \mathbf{x}_1= \begin{bmatrix}3-2s-t\\s\\t\end{bmatrix}, \qquad \mathbf{x}_2= \begin{bmatrix}2-2s-t\\s\\t\end{bmatrix}, \qquad s,t\in\mathbb{R}. $$

Check. For \(\mathbf{x}_1\), the first row product is \((3-2s-t)+2s+t=3\), and the second row product is \(2(3-2s-t)+4s+2t=6\). For \(\mathbf{x}_2\), the row products are \((2-2s-t)+2s+t=2\) and \(2(2-2s-t)+4s+2t=4\). Each parameter choice therefore satisfies its original system.

A Second Shared Reduction

Worked Example: Extracting Two Unique Solutions

Let \(\mathbf{A}=\begin{bmatrix}1&1\\2&3\end{bmatrix}\), with right-hand sides \(\mathbf{b}_1=\begin{bmatrix}1\\3\end{bmatrix}\) and \(\mathbf{b}_2=\begin{bmatrix}2\\5\end{bmatrix}\). Apply \(R_2\to R_2-2R_1\), followed by \(R_1\to R_1-R_2\):

$$ \begin{bmatrix} 1&1&\vert&1&2\\ 2&3&\vert&3&5 \end{bmatrix} \sim \begin{bmatrix} 1&1&\vert&1&2\\ 0&1&\vert&1&1 \end{bmatrix} \sim \begin{bmatrix} 1&0&\vert&0&1\\ 0&1&\vert&1&1 \end{bmatrix}. $$

Reading down each right-hand-side column gives the unique solutions \(\mathbf{x}_1=\begin{bmatrix}0\\1\end{bmatrix}\) and \(\mathbf{x}_2=\begin{bmatrix}1\\1\end{bmatrix}\).

Check. Multiplication gives \(\mathbf{A}\begin{bmatrix}0\\1\end{bmatrix}=\begin{bmatrix}1\\3\end{bmatrix}\), and \(\mathbf{A}\begin{bmatrix}1\\1\end{bmatrix}=\begin{bmatrix}2\\5\end{bmatrix}\), as required.

Common Pitfall: Updating Only Some Columns

A row operation on a combined augmented matrix must be performed on every right-hand-side column. For the matrix in the preceding example, after \(R_2\to R_2-2R_1\), the second right-hand-side entry must become \(5-2(2)=1\). If it is mistakenly left as \(5\), the incorrect intermediate matrix has second right-hand-side column \(\begin{bmatrix}2\\5\end{bmatrix}\) beside the reduced coefficient matrix \(\begin{bmatrix}1&1\\0&1\end{bmatrix}\). Reading it gives \(x_2=5\), \(x_1=-3\). But substitution into the original system gives \(\mathbf{A}\begin{bmatrix}-3\\5\end{bmatrix}=\begin{bmatrix}2\\9\end{bmatrix}\), not \(\begin{bmatrix}2\\5\end{bmatrix}\).

The correction is to apply the operation to the entire row: \(5-2(2)=1\). The next operation \(R_1\to R_1-R_2\) then gives the correct solution \(\begin{bmatrix}1\\1\end{bmatrix}\) for the second system. A quick check by multiplying each proposed solution by the original coefficient matrix is a reliable way to catch a missed update.

A Reliable Procedure

1
Assemble the columns.
Write the coefficient matrix once, followed by every right-hand-side column in the combined augmented matrix.
2
Reduce across the full width.
For each row operation, update all coefficient and right-hand-side entries in the affected row.
3
Test each column separately.
In every row whose coefficient entries are all zero, inspect each right-hand-side entry. A nonzero entry marks that column’s system inconsistent.
4
Read and verify solutions.
For a consistent column, solve the reduced equations, retaining any free variables, then substitute the result into the original system.

This procedure separates two questions that are easy to conflate: whether a system has a solution, and what its solution set is. The zero-coefficient rows answer the first question for each right-hand side. The pivot and free variables in the reduced equations answer the second. Because the reduction is shared, the coefficient structure is exposed once, while every column still receives its own consistency decision and solution check.

Check Your Understanding

For each question, keep track of all right-hand-side columns during the row operations.

  1. What does a row with zero coefficient entries and a nonzero entry in only one right-hand-side column imply?
  2. Reduce the combined augmented matrix with coefficient matrix \(\begin{bmatrix}1&1\\2&2\end{bmatrix}\) and right-hand sides \(\begin{bmatrix}1&1\\2&3\end{bmatrix}\). Which system is consistent?
  3. For \(\mathbf{A}=\begin{bmatrix}1&2&1\\2&4&2\end{bmatrix}\), describe the free variables in a consistent system with right-hand side \(\begin{bmatrix}3\\6\end{bmatrix}\).
  4. Why must an operation such as \(R_2\to R_2-2R_1\) update every right-hand-side entry in row 2?
  5. After finding a proposed solution for one column, how can multiplication by the original coefficient matrix check it?

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon