Tutorials › Linear Algebra › An Infinite-Solution Reduction Workshop

Row Reduction and Echelon Forms · Tutorial 43 of 1000

An Infinite-Solution Reduction Workshop

You will reduce consistent systems with multiple free variables and express their complete solution sets using independent parameters.

Beginner 9 min read

What You'll Learn

  • Identify pivot and free variables in a reduced augmented matrix.
  • Assign a separate real parameter to each free variable.
  • Solve for pivot variables in terms of those parameters.
  • Write a complete solution set in parametric form.
  • Verify a parametrized solution in the original equations.
  • Recognize how a sign error or tied parameters can omit valid solutions.

From a Reduced System to a Family of Solutions

When a consistent system has free variables, a single answer cannot describe all its solutions. Instead, we describe a family: each free variable can be chosen, and the pivot variables are then determined by those choices. If there are multiple free variables, each needs its own independent parameter. This workshop focuses on carrying out that process carefully, from row reduction through a check in the original equations.

Throughout, the variables and parameters are real. An augmented matrix records the coefficients of a linear system together with its right-hand-side column. Row operations on an augmented matrix correspond to swapping equations, multiplying an equation by a nonzero number, or adding a multiple of one equation to another.

Definition: A system is consistent if it has at least one solution. In a row-reduced system, a pivot variable is a variable whose column contains a pivot, and a free variable is a variable whose column does not. A parametric description of the solution set assigns a real parameter to each free variable and gives the pivot variables in terms of those parameters.

The reason row reduction is valid here is that each elementary row operation preserves the system's solutions. This lets us solve a simpler equivalent system instead of repeatedly manipulating the original equations.

Proof. Swapping two rows only changes the order of the equations, so it does not change which variable values satisfy them. Multiplying a row by a nonzero scalar preserves its equation because an equation \(L=b\) is equivalent to \(cL=cb\) when \(c\ne0\). Replacing one row by itself plus a multiple of another also preserves the solutions: any solution of the original equations satisfies the new equation, and the original row can be recovered by subtracting that same multiple. Thus each elementary row operation preserves the solution set, and any sequence of such operations does too. \(\square\)

A General Parametrization Rule

Suppose a consistent augmented matrix has been reduced to reduced row echelon form (RREF). Assume it has \(n\) variable columns, with pivot columns \(p_1,\dots,p_r\). The remaining column indices are the free-variable indices. Because the system is consistent, there is no row of the form \([0\ \cdots\ 0\mid b]\) with \(b\ne0\). Each nonzero row therefore gives an equation for one pivot variable.

Theorem: In a consistent system in RREF, assign a separate arbitrary real parameter to each free variable. The pivot equations then determine exactly one value for each pivot variable. As the parameters vary independently over \(\mathbb{R}\), the resulting assignments give every solution, and each solution is obtained from exactly one parameter choice. In particular, if there is at least one free variable, the system has infinitely many distinct solutions.

Proof. In each nonzero row \(i\), let \(x_{p_i}\) be its pivot variable. The RREF conditions say that its coefficient is \(1\), and that every other pivot column has coefficient \(0\). Thus the equation in that row has the form \(x_{p_i}+\sum_{j\text{ free}}a_{ij}x_j=b_i\). Assign a real number \(t_j\) to each free variable \(x_j\). The equation forces \(x_{p_i}=b_i-\sum_{j\text{ free}}a_{ij}t_j\), so it determines one value for this pivot variable. Doing this for every nonzero row produces a solution: every pivot equation holds by construction, every free variable has its assigned value, and any zero row is \(0=0\) because the system is consistent. Conversely, any solution must satisfy each pivot equation, so its pivot variables must equal these same expressions in its free-variable values. It is therefore obtained by assigning its actual free-variable values as the parameters. Those parameter values are unique because each parameter equals its corresponding free variable. Finally, if there is a free variable, changing its real parameter while holding the others fixed changes that coordinate of the solution, giving infinitely many distinct solutions. \(\square\)

In practice, the rule is simple: read the free columns first, name their variables with different parameters, and then substitute those expressions into the pivot equations. The signs matter. A final substitution into the original equations checks both the reduction and the parametrization.

Worked Examples

Worked Example: Two Free Variables in a Four-Variable System

Reduce the system represented by the augmented matrix below and describe all its solutions. The equations are \(x_1+2x_2-x_3+x_4=4\), \(2x_1+4x_2+x_3=7\), and \(0=0\).

$$ \begin{bmatrix} 1&2&-1&1&4\\ 2&4&1&0&7\\ 0&0&0&0&0 \end{bmatrix} \xrightarrow{R_2\to R_2-2R_1} \begin{bmatrix} 1&2&-1&1&4\\ 0&0&3&-2&-1\\ 0&0&0&0&0 \end{bmatrix}. $$

Scale the second row by \(\frac13\). Then add the new second row to the first row to clear the entry above its pivot:

$$ \begin{bmatrix} 1&2&-1&1&4\\ 0&0&3&-2&-1\\ 0&0&0&0&0 \end{bmatrix} \xrightarrow{R_2\to\frac13R_2} \begin{bmatrix} 1&2&-1&1&4\\ 0&0&1&-\frac23&-\frac13\\ 0&0&0&0&0 \end{bmatrix} \xrightarrow{R_1\to R_1+R_2} \begin{bmatrix} 1&2&0&\frac13&\frac{11}{3}\\ 0&0&1&-\frac23&-\frac13\\ 0&0&0&0&0 \end{bmatrix}. $$

The pivot variables are \(x_1\) and \(x_3\); \(x_2\) and \(x_4\) are free. Set \(x_2=s\) and \(x_4=t\), where \(s,t\in\mathbb{R}\) vary independently. The reduced equations give \(x_1+2s+\frac13t=\frac{11}{3}\) and \(x_3-\frac23t=-\frac13\). Hence

$$ x_1=\frac{11}{3}-2s-\frac13t,\qquad x_2=s,\qquad x_3=-\frac13+\frac23t,\qquad x_4=t. $$

Check in the original equations: the left side of the first equation is \(\frac{11}{3}-2s-\frac13t+2s-(-\frac13+\frac23t)+t=4\). The left side of the second is \(2(\frac{11}{3}-2s-\frac13t)+4s+(-\frac13+\frac23t)=7\). The third equation is \(0=0\). Thus every parameter choice gives a solution.

Worked Example: Free Variables Before and Between Pivot Variables

Reduce this system and give its entire solution set:

$$ \begin{bmatrix} 0&2&4&0&6\\ 0&0&0&3&-3\\ 0&2&4&3&3 \end{bmatrix}. $$

Scale the first row by \(\frac12\), scale the second by \(\frac13\), subtract twice the new first row from the third, and then subtract three times the second row from the third:

$$ \begin{bmatrix} 0&2&4&0&6\\ 0&0&0&3&-3\\ 0&2&4&3&3 \end{bmatrix} \xrightarrow{R_1\to\frac12R_1,\ R_2\to\frac13R_2} \begin{bmatrix} 0&1&2&0&3\\ 0&0&0&1&-1\\ 0&2&4&3&3 \end{bmatrix} $$
$$ \xrightarrow{R_3\to R_3-2R_1} \begin{bmatrix} 0&1&2&0&3\\ 0&0&0&1&-1\\ 0&0&0&3&-3 \end{bmatrix} \xrightarrow{R_3\to R_3-3R_2} \begin{bmatrix} 0&1&2&0&3\\ 0&0&0&1&-1\\ 0&0&0&0&0 \end{bmatrix}. $$

The pivot variables are \(x_2\) and \(x_4\), so \(x_1\) and \(x_3\) are free. Set \(x_1=s\) and \(x_3=t\). The pivot equations give \(x_2+2t=3\) and \(x_4=-1\). Therefore

$$ x_1=s,\qquad x_2=3-2t,\qquad x_3=t,\qquad x_4=-1, \qquad s,t\in\mathbb{R}. $$

Check in the original equations: the first left side is \(2(3-2t)+4t=6\); the second is \(3(-1)=-3\); and the third is \(2(3-2t)+4t+3(-1)=3\). Each equals its right side for every \(s,t\).

Worked Example: Choosing Parameters for Nonconsecutive Free Variables

Find all solutions of the system with augmented matrix shown below:

$$ \begin{bmatrix} 0&1&0&1&1\\ 0&2&2&-2&4 \end{bmatrix}. $$

Subtract twice the first row from the second, then divide the second row by \(2\):

$$ \begin{bmatrix} 0&1&0&1&1\\ 0&2&2&-2&4 \end{bmatrix} \xrightarrow{R_2\to R_2-2R_1} \begin{bmatrix} 0&1&0&1&1\\ 0&0&2&-4&2 \end{bmatrix} \xrightarrow{R_2\to\frac12R_2} \begin{bmatrix} 0&1&0&1&1\\ 0&0&1&-2&1 \end{bmatrix}. $$

The pivot variables are \(x_2,x_3\). The free variables are \(x_1,x_4\), so set \(x_1=s\) and \(x_4=t\). From the second row, \(x_3-2t=1\), giving \(x_3=1+2t\). The first row gives \(x_2+t=1\), so \(x_2=1-t\). Thus the complete solution set is

$$ x_1=s,\qquad x_2=1-t,\qquad x_3=1+2t,\qquad x_4=t, \qquad s,t\in\mathbb{R}. $$

Check in the original equations: the first left side is \((1-t)+t=1\). The second is \(2(1-t)+2(1+2t)-2t=4\). Both original equations hold for every parameter choice.

Reading and Checking a Parametric Answer

A parametric answer is complete only if it includes every free variable and all pivot variables are correctly expressed in terms of them. The parameters do not need to appear in every pivot equation: in the second example, changing \(s\) changes \(x_1\), while the pivot variables do not depend on \(s\). That is still a genuine free choice.

A useful check has two parts. First, substitute the parameter expressions into the reduced equations; this confirms the algebra used to solve for the pivot variables. Then substitute into the original equations, as in the examples. Since the row operations preserve the solution set, a correct solution of the reduced system is a solution of the original one. The direct substitution is also a practical way to catch arithmetic mistakes.

1
Reduce the augmented matrix.
Use elementary row operations until the pivot equations are easy to read.
2
List the free variables.
Every variable column without a pivot needs a parameter.
3
Solve the pivot equations.
Substitute the parameter expressions into each pivot row, keeping track of signs.
4
Verify the result.
Substitute the expressions into the original equations and check each right-hand side.

Common Pitfall: Tying Parameters Together

In the first example, both \(x_2\) and \(x_4\) are free. A tempting but incorrect shortcut is to set \(x_2=t\) and \(x_4=t\), using the same parameter for both. This only describes the special choices where those two coordinates happen to be equal. For instance, \(x_2=1\) and \(x_4=0\) are allowed choices in the first example, but they cannot be represented by the tied assignment.

The correction is to use separate parameters: \(x_2=s\) and \(x_4=t\). They can take any real values independently. Another frequent error is to lose a sign while isolating a pivot variable. In the first example, \(x_1+2s+\frac13t=\frac{11}{3}\) gives \(x_1=\frac{11}{3}-2s-\frac13t\), not \(\frac{11}{3}+2s+\frac13t\). Substituting that incorrect expression into the left side gives \(\frac{11}{3}+4s+\frac23t\), which does not equal \(\frac{11}{3}\) for arbitrary \(s,t\). Solving and then substituting back is a reliable way to catch this mistake.

Check Your Understanding

For each question, use separate parameters for separate free variables and check the resulting expressions in the system.

  1. If a consistent RREF system has four variables and pivots in columns 1 and 3, which variables are free?
  2. For the equations \(x_1+x_2-x_3=2\) and \(x_2+2x_3=1\), assign parameters to the free variables and write all solutions.
  3. Why must each free variable receive its own parameter when describing the full solution set?
  4. For the system with equations \(x_2+2x_3=5\) and \(x_4=-2\), write a parametrization of all solutions in \(\mathbb{R}^4\).
  5. Explain why substituting a parametrization into the original equations verifies that its members are solutions, but does not by itself show that every solution is included.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon