Tutorials › Linear Algebra › Free Variables in Echelon Systems

Row Reduction and Echelon Forms · Tutorial 35 of 1000

Free Variables in Echelon Systems

Use free variables as parameters and back substitution to write all solutions of a consistent echelon system.

Beginner 9 min read

What You'll Learn

  • Identify pivot and nonpivot variables from an echelon augmented matrix.
  • Assign an independent parameter to each nonpivot variable.
  • Solve for pivot variables by back substitution, including when pivots are not 1.
  • Write a complete parametric description of a system’s solutions.
  • Verify a parameterized solution by substituting it into every equation.

What Free Variables Record

When a consistent system has more variables than pivot positions, some variables are not determined by their own leading equations. Those variables are free variables: their values may be chosen arbitrarily, and the remaining variables must then adjust to satisfy the equations. A complete solution description therefore does two things: it assigns a parameter to each free variable, and it expresses every pivot variable in terms of those parameters.

Assume throughout that the system is over \(\mathbb{R}\), has \(n\) variables \(x_1,\dots,x_n\), and has been written as an augmented matrix in row echelon form. A pivot is the first nonzero entry of a nonzero row; its column is a pivot column, and the variable in that column is a pivot variable. Variables in the other columns are free variables. A row of zeros in the coefficient part is allowed in a consistent system only when its augmented entry is also zero. We will start from echelon systems, so the task here is to read and describe their solutions, not to perform the reduction that produced them.

Definition: In a consistent echelon system, a free variable is a variable whose column contains no pivot. A parameter is an arbitrary scalar used to represent the chosen value of a free variable. Each free variable receives its own parameter; pivot variables are then computed from the equations by back substitution.

Parameters are not extra unknowns in the original system. They are labels for all possible choices of free-variable values. For example, if \(x_2\) is free, writing \(x_2=s\) means that \(x_2\) may be any real number \(s\). The pivot equations then determine what values of the other variables are compatible with that choice.

A Reliable Reading Procedure

Read the nonzero rows from bottom to top. In the bottom nonzero row, the pivot variable can be solved in terms of the variables to its right. Move upward and substitute the expressions already found into each earlier pivot equation. Do not assign new parameters to pivot variables: doing so would make them appear arbitrary even though the equations constrain them.

1
Mark the pivot columns.
Each pivot identifies a variable that must be solved from its row.
2
Assign parameters.
Give each nonpivot variable a distinct real parameter, such as \(s\) or \(t\).
3
Back-substitute.
Starting at the last nonzero row, solve for pivot variables in terms of the parameters and any pivot variables already found.
4
State and check the solution.
Give the variables together as a parametric vector, then substitute into the nonzero equations.

If a pivot entry is not \(1\), divide by that nonzero coefficient when solving its equation. A consistent all-zero row contributes no equation and imposes no additional restriction. In particular, if there are no pivot columns, all variables are free; consistency then requires that the equations impose no contradictory condition.

Why the Parameter Description Gives Every Solution

Theorem: For a consistent system in row echelon form, assigning arbitrary real values to all free variables and solving the pivot equations from bottom to top produces exactly all solutions of the system. Each assignment of free-variable values produces one solution, and every solution is produced by exactly one such assignment.

Proof. Let the nonzero rows be ordered from top to bottom, and consider them from bottom to top. In the last nonzero row, the pivot coefficient is nonzero, and every variable to its right is either free or a pivot variable in a later column. Once the free values are assigned, any later pivot variables have already been determined, so division by the pivot coefficient determines the row’s pivot variable. Repeat this argument upward: at each row, variables to the right already have values, so its pivot variable is determined. Thus the procedure constructs values satisfying every nonzero row; the zero rows impose no further conditions because the system is consistent. Conversely, any solution must use its own values for the free variables. In the bottom nonzero row, its pivot value is forced by that row; proceeding upward, every pivot value is forced in turn. Therefore the procedure reproduces that solution. Finally, two different assignments differ in at least one free-variable coordinate, so they cannot give the same solution vector. If there are no nonzero rows, all coordinates are free and the same statements hold directly. \(\square\)

Worked Example: Two Free Variables

Describe all solutions of the echelon system with augmented matrix

$$ \begin{bmatrix} 1&2&-1&1&5\\ 0&0&1&3&2\\ 0&0&0&0&0 \end{bmatrix}. $$

The columns for \(x_1\) and \(x_3\) contain pivots, so \(x_1,x_3\) are pivot variables. The columns for \(x_2,x_4\) have no pivots, so assign \(x_2=s\) and \(x_4=t\), where \(s,t\in\mathbb{R}\). The nonzero rows represent

$$ \begin{aligned} x_1+2x_2-x_3+x_4&=5,\\ x_3+3x_4&=2. \end{aligned} $$

Start with the lower equation. Substituting \(x_4=t\) gives \(x_3+3t=2\), hence \(x_3=2-3t\). Substitute this and \(x_2=s,\ x_4=t\) into the first equation:

$$ \begin{aligned} x_1+2s-(2-3t)+t&=5,\\ x_1+2s-2+4t&=5,\\ x_1&=7-2s-4t. \end{aligned} $$

Thus the complete solution is

$$ \mathbf{x}= \begin{bmatrix} 7-2s-4t\\ s\\ 2-3t\\ t \end{bmatrix}, \qquad s,t\in\mathbb{R}. $$

Check: In the second equation, \(2-3t+3t=2\). In the first, the left side becomes \((7-2s-4t)+2s-(2-3t)+t=5\). Both equations hold for every real \(s,t\).

Parameter Form as an Affine Expression

A parametric vector can also be written as one fixed solution plus parameter-dependent changes. This form makes the effect of changing each free variable easier to read. It does not introduce a new method for solving: it is a rearrangement of the expressions obtained by back substitution.

Proposition: If a consistent echelon system has \(k\) free variables with parameters \(t_1,\dots,t_k\), its solution vector can be written as \(\mathbf{x}_0+t_1\mathbf{d}_1+\cdots+t_k\mathbf{d}_k\), where \(\mathbf{x}_0\) is the solution obtained by setting every parameter to zero. The vector \(\mathbf{d}_j\) records the change in the solution when \(t_j\) is increased by \(1\) and the other parameters remain \(0\).

Proof. Each free-variable coordinate is either one parameter or, if it is the coordinate for \(t_j\), the value \(t_j\). For a pivot coordinate, its row expresses it as a constant plus a linear combination of variables to its right: divide the row by its nonzero pivot coefficient and move the other terms to the other side. Starting at the last nonzero row and proceeding upward, substitution shows that every pivot coordinate is also a constant plus a linear combination of \(t_1,\dots,t_k\). Consequently, coordinate by coordinate, the solution has the form \(\mathbf{x}_0+\sum_{j=1}^k t_j\mathbf{d}_j\): its constant coordinates form \(\mathbf{x}_0\), and the coefficient of \(t_j\) in each coordinate forms \(\mathbf{d}_j\). Setting all parameters to zero gives \(\mathbf{x}_0\); setting \(t_j=1\) and the rest to zero shows that the change from \(\mathbf{x}_0\) is exactly \(\mathbf{d}_j\). \(\square\)

For the preceding example, setting \(s=t=0\) gives \(\mathbf{x}_0=(7,0,2,0)^{\top}\). The coefficient of \(s\) is \((-2,1,0,0)^{\top}\), and the coefficient of \(t\) is \((-4,0,-3,1)^{\top}\). Therefore the same solution set is

$$ \mathbf{x}= \begin{bmatrix}7\\0\\2\\0\end{bmatrix} +s\begin{bmatrix}-2\\1\\0\\0\end{bmatrix} +t\begin{bmatrix}-4\\0\\-3\\1\end{bmatrix}. $$

Worked Examples with Different Pivot Patterns

Worked Example: A Pivot Coefficient Other Than One

Find all solutions of

$$ \begin{bmatrix} 2&1&-3&7\\ 0&0&4&8\\ 0&0&0&0 \end{bmatrix}. $$

The pivots are in columns 1 and 3. Thus \(x_2\) is free; set \(x_2=s\). The lower nonzero row gives \(4x_3=8\), so \(x_3=2\). The first row gives

$$ \begin{aligned} 2x_1+s-3(2)&=7,\\ 2x_1+s-6&=7,\\ 2x_1&=13-s,\\ x_1&=\frac{13}{2}-\frac{s}{2}. \end{aligned} $$

Hence

$$ \mathbf{x}= \begin{bmatrix} \frac{13}{2}-\frac{s}{2}\\ s\\ 2 \end{bmatrix}, \qquad s\in\mathbb{R}. $$

Check: The second equation is \(4(2)=8\). In the first, \(2(\frac{13}{2}-\frac{s}{2})+s-3(2)=13-s+s-6=7\), as required.

Worked Example: Free Variables Before and Between Pivots

Describe all solutions of

$$ \begin{bmatrix} 0&1&2&-1&1\\ 0&0&0&1&3\\ 0&0&0&0&0 \end{bmatrix}. $$

The pivots are in columns 2 and 4. Therefore \(x_1\) and \(x_3\) are free. Set \(x_1=s\) and \(x_3=t\). The second row says \(x_4=3\). Substituting that into the first row gives \(x_2+2t-3=1\), so \(x_2=4-2t\). The full description is

$$ \mathbf{x}= \begin{bmatrix} s\\ 4-2t\\ t\\ 3 \end{bmatrix}, \qquad s,t\in\mathbb{R}. $$

Check: The second equation reads \(x_4=3\), which holds. The first becomes \((4-2t)+2t-3=1\). The zero row contributes \(0=0\), so it imposes no restriction on \(s\) or \(t\).

Common Mistakes and a Useful Check

Do not assign parameters to pivot variables. In the first worked example, a mistaken approach might set \(x_1=s\), \(x_2=t\), and \(x_4=u\) as if all three could be chosen freely. But the lower equation forces \(x_3=2-3u\), and the first then forces \(x_1=7-2t-4u\). The proposed arbitrary \(s\) is not valid unless it happens to equal \(7-2t-4u\). The correction is to parameterize only nonpivot columns, then solve for every pivot variable.

A second common error is to stop after finding the pivot variables without stating which parameter values are allowed. For a consistent echelon system over \(\mathbb{R}\), each free variable can take any real value: the bottom-up substitutions divide only by nonzero pivot coefficients. State the parameter domain explicitly, and verify every nonzero row after substitution. Checking just one chosen parameter value does not verify a formula intended to describe all solutions.

Parameters provide a compact record of the system’s freedom: the free coordinates can be chosen first, and the pivot coordinates respond to those choices. This description is useful whenever a system has infinitely many solutions, because it specifies the entire family rather than a single example from it. It also gives a direct way to test a proposed answer: substitute the parameterized coordinates into each equation and simplify.

Check Your Understanding

For each system, identify the free variables and give a complete parametric solution. Check the result in the equations.

  1. For \(\begin{bmatrix}1&-2&1&4\\0&0&1&-1\end{bmatrix}\), which variables are free, and what is the solution set?
  2. In an echelon system, a pivot row is \(3x_2-x_4=6\), and \(x_4\) is free. Solve for \(x_2\) using a parameter \(t\) for \(x_4\).
  3. Explain why a zero row with zero augmented entry gives no restriction on the parameters.
  4. Write \(\begin{bmatrix}2+s\\-1+3s\\s\end{bmatrix}\) as a fixed vector plus a scalar multiple of a direction vector.
  5. Why must two different assignments to the free variables produce different solution vectors?

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon