Tutorials › Linear Algebra › Homogeneous Systems in Echelon Form

Row Reduction and Echelon Forms · Tutorial 45 of 1000

Homogeneous Systems in Echelon Form

Use echelon form to solve homogeneous systems, track free variables as parameters, and check the resulting solution vectors.

Beginner 9 min read

What You'll Learn

  • Recognize a homogeneous system and its always-present zero solution
  • Use row operations without changing the solution set
  • Read pivot and free variables from echelon form
  • Express solutions in terms of free-variable parameters
  • Check parameterized solutions in the original system
  • Spot common sign and variable-assignment mistakes

Homogeneous Systems and Their Solutions

A system of linear equations is homogeneous when every equation has zero on the right-hand side. In matrix form it is \(\mathbf{A}\mathbf{x}=\mathbf{0}\), where \(\mathbf{A}\in\mathbb{R}^{m\times n}\), \(\mathbf{x}\in\mathbb{R}^n\), and \(\mathbf{0}\in\mathbb{R}^m\). Unlike a system with a nonzero right-hand side, this system always has at least one solution: choosing every entry of \(\mathbf{x}\) to be zero makes \(\mathbf{A}\mathbf{x}=\mathbf{0}\).

Definition: The solution set of a homogeneous system \(\mathbf{A}\mathbf{x}=\mathbf{0}\) is the set of all vectors \(\mathbf{x}\in\mathbb{R}^n\) satisfying that equation. The solution \(\mathbf{x}=\mathbf{0}\) is called the zero solution or trivial solution. Any solution \(\mathbf{x}\ne\mathbf{0}\) is called a nonzero solution or nontrivial solution.

The zero solution is guaranteed, but it need not be the only solution. To describe all solutions, reduce the coefficient matrix to echelon form and use back substitution. A pivot variable corresponds to a pivot column; a variable corresponding to a column without a pivot is a free variable. In the homogeneous case, assigning values to the free variables leaves equations with zero right-hand sides, which determine the pivot variables.

We use echelon form in the following sense: all zero rows, if any, are at the bottom; the first nonzero entry of each nonzero row is its leading entry; and each leading entry is to the right of the leading entry in the row above. A row with leading entry in column \(j\) gives an equation in which the variable \(x_j\) can be solved for using variables to its right.

Why Row Reduction Preserves the Solutions

For a homogeneous system, row-reducing \(\mathbf{A}\) means applying row operations to its equations. The right-hand side remains zero under each operation. The reason this is valid is that each elementary row operation replaces equations by equivalent equations: it does not change which vectors satisfy the whole system.

Proposition: If \(\mathbf{B}\) is obtained from \(\mathbf{A}\) by a finite sequence of elementary row operations, then \(\mathbf{A}\mathbf{x}=\mathbf{0}\) and \(\mathbf{B}\mathbf{x}=\mathbf{0}\) have exactly the same solutions.

Proof. It is enough to consider one row operation at a time. Swapping two rows only changes the order in which two equations are written, so it preserves their simultaneous solutions. Multiplying one row by a nonzero scalar replaces an equation by a nonzero multiple of that equation; a vector satisfies one equation exactly when it satisfies its nonzero multiple. Replacing a row by itself plus a scalar multiple of another row also preserves solutions: any vector satisfying both original equations satisfies their stated combination, and the original changed row can be recovered by subtracting the same multiple of the unchanged row. Thus each operation preserves the solution set. Applying this argument successively proves the claim for any finite sequence of row operations. \(\square\)

Consequently, we can solve the reduced system instead of the original one. In a homogeneous system, a zero row gives \(0=0\), which imposes no additional condition. The nonzero rows supply the equations used in back substitution.

Reading Every Solution from Echelon Form

Theorem: Consider a homogeneous system whose coefficient matrix is in echelon form. Choose arbitrary real values for its free variables. There is exactly one assignment of values to its pivot variables that satisfies the system.

Proof. Start with the last nonzero row. Its leading variable has a nonzero coefficient, and every other variable appearing in that row is to its right. Those variables are free variables, or pivot variables that occur later in the order of the rows. Once their values are set, the equation determines the leading variable uniquely by division by its nonzero coefficient. Move to the row above and repeat: the variables to the right have already been assigned, so that row uniquely determines its leading variable. Continuing upward determines every pivot variable. This constructs a solution for the chosen free-variable values. It also proves uniqueness: each pivot variable is forced by its row after the variables to its right are fixed. Any zero rows impose only \(0=0\), so they do not obstruct the construction. \(\square\)

This result gives a practical method: mark the pivot variables, name the free variables with parameters, and substitute upward from the bottom row. The resulting parameterized vector describes all solutions, because every solution must use some values for its free variables, and those values determine the pivot variables uniquely.

Worked Example: One Free Variable

Solve the homogeneous system with coefficient matrix \(\mathbf{A}=\begin{bmatrix}1&2&-1\\2&5&5\end{bmatrix}\). Row-reduce using \(R_2\to R_2-2R_1\):

$$ \begin{bmatrix}1&2&-1\\2&5&5\end{bmatrix} \sim \begin{bmatrix}1&2&-1\\0&1&7\end{bmatrix}. $$

The equations are \(x_1+2x_2-x_3=0\) and \(x_2+7x_3=0\). Columns 1 and 2 are pivot columns, so \(x_1,x_2\) are pivot variables and \(x_3\) is free. Set \(x_3=t\), where \(t\in\mathbb{R}\). The second equation gives \(x_2=-7t\). Substituting into the first gives \(x_1+2(-7t)-t=0\), hence \(x_1=15t\). Therefore every solution has the form \(\mathbf{x}=(15t,-7t,t)^{\top}\).

Check: Multiply by the original matrix:

$$ \begin{bmatrix}1&2&-1\\2&5&5\end{bmatrix} \begin{bmatrix}15t\\-7t\\t\end{bmatrix} = \begin{bmatrix}15t-14t-t\\30t-35t+5t\end{bmatrix} = \begin{bmatrix}0\\0\end{bmatrix}. $$

When \(t=0\), this gives the zero solution. For example, \(t=1\) gives the nonzero solution \((15,-7,1)^{\top}\). Both are included in the parameterized description.

Worked Example: Two Free Variables

Consider the homogeneous system with echelon-form coefficient matrix

$$ \mathbf{A}= \begin{bmatrix} 1&2&-1&3\\ 0&1&2&-1\\ 0&0&0&0 \end{bmatrix}. $$

The corresponding equations are \(x_1+2x_2-x_3+3x_4=0\), \(x_2+2x_3-x_4=0\), and \(0=0\). Columns 1 and 2 have pivots, so \(x_1,x_2\) are pivot variables. Columns 3 and 4 have no pivots, so set \(x_3=s\) and \(x_4=t\), with \(s,t\in\mathbb{R}\). From the second equation, \(x_2+2s-t=0\), so \(x_2=-2s+t\). Substitution into the first gives \(x_1+2(-2s+t)-s+3t=0\), hence \(x_1=5s-5t\). Thus the full solution set is

$$ \mathbf{x}= \begin{bmatrix} 5s-5t\\ -2s+t\\ s\\ t \end{bmatrix}, \qquad s,t\in\mathbb{R}. $$

Check: Substitution into each nonzero row gives

$$ (5s-5t)+2(-2s+t)-s+3t=0, \qquad (-2s+t)+2s-t=0. $$

The last row also gives \(0=0\). Therefore every vector in the displayed family solves the original matrix equation. For instance, taking \(s=1,t=0\) produces \((5,-2,1,0)^{\top}\), which is nonzero.

Worked Example: Only the Zero Solution in a Particular System

Solve the homogeneous system with coefficient matrix \(\mathbf{A}=\begin{bmatrix}1&-2&1\\0&3&6\\0&0&-2\end{bmatrix}\). It is already in echelon form, with a pivot in each column. Back substitution begins with the last equation, \(-2x_3=0\), so \(x_3=0\). The second equation becomes \(3x_2+6(0)=0\), so \(x_2=0\). The first then gives \(x_1-2(0)+0=0\), so \(x_1=0\). The solution is \(\mathbf{x}=\mathbf{0}\).

Check: Multiplication confirms the result:

$$ \begin{bmatrix}1&-2&1\\0&3&6\\0&0&-2\end{bmatrix} \begin{bmatrix}0\\0\\0\end{bmatrix} = \begin{bmatrix}0\\0\\0\end{bmatrix}. $$

This example illustrates why the zero solution and the entire solution set should not be confused. The zero vector is always one solution; back substitution determines whether other solutions occur in a particular system.

Common Mistakes and a Reliable Routine

Mistake: assuming a homogeneous system has only the zero solution. In the first worked example, the system is homogeneous, but \((15,-7,1)^{\top}\) is a nonzero solution. “Homogeneous” means that the right-hand side is zero; it does not, by itself, say that all entries of every solution must be zero. To decide what the solutions are, use the equations in echelon form.

Mistake: reversing a sign during back substitution. In the first example, the last equation is \(x_2+7x_3=0\). A wrong calculation is \(x_2=7x_3\). Moving \(7x_3\) to the other side gives \(x_2=-7x_3\), not \(7x_3\). Checking in the equation catches the error: \(7t+7t=14t\), which is generally not zero, whereas \(-7t+7t=0\).

Mistake: assigning arbitrary values to pivot variables. In the second example, \(x_1\) and \(x_2\) are constrained by the equations. The parameters belong to \(x_3\) and \(x_4\), the variables in columns without pivots. Once those values are chosen, back substitution fixes the pivot variables.

1
Reduce the coefficient matrix.
Apply row operations to \(\mathbf{A}\); for a homogeneous system the right-hand side remains zero.
2
Identify pivots and free variables.
Variables in pivot columns are determined by the equations; variables in columns without pivots are assigned parameters.
3
Back-substitute from the bottom.
Solve each pivot equation in turn, keeping the free-variable parameters visible.
4
Check in the original system.
Multiply the original coefficient matrix by the parameterized vector and verify that every entry is zero.

The check is useful even when the row reduction is correct: it verifies both the signs in the parameter formulas and that the formulas satisfy the original equations. Keep the free parameters in the final answer, since setting them all to zero records only the zero solution rather than describing the full solution set.

Check Your Understanding

For each system, identify the pivot and free variables before writing the solution set.

  1. Solve the system with coefficient matrix \(\begin{bmatrix}1&3&2\\0&1&-4\end{bmatrix}\), and check the resulting vector by multiplication.
  2. For the echelon-form matrix \(\begin{bmatrix}1&0&2&-1\\0&1&3&4\\0&0&0&0\end{bmatrix}\), write every solution using parameters.
  3. Explain why the zero vector solves every homogeneous system \(\mathbf{A}\mathbf{x}=\mathbf{0}\).
  4. In the equation \(x_1-5x_2=0\), if \(x_2=t\), what is \(x_1\)? Check the sign by substitution.
  5. For the matrix \(\begin{bmatrix}2&0\\0&-3\end{bmatrix}\), use back substitution to solve the associated homogeneous system.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon