Tutorials › Linear Algebra › Mixed Independence Problems: A Row-Reduction Workshop

Linear Independence · Tutorial 185 of 1000

Mixed Independence Problems: A Row-Reduction Workshop

Practise turning mixed independence questions into homogeneous systems, reading their pivots and free variables, and checking explicit dependence relations.

Beginner 10 min read

What You'll Learn

  • Arrange a coordinate list as the columns of a matrix and write its homogeneous system.
  • Use pivot and free-variable information to decide independence.
  • Separate parameter values that give independent columns from those that give dependence.
  • Extract a nontrivial coefficient vector from a free variable.
  • Check a proposed dependence relation in the original coordinate lists.

A Common Framework for Mixed Problems

Independence questions may be presented as coordinate lists, as columns of a matrix, or as a family that depends on a parameter. In each case, the central task is to determine whether a homogeneous system has a nonzero solution. If it does, its solution gives coefficients for a dependence relation; if it does not, the list is independent. The row-reduction work is only part of the answer: the coefficient order must match the original list, and a claimed relation should be checked in the original coordinates.

Throughout, scalars are real, vectors in \(\mathbb{R}^n\) are columns, and a list keeps track of the order of its vectors. Given \(\mathbf{v}_1,\dots,\mathbf{v}_p\in\mathbb{R}^n\), put them in that order as the columns of \(\mathbf{A}\in\mathbb{R}^{n\times p}\). A coefficient vector is \(\mathbf{c}=(c_1,\dots,c_p)^\top\).

Definition: The list \(\mathbf{v}_1,\dots,\mathbf{v}_p\) is linearly independent if \(c_1\mathbf{v}_1+\cdots+c_p\mathbf{v}_p=\mathbf{0}\) implies \(c_1=\cdots=c_p=0\). It is linearly dependent if some coefficients, not all zero, give this equation. Such coefficients form a nontrivial dependence relation.

The matrix equation \(\mathbf{A}\mathbf{c}=\mathbf{0}\) is exactly the vector equation in this definition. Thus independence asks whether the homogeneous system has only its zero solution. Row operations preserve the solution set of a homogeneous system: swapping equations, multiplying one equation by a nonzero scalar, or adding a multiple of one equation to another leaves an equivalent system, and each operation can be reversed.

Result: For a list of columns \(\mathbf{v}_1,\dots,\mathbf{v}_p\), the list is independent exactly when \(\mathbf{A}\mathbf{c}=\mathbf{0}\) has only the solution \(\mathbf{c}=\mathbf{0}\). Row-reducing \(\mathbf{A}\) is valid because the row operations preserve that homogeneous solution set.

Proof. By the definition of matrix multiplication, \(\mathbf{A}\mathbf{c}=c_1\mathbf{v}_1+\cdots+c_p\mathbf{v}_p\). Therefore \(\mathbf{A}\mathbf{c}=\mathbf{0}\) holds for exactly the coefficient vectors that give a relation among the list. The list is independent precisely when the only such coefficient vector is zero, by the definition of independence. Each elementary row operation replaces the equations by an equivalent system because the operation is reversible. Consequently row reduction does not change which coefficient vectors solve the system. \(\square\)

Reading a Reduced System Reliably

The reduced row echelon form (RREF) makes the solution choices visible. A column containing a pivot corresponds to a pivot variable; a column without one corresponds to a free variable. In a homogeneous system, there is no constant term, so when all variables are pivot variables, solving from the last pivot row upward forces every variable to be zero. A free variable, on the other hand, can be assigned a nonzero value, producing a nonzero solution.

Theorem (Free-variable test): Let \(\mathbf{A}\in\mathbb{R}^{n\times p}\), with \(p\geq1\). The homogeneous system \(\mathbf{A}\mathbf{c}=\mathbf{0}\) has only the zero solution if and only if every column of \(\operatorname{rref}(\mathbf{A})\) is a pivot column.

Proof. Row operations preserve the solutions, so it is enough to solve the system whose matrix is \(\operatorname{rref}(\mathbf{A})\). If every column has a pivot, there are no free variables. Each pivot equation expresses its pivot variable using variables to its right. Starting at the last pivot and proceeding upward, each pivot variable must be zero: the last equation has no nonzero variable to its right, and each preceding equation has only variables already forced to zero. Thus the only solution is \(\mathbf{c}=\mathbf{0}\). Conversely, suppose a column has no pivot. Assign one free variable the value \(1\), and assign every other free variable the value \(0\). Solve the pivot equations from the last pivot upward to determine the pivot variables. This gives a solution of the homogeneous system, and it is nonzero because the chosen free variable is \(1\). Hence the system does not have only the zero solution. These two implications prove the statement. \(\square\)

This result gives a decision procedure, but a dependence problem asks for more than a yes-or-no answer. To find a relation, keep the variables in the same order as the original columns, choose convenient values for the free variables, solve for the pivot variables, and then substitute the resulting coefficients into the original list.

Worked Example: Four Coordinate Vectors in \(\mathbb{R}^3\)

Worked Example: Finding a Relation from Free Variables

Consider the ordered list \(\mathbf{v}_1=(1,0,1)^\top\), \(\mathbf{v}_2=(0,1,1)^\top\), \(\mathbf{v}_3=(1,1,2)^\top\), and \(\mathbf{v}_4=(1,2,3)^\top\). Decide whether it is independent and find a nontrivial dependence relation if it is dependent.

Place the vectors in order as columns. Subtract row 1 from row 3, then subtract row 2 from the new row 3:

$$ \begin{bmatrix} 1&0&1&1\\ 0&1&1&2\\ 1&1&2&3 \end{bmatrix} \xrightarrow{R_3\to R_3-R_1} \begin{bmatrix} 1&0&1&1\\ 0&1&1&2\\ 0&1&1&2 \end{bmatrix} \xrightarrow{R_3\to R_3-R_2} \begin{bmatrix} 1&0&1&1\\ 0&1&1&2\\ 0&0&0&0 \end{bmatrix}. $$

Columns 1 and 2 are pivot columns; variables \(c_3,c_4\) are free. The reduced system says \(c_1+c_3+c_4=0\) and \(c_2+c_3+2c_4=0\). Choose \(c_3=1\) and \(c_4=0\). Then \(c_1=-1\) and \(c_2=-1\), giving \(\mathbf{c}=(-1,-1,1,0)^\top\). Since this is nonzero, the list is dependent.

Check: Substituting into the original vectors gives \(-\mathbf{v}_1-\mathbf{v}_2+\mathbf{v}_3=(-1,0,-1)^\top+(0,-1,-1)^\top+(1,1,2)^\top=(0,0,0)^\top\). The coefficients are not all zero, so this is indeed a dependence relation.

There is more than one valid choice of free-variable values. For example, setting \(c_3=0\) and \(c_4=1\) gives \(c_1=-1\) and \(c_2=-2\), another nontrivial relation. The first choice was convenient because it avoided a coefficient on the fourth vector. A free-variable assignment is a way to produce one relation, not a claim that the relation is unique.

Worked Example: A Parameter Changes the Answer

Worked Example: Separating the Parameter Cases

For \(t\in\mathbb{R}\), consider the ordered columns \(\mathbf{u}_1=(1,1,0)^\top\), \(\mathbf{u}_2=(0,1,1)^\top\), and \(\mathbf{u}_3=(1,2,t)^\top\). Determine exactly when they are independent.

The homogeneous system has coefficient matrix shown below. First replace row 2 by row 2 minus row 1; then replace row 3 by row 3 minus the new row 2:

$$ \begin{bmatrix} 1&0&1\\ 1&1&2\\ 0&1&t \end{bmatrix} \xrightarrow{R_2\to R_2-R_1} \begin{bmatrix} 1&0&1\\ 0&1&1\\ 0&1&t \end{bmatrix} \xrightarrow{R_3\to R_3-R_2} \begin{bmatrix} 1&0&1\\ 0&1&1\\ 0&0&t-1 \end{bmatrix}. $$

If \(t\ne1\), the last row gives \((t-1)c_3=0\), so \(c_3=0\). The first two rows then give \(c_1=0\) and \(c_2=0\). Thus the columns are independent for every \(t\ne1\). If \(t=1\), the last row is zero and the first two equations give \(c_1=-c_3\) and \(c_2=-c_3\). Taking \(c_3=1\) gives the nonzero coefficient vector \((-1,-1,1)^\top\), so the columns are dependent at \(t=1\).

Check: At \(t=1\), \(-\mathbf{u}_1-\mathbf{u}_2+\mathbf{u}_3=(-1,-1,0)^\top+(0,-1,-1)^\top+(1,2,1)^\top=(0,0,0)^\top\). The relation verifies the dependent case directly. In the independent cases, substituting into the three reduced equations forces the coefficient vector to be zero.

This example illustrates why a parameter must be handled by cases. A row containing \(t-1\) cannot be treated as a pivot row when \(t=1\), because then its entries are all zero. Dividing by \(t-1\) without first stating \(t\ne1\) would discard the very case that creates dependence.

Worked Example: Pivot Test with More Coordinates Than Vectors

Worked Example: Three Columns in \(\mathbb{R}^4\)

Test the columns \(\mathbf{w}_1=(1,0,1,2)^\top\), \(\mathbf{w}_2=(0,1,1,-1)^\top\), and \(\mathbf{w}_3=(1,1,0,1)^\top\) for independence.

Form the matrix whose columns are the vectors. Replace row 3 by row 3 minus rows 1 and 2, and replace row 4 by row 4 minus twice row 1 plus row 2:

$$ \begin{bmatrix} 1&0&1\\ 0&1&1\\ 1&1&0\\ 2&-1&1 \end{bmatrix} \xrightarrow{\substack{R_3\to R_3-R_1-R_2\\R_4\to R_4-2R_1+R_2}} \begin{bmatrix} 1&0&1\\ 0&1&1\\ 0&0&-2\\ 0&0&0 \end{bmatrix}. $$

Scale row 3 by \(-\tfrac12\), then subtract the new row 3 from rows 1 and 2:

$$ \begin{bmatrix} 1&0&1\\ 0&1&1\\ 0&0&-2\\ 0&0&0 \end{bmatrix} \xrightarrow{R_3\to-\frac12R_3} \begin{bmatrix} 1&0&1\\ 0&1&1\\ 0&0&1\\ 0&0&0 \end{bmatrix} \xrightarrow{\substack{R_1\to R_1-R_3\\R_2\to R_2-R_3}} \begin{bmatrix} 1&0&0\\ 0&1&0\\ 0&0&1\\ 0&0&0 \end{bmatrix}. $$

Every column is a pivot column, so the homogeneous system has only the zero solution and the three vectors are independent. Checking in the original matrix, \(\mathbf{A}(0,0,0)^\top=(0,0,0,0)^\top\); the RREF equations show there is no other coefficient vector that gives zero.

A Practical Order for Solving These Problems

For a mixed set of independence exercises, a consistent sequence reduces avoidable errors:

1
Preserve the list order.
Write the vectors as columns in the stated order. This order also fixes the meanings of \(c_1,\dots,c_p\).
2
Set up the homogeneous system.
Use \(\mathbf{A}\mathbf{c}=\mathbf{0}\), so that any solution gives coefficients of a relation among the original columns.
3
Reduce and separate cases.
Track parameter values at which a potential pivot becomes zero. Do not divide by an expression until its nonzero condition is stated.
4
Read the coefficient system.
If there is a free variable, choose its value and solve for pivot variables. If every variable is a pivot variable, the homogeneous system has only the zero solution.
5
Verify in the original coordinates.
Multiply the original matrix by the proposed coefficient vector, or calculate the corresponding linear combination directly.

Common Pitfall: Putting the Vectors in the Rows

For an independence test, row-reduce the matrix whose columns are the vectors. A concrete error arises with \(\mathbf{e}_1=(1,0,0)^\top\) and \(\mathbf{e}_2=(0,1,0)^\top\) in \(\mathbb{R}^3\). If they are mistakenly written as rows, the matrix is \(\begin{bmatrix}1&0&0\\0&1&0\end{bmatrix}\). Seeing that its third column has no pivot and concluding “the two vectors are dependent” applies the column test to the wrong arrangement.

The correction is to place the vectors as columns: \(\mathbf{A}=\begin{bmatrix}1&0\\0&1\\0&0\end{bmatrix}\). Both columns have pivots. Equivalently, \(c_1\mathbf{e}_1+c_2\mathbf{e}_2=(c_1,c_2,0)^\top=\mathbf{0}\) forces \(c_1=c_2=0\). The vectors are independent. The example also shows why an answer should be tied back to the homogeneous system, not read from a matrix whose rows or columns do not represent the intended list.

Check Your Understanding

For each item, set up the homogeneous system and use its solutions to justify your conclusion.

  1. Put \((1,0,1)^\top\), \((0,1,1)^\top\), and \((1,1,2)^\top\) in a column matrix. Find a nontrivial dependence relation.
  2. For which real values of \(s\) are \((1,0,1)^\top\), \((0,1,1)^\top\), and \((1,1,s)^\top\) independent?
  3. A reduced homogeneous system has two pivot variables and one free variable. Explain why it has a nonzero solution.
  4. Explain why a zero row in a reduced matrix does not by itself prove that the columns are dependent.
  5. Verify directly whether \((1,2,0)^\top\), \((0,1,1)^\top\), and \((1,3,1)^\top\) are dependent.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon