Tutorials › Linear Algebra › Linear Independence Through Its Defining Equation

Basis and Dimension · Tutorial 305 of 1000

Linear Independence Through Its Defining Equation

Use the defining equation for linear independence to decide whether a finite list has only the trivial zero combination.

Intermediate 10 min read

What You'll Learn

  • State linear independence and dependence using coefficients in a zero-combination equation.
  • Test finite lists in real coordinate spaces by matching coordinates.
  • Test polynomial lists by matching coefficients of like powers.
  • Recognize the zero vector and repeated vectors as sources of dependence.
  • Prove that every sublist of an independent list remains independent.
  • Connect independence to uniqueness of coefficients in linear combinations.

The Defining Equation

Linear independence is decided by asking whether a particular equation has any nontrivial solution. The equation is a linear combination equal to the zero vector, and its unknowns are the scalar coefficients. This viewpoint works in \(\mathbb{R}^n\), where the equation can be separated into coordinate equations, and in other vector spaces such as spaces of polynomials, where coefficients of like terms can be compared.

Throughout this tutorial, scalars are real numbers. A finite list \((\mathbf{v}_1,\dots,\mathbf{v}_p)\) records both its entries and their order; entries may repeat. A coefficient choice is a list of real numbers \((c_1,\dots,c_p)\). The choice is trivial if every \(c_i=0\), and nontrivial if at least one coefficient is nonzero.

Definition: A finite list \((\mathbf{v}_1,\dots,\mathbf{v}_p)\) in a real vector space is linearly independent if \(c_1\mathbf{v}_1+\cdots+c_p\mathbf{v}_p=\mathbf{0}\) implies \(c_1=\cdots=c_p=0\). The list is linearly dependent if there is a nontrivial coefficient choice for which that equation holds. The empty list is independent: it has no coefficients other than the empty, trivial choice.

The definition is about the whole list, not about whether each vector is nonzero separately. The zero coefficients always give a solution to the equation. Independence says that no other coefficient choice does. Dependence can be established by displaying one nontrivial choice and checking that its combination really is zero. To establish independence, the coordinate or coefficient equations must force every coefficient to be zero.

Coordinate Equations in \(\mathbb{R}^n\)

For vectors in \(\mathbb{R}^n\), each vector is a column with \(n\) coordinates. Adding scalar multiples coordinate by coordinate turns the defining equation into \(n\) scalar equations. Solving those equations directly tests the definition; no row-reduction criterion is needed for these small examples.

Worked Example: Three Vectors in \(\mathbb{R}^3\)

Test the list \((\mathbf{v}_1,\mathbf{v}_2,\mathbf{v}_3)\), where \(\mathbf{v}_1=(1,0,1)^{\top}\), \(\mathbf{v}_2=(0,1,1)^{\top}\), and \(\mathbf{v}_3=(1,1,0)^{\top}\).

Start with the defining equation and write its three coordinates:

$$ c_1\begin{bmatrix}1\\0\\1\end{bmatrix} +c_2\begin{bmatrix}0\\1\\1\end{bmatrix} +c_3\begin{bmatrix}1\\1\\0\end{bmatrix} =\begin{bmatrix}0\\0\\0\end{bmatrix} \quad\Longleftrightarrow\quad \begin{cases} c_1+c_3=0,\\ c_2+c_3=0,\\ c_1+c_2=0. \end{cases} $$

The first two equations give \(c_1=-c_3\) and \(c_2=-c_3\). Substituting both into the third gives \(-2c_3=0\), so \(c_3=0\), and then \(c_1=c_2=0\). Only the trivial coefficient choice works, so the list is independent.

Check: substituting the resulting coefficients gives \(0\mathbf{v}_1+0\mathbf{v}_2+0\mathbf{v}_3=\mathbf{0}\). The coordinate equations also show that no other coefficients solve the defining equation.

The reverse situation is just as direct: if the equations admit a nonzero coefficient choice, the list is dependent. A single such choice is enough; it is not necessary to describe every solution.

Worked Example: A Dependent List in \(\mathbb{R}^2\)

Test \((\mathbf{u}_1,\mathbf{u}_2,\mathbf{u}_3)\), where \(\mathbf{u}_1=(1,2)^{\top}\), \(\mathbf{u}_2=(2,4)^{\top}\), and \(\mathbf{u}_3=(0,1)^{\top}\).

The defining equation is equivalent to the two coordinate equations

$$ c_1\begin{bmatrix}1\\2\end{bmatrix} +c_2\begin{bmatrix}2\\4\end{bmatrix} +c_3\begin{bmatrix}0\\1\end{bmatrix} =\begin{bmatrix}0\\0\end{bmatrix} \quad\Longleftrightarrow\quad \begin{cases} c_1+2c_2=0,\\ 2c_1+4c_2+c_3=0. \end{cases} $$

Choose \(c_2=1\). The first equation then gives \(c_1=-2\), and the second gives \(2(-2)+4(1)+c_3=0\), so \(c_3=0\). This is a nontrivial choice, since \(c_2=1\), and therefore the list is dependent.

Check: \(-2\mathbf{u}_1+\mathbf{u}_2+0\mathbf{u}_3=(-2, -4)^{\top}+(2,4)^{\top}+(0,0)^{\top}=(0,0)^{\top}\). The displayed coefficients do satisfy the defining equation.

Testing Polynomial Lists

Polynomials form a real vector space under the usual addition and scalar multiplication. In the space of polynomials of degree at most \(d\), equality means that the coefficients of each power \(1,x,\dots,x^d\) agree. Thus the defining equation for a polynomial list becomes a system of scalar equations, one for each power. Powers whose coefficients are all zero contribute equations such as \(0=0\), which impose no restriction.

Worked Example: Independent Polynomials

In the space of real polynomials of degree at most \(1\), test the list \((1+x,1-x)\).

Suppose \(c_1(1+x)+c_2(1-x)\) is the zero polynomial. The constant coefficient is \(c_1+c_2\), and the coefficient of \(x\) is \(c_1-c_2\). Both must be zero:

$$ \begin{cases} c_1+c_2=0,\\ c_1-c_2=0. \end{cases} \qquad \begin{aligned} \text{Adding the equations gives }&2c_1=0,\\ \text{so }&c_1=0,\\ \text{and then }&c_2=0. \end{aligned} $$

Only the trivial choice works, so the two polynomials are independent.

Check: with \(c_1=c_2=0\), the combination is the zero polynomial. Conversely, if it is the zero polynomial, both of its coefficients must vanish, and the equations above force those same coefficients \(c_1,c_2\) to be zero.

Worked Example: A Dependent Polynomial List

In the space of real polynomials of degree at most \(2\), test \(q_1=1+x\), \(q_2=x+x^2\), and \(q_3=1+2x+x^2\).

Set \(c_1q_1+c_2q_2+c_3q_3\) equal to the zero polynomial. Matching the constant, \(x\), and \(x^2\) coefficients gives

$$ \begin{cases} c_1+c_3=0,\\ c_1+c_2+2c_3=0,\\ c_2+c_3=0. \end{cases} $$

Take \(c_3=1\). The first equation gives \(c_1=-1\), and the third gives \(c_2=-1\). The middle equation is then \(-1-1+2=0\), so \((-1,-1,1)\) is a nontrivial solution. The list is dependent.

Check: \(-q_1-q_2+q_3=-(1+x)-(x+x^2)+(1+2x+x^2)=0\). The constant, \(x\), and \(x^2\) coefficients each cancel.

Consequences of the Definition

Several useful facts follow directly from the defining equation. They do not require a general test for independence; each can be checked by considering what coefficients would make a zero combination.

Theorem: A one-vector list \((\mathbf{v})\) in a real vector space is independent if and only if \(\mathbf{v}\ne\mathbf{0}\).

Proof. If \(\mathbf{v}=\mathbf{0}\), then \(1\mathbf{v}=\mathbf{0}\) is a nontrivial zero combination, so the list is dependent. If \(\mathbf{v}\ne\mathbf{0}\) and \(c\mathbf{v}=\mathbf{0}\), then \(c\ne0\) would allow division by \(c\), giving \(\mathbf{v}=\mathbf{0}\), a contradiction. Therefore \(c=0\) is the only possible coefficient, and the list is independent. \(\square\)

Theorem: Every sublist of a linearly independent finite list is linearly independent.

Proof. Let \((\mathbf{v}_1,\dots,\mathbf{v}_p)\) be independent, and select any sublist \((\mathbf{v}_{i_1},\dots,\mathbf{v}_{i_q})\). Suppose \(d_1\mathbf{v}_{i_1}+\cdots+d_q\mathbf{v}_{i_q}=\mathbf{0}\). In the full list, give each selected vector its corresponding coefficient \(d_k\) and give every omitted vector coefficient \(0\). This is a zero combination of the full list. Independence of that list forces all its coefficients to be zero, so \(d_1=\cdots=d_q=0\). This proves that the selected sublist is independent. If the selected sublist is empty, it is independent by the empty-list convention. \(\square\)

In particular, a list containing \(\mathbf{0}\) is dependent: put coefficient \(1\) on that entry and \(0\) on every other entry. A list with two equal entries is also dependent: put coefficients \(1\) and \(-1\) on those entries and \(0\) elsewhere. In each case the resulting zero combination has a nonzero coefficient. These conclusions concern lists, so repeated entries are counted as separate positions.

Theorem: A finite list \((\mathbf{v}_1,\dots,\mathbf{v}_p)\) is independent if and only if every vector that can be expressed as a linear combination of the list has only one coefficient list representing it.

Proof. Suppose first that the list is independent and that two coefficient lists represent the same vector: \(a_1\mathbf{v}_1+\cdots+a_p\mathbf{v}_p=b_1\mathbf{v}_1+\cdots+b_p\mathbf{v}_p\). Subtracting the right side from the left gives \((a_1-b_1)\mathbf{v}_1+\cdots+(a_p-b_p)\mathbf{v}_p=\mathbf{0}\). Independence forces \(a_i-b_i=0\) for every \(i\), so the coefficient lists are equal. Conversely, suppose every represented vector has only one coefficient list. The zero vector has the all-zero coefficient list. Any other coefficient list that represented zero would be a second, distinct representation of the zero vector. No such list exists, so the defining equation has only the trivial solution and the list is independent. \(\square\)

Common Pitfall: Nonzero Entries Do Not Guarantee Independence

A tempting but incorrect test is to check that every vector in a list is nonzero and then declare the list independent. For example, each of \((1,0)^{\top}\), \((0,1)^{\top}\), and \((1,1)^{\top}\) is nonzero, but that fact alone does not settle the defining equation. Using the first two vectors with coefficient \(1\) and the third with coefficient \(-1\) gives

$$ \begin{bmatrix}1\\0\end{bmatrix} +\begin{bmatrix}0\\1\end{bmatrix} -\begin{bmatrix}1\\1\end{bmatrix} =\begin{bmatrix}0\\0\end{bmatrix}. $$

The coefficient choice \((1,1,-1)\) is nontrivial, so the list is dependent. The correction is to test the combination of the entire list, not the entries one at a time. Likewise, checking only one or two coordinate equations is not enough: independence requires that all coordinate equations together force every coefficient to be zero.

The defining-equation approach gives a consistent procedure in both coordinate and polynomial spaces: write a general linear combination, set it equal to zero, and equate the relevant coordinates or polynomial coefficients. If every solution is trivial, the list is independent; if even one nontrivial solution works, it is dependent.

Check Your Understanding

For each list, write the zero-combination equation and determine whether only the trivial coefficient choice works.

  1. Test \((1,1)^{\top}\) and \((1,-1)^{\top}\) in \(\mathbb{R}^2\).
  2. Test \((1,2)^{\top}\) and \((3,6)^{\top}\) in \(\mathbb{R}^2\).
  3. In the space of real polynomials of degree at most \(1\), test \(1\) and \(x\).
  4. Explain directly from the definition why a list containing the zero vector is dependent.
  5. Why must every sublist of an independent list be independent?

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon