Tutorials › Linear Algebra › Dependence Relations and Their Coefficients

Basis and Dimension · Tutorial 306 of 1000

Dependence Relations and Their Coefficients

Learn to construct, verify, and interpret coefficient lists that witness dependence.

Intermediate 10 min read

What You'll Learn

  • Define dependence through a nonzero coefficient list whose linear combination is zero
  • Check a proposed relation by calculating each coordinate or coefficient
  • Use a nonzero coefficient to isolate and express its vector
  • Distinguish a relation with a zero coefficient from one that involves every listed vector
  • Understand how adding or scaling relations changes their coefficient lists

What a Dependence Relation Records

A statement that a list of vectors is dependent says that some nontrivial combination of them gives the zero vector. A dependence relation makes that statement explicit: it records the coefficients, so we can check the equation and see which vectors participate. Its coefficients also tell us how to rearrange the equation to express one vector as a combination of the others.

Throughout, let \(V\) be a vector space over a field \(\mathbb{F}\), and consider an ordered list \(\mathbf{v}_1,\dots,\mathbf{v}_p\) in \(V\). The list is ordered because each coefficient belongs to a particular position. A coefficient list is the \(p\)-tuple \((c_1,\dots,c_p)\) of scalars in \(\mathbb{F}\). The list of vectors is linearly independent when the only coefficient list satisfying the equation below is the all-zero list; it is dependent when at least one other coefficient list satisfies it.

Definition: A dependence relation on \(\mathbf{v}_1,\dots,\mathbf{v}_p\) is an equation \(c_1\mathbf{v}_1+\cdots+c_p\mathbf{v}_p=\mathbf{0}\). It is nontrivial if at least one coefficient \(c_i\) is nonzero. The list is linearly dependent if it has a nontrivial dependence relation.

The distinction between a relation and a nontrivial relation matters: choosing every coefficient to be zero always gives an equation, but that equation reveals no dependence. Conversely, a single checked nontrivial relation is enough to prove dependence. You do not need to show that it is the only relation or that every coefficient is nonzero.

Using a Relation to Isolate a Vector

Theorem: Let \(\mathbf{v}_1,\dots,\mathbf{v}_p\) be a finite list in a vector space over \(\mathbb{F}\). If \(c_1\mathbf{v}_1+\cdots+c_p\mathbf{v}_p=\mathbf{0}\) and \(c_k\ne0\), then \(\mathbf{v}_k\) is a linear combination of the other listed vectors. Conversely, if one vector in the list is a linear combination of the others, there is a nontrivial dependence relation on the list. The empty combination, when there are no other vectors, means \(\mathbf{0}\).

Proof. Suppose the displayed relation holds and \(c_k\ne0\). Move all terms except the \(k\)-th to the other side, then divide by \(c_k\), which is permitted because it is nonzero: \(\mathbf{v}_k=-\sum_{i\ne k}(c_i/c_k)\mathbf{v}_i\). This expresses \(\mathbf{v}_k\) using the other vectors. Conversely, suppose \(\mathbf{v}_k=\sum_{i\ne k}d_i\mathbf{v}_i\). Subtract \(\mathbf{v}_k\) from both sides to obtain \(\sum_{i\ne k}d_i\mathbf{v}_i-\mathbf{v}_k=\mathbf{0}\). This is a dependence relation whose coefficient on \(\mathbf{v}_k\) is \(-1\), so it is nontrivial. If \(p=1\), the same argument says that \(\mathbf{v}_1=\mathbf{0}\) gives the relation \(-\mathbf{v}_1=\mathbf{0}\), consistent with the empty-combination convention. \(\square\)

This theorem explains why the nonzero coefficients matter. To isolate a vector, choose an index \(k\) for which \(c_k\ne0\). A coefficient equal to zero cannot be divided by, and its vector does not appear in the expression obtained by rearranging that relation. A relation may therefore show that one vector is redundant without showing that every vector in the list is redundant.

Worked Example: Expressing a Vector in R²

Let \(\mathbf{v}_1=\begin{bmatrix}1\\2\end{bmatrix}\), \(\mathbf{v}_2=\begin{bmatrix}3\\1\end{bmatrix}\), and \(\mathbf{v}_3=\begin{bmatrix}5\\5\end{bmatrix}\). Find a nontrivial dependence relation and use it to express \(\mathbf{v}_3\) in terms of the first two vectors.

Calculate twice the first vector and add the second:

$$ 2\mathbf{v}_1+\mathbf{v}_2 =2\begin{bmatrix}1\\2\end{bmatrix} +\begin{bmatrix}3\\1\end{bmatrix} =\begin{bmatrix}2\\4\end{bmatrix} +\begin{bmatrix}3\\1\end{bmatrix} =\begin{bmatrix}5\\5\end{bmatrix} =\mathbf{v}_3. $$

Moving \(\mathbf{v}_3\) to the left gives \(2\mathbf{v}_1+\mathbf{v}_2-\mathbf{v}_3=\mathbf{0}\). Thus \((2,1,-1)\) is a nonzero coefficient list witnessing dependence. The coefficient on \(\mathbf{v}_3\) is \(-1\), so isolating it recovers \(\mathbf{v}_3=2\mathbf{v}_1+\mathbf{v}_2\).

Check: \(2\mathbf{v}_1+\mathbf{v}_2-\mathbf{v}_3=\begin{bmatrix}2\\4\end{bmatrix}+\begin{bmatrix}3\\1\end{bmatrix}-\begin{bmatrix}5\\5\end{bmatrix}=\begin{bmatrix}0\\0\end{bmatrix}\). The equation holds in both coordinates, and the coefficient list is not all zero.

Reading Coefficients in a Different Vector Space

The same method works in abstract vector spaces: check equality in the space being used, then use a nonzero coefficient to solve for its vector. For polynomials, equality means equality of every coefficient of each power of the variable. The vectors need not be columns in \(\mathbb{R}^n\).

Worked Example: A Relation Among Polynomials

In the real vector space of polynomials, let \(p_1(x)=1+x\), \(p_2(x)=x+x^2\), and \(p_3(x)=1+2x+x^2\). Find a nontrivial dependence relation and express \(p_3\) using the other two polynomials.

Compare the coefficients of \(1\), \(x\), and \(x^2\). For \(a p_1(x)+b p_2(x)+c p_3(x)\) to be the zero polynomial, each coefficient must vanish:

$$ a+c=0,\qquad a+b+2c=0,\qquad b+c=0. $$

Choose \(c=1\). The first equation gives \(a=-1\), and the third gives \(b=-1\). Substitution into the middle equation gives \(-1-1+2=0\), as required. Thus \((-1,-1,1)\) is a nonzero coefficient list and \(-p_1(x)-p_2(x)+p_3(x)=0\). Rearranging gives \(p_3(x)=p_1(x)+p_2(x)\).

Check: \(p_1(x)+p_2(x)=(1+x)+(x+x^2)=1+2x+x^2=p_3(x)\). Therefore the polynomial identity, and hence the dependence relation, is correct.

Coefficient Lists Can Be Combined

For a fixed list of vectors, some coefficient lists give relations and others do not. The relation lists have a useful closure property: adding two of them, or multiplying one by a scalar, produces another relation list. The result follows directly from the vector-space operations.

Theorem: For a fixed list \(\mathbf{v}_1,\dots,\mathbf{v}_p\) in a vector space \(V\) over \(\mathbb{F}\), the set of coefficient lists satisfying \(\sum_{i=1}^{p}c_i\mathbf{v}_i=\mathbf{0}\) is a subspace of \(\mathbb{F}^p\).

Proof. The all-zero coefficient list belongs to the set because \(\sum_{i=1}^{p}0\mathbf{v}_i=\mathbf{0}\). Suppose \((c_1,\dots,c_p)\) and \((d_1,\dots,d_p)\) belong to it. Then \(\sum_{i=1}^{p}(c_i+d_i)\mathbf{v}_i=\sum_{i=1}^{p}c_i\mathbf{v}_i+\sum_{i=1}^{p}d_i\mathbf{v}_i=\mathbf{0}+\mathbf{0}=\mathbf{0}\), so their sum belongs to the set. For any scalar \(a\in\mathbb{F}\), if \((c_1,\dots,c_p)\) belongs to the set, then \(\sum_{i=1}^{p}(ac_i)\mathbf{v}_i=a\sum_{i=1}^{p}c_i\mathbf{v}_i=a\mathbf{0}=\mathbf{0}\). Thus the set contains zero and is closed under addition and scalar multiplication, which are the subspace conditions. \(\square\)

This closure property can produce more than one relation from a known one: every nonzero scalar multiple of a nontrivial relation remains nontrivial. For example, multiplying \((2,1,-1)\) by \(3\) gives \((6,3,-3)\), another witness for the vectors in the first example. Adding relations is also permitted, but the sum may be the zero coefficient list. Therefore addition alone does not guarantee a new nontrivial witness.

A Zero Coefficient Does Not Involve That Vector

Worked Example: A Relation That Leaves One Vector Out

Consider the vectors in \(\mathbb{R}^3\): \(\mathbf{v}_1=\begin{bmatrix}1\\0\\1\end{bmatrix}\), \(\mathbf{v}_2=\begin{bmatrix}0\\1\\1\end{bmatrix}\), \(\mathbf{v}_3=\begin{bmatrix}1\\1\\2\end{bmatrix}\), and \(\mathbf{v}_4=\begin{bmatrix}0\\0\\1\end{bmatrix}\). Verify a relation among the first three and determine whether it expresses \(\mathbf{v}_4\) using them.

Adding \(\mathbf{v}_1\) and \(\mathbf{v}_2\) gives \(\begin{bmatrix}1\\1\\2\end{bmatrix}=\mathbf{v}_3\). Hence \(\mathbf{v}_1+\mathbf{v}_2-\mathbf{v}_3=\mathbf{0}\), and for the full four-vector list the coefficient list is \((1,1,-1,0)\). It is nonzero, so the full list is dependent. But its fourth coefficient is zero: this particular relation says nothing that would isolate \(\mathbf{v}_4\).

In fact, \(\mathbf{v}_4\) cannot be expressed using the first three. If \(a\mathbf{v}_1+b\mathbf{v}_2+c\mathbf{v}_3=\mathbf{v}_4\), comparing coordinates gives \(a+c=0\), \(b+c=0\), and \(a+b+2c=1\). The first two equations imply \(a=-c\) and \(b=-c\). Substituting into the third gives \(-c-c+2c=0=1\), a contradiction. Thus the displayed relation establishes dependence, but only gives \(\mathbf{v}_3=\mathbf{v}_1+\mathbf{v}_2\).

Check: \(\mathbf{v}_1+\mathbf{v}_2-\mathbf{v}_3+\mathbf{0}\mathbf{v}_4=\begin{bmatrix}1+0-1+0\\0+1-1+0\\1+1-2+0\end{bmatrix}=\begin{bmatrix}0\\0\\0\end{bmatrix}\). The coefficient of \(\mathbf{v}_4\) really is zero, and the contradiction above confirms that \(\mathbf{v}_4\) is not a combination of the first three.

Common Coefficient Errors

A frequent mistake is to find a plausible expression for one vector but move it to the wrong side when writing the relation. For the vectors in the first worked example, a mistaken calculation might claim \(\mathbf{v}_1+\mathbf{v}_2-\mathbf{v}_3=\mathbf{0}\). Substitution exposes the error:

$$ \mathbf{v}_1+\mathbf{v}_2-\mathbf{v}_3 =\begin{bmatrix}1\\2\end{bmatrix} +\begin{bmatrix}3\\1\end{bmatrix} -\begin{bmatrix}5\\5\end{bmatrix} =\begin{bmatrix}-1\\-2\end{bmatrix}\ne\mathbf{0}. $$

The correct expression is \(\mathbf{v}_3=2\mathbf{v}_1+\mathbf{v}_2\), so moving all terms to the left gives \(2\mathbf{v}_1+\mathbf{v}_2-\mathbf{v}_3=\mathbf{0}\). Substitution gives \(\begin{bmatrix}2\\4\end{bmatrix}+\begin{bmatrix}3\\1\end{bmatrix}-\begin{bmatrix}5\\5\end{bmatrix}=\mathbf{0}\), verifying the corrected coefficients.

Another error is to treat a zero coefficient as though it helps isolate that vector. The isolation step requires division by a nonzero coefficient; if the coefficient is zero, no such division is valid. Always identify a nonzero coefficient before choosing which vector to express, and substitute the proposed relation back into the original vector equation. In \(\mathbb{R}^n\), this means checking every coordinate; for polynomials, it means checking every power that appears.

Check Your Understanding

For each proposed coefficient list, verify the relation by substitution before interpreting it.

  1. For \(\mathbf{u}_1=\begin{bmatrix}1\\0\end{bmatrix}\), \(\mathbf{u}_2=\begin{bmatrix}0\\1\end{bmatrix}\), and \(\mathbf{u}_3=\begin{bmatrix}2\\3\end{bmatrix}\), find a nontrivial dependence relation or explain why none exists.
  2. Given \(3\mathbf{w}_1-2\mathbf{w}_2+\mathbf{w}_3=\mathbf{0}\), with \(\mathbf{w}_1,\mathbf{w}_2,\mathbf{w}_3\) in a real vector space, express \(\mathbf{w}_2\) using the other two.
  3. Explain why a coefficient list with a zero entry can still be a nontrivial dependence relation.
  4. If \((c_1,c_2,c_3)\) and \((d_1,d_2,d_3)\) both give relations on the same list, why does their sum also give a relation?
  5. Write a dependence relation equivalent to \(\mathbf{a}=4\mathbf{b}-\mathbf{c}\), using the ordered list \(\mathbf{a},\mathbf{b},\mathbf{c}\).

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon