Tutorials › Linear Algebra › How Reordering a List Affects Independence

Linear Independence · Tutorial 182 of 1000

How Reordering a List Affects Independence

Learn how to reorder a vector list, track the matching coefficient changes, and prove that independence is unchanged.

Beginner 10 min read

What You'll Learn

  • Define a reordering of a finite vector list using a permutation of its indices.
  • Convert the coefficients of a dependence relation to match a reordered list.
  • Recover the original coefficients from those of the reordered list.
  • Prove that a list is independent exactly when any reordering is independent.
  • Check coefficient tracking in independent and dependent examples.
  • Identify and correct a common mistake when moving coefficients.

Why Order Can Change the Work but Not the Independence

A vector list has positions: its first vector, second vector, and so on. Changing those positions can change how a dependence relation is written, because each coefficient belongs to the vector in the same position. But reordering does not create or remove a dependence relation. It only changes which coefficient is attached to each vector. Keeping track of that matching is the key to proving that independence is unchanged.

Throughout, the vectors and scalars are in \(\mathbb{R}^n\) and \(\mathbb{R}\), respectively. A list is ordered, and repeated vectors, if present, still occupy separate positions. For a list \(\mathbf{v}_1,\ldots,\mathbf{v}_p\), a dependence relation is an equation \(c_1\mathbf{v}_1+\cdots+c_p\mathbf{v}_p=\mathbf{0}\). It is nontrivial when at least one coefficient is nonzero. The list is linearly independent if its only dependence relation has all coefficients zero; otherwise it is linearly dependent.

Definition: A permutation of the positions \(1,\ldots,p\) is a bijection \(\pi:\{1,\ldots,p\}\to\{1,\ldots,p\}\). The reordered list determined by \(\pi\) is \(\mathbf{w}_1,\ldots,\mathbf{w}_p\), where \(\mathbf{w}_i=\mathbf{v}_{\pi(i)}\). Thus \(\pi(i)\) tells us which original vector is placed in position \(i\) of the new list.

For instance, if \(\pi(1)=3,\ \pi(2)=1,\ \pi(3)=2\), then the reordered list is \(\mathbf{v}_3,\mathbf{v}_1,\mathbf{v}_2\). The coefficient in the first position of a relation for this reordered list must multiply \(\mathbf{v}_3\), not \(\mathbf{v}_1\). This positional detail is easy to lose if we treat a list as though it were an unordered set.

How the Coefficients Move

Suppose the original list has a coefficient vector \(\mathbf{c}=(c_1,\ldots,c_p)^\top\). For the reordered list, define the new coefficient vector \(\mathbf{d}=(d_1,\ldots,d_p)^\top\) by \(d_i=c_{\pi(i)}\). Each new coefficient is the old coefficient belonging to the vector now occupying that position. The entire relation then has the same terms as before, just written in a different order.

Proposition: Let \(\mathbf{w}_i=\mathbf{v}_{\pi(i)}\) be a reordering of a list in \(\mathbb{R}^n\). If \(\mathbf{c}\) is a coefficient vector for the original list, the matching coefficient vector for the reordered list is \(d_i=c_{\pi(i)}\). This matching takes every relation for the original list to a relation for the reordered list, and every relation for the reordered list comes from exactly one relation for the original list.

Proof. Let \(d_i=c_{\pi(i)}\) for every \(i\). Since \(\mathbf{w}_i=\mathbf{v}_{\pi(i)}\), we have \(\sum_{i=1}^p d_i\mathbf{w}_i=\sum_{i=1}^p c_{\pi(i)}\mathbf{v}_{\pi(i)}\). Because \(\pi\) is a bijection, each original index \(j\) occurs exactly once among \(\pi(1),\ldots,\pi(p)\). Reordering the terms therefore gives \(\sum_{i=1}^p c_{\pi(i)}\mathbf{v}_{\pi(i)}=\sum_{j=1}^p c_j\mathbf{v}_j\). So an original relation equal to \(\mathbf{0}\) gives a reordered relation equal to \(\mathbf{0}\). To reverse the correspondence, set \(c_j=d_{\pi^{-1}(j)}\) for every \(j\), where \(\pi^{-1}\) is the inverse permutation. This recovers each original coefficient uniquely, since \(\pi\) has an inverse. For \(p=0\), both lists have no coefficients and the empty sum is \(\mathbf{0}\), so the correspondence also holds in that case. \(\square\)

The formula has two equivalent readings. To write a relation for the reordered list, read the original coefficients in the order \(\pi(1),\ldots,\pi(p)\). To recover the original coefficient at position \(j\) from the reordered coefficients, use \(c_j=d_{\pi^{-1}(j)}\). The inverse matters: \(\pi\) describes where each new position came from, while \(\pi^{-1}\) describes where an original position ended up.

Worked Example: Reordering a Dependence Relation

Consider \(\mathbf{v}_1=(1,0,1)^\top\), \(\mathbf{v}_2=(0,1,1)^\top\), and \(\mathbf{v}_3=(1,1,2)^\top\). The coefficients \(\mathbf{c}=(1,1,-1)^\top\) give the relation

$$ \mathbf{v}_1+\mathbf{v}_2-\mathbf{v}_3 =(1,0,1)^\top+(0,1,1)^\top-(1,1,2)^\top =(0,0,0)^\top. $$

Now choose \(\pi(1)=3,\ \pi(2)=1,\ \pi(3)=2\). The reordered list is \((\mathbf{v}_3,\mathbf{v}_1,\mathbf{v}_2)\). Its coefficients must be \(d_1=c_3=-1,\ d_2=c_1=1,\ d_3=c_2=1\), so \(\mathbf{d}=(-1,1,1)^\top\). Substituting gives

$$ -\mathbf{v}_3+\mathbf{v}_1+\mathbf{v}_2 =-(1,1,2)^\top+(1,0,1)^\top+(0,1,1)^\top =(0,0,0)^\top. $$

The reordered relation checks directly, and its coefficients are the original coefficients read in the order \(3,1,2\).

Independence Is Invariant Under Reordering

Theorem: A finite list of vectors in \(\mathbb{R}^n\) is linearly independent if and only if every reordering of that list is linearly independent.

Proof. Fix a permutation \(\pi\), and let \(\mathbf{w}_i=\mathbf{v}_{\pi(i)}\). By the proposition, the correspondence between coefficient vectors takes relations for the original list to relations for the reordered list and has an inverse. Furthermore, the reordered coefficient vector \(\mathbf{d}\) has all entries zero exactly when the original coefficient vector \(\mathbf{c}\) has all entries zero: the entries of \(\mathbf{d}\) are precisely the entries of \(\mathbf{c}\), each used once. If the original list is independent, every original relation has only zero coefficients, so every reordered relation also has only zero coefficients. Thus the reordered list is independent. Conversely, if the reordered list is independent, the inverse correspondence shows that every original relation has only zero coefficients, so the original list is independent. The empty list is independent by the definition, since there are no coefficients that could form a nontrivial relation. \(\square\)

The statement is an “if and only if,” not merely a one-way implication. A permutation can be undone, so independence cannot be lost in one direction or gained in the other. The same reasoning shows that dependence is also unchanged: any nontrivial relation remains nontrivial because reordering its coefficients cannot turn a nonzero coefficient into zero.

Worked Example: Reordering an Independent List

Let \(\mathbf{u}_1=(1,0,1)^\top\) and \(\mathbf{u}_2=(0,1,1)^\top\). First check independence directly. If \(a\mathbf{u}_1+b\mathbf{u}_2=\mathbf{0}\), then

$$ a(1,0,1)^\top+b(0,1,1)^\top =(a,b,a+b)^\top=(0,0,0)^\top. $$

Equality of the first and second coordinates gives \(a=0\) and \(b=0\). Thus the original list is independent. Now reorder it as \((\mathbf{u}_2,\mathbf{u}_1)\), so \(\pi(1)=2,\ \pi(2)=1\). For a relation \(d_1\mathbf{u}_2+d_2\mathbf{u}_1=\mathbf{0}\), the coordinates give

$$ d_1(0,1,1)^\top+d_2(1,0,1)^\top =(d_2,d_1,d_1+d_2)^\top =(0,0,0)^\top. $$

The first two coordinates force \(d_2=0\) and \(d_1=0\). The only relation for the reordered list is therefore the trivial one, which directly confirms independence. Under this permutation, the coefficient vector changes from \((a,b)^\top\) to \((b,a)^\top\); in particular, the zero coefficient vector remains zero.

Reading Coefficients Backward

When a relation is given for the reordered list, it can be useful to recover the original one explicitly. The safe procedure is to locate each vector and carry its coefficient with it. In a list with repeated vectors, keep track of positions rather than matching vectors by their values: two equal vectors can occupy different positions and have different coefficients in a relation.

Worked Example: Recovering the Original Relation

Let \(\mathbf{v}_1=(1,2)^\top,\ \mathbf{v}_2=(2,4)^\top,\ \mathbf{v}_3=(0,1)^\top\). An original relation is given by \(\mathbf{c}=(2,-1,0)^\top\), since

$$ 2\mathbf{v}_1-\mathbf{v}_2+0\mathbf{v}_3 =2(1,2)^\top-(2,4)^\top+(0,0)^\top =(0,0)^\top. $$

Reorder by \(\pi(1)=3,\ \pi(2)=1,\ \pi(3)=2\), giving \((\mathbf{v}_3,\mathbf{v}_1,\mathbf{v}_2)\). The new coefficient vector is \(\mathbf{d}=(c_3,c_1,c_2)^\top=(0,2,-1)^\top\). Checking it in the new order gives

$$ 0\mathbf{v}_3+2\mathbf{v}_1-\mathbf{v}_2 =0(0,1)^\top+2(1,2)^\top-(2,4)^\top =(0,0)^\top. $$

To recover the original coefficients from \(\mathbf{d}\), note that \(\pi^{-1}(1)=2,\ \pi^{-1}(2)=3,\ \pi^{-1}(3)=1\). Therefore \(c_1=d_2=2,\ c_2=d_3=-1,\ c_3=d_1=0\), which recovers \(\mathbf{c}=(2,-1,0)^\top\). This relation is nontrivial both before and after reordering: it has nonzero coefficients on \(\mathbf{v}_1\) and \(\mathbf{v}_2\), and the reordered relation has the same two nonzero coefficients attached to those same vectors.

Common Mistake: Moving the Vectors but Not the Coefficients

A frequent error is to reorder the vectors and then leave the coefficient list in its old order. Use the preceding example to see why this fails. The original coefficient list is \((2,-1,0)\), but after the permutation \(3,1,2\), the reordered list is \((\mathbf{v}_3,\mathbf{v}_1,\mathbf{v}_2)\). Leaving the coefficients unchanged would incorrectly claim that

$$ 2\mathbf{v}_3-\mathbf{v}_1+0\mathbf{v}_2 =2(0,1)^\top-(1,2)^\top =(-1,0)^\top=\mathbf{0}. $$

The final equality is false: \((-1,0)^\top\ne\mathbf{0}\). The correction is to move each coefficient with its original vector. The coefficient \(0\) belonged to \(\mathbf{v}_3\), now first; \(2\) belonged to \(\mathbf{v}_1\), now second; and \(-1\) belonged to \(\mathbf{v}_2\), now third. The correct coefficients are \((0,2,-1)\), and substitution gives \(0\mathbf{v}_3+2\mathbf{v}_1-\mathbf{v}_2=(0,0)^\top\).

This is also why a list should not be treated as a set. A set records which vectors are present, but not their positions or the coefficients attached to those positions. A list records both. If two entries are equal, swapping them may leave the displayed vector values looking unchanged, but the coefficient positions still follow the permutation. The correspondence in the proposition works by indices and remains valid in that case.

Using the Result

The practical value of the theorem is that an independence question can be answered in whichever order is most convenient. For example, one may reorder a list to put a useful vector first, group similar vectors together, or match a list to a familiar coordinate pattern. The proof guarantees that such rearrangements do not alter the answer. It does not claim that every calculation has the same appearance after reordering: the coefficients in a relation change positions, and a row-reduction calculation may show pivots in different columns. What stays the same is whether a nontrivial dependence relation exists.

When a relation is known, use the following sequence to avoid mistakes:

  1. Write the permutation as a list of source indices, \(\pi(1),\ldots,\pi(p)\).
  2. Write the reordered vectors as \(\mathbf{v}_{\pi(1)},\ldots,\mathbf{v}_{\pi(p)}\).
  3. Read the new coefficients in exactly that same order: \(d_i=c_{\pi(i)}\).
  4. Substitute the new coefficients and vectors to check that their sum is still \(\mathbf{0}\).

If instead the reordered coefficients are known and the original ones are needed, use the inverse rule \(c_j=d_{\pi^{-1}(j)}\). These formulas preserve all coefficients, including zero coefficients; omitting a zero can obscure which vector position it belonged to.

Check Your Understanding

For each question, keep the index positions visible and check any proposed relation by substitution.

  1. If \(\pi(1)=2,\ \pi(2)=3,\ \pi(3)=1\) and \(\mathbf{c}=(4,0,-2)^\top\), what is the coefficient vector for the reordered list?
  2. A relation for an original list has coefficients \((1,-3,2)^\top\). The reordered list is \((\mathbf{v}_3,\mathbf{v}_1,\mathbf{v}_2)\). Write the matching relation coefficients in the new order.
  3. Explain why the coefficient correspondence for a permutation cannot take a nontrivial relation to the trivial relation.
  4. If a list is dependent, what does the theorem imply about every reordering? State how the dependence coefficients change.
  5. For the original coefficients \((2,-1,0)^\top\) and permutation \(3,1,2\), use the inverse permutation to recover the original coefficients from the reordered vector \((0,2,-1)^\top\).

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon