Tutorials › Linear Algebra › Triangular Coordinate Patterns and Independence

Linear Independence · Tutorial 179 of 1000

Triangular Coordinate Patterns and Independence

Use triangular structure to test independence by solving the associated homogeneous system in a deliberate order.

Beginner 9 min read

What You'll Learn

  • Recognize upper- and lower-triangular coordinate matrices.
  • Translate a list of vectors into a homogeneous matrix equation.
  • Prove independence by solving upper-triangular equations from the last row upward.
  • Understand why a zero diagonal entry in a square triangular matrix gives dependence.
  • Check parameter-dependent triangular lists without full row reduction.
  • Avoid solving triangular systems in an order that leaves later equations unchecked.

Reading Independence from a Triangular Pattern

When a list of vectors is placed into a matrix as columns, its independence is determined by the solutions of a homogeneous system. Sometimes the coordinate matrix has a pattern that makes a full row reduction unnecessary. In an upper-triangular matrix, each row equation involves a coefficient and only the coefficients to its right. Starting with the last equation and working upward can therefore settle independence directly.

Throughout, the vectors and scalars are in \(\mathbb{R}^n\) and \(\mathbb{R}\), respectively. For a list \(\mathbf{v}_1,\dots,\mathbf{v}_n\), put the vectors into the columns of the square matrix \(\mathbf{A}=\begin{bmatrix}\mathbf{v}_1&\cdots&\mathbf{v}_n\end{bmatrix}\). The list is linearly independent exactly when the equation \(\mathbf{A}\mathbf{c}=\mathbf{0}\), where \(\mathbf{c}=(c_1,\dots,c_n)^{\top}\), has only the solution \(\mathbf{c}=\mathbf{0}\). This follows directly from the definition of linear independence.

Definition: A square matrix \(\mathbf{A}=(a_{ij})\in\mathbb{R}^{n\times n}\) is upper triangular if \(a_{ij}=0\) whenever \(i>j\). It is lower triangular if \(a_{ij}=0\) whenever \(i<j\). Its diagonal entries are \(a_{11},a_{22},\dots,a_{nn}\).

For an upper-triangular matrix, row \(i\) of \(\mathbf{A}\mathbf{c}=\mathbf{0}\) has the form \(a_{ii}c_i+a_{i,i+1}c_{i+1}+\cdots+a_{in}c_n=0\). Thus, if every diagonal entry is nonzero, the last equation forces \(c_n=0\). The equation above it then forces \(c_{n-1}=0\), and this continues upward. The following result makes the test precise.

Proposition: If \(\mathbf{A}\in\mathbb{R}^{n\times n}\) is upper triangular and every diagonal entry is nonzero, then its columns are linearly independent.

Proof. Suppose \(\mathbf{A}\mathbf{c}=\mathbf{0}\). The last row equation is \(a_{nn}c_n=0\). Since \(a_{nn}\ne0\), it follows that \(c_n=0\). Now suppose, for some \(i<n\), that \(c_{i+1}=\cdots=c_n=0\). Row \(i\) gives \(a_{ii}c_i=0\), because every term involving a later coefficient vanishes. Since \(a_{ii}\ne0\), we get \(c_i=0\). Applying this argument successively for \(i=n-1,n-2,\dots,1\) gives \(\mathbf{c}=\mathbf{0}\). The homogeneous system therefore has only the trivial solution, so the columns are independent. \(\square\)

Solving an Upper-Triangular System from the Bottom

The procedure in the proof is backward substitution: use the last row first, then move to the row immediately above it. At each stage, the coefficients already found to be zero remove the later terms from the current equation. The order matters; beginning with the first row may leave several unknown coefficients mixed together. A worked calculation shows how the pattern matches the definition.

Worked Example: An Upper-Triangular Coordinate Matrix

Determine whether the columns of the following matrix are linearly independent:

$$ \mathbf{A}= \begin{bmatrix} 2&1&3\\ 0&-1&4\\ 0&0&5 \end{bmatrix}. $$

Its columns are \(\mathbf{v}_1=(2,0,0)^{\top}\), \(\mathbf{v}_2=(1,-1,0)^{\top}\), and \(\mathbf{v}_3=(3,4,5)^{\top}\). To test independence, solve \(\mathbf{A}\mathbf{c}=\mathbf{0}\):

$$ \begin{aligned} 2c_1+c_2+3c_3&=0,\\ -c_2+4c_3&=0,\\ 5c_3&=0. \end{aligned} $$

The last equation gives \(c_3=0\). Substituting into the second gives \(-c_2+4(0)=0\), so \(c_2=0\). Substituting \(c_2=c_3=0\) into the first gives \(2c_1=0\), so \(c_1=0\). The only solution is \((c_1,c_2,c_3)=(0,0,0)\), and the columns are independent.

Check: Substitution into the original matrix equation gives

$$ \begin{bmatrix} 2&1&3\\ 0&-1&4\\ 0&0&5 \end{bmatrix} \begin{bmatrix}0\\0\\0\end{bmatrix} = \begin{bmatrix}0\\0\\0\end{bmatrix}. $$

Each diagonal entry is nonzero, as the proposition predicts.

The test also handles parameters: an upper-triangular pattern remains useful even when one diagonal entry depends on a scalar. When that entry vanishes, the equations may permit a nonzero coefficient vector. The next result shows that for a square triangular matrix, this is not just a limitation of the test: a zero on the diagonal really does mean dependence.

Theorem: The columns of an upper-triangular matrix \(\mathbf{A}\in\mathbb{R}^{n\times n}\) are linearly independent if and only if every diagonal entry of \(\mathbf{A}\) is nonzero.

Proof. The proposition proves that nonzero diagonal entries imply independence. For the converse, we prove by induction on \(n\) that if an upper-triangular matrix has a zero diagonal entry, then its columns are dependent. When \(n=1\), a zero diagonal entry makes the matrix \([0]\), whose single column is the zero vector, so its columns are dependent.

Now let \(n>1\), and write the matrix in block form as

$$ \mathbf{A}= \begin{bmatrix} a_{11}&\mathbf{r}\\ \mathbf{0}&\mathbf{B} \end{bmatrix}, $$

where \(\mathbf{r}\) is a row and \(\mathbf{B}\) is an \((n-1)\times(n-1)\) upper-triangular matrix. If \(a_{11}=0\), the first column of \(\mathbf{A}\) is \(\mathbf{0}\), so the columns are dependent. If \(a_{11}\ne0\), the assumed zero diagonal entry must occur in \(\mathbf{B}\). By the induction hypothesis, there is a nonzero vector \(\mathbf{y}\) with \(\mathbf{B}\mathbf{y}=\mathbf{0}\). Define \(x_1=-\mathbf{r}\mathbf{y}/a_{11}\) and \(\mathbf{x}=(x_1,\mathbf{y}^{\top})^{\top}\). Then \(\mathbf{x}\ne\mathbf{0}\), since \(\mathbf{y}\ne\mathbf{0}\), and block multiplication gives

$$ \mathbf{A}\mathbf{x} = \begin{bmatrix} a_{11}x_1+\mathbf{r}\mathbf{y}\\ \mathbf{B}\mathbf{y} \end{bmatrix} = \begin{bmatrix} a_{11}\left(-\dfrac{\mathbf{r}\mathbf{y}}{a_{11}}\right)+\mathbf{r}\mathbf{y}\\ \mathbf{0} \end{bmatrix} = \mathbf{0}. $$

Thus the homogeneous system has a nonzero solution, so the columns are dependent. This proves that independence requires every diagonal entry to be nonzero, completing both directions. \(\square\)

Examples with Parameters and a Different Orientation

A diagonal entry that varies with a parameter identifies exactly where the triangular independence test changes its conclusion. At the exceptional value, it is useful to produce and check a specific dependence relation rather than stop at the test.

Worked Example: A Parameter on the Diagonal

For which real values of \(t\) are the columns of this matrix independent?

$$ \mathbf{A}= \begin{bmatrix} 2&1&0\\ 0&t-1&4\\ 0&0&3 \end{bmatrix}. $$

For \(\mathbf{A}\mathbf{c}=\mathbf{0}\), the equations are \(2c_1+c_2=0\), \((t-1)c_2+4c_3=0\), and \(3c_3=0\). The last equation gives \(c_3=0\). If \(t\ne1\), the second then gives \(c_2=0\), and the first gives \(c_1=0\). The columns are independent for \(t\ne1\).

If \(t=1\), the equations instead reduce to \(2c_1+c_2=0\), \(4c_3=0\), and \(3c_3=0\). Taking \(c_1=1\), \(c_2=-2\), and \(c_3=0\) satisfies all three equations and gives a nonzero solution. The columns are dependent at \(t=1\).

Check: At \(t=1\), the first two columns are \((2,0,0)^{\top}\) and \((1,0,0)^{\top}\). Their relation is \(\mathbf{v}_1-2\mathbf{v}_2=\mathbf{0}\), since \((2,0,0)^{\top}-2(1,0,0)^{\top}=(0,0,0)^{\top}\). This confirms the dependence.

For a lower-triangular matrix, the equations have the reverse pattern: row \(i\) involves \(c_1,\dots,c_i\). With nonzero diagonal entries, one starts at the first row and works downward. This is the same coordinate reasoning in the opposite direction.

Worked Example: A Lower-Triangular Coordinate Matrix

Test the columns of \(\mathbf{B}\) for independence, where

$$ \mathbf{B}= \begin{bmatrix} 2&0&0\\ 3&4&0\\ -1&2&3 \end{bmatrix}. $$

The homogeneous equations are \(2c_1=0\), \(3c_1+4c_2=0\), and \(-c_1+2c_2+3c_3=0\). From the first equation, \(c_1=0\). The second then gives \(4c_2=0\), so \(c_2=0\). The third becomes \(3c_3=0\), so \(c_3=0\). Hence the columns are independent.

Check: The solution found satisfies the original system because

$$ \begin{bmatrix} 2&0&0\\ 3&4&0\\ -1&2&3 \end{bmatrix} \begin{bmatrix}0\\0\\0\end{bmatrix} = \begin{bmatrix}0\\0\\0\end{bmatrix}. $$

Here the order of substitution is top to bottom, matching the lower-triangular pattern.

Common Mistake: Starting at the Wrong End

For an upper-triangular matrix, using the first row first does not by itself determine the first coefficient, because that row can involve all the coefficients to its right. For example, consider the equation \(\mathbf{A}\mathbf{c}=\mathbf{0}\) with

$$ \mathbf{A}= \begin{bmatrix} 1&2\\ 0&3 \end{bmatrix}. $$

A wrong calculation starts with the first row, chooses \(c_1=1\), and uses \(c_1+2c_2=0\) to obtain \(c_2=-\tfrac12\). But this proposed vector does not solve the system: the second row gives \(3c_2=-\tfrac32\ne0\). The correction is to start with the last row. It forces \(3c_2=0\), so \(c_2=0\); the first row then forces \(c_1=0\). The order of substitution is part of the method, not a cosmetic choice.

The diagonal test is especially useful when the zero pattern is already visible in the coordinate matrix: it can decide independence without calculating a reduced row echelon form. It is specific to triangular square matrices. A nonzero diagonal in a general, non-triangular matrix is not by itself enough to apply this argument, because the equations may mix coefficients without the one-directional pattern used in substitution. For a triangular matrix with a zero diagonal entry, the theorem gives the opposite conclusion: its columns are dependent.

Check Your Understanding

For each question, use the coordinate equations and check any proposed dependence relation in the original matrix equation.

  1. Are the columns of \(\begin{bmatrix}1&-2&4\\0&3&5\\0&0&-1\end{bmatrix}\) independent? State the order in which you solve for the coefficients.
  2. For which real values of \(t\) are the columns of \(\begin{bmatrix}1&2\\0&t+3\end{bmatrix}\) independent?
  3. Find a nonzero solution of \(\mathbf{A}\mathbf{c}=\mathbf{0}\) when \(\mathbf{A}=\begin{bmatrix}2&1\\0&0\end{bmatrix}\), and verify it by multiplication.
  4. Explain why the first row of an upper-triangular homogeneous system is generally not the best equation to use first.
  5. For a lower-triangular matrix with all diagonal entries nonzero, should the homogeneous equations be solved from top to bottom or bottom to top? Explain using the zero pattern.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon