Tutorials › Linear Algebra › Leading Principal Minors and No-Pivot Breakdown

LU Factorization and Numerical Considerations · Tutorial 906 of 1000

Leading Principal Minors and No-Pivot Breakdown

Use leading principal minors to predict no-pivot elimination, identify where a zero pivot occurs, and understand what that pivot does—and does not—prevent.

Intermediate 12 min read

What You'll Learn

  • Define leading principal submatrices and their determinants.
  • Relate each elimination pivot to consecutive leading principal minors.
  • Test whether elimination can use nonzero pivots without row exchanges.
  • Compute and verify an LU factorization from elimination.
  • Distinguish an interior zero-pivot breakdown from a zero final pivot.
  • Avoid mistaking a nonzero determinant for a sufficient no-pivot test.

Leading Principal Minors Record the Pivots

Gaussian elimination without row exchanges depends on the entries that appear on the diagonal as elimination proceeds. If one of these pivot entries is zero, the usual multiplier—an entry below the pivot divided by the pivot—is undefined. The determinants of the leading principal submatrices give a way to check these pivots in advance. They record not just whether the whole matrix is singular, but where a no-pivot elimination process first encounters trouble.

Let \(\mathbf{A}\in\mathbb{R}^{n\times n}\). For \(1\leq k\leq n\), its leading principal submatrix of order \(k\) is the \(k\times k\) matrix formed from the first \(k\) rows and first \(k\) columns. Its determinant is called the leading principal minor of order \(k\). Write this determinant as \(\Delta_k\), and set \(\Delta_0=1\) by convention. Thus \(\Delta_n=\det\mathbf{A}\), but the earlier \(\Delta_k\) contain information that \(\det\mathbf{A}\) alone does not.

$$ \Delta_k=\det\begin{bmatrix} a_{11}&\cdots&a_{1k}\\ \vdots&\ddots&\vdots\\ a_{k1}&\cdots&a_{kk} \end{bmatrix}. $$

We use the standard determinant facts that replacing a row by itself plus a multiple of another row preserves the determinant, and that the determinant of a triangular matrix is the product of its diagonal entries. In elimination, let \(p_k\) denote the pivot at step \(k\), after the first \(k-1\) columns have been eliminated below their pivots. When the preceding pivots are nonzero, the relationship is

$$ \Delta_k=p_1p_2\cdots p_k, \qquad p_k=\frac{\Delta_k}{\Delta_{k-1}}. $$

The quotient formula applies only when \(\Delta_{k-1}\ne0\), so the earlier pivots have been defined and are nonzero. The product formula explains why the minors detect the successive pivots.

Theorem (Leading principal minor test for nonzero pivots): Let \(\mathbf{A}\in\mathbb{R}^{n\times n}\), and let \(\Delta_k\) be its leading principal minors. Elimination without row exchanges has a nonzero pivot at every step \(k=1,\dots,n\) if and only if \(\Delta_k\ne0\) for every \(k=1,\dots,n\). In that case the pivots satisfy \(p_k=\Delta_k/\Delta_{k-1}\), with \(\Delta_0=1\).

Proof. First suppose elimination has nonzero pivots \(p_1,\dots,p_n\). For any \(k\), perform the first \(k-1\) elimination steps within the leading \(k\times k\) block. Each step replaces a row by itself plus a multiple of another row, so its determinant remains \(\Delta_k\). After those steps, the leading block is upper triangular, with diagonal entries \(p_1,\dots,p_k\). Its determinant is their product. Therefore \(\Delta_k=p_1\cdots p_k\ne0\). Dividing the product for \(\Delta_k\) by the product for \(\Delta_{k-1}\) gives \(p_k=\Delta_k/\Delta_{k-1}\).

Conversely, suppose every \(\Delta_k\ne0\). We show successively that each pivot exists and is nonzero. For \(k=1\), the first pivot is \(p_1=a_{11}=\Delta_1\ne0\). Now suppose the first \(k-1\) pivots have been obtained and are nonzero. The first \(k-1\) elimination steps can therefore be performed. In the resulting leading \(k\times k\) block, the first \(k-1\) diagonal entries are \(p_1,\dots,p_{k-1}\), all entries below those pivots are zero, and the last diagonal entry is the next pivot candidate \(p_k\). The row operations have preserved the determinant, so \(\Delta_k=p_1\cdots p_{k-1}p_k\). Since \(\Delta_k\ne0\) and the previous pivots are nonzero, \(p_k=\Delta_k/\Delta_{k-1}\ne0\). This completes the induction through \(k=n\). \(\square\)

A Successful No-Pivot Factorization

Worked Example: Checking All Three Pivots

For the matrix below, calculate the leading principal minors, carry out elimination without row exchanges, and verify the resulting factorization \(\mathbf{A}=\mathbf{L}\mathbf{U}\).

$$ \mathbf{A}=\begin{bmatrix} 2&1&1\\ 4&3&3\\ 2&2&4 \end{bmatrix}. $$

The first leading principal minor is \(\Delta_1=2\). The second is

$$ \Delta_2=\det\begin{bmatrix}2&1\\4&3\end{bmatrix} =2\cdot3-1\cdot4=2. $$

The full determinant is \(\Delta_3=4\). For example, expansion along the first row gives \(2(12-6)-(16-6)+(8-6)=12-10+2=4\). Since all three leading principal minors are nonzero, the theorem predicts three nonzero pivots: \(p_1=2\), \(p_2=2/2=1\), and \(p_3=4/2=2\).

Check these values by elimination. At the first pivot, the multipliers are \(4/2=2\) and \(2/2=1\). Subtract \(2R_1\) from \(R_2\) and \(R_1\) from \(R_3\):

$$ \begin{bmatrix}2&1&1\\4&3&3\\2&2&4\end{bmatrix} \sim \begin{bmatrix}2&1&1\\0&1&1\\0&1&3\end{bmatrix}. $$

The second pivot is \(1\), with multiplier \(1/1=1\) in row 3. Subtract \(R_2\) from \(R_3\):

$$ \begin{bmatrix}2&1&1\\0&1&1\\0&1&3\end{bmatrix} \sim \begin{bmatrix}2&1&1\\0&1&1\\0&0&2\end{bmatrix} =\mathbf{U}. $$

The multipliers occupy the entries below the diagonal of the unit lower triangular matrix \(\mathbf{L}\), so \(\mathbf{L}=\begin{bmatrix}1&0&0\\2&1&0\\1&1&1\end{bmatrix}\). Multiplying verifies the factorization:

$$ \mathbf{L}\mathbf{U} = \begin{bmatrix} 2&1&1\\ 4&3&3\\ 2&2&4 \end{bmatrix} =\mathbf{A}. $$

For instance, the second row of the product is \(2(2,1,1)+(0,1,1)=(4,3,3)\), and the third is \((2,1,1)+(0,1,1)+(0,0,2)=(2,2,4)\). The pivots also check against the minors: \(\Delta_1=2\), \(\Delta_2=2\cdot1=2\), and \(\Delta_3=2\cdot1\cdot2=4\).

When a Zero Pivot Stops the Process

If \(\Delta_{k-1}\ne0\) but \(\Delta_k=0\), the quotient formula gives a zero pivot at step \(k\). When \(k<n\), this is an interior step: there are rows below the pivot whose entries might need to be eliminated, but the usual multiplier would require division by zero. Without a row exchange or a different method, that no-pivot elimination step cannot be carried out.

Worked Example: A Nonsingular Matrix That Breaks Down at Step Two

Consider

$$ \mathbf{A}=\begin{bmatrix} 1&1&0\\ 1&1&1\\ 0&1&0 \end{bmatrix}. $$

Its first two leading principal minors are \(\Delta_1=1\) and \(\Delta_2=1\cdot1-1\cdot1=0\). The full determinant is \(\Delta_3=-1\): expanding along the first row gives \((1\cdot0-1\cdot1)-(1\cdot0-1\cdot0)=-1\). Thus the matrix is nonsingular, but its second leading principal minor vanishes.

Eliminate below the first pivot, which is \(1\), by subtracting \(R_1\) from \(R_2\):

$$ \begin{bmatrix}1&1&0\\1&1&1\\0&1&0\end{bmatrix} \sim \begin{bmatrix}1&1&0\\0&0&1\\0&1&0\end{bmatrix}. $$

The second pivot is \(0\), while the entry below it in column 2 is \(1\). The required multiplier would be \(1/0\), which is undefined. Therefore elimination without row exchanges breaks down at step two. In terms of minors, \(p_2=\Delta_2/\Delta_1=0/1=0\).

This also rules out a factorization \(\mathbf{A}=\mathbf{L}\mathbf{U}\) with \(\mathbf{L}\) unit lower triangular and \(\mathbf{U}\) upper triangular having nonzero diagonal. More strongly, there is no such factorization even if zero diagonal entries in \(\mathbf{U}\) are allowed. Indeed, for any such triangular factors, the leading \(k\times k\) blocks satisfy \(\mathbf{A}_k=\mathbf{L}_k\mathbf{U}_k\): entries in the first \(k\) rows of a lower triangular matrix are zero in columns greater than \(k\), so the leading block of the product is the product of the leading blocks. Taking determinants gives \(\Delta_k=\prod_{j=1}^k u_{jj}\), because \(\mathbf{L}_k\) has determinant \(1\). Here \(\Delta_1=1\) forces \(u_{11}=1\), while \(\Delta_2=0\) forces \(u_{22}=0\). Then \(\Delta_3=u_{11}u_{22}u_{33}=0\), contradicting \(\Delta_3=-1\).

Why the Full Determinant Is Not Enough

The determinant \(\Delta_n\) answers whether the entire matrix is nonsingular. It does not, by itself, tell us whether the intermediate pivots are nonzero. The previous example has \(\det\mathbf{A}=-1\), yet elimination without row exchanges still fails before reaching the last column. To predict the path of elimination, check the leading principal minors in order, not just the determinant of the full matrix.

Worked Example: A Zero Final Pivot Is Different

Consider the diagonal matrix \(\mathbf{B}=\begin{bmatrix}2&0&0\\0&3&0\\0&0&0\end{bmatrix}\). Its leading principal minors are \(\Delta_1=2\), \(\Delta_2=6\), and \(\Delta_3=0\). The first two pivots, \(2\) and \(3\), are nonzero. The final pivot is \(0=\Delta_3/\Delta_2\).

There is no row below the third pivot, so no elimination of entries below it is needed. The matrix is already upper triangular, and \(\mathbf{B}=\mathbf{I}_3\mathbf{B}\) is an LU factorization. This example distinguishes two claims: a zero pivot before the final stage can obstruct elimination, while a zero in the last diagonal position does not prevent the matrix from being upper triangular or from having an LU factorization. It does mean that not every pivot is nonzero, so the all-nonzero-pivot test fails.

For an invertible matrix, \(\Delta_n\ne0\). Consequently, if some earlier leading principal minor vanishes, there is a first index \(k<n\) with \(\Delta_k=0\); all the preceding minors are nonzero, and the pivot at step \(k\) is zero. This is the characteristic no-pivot breakdown for an invertible matrix. For a singular matrix, the first vanishing minor might instead be \(\Delta_n\), as in the diagonal example, where the final zero does not require an elimination operation.

Takeaway: To guarantee nonzero pivots throughout no-pivot elimination, check \(\Delta_1,\Delta_2,\dots,\Delta_n\) and require each to be nonzero. When \(\Delta_{k-1}\ne0\), the next pivot is \(\Delta_k/\Delta_{k-1}\). If this quotient is zero at an interior step, the usual elimination multiplier cannot be formed. A nonzero determinant alone does not rule out such an earlier zero pivot.

Common Pitfall

Wrong claim: “The matrix is nonsingular, so elimination without row exchanges will have nonzero pivots.” Applying that claim to the matrix in the second worked example would predict success because \(\det\mathbf{A}=-1\ne0\). But after the first valid elimination step, the matrix is \(\begin{bmatrix}1&1&0\\0&0&1\\0&1&0\end{bmatrix}\), whose second pivot is \(0\) and whose entry below that pivot is \(1\). The correction is to check each leading principal minor: \(\Delta_1=1\ne0\), but \(\Delta_2=0\). The full determinant tests nonsingularity; the sequence of leading principal minors tests the successive no-pivot pivots.

Check Your Understanding

Use the leading principal minor test where it applies, and distinguish a zero interior pivot from a zero final pivot.

  1. For \(\begin{bmatrix}3&1\\6&5\end{bmatrix}\), calculate \(\Delta_1,\Delta_2\) and the two pivots predicted by the quotient formula.
  2. Explain why \(\det\mathbf{A}\ne0\) alone does not guarantee that no-pivot elimination succeeds.
  3. If \(\Delta_1,\Delta_2\ne0\) but \(\Delta_3=0\) for a \(3\times3\) matrix, identify the first zero pivot and explain whether it has rows below it.
  4. For \(\mathbf{C}=\begin{bmatrix}1&0&0\\0&4&0\\0&0&0\end{bmatrix}\), state which pivots are nonzero and whether the matrix is already upper triangular.
  5. State the condition on all leading principal minors that guarantees every no-pivot elimination pivot is nonzero.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon