Tutorials › Multivariate Statistics (Graduate) › Schur Complements and Block Matrix Definiteness

Matrix Foundations for Inference · Tutorial 8 of 975

Schur Complements and Block Matrix Definiteness

Learn to eliminate blocks, compute inverses, and test positive definiteness using Schur complements.

Beginner 9 min read

What You'll Learn

  • Define the Schur complement of an invertible diagonal block.
  • Derive the block inverse formula from a block factorization.
  • Use a quadratic-form decomposition to test positive definiteness.
  • Compute Schur complements and inverses in scalar and matrix examples.
  • Recognize why changing the pivot block changes the calculation.

Why Block Elimination Matters

A matrix written in blocks can often be simplified by eliminating one group of variables while retaining an exact description of what remains. The Schur complement is the matrix left behind by this elimination. It appears naturally in block inverse calculations and, for symmetric matrices, gives a precise test for positive definiteness. The key is to keep track of which block is being eliminated and to check that it is invertible.

Definition and Block Elimination

Let \(A\) be a \(p\times p\) invertible matrix, \(B\) a \(p\times q\) matrix, \(C\) a \(q\times p\) matrix, and \(D\) a \(q\times q\) matrix. Partition a square matrix \(M\) conformably:

$$ M=\begin{bmatrix}A&B\\C&D\end{bmatrix}. $$

The Schur complement of \(A\) in \(M\) is the \(q\times q\) matrix \(D-CA^{-1}B\). It describes the lower-right block after eliminating the terms that couple it to the \(A\) block. In the symmetric case, where \(C=B^{T}\), this complement is \(D-B^{T}A^{-1}B\).

Definition: If \(A\) is invertible, the Schur complement of \(A\) in \(M\) is \(S_A=D-CA^{-1}B\). If instead \(D\) is invertible, the Schur complement of \(D\) in \(M\) is \(S_D=A-BD^{-1}C\). The two definitions use different pivot blocks and are not interchangeable without changing the calculation.

The elimination can be seen directly by multiplying by block triangular matrices. When \(A\) is invertible,

$$ \begin{bmatrix}I&0\\-CA^{-1}&I\end{bmatrix} \begin{bmatrix}A&B\\C&D\end{bmatrix} = \begin{bmatrix}A&B\\0&D-CA^{-1}B\end{bmatrix}. $$

The lower-left block becomes zero because \(-CA^{-1}A+C=0\). The lower-right block is \(D-CA^{-1}B\), exactly the Schur complement. This is the block analogue of eliminating entries below a pivot in ordinary Gaussian elimination.

Worked Example: Computing a Schur Complement

Consider \(M=\begin{bmatrix}2&1\\3&4\end{bmatrix}\), with the upper-left entry as the pivot block. Here \(A=2\), \(B=1\), \(C=3\), and \(D=4\), so \(A^{-1}=1/2\). The Schur complement is

$$ S_A=D-CA^{-1}B=4-3\left(\frac12\right)(1)=\frac52. $$

Elimination confirms the result: \(\begin{bmatrix}1&0\\-3/2&1\end{bmatrix}M =\begin{bmatrix}2&1\\0&5/2\end{bmatrix}\). The pivot block is invertible, and the remaining diagonal block after elimination is \(5/2\).

Block Inverse Formula

Elimination also gives an inverse formula. The formula requires both \(A\) and its Schur complement \(S_A\) to be invertible. Invertibility of \(A\) alone does not guarantee that \(M\) is invertible.

Theorem: Suppose \(A\) is invertible and \(S_A=D-CA^{-1}B\) is invertible. Then \(M\) is invertible, and
$$ M^{-1}= \begin{bmatrix} A^{-1}+A^{-1}BS_A^{-1}CA^{-1}&-A^{-1}BS_A^{-1}\\ -S_A^{-1}CA^{-1}&S_A^{-1} \end{bmatrix}. $$

To prove the formula, factor \(M\) using the Schur complement:

$$ M= \begin{bmatrix}I&0\\CA^{-1}&I\end{bmatrix} \begin{bmatrix}A&B\\0&S_A\end{bmatrix}. $$

Multiplying the factors gives top row \([A\ \ B]\) and bottom row \([C\ \ CA^{-1}B+S_A]=[C\ \ D]\), as required. The second factor can be written as \(\begin{bmatrix}A&0\\0&S_A\end{bmatrix} \begin{bmatrix}I&A^{-1}B\\0&I\end{bmatrix}\). All three factors are invertible under the stated assumptions. Their inverses, in reverse order, are

$$ \begin{bmatrix}I&-A^{-1}B\\0&I\end{bmatrix} \begin{bmatrix}A^{-1}&0\\0&S_A^{-1}\end{bmatrix} \begin{bmatrix}I&0\\-CA^{-1}&I\end{bmatrix}. $$

Multiplying these three matrices gives the displayed block inverse: the upper-left block is \(A^{-1}+A^{-1}BS_A^{-1}CA^{-1}\), the upper-right is \(-A^{-1}BS_A^{-1}\), the lower-left is \(-S_A^{-1}CA^{-1}\), and the lower-right is \(S_A^{-1}\). Thus the product is the inverse of \(M\). \(\square\)

Worked Example: Inverting a Scalar-Block Matrix

Let \(M=\begin{bmatrix}4&1\\1&3\end{bmatrix}\). Take \(A=4\), so \(A^{-1}=1/4\), and calculate \(S_A=3-(1)(1/4)(1)=11/4\), hence \(S_A^{-1}=4/11\). The formula gives

$$ M^{-1}= \begin{bmatrix} \frac14+\frac14(1)\frac4{11}(1)\frac14& -\frac14(1)\frac4{11}\\ -\frac4{11}(1)\frac14&\frac4{11} \end{bmatrix} = \begin{bmatrix}\frac3{11}&-\frac1{11}\\-\frac1{11}&\frac4{11}\end{bmatrix}. $$

Check by multiplication: \(\begin{bmatrix}4&1\\1&3\end{bmatrix} \begin{bmatrix}3/11&-1/11\\-1/11&4/11\end{bmatrix} =\begin{bmatrix}1&0\\0&1\end{bmatrix}\). For example, the upper-left entry is \((12-1)/11=1\), and the upper-right entry is \((-4+4)/11=0\); the other two entries are \((3-3)/11=0\) and \((-1+12)/11=1\).

Positive Definiteness Through the Schur Complement

For a symmetric block matrix, the Schur complement has a second use: it separates a quadratic form into a contribution from the pivot block and a contribution from the remaining variables. That decomposition gives an exact criterion for positive definiteness.

Theorem: Let \(M=\begin{bmatrix}A&B\\B^{T}&D\end{bmatrix}\) be symmetric, with \(A\) invertible, and define \(S_A=D-B^{T}A^{-1}B\). Then \(M\) is positive definite if and only if both \(A\) and \(S_A\) are positive definite.

For the proof, symmetry of \(A\) and its invertibility imply that \(A^{-1}\) is symmetric. Direct block multiplication gives the congruence factorization

$$ M= \begin{bmatrix}I&0\\B^{T}A^{-1}&I\end{bmatrix} \begin{bmatrix}A&0\\0&S_A\end{bmatrix} \begin{bmatrix}I&A^{-1}B\\0&I\end{bmatrix}. $$

The first and third factors are transposes of one another, and the third factor is invertible. For any vectors \(x\in\mathbb{R}^{p}\) and \(y\in\mathbb{R}^{q}\), this yields

$$ \begin{bmatrix}x\\y\end{bmatrix}^{T} M \begin{bmatrix}x\\y\end{bmatrix} = (x+A^{-1}By)^{T}A(x+A^{-1}By)+y^{T}S_Ay. $$

If \(A\) and \(S_A\) are positive definite, the right-hand side is positive for every nonzero \((x,y)\). Indeed, if \(y\ne0\), its second term is positive and its first term is nonnegative; if \(y=0\) and \(x\ne0\), its first term is positive. Thus \(M\) is positive definite.

Conversely, the congruence factorization shows that \(M\) is positive definite exactly when \(\operatorname{diag}(A,S_A)\) is positive definite: an invertible change of variables preserves strict positivity of the quadratic form. The block diagonal matrix is positive definite exactly when each diagonal block is positive definite. To see necessity, test vectors of the forms \((x,0)\) and \((0,y)\); sufficiency follows by adding the two positive quadratic forms for any nonzero \((x,y)\). Therefore \(A\) and \(S_A\) must both be positive definite. \(\square\)

The same criterion can be applied by pivoting on \(D\) instead, when \(D\) is invertible: \(M\) is positive definite if and only if \(D\) and \(A-BD^{-1}B^{T}\) are positive definite. The choice of pivot is a calculation choice; it does not change the matrix being tested.

Worked Example: Testing Positive Definiteness with a Matrix Block

Consider \(M=\begin{bmatrix}2&0&1\\0&1&1\\1&1&2\end{bmatrix}\), partitioned with \(A=\begin{bmatrix}2&0\\0&1\end{bmatrix}\), \(B=\begin{bmatrix}1\\1\end{bmatrix}\), and \(D=2\). The block \(A\) is positive definite because its diagonal entries are positive. Its inverse is \(A^{-1}=\begin{bmatrix}1/2&0\\0&1\end{bmatrix}\). Therefore

$$ S_A=2- \begin{bmatrix}1&1\end{bmatrix} \begin{bmatrix}1/2&0\\0&1\end{bmatrix} \begin{bmatrix}1\\1\end{bmatrix} =2-\left(\frac12+1\right)=\frac12. $$

Since the one-by-one matrix \([1/2]\) is positive definite, the criterion proves that \(M\) is positive definite. The quadratic-form decomposition makes the conclusion explicit. For \(x=(x_1,x_2)^{T}\) and scalar \(y\),

$$ \begin{bmatrix}x\\y\end{bmatrix}^{T}M\begin{bmatrix}x\\y\end{bmatrix} =2\left(x_1+\frac y2\right)^2+(x_2+y)^2+\frac12y^2. $$

If \(y\ne0\), the last term is positive. If \(y=0\) and \(x\ne0\), at least one of the first two terms is positive. Hence the quadratic form is strictly positive for every nonzero vector.

Worked Example: A Positive Pivot Does Not Guarantee Positive Definiteness

Let \(M=\begin{bmatrix}1&2\\2&1\end{bmatrix}\), and pivot on \(A=1\). The pivot is positive, but its Schur complement is \(S_A=1-2(1)^{-1}2=-3\). The criterion therefore rules out positive definiteness. In fact, the quadratic form at \((x,y)=(-2,1)\) is

$$ \begin{bmatrix}-2&1\end{bmatrix} M \begin{bmatrix}-2\\1\end{bmatrix} =4-8+1=-3<0. $$

The negative value directly confirms the failure of positive definiteness. This example shows why checking the pivot block alone is not enough: the Schur complement must also be positive definite.

Common Pitfalls and Practical Use

A frequent error is to call \(D-CA^{-1}B\) “the” complement without saying which block was eliminated. The expression is the Schur complement of \(A\), and it requires \(A\) to be invertible. If the partition or pivot changes, the appropriate formula changes too. Dimensions provide a useful check: \(CA^{-1}B\) must have the same \(q\times q\) dimensions as \(D\).

Another mistake is to infer that a symmetric block matrix is positive definite merely because \(A\) is positive definite. The worked example with \(M=\begin{bmatrix}1&2\\2&1\end{bmatrix}\) disproves that inference. The exact test requires both \(A\) and \(S_A\) to be positive definite. The theorem is stated for strict positive definiteness with an invertible pivot; it should not be transferred unchanged to singular pivots or to a positive-semidefinite claim.

Schur complements matter because they turn block calculations into familiar smaller-matrix calculations. They can reduce an inverse problem to two inverses, identify whether a symmetric block matrix is positive definite, and clarify how coupling between blocks changes the remaining quadratic form. In applications, blocks often represent different groups of variables or parameters; eliminating one group leaves the adjusted contribution of the others in the Schur complement.

Key takeaway: Choose an invertible pivot block, eliminate it, and compute the corresponding Schur complement. For a symmetric matrix with a positive-definite pivot, the whole matrix is positive definite exactly when the Schur complement is positive definite as well.

Check Your Understanding

Work through these questions, keeping the choice of pivot explicit.

  1. For \(M=\begin{bmatrix}3&2\\1&5\end{bmatrix}\), compute the Schur complement of the upper-left block.
  2. State the two invertibility conditions needed for the block inverse formula using \(S_A\).
  3. For a symmetric block matrix with invertible \(A\), write its Schur complement and state the positive-definiteness criterion.
  4. Why does \(A\) positive definite, by itself, not establish that \(M\) is positive definite?
  5. If the lower-right block is chosen as the pivot, what is the corresponding Schur complement?
Clinical Biostats