Tutorials › Linear Algebra › Equivalent Forms of Orthogonal Diagonalizability

Symmetric Matrices and the Spectral Theorem · Tutorial 736 of 1000

Equivalent Forms of Orthogonal Diagonalizability

Learn how orthogonal diagonalization is expressed as \(A=QDQ^{\top}\), and why this representation is equivalent to symmetry for real square matrices.

Advanced 10 min read

What You'll Learn

  • Define orthogonal diagonalizability using a real orthogonal matrix and a real diagonal matrix
  • Translate between \(A=QDQ^{\top}\) and \(Q^{\top}AQ=D\)
  • Prove that every orthogonally diagonalizable real matrix is symmetric
  • Use the Spectral Theorem to prove that every real symmetric matrix is orthogonally diagonalizable
  • Distinguish ordinary diagonalizability from orthogonal diagonalizability

Two Equivalent Ways to Describe a Matrix

A real square matrix can be described by its action on coordinates, or by its action along particular directions. Diagonalization expresses the second description: in a suitable basis, the matrix acts by scaling each basis vector. Orthogonal diagonalization requires that basis to be orthonormal, so the change of coordinates preserves lengths and angles. For real matrices, this stronger requirement is not merely a convenient choice: it is exactly what symmetry characterizes.

Throughout, let \(\mathbf{A}\in\mathbb{R}^{n\times n}\), where \(n\in\mathbb{N}\). A real square matrix \(\mathbf{Q}\) is orthogonal if \(\mathbf{Q}^{\top}\mathbf{Q}=\mathbf{I}_n\); for a square matrix this also gives \(\mathbf{Q}\mathbf{Q}^{\top}=\mathbf{I}_n\). A real diagonal matrix has all its off-diagonal entries equal to zero.

Definition: The matrix \(\mathbf{A}\) is orthogonally diagonalizable if there are a real orthogonal matrix \(\mathbf{Q}\) and a real diagonal matrix \(\mathbf{D}\) such that \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\). Equivalently, \(\mathbf{A}\) is similar to a real diagonal matrix by an orthogonal change of coordinates.

The columns of an orthogonal matrix form an orthonormal basis of \(\mathbb{R}^n\). If \(\mathbf{Q}=[\mathbf{q}_1\ \cdots\ \mathbf{q}_n]\) and \(\mathbf{D}=\operatorname{diag}(\lambda_1,\dots,\lambda_n)\), then \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\) says that each column \(\mathbf{q}_j\) is an eigenvector with eigenvalue \(\lambda_j\). In particular, the representation is a matrix form of having an orthonormal basis of eigenvectors.

Changing Between the Two Forms

Proposition: For a real orthogonal matrix \(\mathbf{Q}\) and a real diagonal matrix \(\mathbf{D}\), the equation \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\) holds if and only if \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}=\mathbf{D}\).

Proof. Suppose first that \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\). Multiplying on the left by \(\mathbf{Q}^{\top}\) and on the right by \(\mathbf{Q}\) gives \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}=\mathbf{Q}^{\top}\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\mathbf{Q}=\mathbf{I}_n\mathbf{D}\mathbf{I}_n=\mathbf{D}\). Conversely, suppose \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}=\mathbf{D}\). Multiply on the left by \(\mathbf{Q}\) and on the right by \(\mathbf{Q}^{\top}\). Then \(\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}=\mathbf{Q}\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}\mathbf{Q}^{\top}=\mathbf{I}_n\mathbf{A}\mathbf{I}_n=\mathbf{A}\). Both directions use orthogonality, which gives \(\mathbf{Q}^{\top}\mathbf{Q}=\mathbf{Q}\mathbf{Q}^{\top}=\mathbf{I}_n\). \(\square\)

Worked Example: Reading a Diagonalization in Both Directions

Let \(\mathbf{Q}=\frac{1}{\sqrt{2}}\begin{bmatrix}1&1\\1&-1\end{bmatrix}\) and \(\mathbf{D}=\begin{bmatrix}3&0\\0&1\end{bmatrix}\). Compute \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\), then check the equivalent form \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}=\mathbf{D}\).

The columns of \(\mathbf{Q}\) have squared lengths \((1^2+1^2)/2=1\) and \((1^2+(-1)^2)/2=1\); their dot product is \((1-1)/2=0\). Thus \(\mathbf{Q}^{\top}\mathbf{Q}=\mathbf{I}_2\), and here \(\mathbf{Q}^{\top}=\mathbf{Q}\). First multiply \(\mathbf{Q}\mathbf{D}\):

$$ \mathbf{Q}\mathbf{D} = \frac{1}{\sqrt{2}} \begin{bmatrix}1&1\\1&-1\end{bmatrix} \begin{bmatrix}3&0\\0&1\end{bmatrix} = \frac{1}{\sqrt{2}} \begin{bmatrix}3&1\\3&-1\end{bmatrix}. $$

Now multiply by \(\mathbf{Q}^{\top}\):

$$ \mathbf{A} = \frac12 \begin{bmatrix}3&1\\3&-1\end{bmatrix} \begin{bmatrix}1&1\\1&-1\end{bmatrix} = \begin{bmatrix}2&1\\1&2\end{bmatrix}. $$

To check the reverse form, calculate both products, keeping the factors of \(1/\sqrt{2}\):

$$ \mathbf{A}\mathbf{Q} = \frac{1}{\sqrt{2}} \begin{bmatrix}2&1\\1&2\end{bmatrix} \begin{bmatrix}1&1\\1&-1\end{bmatrix} = \frac{1}{\sqrt{2}} \begin{bmatrix}3&1\\3&-1\end{bmatrix} = \mathbf{Q}\mathbf{D}, $$ $$ \mathbf{Q}^{\top}\mathbf{A}\mathbf{Q} = \mathbf{Q}^{\top}(\mathbf{Q}\mathbf{D}) = \mathbf{D}. $$

The matrix \(\mathbf{A}\) is symmetric, as its two off-diagonal entries are both \(1\), and the computation verifies the stated diagonalization in either form.

The Characterization by Symmetry

Theorem (Orthogonal diagonalization criterion): A real matrix \(\mathbf{A}\in\mathbb{R}^{n\times n}\) is orthogonally diagonalizable if and only if it is symmetric, meaning \(\mathbf{A}^{\top}=\mathbf{A}\).

Proof. First suppose that \(\mathbf{A}\) is orthogonally diagonalizable. Then \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\) for an orthogonal \(\mathbf{Q}\) and a real diagonal \(\mathbf{D}\). Transposing this equation and using the rule \((\mathbf{X}\mathbf{Y})^{\top}=\mathbf{Y}^{\top}\mathbf{X}^{\top}\) gives \((\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top})^{\top}=\mathbf{Q}\mathbf{D}^{\top}\mathbf{Q}^{\top}\). A real diagonal matrix satisfies \(\mathbf{D}^{\top}=\mathbf{D}\), so \(\mathbf{A}^{\top}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}=\mathbf{A}\). Hence \(\mathbf{A}\) is symmetric.

For the reverse direction, suppose that \(\mathbf{A}\) is real and symmetric. The Spectral Theorem, proved by induction on dimension in the earlier material, states that every real symmetric \(n\times n\) matrix has an orthonormal basis of real eigenvectors. Let \(\mathbf{q}_1,\dots,\mathbf{q}_n\) be such a basis, with corresponding real eigenvalues \(\lambda_1,\dots,\lambda_n\). Form \(\mathbf{Q}=[\mathbf{q}_1\ \cdots\ \mathbf{q}_n]\) and \(\mathbf{D}=\operatorname{diag}(\lambda_1,\dots,\lambda_n)\). Orthonormality gives \(\mathbf{Q}^{\top}\mathbf{Q}=\mathbf{I}_n\), and the eigenvector equations \(\mathbf{A}\mathbf{q}_j=\lambda_j\mathbf{q}_j\), one for each \(j\), give \(\mathbf{A}\mathbf{Q}=\mathbf{Q}\mathbf{D}\). Multiplying this equality on the right by \(\mathbf{Q}^{\top}\), and using \(\mathbf{Q}\mathbf{Q}^{\top}=\mathbf{I}_n\), yields \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\). Thus \(\mathbf{A}\) is orthogonally diagonalizable. The two implications prove the equivalence. \(\square\)

This proof uses the Spectral Theorem specifically for a real symmetric matrix; it does not claim that every real matrix has real eigenvalues or an orthonormal eigenbasis. The criterion is an equivalence over \(\mathbb{R}\), with a real diagonal matrix and a real orthogonal matrix. Its reverse implication depends on the existence of the orthonormal eigenbasis guaranteed by that theorem.

Worked Example: A Three-Dimensional Orthogonal Representation

Consider \(\mathbf{Q}=\frac13\begin{bmatrix}1&2&2\\2&1&-2\\-2&2&-1\end{bmatrix}\) and \(\mathbf{D}=\begin{bmatrix}1&0&0\\0&2&0\\0&0&4\end{bmatrix}\). Verify the orthogonality of \(\mathbf{Q}\), compute \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\), and check the resulting representation.

Write the rows of \(3\mathbf{Q}\) as \((1,2,2)\), \((2,1,-2)\), and \((-2,2,-1)\). Each has squared length \(9\); their pairwise dot products are \(2+2-4=0\), \(-2+4-2=0\), and \(-4+2+2=0\). Dividing each row by \(3\) makes the rows orthonormal, so \(\mathbf{Q}\mathbf{Q}^{\top}=\mathbf{I}_3\), and \(\mathbf{Q}\) is orthogonal.

Let \(\mathbf{C}=3\mathbf{Q}\). Since \(\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}=\frac19\mathbf{C}\mathbf{D}\mathbf{C}^{\top}\), the entries can be computed by multiplying each pair of rows with the diagonal weights \(1,2,4\):

$$ \mathbf{A} = \frac19 \begin{bmatrix} 1+8+16&2+4-16&-2+8-8\\ 2+4-16&4+2+16&-4+4+8\\ -2+8-8&-4+4+8&4+8+4 \end{bmatrix} = \frac19 \begin{bmatrix} 25&-10&-2\\ -10&22&8\\ -2&8&16 \end{bmatrix}. $$

The result is symmetric. To check the diagonalization by multiplication, write \(\mathbf{C}=\begin{bmatrix}1&2&2\\2&1&-2\\-2&2&-1\end{bmatrix}\). Then

$$ \mathbf{A}\mathbf{Q} = \frac{1}{27} \begin{bmatrix}25&-10&-2\\-10&22&8\\-2&8&16\end{bmatrix} \begin{bmatrix}1&2&2\\2&1&-2\\-2&2&-1\end{bmatrix} = \frac13 \begin{bmatrix}1&4&8\\2&2&-8\\-2&4&-4\end{bmatrix} = \mathbf{Q}\mathbf{D}. $$

Because \(\mathbf{Q}\mathbf{Q}^{\top}=\mathbf{I}_3\), this check gives \(\mathbf{A}=\mathbf{A}\mathbf{Q}\mathbf{Q}^{\top}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\). Thus the computed symmetric matrix does have the displayed orthogonal diagonalization.

What Symmetry Rules Out

The forward direction of the theorem is a useful test: if a real matrix is not symmetric, it cannot be orthogonally diagonalizable. This does not mean it cannot be diagonalized at all. Ordinary diagonalization allows a change-of-basis matrix that need not be orthogonal, so its columns need not be perpendicular or unit length.

Worked Example: Diagonalizable but Not Orthogonally Diagonalizable

Let \(\mathbf{P}=\begin{bmatrix}1&1\\0&1\end{bmatrix}\) and \(\mathbf{D}=\begin{bmatrix}1&0\\0&2\end{bmatrix}\). Compute \(\mathbf{A}=\mathbf{P}\mathbf{D}\mathbf{P}^{-1}\) and use the criterion to decide whether \(\mathbf{A}\) is orthogonally diagonalizable.

The inverse is \(\mathbf{P}^{-1}=\begin{bmatrix}1&-1\\0&1\end{bmatrix}\), since multiplying it by \(\mathbf{P}\) gives \(\mathbf{I}_2\). Therefore

$$ \mathbf{P}\mathbf{D} = \begin{bmatrix}1&1\\0&1\end{bmatrix} \begin{bmatrix}1&0\\0&2\end{bmatrix} = \begin{bmatrix}1&2\\0&2\end{bmatrix}, \qquad \mathbf{A} = \begin{bmatrix}1&2\\0&2\end{bmatrix} \begin{bmatrix}1&-1\\0&1\end{bmatrix} = \begin{bmatrix}1&1\\0&2\end{bmatrix}. $$

This matrix is diagonalizable by the displayed formula, but it is not symmetric: its \((1,2)\) entry is \(1\), while its \((2,1)\) entry is \(0\). By the orthogonal diagonalization criterion, it is not orthogonally diagonalizable. The calculation also verifies the ordinary diagonalization: multiplying \(\mathbf{P}\mathbf{D}\mathbf{P}^{-1}\) back gives exactly \(\mathbf{A}\).

Common mistake: treating every diagonalization as orthogonal. A tempting but incorrect inference is “\(\mathbf{A}=\mathbf{P}\mathbf{D}\mathbf{P}^{-1}\), so \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\).” In the example, the actual change-of-basis matrix is \(\mathbf{P}=\begin{bmatrix}1&1\\0&1\end{bmatrix}\). Its columns have dot product \(1\), not \(0\), so \(\mathbf{P}\) is not orthogonal and \(\mathbf{P}^{-1}\ne\mathbf{P}^{\top}\). The correction is to check the hypotheses: the symmetric-matrix criterion guarantees an orthogonal diagonalization, while an arbitrary diagonalization does not.

Using the Criterion Efficiently

The theorem turns two different questions into one another. To decide whether a real square matrix could be orthogonally diagonalized, first check whether it is symmetric. If it fails the transpose criterion, the answer is no. If it is symmetric, the Spectral Theorem guarantees an orthogonal diagonalization; actually finding the eigenvalues, eigenvectors, and matrices \(\mathbf{Q}\) and \(\mathbf{D}\) is a separate computational task.

StatementWhat it meansWhat follows
\(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\), with \(\mathbf{Q}\) orthogonal and \(\mathbf{D}\) real diagonalOrthogonal diagonalization\(\mathbf{A}\) is symmetric
\(\mathbf{A}\) is real and symmetric\(\mathbf{A}^{\top}=\mathbf{A}\)The Spectral Theorem guarantees orthogonal diagonalization
\(\mathbf{A}=\mathbf{P}\mathbf{D}\mathbf{P}^{-1}\), with \(\mathbf{P}\) invertibleOrdinary diagonalizationNot enough, by itself, to conclude symmetry or orthogonal diagonalization

The useful conceptual distinction is the role of the columns of the change-of-basis matrix. In orthogonal diagonalization they are not just eigenvectors: they must form an orthonormal basis. Symmetry is precisely the condition that ensures such a basis exists for a real matrix. The factor \(\mathbf{Q}^{\top}\) is therefore not an interchangeable substitute for any inverse; it records the special geometry of an orthonormal coordinate system.

Check Your Understanding

For each question, distinguish the condition that is given from the conclusion that it does or does not permit.

  1. Suppose \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\), where \(\mathbf{Q}\) is real orthogonal and \(\mathbf{D}\) is real diagonal. Show directly that \(\mathbf{A}^{\top}=\mathbf{A}\).
  2. If a real \(3\times3\) matrix is not symmetric, what can you conclude about its orthogonal diagonalizability? Which direction of the criterion justifies the conclusion?
  3. For an orthogonal \(\mathbf{Q}\), derive \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\) from \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}=\mathbf{D}\).
  4. Explain why the matrix \(\begin{bmatrix}1&1\\0&2\end{bmatrix}\) is diagonalizable but not orthogonally diagonalizable.
  5. What additional fact, beyond having an eigenbasis, is required for a diagonalization to be orthogonal?

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon