Two Equivalent Ways to Describe a Matrix
A real square matrix can be described by its action on coordinates, or by its action along particular directions. Diagonalization expresses the second description: in a suitable basis, the matrix acts by scaling each basis vector. Orthogonal diagonalization requires that basis to be orthonormal, so the change of coordinates preserves lengths and angles. For real matrices, this stronger requirement is not merely a convenient choice: it is exactly what symmetry characterizes.
Throughout, let \(\mathbf{A}\in\mathbb{R}^{n\times n}\), where \(n\in\mathbb{N}\). A real square matrix \(\mathbf{Q}\) is orthogonal if \(\mathbf{Q}^{\top}\mathbf{Q}=\mathbf{I}_n\); for a square matrix this also gives \(\mathbf{Q}\mathbf{Q}^{\top}=\mathbf{I}_n\). A real diagonal matrix has all its off-diagonal entries equal to zero.
The columns of an orthogonal matrix form an orthonormal basis of \(\mathbb{R}^n\). If \(\mathbf{Q}=[\mathbf{q}_1\ \cdots\ \mathbf{q}_n]\) and \(\mathbf{D}=\operatorname{diag}(\lambda_1,\dots,\lambda_n)\), then \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\) says that each column \(\mathbf{q}_j\) is an eigenvector with eigenvalue \(\lambda_j\). In particular, the representation is a matrix form of having an orthonormal basis of eigenvectors.
Changing Between the Two Forms
Proof. Suppose first that \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\). Multiplying on the left by \(\mathbf{Q}^{\top}\) and on the right by \(\mathbf{Q}\) gives \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}=\mathbf{Q}^{\top}\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\mathbf{Q}=\mathbf{I}_n\mathbf{D}\mathbf{I}_n=\mathbf{D}\). Conversely, suppose \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}=\mathbf{D}\). Multiply on the left by \(\mathbf{Q}\) and on the right by \(\mathbf{Q}^{\top}\). Then \(\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}=\mathbf{Q}\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}\mathbf{Q}^{\top}=\mathbf{I}_n\mathbf{A}\mathbf{I}_n=\mathbf{A}\). Both directions use orthogonality, which gives \(\mathbf{Q}^{\top}\mathbf{Q}=\mathbf{Q}\mathbf{Q}^{\top}=\mathbf{I}_n\). \(\square\)
Worked Example: Reading a Diagonalization in Both Directions
Let \(\mathbf{Q}=\frac{1}{\sqrt{2}}\begin{bmatrix}1&1\\1&-1\end{bmatrix}\) and \(\mathbf{D}=\begin{bmatrix}3&0\\0&1\end{bmatrix}\). Compute \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\), then check the equivalent form \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}=\mathbf{D}\).
The columns of \(\mathbf{Q}\) have squared lengths \((1^2+1^2)/2=1\) and \((1^2+(-1)^2)/2=1\); their dot product is \((1-1)/2=0\). Thus \(\mathbf{Q}^{\top}\mathbf{Q}=\mathbf{I}_2\), and here \(\mathbf{Q}^{\top}=\mathbf{Q}\). First multiply \(\mathbf{Q}\mathbf{D}\):
Now multiply by \(\mathbf{Q}^{\top}\):
To check the reverse form, calculate both products, keeping the factors of \(1/\sqrt{2}\):
The matrix \(\mathbf{A}\) is symmetric, as its two off-diagonal entries are both \(1\), and the computation verifies the stated diagonalization in either form.
The Characterization by Symmetry
Proof. First suppose that \(\mathbf{A}\) is orthogonally diagonalizable. Then \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\) for an orthogonal \(\mathbf{Q}\) and a real diagonal \(\mathbf{D}\). Transposing this equation and using the rule \((\mathbf{X}\mathbf{Y})^{\top}=\mathbf{Y}^{\top}\mathbf{X}^{\top}\) gives \((\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top})^{\top}=\mathbf{Q}\mathbf{D}^{\top}\mathbf{Q}^{\top}\). A real diagonal matrix satisfies \(\mathbf{D}^{\top}=\mathbf{D}\), so \(\mathbf{A}^{\top}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}=\mathbf{A}\). Hence \(\mathbf{A}\) is symmetric.
For the reverse direction, suppose that \(\mathbf{A}\) is real and symmetric. The Spectral Theorem, proved by induction on dimension in the earlier material, states that every real symmetric \(n\times n\) matrix has an orthonormal basis of real eigenvectors. Let \(\mathbf{q}_1,\dots,\mathbf{q}_n\) be such a basis, with corresponding real eigenvalues \(\lambda_1,\dots,\lambda_n\). Form \(\mathbf{Q}=[\mathbf{q}_1\ \cdots\ \mathbf{q}_n]\) and \(\mathbf{D}=\operatorname{diag}(\lambda_1,\dots,\lambda_n)\). Orthonormality gives \(\mathbf{Q}^{\top}\mathbf{Q}=\mathbf{I}_n\), and the eigenvector equations \(\mathbf{A}\mathbf{q}_j=\lambda_j\mathbf{q}_j\), one for each \(j\), give \(\mathbf{A}\mathbf{Q}=\mathbf{Q}\mathbf{D}\). Multiplying this equality on the right by \(\mathbf{Q}^{\top}\), and using \(\mathbf{Q}\mathbf{Q}^{\top}=\mathbf{I}_n\), yields \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\). Thus \(\mathbf{A}\) is orthogonally diagonalizable. The two implications prove the equivalence. \(\square\)
This proof uses the Spectral Theorem specifically for a real symmetric matrix; it does not claim that every real matrix has real eigenvalues or an orthonormal eigenbasis. The criterion is an equivalence over \(\mathbb{R}\), with a real diagonal matrix and a real orthogonal matrix. Its reverse implication depends on the existence of the orthonormal eigenbasis guaranteed by that theorem.
Worked Example: A Three-Dimensional Orthogonal Representation
Consider \(\mathbf{Q}=\frac13\begin{bmatrix}1&2&2\\2&1&-2\\-2&2&-1\end{bmatrix}\) and \(\mathbf{D}=\begin{bmatrix}1&0&0\\0&2&0\\0&0&4\end{bmatrix}\). Verify the orthogonality of \(\mathbf{Q}\), compute \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\), and check the resulting representation.
Write the rows of \(3\mathbf{Q}\) as \((1,2,2)\), \((2,1,-2)\), and \((-2,2,-1)\). Each has squared length \(9\); their pairwise dot products are \(2+2-4=0\), \(-2+4-2=0\), and \(-4+2+2=0\). Dividing each row by \(3\) makes the rows orthonormal, so \(\mathbf{Q}\mathbf{Q}^{\top}=\mathbf{I}_3\), and \(\mathbf{Q}\) is orthogonal.
Let \(\mathbf{C}=3\mathbf{Q}\). Since \(\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}=\frac19\mathbf{C}\mathbf{D}\mathbf{C}^{\top}\), the entries can be computed by multiplying each pair of rows with the diagonal weights \(1,2,4\):
The result is symmetric. To check the diagonalization by multiplication, write \(\mathbf{C}=\begin{bmatrix}1&2&2\\2&1&-2\\-2&2&-1\end{bmatrix}\). Then
Because \(\mathbf{Q}\mathbf{Q}^{\top}=\mathbf{I}_3\), this check gives \(\mathbf{A}=\mathbf{A}\mathbf{Q}\mathbf{Q}^{\top}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\). Thus the computed symmetric matrix does have the displayed orthogonal diagonalization.
What Symmetry Rules Out
The forward direction of the theorem is a useful test: if a real matrix is not symmetric, it cannot be orthogonally diagonalizable. This does not mean it cannot be diagonalized at all. Ordinary diagonalization allows a change-of-basis matrix that need not be orthogonal, so its columns need not be perpendicular or unit length.
Worked Example: Diagonalizable but Not Orthogonally Diagonalizable
Let \(\mathbf{P}=\begin{bmatrix}1&1\\0&1\end{bmatrix}\) and \(\mathbf{D}=\begin{bmatrix}1&0\\0&2\end{bmatrix}\). Compute \(\mathbf{A}=\mathbf{P}\mathbf{D}\mathbf{P}^{-1}\) and use the criterion to decide whether \(\mathbf{A}\) is orthogonally diagonalizable.
The inverse is \(\mathbf{P}^{-1}=\begin{bmatrix}1&-1\\0&1\end{bmatrix}\), since multiplying it by \(\mathbf{P}\) gives \(\mathbf{I}_2\). Therefore
This matrix is diagonalizable by the displayed formula, but it is not symmetric: its \((1,2)\) entry is \(1\), while its \((2,1)\) entry is \(0\). By the orthogonal diagonalization criterion, it is not orthogonally diagonalizable. The calculation also verifies the ordinary diagonalization: multiplying \(\mathbf{P}\mathbf{D}\mathbf{P}^{-1}\) back gives exactly \(\mathbf{A}\).
Common mistake: treating every diagonalization as orthogonal. A tempting but incorrect inference is “\(\mathbf{A}=\mathbf{P}\mathbf{D}\mathbf{P}^{-1}\), so \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\).” In the example, the actual change-of-basis matrix is \(\mathbf{P}=\begin{bmatrix}1&1\\0&1\end{bmatrix}\). Its columns have dot product \(1\), not \(0\), so \(\mathbf{P}\) is not orthogonal and \(\mathbf{P}^{-1}\ne\mathbf{P}^{\top}\). The correction is to check the hypotheses: the symmetric-matrix criterion guarantees an orthogonal diagonalization, while an arbitrary diagonalization does not.
Using the Criterion Efficiently
The theorem turns two different questions into one another. To decide whether a real square matrix could be orthogonally diagonalized, first check whether it is symmetric. If it fails the transpose criterion, the answer is no. If it is symmetric, the Spectral Theorem guarantees an orthogonal diagonalization; actually finding the eigenvalues, eigenvectors, and matrices \(\mathbf{Q}\) and \(\mathbf{D}\) is a separate computational task.
| Statement | What it means | What follows |
|---|---|---|
| \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\), with \(\mathbf{Q}\) orthogonal and \(\mathbf{D}\) real diagonal | Orthogonal diagonalization | \(\mathbf{A}\) is symmetric |
| \(\mathbf{A}\) is real and symmetric | \(\mathbf{A}^{\top}=\mathbf{A}\) | The Spectral Theorem guarantees orthogonal diagonalization |
| \(\mathbf{A}=\mathbf{P}\mathbf{D}\mathbf{P}^{-1}\), with \(\mathbf{P}\) invertible | Ordinary diagonalization | Not enough, by itself, to conclude symmetry or orthogonal diagonalization |
The useful conceptual distinction is the role of the columns of the change-of-basis matrix. In orthogonal diagonalization they are not just eigenvectors: they must form an orthonormal basis. Symmetry is precisely the condition that ensures such a basis exists for a real matrix. The factor \(\mathbf{Q}^{\top}\) is therefore not an interchangeable substitute for any inverse; it records the special geometry of an orthonormal coordinate system.
Check Your Understanding
For each question, distinguish the condition that is given from the conclusion that it does or does not permit.
- Suppose \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\), where \(\mathbf{Q}\) is real orthogonal and \(\mathbf{D}\) is real diagonal. Show directly that \(\mathbf{A}^{\top}=\mathbf{A}\).
- If a real \(3\times3\) matrix is not symmetric, what can you conclude about its orthogonal diagonalizability? Which direction of the criterion justifies the conclusion?
- For an orthogonal \(\mathbf{Q}\), derive \(\mathbf{A}=\mathbf{Q}\mathbf{D}\mathbf{Q}^{\top}\) from \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}=\mathbf{D}\).
- Explain why the matrix \(\begin{bmatrix}1&1\\0&2\end{bmatrix}\) is diagonalizable but not orthogonally diagonalizable.
- What additional fact, beyond having an eigenbasis, is required for a diagonalization to be orthogonal?