Tutorials › Linear Algebra › Orthogonal Similarity Preserves Symmetry

Symmetric Matrices and the Spectral Theorem · Tutorial 723 of 1000

Orthogonal Similarity Preserves Symmetry

Show why an orthogonal change of coordinates keeps a real symmetric matrix symmetric, and check the result by exact matrix multiplication.

Advanced 10 min read

What You'll Learn

  • Define orthogonal similarity for real square matrices.
  • Prove that the transpose of the transformed matrix equals the transformed matrix.
  • Identify the precise role of orthogonality in the argument.
  • Compute orthogonal similarities using rotations, an orthogonal mixing matrix, and a coordinate permutation.
  • Avoid confusing \(Q^{\top}AQ\) with \(AQ\) or assuming symmetry preservation requires orthogonality.

Symmetry Under an Orthogonal Change of Coordinates

A real symmetric matrix represents a linear transformation whose matrix has matching entries across its main diagonal. When coordinates are changed using an orthonormal basis, the representing matrix changes from \(\mathbf{A}\) to \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}\), where \(\mathbf{Q}\) is orthogonal. A useful structural fact is that the new matrix is still symmetric. This matters because it lets us change orthonormal coordinates without losing symmetry; it does not, by itself, say anything about diagonalization or eigenvalues.

All matrices in this tutorial are real and square, and products are assumed to have compatible sizes. Recall that a matrix \(\mathbf{A}\) is symmetric when \(\mathbf{A}^{\top}=\mathbf{A}\). A square matrix \(\mathbf{Q}\) is orthogonal when \(\mathbf{Q}^{\top}\mathbf{Q}=\mathbf{I}\); equivalently, \(\mathbf{Q}^{-1}=\mathbf{Q}^{\top}\). The expression \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}\) is called an orthogonal similarity of \(\mathbf{A}\): orthogonality makes this expression the usual similarity \(\mathbf{Q}^{-1}\mathbf{A}\mathbf{Q}\).

Theorem: If \(\mathbf{A}\in\mathbb{R}^{n\times n}\) is symmetric and \(\mathbf{Q}\in\mathbb{R}^{n\times n}\) is orthogonal, then \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}\) is symmetric.

Proof. Set \(\mathbf{B}=\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}\). The transpose of a product reverses the factor order, so \((\mathbf{X}\mathbf{Y})^{\top}=\mathbf{Y}^{\top}\mathbf{X}^{\top}\) for compatible matrices. Applying this rule twice, and using \((\mathbf{Q}^{\top})^{\top}=\mathbf{Q}\), gives \[ \mathbf{B}^{\top} =(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q})^{\top} =\mathbf{Q}^{\top}\mathbf{A}^{\top}\mathbf{Q}. \] Since \(\mathbf{A}\) is symmetric, \(\mathbf{A}^{\top}=\mathbf{A}\). Therefore \[ \mathbf{B}^{\top}=\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}=\mathbf{B}, \] which is the definition of symmetry. \(\square\)

Notice what the proof uses: symmetry of \(\mathbf{A}\) and the transpose rule for products. It does not use \(\mathbf{Q}^{\top}\mathbf{Q}=\mathbf{I}\). Thus a stronger observation follows: for any real square \(\mathbf{Q}\), not necessarily orthogonal, \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}\) is symmetric whenever \(\mathbf{A}\) is symmetric. Orthogonality matters for calling the operation a similarity and for interpreting it as a change between orthonormal coordinates. The broader operation \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}\) is called a congruence.

Computing the Transformed Matrix

The theorem gives a quick structural check, but it is still important to compute the entries correctly. A reliable approach is to form \(\mathbf{A}\mathbf{Q}\) first and then multiply on the left by \(\mathbf{Q}^{\top}\). The columns of \(\mathbf{Q}\) determine which combinations of the columns of \(\mathbf{A}\) appear in \(\mathbf{A}\mathbf{Q}\); the left multiplication then combines rows. The examples below show how different orthogonal matrices produce different symmetric matrices.

Worked Example: A Quarter-Turn of Coordinates

Let \(\mathbf{A}=\begin{bmatrix}2&1\\1&3\end{bmatrix}\) and \(\mathbf{Q}=\begin{bmatrix}0&-1\\1&0\end{bmatrix}\). First verify orthogonality. Here \(\mathbf{Q}^{\top}=\begin{bmatrix}0&1\\-1&0\end{bmatrix}\), so

$$ \mathbf{Q}^{\top}\mathbf{Q} = \begin{bmatrix}0&1\\-1&0\end{bmatrix} \begin{bmatrix}0&-1\\1&0\end{bmatrix} = \begin{bmatrix}1&0\\0&1\end{bmatrix} =\mathbf{I}_2. $$

Now multiply on the right:

$$ \mathbf{A}\mathbf{Q} = \begin{bmatrix}2&1\\1&3\end{bmatrix} \begin{bmatrix}0&-1\\1&0\end{bmatrix} = \begin{bmatrix}1&-2\\3&-1\end{bmatrix}. $$

Then multiply by \(\mathbf{Q}^{\top}\) on the left:

$$ \mathbf{Q}^{\top}\mathbf{A}\mathbf{Q} = \begin{bmatrix}0&1\\-1&0\end{bmatrix} \begin{bmatrix}1&-2\\3&-1\end{bmatrix} = \begin{bmatrix}3&-1\\-1&2\end{bmatrix}. $$

Check: transposing the result gives \(\begin{bmatrix}3&-1\\-1&2\end{bmatrix}^{\top} =\begin{bmatrix}3&-1\\-1&2\end{bmatrix}\). It is symmetric, as the theorem predicts.

Worked Example: Mixing Two Coordinate Directions

Consider \(\mathbf{A}=\begin{bmatrix}2&0\\0&4\end{bmatrix}\) and \(\mathbf{Q}=\frac{1}{\sqrt{2}}\begin{bmatrix}1&1\\1&-1\end{bmatrix}\). The columns of \(\mathbf{Q}\) have length \(1\) and dot product \(0\); directly,

$$ \mathbf{Q}^{\top}\mathbf{Q} = \frac{1}{2} \begin{bmatrix}1&1\\1&-1\end{bmatrix} \begin{bmatrix}1&1\\1&-1\end{bmatrix} = \frac{1}{2} \begin{bmatrix}2&0\\0&2\end{bmatrix} =\mathbf{I}_2. $$

This \(\mathbf{Q}\) is symmetric, so \(\mathbf{Q}^{\top}=\mathbf{Q}\). First compute

$$ \mathbf{A}\mathbf{Q} = \frac{1}{\sqrt{2}} \begin{bmatrix}2&2\\4&-4\end{bmatrix}. $$

Multiplication on the left now gives

$$ \mathbf{Q}^{\top}\mathbf{A}\mathbf{Q} = \frac{1}{2} \begin{bmatrix}1&1\\1&-1\end{bmatrix} \begin{bmatrix}2&2\\4&-4\end{bmatrix} = \frac{1}{2} \begin{bmatrix}6&-2\\-2&6\end{bmatrix} = \begin{bmatrix}3&-1\\-1&3\end{bmatrix}. $$

Check: the off-diagonal entries are both \(-1\), and direct transposition leaves the result unchanged. The factors \(1/\sqrt{2}\) from the two copies of \(\mathbf{Q}\) combine to \(1/2\); omitting one of these factors would give the wrong matrix.

Worked Example: Permuting Three Coordinates

Let \(\mathbf{A}=\begin{bmatrix}4&1&2\\1&5&3\\2&3&6\end{bmatrix}\), and let \(\mathbf{Q}\) exchange the first and third coordinate while leaving the second fixed: \(\mathbf{Q}=\begin{bmatrix}0&0&1\\0&1&0\\1&0&0\end{bmatrix}\). Since \(\mathbf{Q}^{\top}=\mathbf{Q}\), direct multiplication gives

$$ \mathbf{Q}^{\top}\mathbf{Q} = \begin{bmatrix}0&0&1\\0&1&0\\1&0&0\end{bmatrix} \begin{bmatrix}0&0&1\\0&1&0\\1&0&0\end{bmatrix} = \begin{bmatrix}1&0&0\\0&1&0\\0&0&1\end{bmatrix} =\mathbf{I}_3. $$

Right multiplication exchanges the first and third columns of \(\mathbf{A}\):

$$ \mathbf{A}\mathbf{Q} = \begin{bmatrix}4&1&2\\1&5&3\\2&3&6\end{bmatrix} \begin{bmatrix}0&0&1\\0&1&0\\1&0&0\end{bmatrix} = \begin{bmatrix}2&1&4\\3&5&1\\6&3&2\end{bmatrix}. $$

Left multiplication by \(\mathbf{Q}^{\top}=\mathbf{Q}\) exchanges the first and third rows:

$$ \mathbf{Q}^{\top}\mathbf{A}\mathbf{Q} = \begin{bmatrix}0&0&1\\0&1&0\\1&0&0\end{bmatrix} \begin{bmatrix}2&1&4\\3&5&1\\6&3&2\end{bmatrix} = \begin{bmatrix}6&3&2\\3&5&1\\2&1&4\end{bmatrix}. $$

Check: the resulting entries in positions \((1,2)\) and \((2,1)\) are both \(3\); those in positions \((1,3)\) and \((3,1)\) are both \(2\); and those in positions \((2,3)\) and \((3,2)\) are both \(1\). Thus the computed matrix is symmetric.

What Orthogonality Adds

The symmetry conclusion is a consequence of the matching outer factors \(\mathbf{Q}^{\top}\) and \(\mathbf{Q}\). Orthogonality adds the identity \(\mathbf{Q}^{\top}=\mathbf{Q}^{-1}\), so the same expression can be read as a similarity. This is why orthogonal similarity is the relevant operation for changing coordinates by an orthonormal basis: it changes the matrix representing the transformation while preserving the symmetric structure.

It is useful to separate two claims that can otherwise be confused:

ClaimHypothesesReason
\(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}\) is symmetric\(\mathbf{A}^{\top}=\mathbf{A}\); \(\mathbf{Q}\) is any real square matrixTaking the transpose returns \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}\)
\(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}=\mathbf{Q}^{-1}\mathbf{A}\mathbf{Q}\)\(\mathbf{Q}\) is orthogonalOrthogonality gives \(\mathbf{Q}^{\top}=\mathbf{Q}^{-1}\)
\(\mathbf{A}\mathbf{Q}\) is symmetricNot guaranteed by symmetry of \(\mathbf{A}\) and orthogonality of \(\mathbf{Q}\)There is no left factor \(\mathbf{Q}^{\top}\) to produce the symmetry argument

The first row follows by the same transpose computation as the theorem: \((\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q})^{\top} =\mathbf{Q}^{\top}\mathbf{A}^{\top}\mathbf{Q} =\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}\). It does not assert that an arbitrary \(\mathbf{Q}\) gives a similarity, because \(\mathbf{Q}^{\top}\) need not be the inverse of \(\mathbf{Q}\). The second row is the point where orthogonality is essential.

Common Mistake: Multiplying on Only One Side

A tempting but incorrect calculation is to argue that \(\mathbf{A}\mathbf{Q}\) must be symmetric because \(\mathbf{A}\) is symmetric and \(\mathbf{Q}\) is orthogonal. For a concrete check, use the matrices from the first example. We found \(\mathbf{A}\mathbf{Q}=\begin{bmatrix}1&-2\\3&-1\end{bmatrix}\). Its transpose is \(\begin{bmatrix}1&3\\-2&-1\end{bmatrix}\), which is not equal to it. So \(\mathbf{A}\mathbf{Q}\) is not symmetric. The correction is to compute the full expression, including the left factor: \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}=\begin{bmatrix}3&-1\\-1&2\end{bmatrix}\), which is symmetric.

Another potential overstatement is that orthogonality is required for symmetry to survive. It is not. For instance, take \(\mathbf{A}=\begin{bmatrix}1&2\\2&3\end{bmatrix}\) and \(\mathbf{C}=\begin{bmatrix}2&0\\0&1\end{bmatrix}\), which is not orthogonal. Then

$$ \mathbf{C}^{\top}\mathbf{A}\mathbf{C} = \begin{bmatrix}2&0\\0&1\end{bmatrix} \begin{bmatrix}1&2\\2&3\end{bmatrix} \begin{bmatrix}2&0\\0&1\end{bmatrix} = \begin{bmatrix}4&4\\4&3\end{bmatrix}. $$

This result is symmetric, but this calculation is a congruence, not an orthogonal similarity. Keeping the two statements separate prevents the right conclusion from being supported by the wrong hypothesis.

Why the Result Is Useful

Symmetric matrices often arise from relationships that do not depend on the order in which two coordinates are paired: the \((i,j)\) and \((j,i)\) entries agree. When an orthonormal coordinate system is changed, the matrix entries may change—as the examples show—but the resulting matrix remains symmetric. Thus symmetry is a structural property of the represented transformation that survives orthogonal changes of coordinates, rather than a feature tied to one particular coordinate system.

For calculations, use this short checklist:

  • Confirm that \(\mathbf{A}\) is square and \(\mathbf{A}^{\top}=\mathbf{A}\).
  • Confirm that \(\mathbf{Q}\) is square of the same size and orthogonal if the transformation is being called an orthogonal similarity.
  • Form \(\mathbf{A}\mathbf{Q}\), then multiply by \(\mathbf{Q}^{\top}\) on the left.
  • Check the final result by comparing it with its transpose.

Check Your Understanding

Use the transpose criterion and exact multiplication where requested.

  1. For symmetric \(\mathbf{A}\) and square \(\mathbf{Q}\), show in one line that \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}\) is symmetric without assuming \(\mathbf{Q}\) is orthogonal.
  2. Compute \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}\) for \(\mathbf{A}=\begin{bmatrix}1&2\\2&5\end{bmatrix}\) and \(\mathbf{Q}=\begin{bmatrix}0&-1\\1&0\end{bmatrix}\), and check the result by transposing it.
  3. What additional fact does orthogonality give that lets \(\mathbf{Q}^{\top}\mathbf{A}\mathbf{Q}\) be written as a similarity?
  4. Explain why symmetry of \(\mathbf{A}\) and orthogonality of \(\mathbf{Q}\) do not guarantee that \(\mathbf{A}\mathbf{Q}\) is symmetric.
  5. Is \(\mathbf{C}^{\top}\mathbf{A}\mathbf{C}\) symmetric for every square \(\mathbf{C}\) when \(\mathbf{A}\) is symmetric? Justify your answer using a transpose calculation.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon