Tutorials › Linear Algebra › Orthogonality In Complex Inner Product Spaces

Inner Products and Norms · Tutorial 622 of 1000

Orthogonality In Complex Inner Product Spaces

Learn to test complex vectors for orthogonality and calculate inner products correctly when scalars are multiplied into either argument.

Intermediate 9 min read

What You'll Learn

  • Define orthogonality for vectors in a complex inner product space.
  • Calculate the standard inner product on complex coordinate vectors.
  • Explain why reversing the arguments conjugates the inner product.
  • Apply the different scalar rules in the first and second arguments.
  • Check when multiplying vectors by scalars preserves orthogonality.
  • Recognize and correct a common conjugation error.

Orthogonality When Scalars Are Complex

For real vectors, the inner product is a real number, so reversing the order of its arguments leaves its value unchanged. In a complex inner product space, an inner product can itself be complex, and reversing the arguments generally conjugates its value. This difference affects calculations even though the definition of orthogonality remains simple: the inner product must equal zero.

Throughout this tutorial, complex inner products are linear in the first argument and conjugate-linear in the second. Keeping that convention visible is essential. Some sources use the opposite convention, so a calculation involving a nonzero inner product or a complex scalar can look different there. The zero condition defining orthogonality, however, is unchanged.

Definition: A complex inner product space is a complex vector space \(V\) equipped with a function \(\langle\cdot,\cdot\rangle:V\times V\to\mathbb{C}\) that is linear in its first argument, conjugate-linear in its second, satisfies \(\langle\mathbf{u},\mathbf{v}\rangle=\overline{\langle\mathbf{v},\mathbf{u}\rangle}\), and is positive definite: \(\langle\mathbf{v},\mathbf{v}\rangle\) is a positive real number whenever \(\mathbf{v}\ne\mathbf{0}\), and equals \(0\) when \(\mathbf{v}=\mathbf{0}\). Vectors \(\mathbf{u}\) and \(\mathbf{v}\) are orthogonal, written \(\mathbf{u}\perp\mathbf{v}\), if \(\langle\mathbf{u},\mathbf{v}\rangle=0\).

Linearity and conjugate-linearity mean that, for vectors \(\mathbf{u},\mathbf{v},\mathbf{w}\in V\) and scalars \(a,b\in\mathbb{C}\), the rules are

$$ \langle a\mathbf{u}+b\mathbf{v},\mathbf{w}\rangle =a\langle\mathbf{u},\mathbf{w}\rangle+b\langle\mathbf{v},\mathbf{w}\rangle, \qquad \langle\mathbf{u},a\mathbf{v}+b\mathbf{w}\rangle =\overline{a}\langle\mathbf{u},\mathbf{v}\rangle+ \overline{b}\langle\mathbf{u},\mathbf{w}\rangle. $$

In particular, a complex scalar in the first argument comes out unchanged, while a complex scalar in the second argument comes out conjugated. For real scalars these rules agree, since a real scalar is its own conjugate. This is why calculations in real inner product spaces do not reveal the distinction.

For \(\mathbb{C}^n\), the standard inner product with this convention is \(\langle\mathbf{u},\mathbf{v}\rangle=\sum_{j=1}^{n}u_j\overline{v_j}\). Equivalently, \(\langle\mathbf{u},\mathbf{v}\rangle=\mathbf{v}^{*}\mathbf{u}\), where \(\mathbf{v}^{*}\) is the conjugate transpose. The conjugation is on the entries of the second vector in the sum. That detail determines all the calculations that follow.

Testing Orthogonality by Computing the Inner Product

Worked Example: Two Orthogonal Vectors in \(\mathbb{C}^2\)

Test whether \(\mathbf{u}=(1,i)\) and \(\mathbf{v}=(1,-i)\) are orthogonal in \(\mathbb{C}^2\) with the standard inner product.

Conjugate the entries of the second vector: \(\overline{1}=1\) and \(\overline{-i}=i\). Then calculate each term of the inner product:

$$ \langle\mathbf{u},\mathbf{v}\rangle =1\cdot\overline{1}+i\cdot\overline{-i} =1+i\cdot i =1-1 =0. $$

Therefore \(\mathbf{u}\perp\mathbf{v}\). To check the result in the reverse order, conjugate the entries of \(\mathbf{u}\), which gives \((1,-i)\):

$$ \langle\mathbf{v},\mathbf{u}\rangle =1\cdot\overline{1}+(-i)\cdot\overline{i} =1+(-i)(-i) =1-1 =0. $$

Both calculations give zero. This example also shows why one must conjugate an entry rather than simply multiply matching entries: the second coordinate contributes \(i\cdot i=-1\), not \(i\cdot(-i)=1\).

Complex coordinates can cancel through their phases. Orthogonality does not require each coordinate contribution to the inner product to vanish separately; it requires their sum to vanish. Nor does orthogonality mean that the vectors have disjoint nonzero coordinates. The first example had nonzero entries in both vectors in both coordinates, yet the two terms in the inner product cancelled.

Proposition: In a complex inner product space, \(\mathbf{u}\perp\mathbf{v}\) if and only if \(\mathbf{v}\perp\mathbf{u}\).

Proof. By definition, \(\mathbf{u}\perp\mathbf{v}\) means \(\langle\mathbf{u},\mathbf{v}\rangle=0\). Conjugate symmetry gives \(\langle\mathbf{v},\mathbf{u}\rangle=\overline{\langle\mathbf{u},\mathbf{v}\rangle}\). If the first inner product is zero, its conjugate is zero, so \(\mathbf{v}\perp\mathbf{u}\). Conversely, if \(\langle\mathbf{v},\mathbf{u}\rangle=0\), conjugate symmetry gives \(\langle\mathbf{u},\mathbf{v}\rangle=\overline{0}=0\), so \(\mathbf{u}\perp\mathbf{v}\). \(\square\)

This symmetry concerns only whether the inner product is zero; it does not say that the two inner products are always equal. A nonzero complex value and its conjugate can differ.

Worked Example: Reversing the Arguments Conjugates the Value

Let \(\mathbf{u}=(1+i,2)\) and \(\mathbf{w}=(i,1-i)\). Compute the inner product in both orders and compare the results.

For \(\langle\mathbf{u},\mathbf{w}\rangle\), the conjugate of \(\mathbf{w}\) is \((-i,1+i)\). The two coordinate contributions are

$$ (1+i)(-i)=1-i, \qquad 2(1+i)=2+2i. $$

Adding them gives \(\langle\mathbf{u},\mathbf{w}\rangle=(1-i)+(2+2i)=3+i\), which is nonzero. In the reverse order, the conjugate of \(\mathbf{u}\) is \((1-i,2)\), so

$$ \langle\mathbf{w},\mathbf{u}\rangle =i(1-i)+(1-i)2 =(1+i)+(2-2i) =3-i. $$

Thus \(\langle\mathbf{w},\mathbf{u}\rangle=3-i=\overline{3+i}=\overline{\langle\mathbf{u},\mathbf{w}\rangle}\). The vectors are not orthogonal because \(3+i\ne0\), and reversing their order does not change that conclusion.

What Happens When a Vector Is Scaled?

Let \(\alpha,\beta\in\mathbb{C}\). Applying linearity in the first argument and conjugate-linearity in the second gives the useful combined rule

$$ \langle\alpha\mathbf{u},\beta\mathbf{v}\rangle =\alpha\overline{\beta}\langle\mathbf{u},\mathbf{v}\rangle. $$

The conjugate on \(\beta\) is required because \(\beta\) multiplies the vector in the second argument. If \(\mathbf{u}\) and \(\mathbf{v}\) are orthogonal, this formula shows that their scalar multiples are also orthogonal, including when one of the scalars is zero. When both scalars are nonzero, the converse holds as well: \(\alpha\mathbf{u}\perp\beta\mathbf{v}\) implies \(\mathbf{u}\perp\mathbf{v}\), because \(\alpha\overline{\beta}\ne0\).

Proposition: For \(\mathbf{u},\mathbf{v}\) in a complex inner product space and \(\alpha,\beta\in\mathbb{C}\), \(\langle\alpha\mathbf{u},\beta\mathbf{v}\rangle=\alpha\overline{\beta}\langle\mathbf{u},\mathbf{v}\rangle\). In particular, if \(\mathbf{u}\perp\mathbf{v}\), then \(\alpha\mathbf{u}\perp\beta\mathbf{v}\) for all \(\alpha,\beta\). If \(\alpha\ne0\) and \(\beta\ne0\), the scaled vectors are orthogonal if and only if the original vectors are orthogonal.

Proof. By linearity in the first argument, \(\langle\alpha\mathbf{u},\beta\mathbf{v}\rangle=\alpha\langle\mathbf{u},\beta\mathbf{v}\rangle\). Conjugate-linearity in the second argument gives \(\langle\mathbf{u},\beta\mathbf{v}\rangle=\overline{\beta}\langle\mathbf{u},\mathbf{v}\rangle\). Combining these equalities proves the formula. If \(\langle\mathbf{u},\mathbf{v}\rangle=0\), the formula gives \(\langle\alpha\mathbf{u},\beta\mathbf{v}\rangle=\alpha\overline{\beta}\cdot0=0\). If \(\alpha\) and \(\beta\) are nonzero, then \(\alpha\overline{\beta}\ne0\); hence \(\alpha\overline{\beta}\langle\mathbf{u},\mathbf{v}\rangle=0\) holds exactly when \(\langle\mathbf{u},\mathbf{v}\rangle=0\). \(\square\)

Worked Example: Scaling an Orthogonal Pair

Use \(\mathbf{u}=(1,i)\) and \(\mathbf{v}=(1,-i)\) from the first example. Set \(\alpha=1+i\) and \(\beta=2-i\). Calculate the scaled vectors and verify that they remain orthogonal.

First multiply each vector by its scalar:

$$ \alpha\mathbf{u} =((1+i)\cdot1,(1+i)i) =(1+i,-1+i), $$
$$ \beta\mathbf{v} =((2-i)\cdot1,(2-i)(-i)) =(2-i,-1-2i). $$

Now take the inner product, conjugating the second scaled vector to obtain \((2+i,-1+2i)\):

$$ \begin{aligned} \langle\alpha\mathbf{u},\beta\mathbf{v}\rangle &=(1+i)(2+i)+(-1+i)(-1+2i)\\ &=(1+3i)+(-1-3i)\\ &=0. \end{aligned} $$

The scalar rule gives the same check. Since \(\overline{\beta}=2+i\) and \(\langle\mathbf{u},\mathbf{v}\rangle=0\),

$$ \langle\alpha\mathbf{u},\beta\mathbf{v}\rangle =(1+i)(2+i)\cdot0 =(1+3i)\cdot0 =0. $$

The direct calculation and the scalar rule agree, verifying that this scaled pair is orthogonal.

Common Mistake: Using the Same Scalar Rule in Both Arguments

A frequent error is to treat the inner product as linear in each argument. Under the convention used here, that gives the wrong result whenever a non-real scalar is put in the second argument and the original inner product is nonzero. With \(\mathbf{u}\) and \(\mathbf{w}\) from the earlier example, \(\langle\mathbf{u},\mathbf{w}\rangle=3+i\). A mistaken calculation might write

$$ \langle\mathbf{u},i\mathbf{w}\rangle \mathrel{\color{red}{\text{(wrong)}}} =i\langle\mathbf{u},\mathbf{w}\rangle =i(3+i) =-1+3i. $$

The correction is to conjugate the scalar in the second argument. Since \(\overline{i}=-i\), the scalar rule gives

$$ \langle\mathbf{u},i\mathbf{w}\rangle =\overline{i}\langle\mathbf{u},\mathbf{w}\rangle =(-i)(3+i) =1-3i. $$

Direct computation confirms the correction. We have \(i\mathbf{w}=(-1,1+i)\), whose conjugate is \((-1,1-i)\). Therefore

$$ \langle\mathbf{u},i\mathbf{w}\rangle =(1+i)(-1)+2(1-i) =(-1-i)+(2-2i) =1-3i. $$

The incorrect answer \(-1+3i\) is not a small rounding difference: it results from using the first-argument rule in the second argument. As a second check on the distinction, placing \(i\) in the first argument instead gives \(\langle i\mathbf{u},\mathbf{w}\rangle=i(3+i)=-1+3i\), not \(1-3i\). The location of the scalar matters.

Keep the Zero Test and the Convention Separate

To decide orthogonality in a complex inner product space, compute the inner product using the stated convention and test whether the result is exactly zero. Do not infer orthogonality from the appearance of the coordinates, and do not discard a nonzero imaginary part. For example, \(3+i\) is not zero, so the vectors in the second worked example are not orthogonal.

For the standard inner product on \(\mathbb{C}^n\), a reliable sequence is to write the coordinate formula, conjugate the second vector, multiply corresponding entries, and add. When scaling vectors, use \(\alpha\overline{\beta}\langle\mathbf{u},\mathbf{v}\rangle\), not \(\alpha\beta\langle\mathbf{u},\mathbf{v}\rangle\). These steps keep the definition, the complex arithmetic, and the chosen convention aligned.

Check Your Understanding

For each calculation, use the convention linear in the first argument and conjugate-linear in the second.

  1. Compute \(\langle(1+i,1),(1,1-i)\rangle\) in \(\mathbb{C}^2\). Are the vectors orthogonal?
  2. If \(\langle\mathbf{u},\mathbf{v}\rangle=2-i\), find \(\langle\mathbf{v},\mathbf{u}\rangle\).
  3. If \(\langle\mathbf{u},\mathbf{v}\rangle=1+2i\), calculate \(\langle\mathbf{u},-i\mathbf{v}\rangle\).
  4. State the scalar rule for \(\langle\alpha\mathbf{u},\beta\mathbf{v}\rangle\), identifying which scalar is conjugated.
  5. Explain why orthogonality is symmetric even though \(\langle\mathbf{u},\mathbf{v}\rangle\) and \(\langle\mathbf{v},\mathbf{u}\rangle\) need not be equal.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon