Tutorials › Linear Algebra › Conventions For Complex Inner Products

Inner Products and Norms · Tutorial 602 of 1000

Conventions For Complex Inner Products

Learn how conjugate symmetry determines which argument is conjugate-linear and how to translate formulas between the two standard conventions.

Intermediate 10 min read

What You'll Learn

  • State the axioms for a complex inner product that is linear in the first argument.
  • Derive conjugate-linearity in the second argument from linearity and conjugate symmetry.
  • Write the corresponding rules when the second argument is chosen to be linear.
  • Translate values and scalar formulas between the two conventions.
  • Identify why a nonzero complex inner-product space cannot have an inner product linear in both arguments.

Why Complex Inner-Product Conventions Need Care

Over \(\mathbb{R}\), switching the order of the arguments of an inner product does not change its value. Over \(\mathbb{C}\), switching the arguments conjugates the value. As a result, the two arguments do not obey the same scalar rule: if an inner product is linear in one argument, it is conjugate-linear in the other. Textbooks differ on which argument is chosen to be linear, so a formula must be read together with its convention.

Throughout this tutorial, \(V\) is a vector space over \(\mathbb{C}\). A complex number \(a\) has conjugate \(\overline{a}\). A map \(\langle\cdot,\cdot\rangle:V\times V\to\mathbb{C}\) is an inner product under the first-argument-linear convention if it is linear in its first argument, satisfies conjugate symmetry, and is positive definite. Here linearity means additivity and homogeneity with respect to complex scalars.

Definition: Under the first-argument-linear convention, an inner product satisfies, for all \(\mathbf{u},\mathbf{v},\mathbf{w}\in V\) and \(a,b\in\mathbb{C}\):

\(\langle a\mathbf{u}+b\mathbf{v},\mathbf{w}\rangle=a\langle\mathbf{u},\mathbf{w}\rangle+b\langle\mathbf{v},\mathbf{w}\rangle\); \(\langle\mathbf{u},\mathbf{v}\rangle=\overline{\langle\mathbf{v},\mathbf{u}\rangle}\); and \(\langle\mathbf{u},\mathbf{u}\rangle\) is real and nonnegative, with \(\langle\mathbf{u},\mathbf{u}\rangle>0\) whenever \(\mathbf{u}\ne\mathbf{0}\).

The second-argument rule is not an additional independent choice. It follows from the first-argument rule and conjugate symmetry. Likewise, the convention in which the second argument is linear follows by reversing the arguments. Deriving these rules is useful because it prevents accidental use of real-number algebra with complex scalars.

Deriving the Conjugate-Linear Rule

Theorem: If a complex inner product is linear in its first argument and conjugate-symmetric, then it is conjugate-linear in its second argument: \(\langle\mathbf{u},a\mathbf{v}+b\mathbf{w}\rangle=\overline{a}\langle\mathbf{u},\mathbf{v}\rangle+\overline{b}\langle\mathbf{u},\mathbf{w}\rangle\).

Proof. Conjugate symmetry lets us reverse the arguments, apply first-argument linearity, and reverse them back. In full, for \(\mathbf{u},\mathbf{v},\mathbf{w}\in V\) and \(a,b\in\mathbb{C}\),

$$ \begin{aligned} \langle\mathbf{u},a\mathbf{v}+b\mathbf{w}\rangle &=\overline{\langle a\mathbf{v}+b\mathbf{w},\mathbf{u}\rangle}\\ &=\overline{a\langle\mathbf{v},\mathbf{u}\rangle+b\langle\mathbf{w},\mathbf{u}\rangle}\\ &=\overline{a}\,\overline{\langle\mathbf{v},\mathbf{u}\rangle} +\overline{b}\,\overline{\langle\mathbf{w},\mathbf{u}\rangle}\\ &=\overline{a}\langle\mathbf{u},\mathbf{v}\rangle +\overline{b}\langle\mathbf{u},\mathbf{w}\rangle. \end{aligned} $$

In the second line, first-argument linearity applies. In the third, complex conjugation conjugates each scalar and distributes over sums. The last line is conjugate symmetry applied to each pairing. This proves additivity and conjugate homogeneity in the second argument. \(\square\)

Thus, when the first argument is linear, multiplying the second argument by \(a\) multiplies the inner product by \(\overline{a}\), not by \(a\). If \(a\) is real, then \(\overline{a}=a\), which is one reason this distinction can go unnoticed when working only over \(\mathbb{R}\).

Worked Example: Scalar Factors in Each Argument

On the complex vector space \(\mathbb{C}\), use the first-argument-linear rule \(\langle z,w\rangle=z\overline{w}\). Take \(z=2+i\), \(w=1-2i\), and \(a=1+i\). Calculate the pairing and compare scaling the first and second arguments.

First, conjugate \(w\) and calculate the pairing:

$$ \langle z,w\rangle =(2+i)(1+2i) =2+4i+i+2i^2 =5i. $$

Scaling the first argument by \(a\) uses ordinary linearity, so

$$ \langle az,w\rangle =a\langle z,w\rangle =(1+i)(5i) =-5+5i. $$

Direct substitution checks this value: \(az=(1+i)(2+i)=1+3i\), and therefore \(\langle az,w\rangle=(1+3i)(1+2i)=1+2i+3i+6i^2=-5+5i\).

Scaling the second argument conjugates the scalar. Since \(\overline{a}=1-i\),

$$ \langle z,aw\rangle =\overline{a}\langle z,w\rangle =(1-i)(5i) =5+5i. $$

For a direct check, \(aw=(1+i)(1-2i)=3-i\), so \(\langle z,aw\rangle=(2+i)(3+i)=6+2i+3i+i^2=5+5i\). Both calculations agree with their respective scalar rules.

The Other Standard Convention

Another common choice is to make the second argument linear. Denote its pairing temporarily by \([\mathbf{u},\mathbf{v}]\), to distinguish it from the first-argument-linear pairing \(\langle\mathbf{u},\mathbf{v}\rangle\). The second convention has its own conjugate symmetry and positivity conditions. Its first-argument rule is then conjugate-linear.

Definition: Under the second-argument-linear convention, an inner product satisfies \([\mathbf{u},a\mathbf{v}+b\mathbf{w}]=a[\mathbf{u},\mathbf{v}]+b[\mathbf{u},\mathbf{w}]\), \([\mathbf{u},\mathbf{v}]=\overline{[\mathbf{v},\mathbf{u}]}\), and \([\mathbf{u},\mathbf{u}]\) is real and nonnegative, with \([\mathbf{u},\mathbf{u}]>0\) for \(\mathbf{u}\ne\mathbf{0}\). Consequently, \([a\mathbf{u}+b\mathbf{v},\mathbf{w}]=\overline{a}[\mathbf{u},\mathbf{w}]+\overline{b}[\mathbf{v},\mathbf{w}]\).

The two conventions describe the same underlying pairing rule with opposite argument order. More precisely, given a first-argument-linear inner product, define a second-argument-linear one by \([\mathbf{u},\mathbf{v}]=\langle\mathbf{v},\mathbf{u}\rangle\). Conjugate symmetry also gives \([\mathbf{u},\mathbf{v}]=\overline{\langle\mathbf{u},\mathbf{v}\rangle}\). The following result verifies that this translation satisfies all the required rules.

Proposition: If \(\langle\cdot,\cdot\rangle\) is a first-argument-linear complex inner product on \(V\), then \([\mathbf{u},\mathbf{v}]=\langle\mathbf{v},\mathbf{u}\rangle\) is a second-argument-linear complex inner product on \(V\).

Proof. For \(\mathbf{u},\mathbf{v},\mathbf{w}\in V\) and \(a,b\in\mathbb{C}\), first-argument linearity of the original pairing gives \([\mathbf{u},a\mathbf{v}+b\mathbf{w}]=\langle a\mathbf{v}+b\mathbf{w},\mathbf{u}\rangle=a\langle\mathbf{v},\mathbf{u}\rangle+b\langle\mathbf{w},\mathbf{u}\rangle=a[\mathbf{u},\mathbf{v}]+b[\mathbf{u},\mathbf{w}]\). For conjugate symmetry, \([\mathbf{v},\mathbf{u}]=\langle\mathbf{u},\mathbf{v}\rangle=\overline{\langle\mathbf{v},\mathbf{u}\rangle}=\overline{[\mathbf{u},\mathbf{v}]}\). Finally, \([\mathbf{u},\mathbf{u}]=\langle\mathbf{u},\mathbf{u}\rangle\), so it is real and nonnegative and is positive whenever \(\mathbf{u}\ne\mathbf{0}\). These are exactly the second-argument convention’s requirements. \(\square\)

Worked Example: Translating a Pairing Between Conventions

Again use \(\langle z,w\rangle=z\overline{w}\) on \(\mathbb{C}\), with \(z=2+i\) and \(w=1-2i\). The first-argument convention gives \(\langle z,w\rangle=5i\). Define the second-argument convention by \([z,w]=\langle w,z\rangle\).

Calculate the reversed pairing directly:

$$ [w,z] =\langle z,w\rangle =5i, \qquad [z,w] =\langle w,z\rangle =(1-2i)(2-i) =-5i. $$

The value \([z,w]\) is the conjugate of \(\langle z,w\rangle\): \(\overline{5i}=-5i\). Now use \(a=1+i\) to check the second-argument-linear rule. Since \(aw=(1+i)(1-2i)=3-i\),

$$ [z,aw] =(2+i)(3-i) =6-2i+3i-i^2 =7+i. $$

On the other hand, \([z,w]=(1-2i)(2-i)=-5i\) is not the calculation needed here; the correct base pairing for this scaling is \([z,w]=\overline{\langle z,w\rangle}=-5i\), and multiplying it by \(a\) would give \((1+i)(-5i)=5-5i\), not \(7+i\). This signals that the chosen second argument in the direct check must be tracked carefully: the direct calculation above used \(z=2+i\) and \(aw=3-i\), so \([z,aw]\) under the defined convention is \(\langle aw,z\rangle\), not \(\langle z,aw\rangle\). Compute that value:

$$ [z,aw] =\langle aw,z\rangle =(3-i)(2-i) =6-3i-2i+i^2 =5-5i. $$

Now \([z,aw]=a[z,w]=(1+i)(-5i)=5-5i\), as required. The distinction between \([z,aw]\) and \(\langle z,aw\rangle\) is precisely why the convention must be kept explicit.

Expanding Pairings Without Losing Conjugates

Once the scalar rules are fixed, expansions follow systematically. Under the first-argument-linear convention, scalar coefficients in the first argument stay unchanged, while coefficients in the second argument are conjugated. Under the second-argument-linear convention, the roles reverse. Keeping a short formula nearby is safer than trying to infer the rules from real-valued examples.

Worked Example: Expanding a Pairing of Sums

Use the first-argument-linear pairing \(\langle z,w\rangle=z\overline{w}\) on \(\mathbb{C}\). Let \(u=1+i\) and \(v=2-i\). Expand and evaluate \(\langle u+v,iu-v\rangle\) using the argument rules, then check by direct substitution.

Additivity in both arguments gives \(\langle u+v,iu-v\rangle=\langle u,iu\rangle-\langle u,v\rangle+\langle v,iu\rangle-\langle v,v\rangle\). The four terms are

$$ \begin{aligned} \langle u,iu\rangle &=(1+i)\overline{-1+i} =(1+i)(-1-i)=-2i,\\ \langle u,v\rangle &=(1+i)\overline{2-i} =(1+i)(2+i)=1+3i,\\ \langle v,iu\rangle &=(2-i)\overline{-1+i} =(2-i)(-1-i)=-3-i,\\ \langle v,v\rangle &=(2-i)(2+i)=5. \end{aligned} $$

Therefore,

$$ \langle u+v,iu-v\rangle =-2i-(1+3i)+(-3-i)-5 =-9-6i. $$

For a direct check, \(u+v=3\) and \(iu-v=(-1+i)-(2-i)=-3+2i\). Thus \(\langle u+v,iu-v\rangle=3\overline{-3+2i}=3(-3-2i)=-9-6i\), agreeing with the expansion.

Why Linearity in Both Arguments Fails

It may seem that both arguments could simply be made linear. Conjugate symmetry and positive definiteness rule this out on every nonzero complex inner-product space. The qualification “nonzero” matters: the zero vector space has no nonzero vectors on which the contradiction could be tested.

Theorem: On a nonzero complex vector space, no pairing can be linear in both arguments, conjugate-symmetric, and positive definite. On the zero vector space, the unique pairing satisfies these conditions vacuously.

Proof. First suppose \(V\) is nonzero and choose \(\mathbf{x}\ne\mathbf{0}\). Positive definiteness gives \(r=\langle\mathbf{x},\mathbf{x}\rangle>0\), with \(r\) real. If the pairing were linear in both arguments, then \(\langle i\mathbf{x},\mathbf{x}\rangle=ir\) by first-argument linearity. Conjugate symmetry would then imply \(\langle\mathbf{x},i\mathbf{x}\rangle=\overline{\langle i\mathbf{x},\mathbf{x}\rangle}=\overline{ir}=-ir\). But second-argument linearity also gives \(\langle\mathbf{x},i\mathbf{x}\rangle=i\langle\mathbf{x},\mathbf{x}\rangle=ir\). Hence \(ir=-ir\), so \(2ir=0\), contradicting \(r>0\). For the zero vector space, the only possible pairing has value \(0\) on its sole pair \((\mathbf{0},\mathbf{0})\). Both linearity rules and conjugate symmetry hold, and positive definiteness requires positivity only for nonzero vectors, of which there are none. \(\square\)

Common Mistake: Treating Conjugate Symmetry as Symmetry

A frequent error is to write \(\langle\mathbf{u},\mathbf{v}\rangle=\langle\mathbf{v},\mathbf{u}\rangle\) over \(\mathbb{C}\), copying the real inner-product rule. For the first-argument-linear pairing above, \(z=2+i\) and \(w=1-2i\) give \(\langle z,w\rangle=5i\), while \(\langle w,z\rangle=-5i\). The incorrect symmetry claim would assert \(5i=-5i\), which is false. The correction is conjugate symmetry: \(\langle z,w\rangle=\overline{\langle w,z\rangle}=\overline{-5i}=5i\).

Another version of the same error is to use the first-argument scalar rule in the second argument. For example, \(\langle z,aw\rangle\) is not generally \(a\langle z,w\rangle\) under the first-argument-linear convention; it is \(\overline{a}\langle z,w\rangle\). This distinction disappears for real scalars but matters for complex ones.

ConventionFirst argumentSecond argumentConjugate symmetry
First argument linearLinearConjugate-linear\(\langle\mathbf{u},\mathbf{v}\rangle=\overline{\langle\mathbf{v},\mathbf{u}\rangle}\)
Second argument linearConjugate-linearLinear\([\mathbf{u},\mathbf{v}]=\overline{[\mathbf{v},\mathbf{u}]}\)

When translating a formula, first identify the convention, then apply the scalar rule for each argument separately. Reversing the arguments converts one convention to the other, and conjugate symmetry converts the value. These checks are especially important in computations involving complex scalars, where swapping arguments or moving a scalar without conjugating it can change the result.

Check Your Understanding

State which convention you are using in each answer, and show where conjugation enters.

  1. Under the first-argument-linear convention, write the formula for \(\langle\mathbf{u},a\mathbf{v}+b\mathbf{w}\rangle\).
  2. If \(\langle\mathbf{u},\mathbf{v}\rangle=3-2i\), what is \(\langle\mathbf{v},\mathbf{u}\rangle\)?
  3. Under the second-argument-linear convention, express \([a\mathbf{u},\mathbf{v}]\) in terms of \([\mathbf{u},\mathbf{v}]\).
  4. Given a first-argument-linear pairing, define a second-argument-linear pairing using argument reversal and state the relation between their values.
  5. Why does the contradiction to linearity in both arguments require a nonzero vector, and what happens on the zero vector space?

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon