Tutorials › Linear Algebra › Diagnosing Invalid Inner Products And Norm Claims

Inner Products and Norms · Tutorial 624 of 1000

Diagnosing Invalid Inner Products And Norm Claims

Use exact counterexamples and necessary norm identities to distinguish invalid inner products from norms that cannot come from any inner product.

Intermediate 9 min read

What You'll Learn

  • Check positive definiteness by evaluating a proposed inner product on a nonzero vector.
  • Test conjugate symmetry on selected pairs of complex vectors.
  • Explain why an inner product must give real, positive self-products for nonzero vectors.
  • Derive homogeneity and the parallelogram identity for induced norms.
  • Distinguish a norm from a norm induced by an inner product.
  • Use counterexamples to reject proposed inner products and induced norms.

What a Diagnostic Test Must Show

A proposed formula can look like an inner product or a norm without satisfying the required conditions. The most direct way to test a claimed inner product is to check its defining properties, especially positive definiteness and, over \(\mathbb{C}\), conjugate symmetry. To test whether a proposed norm comes from an inner product, one can check identities that every induced norm must satisfy. A single counterexample is enough to disprove a claim, provided the calculation tests a necessary condition.

For vectors \(\mathbf{u},\mathbf{v}\in\mathbb{R}^n\), a real inner product is a function \(\langle\mathbf{u},\mathbf{v}\rangle\) that is linear in each variable, symmetric, and positive definite. Positive definiteness means that \(\langle\mathbf{v},\mathbf{v}\rangle\ge 0\) for every \(\mathbf{v}\), with equality exactly when \(\mathbf{v}=\mathbf{0}\). Over \(\mathbb{C}\), we use the convention that an inner product is linear in its first variable and conjugate-linear in its second. It must also satisfy conjugate symmetry.

Definition: A complex inner product on a complex vector space satisfies \(\langle a\mathbf{u}+b\mathbf{w},\mathbf{v}\rangle=a\langle\mathbf{u},\mathbf{v}\rangle+b\langle\mathbf{w},\mathbf{v}\rangle\), \(\langle\mathbf{u},a\mathbf{v}+b\mathbf{w}\rangle=\overline{a}\langle\mathbf{u},\mathbf{v}\rangle+\overline{b}\langle\mathbf{u},\mathbf{w}\rangle\), and \(\langle\mathbf{u},\mathbf{v}\rangle=\overline{\langle\mathbf{v},\mathbf{u}\rangle}\). It is positive definite: \(\langle\mathbf{v},\mathbf{v}\rangle\ge 0\), and \(\langle\mathbf{v},\mathbf{v}\rangle=0\) if and only if \(\mathbf{v}=\mathbf{0}\). A real inner product has the corresponding real bilinearity and symmetry, together with positive definiteness.

In either field, conjugate symmetry (or symmetry over \(\mathbb{R}\)) implies that \(\langle\mathbf{v},\mathbf{v}\rangle\) is real: it equals its own complex conjugate. Positive definiteness then makes this self-product strictly positive whenever \(\mathbf{v}\ne\mathbf{0}\). These are useful quick checks, but passing a few checks does not prove that a formula is an inner product; all the defining properties must hold.

Counterexamples to Positive Definiteness

Worked Example: A Real Bilinear Formula with a Negative Self-Product

Consider the proposed formula on \(\mathbb{R}^2\) \(\langle\mathbf{u},\mathbf{v}\rangle=u_1v_1-u_2v_2\), where \(\mathbf{u}=\begin{bmatrix}u_1\\u_2\end{bmatrix}\) and \(\mathbf{v}=\begin{bmatrix}v_1\\v_2\end{bmatrix}\). It is bilinear and symmetric, so test positive definiteness.

Take the nonzero vector \(\mathbf{e}_2=\begin{bmatrix}0\\1\end{bmatrix}\). Substituting it into both slots gives

$$ \langle\mathbf{e}_2,\mathbf{e}_2\rangle =(0)(0)-(1)(1)=-1. $$

This is negative, so the formula is not positive definite and therefore is not an inner product. The associated proposed square-root expression would give \(\sqrt{\langle\mathbf{e}_2,\mathbf{e}_2\rangle}=\sqrt{-1}\), which is not a real-valued norm on \(\mathbb{R}^2\). The counterexample checks the formula directly at a nonzero vector, exactly where positive definiteness requires a strictly positive value.

A zero self-product at a nonzero vector is another decisive failure. For example, the real bilinear symmetric formula \(\langle\mathbf{u},\mathbf{v}\rangle=u_1v_1\) on \(\mathbb{R}^2\) gives \(\langle\mathbf{e}_2,\mathbf{e}_2\rangle=0\) even though \(\mathbf{e}_2\ne\mathbf{0}\). Nonnegativity alone is not sufficient: positive definiteness requires equality with zero only at the zero vector.

Testing Conjugate Symmetry Over \(\mathbb{C}\)

For a complex formula, testing only self-products can miss a failure of conjugate symmetry. That property compares two orders of a pair: the value with arguments \((\mathbf{u},\mathbf{v})\) must equal the conjugate of the value with arguments \((\mathbf{v},\mathbf{u})\). Standard basis vectors often make this comparison short.

Worked Example: A Complex Formula That Fails Conjugate Symmetry

On \(\mathbb{C}^2\), consider the proposed formula \(\langle\mathbf{u},\mathbf{v}\rangle=u_1\overline{v_1}+u_2\overline{v_2}+i u_1\overline{v_2}\). It is linear in \(\mathbf{u}\) and conjugate-linear in \(\mathbf{v}\), but those properties alone do not establish that it is an inner product. Let \(\mathbf{e}_1=\begin{bmatrix}1\\0\end{bmatrix}\) and \(\mathbf{e}_2=\begin{bmatrix}0\\1\end{bmatrix}\). Evaluate the two orders:

$$ \begin{aligned} \langle\mathbf{e}_1,\mathbf{e}_2\rangle &=1\overline{0}+0\overline{1}+i(1)\overline{1}=i,\\ \langle\mathbf{e}_2,\mathbf{e}_1\rangle &=0\overline{1}+1\overline{0}+i(0)\overline{0}=0. \end{aligned} $$

Conjugate symmetry would require \(\langle\mathbf{e}_1,\mathbf{e}_2\rangle=\overline{\langle\mathbf{e}_2,\mathbf{e}_1\rangle}\). Here the left side is \(i\), while the right side is \(\overline{0}=0\). Since \(i\ne0\), conjugate symmetry fails and the formula is not an inner product. This pairwise test is conclusive; no further property needs to be checked to reject the formula.

Result: If a proposed real or complex inner product has \(\langle\mathbf{v},\mathbf{v}\rangle<0\) for some vector, has \(\langle\mathbf{v},\mathbf{v}\rangle=0\) for a nonzero vector, or fails symmetry or conjugate symmetry for some pair, then it is not an inner product.

Proof. Each condition listed is part of the definition of an inner product. A negative self-product contradicts nonnegativity; a zero self-product at a nonzero vector contradicts the equality condition in positive definiteness; and a pair for which symmetry or conjugate symmetry fails contradicts that required axiom. Therefore any one such counterexample is enough to rule out the proposed formula. \(\square\)

Necessary Tests for an Induced Norm

An inner product induces a norm by the formula \(\|\mathbf{v}\|=\sqrt{\langle\mathbf{v},\mathbf{v}\rangle}\). A norm is a function with nonnegative values, equal to zero exactly at \(\mathbf{0}\), absolutely homogeneous (\(\|c\mathbf{v}\|=|c|\|\mathbf{v}\|\)), and satisfying the triangle inequality. Every norm induced by an inner product must have these norm properties. It must also satisfy the parallelogram identity, which is a stronger diagnostic: some norms meet all the norm axioms but do not come from any inner product.

Theorem: For an inner product on a real or complex vector space, its induced norm satisfies \(\|c\mathbf{v}\|=|c|\|\mathbf{v}\|\) and \(\|\mathbf{u}+\mathbf{v}\|^2+\|\mathbf{u}-\mathbf{v}\|^2=2\|\mathbf{u}\|^2+2\|\mathbf{v}\|^2\).

Proof. By the definition of an induced norm and the scalar rules for the inner product, \(\|c\mathbf{v}\|^2=\langle c\mathbf{v},c\mathbf{v}\rangle=c\overline{c}\langle\mathbf{v},\mathbf{v}\rangle=|c|^2\|\mathbf{v}\|^2\). Both norms are nonnegative and \(|c|\ge0\), so taking nonnegative square roots gives \(\|c\mathbf{v}\|=|c|\|\mathbf{v}\|\). For the second identity, expand using linearity in the first slot and conjugate-linearity in the second: \(\|\mathbf{u}+\mathbf{v}\|^2=\|\mathbf{u}\|^2+\|\mathbf{v}\|^2+\langle\mathbf{u},\mathbf{v}\rangle+\langle\mathbf{v},\mathbf{u}\rangle\). Likewise, \(\|\mathbf{u}-\mathbf{v}\|^2=\|\mathbf{u}\|^2+\|\mathbf{v}\|^2-\langle\mathbf{u},\mathbf{v}\rangle-\langle\mathbf{v},\mathbf{u}\rangle\). Adding these equalities cancels both cross terms and leaves \(2\|\mathbf{u}\|^2+2\|\mathbf{v}\|^2\), as required. \(\square\)

The parallelogram identity is a necessary condition, not a conclusion to assume without proof. If a proposed norm fails it for even one pair of vectors, no inner product can induce that norm. Passing the test does not, by itself, construct an inner product; it only means this particular obstruction has not ruled one out.

A Norm That Is Not Induced by an Inner Product

Worked Example: The Weighted Sum of Absolute Values

On \(\mathbb{R}^2\), define \(N\left(\begin{bmatrix}x\\y\end{bmatrix}\right)=|x|+2|y|\). First, this is a norm. It is nonnegative, and it is zero exactly when \(x=y=0\). For \(c\in\mathbb{R}\), \(N(c\mathbf{v})=|c|N(\mathbf{v})\), since \(|cx|=|c||x|\) and \(|cy|=|c||y|\). For \(\mathbf{u}=\begin{bmatrix}x_1\\y_1\end{bmatrix}\) and \(\mathbf{v}=\begin{bmatrix}x_2\\y_2\end{bmatrix}\), the scalar triangle inequality gives \(N(\mathbf{u}+\mathbf{v})=|x_1+x_2|+2|y_1+y_2|\le |x_1|+|x_2|+2|y_1|+2|y_2|=N(\mathbf{u})+N(\mathbf{v})\).

Now test the parallelogram identity with \(\mathbf{e}_1=\begin{bmatrix}1\\0\end{bmatrix}\) and \(\mathbf{e}_2=\begin{bmatrix}0\\1\end{bmatrix}\). We have \(N(\mathbf{e}_1)=1\), \(N(\mathbf{e}_2)=2\), \(N(\mathbf{e}_1+\mathbf{e}_2)=|1|+2|1|=3\), and \(N(\mathbf{e}_1-\mathbf{e}_2)=|1|+2|-1|=3\). Therefore

$$ N(\mathbf{e}_1+\mathbf{e}_2)^2+N(\mathbf{e}_1-\mathbf{e}_2)^2 =3^2+3^2=18, $$ $$ 2N(\mathbf{e}_1)^2+2N(\mathbf{e}_2)^2 =2(1^2)+2(2^2)=10. $$

Since \(18\ne10\), the parallelogram identity fails. Thus \(N\) is a norm, but it is not induced by any inner product on \(\mathbb{R}^2\).

This example illustrates why “it is a norm” and “it is an inner-product norm” are different claims. The norm axioms do not imply the parallelogram identity; the calculation above proves that this particular norm cannot arise from an inner product.

Common Pitfall: Positivity Is Not Enough

A common incorrect argument is: “The expression \(N(\mathbf{v})=|x|+2|y|\) is always nonnegative and satisfies the norm axioms, so it must be induced by an inner product.” The conclusion does not follow. In the calculation above, the left side of the required parallelogram identity is \(18\), while the right side is \(10\). The correction is to use the parallelogram identity as a necessary test for an inner-product-induced norm, rather than treating the norm axioms as sufficient.

Another tempting shortcut is to check a complex formula only on the diagonal \(\langle\mathbf{v},\mathbf{v}\rangle\). That cannot replace a conjugate-symmetry check: the formula in the complex worked example gives \(\langle\mathbf{e}_1,\mathbf{e}_1\rangle=\langle\mathbf{e}_2,\mathbf{e}_2\rangle=1\), but it still fails conjugate symmetry on \((\mathbf{e}_1,\mathbf{e}_2)\). A reliable diagnosis tests the property that the proposed formula is claimed to satisfy.

1
For a proposed inner product.
Check the correct scalar rules and symmetry condition for the field, then test positive definiteness on nonzero vectors. One failed axiom disproves the claim.
2
For a proposed induced norm.
Check the norm conditions and, in particular, test the parallelogram identity on convenient vectors. A single failure proves that no inner product induces it.

Check Your Understanding

For each proposed formula, identify the necessary property to test and support your conclusion with an explicit calculation.

  1. On \(\mathbb{R}^2\), test whether \(\langle\mathbf{u},\mathbf{v}\rangle=2u_1v_1+u_2v_2\) is an inner product.
  2. On \(\mathbb{R}^2\), test positive definiteness of \(\langle\mathbf{u},\mathbf{v}\rangle=u_1v_1+u_1v_2+u_2v_1+u_2v_2\).
  3. For the complex formula \(\langle\mathbf{u},\mathbf{v}\rangle=u_1\overline{v_1}+2u_2\overline{v_2}\), check conjugate symmetry on \(\mathbf{e}_1,\mathbf{e}_2\).
  4. Does \(N\left(\begin{bmatrix}x\\y\end{bmatrix}\right)=\sqrt{x^2+4y^2}\) fail the parallelogram identity for \(\mathbf{e}_1,\mathbf{e}_2\), or pass it?
  5. Explain why a single nonzero vector with self-product zero disproves positive definiteness.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon