Tutorials › Calculus III › Symmetry and Structured Hessians at Critical Points

Critical Points and Local Extrema · Tutorial 423 of 999

Symmetry and Structured Hessians at Critical Points

Use symmetry to organize stationary points and simplify the Hessian test without assuming that symmetry alone determines every critical point.

Intermediate 10 min read

What You'll Learn

  • Use coordinate evenness to identify stationary points on symmetry planes.
  • Find how exchanging variables relates critical points and their classifications.
  • Recognize block structure in Hessians at points fixed by a symmetry.
  • Reduce a Hessian test to symmetric and antisymmetric directions.
  • Check which conclusions symmetry supports—and which it does not.

Why Symmetry Helps

A function can have many stationary points, and solving its full system of partial-derivative equations may obscure useful structure. If the function is unchanged by reversing a coordinate or exchanging two variables, its critical points and Hessians often inherit that symmetry.

This structure can reduce the work: it can identify points that must be stationary, show that other stationary points occur in related groups, and split a Hessian test into simpler directions. But symmetry does not by itself guarantee that every stationary point lies on a symmetry axis or plane.

Definition: A symmetry of \(f:\mathbb{R}^n\to\mathbb{R}\) is a transformation \(T\) of the input space for which \(f(T\mathbf{x})=f(\mathbf{x})\) wherever the function is defined. A point is fixed by \(T\) if \(T\mathbf{x}=\mathbf{x}\).

Throughout, assume \(f\) has continuous second partial derivatives near the points under discussion. A stationary point is a point where every first partial derivative is zero. Its Hessian is the matrix of second partial derivatives.

Coordinate Evenness and Symmetry Planes

If \(f\) is even in \(x\), then \(f(-x,y,z)=f(x,y,z)\). Differentiating with respect to \(x\) shows that \(f_x\) is odd in \(x\), so \(f_x(0,y,z)=0\). Thus the plane \(x=0\) automatically satisfies one of the three stationary-point equations. A stationary point on that plane still has to satisfy \(f_y=0\) and \(f_z=0\).

Evenness also restricts the Hessian on the fixed plane. The mixed partial derivatives \(f_{xy}\) and \(f_{xz}\) are odd in \(x\), so both vanish when \(x=0\). The Hessian then separates the \(x\)-direction from the \(y,z\)-directions.

$$ x=0 \quad\Longrightarrow\quad f_x=0,\qquad f_{xy}=f_{xz}=0. $$

This is a useful way to locate candidates and simplify their classification. It does not say that all stationary points have \(x=0\): points with \(x\ne 0\) may also solve the full gradient system.

Variable Exchange and Related Critical Points

Suppose \(f(x,y,z)=f(y,x,z)\). Exchanging \(x\) and \(y\) leaves the function unchanged. If \((a,b,c)\) is stationary, then \((b,a,c)\) is also stationary. Their Hessians have the same curvature classification, with the \(x\)- and \(y\)-directions exchanged.

At a point fixed by the exchange, where \(x=y\), the first partial derivatives satisfy \(f_x=f_y\). The Hessian has the form

$$ \mathbf{H} = \begin{pmatrix} a & b & c\\ b & a & c\\ c & c & d \end{pmatrix}. $$

The direction \((1,-1,0)\), which changes \(x-y\) while leaving \(x+y\) unchanged, separates from the other two directions. The remaining directions lie in the plane \(x=y\). This converts a three-dimensional Hessian test into one test in the exchange-antisymmetric direction and a two-dimensional test in the exchange-symmetric plane.

Important limitation: Symmetry ensures that critical points are carried to critical points and that points fixed by a symmetry have structured Hessians. It does not ensure that every critical point is fixed by the symmetry. Off-axis points may occur in exchanged pairs.

Why the Hessian Inherits Symmetry

The structure above follows from differentiating the symmetry relation. For an orthogonal linear symmetry represented by a matrix \(\mathbf{P}\), suppose \(f(\mathbf{P}\mathbf{x})=f(\mathbf{x})\). The chain rule gives

$$ \mathbf{P}^{\top}\nabla f(\mathbf{P}\mathbf{x})=\nabla f(\mathbf{x}). $$

Because \(\mathbf{P}\) is invertible, a zero gradient at \(\mathbf{x}\) implies a zero gradient at \(\mathbf{P}\mathbf{x}\). Differentiating a second time gives

$$ \mathbf{P}^{\top}\mathbf{H}(\mathbf{P}\mathbf{x})\mathbf{P} = \mathbf{H}(\mathbf{x}). $$

At a fixed point, \(\mathbf{P}\mathbf{x}=\mathbf{x}\), so the Hessian satisfies \(\mathbf{P}^{\top}\mathbf{H}(\mathbf{x})\mathbf{P}=\mathbf{H}(\mathbf{x})\). In the variable-exchange case, \(\mathbf{P}\) swaps the first two coordinates. The vector \((1,-1,0)\) changes sign under this swap, while vectors of the form \((u,u,v)\) remain fixed. The Hessian therefore cannot mix these two types of direction: its quadratic form separates into the antisymmetric direction and the symmetric plane. This is the reason the block structure simplifies classification.

Worked Example: Evenness Reveals Critical-Point Families

Worked Example: Evenness Reveals Critical-Point Families

Consider

$$ f(x,y,z)=x^4+y^4+x^2y^2-2x^2-2y^2+z^2. $$

The function is even in each coordinate. Differentiate:

$$ f_x=4x^3+2xy^2-4x=2x(2x^2+y^2-2), \qquad f_y=4y^3+2x^2y-4y=2y(x^2+2y^2-2), \qquad f_z=2z. $$

The equation \(f_z=0\) gives \(z=0\). The other equations give \(x=0\) or \(2x^2+y^2=2\), and \(y=0\) or \(x^2+2y^2=2\). If \(x=0\), then \(y=0\) or \(y^2=1\). If \(y=0\), then \(x=0\) or \(x^2=1\). When both are nonzero, solve

$$ 2x^2+y^2=2,\qquad x^2+2y^2=2. $$

Subtracting the equations gives \(x^2-y^2=0\), so \(x^2=y^2\). Substitution then gives \(3x^2=2\), hence \(x^2=y^2=2/3\). The complete list is the origin, the four axis points \((\pm1,0,0),(0,\pm1,0)\), and the four points with \(x=\pm\sqrt{2/3}\), \(y=\pm\sqrt{2/3}\), \(z=0\).

The Hessian is

$$ \mathbf{H}= \begin{pmatrix} 12x^2+2y^2-4 & 4xy & 0\\ 4xy & 2x^2+12y^2-4 & 0\\ 0&0&2 \end{pmatrix}. $$

At the origin it is \(\operatorname{diag}(-4,-4,2)\), which is indefinite, so the origin is a saddle. At \((1,0,0)\), for example, it is \(\operatorname{diag}(8,-2,2)\), also indefinite; the other axis points have the same classification by the coordinate symmetries.

At a point with \(x^2=y^2=2/3\), the two diagonal entries of the \(x,y\) block are \(16/3\), and its off-diagonal entry is \(4xy=\pm 8/3\). The eigenvalues of that block are \(16/3+8/3=8\) and \(16/3-8/3=8/3\). The remaining eigenvalue is \(2\). All are positive, so each of these four points is a local minimum.

As a check on the candidate equations, at \(x^2=y^2=2/3\), each bracket in \(f_x\) and \(f_y\) equals \(2(2/3)+2/3-2=0\); also \(z=0\), so all three first partial derivatives vanish. The sign choices occur in symmetry-related groups, which lets one classification apply to the entire group.

Worked Example: A Symmetric Hessian Splits into Two Tests

Worked Example: A Symmetric Hessian Splits into Two Tests

Consider the function, unchanged when \(x\) and \(y\) are exchanged,

$$ f(x,y,z)=x^2+y^2+xy+z(x+y)+2z^2-2x-2y. $$

Its gradient equations are

$$ 2x+y+z-2=0,\qquad x+2y+z-2=0,\qquad x+y+4z=0. $$

Subtracting the first two equations gives \(x-y=0\), so set \(x=y=t\). The first and third equations become \(3t+z=2\) and \(2t+4z=0\). The second gives \(t=-2z\); substituting into the first yields \(-5z=2\). Therefore \(z=-2/5\) and \(x=y=4/5\). Substitution checks the equations: \(8/5+4/5-2/5-2=0\) in each of the first two, and \(8/5-8/5=0\) in the third.

The Hessian is constant:

$$ \mathbf{H}= \begin{pmatrix} 2&1&1\\ 1&2&1\\ 1&1&4 \end{pmatrix}. $$

In the antisymmetric direction \((1,-1,0)\), the eigenvalue is \(1\). In the symmetric plane, use the orthonormal directions \((1,1,0)/\sqrt{2}\) and \((0,0,1)\). The corresponding block is

$$ \begin{pmatrix} 3&\sqrt{2}\\ \sqrt{2}&4 \end{pmatrix}. $$

For coordinates \(u,v\) in this plane, its quadratic form is

$$ 3u^2+2\sqrt{2}uv+4v^2 = 3\left(u+\frac{\sqrt{2}}{3}v\right)^2+\frac{10}{3}v^2. $$

This is positive for every nonzero pair \((u,v)\), and the antisymmetric eigenvalue is positive as well. Thus the Hessian is positive definite, and the stationary point is a strict local minimum.

Worked Example: Exchange Symmetry Does Not Force the Diagonal

Worked Example: Exchange Symmetry Does Not Force the Diagonal

Let \(s=x+y\), \(d=x-y\), and define

$$ f(x,y)=\big((x+y)^2-1\big)^2+\big((x-y)^2-4\big)^2. $$

Exchanging \(x\) and \(y\) keeps \(s\) fixed and changes \(d\) to \(-d\), so \(f\) is unchanged. Since \(s,d\) are invertible linear coordinates, a point is stationary in \(x,y\) exactly when both derivatives with respect to \(s,d\) vanish. These are

$$ f_s=4s(s^2-1),\qquad f_d=4d(d^2-4). $$

Thus \(s\in\{0,-1,1\}\) and \(d\in\{0,-2,2\}\), giving nine stationary points. Recover their original coordinates using \(x=(s+d)/2\), \(y=(s-d)/2\). For example, \(s=1,d=2\) gives \((x,y)=(3/2,-1/2)\), which is not on the diagonal. Exchanging the variables gives the distinct point \((-1/2,3/2)\).

In the \(s,d\) coordinates, the second derivative matrix is diagonal, with entries \(12s^2-4\) and \(12d^2-16\). At \(s=0,d=0\), both entries are negative, so the origin is a strict local maximum. At \(s=\pm1,d=\pm2\), both are positive, so the four corresponding points are strict local minima. At the other four combinations, one entry is positive and the other negative, so those points are saddles.

The classification is valid in the original coordinates as well: the change from \((x,y)\) to \((s,d)\) is invertible, so it preserves whether the quadratic form has positive and negative directions. This example shows why it is unsafe to search only on \(x=y\): symmetry pairs off-diagonal stationary points, but does not rule them out.

Using the Structure Carefully

Symmetry is most useful when it guides a complete search rather than replacing one. For coordinate evenness, inspect the fixed plane where the corresponding coordinate is zero, but also solve for possible stationary points away from it. For variable exchange, exploit the diagonal to simplify equations when appropriate, while checking for off-diagonal solutions. Once candidates are found, use the Hessian structure only at points where the relevant symmetry actually fixes the point.

For a three-variable Hessian, positive definiteness gives a strict local minimum and negative definiteness gives a strict local maximum. An indefinite Hessian gives a saddle. If the Hessian is only semidefinite, its second-derivative test may be inconclusive; symmetry does not remove the need for further analysis in that case.

Takeaway: Symmetry can reduce equations and reveal independent Hessian directions. It produces candidate structure, not a guarantee that every candidate lies on a symmetry axis, and a Hessian test still depends on the signs of all relevant directions.

Check Your Understanding

Use the symmetry and Hessian ideas above to answer these questions.

  1. If \(f\) is even in \(x\), which first and mixed second partial derivatives must vanish on \(x=0\)?
  2. If \(f(x,y,z)=f(y,x,z)\) and \((a,b,c)\) is stationary, what other point must be stationary?
  3. Why does the Hessian at a point with \(x=y\) separate the direction \((1,-1,0)\) from the plane \(x=y\)?
  4. Does variable-exchange symmetry imply that every stationary point has \(x=y\)? Explain.
  5. What additional analysis may be needed if a symmetry-reduced Hessian is semidefinite?