Tutorials › Statistical Decision Theory › Noncompact Actions and Escaping Minimizers

Complete-Class Theorems · Tutorial 360 of 982

Noncompact Actions and Escaping Minimizers

Learn to distinguish finite unattained infima from objectives unbounded below, and to use coercive objectives to obtain minimizing actions without compact action spaces.

Advanced 12 min read

What You'll Learn

  • Define escaping minimizing sequences and distinguish them from objectives whose infimum is minus infinity
  • Prove attainment for real-valued lower-semicontinuous objectives on compact action sets
  • State and prove an existence result for coercive objectives on closed subsets of Euclidean space
  • Check coercivity and calculate a Bayes action for an explicit squared-error problem
  • Identify why coercivity at infinity alone does not handle a nonclosed action space
  • Explain what coercivity can and cannot replace in compactness-based arguments

Why Noncompact Action Spaces Need Attention

In a decision problem, an action space need not be compact. For example, an action may be any real number, so \(A=\mathbb{R}\). When an objective is minimized over a compact action space, lower semicontinuity ensures that a minimizing sequence has a convergent subsequence whose limit is an optimizer. On a noncompact space, that sequence may instead move indefinitely far away. A finite infimum can then fail to be attained.

This is one reason compactness appears in compactness-based complete-class arguments: it helps prevent limits of nearly optimal choices from disappearing outside the available space. But compactness is not the only possible route to existence. For an action space contained in Euclidean space, a sufficiently coercive objective keeps all near-minimizers in a bounded region. Closedness then gives the compactness needed to extract a convergent subsequence.

Definition: A sequence of actions \(a_n\in A\) escapes to infinity if \(\|a_n\|\to\infty\). If \(g:A\to\mathbb{R}\) has a finite infimum \(m=\inf_{a\in A}g(a)\), a sequence is a minimizing sequence if \(g(a_n)\to m\). An escaping minimizing sequence approaches the finite infimum while its actions leave every bounded region.

An infimum is a lower bound approached arbitrarily closely; it need not be the value of the objective at any action. It is important to distinguish a finite infimum that is not attained from an objective that is unbounded below. In the latter case, the infimum is \(-\infty\), not a finite number.

Worked Example: A Finite Infimum That Escapes

Let \(A=\mathbb{R}\) and \(g(a)=e^{-a}\). Since \(e^{-a}>0\) for every real \(a\), the objective is bounded below by zero. For \(a_n=n\),

$$ g(a_n)=e^{-n}\longrightarrow 0. $$

Thus \(\inf_{a\in\mathbb{R}}g(a)=0\). No action attains this value, because \(e^{-a}\) is strictly positive for every finite \(a\). The sequence \(a_n=n\) escapes to infinity while its objective values approach the finite infimum.

This example isolates the issue: having a finite infimum does not itself guarantee an optimizing action. The minimizing sequence has no convergent subsequence in \(A\).

Worked Example: An Escaping Sequence Is Not Always a Finite Minimization Problem

Again take \(A=\mathbb{R}\), but now let \(g(a)=-a\). The sequence \(a_n=n\) escapes to infinity and

$$ g(a_n)=-n\longrightarrow-\infty. $$

For any proposed real lower bound \(b\), choosing \(a>-b\) gives \(g(a)=-a<b\). Hence \(g\) is unbounded below and \(\inf_{a\in\mathbb{R}}g(a)=-\infty\). There is no finite infimum for a minimizing sequence to approach. This differs from the preceding example, where the infimum was zero and finite, but unattained.

Compactness and Lower Semicontinuity

The compact-space existence result is the basic comparison point. A function \(g\) is lower semicontinuous (l.s.c.) on a metric space if, whenever \(a_n\to a\), it satisfies \(g(a)\leq\liminf_{n\to\infty}g(a_n)\). Intuitively, the value at a limit cannot exceed the limiting lower value of nearby objective values. This condition allows the objective value at a limit point to be no worse than the values along a minimizing sequence.

Theorem: Let \(K\) be a nonempty compact metric space and let \(g:K\to\mathbb{R}\) be lower semicontinuous. Then \(g\) is bounded below and attains its finite infimum on \(K\).

Proof. First, \(g\) is bounded below. Otherwise, for each positive integer \(n\) one could choose \(a_n\in K\) with \(g(a_n)<-n\). Compactness gives a subsequence \(a_{n_j}\to a^*\in K\). Since \(n_j\to\infty\), \(\liminf_j g(a_{n_j})=-\infty\). Lower semicontinuity would imply \(g(a^*)\leq-\infty\), which is impossible because \(g\) is real-valued. Thus \(g\) has a real lower bound. It also has a finite upper bound on its infimum, since \(K\) is nonempty and the value at any chosen point is finite. Therefore \(m=\inf_{a\in K}g(a)\) is finite.

Choose a minimizing sequence with \(g(a_n)\to m\). By compactness, some subsequence \(a_{n_j}\) converges to \(a^*\in K\). Lower semicontinuity gives

$$ g(a^*)\leq\liminf_{j\to\infty}g(a_{n_j})=m. $$

Since \(m\) is the infimum, \(m\leq g(a^*)\). Therefore \(g(a^*)=m\), so \(a^*\) attains the infimum. \(\square\)

Coercivity as an Alternative to Compactness

On a noncompact subset of Euclidean space, coercivity prevents near-minimizers from escaping. The relevant condition is about the objective at large action values, not about the parameter space of the statistical model.

Definition: Let \(A\subseteq\mathbb{R}^k\). A function \(g:A\to\mathbb{R}\) is coercive if, for every real \(M\), there is an \(R<\infty\) such that \(a\in A\) and \(\|a\|\geq R\) imply \(g(a)\geq M\). Equivalently, \(g(a)\to+\infty\) as \(\|a\|\to\infty\) within \(A\).
Theorem: Let \(A\) be a nonempty closed subset of \(\mathbb{R}^k\). If \(g:A\to\mathbb{R}\) is lower semicontinuous and coercive, then \(g\) is bounded below and attains its finite infimum on \(A\).

Proof. Choose \(a_0\in A\). By coercivity, there is \(R<\infty\) such that \(g(a)\geq g(a_0)\) whenever \(a\in A\) and \(\|a\|\geq R\). The set \(K=A\cap\{a:\|a\|\leq R\}\) is compact: it is closed and bounded in \(\mathbb{R}^k\). If \(K\) is nonempty, the compact-space result just proved shows that \(g\) is bounded below on \(K\). If \(K\) is empty, there are no points of \(A\) to consider inside that ball. Outside the ball, \(g(a)\geq g(a_0)\). In either case, \(g\) is bounded below on \(A\); since \(A\) is nonempty and \(g(a_0)\) is finite, \(m=\inf_{a\in A}g(a)\) is finite.

Take a minimizing sequence \(a_n\in A\) with \(g(a_n)\to m\). Eventually \(g(a_n)\leq g(a_0)+1\). Coercivity, applied with \(M=g(a_0)+1\), gives a radius outside which \(g(a)\geq g(a_0)+1\). Thus all sufficiently late terms of the minimizing sequence lie inside a bounded ball. Since \(A\) is closed, a subsequence converges to some \(a^*\in A\). Lower semicontinuity gives \(g(a^*)\leq m\); the definition of \(m\) gives \(m\leq g(a^*)\). Hence \(g(a^*)=m\), and the infimum is attained. \(\square\)

The proof identifies the role of each assumption. Coercivity rules out escape by a minimizing sequence. Closedness ensures that a subsequential limit remains an available action. Lower semicontinuity ensures that the limit is at least as good as the limiting objective values. In particular, every sublevel set \(\{a\in A:g(a)\leq c\}\), for finite \(c\), is bounded by coercivity and closed by lower semicontinuity; it is therefore compact.

Worked Example: A Coercive Bayes Objective

Suppose the unknown state is \(\theta\in\{0,1\}\), the action is \(a\in\mathbb{R}\), and the loss is \(L(\theta,a)=(a-\theta)^2\). Consider a prior with \(P(\theta=0)=0.75\) and \(P(\theta=1)=0.25\). With no observation, the Bayes objective is the prior expected loss:

$$ g(a)=0.75a^2+0.25(a-1)^2 =0.75a^2+0.25a^2-0.5a+0.25 =a^2-0.5a+0.25. $$

Completing the square gives

$$ g(a)=(a-0.25)^2+0.1875. $$

Thus \(g(a)\geq0.1875\) for all real \(a\), with equality at \(a=0.25\). The quadratic term also shows \(g(a)\to+\infty\) as \(|a|\to\infty\), so \(g\) is coercive. The action space is noncompact, but the Bayes objective has a minimizer at \(a=0.25\), and its minimum risk is \(0.1875\).

What Coercivity Does—and Does Not—Replace

Coercivity is a condition on a particular objective function. It can replace compactness of the action space when the question is whether that objective has a minimizer, provided the space is closed and the objective is lower semicontinuous. It does not, by itself, establish all the compactness properties needed in a complete-class theorem. Such arguments may involve sequences of decision rules, risk functions, or probability kernels, and each requires its own hypotheses and limit argument.

The closedness condition also matters. Coercivity at infinity controls sequences whose norms grow without bound; it does not prevent a sequence from approaching a missing boundary point at finite distance.

Worked Example: Why a Nonclosed Action Space Can Still Cause Failure

Let \(A=(0,1)\) and \(g(a)=a\). This function is continuous and bounded below by zero, but it does not attain its infimum: \(\inf_{a\in(0,1)}g(a)=0\), and \(0\notin A\). The minimizing sequence \(a_n=1/n\) converges to the excluded boundary point \(0\).

The condition \(g(a)\to+\infty\) as \(\|a\|\to\infty\) does not rule out this failure: \(A\) is bounded, so there are no actions with arbitrarily large norm. The stronger compact-sublevel formulation makes the issue visible. For example, the sublevel set \(\{a\in A:g(a)\leq 1/2\}=(0,1/2]\) is not compact in \(A\). Closedness of \(A\), or an appropriate compactness condition on sublevel sets, is needed to prevent minimizing sequences from converging outside the action space.

Common Mistakes

  • Calling every escaping sequence evidence of an unattained finite optimum. For \(g(a)=-a\), the objective values tend to \(-\infty\), so there is no finite infimum. Check whether the infimum is finite before describing a sequence as approaching it.
  • Assuming a finite infimum must be attained. For \(g(a)=e^{-a}\), the infimum is zero, but every available action has strictly positive objective value.
  • Using coercivity without checking the action space. A closed subset of Euclidean space is needed for the theorem above. Coercivity at infinity alone does not prevent a minimizing sequence from approaching an excluded finite boundary point.
  • Applying objective-level existence to an entire decision-theoretic limit argument. Coercivity can yield an optimizer for a specified objective; it does not automatically supply compactness or risk-limit properties for a class of decision rules.
Key takeaway: A noncompact action space permits minimizing sequences to escape. If the objective has a finite infimum, this can leave the infimum unattained; if the objective is coercive, lower semicontinuity and a closed Euclidean action space instead force a minimizer to exist.

Check Your Understanding

Answer each question by identifying the relevant condition and, where appropriate, showing the calculation.

  1. For \(g(a)=1/(1+a)\) on \(A=[0,\infty)\), determine the infimum and whether it is attained. Give an escaping minimizing sequence.
  2. Why does the sequence \(a_n=n\) for \(g(a)=-a\) not demonstrate failure to attain a finite infimum?
  3. State the three main hypotheses in the coercive minimization theorem and explain the role of each.
  4. For squared-error loss with \(P(\theta=0)=0.4\) and \(P(\theta=1)=0.6\), calculate the Bayes objective and its minimizing action.
  5. Why does coercivity at infinity fail to ensure an optimizer for \(g(a)=a\) on \(A=(0,1)\)?
Clinical Biostats