Tutorials › Statistical Theory I - Probability and Distribution Theory › Critical Points and Integrable Density Singularities

Many-to-One Transformations · Tutorial 426 of 994

Critical Points and Integrable Density Singularities

See how critical points create unbounded but integrable densities, and learn when a transformed value is instead a genuine atom.

Intermediate 10 min read

What You'll Learn

  • Identify a critical point and the first nonzero term in a transformation’s local expansion
  • Derive the power-law rate of a density singularity near a critical value
  • Check why the singularity is integrable even when the density is unbounded
  • Distinguish a density singularity from an atom using probability at a single point
  • Work with even- and odd-order critical points and mixed input distributions

Why a Vanishing Derivative Changes the Density

For a one-to-one differentiable transformation, the density formula divides the input density by the absolute derivative of the transformation. A small derivative therefore stretches probability over a short range of output values and can produce a large density. At a critical point, where the derivative is zero, that formula cannot be evaluated directly. The right question is how quickly the derivative approaches zero and what that implies for the density nearby.

The key distinction is between a density that becomes unbounded near a value and an atom at that value. An unbounded density can still assign probability zero to the value itself; an atom assigns it positive probability. The local shape of the transformed density explains the first phenomenon, while the probability of the entire inverse image of the value determines the second.

Definition: Let \(Y=g(X)\). A point \(x_0\) is a critical point of \(g\) if \(g'(x_0)=0\); its image \(y_0=g(x_0)\) is a critical value. A probability distribution has an atom at \(y_0\) if \(P(Y=y_0)>0\).

Assume \(X\) has density \(f\), and consider a critical point \(x_0\) at which \(f\) is continuous and positive. Suppose the first nonzero derivative of \(g\) at \(x_0\) has finite order \(m\geq 2\). In a neighborhood of \(x_0\), this means \(g(x_0+h)-g(x_0)\) is approximately \(a h^m\), where \(a=g^{(m)}(x_0)/m!\ne 0\). The order \(m\) controls the singularity: higher-order flattening produces a stronger, though still integrable, divergence.

Local Density Near a Critical Value

Away from critical values, the finite-to-one change-of-variables formula sums a contribution from each inverse branch: at a regular value \(y\), the density is the sum of \(f(x)/|g'(x)|\) over roots \(x\) of \(g(x)=y\). Near \(y_0\), focus on the roots close to \(x_0\). Taylor expansion gives \(g(x_0+h)-y_0=a h^m+o(|h|^m)\) and \(g'(x_0+h)=ma h^{m-1}+o(|h|^{m-1})\). Thus a nearby root has distance from \(x_0\) approximately \((|y-y_0|/|a|)^{1/m}\), while the derivative there is of order \(|y-y_0|^{(m-1)/m}\).

Theorem: Suppose \(g\) is \(m\) times continuously differentiable near \(x_0\), with \(g'(x_0)=\cdots=g^{(m-1)}(x_0)=0\) and \(g^{(m)}(x_0)\ne 0\), for some integer \(m\geq 2\). Suppose \(X\) has a density \(f\) continuous at \(x_0\), with \(f(x_0)>0\). Write \(y_0=g(x_0)\) and \(a=g^{(m)}(x_0)/m!\). The density contribution from inverse branches near \(x_0\), at regular values \(y\ne y_0\) on the attainable side or sides, satisfies

\(\displaystyle f_{Y,\mathrm{loc}}(y)\sim \frac{q f(x_0)}{m|a|^{1/m}}\,|y-y_0|^{-(m-1)/m},\)

where \(q=2\) if \(m\) is even (there are two nearby branches on the attainable side), and \(q=1\) if \(m\) is odd (there is one nearby branch on each side). This singularity is integrable at \(y_0\).

Here \(f_{Y,\mathrm{loc}}\) denotes only the contribution from roots near \(x_0\). If other inverse branches also approach regular roots over \(y_0\), they contribute additional terms; they do not change this local leading singularity. The density formula is used at regular values, not by substituting \(y=y_0\) into a denominator that is zero.

Proof. Put \(h=x-x_0\). Taylor’s theorem under the stated differentiability assumptions yields \(g(x_0+h)-y_0=a h^m+o(|h|^m)\) and \(g'(x_0+h)=ma h^{m-1}+o(|h|^{m-1})\) as \(h\to 0\). On each side of \(x_0\), the derivative has a fixed nonzero sign sufficiently close to \(x_0\): its leading term is \(ma h^{m-1}\), and the remainder divided by \(|h|^{m-1}\) tends to zero. The map is therefore strictly monotone on each such side and has a local inverse there.

For a root \(x=x_0+h\) near \(x_0\), the first expansion implies \(|y-y_0|=|a||h|^m(1+o(1))\). Consequently, \(|h|=(|y-y_0|/|a|)^{1/m}(1+o(1))\). The derivative expansion then gives \[ |g'(x)|=m|a|^{1/m}|y-y_0|^{(m-1)/m}(1+o(1)). \] Continuity of \(f\) gives \(f(x)=f(x_0)+o(1)\). Each nearby inverse branch thus contributes \[ \frac{f(x)}{|g'(x)|} \sim \frac{f(x_0)}{m|a|^{1/m}}|y-y_0|^{-(m-1)/m}. \] For even \(m\), \(a h^m\) has the same sign on either side of zero, so there are two local roots on the attainable side and none on the other. For odd \(m\), there is one local root on each side. Summing the branch contributions gives the stated asymptotic.

Finally, \((m-1)/m<1\), and for any \(\varepsilon>0\), \[ \int_0^\varepsilon t^{-(m-1)/m}\,dt=m\varepsilon^{1/m}<\infty. \] The density divergence is therefore integrable. The argument also shows why an infinite limiting density at one point does not require positive probability at that point. \(\square\)

Worked Examples

Worked Example: A Fourth-Power Transformation

Let \(X\sim\operatorname{Uniform}(-1,1)\), and set \(Y=X^4\). Find the density of \(Y\), including its behavior near zero.

The input density is \(f(x)=1/2\) on \((-1,1)\). For \(0<y<1\), the equation \(x^4=y\) has two roots, \(x=y^{1/4}\) and \(x=-y^{1/4}\). At either root, \(|g'(x)|=|4x^3|=4y^{3/4}\). Each root contributes \((1/2)/(4y^{3/4})=1/(8y^{3/4})\), so \[ f_Y(y)=\frac{1}{4y^{3/4}},\qquad 0<y<1. \] It is zero outside \([0,1]\), apart from the fact that a density’s value at an individual endpoint may be chosen arbitrarily. Normalization checks directly: \[ \int_0^1\frac{1}{4y^{3/4}}\,dy =\frac14\left[4y^{1/4}\right]_0^1=1. \] The density diverges at zero, but \(P(Y=0)=P(X=0)=0\), since \(X\) has a density. This is an unbounded density, not an atom.

Worked Example: An Odd-Order Critical Point

Let \(X\sim\operatorname{Uniform}(-1,1)\) and \(Y=X^3\). Determine the density on its support and check the singularity at zero.

The map is increasing, with inverse \(x=y^{1/3}\) and derivative \(g'(x)=3x^2\). For \(-1<y<1\), there is one inverse root, and \[ f_Y(y)=\frac{1/2}{3(y^{1/3})^2} =\frac{1}{6|y|^{2/3}},\qquad y\ne 0. \] The formula applies on both sides of zero. Its integral is \[ \int_{-1}^1\frac{1}{6|y|^{2/3}}\,dy =2\cdot\frac16\left[3y^{1/3}\right]_0^1=1. \] Here \(m=3\), so the theorem predicts exponent \(-(m-1)/m=-2/3\), as obtained. Also \(P(Y=0)=P(X=0)=0\): the divergence around zero creates no point mass.

Worked Example: A Shifted Quadratic with a Boundary

Let \(X\sim\operatorname{Uniform}(0,3)\), and let \(Y=(X-1)^2+2\). Find the density near its minimum and describe where the branches contribute.

The input density is \(1/3\), and \(y=2\) is the critical value at \(x=1\). For \(2<y<3\), both roots \(x=1\pm\sqrt{y-2}\) lie in \((0,3)\). The derivative has magnitude \(2\sqrt{y-2}\) at either root, so each contributes \(1/[6\sqrt{y-2}]\). Thus \[ f_Y(y)=\frac{1}{3\sqrt{y-2}},\qquad 2<y<3. \] For \(3<y<6\), the root \(1-\sqrt{y-2}\) is below zero, so only the plus root remains and \(f_Y(y)=1/[6\sqrt{y-2}]\). Outside \([2,11]\)? The range of \(g\) on \([0,3]\) is \([2,6]\), so the density is zero outside \([2,6]\). The singularity at 2 is integrable: for \(0<\varepsilon<1\), \[ P(2<Y<2+\varepsilon) =\int_2^{2+\varepsilon}\frac{1}{3\sqrt{y-2}}\,dy =\frac{2\sqrt{\varepsilon}}{3}. \] Equivalently, the event is \(1-\sqrt{\varepsilon}<X<1+\sqrt{\varepsilon}\), an interval of length \(2\sqrt{\varepsilon}\). In particular, \(P(Y=2)=P(X=1)=0\).

Worked Example: A Genuine Atom and an Unbounded Density

Suppose \(X\) has probability \(0.2\) at zero and, with probability \(0.8\), is uniform on \((-1,1)\). Set \(Y=X^4\). Identify both components of the distribution of \(Y\).

The event \(X=0\) has probability \(0.2\), and \(X^4=0\) on that event. Hence \(P(Y=0)=0.2\): there is a genuine atom at zero. The continuous part of the distribution has total weight \(0.8\). From the fourth-power calculation, its density is \(0.8/(4y^{3/4})=0.2y^{-3/4}\) for \(0<y<1\). Its integral is \[ \int_0^1 0.2y^{-3/4}\,dy=0.2\cdot 4=0.8. \] The atom and continuous component therefore have total probability \(0.2+0.8=1\). The density’s divergence near zero describes the continuous probability accumulating nearby; the atom is the separate probability assigned exactly to zero.

Critical Values Are Not Automatically Atoms

For any deterministic transformation \(Y=g(X)\), \[ P(Y=y_0)=P\bigl(X\in\{x:g(x)=y_0\}\bigr). \] A zero derivative alone does not imply that this probability is positive. If \(X\) has a density and the level set \(\{x:g(x)=y_0\}\) consists of finitely many points, that set has probability zero, so \(Y\) has no atom at \(y_0\). In the examples above, the critical level sets are finite. By contrast, an atom of \(X\) at a point mapped to \(y_0\) can produce an atom of \(Y\) there, as the mixture example demonstrates. More generally, the level set’s probability—not whether the density is unbounded nearby—decides whether an atom exists.

A common mistake is to substitute the critical root directly into \(f(x)/|g'(x)|\), obtain division by zero, and conclude that the transformed distribution has infinite probability at the critical value. The correction is to use the formula at nearby regular values, determine the rate of divergence, and integrate over a neighborhood. Since the exponent \((m-1)/m\) is less than one, the nearby probability is finite and tends to zero with the neighborhood’s width. Then check \(P(X\in g^{-1}(\{y_0\}))\) separately to decide whether there is an atom.

Key takeaway: A critical point of order \(m\) with positive input density typically produces a density proportional to \(|y-y_0|^{-(m-1)/m}\) on its attainable side or sides. This power-law divergence is integrable. An atom is a separate matter, determined by the probability of the full inverse image of the value.

Check Your Understanding

Use the local transformation formula and distinguish pointwise density behavior from probability at a single value.

  1. If the first nonzero derivative at a critical point is of order \(m=4\), what power of \(|y-y_0|\) describes the local density divergence?
  2. Why is a density proportional to \(t^{-3/4}\) integrable near \(t=0\)?
  3. For \(X\) with a density and \(Y=g(X)\), what probability determines whether \(Y\) has an atom at \(y_0\)?
  4. For an even-order critical point, how many local inverse branches contribute on the attainable side?
  5. In the mixture example, which part creates the atom at zero, and which part creates the unbounded density near zero?