Why a Vanishing Derivative Changes the Density
For a one-to-one differentiable transformation, the density formula divides the input density by the absolute derivative of the transformation. A small derivative therefore stretches probability over a short range of output values and can produce a large density. At a critical point, where the derivative is zero, that formula cannot be evaluated directly. The right question is how quickly the derivative approaches zero and what that implies for the density nearby.
The key distinction is between a density that becomes unbounded near a value and an atom at that value. An unbounded density can still assign probability zero to the value itself; an atom assigns it positive probability. The local shape of the transformed density explains the first phenomenon, while the probability of the entire inverse image of the value determines the second.
Assume \(X\) has density \(f\), and consider a critical point \(x_0\) at which \(f\) is continuous and positive. Suppose the first nonzero derivative of \(g\) at \(x_0\) has finite order \(m\geq 2\). In a neighborhood of \(x_0\), this means \(g(x_0+h)-g(x_0)\) is approximately \(a h^m\), where \(a=g^{(m)}(x_0)/m!\ne 0\). The order \(m\) controls the singularity: higher-order flattening produces a stronger, though still integrable, divergence.
Local Density Near a Critical Value
Away from critical values, the finite-to-one change-of-variables formula sums a contribution from each inverse branch: at a regular value \(y\), the density is the sum of \(f(x)/|g'(x)|\) over roots \(x\) of \(g(x)=y\). Near \(y_0\), focus on the roots close to \(x_0\). Taylor expansion gives \(g(x_0+h)-y_0=a h^m+o(|h|^m)\) and \(g'(x_0+h)=ma h^{m-1}+o(|h|^{m-1})\). Thus a nearby root has distance from \(x_0\) approximately \((|y-y_0|/|a|)^{1/m}\), while the derivative there is of order \(|y-y_0|^{(m-1)/m}\).
\(\displaystyle f_{Y,\mathrm{loc}}(y)\sim \frac{q f(x_0)}{m|a|^{1/m}}\,|y-y_0|^{-(m-1)/m},\)
where \(q=2\) if \(m\) is even (there are two nearby branches on the attainable side), and \(q=1\) if \(m\) is odd (there is one nearby branch on each side). This singularity is integrable at \(y_0\).
Here \(f_{Y,\mathrm{loc}}\) denotes only the contribution from roots near \(x_0\). If other inverse branches also approach regular roots over \(y_0\), they contribute additional terms; they do not change this local leading singularity. The density formula is used at regular values, not by substituting \(y=y_0\) into a denominator that is zero.
Proof. Put \(h=x-x_0\). Taylor’s theorem under the stated differentiability assumptions yields \(g(x_0+h)-y_0=a h^m+o(|h|^m)\) and \(g'(x_0+h)=ma h^{m-1}+o(|h|^{m-1})\) as \(h\to 0\). On each side of \(x_0\), the derivative has a fixed nonzero sign sufficiently close to \(x_0\): its leading term is \(ma h^{m-1}\), and the remainder divided by \(|h|^{m-1}\) tends to zero. The map is therefore strictly monotone on each such side and has a local inverse there.
For a root \(x=x_0+h\) near \(x_0\), the first expansion implies \(|y-y_0|=|a||h|^m(1+o(1))\). Consequently, \(|h|=(|y-y_0|/|a|)^{1/m}(1+o(1))\). The derivative expansion then gives \[ |g'(x)|=m|a|^{1/m}|y-y_0|^{(m-1)/m}(1+o(1)). \] Continuity of \(f\) gives \(f(x)=f(x_0)+o(1)\). Each nearby inverse branch thus contributes \[ \frac{f(x)}{|g'(x)|} \sim \frac{f(x_0)}{m|a|^{1/m}}|y-y_0|^{-(m-1)/m}. \] For even \(m\), \(a h^m\) has the same sign on either side of zero, so there are two local roots on the attainable side and none on the other. For odd \(m\), there is one local root on each side. Summing the branch contributions gives the stated asymptotic.
Finally, \((m-1)/m<1\), and for any \(\varepsilon>0\), \[ \int_0^\varepsilon t^{-(m-1)/m}\,dt=m\varepsilon^{1/m}<\infty. \] The density divergence is therefore integrable. The argument also shows why an infinite limiting density at one point does not require positive probability at that point. \(\square\)
Worked Examples
Worked Example: A Fourth-Power Transformation
Let \(X\sim\operatorname{Uniform}(-1,1)\), and set \(Y=X^4\). Find the density of \(Y\), including its behavior near zero.
The input density is \(f(x)=1/2\) on \((-1,1)\). For \(0<y<1\), the equation \(x^4=y\) has two roots, \(x=y^{1/4}\) and \(x=-y^{1/4}\). At either root, \(|g'(x)|=|4x^3|=4y^{3/4}\). Each root contributes \((1/2)/(4y^{3/4})=1/(8y^{3/4})\), so \[ f_Y(y)=\frac{1}{4y^{3/4}},\qquad 0<y<1. \] It is zero outside \([0,1]\), apart from the fact that a density’s value at an individual endpoint may be chosen arbitrarily. Normalization checks directly: \[ \int_0^1\frac{1}{4y^{3/4}}\,dy =\frac14\left[4y^{1/4}\right]_0^1=1. \] The density diverges at zero, but \(P(Y=0)=P(X=0)=0\), since \(X\) has a density. This is an unbounded density, not an atom.
Worked Example: An Odd-Order Critical Point
Let \(X\sim\operatorname{Uniform}(-1,1)\) and \(Y=X^3\). Determine the density on its support and check the singularity at zero.
The map is increasing, with inverse \(x=y^{1/3}\) and derivative \(g'(x)=3x^2\). For \(-1<y<1\), there is one inverse root, and \[ f_Y(y)=\frac{1/2}{3(y^{1/3})^2} =\frac{1}{6|y|^{2/3}},\qquad y\ne 0. \] The formula applies on both sides of zero. Its integral is \[ \int_{-1}^1\frac{1}{6|y|^{2/3}}\,dy =2\cdot\frac16\left[3y^{1/3}\right]_0^1=1. \] Here \(m=3\), so the theorem predicts exponent \(-(m-1)/m=-2/3\), as obtained. Also \(P(Y=0)=P(X=0)=0\): the divergence around zero creates no point mass.
Worked Example: A Shifted Quadratic with a Boundary
Let \(X\sim\operatorname{Uniform}(0,3)\), and let \(Y=(X-1)^2+2\). Find the density near its minimum and describe where the branches contribute.
The input density is \(1/3\), and \(y=2\) is the critical value at \(x=1\). For \(2<y<3\), both roots \(x=1\pm\sqrt{y-2}\) lie in \((0,3)\). The derivative has magnitude \(2\sqrt{y-2}\) at either root, so each contributes \(1/[6\sqrt{y-2}]\). Thus \[ f_Y(y)=\frac{1}{3\sqrt{y-2}},\qquad 2<y<3. \] For \(3<y<6\), the root \(1-\sqrt{y-2}\) is below zero, so only the plus root remains and \(f_Y(y)=1/[6\sqrt{y-2}]\). Outside \([2,11]\)? The range of \(g\) on \([0,3]\) is \([2,6]\), so the density is zero outside \([2,6]\). The singularity at 2 is integrable: for \(0<\varepsilon<1\), \[ P(2<Y<2+\varepsilon) =\int_2^{2+\varepsilon}\frac{1}{3\sqrt{y-2}}\,dy =\frac{2\sqrt{\varepsilon}}{3}. \] Equivalently, the event is \(1-\sqrt{\varepsilon}<X<1+\sqrt{\varepsilon}\), an interval of length \(2\sqrt{\varepsilon}\). In particular, \(P(Y=2)=P(X=1)=0\).
Worked Example: A Genuine Atom and an Unbounded Density
Suppose \(X\) has probability \(0.2\) at zero and, with probability \(0.8\), is uniform on \((-1,1)\). Set \(Y=X^4\). Identify both components of the distribution of \(Y\).
The event \(X=0\) has probability \(0.2\), and \(X^4=0\) on that event. Hence \(P(Y=0)=0.2\): there is a genuine atom at zero. The continuous part of the distribution has total weight \(0.8\). From the fourth-power calculation, its density is \(0.8/(4y^{3/4})=0.2y^{-3/4}\) for \(0<y<1\). Its integral is \[ \int_0^1 0.2y^{-3/4}\,dy=0.2\cdot 4=0.8. \] The atom and continuous component therefore have total probability \(0.2+0.8=1\). The density’s divergence near zero describes the continuous probability accumulating nearby; the atom is the separate probability assigned exactly to zero.
Critical Values Are Not Automatically Atoms
For any deterministic transformation \(Y=g(X)\), \[ P(Y=y_0)=P\bigl(X\in\{x:g(x)=y_0\}\bigr). \] A zero derivative alone does not imply that this probability is positive. If \(X\) has a density and the level set \(\{x:g(x)=y_0\}\) consists of finitely many points, that set has probability zero, so \(Y\) has no atom at \(y_0\). In the examples above, the critical level sets are finite. By contrast, an atom of \(X\) at a point mapped to \(y_0\) can produce an atom of \(Y\) there, as the mixture example demonstrates. More generally, the level set’s probability—not whether the density is unbounded nearby—decides whether an atom exists.
A common mistake is to substitute the critical root directly into \(f(x)/|g'(x)|\), obtain division by zero, and conclude that the transformed distribution has infinite probability at the critical value. The correction is to use the formula at nearby regular values, determine the rate of divergence, and integrate over a neighborhood. Since the exponent \((m-1)/m\) is less than one, the nearby probability is finite and tends to zero with the neighborhood’s width. Then check \(P(X\in g^{-1}(\{y_0\}))\) separately to decide whether there is an atom.
Check Your Understanding
Use the local transformation formula and distinguish pointwise density behavior from probability at a single value.
- If the first nonzero derivative at a critical point is of order \(m=4\), what power of \(|y-y_0|\) describes the local density divergence?
- Why is a density proportional to \(t^{-3/4}\) integrable near \(t=0\)?
- For \(X\) with a density and \(Y=g(X)\), what probability determines whether \(Y\) has an atom at \(y_0\)?
- For an even-order critical point, how many local inverse branches contribute on the attainable side?
- In the mixture example, which part creates the atom at zero, and which part creates the unbounded density near zero?