Tutorials › Statistical Theory I - Probability and Distribution Theory › When Characteristic-Function Inversion Needs Care

Characteristic Functions · Tutorial 565 of 994

When Characteristic-Function Inversion Needs Care

Separate interval, atom, and density inversion by their hypotheses, and see what can go wrong when the characteristic function is not integrable.

Advanced 11 min read

What You'll Learn

  • State the endpoint convention in Lévy inversion for interval probabilities.
  • Recover an atom directly from its characteristic function.
  • Explain why an integrable characteristic function guarantees a continuous density.
  • Distinguish absolute integrability from conditional Fourier inversion.
  • Diagnose formal inverse integrals for discrete and mixed distributions.

One Transform, Several Different Questions

A characteristic function can encode an interval probability, the probability of a single point, or a density, but these are different inversion questions. Their formulas do not have identical hypotheses or identical meanings. In particular, writing down an inverse Fourier integral does not by itself show that a distribution has a density.

Throughout, let \(X\) be a real-valued random variable with characteristic function \(\varphi(t)=E[e^{itX}]\). The distribution may have a density, atoms, or both. The central distinction is this: interval inversion and atom inversion apply without assuming a density, whereas the standard absolutely convergent density inversion theorem requires \(\varphi\) to be integrable.

Definition: The characteristic function of \(X\) is \(\varphi(t)=E[e^{itX}]\), for \(t\in\mathbb{R}\). It always exists and satisfies \(|\varphi(t)|\leq 1\). The condition \(\varphi\in L^1(\mathbb{R})\) means \(\int_{\mathbb{R}}|\varphi(t)|\,dt<\infty\); it is a stronger condition than mere existence of the characteristic function.

Interval Probabilities: Boundary Mass Must Be Counted

Lévy inversion recovers probabilities of intervals directly from \(\varphi\). The symmetric truncation in the formula matters: if the distribution has mass at an endpoint, that endpoint contributes one half. Thus the formula applies whether or not \(X\) has a density, but the endpoint convention must be respected.

Theorem (Lévy inversion for intervals): For any real \(a<b\),
$$ \lim_{T\to\infty}\frac{1}{2\pi}\int_{-T}^{T} \varphi(t)\frac{e^{-ita}-e^{-itb}}{it}\,dt = P(a<X<b)+\frac12P(X=a)+\frac12P(X=b). $$
The integrand has a removable singularity at \(t=0\), so its value there can be assigned by continuity. In particular, if \(P(X=a)=P(X=b)=0\), the limit equals \(P(a<X<b)\).

Here is the justification, including why the expectation and the limiting operation are legitimate. For finite \(T\), the integrand can be written as an expectation and integrated over a bounded interval; the quotient has a finite limit at zero. For a fixed value \(x\), the resulting kernel is

$$ \frac{1}{2\pi}\int_{-T}^{T}e^{itx} \frac{e^{-ita}-e^{-itb}}{it}\,dt = \frac{1}{\pi}\int_0^T \frac{\sin(t(x-a))-\sin(t(x-b))}{t}\,dt. $$

The sine integral \(\int_0^T\sin(tu)/t\,dt\) is bounded by a constant independent of \(u\) and \(T\). As \(T\to\infty\), it tends to \(\frac{\pi}{2}\) for \(u>0\), to \(-\frac{\pi}{2}\) for \(u<0\), and is zero for \(u=0\). Therefore the displayed kernel is uniformly bounded and converges to 1 when \(a<x<b\), to \(1/2\) when \(x=a\) or \(x=b\), and to 0 otherwise. Taking expectations and applying bounded convergence proves the formula. \(\square\)

Worked Example: An Interval Probability with an Endpoint Atom

Let \(X\) take the values 0 and 1 with probabilities \(1/3\) and \(2/3\), respectively. Its characteristic function is \(\varphi(t)=\frac13+\frac23e^{it}\). Find the Lévy inversion value for \(a=0\), \(b=1\).

The open interval \((0,1)\) contains no possible value of \(X\), so \(P(0<X<1)=0\). The endpoint probabilities are \(P(X=0)=1/3\) and \(P(X=1)=2/3\). Hence the inversion value is

$$ 0+\frac12\left(\frac13\right)+\frac12\left(\frac23\right)=\frac12. $$

This is not \(P(0<X\leq 1)=2/3\) or \(P(0\leq X<1)=1/3\). The symmetric inversion formula assigns half of each endpoint atom; it does not silently choose one of those half-open intervals.

Atoms: A Separate Inversion Formula

An atom is a point \(x\) with \(P(X=x)>0\). Its mass can be recovered without assuming that \(X\) has a density or that \(\varphi\) is integrable.

Theorem (atom inversion): For every \(x\in\mathbb{R}\),
$$ P(X=x)=\lim_{T\to\infty}\frac{1}{2T} \int_{-T}^{T}e^{-itx}\varphi(t)\,dt. $$

To prove this, interchange expectation and integration on the finite interval. The right-hand expression before taking the limit becomes

$$ E\left[\frac{1}{2T}\int_{-T}^{T}e^{it(X-x)}\,dt\right] = E\left[\frac{\sin(T(X-x))}{T(X-x)}\right], $$

where the ratio is defined as 1 when \(X=x\). The ratio has absolute value at most 1. As \(T\to\infty\), it tends to 1 if \(X=x\) and to 0 otherwise. Bounded convergence gives the claimed probability. \(\square\)

Worked Example: Recovering a Point Mass

Suppose \(X=c\) with probability 1. Then \(\varphi(t)=e^{itc}\). At the point \(x=c\), atom inversion gives

$$ \frac{1}{2T}\int_{-T}^{T}e^{-itc}e^{itc}\,dt =\frac{1}{2T}(2T)=1. $$

At any \(x\ne c\), the same average equals

$$ \frac{1}{2T}\int_{-T}^{T}e^{it(c-x)}\,dt =\frac{\sin(T(c-x))}{T(c-x)} \longrightarrow 0. $$

Thus the formula returns mass 1 at \(c\) and mass 0 elsewhere, as required. It is an averaged inversion formula, not an ordinary inverse integral intended to produce a density.

Density Inversion: What Integrability Guarantees

A useful sufficient condition for ordinary density inversion is absolute integrability of the characteristic function. It ensures both that the inverse integral exists and that the distribution is absolutely continuous.

Theorem (density inversion for an integrable characteristic function): If \(\int_{\mathbb{R}}|\varphi(t)|\,dt<\infty\), then the distribution of \(X\) has a bounded, uniformly continuous density \(f\). A continuous version of that density is
$$ f(x)=\frac{1}{2\pi}\int_{\mathbb{R}}e^{-itx}\varphi(t)\,dt, \qquad x\in\mathbb{R}. $$

A regularization argument proves the claim without assuming the desired density in advance. Let \(Z\sim N(0,1)\) be independent of \(X\), and for \(\varepsilon>0\) consider \(X+\varepsilon Z\). This variable has a density \(f_\varepsilon\), obtained by averaging the normal density centered at \(X\). Its characteristic function is \(\varphi(t)e^{-\varepsilon^2t^2/2}\), so Fourier inversion for the smoothed distribution gives

$$ f_\varepsilon(x)=\frac{1}{2\pi}\int_{\mathbb{R}} e^{-itx}\varphi(t)e^{-\varepsilon^2t^2/2}\,dt. $$

Because \(|\varphi|\) is integrable, dominated convergence shows that \(f_\varepsilon(x)\) converges uniformly in \(x\) to the inverse integral \(g(x)\): indeed, the supremum of the difference is at most

$$ \frac{1}{2\pi}\int_{\mathbb{R}}|\varphi(t)| \left|e^{-\varepsilon^2t^2/2}-1\right|\,dt \longrightarrow 0. $$

The inverse integral \(g\) is bounded and uniformly continuous, by integrability of \(\varphi\) and dominated convergence applied to translations in \(x\). Each \(f_\varepsilon\) is nonnegative, so the uniform limit \(g\) is nonnegative. For any continuous compactly supported function \(h\), uniform convergence on its support gives \(\int h(x)f_\varepsilon(x)\,dx\to\int h(x)g(x)\,dx\). On the other hand, \(E[h(X+\varepsilon Z)]\to E[h(X)]\) by bounded convergence, using the same \(X,Z\) for all \(\varepsilon\). Thus

$$ E[h(X)]=\int_{\mathbb{R}}h(x)g(x)\,dx. $$

Equality for all continuous compactly supported \(h\) identifies the distribution of \(X\) with the measure having density \(g\). Consequently \(g\) integrates to 1 and is the asserted continuous density. \(\square\)

Worked Example: Inverting the Cauchy Characteristic Function

For a standard Cauchy random variable, \(\varphi(t)=e^{-|t|}\). It is integrable because

$$ \int_{\mathbb{R}}e^{-|t|}\,dt=2\int_0^\infty e^{-t}\,dt=2. $$

The inversion theorem therefore applies. Splitting the integral at zero gives

$$ \begin{aligned} f(x) &=\frac{1}{2\pi}\left( \int_0^\infty e^{-t}e^{-itx}\,dt+ \int_0^\infty e^{-t}e^{itx}\,dt\right)\\ &=\frac{1}{2\pi}\left(\frac{1}{1+ix}+\frac{1}{1-ix}\right) =\frac{1}{\pi(1+x^2)}. \end{aligned} $$

The two fractions sum to \(2/(1+x^2)\), confirming the normalization and the familiar Cauchy density.

When the Characteristic Function Is Not Integrable

Failure of \(\varphi\in L^1\) has a limited but important meaning: the theorem guaranteeing an absolutely convergent inverse integral and a continuous density cannot be applied. It does not prove that no density exists. Some distributions with densities have nonintegrable characteristic functions, and a symmetric or regularized inverse may still recover their density at suitable points.

Worked Example: A Nonintegrable Characteristic Function with a Density

If \(X\) is uniform on \((-1,1)\), then its density is \(1/2\) on that interval and its characteristic function is \(\varphi(t)=\sin(t)/t\), with value 1 at zero. This characteristic function is not absolutely integrable: on intervals where \(|\sin t|\geq 1/2\), its absolute value is at least \(1/(2|t|)\), and summing the resulting contributions over successive periods yields a divergent harmonic-type sum.

Nevertheless, the symmetric truncated inverse has a limit. For \(|x|<1\), it equals

$$ \begin{aligned} \frac{1}{2\pi}\int_{-T}^{T}e^{-itx}\frac{\sin t}{t}\,dt &=\frac{1}{\pi}\int_0^T\frac{\sin t\cos(tx)}{t}\,dt\\ &=\frac{1}{2\pi}\int_0^T \frac{\sin((1+x)t)+\sin((1-x)t)}{t}\,dt. \end{aligned} $$

Both coefficients \(1+x\) and \(1-x\) are positive. Each sine integral tends to \(\pi/2\), so the limit is \(1/2\). If \(x>1\), the two coefficients have opposite signs and their limits cancel; the result is 0. The same cancellation holds for \(x<-1\). At \(x=1\) or \(x=-1\), one coefficient is zero and the other positive, so the limit is \(1/4\), the symmetric boundary value. Thus a non-\(L^1\) characteristic function can still admit useful symmetric inversion; what is missing is the absolute-integrability guarantee.

Worked Example: A Formal Inverse for an Atom Is Not a Density

For the point mass \(X=c\), the formal inverse integral truncated symmetrically at \(T\) is

$$ \frac{1}{2\pi}\int_{-T}^{T}e^{-itx}\varphi(t)\,dt = \begin{cases} \dfrac{\sin(T(c-x))}{\pi(c-x)}, & x\ne c,\\[6pt] \dfrac{T}{\pi}, & x=c. \end{cases} $$

At \(x=c\), the value diverges to infinity. At \(x\ne c\), it oscillates and generally has no limit as \(T\to\infty\). No ordinary density is obtained. The distribution is concentrated at one point, and its mass is recovered by atom inversion instead. In generalized-function language the inverse corresponds to a point mass, not to an ordinary function that can serve as a density.

Common Pitfalls and a Practical Choice

A recurring error is to treat every inverse Fourier expression as if it were a density. For example, the argument “the characteristic function has a Fourier inverse, so that inverse must be the density” skips the essential hypotheses. A point mass has a perfectly valid characteristic function but no density, and its formal symmetric inverse does not converge to an ordinary density. Conversely, the uniform example shows that \(\varphi\notin L^1\) alone does not imply that a density is absent.

Choose the inversion tool to match the question:

  • For an interval probability, use Lévy inversion and account for half-mass at each endpoint.
  • For the probability at one point, use atom inversion.
  • For a density from an absolutely integrable characteristic function, use the ordinary inverse integral.
  • If the characteristic function is not integrable, do not infer either the presence or absence of a density from that fact alone. Check the distributional structure and the convergence mode of any proposed inverse.

Absolute integrability is a clean sufficient condition, not a necessary condition for every possible density inversion formula. A conditional limit, a symmetric truncation, or a smoothing procedure needs its own justification and may encode boundary values differently. Keeping these distinctions explicit prevents a formal calculation from being mistaken for a theorem.

Check Your Understanding

Use the hypotheses and endpoint conventions in each question.

  1. What does Lévy inversion assign to an interval endpoint that carries positive probability?
  2. Why can atom inversion be applied even when the characteristic function is not integrable?
  3. State the conclusion guaranteed when a characteristic function is absolutely integrable.
  4. Does a nonintegrable characteristic function prove that the distribution has no density? Explain using an example from this tutorial.
  5. Why does the symmetric inverse of the characteristic function of a point mass fail to be an ordinary density?