Tutorials › Stochastic Processes › Absolutely Continuous, Atomic, and Singular Spectra

Weak Stationarity and Spectral Representation · Tutorial 901 of 994

Absolutely Continuous, Atomic, and Singular Spectra

Learn to distinguish the three parts of a spectral measure, recognize when a density exists, and check their covariance contributions.

Advanced 10 min read

What You'll Learn

  • State the Lebesgue decomposition of a finite spectral measure.
  • Distinguish absolutely continuous, atomic, and singular-continuous measures.
  • Identify densities, point masses, and singular continuous support in examples.
  • Compute covariance contributions using the course’s Fourier convention.
  • Check component masses and identify a common error in mixed spectra.

Three Ways Spectral Mass Can Be Distributed

A spectral measure need not have a density. Its mass may be spread across frequencies in a way described by a density, concentrated at individual frequencies, or concentrated on a set of Lebesgue measure zero without any point masses. Distinguishing these possibilities matters because a density describes only the first kind of mass; it cannot encode atoms or singular-continuous mass.

Let \((X_n)_{n\ge0}\) be a real-valued weakly stationary sequence on a probability space \((\Omega,\mathcal{F},\mathbb{P})\), with finite second moments. Write \(\gamma(h)=\operatorname{Cov}(X_{n+h},X_n)\), for integer lag \(h\), and use the spectral convention from the earlier material: a finite positive measure \(F\) on the frequency circle \([-\pi,\pi)\) satisfies \(\gamma(h)=\int e^{ih\lambda}F(d\lambda)\). For a real-valued sequence, \(F\) is symmetric. In particular, \(F([-\pi,\pi))=\gamma(0)=\operatorname{Var}(X_n)\). The endpoints of this interval are identified when treating it as a circle.

Definition: Let \(m\) denote Lebesgue measure on the frequency circle. A finite positive measure \(F\) is absolutely continuous if \(F\ll m\): whenever \(m(A)=0\), \(F(A)=0\). It is singular if it is concentrated on a set \(N\) with \(m(N)=0\). It is atomic if it is a sum of point masses \(a_j\delta_{\lambda_j}\), where \(a_j>0\). It is singular continuous if it is singular and has no point masses, so \(F(\{\lambda\})=0\) for every \(\lambda\).

The Lebesgue decomposition theorem says that every finite positive measure has a unique decomposition into an absolutely continuous part and a singular part. This is a standard measure-theoretic result; its proof is beyond this tutorial. The singular part itself splits uniquely into its atoms and a singular-continuous remainder. Thus the spectral measure has the form

$$ F(d\lambda)=f(\lambda)\,d\lambda+ \sum_{j}a_j\delta_{\lambda_j}(d\lambda)+F_{\mathrm{sc}}(d\lambda), $$

where \(f\ge0\) is integrable, the frequencies \(\lambda_j\) are distinct, \(a_j>0\), and \(F_{\mathrm{sc}}\) is singular continuous. The sum may be finite, countably infinite, or empty. In the absolutely continuous part, the Radon–Nikodym theorem supplies the density \(f\); the density is defined up to changes on a Lebesgue-null set. Neither an atom nor a nonzero singular-continuous measure can be represented by an integrable density with respect to \(d\lambda\).

Theorem (Three-part decomposition): Every finite positive spectral measure \(F\) has a unique decomposition into an absolutely continuous measure, a purely atomic measure, and a singular-continuous measure. For a real-valued stationary sequence, each component can be taken symmetric. The existence of the absolutely continuous/singular split is the standard Lebesgue decomposition theorem; the proof of that deep measure-theoretic result is not given here. The uniqueness of the split and the further atomic split are justified below.

Proof. For uniqueness of the absolutely continuous/singular split, suppose \(F=\alpha+\sigma\), where \(\alpha\ll m\) and \(\sigma\) is concentrated on a Lebesgue-null set \(N\). On any measurable set \(A\subseteq N^c\), \(\sigma(A)=0\), so \(\alpha(A)=F(A)\). On \(N\), absolute continuity gives \(\alpha(N)=0\), so \(\sigma(A)=F(A)\) for measurable \(A\subseteq N\). These identities determine both measures: \(\alpha(A)=F(A\cap N^c)\) and \(\sigma(A)=F(A\cap N)\) for every measurable \(A\). Hence the two measures are unique. For any finite measure \(\sigma\), its set of atoms \(D=\{\lambda:\sigma(\{\lambda\})>0\}\) is countable: for each positive integer \(r\), there can be only finitely many points with mass at least \(1/r\), since \(\sigma\) has finite total mass, and every positive mass is at least \(1/r\) for some \(r\). Consequently \(\sigma_{\mathrm{at}}=\sum_{\lambda\in D}\sigma(\{\lambda\})\delta_\lambda\) is well-defined, and \(\sigma-\sigma_{\mathrm{at}}\) is positive and has no atoms. If \(\sigma\) is singular, both measures are concentrated on its null supporting set, so the remainder is singular continuous. The atomic part is fixed by its singleton masses, which proves uniqueness of this further split. Finally, if \(F\) is symmetric, reflection of any of these components is another decomposition with the same defining properties. Uniqueness therefore makes each component symmetric. \(\square\)

The three pieces contribute separately to the covariance integral. The density contributes \(\int e^{ih\lambda}f(\lambda)\,d\lambda\); the atoms contribute \(\sum_j a_je^{ih\lambda_j}\); and the singular-continuous part contributes \(\int e^{ih\lambda}F_{\mathrm{sc}}(d\lambda)\). When \(F\) is symmetric, these integrals are real and may be written with \(\cos(h\lambda)\). A density exists for the absolutely continuous component, but not for the atomic or nonzero singular-continuous components.

Worked Example: A Purely Absolutely Continuous Spectrum

Take \(F(d\lambda)=\frac{1}{2\pi}d\lambda\) on \([-\pi,\pi)\). Its density is the constant \(f(\lambda)=1/(2\pi)\), so the measure is absolutely continuous and has no atomic or singular-continuous part. Its total mass is \(\frac{1}{2\pi}(2\pi)=1\).

For \(h=0\), the covariance is the total mass, \(\gamma(0)=1\). For a nonzero integer \(h\), direct integration gives

$$ \gamma(h)=\frac{1}{2\pi}\int_{-\pi}^{\pi}e^{ih\lambda}\,d\lambda =\frac{e^{ih\pi}-e^{-ih\pi}}{2\pi ih} =\frac{\sin(h\pi)}{\pi h}=0. $$

Check: the resulting covariance is \(\gamma(h)=\mathbf{1}_{\{h=0\}}\), and \(\gamma(0)=1=F([-\pi,\pi))\). Thus the total mass and the variance agree.

Worked Example: A Purely Atomic Spectrum

Consider \(F=\frac12\delta_{\pi/2}+\frac12\delta_{-\pi/2}\). Its two atoms have masses \(1/2\) each, so \(F([-\pi,\pi))=\frac12+\frac12=1\). There is no density with respect to Lebesgue measure: a measure with positive mass at a singleton is not absolutely continuous.

Using the two point masses, for any integer \(h\),

$$ \gamma(h)=\tfrac12e^{ih\pi/2}+\tfrac12e^{-ih\pi/2} =\cos(h\pi/2). $$

For example, at \(h=0\), \(\gamma(0)=\cos(0)=1\). At \(h=1\), \(\gamma(1)=\cos(\pi/2)=0\); at \(h=2\), \(\gamma(2)=\cos(\pi)=-1\). Check: the covariance at zero equals the total mass, \(1\). The measure is symmetric because its two atoms have equal weights at opposite frequencies.

Worked Example: A Singular-Continuous Spectrum

Let \(B_1,B_2,\ldots\) be independent Bernoulli random variables with probabilities \(\mathbb{P}(B_k=0)=\mathbb{P}(B_k=1)=1/2\), and define \(U=\sum_{k=1}^{\infty}2B_k/3^k\). Let \(\nu\) be the distribution of \(\lambda=\pi(U-\frac12)\). This defines a probability measure on \([-\pi/2,\pi/2]\), hence on the frequency circle, with total mass \(1\).

The values of \(U\) lie in the middle-thirds Cantor set. At stage \(r\) of its construction, that set is covered by \(2^r\) intervals of length \(3^{-r}\), whose total length is \((2/3)^r\), tending to zero. Thus the set has Lebesgue measure zero, and so does its affine image supporting \(\nu\). Also, each level-\(r\) interval has probability \(2^{-r}\); any point lies in at most two such intervals, so its probability is at most \(2\cdot 2^{-r}\), tending to zero. Hence \(\nu\) has no atoms. It is singular continuous.

The law of \(U\) is symmetric about \(1/2\): replacing every \(B_k\) by \(1-B_k\) leaves their joint distribution unchanged and changes \(U\) to \(1-U\), since \(\sum_{k=1}^{\infty}2/3^k=1\). Therefore \(\nu\) is symmetric about frequency zero. Its covariance contribution is \(\int\cos(h\lambda)\nu(d\lambda)\). To compute it, use independence and the convergent series defining \(U\): for every integer \(h\),

$$ \begin{aligned} \int e^{ih\lambda}\nu(d\lambda) &=\mathbb{E}\!\left[e^{ih\pi(U-1/2)}\right]\\ &=e^{-ih\pi/2}\prod_{k=1}^{\infty} \left(\frac{1+e^{i2h\pi/3^k}}{2}\right)\\ &=e^{-ih\pi/2}\prod_{k=1}^{\infty} \left(e^{ih\pi/3^k}\cos(h\pi/3^k)\right)\\ &=\prod_{k=1}^{\infty}\cos(h\pi/3^k). \end{aligned} $$

The last equality uses \(\sum_{k=1}^{\infty}3^{-k}=1/2\), so the product of the phase factors cancels \(e^{-ih\pi/2}\). At \(h=0\), every factor is \(\cos(0)=1\), and the product is \(1=\nu([-\pi,\pi))\). This measure has no density: it is nonzero, yet concentrated on a Lebesgue-null set.

Reading a Mixed Spectrum Correctly

A single spectral measure may contain all three components. The following example also shows why each covariance term must carry the mass of its own component. It uses the same singular-continuous probability measure \(\nu\) just constructed.

Worked Example: Identifying and Checking All Three Parts

Define

$$ F(d\lambda)=\frac{1}{2\pi}d\lambda+ \frac14\delta_{\pi/2}(d\lambda)+ \frac14\delta_{-\pi/2}(d\lambda)+ \frac12\nu(d\lambda). $$

The absolutely continuous component has mass \(\frac{1}{2\pi}(2\pi)=1\). The two atoms have combined mass \(\frac14+\frac14=\frac12\). The singular-continuous component has mass \(\frac12\nu([-\pi,\pi))=\frac12\). Therefore \(F\) has total mass \(1+\frac12+\frac12=2\).

For any integer \(h\), the three contributions to the covariance are, respectively, \(\mathbf{1}_{\{h=0\}}\), \(\frac12\cos(h\pi/2)\), and \(\frac12\int\cos(h\lambda)\nu(d\lambda)\). Thus

$$ \gamma(h)=\mathbf{1}_{\{h=0\}}+ \tfrac12\cos(h\pi/2)+ \tfrac12\int\cos(h\lambda)\nu(d\lambda). $$

Check at zero: substituting \(h=0\) gives \(\gamma(0)=1+\frac12+\frac12\int 1\,\nu(d\lambda)=1+\frac12+\frac12=2\), exactly the total mass of \(F\). The factor \(1/2\) in front of the singular-continuous integral is required because that component is \(\frac12\nu\), not \(\nu\).

Common Pitfall: Confusing Singular with Atomic

“Singular” does not mean “made of atoms.” Both atomic and singular-continuous measures are singular with respect to Lebesgue measure. The distinction is whether any singleton has positive mass: an atomic measure has at least one such point, while a singular-continuous measure has none. A density describes the absolutely continuous part only; writing a point mass or a singular-continuous measure as an ordinary density loses its actual distribution of mass.

A second common error is to omit a component’s weight when computing its covariance contribution. In the mixed example, a wrong calculation would replace \(\frac12\int\cos(h\lambda)\nu(d\lambda)\) by \(\int\cos(h\lambda)\nu(d\lambda)\). At \(h=0\), that gives \(1+\frac12+1=\frac52\), while the displayed measure has total mass \(2\). Substituting the actual component \(\frac12\nu\) gives \(1+\frac12+\frac12=2\), as required. Checking \(h=0\) is a quick way to detect a missing or duplicated mass.

In practice, classify each part by asking three questions: Is it absolutely continuous with respect to Lebesgue measure, and therefore expressible through a density? Does it assign positive mass to any single frequency? If neither description applies, is it singular and atomless? These tests distinguish the components without treating every non-density as an atom or assuming that every spectral measure has a density.

Check Your Understanding

For each question, identify the relevant component and use the stated Fourier convention.

  1. Why can a nonzero measure supported on a Lebesgue-null set not have a density with respect to Lebesgue measure?
  2. For \(F=\frac13\delta_0+\frac23\delta_{\pi}\), identify the atomic mass and compute \(\gamma(0)\).
  3. What two properties must a singular-continuous measure satisfy? Why does the Cantor construction above satisfy both?
  4. If a singular-continuous probability measure \(\nu\) appears in \(F\) with weight \(c\), what factor multiplies its covariance integral?
  5. For the mixed spectrum in the last worked example, compute the absolutely continuous component’s mass and verify the total mass of \(F\).