Tutorials › Measure Theory › Countable Dense Simple Functions from Countable Generators

Completeness and Density in L^p · Tutorial 552 of 798

Countable Dense Simple Functions from Countable Generators

Learn how approximation in measure turns a countable generating algebra into a countable dense family for every finite-\(p\) \(L^p\) space on a finite measure space.

Advanced 10 min read

What You'll Learn

  • Define generation modulo null sets for a countable algebra on a finite measure space
  • Prove that sets in the generated sigma-algebra can be approximated in measure by algebra sets
  • Construct a countable family of rational-valued simple functions
  • Prove density for real- and complex-valued \(L^p\) functions when \(0<p<\infty\)
  • Track the error from changing both sets and coefficients
  • Distinguish approximation in measure from exact membership in the generating algebra

From a Countable Algebra to a Countable Dense Family

Density says that every element of a function space can be approximated as accurately as desired by elements of a specified family. Separability is the stronger-looking but often more useful conclusion that one can choose that family to be countable. On a finite measure space, a countable algebra that generates the measurable sets modulo null sets supplies a concrete countable dense family in every \(L^p\) with \(0<p<\infty\).

Fix a finite measure space \((X,\mathcal{M},\mu)\), so \(\mu(X)<\infty\), and let \(\mathcal{A}\subseteq\mathcal{M}\) be a countable algebra of sets. An algebra contains \(X\) and is closed under complements and finite unions. Assume it generates \(\mathcal{M}\) modulo null sets in the following precise sense: for every \(E\in\mathcal{M}\), there is a \(B\in\sigma(\mathcal{A})\) such that \(\mu(E\triangle B)=0\). The space need not be complete. Here \(L^p(\mu)\) consists of equivalence classes, under equality \(\mu\)-a.e., of measurable real- or complex-valued functions \(f\) for which \(\int |f|^p\,d\mu<\infty\). When \(0<p<1\), the usual \(L^p\) quantity is a quasi-norm rather than a norm; the density assertion remains valid.

Definition: Let \(\mathbb{Q}\) denote the rationals, and let \(\mathbb{Q}_{\mathbb{C}}=\{a+ib:a,b\in\mathbb{Q}\}\). Define \(\mathcal{D}_{\mathcal{A}}\) to consist of all finite sums \(\sum_{j=1}^k q_j\chi_{A_j}\), where \(k\) is a nonnegative integer, \(A_j\in\mathcal{A}\), and \(q_j\in\mathbb{Q}\) for real-valued functions or \(q_j\in\mathbb{Q}_{\mathbb{C}}\) for complex-valued functions. The empty sum is the zero function.

Overlaps among the sets \(A_j\) are allowed. A finite sum of this form is still a simple function, takes finitely many rational (or rational-complex) values, and is measurable. Since \(\mathcal{A}\) is countable, there are only countably many choices of each finite list of sets and coefficients. Taking the union over all finite lengths shows that \(\mathcal{D}_{\mathcal{A}}\) is countable. Finiteness of \(\mu(X)\) also ensures every member belongs to \(L^p(\mu)\): each is bounded and \(\int |g|^p\,d\mu\le \|g\|_\infty^p\mu(X)<\infty\).

Approximating Measurable Sets in Measure

The first step is a set approximation fact. It is important that it gives approximation in measure, not exact equality with an element of the algebra.

Lemma: If \(\mu(X)<\infty\) and \(\mathcal{A}\) is an algebra, then for every \(E\in\sigma(\mathcal{A})\) and every \(\varepsilon>0\), there is an \(A\in\mathcal{A}\) such that \(\mu(E\triangle A)<\varepsilon\).

Proof. Let \(\mathcal{C}\) be the collection of sets \(E\in\sigma(\mathcal{A})\) for which, for every \(\varepsilon>0\), some \(A\in\mathcal{A}\) satisfies \(\mu(E\triangle A)<\varepsilon\). Every \(A\in\mathcal{A}\) belongs to \(\mathcal{C}\), by using \(A\) itself. If \(E\in\mathcal{C}\), choose \(A\in\mathcal{A}\) with \(\mu(E\triangle A)<\varepsilon\). Since \(A^c\in\mathcal{A}\) and \(E^c\triangle A^c=E\triangle A\), the complement \(E^c\) is in \(\mathcal{C}\).

Now let \(E_1,E_2,\ldots\in\mathcal{C}\), and put \(E=\bigcup_{j=1}^{\infty}E_j\). Because \(\mu(X)<\infty\), continuity from below gives \(\mu(E\setminus\bigcup_{j=1}^N E_j)\to0\). Given \(\varepsilon>0\), choose \(N\) so this measure is less than \(\varepsilon/2\). For each \(j=1,\ldots,N\), choose \(A_j\in\mathcal{A}\) with \(\mu(E_j\triangle A_j)<\varepsilon/(2N)\), and set \(A=\bigcup_{j=1}^N A_j\), which is in \(\mathcal{A}\). The symmetric difference between the two finite unions is contained in \(\bigcup_{j=1}^N(E_j\triangle A_j)\). Therefore, by subadditivity,

$$ \mu(E\triangle A) \le \mu\left(E\setminus\bigcup_{j=1}^N E_j\right) +\sum_{j=1}^N\mu(E_j\triangle A_j) <\frac{\varepsilon}{2}+N\frac{\varepsilon}{2N} =\varepsilon. $$

Thus \(\mathcal{C}\) contains \(\mathcal{A}\) and is closed under complements and countable unions. It is a sigma-algebra, so it contains \(\sigma(\mathcal{A})\). This proves the lemma. \(\square\)

Under the modulo-null-sets assumption, this lemma also approximates every \(E\in\mathcal{M}\): choose \(B\in\sigma(\mathcal{A})\) with \(\mu(E\triangle B)=0\), then approximate \(B\) by \(A\in\mathcal{A}\). The inclusion \(E\triangle A\subseteq(E\triangle B)\cup(B\triangle A)\) gives \(\mu(E\triangle A)=\mu(B\triangle A)\), which can be made arbitrarily small.

Worked Example: Approximating an Interval by Dyadic Sets

Let \(X=[0,1]\) with Lebesgue measure \(m\), and let \(\mathcal{A}\) be the algebra of finite unions of dyadic half-open intervals, with the endpoint \(\{1\}\) included as an algebra element. This algebra generates the Borel sets; the Lebesgue sigma-algebra is their completion, so its sets agree modulo null sets with Borel sets. Approximate \(E=(1/3,2/3)\) by elements of \(\mathcal{A}\).

For \(n\ge1\), set \(k_n=\lfloor 2^n/3\rfloor\), \(l_n=\lceil 2^{n+1}/3\rceil\), and \(B_n=[k_n/2^n,l_n/2^n)\). These endpoints are dyadic, and \(k_n/2^n\le1/3\le2/3\le l_n/2^n\). The symmetric difference consists, up to endpoints of measure zero, of the two excess intervals. Thus

$$ m(E\triangle B_n) =\left(\frac13-\frac{k_n}{2^n}\right) +\left(\frac{l_n}{2^n}-\frac23\right) \le \frac{2}{2^n}. $$

For a direct check at \(n=2\), \(k_2=\lfloor4/3\rfloor=1\) and \(l_2=\lceil8/3\rceil=3\), so \(B_2=[1/4,3/4)\). Its error is \((1/3-1/4)+(3/4-2/3)=1/12+1/12=1/6\), agreeing with the displayed formula. The bound \(2/2^n\) tends to zero, so these algebra sets approximate \(E\) in measure.

Density of the Countable Family

Theorem: Let \((X,\mathcal{M},\mu)\) be a finite measure space, and let \(\mathcal{A}\subseteq\mathcal{M}\) be a countable algebra that generates \(\mathcal{M}\) modulo null sets. For every \(0<p<\infty\), the countable family \(\mathcal{D}_{\mathcal{A}}\) is dense in \(L^p(\mu)\), for real-valued or complex-valued functions, with distance measured by \(\|f-g\|_p=(\int |f-g|^p\,d\mu)^{1/p}\).

Proof. Fix \(f\in L^p(\mu)\) and a desired error \(\varepsilon>0\). The earlier density result for simple functions in finite-\(p\) \(L^p\) gives a finite-valued measurable simple function \(s\) with \(\|f-s\|_p<\varepsilon/2\). Write \(s=\sum_{j=1}^k c_j\chi_{E_j}\), where \(E_j\in\mathcal{M}\) are disjoint and the coefficients \(c_j\) are real or complex. If \(s=0\), the zero member of \(\mathcal{D}_{\mathcal{A}}\) already has zero distance from \(s\). Otherwise, terms with coefficient zero may be discarded, so take \(k\ge1\) and at least one \(c_j\ne0\).

By set approximation, for any \(\delta>0\) choose \(A_j\in\mathcal{A}\) with \(\mu(E_j\triangle A_j)<\delta\). Put \(h=\sum_{j=1}^k c_j\chi_{A_j}\) and \(U=\bigcup_{j=1}^k(E_j\triangle A_j)\). Outside \(U\), \(s=h\). Everywhere, \(|s-h|\le C\), where \(C=\sum_{j=1}^k|c_j|\). Hence

$$ \int|s-h|^p\,d\mu\le C^p\mu(U) \le C^p\sum_{j=1}^k\mu(E_j\triangle A_j) < C^p k\delta. $$

Choose \(\delta\) small enough that \(C^p k\delta<\varepsilon^p/(2K_p)\), where \(K_p=1\) if \(0<p\le1\), and \(K_p=2^{p-1}\) if \(p>1\). Next choose rational (or rational-complex) \(q_j\) so that \(\sum_{j=1}^k|q_j-c_j|<\eta\), where \(\eta>0\) is small enough that \(\eta^p\mu(X)<\varepsilon^p/(2K_p)\). Such coefficients exist because the rationals are dense in the reals, and \(\mathbb{Q}_{\mathbb{C}}\) is dense in the complex numbers. If \(\mu(X)=0\), all \(L^p\) classes are zero and the theorem is immediate; otherwise this choice of \(\eta\) is possible.

Set \(g=\sum_{j=1}^k q_j\chi_{A_j}\in\mathcal{D}_{\mathcal{A}}\). Pointwise, \(|h-g|\le\sum_j|c_j-q_j|<\eta\), so \(\int|h-g|^p\,d\mu\le\eta^p\mu(X)\). For any complex or real numbers \(u,v\), \(|u+v|^p\le K_p(|u|^p+|v|^p)\): for \(p\le1\) this follows from subadditivity of the \(p\)th power on nonnegative numbers, and for \(p>1\) it follows from convexity applied to \((|u|+|v|)/2\). Applying this inequality to \(s-g=(s-h)+(h-g)\) yields

$$ \|s-g\|_p^p \le K_p\left(\int|s-h|^p\,d\mu+\int|h-g|^p\,d\mu\right) <\varepsilon^p. $$

Finally, if \(p\ge1\), Minkowski's inequality gives \(\|f-g\|_p\le\|f-s\|_p+\|s-g\|_p<\varepsilon\). If \(0<p<1\), integrate \(|f-g|^p\le|f-s|^p+|s-g|^p\); the two terms are each less than \((\varepsilon/2)^p\), so \(\|f-g\|_p^p<2(\varepsilon/2)^p\), which alone need not be less than \(\varepsilon^p\). To ensure the desired bound in this case, start instead with both errors less than \(\varepsilon/4\): simple-function density supplies \(\|f-s\|_p<\varepsilon/4\), and the choices above can make \(\|s-g\|_p<\varepsilon/4\). Then \(\|f-g\|_p^p<2(\varepsilon/4)^p\le\varepsilon^p\), since \(2/4^p<1\) is not true for every positive \(p\). More generally choose both errors less than \(\varepsilon\,2^{-1/p-1}\); then \(2(\varepsilon\,2^{-1/p-1})^p=\varepsilon^p/2^p<\varepsilon^p\). Simple-function density and the construction allow this choice. Thus \(\|f-g\|_p<\varepsilon\) also for \(0<p<1\), proving density. \(\square\)

Worked Example: A Rational Approximation on a Finite Space

Let \(X=\{a,b,c\}\), let \(\mathcal{M}\) be its power set, and assign masses \(\mu(\{a\})=1/4\), \(\mu(\{b\})=1/2\), and \(\mu(\{c\})=1/4\). Take \(\mathcal{A}=\mathcal{M}\), which is a finite, hence countable, algebra. For \(p=2\), define \(f(a)=\sqrt2\), \(f(b)=-\pi\), and \(f(c)=1/3\). The function \(g(a)=7/5\), \(g(b)=-22/7\), \(g(c)=1/3\) belongs to \(\mathcal{D}_{\mathcal{A}}\), since each singleton is in the algebra and the coefficients are rational.

Summing over the three atoms gives the full squared error:

$$ \|f-g\|_2^2 =\frac14\left(\sqrt2-\frac75\right)^2 +\frac12\left(-\pi+\frac{22}{7}\right)^2 +\frac14\left(\frac13-\frac13\right)^2 =\frac14\left(\sqrt2-\frac75\right)^2 +\frac12\left(\pi-\frac{22}{7}\right)^2. $$

Check: calculating separately at \(a,b,c\) gives respectively the squared differences \((\sqrt2-7/5)^2\), \((\pi-22/7)^2\), and \(0\); multiplying by their masses gives exactly the displayed expression. This particular \(g\) illustrates the family and its error formula; density follows by choosing rational coefficients as close as needed, not by requiring this one choice to meet every tolerance.

Worked Example: Dyadic Simple Functions Approximating the Identity

On \([0,1]\) with Lebesgue measure, use the dyadic algebra and let \(f(x)=x\). For each \(n\ge1\), define \(g_n(x)=2^{-n}\lfloor2^n x\rfloor\). On each interval \([k/2^n,(k+1)/2^n)\), for \(k=0,\ldots,2^n-1\), this is the rational value \(k/2^n\); at \(x=1\), it is \(1\). Thus \(g_n\in\mathcal{D}_{\mathcal{A}}\).

On each interval of length \(2^{-n}\), write \(x=k/2^n+t\), where \(0\le t<2^{-n}\); then \(x-g_n(x)=t\). The endpoint \(x=1\) has measure zero. Summing the \(p\)th-power integrals over the \(2^n\) intervals gives, for every \(0<p<\infty\),

$$ \|f-g_n\|_p^p =2^n\int_0^{2^{-n}}t^p\,dt =2^n\frac{(2^{-n})^{p+1}}{p+1} =\frac{2^{-np}}{p+1}, \qquad \|f-g_n\|_p=\frac{2^{-n}}{(p+1)^{1/p}}. $$

Check: for \(p=2\) and \(n=2\), the squared error is \(2^{-4}/3=1/48\), and the norm is \(\sqrt{1/48}=1/(4\sqrt3)\). This agrees with integrating the squared error over four intervals: each contributes \(\int_0^{1/4}t^2\,dt=(1/4)^3/3=1/192\), and four such contributions sum to \(1/48\).

Why “Generated” Does Not Mean “Already in the Algebra”

A common mistake is to infer that every measurable set belongs to the original algebra because that algebra generates the sigma-algebra. Generation means that countable set operations produce \(\sigma(\mathcal{A})\); it does not say that each resulting set is already an element of \(\mathcal{A}\). In the dyadic example, \(E=(1/3,2/3)\) is not a finite union of dyadic intervals, so using \(\chi_E\) as if it were one of the algebra indicators is unjustified. The correction is to use \(B_2=[1/4,3/4)\), for which the exact symmetric-difference measure is \(1/6\), and then use the sequence \(B_n\) whose errors tend to zero. For indicators, the relevant relation is exact: \(\|\chi_E-\chi_A\|_p^p=\mu(E\triangle A)\). Thus approximation in measure of sets is precisely what converts into \(L^p\) approximation of their indicators.

The finite-measure assumption enters the set lemma when continuity from below is used to discard the tail of a countable union. It also ensures bounded simple functions lie in \(L^p\). The theorem therefore does not claim, without additional hypotheses or localization, that the same construction applies on an arbitrary infinite-measure space.

Check Your Understanding

Use the definitions and estimates above to test each part of the construction.

  1. State precisely what it means for \(\mathcal{A}\) to generate \(\mathcal{M}\) modulo null sets. Does this require \((X,\mathcal{M},\mu)\) to be complete?
  2. Why is the family of finite rational linear combinations of indicators from a countable algebra countable, even when the sets in a sum overlap?
  3. For measurable \(E\) and \(A\), verify that \(\|\chi_E-\chi_A\|_p^p=\mu(E\triangle A)\) for \(0<p<\infty\).
  4. In the dyadic interval example, calculate \(m(E\triangle B_3)\) using the stated floor and ceiling definitions.
  5. In the density proof, identify where finiteness of \(\mu(X)\) is used, and explain why approximation of sets alone does not yet approximate an arbitrary \(L^p\) function.