Tutorials › Stochastic Processes › The Renewal Measure and Its Atoms

Renewal Processes · Tutorial 566 of 994

The Renewal Measure and Its Atoms

Learn to construct the renewal measure and determine whether its mass is concentrated at atoms or described by a density.

Intermediate 9 min read

What You'll Learn

  • Define the renewal measure using the distributions of positive renewal epochs.
  • Express the mass at a point as a sum of convolution probabilities.
  • Determine when the renewal measure has atoms.
  • Compute renewal-measure atoms for deterministic and discrete interarrivals.
  • Derive the renewal-measure density for exponential interarrivals.
  • Distinguish positive renewal epochs from a convention that also counts time zero.

From Renewal Epochs to a Measure

A renewal process can be described not only by the number of renewals before a time, but also by the distribution of all its renewal epochs. The measure obtained by adding the distributions of those epochs records how much renewal mass lies in any chosen time set. In particular, its mass at a single point tells us how often, in expectation, renewal epochs occur exactly there. This makes atoms important: a deterministic or lattice-valued interarrival distribution may produce positive mass at specific times, while a continuous interarrival distribution may instead produce a density.

Work on a probability space \((\Omega,\mathcal{F},\mathbb{P})\). Let \((X_k)_{k\ge1}\) be independent and identically distributed random variables taking values in \((0,\infty)\) almost surely, with common distribution \(F\). The \(n\)th renewal epoch is \(S_n=X_1+\cdots+X_n\), for \(n\ge1\). Thus the epoch index \(n\) is discrete, while the epochs take values in the time space \([0,\infty)\). Write \(F^{*n}\) for the distribution of \(S_n\), equivalently the \(n\)-fold convolution of \(F\). Only positive renewal epochs are included in the measure below; there is no epoch at time zero in this convention.

Definition: The renewal measure \(U\) on \([0,\infty)\) is defined for each Borel set \(B\subseteq[0,\infty)\) by \(U(B)=\sum_{n=1}^{\infty}\mathbb{P}(S_n\in B)=\sum_{n=1}^{\infty}F^{*n}(B)\). It sums the distributions of all positive renewal epochs. For a time \(t\), the atom of \(U\) at \(t\) is \(U(\{t\})\), the mass assigned to the singleton set \(\{t\}\).

This is a measure because each \(F^{*n}\) is a measure and a countable sum of nonnegative measures is countably additive. More explicitly, if \((B_r)_{r\ge1}\) are disjoint Borel sets, then countable additivity of each \(F^{*n}\), followed by rearrangement of nonnegative sums, gives \(U(\bigcup_r B_r)=\sum_r U(B_r)\). The value is finite on bounded time intervals under the assumption \(X_k>0\) almost surely. Here is a justification, which also makes clear that the measure is not merely a formal sum.

Fix \(T<\infty\). Since \(X_1>0\) almost surely, there is some \(\varepsilon>0\) for which \(q=\mathbb{P}(X_1\ge\varepsilon)>0\). If \(S_n\le T\), at most \(m=\lfloor T/\varepsilon\rfloor\) of the first \(n\) interarrivals can be at least \(\varepsilon\). The number of such interarrivals has a binomial distribution with parameters \(n\) and \(q\). If \(q=1\), then \(S_n\ge n\varepsilon\), so only finitely many \(n\) can satisfy \(S_n\le T\). If \(0<q<1\), then \(\mathbb{P}(S_n\le T)\le\sum_{r=0}^{m}\binom{n}{r}q^r(1-q)^{n-r}\). For each fixed \(r\), this term is bounded by a constant times \(n^r(1-q)^n\), whose sum over \(n\) is finite because a geometric factor with ratio less than one dominates a fixed power of \(n\). Therefore \(U([0,T])=\sum_{n\ge1}\mathbb{P}(S_n\le T)<\infty\).

Atoms: Add the Contributions from Every Epoch

Theorem: For every \(t\ge0\), \(U(\{t\})=\sum_{n=1}^{\infty}\mathbb{P}(S_n=t)=\sum_{n=1}^{\infty}F^{*n}(\{t\})\). In particular, \(U(\{0\})=0\). Moreover, \(U\) has no atoms if and only if \(F\) has no atoms.

Proof. Apply the definition of \(U\) to the Borel set \(\{t\}\). This gives the displayed sum, with equality at a point (not an interval) required in every term. Since each \(X_k>0\) almost surely, \(S_n>0\) almost surely for every \(n\ge1\); hence every term in the sum at \(t=0\) is zero. If \(F\) has no atoms, then for any fixed \(n\ge2\), condition on \(X_1,\ldots,X_{n-1}\). For every possible value \(s\) of their sum, the conditional probability that \(S_n=t\) is \(\mathbb{P}(X_n=t-s)=0\), because \(F\) assigns zero probability to every singleton. Averaging these zero conditional probabilities gives \(\mathbb{P}(S_n=t)=0\). The same conclusion for \(n=1\) follows directly from \(F(\{t\})=0\). Thus \(U(\{t\})=0\) for every \(t\). Conversely, if \(F\) has an atom at some \(t\), then \(t>0\) and \(U(\{t\})\ge F^{*1}(\{t\})=F(\{t\})>0\). So \(U\) has an atom. This proves both directions. \(\square\)

The atom formula matters because an atom of \(U\) need not come only from the first renewal epoch. Several different epoch numbers can contribute to the same time. The sum is over all \(n\), and each term is the probability of the exact equality \(S_n=t\). It is not enough to inspect \(F(\{t\})\) alone. Conversely, a continuous distribution has no atoms in its renewal measure, even though the renewal measure can still have substantial mass in every interval.

Worked Example: Deterministic Interarrivals

Suppose every interarrival equals \(2\) with probability \(1\), so \(X_k=2\) almost surely for every \(k\). Find the renewal measure and its mass at time \(6\).

For each \(n\ge1\), adding \(n\) interarrivals gives \(S_n=2n\) with probability \(1\). Therefore the distribution \(F^{*n}\) places unit mass at \(2n\) and zero mass elsewhere. Summing those distributions gives \(U=\sum_{n\ge1}\delta_{2n}\), where \(\delta_x\) denotes unit mass at \(x\). In particular, \(6=2n\) exactly when \(n=3\), so only the third epoch contributes at time \(6\).

Check: \(S_1=2\), \(S_2=4\), and \(S_3=6\), each with probability \(1\); for \(n\ge4\), \(S_n=2n\ge8\), so \(\mathbb{P}(S_n=6)=0\). Thus \(U(\{6\})=0+0+1+0+\cdots=1\), as the formula requires. The same reasoning shows that \(U(\{t\})=1\) when \(t\) is a positive even integer and is \(0\) for other \(t\ge0\).

Worked Example: A Two-Point Interarrival Distribution

Let each \(X_k\) equal \(1\) or \(2\), each with probability \(\tfrac12\). Compute the renewal-measure atom at time \(3\), counting contributions from every possible epoch number.

For \(n=1\), \(S_1\) is either \(1\) or \(2\), so \(\mathbb{P}(S_1=3)=0\). For \(n=2\), the four equally likely ordered pairs are \((1,1),(1,2),(2,1),(2,2)\); exactly two sum to \(3\). Hence \(\mathbb{P}(S_2=3)=\tfrac24=\tfrac12\). For \(n=3\), all three interarrivals must equal \(1\): any value of \(2\) makes the sum at least \(4\). The probability of three ones is \(\tfrac12\cdot\tfrac12\cdot\tfrac12=\tfrac18\). For \(n\ge4\), the sum is at least \(n\ge4\), so it cannot equal \(3\).

Adding the contributions gives \(U(\{3\})=0+\tfrac12+\tfrac18+0+\cdots=\tfrac58\). Check: among the four possible two-interarrival sequences, two reach \(3\), contributing \(\tfrac12\); among the eight equally likely three-interarrival sequences, one reaches \(3\), contributing \(\tfrac18\). The total is \(\tfrac12+\tfrac18=\tfrac48+\tfrac18=\tfrac58\). Although the first interarrival distribution has no atom at \(3\), later renewal epochs do, so \(U(\{3\})\) is positive.

Densities: When the Renewal Measure Is Spread Continuously

For a continuous interarrival distribution with density \(f\) on \((0,\infty)\), the distributions of the later epochs also have densities. Write \(f^{*1}=f\), and, for \(n\ge1\), define the convolution recursively by \(f^{*(n+1)}(t)=\int_0^t f^{*n}(s)f(t-s)\,ds\) for \(t>0\). This is the density of \(S_{n+1}\). The renewal measure then has a density formed by adding the densities for all positive epoch numbers.

Theorem: If \(F\) has a density \(f\) on \((0,\infty)\), then \(U\) is absolutely continuous on \([0,\infty)\), with density \(u(t)=\sum_{n=1}^{\infty}f^{*n}(t)\) for almost every \(t>0\). In particular, \(U(\{t\})=0\) for every \(t\ge0\).

Proof. For each \(n\), independence and the convolution formula give \(F^{*n}(B)=\int_B f^{*n}(t)\,dt\) for every Borel set \(B\subseteq[0,\infty)\). Therefore, using the definition of \(U\) and interchanging nonnegative sums and integrals,

$$ U(B)=\sum_{n=1}^{\infty}\int_B f^{*n}(t)\,dt =\int_B\left(\sum_{n=1}^{\infty}f^{*n}(t)\right)dt. $$

The interchange is valid for nonnegative functions, including when an integral is initially allowed to be infinite. The sum in parentheses is consequently a density of \(U\), understood up to equality almost everywhere. An absolutely continuous measure assigns zero mass to every singleton because a singleton has Lebesgue measure zero. At \(t=0\), positive interarrivals also give \(U(\{0\})=0\). \(\square\)

Worked Example: Exponential Interarrivals

Let the interarrivals be exponential with rate \(2\), so \(f(t)=2e^{-2t}\) for \(t>0\). Compute the renewal-measure density by summing the epoch densities.

The sum of \(n\) independent exponential variables with rate \(2\) has density \(f^{*n}(t)=\frac{2^n t^{n-1}e^{-2t}}{(n-1)!}\) for \(t>0\). Thus, for each fixed \(t>0\), put \(k=n-1\) to obtain \(u(t)=\sum_{n=1}^{\infty}\frac{2^n t^{n-1}e^{-2t}}{(n-1)!} =2e^{-2t}\sum_{k=0}^{\infty}\frac{(2t)^k}{k!}\). The exponential series gives \(\sum_{k=0}^{\infty}(2t)^k/k!=e^{2t}\), so \(u(t)=2e^{-2t}e^{2t}=2\).

Check at \(t=1\): the first three epoch-density terms are \(2e^{-2}\), \(4e^{-2}\), and \(4e^{-2}\). In general the term for \(n\) at \(t=1\) is \(2^n e^{-2}/(n-1)!\), so the whole series is \(2e^{-2}\sum_{k=0}^{\infty}2^k/k!=2e^{-2}e^2=2\). Also, for \(0\le a<b\), the density gives \(U((a,b])=\int_a^b 2\,dt=2(b-a)\); in particular, \(U((1,2])=2(2-1)=2\). Each endpoint has zero mass, so using \((1,2]\) rather than \([1,2]\) does not change that value.

Reading the Measure Correctly

The renewal measure records expected epoch mass by location in time; it is not itself a probability distribution. Its total mass on all of \([0,\infty)\) is generally infinite, even though it is finite on every bounded interval. For a set \(B\), \(U(B)\) adds the probabilities that each positive epoch falls in \(B\). The later tutorial on the renewal function considers the expected number of renewals in a time interval; the measure gives the underlying set-by-set quantity from which such counts can be expressed.

A common mistake is to calculate an atom by looking only at the interarrival law. In the two-point example, this would give the incorrect calculation \(U(\{3\})=F(\{3\})=0\). The correction is to include every epoch number: \(F^{*2}(\{3\})=\tfrac12\) and \(F^{*3}(\{3\})=\tfrac18\), so \(U(\{3\})=\tfrac58\). Another convention to watch is whether a source includes an epoch at time zero. The definition here sums over \(n\ge1\); adding an \(n=0\) term would add a unit atom at zero and would describe a different measure.

Check Your Understanding

For each question, distinguish mass at an exact time from mass in an interval, and include every positive epoch number that can contribute.

  1. If every interarrival equals \(3\) almost surely, what is \(U(\{9\})\), and why do no other epoch numbers contribute?
  2. If \(F\) has an atom at \(a>0\), explain why \(U\) must have an atom at \(a\), even before considering later epochs.
  3. For the two-point interarrival law with probabilities \(\tfrac12\) at \(1\) and \(\tfrac12\) at \(2\), compute \(U(\{4\})\). Identify the possible epoch numbers before calculating.
  4. Why does an interarrival distribution with a density imply that the renewal measure assigns zero mass to each singleton?
  5. For exponential interarrivals of rate \(3\), use the density series to determine \(u(t)\) for \(t>0\).