Tutorials › Stochastic Processes › From Poisson Increments to Exponential Gaps

The Poisson Process: Definitions and Equivalent Characterizations · Tutorial 396 of 994

From Poisson Increments to Exponential Gaps

See why Poisson increments produce independent exponential gaps, and how to calculate probabilities involving the first arrivals.

Intermediate 11 min read

What You'll Learn

  • Derive the first waiting time distribution from the probability of zero arrivals.
  • Define arrival times and interarrival gaps precisely.
  • Explain why the process restarts probabilistically at an arrival time.
  • Prove that successive gaps are independent and exponentially distributed.
  • Calculate probabilities involving one or several interarrival times.
  • Avoid confusing a gap after an arrival with a count from time zero.

From Counts to Waiting Times

A Poisson process describes arrivals by counting how many occur in each time interval. Waiting times describe the same events from another perspective: when does the first arrival occur, and how long is each subsequent gap? The first waiting time follows directly from the probability of zero arrivals. To prove that all successive gaps are independent, we also need to justify why the process after an arrival has the same probabilistic behavior as it does from time zero.

Let \((\Omega,\mathcal{F},\mathbb{P})\) be a probability space, and let \((N_t)_{t\ge 0}\) be a Poisson process with rate \(\lambda>0\), adapted to its natural filtration \(\mathcal{F}_t=\sigma(N_s:0\le s\le t)\). Thus \(N_0=0\), the paths are nondecreasing, integer-valued and right-continuous, and increments over disjoint time intervals are independent. For \(0\le s<t\), \(N_t-N_s\) has a Poisson distribution with mean \(\lambda(t-s)\). In particular, \(N_t\) has a Poisson distribution with mean \(\lambda t\).

Definition: The \(n\)th arrival time is \(S_n=\inf\{t\ge0:N_t\ge n\}\), for \(n\ge1\). The first waiting time is \(\tau_1=S_1\), and the \(n\)th interarrival time is \(\tau_n=S_n-S_{n-1}\) for \(n\ge2\). We use \(\inf\varnothing=\infty\). An exponential random variable with rate \(\lambda\) has survival probability \(\mathbb{P}(\tau>x)=e^{-\lambda x}\) for \(x\ge0\).

The assumption \(\lambda>0\) matters: it ensures that each fixed arrival time is finite almost surely. The zero-rate case has no arrivals and is not described by exponential gaps with a positive rate.

Theorem: For a Poisson process with rate \(\lambda>0\), the interarrival times \((\tau_n)_{n\ge1}\) are independent and identically distributed exponential random variables with rate \(\lambda\).

The First Waiting Time

The first arrival has occurred by time \(t\) exactly when \(N_t\ge1\). Thus its survival event is the event of no arrivals by time \(t\). Since \(N_t\) is Poisson with mean \(\lambda t\), this gives the full distribution of the first waiting time:

$$ \mathbb{P}(\tau_1>t)=\mathbb{P}(N_t=0)=e^{-\lambda t},\qquad t\ge0. $$

Consequently, \(\mathbb{P}(\tau_1\le t)=1-e^{-\lambda t}\). This establishes the exponential distribution of the first gap. It does not, by itself, establish independence of later gaps: a later gap begins at a random arrival time, rather than at a fixed time.

Worked Example: The First Arrival at Rate Three Halves

Suppose \(\lambda=\tfrac32\). Find the probability that the first arrival occurs after time \(\tfrac23\), and the probability that it occurs by that time.

Using the zero-count probability with \(\lambda t=\tfrac32\cdot\tfrac23=1\),

$$ \mathbb{P}\left(\tau_1>\tfrac23\right)=\mathbb{P}\left(N_{2/3}=0\right)=e^{-1}. $$

The complementary event is that at least one arrival has occurred, so

$$ \mathbb{P}\left(\tau_1\le\tfrac23\right)=1-\mathbb{P}\left(N_{2/3}=0\right)=1-e^{-1}. $$

Check: These probabilities sum to \(e^{-1}+(1-e^{-1})=1\), as the two events are complements.

Why the Process Restarts at an Arrival

To extend the first-gap calculation, we will use a fact about Poisson increments at a random time. A random time \(\sigma\) is a stopping time for \((\mathcal{F}_t)\) if \(\{\sigma\le t\}\in\mathcal{F}_t\) for every \(t\ge0\). The arrival time \(S_n\) is a stopping time because \(\{S_n\le t\}=\{N_t\ge n\}\). For a stopping time \(\sigma\), \(\mathcal{F}_\sigma\) denotes the information available up to \(\sigma\); an event \(A\) belongs to \(\mathcal{F}_\sigma\) if \(A\cap\{\sigma\le t\}\in\mathcal{F}_t\) for every \(t\).

Lemma: If \(\sigma\) is an almost surely finite stopping time for the natural filtration of a Poisson process, then the future increments \((N_{\sigma+t}-N_\sigma)_{t\ge0}\) have the same finite-dimensional distributions as \((N_t)_{t\ge0}\) and are independent of \(\mathcal{F}_\sigma\).

Proof. First consider a stopping time \(\sigma\) taking values in the grid \(\{k\delta:k=0,1,2,\ldots\}\), where \(\delta>0\). Fix times \(0\le u_1<\cdots<u_r\) and a bounded measurable function \(f\) of the vector of future counts at those times. For any \(A\in\mathcal{F}_\sigma\), split according to the value of \(\sigma\). On \(\{\sigma=k\delta\}\), the event \(A\cap\{\sigma=k\delta\}\) belongs to \(\mathcal{F}_{k\delta}\). Deterministic independent increments imply that the vector \((N_{k\delta+u_j}-N_{k\delta})_{j=1}^r\) is independent of \(\mathcal{F}_{k\delta}\) and has the same distribution as \((N_{u_j})_{j=1}^r\). The independence from \(\mathcal{F}_{k\delta}\) follows by first checking events determined by finitely many past counts and then extending to their generated sigma-field. Summing over \(k\) therefore gives \(\mathbb{E}[\mathbf{1}_A f((N_{\sigma+u_j}-N_\sigma)_{j=1}^r)]=\mathbb{P}(A)\mathbb{E}[f((N_{u_j})_{j=1}^r)]\).

For a general almost surely finite stopping time \(\sigma\), set \(\sigma_m=2^{-m}\lceil 2^m\sigma\rceil\). Each \(\sigma_m\) is a grid-valued stopping time, \(\sigma_m\downarrow\sigma\), and \(\mathcal{F}_\sigma\subseteq\mathcal{F}_{\sigma_m}\). Apply the grid result to \(A\in\mathcal{F}_\sigma\) and \(\sigma_m\). Right-continuity of the paths gives \(N_{\sigma_m+u_j}\to N_{\sigma+u_j}\) and \(N_{\sigma_m}\to N_\sigma\) almost surely for every fixed \(u_j\). For bounded continuous \(f\), bounded convergence passes the grid identity to the limit. This proves independence and equality of the finite-dimensional distributions; the corresponding statement for the future process follows because its events are generated by its finite-dimensional observations. \(\square\)

We also check that the arrival times in this argument are finite and distinct. For \(n\ge1\), \(\{S_n>t\}=\{N_t<n\}\), so \(\mathbb{P}(S_n>t)=e^{-\lambda t}\sum_{r=0}^{n-1}(\lambda t)^r/r!\to0\) as \(t\to\infty\). Hence \(S_n<\infty\) almost surely. To exclude multiple arrivals at the same time, fix \(T>0\) and divide \([0,T]\) into \(m\) equal intervals of length \(h=T/m\). If a jump of size at least two occurs by time \(T\), one of the interval counts is at least two. For a Poisson random variable \(Z\) of mean \(\lambda h\), \(\mathbf{1}_{\{Z\ge2\}}\le Z(Z-1)/2\), and \(\mathbb{E}[Z(Z-1)]=(\lambda h)^2\). The probability of any such interval is therefore at most \(m(\lambda T/m)^2/2=\lambda^2T^2/(2m)\), which tends to zero. Thus all jumps are of size one almost surely, and \(N_{S_n}=n\).

Proof of the Exponential-Gap Theorem

Proof. The first gap \(\tau_1\) is exponential with rate \(\lambda\) by the zero-count calculation. Suppose \(n\ge1\). Since \(S_n\) is an almost surely finite stopping time, the lemma says that the process after \(S_n\), measured from its value \(N_{S_n}=n\), is independent of \(\mathcal{F}_{S_n}\) and has the same finite-dimensional distributions as a fresh Poisson process. The next gap satisfies \[ \{\tau_{n+1}>x\}=\{N_{S_n+x}-N_{S_n}=0\},\qquad x\ge0. \] The lemma makes the probability of this event \(e^{-\lambda x}\), and makes \(\tau_{n+1}\) independent of \(\mathcal{F}_{S_n}\). Every earlier gap \(\tau_1,\ldots,\tau_n\) is determined by the arrival history up to \(S_n\), so it is \(\mathcal{F}_{S_n}\)-measurable. Thus \(\tau_{n+1}\) is exponential with rate \(\lambda\) and independent of all earlier gaps. Applying this argument successively for \(n=1,2,\ldots\) proves that every finite collection of gaps is independent and that all have the same exponential distribution. \(\square\)

Worked Example: Two Consecutive Gaps

Let \(\lambda=2\). Find the probability that the first gap is at most \(\tfrac12\) and the second gap exceeds \(\tfrac14\).

The theorem gives independence, so the desired probability is the product of the two exponential probabilities. Substituting the rate and thresholds gives

$$ \begin{aligned} \mathbb{P}\left(\tau_1\le\tfrac12,\ \tau_2>\tfrac14\right) &=\mathbb{P}\left(\tau_1\le\tfrac12\right)\mathbb{P}\left(\tau_2>\tfrac14\right)\\ &=\left(1-e^{-2(1/2)}\right)e^{-2(1/4)}\\ &=(1-e^{-1})e^{-1/2}. \end{aligned} $$

Check: The first factor is \(1-e^{-1}\), the complement of the no-arrival probability during an interval of length \(\tfrac12\). The second is \(e^{-1/2}\), the no-arrival probability during a fresh interval of length \(\tfrac14\) after the first arrival. Their product uses the independence just proved.

Worked Example: Three Gaps All Exceed Their Thresholds

Let \(\lambda=\tfrac12\). Find the probability that \(\tau_1>1\), \(\tau_2>2\), and \(\tau_3>3\).

Each gap has survival probability \(e^{-\lambda x}\), and the three gaps are independent. Therefore, substituting each threshold separately,

$$ \begin{aligned} \mathbb{P}(\tau_1>1,\tau_2>2,\tau_3>3) &=e^{-(1/2)(1)}e^{-(1/2)(2)}e^{-(1/2)(3)}\\ &=e^{-1/2}e^{-1}e^{-3/2}\\ &=e^{-3}. \end{aligned} $$

Check: The total exponent is \(-\tfrac12-1-\tfrac32=-3\). Each factor is the probability of no arrivals during a fresh interval of the corresponding length, so multiplying is justified by independence of the gaps.

A Common Pitfall

A gap after an arrival is not the time from zero to the next arrival. For instance, at rate \(\lambda=1\), the incorrect calculation \(\mathbb{P}(\tau_1>1,\tau_2>1)=\mathbb{P}(N_1=0)=e^{-1}\) only checks whether the first arrival has not occurred by time \(1\); it says nothing about the second gap. The correct calculation uses the joint law of two independent exponential gaps:

$$ \mathbb{P}(\tau_1>1,\tau_2>1) =\mathbb{P}(\tau_1>1)\mathbb{P}(\tau_2>1) =e^{-1}e^{-1}=e^{-2}. $$

The distinction is between a count in a fixed interval starting at zero and the waiting time measured from a random arrival time. Stationary independent increments, applied at that arrival time through the lemma, justify the second calculation.

Check Your Understanding

Use the zero-count identity and the independence of successive gaps to answer the following.

  1. For rate \(\lambda=3\), find \(\mathbb{P}(\tau_1>\tfrac13)\).
  2. For rate \(\lambda=1\), calculate \(\mathbb{P}(\tau_1\le1,\tau_2>2)\).
  3. Why does the zero-count formula at a fixed time establish the distribution of \(\tau_1\), but not by itself establish independence of \(\tau_1\) and \(\tau_2\)?
  4. State the stopping-time property of \(S_n\) using the event \(\{S_n\le t\}\).
  5. For rate \(\lambda=\tfrac12\), find \(\mathbb{P}(\tau_1>2,\tau_2>2)\), and identify the independence fact used.