Tutorials › Stochastic Processes › Waiting-Time Probability Calculations

The Poisson Process: Definitions and Equivalent Characterizations · Tutorial 406 of 994

Waiting-Time Probability Calculations

Use exponential survival probabilities and Gamma arrival-time distributions to solve Poisson waiting-time questions exactly.

Intermediate 9 min read

What You'll Learn

  • Translate event-free questions into exponential survival probabilities.
  • Derive the distribution of the \(k\)th arrival from independent exponential gaps.
  • Calculate the probability of at least \(k\) arrivals by a deadline.
  • Distinguish an arrival by a deadline from exactly \(k\) arrivals.
  • Check waiting-time results against Poisson count probabilities.
  • Handle zero rates and deadline endpoint conventions.

From Arrival Counts to Waiting-Time Questions

A Poisson process can describe either how many events have occurred by a given time or how long to wait for an event. These are two views of the same process. For example, “no arrivals during the next two hours” concerns a count, while “the third arrival occurs within two hours” concerns an arrival time. The first question uses exponential survival; the second uses a Gamma distribution, also called an Erlang distribution when its shape parameter is an integer.

Work on a probability space \((\Omega,\mathcal{F},\mathbb{P})\). Let \((N_t)_{t\ge0}\) be a Poisson process with state space \(\{0,1,2,\ldots\}\), initial value \(N_0=0\), and rate \(\lambda\). For \(\lambda>0\), its successive interarrival times \(\tau_1,\tau_2,\ldots\) are independent exponential random variables with rate \(\lambda\), as established in the earlier material on Poisson interarrivals. The \(k\)th arrival time is \(S_k=\tau_1+\cdots+\tau_k\), equivalently \(S_k=\inf\{t\ge0:N_t\ge k\}\). We use the convention that an arrival by deadline \(t\) means \(S_k\le t\), or, equivalently, \(N_t\ge k\).

Definition: An exponential random variable with rate \(\lambda>0\) has survival probability \(\mathbb{P}(\tau_1>t)=e^{-\lambda t}\) for \(t\ge0\) and density \(\lambda e^{-\lambda t}\) for \(t>0\). A Gamma distribution with integer shape \(k\ge1\) and rate \(\lambda>0\) has density \(\lambda^k t^{k-1}e^{-\lambda t}/(k-1)!\) for \(t>0\). The \(k\)th Poisson arrival time \(S_k\) has this Gamma distribution.

The rate has units of arrivals per unit time, so the product \(\lambda t\) is dimensionless. When using an exponential formula, check that the rate and time use compatible units. For a zero-rate process, \(N_t=0\) for every \(t\ge0\) almost surely: there are no arrivals, and \(S_k=\infty\) for every \(k\ge1\). The formulas involving exponential gaps and Gamma densities below assume \(\lambda>0\).

Event-Free Probabilities

For a positive-rate process, the probability of no arrivals during an interval of length \(t\) is the probability that its first interarrival time exceeds \(t\). It is also the probability that the Poisson count at time \(t\) is zero.

$$ \mathbb{P}(N_t=0)=\mathbb{P}(S_1>t)=e^{-\lambda t},\qquad \mathbb{P}(N_t\ge1)=\mathbb{P}(S_1\le t)=1-e^{-\lambda t}. $$

The strict inequality in \(S_1>t\) is the complement of the event \(S_1\le t\). For \(\lambda>0\), the arrival time has a continuous distribution, so \(\mathbb{P}(S_1=t)=0\); replacing \(>\) by \(\ge\) in this probability does not change its value. The count convention still matters when describing events: “by time \(t\)” includes an arrival at \(t\), while “after time \(t\)” does not.

By stationary increments, the number of arrivals in an interval of length \(h\ge0\) has the same distribution as \(N_h\). Thus the probability of no arrivals in an interval of length \(h\) is \(e^{-\lambda h}\). This calculation concerns only the interval’s length; the location of the interval does not change the answer.

Worked Example: No Arrivals Before a Deadline

Suppose arrivals follow a Poisson process with rate \(\lambda=\tfrac34\) per hour. Find the probability of no arrivals during the next two hours, and the probability of at least one arrival during that time.

The rate and time are both measured in hours, and their product is \(\lambda t=(\tfrac34)(2)=\tfrac32\). The event-free probability is therefore

$$ \mathbb{P}(N_2=0)=e^{-(3/4)(2)}=e^{-3/2}. $$

Taking the complement gives \(\mathbb{P}(N_2\ge1)=1-e^{-3/2}\). As a check, the Poisson count formula with mean \(\lambda t=\tfrac32\) gives \(\mathbb{P}(N_2=0)=e^{-3/2}(\tfrac32)^0/0!=e^{-3/2}\), agreeing with the survival calculation. The two probabilities sum to \(e^{-3/2}+(1-e^{-3/2})=1\).

The Arrival Time of the \(k\)th Event

Waiting for the \(k\)th arrival means adding \(k\) successive exponential gaps. Independence of those gaps gives a density for their sum. The result is useful whenever the question asks whether several arrivals have occurred by a deadline, or asks for the distribution of a particular arrival time.

Theorem: Let \((N_t)_{t\ge0}\) be a Poisson process with rate \(\lambda>0\), and let \(k\ge1\) be an integer. For \(t>0\), \(S_k\) has density \(f_{S_k}(t)=\lambda^k t^{k-1}e^{-\lambda t}/(k-1)!\), and its distribution function is \(\mathbb{P}(S_k\le t)=1-e^{-\lambda t}\sum_{r=0}^{k-1}(\lambda t)^r/r!\). For \(t=0\), \(\mathbb{P}(S_k\le0)=0\).

Proof. For \(k=1\), \(S_1=\tau_1\), whose density is \(\lambda e^{-\lambda t}\); this is the stated density because \(t^{0}/0!=1\). Suppose the density formula holds for some integer \(k\ge1\). Since \(\tau_{k+1}\) is independent of \(S_k\), the density of \(S_{k+1}=S_k+\tau_{k+1}\), for \(t>0\), is their convolution:

$$ \begin{aligned} f_{S_{k+1}}(t) &=\int_0^t f_{S_k}(u)\lambda e^{-\lambda(t-u)}\,du\\ &=\int_0^t \frac{\lambda^k u^{k-1}e^{-\lambda u}}{(k-1)!} \lambda e^{-\lambda(t-u)}\,du\\ &=\frac{\lambda^{k+1}e^{-\lambda t}}{(k-1)!}\int_0^t u^{k-1}\,du\\ &=\frac{\lambda^{k+1}t^k e^{-\lambda t}}{k!}. \end{aligned} $$

This proves the density formula by induction. To obtain the distribution function, define \(H(t)=1-e^{-\lambda t}\sum_{r=0}^{k-1}(\lambda t)^r/r!\) for \(t\ge0\). At \(t=0\), \(H(0)=1-1=0\). Differentiating the finite sum, the terms from differentiating the powers cancel the terms from differentiating the exponential except for the last power, giving \(H'(t)=\lambda^k t^{k-1}e^{-\lambda t}/(k-1)!\) for \(t>0\). This is the density just proved. The integral of that density from \(0\) to \(t\) and \(H(t)\) therefore have the same derivative and the same value at \(0\), so they are equal. Finally, by the definition of \(S_k\), the event \(S_k\le t\) is exactly the event \(N_t\ge k\). This completes the proof. \(\square\)

The finite sum in the distribution function is also the probability of fewer than \(k\) arrivals, with a complement taken. In fact, the Poisson count formula gives \(\mathbb{P}(N_t=r)=e^{-\lambda t}(\lambda t)^r/r!\). Summing over \(r=0,\ldots,k-1\) and subtracting from one gives the same expression. This provides a second way to compute arrival-by-deadline probabilities.

Worked Example: At Least Three Arrivals by One Hour

Suppose a process has rate \(\lambda=2\) per hour. Find the probability that its third arrival occurs by the one-hour deadline. This is the event \(S_3\le1\), equivalently \(N_1\ge3\).

Substitute \(k=3\), \(\lambda=2\), and \(t=1\) into the distribution function. The dimensionless product is \(\lambda t=(2)(1)=2\), so

$$ \begin{aligned} \mathbb{P}(S_3\le1) &=1-e^{-2}\left(\frac{2^0}{0!}+\frac{2^1}{1!}+\frac{2^2}{2!}\right)\\ &=1-e^{-2}(1+2+2)\\ &=1-5e^{-2}. \end{aligned} $$

Check by counts: the complementary event is \(N_1<3\). Its possible counts are \(0,1,2\), whose probabilities are \(e^{-2}\), \(2e^{-2}\), and \(2^2e^{-2}/2!=2e^{-2}\), respectively. Their sum is \(5e^{-2}\), so the complement is \(1-5e^{-2}\), as above.

Worked Example: The Second Arrival by a Two-Hour Deadline

Let the rate be \(\lambda=\tfrac32\) per hour. Find the probability that the second arrival occurs by time \(t=2\) hours.

Here \(k=2\) and \(\lambda t=(\tfrac32)(2)=3\). Applying the formula gives

$$ \begin{aligned} \mathbb{P}(S_2\le2) &=1-e^{-3}\left(\frac{3^0}{0!}+\frac{3^1}{1!}\right)\\ &=1-e^{-3}(1+3)\\ &=1-4e^{-3}. \end{aligned} $$

Check by counts: \(S_2\le2\) means \(N_2\ge2\). The complementary counts are zero and one. Their probabilities, using mean \((\tfrac32)(2)=3\), are \(e^{-3}3^0/0!=e^{-3}\) and \(e^{-3}3^1/1!=3e^{-3}\). Their sum is \(4e^{-3}\), giving \(1-4e^{-3}\). In particular, this is a probability of at least two arrivals, not exactly two.

Choosing the Right Event

Many errors in waiting-time problems come from using the probability of exactly \(k\) arrivals when the question asks for the \(k\)th arrival by a deadline. The distinction is captured by the event statements below.

QuestionEventProbability for \(\lambda>0\)
No arrivals by \(t\)\(N_t=0\), or \(S_1>t\)\(e^{-\lambda t}\)
At least one arrival by \(t\)\(N_t\ge1\), or \(S_1\le t\)\(1-e^{-\lambda t}\)
At least \(k\) arrivals by \(t\)\(N_t\ge k\), or \(S_k\le t\)\(1-e^{-\lambda t}\sum_{r=0}^{k-1}(\lambda t)^r/r!\)
Exactly \(k\) arrivals by \(t\)\(N_t=k\)\(e^{-\lambda t}(\lambda t)^k/k!\)

Common mistake. Suppose the question asks for the probability that the third arrival occurs by time \(t\). A tempting but incorrect calculation is to use the probability of exactly three arrivals, \(e^{-\lambda t}(\lambda t)^3/3!\). That event excludes outcomes with four or more arrivals, even though the third arrival has already occurred in all of them. The correct event is \(N_t\ge3\), so its probability is \(1-\mathbb{P}(N_t=0)-\mathbb{P}(N_t=1)-\mathbb{P}(N_t=2)\). Substituting the Poisson count probabilities gives \(1-e^{-\lambda t}\{1+\lambda t+(\lambda t)^2/2!\}\), exactly the \(S_3\) deadline formula.

For a zero-rate process, the event “no arrivals by \(t\)” has probability \(1\), and “at least \(k\) arrivals by \(t\)” has probability \(0\) for every \(k\ge1\). Do not substitute \(\lambda=0\) into a Gamma density as if a positive-rate arrival-time distribution still existed: there are no finite arrival times in that case.

Check Your Understanding

For each question, identify the event before choosing a formula. Use \(\lambda>0\) unless a question states otherwise.

  1. A process has rate \(\lambda=1\) per minute. What is the probability of no arrivals in three minutes?
  2. For rate \(\lambda=2\) per hour, write the probability that the fourth arrival occurs by one hour as a finite sum.
  3. Explain why the probability that the third arrival occurs by time \(t\) is not the probability of exactly three arrivals by time \(t\).
  4. If \(\lambda=0\), what are the probabilities of no arrivals by \(t\) and of at least one arrival by \(t\)?
  5. For a positive rate, why do \(S_k\le t\) and \(N_t\ge k\) describe the same event?