Tutorials › Stochastic Processes › The Memoryless Property of Exponential Waiting

The Poisson Process: Definitions and Equivalent Characterizations · Tutorial 388 of 994

The Memoryless Property of Exponential Waiting

Learn why an exponential wait has the same residual distribution after any fixed event-free period, and how to calculate conditional waiting probabilities.

Intermediate 9 min read

What You'll Learn

  • Derive the memoryless identity from the exponential survival function.
  • Interpret conditioning on no arrival by a fixed time.
  • Calculate residual waiting and arrival probabilities over specified intervals.
  • Distinguish conditional residual probabilities from unconditional survival probabilities.
  • Identify when the memoryless calculation applies and what it does not imply.

Why an Event-Free Period Does Not Change an Exponential Wait

Suppose a waiting time has an exponential distribution. If no event has occurred for a while, how does that affect the probability of waiting still longer? The answer is a distinctive feature of the exponential distribution: conditional on having waited through a fixed period, the remaining wait has the same distribution as the original wait. The conditioning matters. The unconditional chance of a long wait and the chance of a long residual wait given survival so far are different probabilities.

Work on a probability space \((\Omega,\mathcal{F},\mathbb{P})\). Let \(T\) be a nonnegative, finite waiting time with exponential rate \(\lambda>0\). Its survival function is \(\mathbb{P}(T>u)=e^{-\lambda u}\) for \(u\ge0\). In particular, for any fixed \(s\ge0\), the event \(T>s\) has positive probability \(e^{-\lambda s}\), so conditioning on that event is meaningful. The distribution has no atoms: its distribution function \(1-e^{-\lambda u}\) is continuous, including at \(u=0\).

Theorem (Memoryless identity): If \(T\) is exponential with rate \(\lambda>0\), then for every \(s,t\ge0\), $$ \mathbb{P}(T>s+t\mid T>s)=\mathbb{P}(T>t)=e^{-\lambda t}. $$ Equivalently, conditional on \(T>s\), the residual waiting time \(T-s\) has an exponential distribution with rate \(\lambda\).

The identity concerns a fixed elapsed time \(s\) and a fixed additional waiting time \(t\). The event in the conditioning has positive probability for every finite \(s\). The cases \(s=0\) and \(t=0\) are included: when \(s=0\), the conditioning event has probability \(1\), and when \(t=0\), both sides equal \(1\).

Proof. By the definition of conditional probability and the inclusion \(\{T>s+t\}\subseteq\{T>s\}\),

$$ \mathbb{P}(T>s+t\mid T>s) =\frac{\mathbb{P}(T>s+t)}{\mathbb{P}(T>s)} =\frac{e^{-\lambda(s+t)}}{e^{-\lambda s}} =e^{-\lambda t} =\mathbb{P}(T>t). $$

For \(t\ge0\), the event that the residual wait exceeds \(t\), given \(T>s\), is exactly \(\{T>s+t\}\) under the same conditioning. Thus the conditional survival function of \(T-s\) is \(e^{-\lambda t}\), which is the exponential survival function with rate \(\lambda\). This proves both statements. \(\square\)

The proof uses only a ratio of survival probabilities. The elapsed period \(s\) appears in both numerator and denominator, so it cancels. That cancellation is the mathematical source of the memoryless property; it is not a claim that the waiting time literally restarts or that an event-free period has not occurred.

Applying the Identity to a Poisson Arrival

For a direct arrival-time interpretation, let \((N_t)_{t\ge0}\) be a Poisson process on the probability space above, with continuous time index \(t\ge0\), state space \(S=\{0,1,2,\ldots\}\), and rate \(\lambda>0\). Define its first arrival time by \(T_1=\inf\{t\ge0:N_t\ge1\}\). The earlier result that the first arrival time is exponential gives \(\mathbb{P}(T_1>u)=e^{-\lambda u}\). The event of no arrivals by time \(s\), \(N_s=0\), is the event \(T_1>s\), up to an endpoint that has probability zero. Therefore, the theorem applies to the first arrival after observing an event-free period.

Residual-wait interpretation: For \(s,t\ge0\), $$ \mathbb{P}(T_1-s>t\mid N_s=0)=e^{-\lambda t}. $$ Thus, given no arrival by time \(s\), the probability of waiting more than \(t\) additional time units for the first arrival is \(e^{-\lambda t}\). The probability of an arrival within the next \(t\) time units is \(1-e^{-\lambda t}\).

There is also a useful formula for probabilities over an interval of residual waiting times. If \(0\le a<b\), the residual wait is in \((a,b]\) exactly when the first arrival occurs after \(s+a\) and no later than \(s+b\), given survival through \(s\). Since the exponential distribution has no atoms, either choice of strictness at a finite endpoint gives the same probability.

Residual interval formula: If \(T\) is exponential with rate \(\lambda>0\), \(s\ge0\), and \(0\le a<b\), then $$ \mathbb{P}(a<T-s\le b\mid T>s)=e^{-\lambda a}-e^{-\lambda b}. $$

Proof. The event \(a<T-s\le b\), together with \(T>s\), is the event \(s+a<T\le s+b\). Its probability is \(\mathbb{P}(T>s+a)-\mathbb{P}(T>s+b)\). Dividing by \(\mathbb{P}(T>s)=e^{-\lambda s}>0\) gives $$ \frac{e^{-\lambda(s+a)}-e^{-\lambda(s+b)}}{e^{-\lambda s}} =e^{-\lambda a}-e^{-\lambda b}. $$ The right side is nonnegative because \(a<b\) and \(\lambda>0\). This establishes the formula. \(\square\)

Worked Residual-Wait Calculations

Worked Example: Waiting Longer After Half an Hour

Suppose the first arrival time \(T_1\) has exponential rate \(\lambda=2\) per hour. Given that no arrival occurred in the first \(\tfrac12\) hour, find the probability of waiting more than another \(\tfrac14\) hour.

Here \(s=\tfrac12\) and \(t=\tfrac14\). The no-arrival event has probability $$ \mathbb{P}(T_1>\tfrac12)=e^{-2(\tfrac12)}=e^{-1}>0. $$ The joint event of no arrival by \(\tfrac12\) hour and waiting more than another \(\tfrac14\) hour is \(T_1>\tfrac34\), whose probability is $$ \mathbb{P}(T_1>\tfrac34)=e^{-2(\tfrac34)}=e^{-3/2}. $$ Consequently, the conditional probability is $$ \mathbb{P}(T_1>\tfrac34\mid T_1>\tfrac12) =\frac{e^{-3/2}}{e^{-1}}=e^{-1/2}. $$

Check: The memoryless identity gives \(e^{-\lambda t}=e^{-2(\tfrac14)}=e^{-1/2}\), matching the conditional-probability calculation.

Worked Example: Arrival Between Two Residual Waiting Times

Let the arrival rate again be \(\lambda=2\) per hour. Given no arrival in the first \(\tfrac12\) hour, find the probability that the residual wait is more than \(\tfrac14\) hour but at most \(\tfrac34\) hour.

Set \(s=\tfrac12\), \(a=\tfrac14\), and \(b=\tfrac34\). The residual interval formula gives $$ \mathbb{P}(\tfrac14<T_1-\tfrac12\le\tfrac34\mid T_1>\tfrac12) =e^{-2(\tfrac14)}-e^{-2(\tfrac34)} =e^{-1/2}-e^{-3/2}. $$ The same result follows directly by dividing the probability of \( \tfrac34<T_1\le\tfrac54\) by the probability of \(T_1>\tfrac12\): $$ \frac{e^{-2(\tfrac34)}-e^{-2(\tfrac54)}}{e^{-2(\tfrac12)}} =\frac{e^{-3/2}-e^{-5/2}}{e^{-1}} =e^{-1/2}-e^{-3/2}. $$

Check: Since \(\tfrac14<\tfrac34\), \(e^{-1/2}>e^{-3/2}\), so the calculated interval probability is positive. The direct calculation and the residual interval formula agree.

Worked Example: Arrival Within the Next Two-Thirds of a Time Unit

Suppose \(T_1\) has exponential rate \(\lambda=3\). Given that no arrival has occurred by time \(s=\tfrac13\), calculate the probability of at least one first arrival in the next \(\tfrac23\) time unit. Here “at least one first arrival” means that the first arrival occurs within that interval.

The additional waiting time is at most \(t=\tfrac23\), so its conditional probability is one minus the conditional probability of waiting longer: $$ \mathbb{P}(T_1-\tfrac13\le\tfrac23\mid T_1>\tfrac13) =1-e^{-3(\tfrac23)} =1-e^{-2}. $$ To check this from the defining conditional probability, the event in the numerator is \(\tfrac13<T_1\le1\). The numerator and denominator are $$ \mathbb{P}(\tfrac13<T_1\le1)=e^{-3(\tfrac13)}-e^{-3(1)}=e^{-1}-e^{-3}, \qquad \mathbb{P}(T_1>\tfrac13)=e^{-3(\tfrac13)}=e^{-1}. $$ Their ratio is $$ \frac{e^{-1}-e^{-3}}{e^{-1}}=1-e^{-2}. $$

Check: The complementary conditional probability of waiting more than \(\tfrac23\) is \(e^{-2}\). The two probabilities sum to \((1-e^{-2})+e^{-2}=1\).

Common Mistake: Leaving Out the Conditioning

A frequent error is to calculate the unconditional chance of surviving from time \(0\) all the way to time \(s+t\), then report it as the chance of surviving another \(t\) given survival to \(s\). In the first worked example, the unconditional probability of no arrival by \(\tfrac34\) hour is \(e^{-3/2}\). It is not the requested conditional probability. The conditioning event, no arrival by \(\tfrac12\) hour, has probability \(e^{-1}\), so the correct calculation divides:

$$ \mathbb{P}(T_1>\tfrac34\mid T_1>\tfrac12) =\frac{e^{-3/2}}{e^{-1}} =e^{-1/2}. $$

The distinction is important in applications: a probability conditional on an event-free observation period describes the residual wait among cases known to have survived that period. It does not describe the original, unconditioned waiting time.

The memoryless identity is specific to exponential waiting times. It does not hold for every waiting-time distribution. For instance, if a wait is uniformly distributed on \([0,2]\), then conditional on surviving one time unit, the chance of surviving one further unit is \(0\), whereas the original chance of surviving one unit is \(\tfrac12\). The conditional and original survival probabilities differ. Thus, an event-free period can change residual waiting probabilities unless the exponential model applies.

For a positive-rate exponential wait, the practical rule is concise: when conditioning on survival through a fixed time \(s\), use the exponential survival formula for the additional time \(t\), not for the total time \(s+t\). For an interval of residual times, subtract the two residual survival probabilities. Always check that the conditioning event has positive probability; here it does because \(e^{-\lambda s}>0\) for finite \(s\).

Check Your Understanding

Use the survival function and the conditional probability definition to justify each answer.

  1. If \(T\) is exponential with rate \(\lambda>0\), write \(\mathbb{P}(T>s+t\mid T>s)\) and explain why the conditioning event has positive probability.
  2. For rate \(\lambda=4\), given \(T>\tfrac12\), calculate the probability that the residual wait is at most \(\tfrac14\).
  3. For rate \(\lambda=1\), given \(T>1\), calculate the probability that the residual wait lies in \((1,2]\).
  4. In a Poisson process, express the event of no arrival by time \(s\) in terms of the first arrival time \(T_1\).
  5. Explain why \(e^{-\lambda(s+t)}\) is not the conditional probability of waiting more than \(t\) additional time units after already waiting \(s\).