Tutorials › Stochastic Processes › Competing Exponential Clocks in a Superposed Stream

Properties of Poisson Processes · Tutorial 415 of 994

Competing Exponential Clocks in a Superposed Stream

Learn how independent exponential clocks combine into a single minimum clock, and how to calculate which source wins the race.

Intermediate 9 min read

What You'll Learn

  • Derive the distribution and density of the minimum of finitely many independent exponential waiting times.
  • Calculate the probability that a particular source supplies the next arrival.
  • Explain why ties have probability zero when the clocks have positive rates.
  • Compute winner probabilities and arrival-time probabilities with unequal rates.
  • Show how the race behaves after conditioning on no arrival by a fixed time.
  • Identify and correct common errors in normalizing competing rates.

One Arrival, Several Independent Clocks

Suppose several independent sources can produce the next event. Each source has its own exponential waiting time, but only the earliest of those times is observed as the next arrival in the combined stream. The minimum determines how long we wait; the identity of the source attaining it determines who supplied that arrival. Both quantities can be calculated directly from the exponential distributions.

Work on a probability space \((\Omega,\mathcal{F},\mathbb{P})\). For a finite collection of \(m\ge1\) independent Poisson counting processes \((N_t^{(r)})_{t\ge0}\), let each process have state space \(\mathbb{Z}_{\ge0}\) and rate \(\lambda_r\), where \(r\in\{1,\ldots,m\}\). The time to the first arrival from source \(r\) is \(T_r=\inf\{t\ge0:N_t^{(r)}\ge1\}\). A positive-rate source has \(T_r\) exponentially distributed with rate \(\lambda_r\), meaning \(\mathbb{P}(T_r>t)=e^{-\lambda_r t}\) for \(t\ge0\). A source with rate zero has \(T_r=\infty\) almost surely.

Definition: The first arrival time in the combined stream is \(T=\min_{1\le r\le m}T_r\). When exactly one source attains this minimum, its index is the source of the next arrival. Write \(\Lambda=\sum_{r=1}^m\lambda_r\) for the sum of the source rates.

We first treat the nondegenerate case in which every rate is positive. Then \(\Lambda>0\), and each waiting time has a continuous distribution. Consequently, two independent clocks tie with probability zero: for distinct \(i,j\), conditional on \(T_i=t\), the probability that \(T_j=t\) is zero for every \(t\), because \(T_j\) has no point masses. Thus there is almost surely a unique source of the next arrival.

The Minimum and the Winning Source

Theorem (Competing exponential clocks): Let \(T_1,\ldots,T_m\) be independent exponential random variables with positive rates \(\lambda_1,\ldots,\lambda_m\), and let \(T=\min_r T_r\). Then \(T\) is exponential with rate \(\Lambda=\sum_r\lambda_r\). For each \(i\), the probability that source \(i\) attains the minimum is \(\lambda_i/\Lambda\).

Proof. For \(t\ge0\), the event \(T>t\) is the event that every clock exceeds \(t\). Independence and the exponential survival formulas give

$$ \mathbb{P}(T>t) =\mathbb{P}(T_1>t,\ldots,T_m>t) =\prod_{r=1}^m e^{-\lambda_r t} =e^{-\Lambda t}. $$

This is the survival function of an exponential random variable with rate \(\Lambda\), so \(T\) has that distribution and density \(f_T(t)=\Lambda e^{-\Lambda t}\) for \(t\ge0\). To calculate the probability that source \(i\) wins, integrate over the possible time \(t\) of its arrival. Its density at \(t\) is \(\lambda_i e^{-\lambda_i t}\), and every other clock must exceed \(t\), an event of probability \(\prod_{r\ne i}e^{-\lambda_r t}\) independent of \(T_i\). Therefore

$$ \mathbb{P}(T_i=T) =\int_0^\infty \lambda_i e^{-\lambda_i t} \prod_{r\ne i}e^{-\lambda_r t}\,dt =\int_0^\infty\lambda_i e^{-\Lambda t}\,dt =\frac{\lambda_i}{\Lambda}. $$

The final equality follows by integrating the exponential: \(\int_0^\infty e^{-\Lambda t}\,dt=1/\Lambda\), since \(\Lambda>0\). Summing over all possible winners gives \(\sum_i\lambda_i/\Lambda=\Lambda/\Lambda=1\), as required. \(\square\)

The rate of the minimum is a sum, not an average: more independent sources give more opportunities for an early event. The winning probabilities are the individual rates divided by that sum. In particular, a source with twice another source’s rate is twice as likely to supply the next arrival, regardless of how long the clocks have already been running, provided the conditioning is that none has yet rung.

Worked Example: Three Sources with Different Rates

Three independent sources have rates \(2\), \(3\), and \(5\) arrivals per hour. Find the distribution of the time to the next arrival in the combined stream and the probability that each source supplies it.

The total rate is \(\Lambda=2+3+5=10\) arrivals per hour. By the theorem, for \(t\ge0\), \(\mathbb{P}(T>t)=e^{-10t}\), so the minimum waiting time is exponential with rate \(10\). Its mean is \(1/10\) hour, or six minutes, because the mean of an exponential random variable with rate \(\Lambda\) is \(1/\Lambda\).

The three winner probabilities are

$$ \mathbb{P}(\text{source 1 wins})=\frac{2}{10}=\frac15,\qquad \mathbb{P}(\text{source 2 wins})=\frac{3}{10},\qquad \mathbb{P}(\text{source 3 wins})=\frac{5}{10}=\frac12. $$

Check: the probabilities sum to \(\tfrac15+\tfrac3{10}+\tfrac12=\tfrac2{10}+\tfrac3{10}+\tfrac5{10}=1\). The combined rate \(10\) also equals the sum of the three source rates, consistent with the derived survival probability.

There is also a useful joint calculation. The probability that source \(i\) wins and the first arrival occurs by a deadline \(t\ge0\) is the integral of its winning density only up to that deadline:

$$ \mathbb{P}(T_i=T,\ T\le t) =\int_0^t\lambda_i e^{-\Lambda u}\,du =\frac{\lambda_i}{\Lambda}\left(1-e^{-\Lambda t}\right). $$

This is not a new assumption about the sources; it follows from the same density-and-survival calculation used in the theorem. Summing over sources gives \(1-e^{-\Lambda t}=\mathbb{P}(T\le t)\), the probability that any source arrives by the deadline.

Worked Example: Which Source Arrives Before a Deadline?

Two independent sources have rates \(1\) and \(2\) per minute. Find the probability that source 1 supplies the first arrival by time \(t=\ln(2)/3\) minutes, and the corresponding probability for source 2.

The total rate is \(\Lambda=1+2=3\) per minute. At the specified deadline, \(e^{-\Lambda t}=e^{-3\ln(2)/3}=e^{-\ln 2}=\tfrac12\). The joint probability for source 1 is therefore

$$ \mathbb{P}(T_1=T,\ T\le t) =\frac13\left(1-\frac12\right)=\frac16. $$

For source 2, the calculation is

$$ \mathbb{P}(T_2=T,\ T\le t) =\frac23\left(1-\frac12\right)=\frac13. $$

Check: these disjoint events have total probability \(\tfrac16+\tfrac13=\tfrac12\). The probability of at least one arrival by the deadline is \(1-e^{-3t}=1-\tfrac12=\tfrac12\), so the two source-specific probabilities account for exactly all arrivals by that time.

What Changes After a Quiet Interval?

Suppose no source has arrived by a fixed time \(s\ge0\). The waiting times still have an exponential race after \(s\). The conditioning event has positive probability, since \(\mathbb{P}(T>s)=e^{-\Lambda s}>0\). For \(x_1,\ldots,x_m\ge0\), independence gives the conditional joint survival probability

$$ \begin{aligned} &\mathbb{P}(T_1-s>x_1,\ldots,T_m-s>x_m\mid T_1>s,\ldots,T_m>s)\\ &\quad=\prod_{r=1}^m \frac{\mathbb{P}(T_r>s+x_r)}{\mathbb{P}(T_r>s)} =\prod_{r=1}^m e^{-\lambda_r x_r}. \end{aligned} $$
Proposition: Conditional on no source having arrived by time \(s\), the residual waiting times \(T_r-s\) are independent exponential random variables with their original rates \(\lambda_r\). Hence the conditional probability that source \(i\) supplies the next arrival is still \(\lambda_i/\Lambda\), and the conditional additional waiting time is exponential with rate \(\Lambda\).

Proof. The conditioning event \(\{T_1>s,\ldots,T_m>s\}\) has probability \(\prod_r e^{-\lambda_r s}=e^{-\Lambda s}>0\), so the conditional probability is defined. The displayed calculation factors into one survival function for each \(r\). Each factor is \(e^{-\lambda_r x_r}\), the survival function of an exponential variable with rate \(\lambda_r\). Since the joint survival function factors into the product of these marginal survival functions for every nonnegative \(x_1,\ldots,x_m\), the residual waiting times are independent with the stated distributions. Applying the theorem to those residual times gives the claimed additional waiting-time distribution and winner probabilities. \(\square\)

This result is the race version of exponential memorylessness. A quiet interval does not favor one source over another: the residual clocks have the same rates as before. The conditioning here is specifically that all sources have remained quiet through time \(s\); conditioning on a different event need not have the same interpretation.

Worked Example: A Two-Source Race After Waiting

Two independent sources have rates \(\tfrac14\) and \(\tfrac12\) per minute. Given that neither has arrived by \(2\) minutes, find the distribution of the additional wait and the conditional probability that source 1 supplies the next arrival.

The event being conditioned on has probability \(e^{-(1/4+1/2)2}=e^{-3/2}>0\), so the conditional calculation is meaningful. By the proposition, the residual waiting times remain independent exponentials with rates \(\tfrac14\) and \(\tfrac12\). Their minimum has rate \(\tfrac14+\tfrac12=\tfrac34\) per minute, and thus the additional wait \(U=T-2\), under this conditioning, has survival function \(\mathbb{P}(U>x\mid T>2)=e^{-3x/4}\) for \(x\ge0\).

The conditional source-1 probability is

$$ \mathbb{P}(\text{source 1 wins}\mid T>2) =\frac{\tfrac14}{\tfrac34} =\frac13. $$

For source 2, the conditional probability is \(\tfrac{1/2}{3/4}=\tfrac23\). Check: \(\tfrac13+\tfrac23=1\), and the conditional minimum rate \(\tfrac34\) is the sum of the residual rates, just as it was before the quiet interval.

Zero Rates and a Common Mistake

The formulas also cover sources with rate zero if at least one source has positive rate. A zero-rate source has waiting time \(\infty\) almost surely and cannot supply the next arrival. The minimum is exponential with rate \(\Lambda\), the sum of the positive rates, and the winner probability for a zero-rate source is \(0/\Lambda=0\). If all rates are zero, then \(T=\infty\) almost surely and there is no next arrival; there is no finite-rate exponential distribution or winning source to calculate.

Common mistake: using the rates themselves as probabilities. With rates \(2\) and \(3\), it is wrong to say that the first source wins with probability \(2\) and the second with probability \(3\). Rates measure arrivals per unit time, not probabilities, and those numbers do not sum to \(1\). The correction is to divide each rate by the total rate: the probabilities are \(2/(2+3)=2/5\) and \(3/(2+3)=3/5\). Their sum is \(1\), and the combined waiting time has rate \(5\), not \(2\), \(3\), or their average.

The main distinction is worth keeping explicit: the minimum waiting time uses the sum of the rates, while the chance that a particular source wins uses that source’s rate divided by the sum. These calculations describe the first event in the race; they do not by themselves establish any further claims about the sequence of source labels.

Check Your Understanding

In each question, assume independent clocks and state any conditions needed for the probabilities to be defined.

  1. Two sources have positive rates \(4\) and \(6\) per hour. What is the distribution of the minimum waiting time, and what is the probability that the second source wins?
  2. Three independent exponential clocks have rates \(1\), \(2\), and \(0\). What is the probability that the zero-rate source supplies the next arrival?
  3. For rates \(\lambda_1,\ldots,\lambda_m>0\), derive the survival probability \(\mathbb{P}(T>t)\) by using independence.
  4. Two sources have rates \(1\) and \(3\) per minute. Find the probability that source 1 wins and the first arrival occurs by \(t=\ln(2)/4\) minutes.
  5. Why does conditioning on no arrival by time \(s\) leave each residual clock’s rate unchanged? State the condition that ensures this conditioning is meaningful.