Tutorials › Stochastic Processes › Uniform Order Statistics Given a Fixed Poisson Count

Properties of Poisson Processes · Tutorial 425 of 994

Uniform Order Statistics Given a Fixed Poisson Count

Condition on the number of arrivals by a fixed time and derive the joint law of their locations, including its equivalence to ordered uniform samples.

Intermediate 9 min read

What You'll Learn

  • State the conditional distribution of Poisson arrival times given the count.
  • Derive the joint density on the ordered time region.
  • Show why the conditional law does not depend on the Poisson rate.
  • Compute conditional probabilities by integrating over ordered regions.
  • Distinguish ordered arrival times from an unordered uniform sample.
  • Identify and correct the missing-factorial normalization error.

Conditioning on the Number of Arrivals

Knowing how many arrivals occur by time \(T\) does not determine when they occur. For a homogeneous Poisson process, however, conditioning on that count gives a particularly simple distribution for their locations: they are distributed like independent uniform points on the observation interval, placed in increasing order. This fact turns questions about arrival times into calculations over a bounded region of Euclidean space.

Let \((\Omega,\mathcal{F},\mathbb{P})\) be a probability space, and let \((N_t)_{t\ge0}\) be a homogeneous Poisson process of rate \(\lambda>0\), with state space \(S=\{0,1,2,\ldots\}\) and continuous time \(t\ge0\). Thus \(N_0=0\), increments over disjoint intervals are independent, and \(N_t-N_s\) has the Poisson distribution with mean \(\lambda(t-s)\) when \(0\le s<t\). For \(k\ge1\), define \(S_k=\inf\{t\ge0:N_t\ge k\}\), the time of the \(k\)th arrival. Fix \(T>0\). We condition on \(N_T=n\), an event of probability \(e^{-\lambda T}(\lambda T)^n/n!>0\), so the conditional law is well-defined.

Theorem: If \(n\ge1\), then conditional on \(N_T=n\), the vector \((S_1,\ldots,S_n)\) has joint density $$ f(s_1,\ldots,s_n\mid N_T=n)=\frac{n!}{T^n}\,\mathbf{1}_{\{0<s_1<\cdots<s_n<T\}}. $$ Equivalently, its conditional distribution is that of the increasing rearrangement of \(n\) independent Uniform\((0,T)\) random variables. For \(n=0\), there are no arrival times to specify.

The ordering in the density is essential: \(S_1,\ldots,S_n\) are already labeled by arrival order, so their possible values lie in the simplex \(0<s_1<\cdots<s_n<T\), not in the whole cube \((0,T)^n\). The factor \(n!\) accounts for the \(n!\) possible orderings of \(n\) distinct uniform values.

Deriving the Conditional Density

For a Poisson process, the successive interarrival times \(\tau_1=S_1\) and \(\tau_k=S_k-S_{k-1}\) for \(k\ge2\) are independent exponential random variables with rate \(\lambda\). This standard consequence of the independent-increment and no-arrival properties can also be seen from \(\mathbb{P}(\tau_1>u)=\mathbb{P}(N_u=0)=e^{-\lambda u}\); the same no-arrival calculation after an arrival gives the same waiting-time law, independently of the past. We use this interarrival representation to derive the theorem.

Proof. Assume first \(n\ge1\). The event \(N_T=n\) is the event \(S_n\le T<S_{n+1}\), up to probability-zero equality at \(T\). Write \(u_k=S_k-S_{k-1}\) with \(S_0=0\). For \(u_1,\ldots,u_n>0\) with \(u_1+\cdots+u_n<T\), the joint density of the first \(n\) interarrival times is \(\lambda^n e^{-\lambda(u_1+\cdots+u_n)}\). Independently, the probability that the next interarrival exceeds \(T-(u_1+\cdots+u_n)\) is \(e^{-\lambda(T-u_1-\cdots-u_n)}\). Multiplying gives the joint density of the first \(n\) gaps together with the event of no further arrival by \(T\): $$ \lambda^n e^{-\lambda(u_1+\cdots+u_n)} e^{-\lambda(T-u_1-\cdots-u_n)} =\lambda^n e^{-\lambda T}. $$ The transformation from gaps \((u_1,\ldots,u_n)\) to arrival times \((s_1,\ldots,s_n)\), where \(s_k=u_1+\cdots+u_k\), has Jacobian determinant \(1\): its matrix is triangular with diagonal entries \(1\). Its range is precisely \(0<s_1<\cdots<s_n<T\). Consequently, the joint density of \((S_1,\ldots,S_n)\) together with \(N_T=n\) is \(\lambda^n e^{-\lambda T}\) on that simplex and \(0\) elsewhere. The Poisson count law gives \(\mathbb{P}(N_T=n)=e^{-\lambda T}(\lambda T)^n/n!\). Dividing the joint density by this positive probability yields \(n!/T^n\) on the simplex, as claimed.

To check the equivalence with ordered uniforms, let \(U_1,\ldots,U_n\) be independent Uniform\((0,T)\) random variables. Their joint density is \(1/T^n\) on the cube \((0,T)^n\). Ties have probability zero, and the cube, except for those ties, divides into \(n!\) disjoint regions according to the ordering of the coordinates. On the region \(0<u_{(1)}<\cdots<u_{(n)}<T\), each of the \(n!\) permutations contributes density \(1/T^n\) to the ordered vector \((u_{(1)},\ldots,u_{(n)})\). Its density is therefore \(n!/T^n\), the same as the conditional density just derived. Equality of these densities proves equality of the distributions. \(\square\)

Consequence: Given \(N_T=n\), the distribution of the arrival-time vector depends on \(T\) and \(n\), but not on \(\lambda\). The rate affects the probability of observing \(n\) arrivals; after conditioning on that count, it cancels from the density.

This conclusion follows directly from the formula: for fixed \(T\) and \(n\), neither \(\lambda\) nor any expression involving it appears in \(n!/T^n\). The restriction to a fixed observation interval matters. The theorem describes the locations conditional on the count within that interval; it does not assert that an unconditioned process has a fixed number of arrivals.

Using the Density to Compute Probabilities

For any event described by inequalities on the ordered arrival times, its conditional probability is the integral of \(n!/T^n\) over the part of the simplex satisfying those inequalities. The calculations below show how to set the region and how to check the resulting answer against the equivalent uniform-sample description.

Worked Example: Two Arrivals on Opposite Sides of an Interval

Suppose \(T=3\), and condition on \(N_3=2\). Find the conditional probability that \(S_1<1\) and \(S_2>2\).

The density on \(0<s_1<s_2<3\) is \(2!/3^2=2/9\). The event restricts the ordered region to \(0<s_1<1\) and \(2<s_2<3\); the ordering is automatically satisfied because \(1<2\). The area of this rectangle is \((1-0)(3-2)=1\). Thus $$ \mathbb{P}(S_1<1,\ S_2>2\mid N_3=2) =\frac{2}{9}\cdot 1=\frac{2}{9}. $$

Check using independent uniforms. For two independent Uniform\((0,3)\) values, the event that the smaller is below \(1\) and the larger is above \(2\) requires one value in \((0,1)\) and the other in \((2,3)\). Either of the two labeled values can be in the first interval. Each assignment has probability \((1/3)(1/3)=1/9\), and the assignments are disjoint, giving \(2(1/9)=2/9\), as above. Strict versus non-strict endpoints does not change the answer because a uniform random variable has probability zero of equaling any fixed endpoint.

Worked Example: All Three Arrivals in a Central Interval

Condition on \(N_2=3\). Find the probability that all three arrival times lie in \([1/2,3/2]\).

The ordered density is \(3!/2^3=6/8=3/4\). The allowed region is \(1/2\le s_1<s_2<s_3\le3/2\). Its volume is the volume of the ordered part of a cube with side length \(3/2-1/2=1\). The six strict orderings partition that cube apart from ties, which have volume zero. Therefore the ordered region has volume \(1^3/3!=1/6\). Integrating the density gives $$ \mathbb{P}\left(\frac12\le S_1<S_2<S_3\le\frac32\mid N_2=3\right) =\frac34\cdot\frac16=\frac18. $$

Check using uniforms. Each of three independent Uniform\((0,2)\) values lies in an interval of length \(1\) with probability \(1/2\). The probability all three lie there is \((1/2)^3=1/8\). Sorting those values does not change whether all of them belong to the interval, confirming the calculation.

Worked Example: A Constraint on the Sum of Two Arrival Times

Condition on \(N_4=2\). Find the probability that \(S_1+S_2<3\).

The conditional density is \(2!/4^2=2/16=1/8\) on \(0<s_1<s_2<4\). For a fixed \(s_2\), the restrictions on \(s_1\) are \(0<s_1<s_2\) and \(s_1<3-s_2\). If \(0<s_2<3/2\), the smaller upper bound is \(s_2\). If \(3/2<s_2<3\), the smaller upper bound is \(3-s_2\). No points satisfy the sum constraint when \(s_2\ge3\). The area is $$ \int_0^{3/2}s_2\,ds_2+\int_{3/2}^{3}(3-s_2)\,ds_2 =\frac{(3/2)^2}{2}+\frac{(3/2)^2}{2} =\frac98+\frac98=\frac94. $$

Multiplying this area by the density gives \((1/8)(9/4)=9/32\). Check using uniforms. The sum of the two ordered values equals the sum of the two original uniform values. In the square \((0,4)^2\), the region \(u_1+u_2<3\) is a right triangle with legs of length \(3\), hence area \(3\cdot3/2=9/2\). The probability is \((9/2)/4^2=(9/2)/16=9/32\), in agreement.

In all three examples, replacing a strict endpoint inequality by a non-strict one leaves the probability unchanged: the boundary consists of lines or faces of volume zero under the joint density.

Normalization and a Common Mistake

The density must integrate to one over the ordered simplex. That simplex occupies \(1/n!\) of the cube \((0,T)^n\): away from ties, each of the \(n!\) orderings occupies the same volume, and together they partition the cube. Its volume is therefore \(T^n/n!\). Multiplying by the density gives \((n!/T^n)(T^n/n!)=1\). This also confirms that the factorial in the theorem is necessary.

Common mistake: omitting the factorial. A tempting but incorrect calculation is to divide the joint density \(\lambda^n e^{-\lambda T}\) by \(\mathbb{P}(N_T=n)\) and report \(1/T^n\) on the ordered simplex. For \(n=2\) and \(T=3\), that would give density \(1/9\). The simplex has area \(3^2/2!=9/2\), so this proposed density integrates to \((1/9)(9/2)=1/2\), not \(1\). The correct division includes \(n!\): the density is \(2!/3^2=2/9\), and \((2/9)(9/2)=1\). The missing factor arises because the conditional count probability contains \((\lambda T)^n/n!\).

The theorem is useful whenever a probability concerns the locations of a fixed number of Poisson arrivals within a fixed time window. It replaces a conditional Poisson-process calculation with a uniform-sample calculation while preserving the arrival ordering. Keep the two parts of the statement distinct: the original uniform values are independent before sorting, but the ordered values are not independent of one another.

Check Your Understanding

For each question, specify the ordered region before integrating, and check whether boundary choices affect the probability.

  1. Given \(N_5=2\), what is the conditional density of \((S_1,S_2)\), and over which region is it positive?
  2. Given \(N_2=2\), find the conditional probability that both arrival times lie in \([0,1]\).
  3. Explain why the conditional joint density does not depend on \(\lambda\), although \(\mathbb{P}(N_T=n)\) does.
  4. For \(n=3\), what is the volume of the ordered region \(0<s_1<s_2<s_3<T\), and how does it verify density normalization?
  5. Why does sorting independent uniform values multiply their density by \(n!\) on the strictly ordered region?