Tutorials › Stochastic Processes › Means and Variances of Conditional Arrival Times

Properties of Poisson Processes · Tutorial 430 of 994

Means and Variances of Conditional Arrival Times

Use conditional order statistics to compute and interpret the mean and variance of a Poisson process’s kth arrival time given its terminal count.

Intermediate 10 min read

What You'll Learn

  • State the conditional order-statistic law of arrival times given a fixed Poisson count
  • Derive the conditional mean and variance of the kth arrival time
  • Check the moment formulas using conditional densities and second moments
  • Interpret how the arrival rank, fixed count, and time horizon affect the moments
  • Recognize why unconditional arrival-time formulas do not apply after conditioning

Arrival-Time Moments Under a Fixed Count

Suppose a Poisson process has exactly \(n\) arrivals during a fixed interval \([0,T]\). The arrival times are then dependent: once their total number is fixed, an early arrival leaves more of the interval available for later arrivals. Nevertheless, their joint conditional law has a simple description. The ordered arrival times behave like the order statistics of \(n\) independent uniform points on \([0,T]\). This gives explicit formulas for the conditional mean and variance of the \(k\)th arrival time.

Let \((\Omega,\mathcal F,\mathbb P)\) be a probability space carrying a homogeneous Poisson process \((N_t)_{t\ge0}\) of rate \(\lambda>0\), with state space \(S=\{0,1,2,\ldots\}\) and natural filtration \(\mathcal F_t=\sigma(N_s:0\le s\le t)\). Fix \(T>0\). Write \(S_k=\inf\{t\ge0:N_t\ge k\}\) for the time of the \(k\)th arrival. We condition on the event \(\{N(T)=n\}\), which has probability \(e^{-\lambda T}(\lambda T)^n/n!>0\). A \(k\)th arrival within the interval exists under this conditioning precisely when \(1\le k\le n\).

Conditional order-statistic law: Given \(N(T)=n\), for \(n\ge1\) the vector \((S_1,\ldots,S_n)\) has density \(n!/T^n\) on \(0<s_1<\cdots<s_n<T\), and density zero elsewhere. Equivalently, it has the law of the increasing order statistics of \(n\) independent Uniform\((0,T)\) random variables.

Here is a brief derivation of the conditional law. For ordered times \(0<s_1<\cdots<s_n<T\), the joint density of arrivals at those locations and no other arrivals in \([0,T]\) is \(e^{-\lambda T}\lambda^n\). Dividing by \(\mathbb P(N(T)=n)=e^{-\lambda T}(\lambda T)^n/n!\) gives the stated conditional density. The same density is obtained by taking \(n\) independent uniform points, whose unordered joint density is \(1/T^n\), and sorting them: each strictly ordered configuration has \(n!\) possible label orderings. Ties and arrivals exactly at the endpoints have probability zero.

The Marginal Density and Moment Formulas

For a fixed \(k\) with \(1\le k\le n\), the event that the \(k\)th ordered point is near \(s\) requires \(k-1\) points below \(s\), one point in a small interval around \(s\), and \(n-k\) points above \(s\). Counting which of the independent uniform points occupy these positions gives the marginal density below.

Theorem: For \(T>0\), \(n\ge1\), and \(1\le k\le n\), the conditional density of \(S_k\) given \(N(T)=n\) is \(f_{k,n,T}(s)=\dfrac{n!}{(k-1)!(n-k)!T^n}s^{k-1}(T-s)^{n-k}\) for \(0<s<T\), and zero otherwise. Its conditional mean and variance are \(\mathbb E[S_k\mid N(T)=n]=\dfrac{kT}{n+1}\) and \(\operatorname{Var}(S_k\mid N(T)=n)=\dfrac{k(n+1-k)T^2}{(n+1)^2(n+2)}\).

Proof. Set \(U_i\) to be the independent Uniform\((0,T)\) points whose order statistics are the arrival times under the conditional law. For a small interval \((s,s+ds)\), the probability that one specified point lies there is approximately \(ds/T\); the probability that a point lies below \(s\) is \(s/T\), and the probability that it lies above \(s\) is \((T-s)/T\). Choose the point in the small interval in \(n\) ways, choose the \(k-1\) points below it in \(\binom{n-1}{k-1}\) ways, and place the remaining \(n-k\) above it. The resulting density is \[ \frac{n!}{(k-1)!(n-k)!}\frac{1}{T} \left(\frac{s}{T}\right)^{k-1} \left(\frac{T-s}{T}\right)^{n-k}, \] which is the displayed marginal density.

To calculate its moments, use \(u=s/T\). For positive integers \(a,b\), the integral \(\int_0^1 u^{a-1}(1-u)^{b-1}\,du=(a-1)!(b-1)!/(a+b-1)!\). This identity follows by integration by parts repeatedly: when \(b>1\), integration by parts gives \(I(a,b)=\frac{b-1}{a}I(a+1,b-1)\), and \(I(a,1)=1/a\). Applying this identity to the density shows that \(S_k/T\) has first moment \(k/(n+1)\) and second moment \(k(k+1)/((n+1)(n+2))\). Therefore \[ \mathbb E[S_k\mid N(T)=n]=\frac{kT}{n+1}, \qquad \mathbb E[S_k^2\mid N(T)=n]=\frac{k(k+1)T^2}{(n+1)(n+2)}. \] Subtracting the square of the mean gives \[ \begin{aligned} \operatorname{Var}(S_k\mid N(T)=n) &=T^2\left(\frac{k(k+1)}{(n+1)(n+2)}-\frac{k^2}{(n+1)^2}\right)\\ &=\frac{k(n+1-k)T^2}{(n+1)^2(n+2)}. \end{aligned} \] The density is normalized because the same integral identity, with \(a=k\) and \(b=n+1-k\), makes its integral equal to \(1\). This proves the density and both moment formulas. \(\square\)

The conditional mean is the fraction \(k/(n+1)\) of the observation horizon, not \(k/n\). The \(n\) random points divide \([0,T]\) into \(n+1\) gaps, including the gaps before the first and after the last arrival; this helps explain the denominator \(n+1\). The variance is largest near the middle ranks and is symmetric under replacing \(k\) by \(n+1-k\). Both moments scale with the observation horizon: multiplying \(T\) by a factor multiplies the mean by that factor and the variance by its square. Once we condition on the count, the rate \(\lambda\) no longer appears in these formulas.

Worked Example: The First Arrival Given Three Arrivals

Suppose a Poisson process has rate \(\lambda>0\), and observe it up to \(T=6\). Given \(N(6)=3\), find the conditional mean and variance of the first arrival time \(S_1\). The conditioning event has probability \(e^{-6\lambda}(6\lambda)^3/3!>0\).

Substitute \(n=3\), \(k=1\), and \(T=6\) into the formulas: \[ \mathbb E[S_1\mid N(6)=3]=\frac{1\cdot6}{3+1}=\frac32, \qquad \operatorname{Var}(S_1\mid N(6)=3) =\frac{1\cdot3\cdot6^2}{4^2\cdot5} =\frac{108}{80}=\frac{27}{20}. \]

Check using the conditional survival function. The first arrival exceeds \(t\) exactly when all three conditional uniform points exceed \(t\), so for \(0\le t\le6\), \(\mathbb P(S_1>t\mid N(6)=3)=(1-t/6)^3\). For a nonnegative bounded random variable \(X\), \(\mathbb E[X^2]=2\int_0^\infty t\mathbb P(X>t)\,dt\); this follows by writing \(X^2=\int_0^X2t\,dt\) and integrating. Thus \[ \begin{aligned} \mathbb E[S_1^2\mid N(6)=3] &=2\int_0^6 t(1-t/6)^3\,dt\\ &=72\int_0^1 u(1-u)^3\,du\\ &=72\left(\frac12-1+\frac34-\frac15\right) =72\left(\frac1{20}\right)=\frac{18}{5}. \end{aligned} \] Subtracting the squared mean gives \(\frac{18}{5}-(\frac32)^2=\frac{72}{20}-\frac{45}{20}=\frac{27}{20}\), as above.

Worked Example: A Middle Arrival Given Five Arrivals

Take \(T=8\), condition on \(N(8)=5\), and consider the third arrival. The conditioning event has probability \(e^{-8\lambda}(8\lambda)^5/5!>0\), and \(k=3\) is a valid rank because \(1\le3\le5\).

The mean and variance are \[ \mathbb E[S_3\mid N(8)=5]=\frac{3\cdot8}{6}=4, \qquad \operatorname{Var}(S_3\mid N(8)=5) =\frac{3\cdot3\cdot64}{6^2\cdot7} =\frac{576}{252}=\frac{16}{7}. \]

Check by the second moment. The conditional second moment is \[ \mathbb E[S_3^2\mid N(8)=5] =\frac{3(3+1)8^2}{(5+1)(5+2)} =\frac{12\cdot64}{42}=\frac{128}{7}. \] Then \(\frac{128}{7}-4^2=\frac{128}{7}-\frac{112}{7}=\frac{16}{7}\), which agrees with the variance formula. The mean is exactly \(T/2\), as expected for the central rank among five ordered points.

Worked Example: How the Rank Changes Variability

Let \(T=10\) and condition on \(N(10)=4\). Compare the first, second, and fourth arrival times. Each requested rank is between \(1\) and \(4\), and the event being conditioned on has probability \(e^{-10\lambda}(10\lambda)^4/4!>0\).

For the first arrival, \[ \mathbb E[S_1\mid N(10)=4]=\frac{10}{5}=2,\qquad \operatorname{Var}(S_1\mid N(10)=4)=\frac{1\cdot4\cdot100}{25\cdot6}=\frac83. \] For the second arrival, \[ \mathbb E[S_2\mid N(10)=4]=\frac{20}{5}=4,\qquad \operatorname{Var}(S_2\mid N(10)=4)=\frac{2\cdot3\cdot100}{25\cdot6}=4. \] For the fourth arrival, \[ \mathbb E[S_4\mid N(10)=4]=\frac{40}{5}=8,\qquad \operatorname{Var}(S_4\mid N(10)=4)=\frac{4\cdot1\cdot100}{25\cdot6}=\frac83. \]

Check by second moments. The formula for the second moment gives \(20/3\) for \(S_1\), \(20\) for \(S_2\), and \(200/3\) for \(S_4\). Subtracting the squared means gives \(20/3-4=8/3\), \(20-16=4\), and \(200/3-64=8/3\), respectively. The first and fourth ranks have equal variance, while the second has larger variance; the variance is symmetric around the center of the ordered sample.

Why Conditioning Changes the Answer

The unconditional \(k\)th arrival time in a rate-\(\lambda\) Poisson process has mean \(k/\lambda\) and variance \(k/\lambda^2\). Those are not the appropriate moments after fixing the count by time \(T\). For example, when \(T=6\), \(\lambda=2\), and \(N(6)=3\), the unconditional mean of the first arrival is \(1/2\), but the conditional mean is \(6/4=3/2\). Conditioning on exactly three arrivals changes the distribution of the arrival locations; it is not valid to retain the unconditional gamma-distribution moments.

Common mistake. A frequent incorrect calculation uses \(k/n\) as the expected fraction of the interval, giving \(S_1\) mean \(T/n\). For \(n=3\) and \(T=6\), that gives \(6/3=2\), which is wrong. The correct denominator is \(n+1\): the first order statistic has mean \(6/(3+1)=3/2\). A direct check uses the first-arrival survival function above, which gives \(\mathbb E[S_1\mid N(6)=3]=\int_0^6(1-t/6)^3dt=6/4=3/2\).

There is no \(k\)th arrival among the arrivals in \([0,T]\) when \(n=0\), so the conditional formulas do not apply for \(k\ge1\) in that case. Likewise, a rank \(k>n\) is not defined as an arrival time within the fixed-count sample. The conditions \(T>0\), \(\lambda>0\), and \(1\le k\le n\) ensure that the interval and requested arrival are meaningful and that the conditioning event has positive probability.

Check Your Understanding

Use the conditional order-statistic formulas, and verify each numerical answer by substituting the parameters into the relevant expression.

  1. Given \(N(12)=5\), find the conditional mean and variance of \(S_1\).
  2. Given \(N(9)=4\), find the conditional mean of \(S_3\). Is it before or after \(T/2\)?
  3. For \(T=8\) and \(n=3\), compare the conditional variances of \(S_1\) and \(S_3\). Explain their relationship.
  4. Why can the unconditional mean \(k/\lambda\) not generally be used for \(\mathbb E[S_k\mid N(T)=n]\)?
  5. For which values of \(n\) and \(k\) is the conditional kth arrival time in \([0,T]\) defined by these formulas?