Tutorials › Stochastic Processes › Poisson Marginals Do Not Ensure a Poisson Process

The Poisson Process: Definitions and Equivalent Characterizations · Tutorial 400 of 994

Poisson Marginals Do Not Ensure a Poisson Process

See why Poisson one-time marginals do not determine a Poisson process, using an explicit construction that exposes dependent increments.

Intermediate 10 min read

What You'll Learn

  • State the defining increment conditions for a Poisson process.
  • Construct ordered arrival times with Gamma marginals using a shared uniform random variable.
  • Verify that the resulting count at each fixed time has a Poisson distribution.
  • Calculate events showing that two increments are dependent.
  • Identify the invalid inference from one-time count distributions to increment distributions.

Why One-Time Distributions Are Not Enough

A counting process records how many events have occurred by each time. Knowing the distribution of the count at every single time may seem to describe the process completely. It does not: those distributions say nothing by themselves about how counts at different times are coupled. In particular, they do not imply that counts accumulated over disjoint time intervals are independent.

For a rate-\(\lambda\) Poisson process, the count at time \(t\) has a Poisson distribution with mean \(\lambda t\). But that is only one part of the definition. A Poisson process also has independent increments: counts over disjoint time intervals are independent. We will construct a process with rate \(1\) Poisson marginals at every time, and then calculate events that show its increments are dependent.

Definition: A counting process \((N_t)_{t\ge0}\) has \(N_0=0\), nondecreasing integer-valued paths, and finitely many events on every bounded time interval. A rate-\(\lambda\) Poisson process additionally has independent increments and \(N_t-N_s\sim\operatorname{Pois}(\lambda(t-s))\) whenever \(0\le s<t\). The latter increment distributions are stationary in the sense that they depend on the interval length \(t-s\), not its location.

The example will use the probability space \(((0,1),\mathcal{B}(0,1),\mathbb{P})\), where \(\mathbb{P}\) is uniform probability, and the state space \(S=\{0,1,2,\ldots\}\). The time index is continuous, \(t\ge0\). Write \(F_n\) for the distribution function of a Gamma random variable with shape \(n\) and rate \(1\), and let \(U\) be the coordinate on \((0,1)\), so \(U\) is uniform. Define the quantile \(F_n^{-1}(u)=\inf\{x:F_n(x)\ge u\}\), and use the same \(U\) for every \(n\).

Construction: Set \(T_n=F_n^{-1}(U)\) for \(n\ge1\), and define \(N_t=\#\{n\ge1:T_n\le t\}\). Thus each proposed arrival time has the correct Gamma marginal, but all the arrival times are coupled through one shared uniform random variable.

We first check that this really defines a counting process and establish its one-time distributions. A Gamma random variable with shape \(n\) and rate \(1\) has the same distribution as a sum of \(n\) independent rate-\(1\) exponential random variables. Adding one more positive exponential variable shows that the shape-\((n+1)\) Gamma distribution is stochastically larger than the shape-\(n\) distribution. Consequently \(F_{n+1}(x)\le F_n(x)\) for every \(x\), and their quantiles satisfy \(F_{n+1}^{-1}(u)\ge F_n^{-1}(u)\). Therefore \(T_{n+1}\ge T_n\).

For any fixed finite \(t\), the probabilities \(F_n(t)=\mathbb{P}(\operatorname{Pois}(t)\ge n)\) tend to zero as \(n\) tends to infinity. For each \(U\in(0,1)\), eventually \(F_n(t)<U\), so \(T_n>t\). Hence there are only finitely many \(T_n\) in every bounded time interval. Also \(T_n>0\), so \(N_0=0\). The paths are nondecreasing and integer-valued, as required.

Proof of the marginal claim. For each \(n\ge1\), the definition of the quantile gives \(\mathbb{P}(T_n\le t)=F_n(t)\). Since the arrival times are ordered, \(N_t\ge n\) if and only if \(T_n\le t\). Thus \(\mathbb{P}(N_t\ge n)=F_n(t)=\mathbb{P}(\operatorname{Pois}(t)\ge n)\). These equalities of tail probabilities for all \(n\) determine the distribution on the nonnegative integers: for \(k\ge0\), the probability of exactly \(k\) is the tail probability at \(k\) minus the tail probability at \(k+1\), with the tail probability at \(0\) equal to \(1\). Therefore \(N_t\sim\operatorname{Pois}(t)\). \(\square\)

Worked Example: Checking the Marginals at Two Times

At \(t=1\), the probability of at least one arrival is \(F_1(1)=\mathbb{P}(\operatorname{Pois}(1)\ge1)=1-e^{-1}\). The probability of at least two is \(F_2(1)=\mathbb{P}(\operatorname{Pois}(1)\ge2)=1-2e^{-1}\). Subtracting successive tails gives \(\mathbb{P}(N_1=0)=e^{-1}\), \(\mathbb{P}(N_1=1)=(1-e^{-1})-(1-2e^{-1})=e^{-1}\), and \(\mathbb{P}(N_1=2)=(1-2e^{-1})-(1-\tfrac52e^{-1})=\tfrac12e^{-1}\).

These are the first three probabilities of a \(\operatorname{Pois}(1)\) variable. At \(t=2\), the probability of no arrivals is \(1-F_1(2)=e^{-2}\), and the probability of exactly one is \(F_1(2)-F_2(2)=(1-e^{-2})-(1-3e^{-2})=2e^{-2}\). In general the tail-difference argument gives \(\mathbb{P}(N_t=k)=e^{-t}t^k/k!\) for every \(k\ge0\).

Check: The probabilities at \(t=1\) are obtained by subtracting the appropriate Poisson tails, not by assuming anything about increments. For example, \(\mathbb{P}(N_1=1)=e^{-1}\), exactly the Poisson probability \(e^{-1}1^1/1!\).

Two Disjoint Increments Are Dependent

Let \(I_1=N_1\) be the count in \([0,1]\), and \(I_2=N_2-N_1\) the count in \((1,2]\). We will show that \(I_1\) and \(I_2\) are not independent. The key is to express arrival-time events as intervals for the shared \(U\).

For \(t\ge0\), set \(a_n(t)=F_n(t)=\mathbb{P}(\operatorname{Pois}(t)\ge n)\). The Gamma distribution functions are continuous and strictly increasing for positive arguments, so \(T_n\in(1,2]\) is equivalent, up to endpoints of probability zero, to \(a_n(1)<U\le a_n(2)\). For the first three values of \(n\), direct Poisson-tail calculations give

$$ \begin{aligned} a_1(1)&=1-e^{-1}, & a_1(2)&=1-e^{-2},\\ a_2(1)&=1-\frac{2}{e}, & a_2(2)&=1-\frac{3}{e^2},\\ a_3(1)&=1-\frac{5}{2e}, & a_3(2)&=1-\frac{5}{e^2}. \end{aligned} $$

The first interval \((a_1(1),a_1(2)]\) is the event that \(T_1\in(1,2]\). The next two intervals, for \(n=2\) and \(n=3\), overlap: \(a_3(2)\ge a_2(1)\) is equivalent to \(e\ge5/2\). Also \(a_2(2)<a_1(1)\) is equivalent to \(e<3\), so this joined pair of intervals is disjoint from the interval for \(n=1\). For completeness, \(5/2<e<3\): the series \(e=\sum_{k\ge0}1/k!\) gives \(e>1+1+\tfrac12+\tfrac16>5/2\), while \(k!\ge2^{k-1}\) for \(k\ge2\), with strict inequality for some \(k\), gives \(e<1+1+\sum_{k\ge2}2^{-(k-1)}=3\).

Worked Example: A Conditional Probability for the Second Interval

The event \(I_1=0\) is the event \(T_1>1\), or equivalently \(U>a_1(1)=1-e^{-1}\). It has probability \(e^{-1}>0\), so conditioning on it is meaningful. On this event, \(I_2\ge1\) exactly when \(T_1\le2\). Therefore \(\mathbb{P}(I_2\ge1\mid I_1=0)=(e^{-1}-e^{-2})/e^{-1}=1-e^{-1}\).

Now calculate an unconditional lower bound. The event \(I_2\ge1\) includes each of the three events \(T_n\in(1,2]\) for \(n=1,2,3\). The interval for \(n=1\) is disjoint from the union of the intervals for \(n=2,3\); those latter intervals overlap. Their total probability is therefore \[ (a_1(2)-a_1(1))+(a_2(2)-a_3(1)) =(e^{-1}-e^{-2})+\left(\frac{5}{2e}-\frac{3}{e^2}\right) =\frac{7}{2e}-\frac{4}{e^2}. \] Thus \(\mathbb{P}(I_2\ge1)\ge \tfrac{7}{2e}-\tfrac{4}{e^2}\).

This lower bound is strictly greater than \(1-e^{-1}\). Indeed, their difference is \[ \frac{-e^2+\tfrac92e-4}{e^2}. \] For \(5/2<e<3\), the numerator equals \(\tfrac12+(3-e)(e-\tfrac32)\), which is greater than \(0\). Hence \(\mathbb{P}(I_2\ge1)>1-e^{-1}\). If \(I_1\) and \(I_2\) were independent, conditioning on the positive-probability event \(I_1=0\) would leave the probability of \(I_2\ge1\) unchanged. The conditional probability is \(1-e^{-1}\), whereas the unconditional probability is strictly larger. This contradiction proves that the two increments are dependent. \(\square\)

Theorem: The constructed process has \(N_t\sim\operatorname{Pois}(t)\) for every \(t\ge0\), but it is not a rate-\(1\) Poisson process because its increments on \([0,1]\) and \((1,2]\) are dependent.

Proof. The marginal assertion was proved by matching the tail probabilities \(\mathbb{P}(N_t\ge n)\) to those of \(\operatorname{Pois}(t)\). The calculation above proves that \(I_1=N_1\) and \(I_2=N_2-N_1\) are dependent. Independent increments are part of the definition of a Poisson process. Therefore the constructed process is not a Poisson process, despite having Poisson marginals at every fixed time. \(\square\)

Worked Example: The First Two Arrival Times Are Also Dependent

The construction couples \(T_1\) and \(T_2\) through the same \(U\). Consider the events \(T_1\le1\) and \(T_2\le2\). Their respective probabilities are \(a_1(1)=1-e^{-1}\) and \(a_2(2)=1-3e^{-2}\). The second event is \(U\le a_2(2)\); it implies the first because \(a_2(2)<a_1(1)\), as verified by \(e<3\). Thus \(\mathbb{P}(T_1\le1,T_2\le2)=a_2(2)=1-3e^{-2}\).

If these arrival-time events were independent, their joint probability would instead be \((1-e^{-1})(1-3e^{-2})\), which is strictly smaller than \(1-3e^{-2}\), since \(0<1-e^{-1}<1\) and \(1-3e^{-2}>0\). The positivity follows, for example, from \(e>5/2\), which gives \(e^2>25/4>3\). This gives a second direct view of the dependence created by sharing \(U\).

Check: The joint event is governed by the smaller threshold, \(a_2(2)\), not by the product of the thresholds. The product would be appropriate only under independence, which this construction does not have.

What the Example Does—and Does Not—Show

The construction preserves every distribution \(N_t\), but it does not preserve the joint laws of counts at different times. A one-time marginal describes the random variable \(N_t\) for one fixed \(t\); it does not determine how \(N_s\) and \(N_t\) are related when \(s<t\). Independent increments are a separate requirement. Here the arrival times are ordered, so the paths are valid counting paths, yet the shared uniform variable links different parts of the path.

Common mistake. A tempting but invalid calculation is to see \(N_1\sim\operatorname{Pois}(1)\) and \(N_2\sim\operatorname{Pois}(2)\), then conclude that \(N_2-N_1\sim\operatorname{Pois}(1)\) and is independent of \(N_1\). The distribution of a difference cannot be found by subtracting the marginal distributions, and independence does not follow from either marginal. In this example, the explicit calculation gives \(\mathbb{P}(I_2\ge1)>1-e^{-1}\), while \(\mathbb{P}(I_2\ge1\mid I_1=0)=1-e^{-1}\). The unequal probabilities directly expose the error.

When checking whether a process is Poisson, verify the increment conditions rather than only checking the distribution at selected times. In particular, Poisson one-time marginals are necessary for a Poisson process, but they are not sufficient.

Check Your Understanding

Use the construction and calculations above to answer the following questions.

  1. Why does \(N_t\ge n\) hold exactly when \(T_n\le t\)?
  2. For the constructed process, compute \(\mathbb{P}(N_2=1)\) by subtracting Poisson tail probabilities.
  3. Explain why \(I_1=0\) has positive probability, and calculate \(\mathbb{P}(I_2\ge1\mid I_1=0)\).
  4. Which defining condition of a rate-\(1\) Poisson process fails in the example?
  5. Why can’t the distribution of \(N_2-N_1\) be determined merely by knowing the separate distributions of \(N_1\) and \(N_2\)?