From the Poisson Probability Mass Function to Its Moments
A Poisson count is described by one parameter, but that parameter has two useful interpretations: it is both the average count and the variance of the count. These facts are not part of the definition; they follow from summing the probabilities in the Poisson distribution. The derivation also gives a practical check on calculations and a way to quantify how much counts typically fluctuate.
Let \((N_t)_{t\ge0}\) be a Poisson counting process on a probability space \((\Omega,\mathcal{F},\mathbb{P})\), with state space \(\{0,1,2,\ldots\}\) and continuous time \(t\ge0\). At a fixed time \(t\), suppose the rate is \(\lambda\ge0\), and write \(\theta=\lambda t\). The single-count distribution is
For \(\theta=0\), this distribution means \(\mathbb{P}(N_t=0)=1\) and \(\mathbb{P}(N_t=k)=0\) for \(k\ge1\). For \(\theta>0\), the displayed formula applies directly. In either case the count is finite almost surely and has finite first and second moments. We derive those moments below. No conditioning on a filtration is needed: each calculation concerns the distribution of the count at one fixed time.
The factorial moment is convenient because multiplying the Poisson probability at \(k\) by \(k\), or by \(k(k-1)\), cancels part of the factorial in the denominator. The resulting sums are exponential series. We first establish both sums in a form that will give the mean and variance.
Proof. If \(\theta=0\), then \(N_t=0\) almost surely, so both equalities hold. Suppose \(\theta>0\). Using the probability mass function and the fact that the \(k=0\) term contributes zero to the first moment,
In the second line, \(k/k!=1/(k-1)!\), and in the third line we set \(r=k-1\). The exponential series sums to \(e^\theta\), which cancels the factor \(e^{-\theta}\). For the second factorial moment, the terms \(k=0,1\) vanish, and for \(k\ge2\), \(k(k-1)/k!=1/(k-2)!\). Therefore
Both sums are finite, so the moments used in these calculations exist. This proves the proposition. \(\square\)
Proof. The proposition gives \(\mathbb{E}[N_t]=\theta\) and \(\mathbb{E}[N_t(N_t-1)]=\theta^2\). Since \(N_t^2=N_t(N_t-1)+N_t\), taking expectations gives \(\mathbb{E}[N_t^2]=\theta^2+\theta\). Thus
When \(\theta=0\), the count is zero almost surely, so its mean and variance are both zero, as asserted. \(\square\)
What the Two Moments Tell You
Because \(\theta=\lambda t\), a larger rate or a longer observation time increases both the expected count and its variance in direct proportion. The standard deviation, the square root of the variance, is \(\sqrt{\lambda t}\). For \(\lambda t>0\), the coefficient of variation is the standard deviation divided by the mean, so it is \(1/\sqrt{\lambda t}\). Thus the standard deviation increases with the expected count, while the relative size of typical fluctuations decreases as the parameter grows. At \(\lambda t=0\), the count is constant; its coefficient of variation is not defined because its mean is zero.
The equality of mean and variance is a feature of the Poisson distribution, not a universal rule for counts. It is useful in two ways. First, the mean provides a quick check on a probability calculation or a proposed expected count. Second, comparing a count model’s variance with its mean helps assess whether the Poisson distribution is a plausible description. A discrepancy can flag a problem with the model or calculation, but agreement alone does not prove that the data follow a Poisson distribution.
Worked Example: A Count with Parameter Two
Suppose the rate is \(\lambda=\tfrac32\) events per hour and the observation time is \(t=\tfrac43\) hours. Find the mean and variance of \(N_t\), and check them using the second raw moment.
First compute the parameter using the stated rate and time:
The theorem gives \(\mathbb{E}[N_t]=2\) and \(\operatorname{Var}(N_t)=2\). For an independent check, the second factorial moment is \(\theta^2=2^2=4\), so the second raw moment is
Substituting this value and the mean into the variance formula gives \(\operatorname{Var}(N_t)=6-2^2=6-4=2\), agreeing with the theorem. As another check on the distribution, its first probabilities are \(\mathbb{P}(N_t=0)=e^{-2}\), \(\mathbb{P}(N_t=1)=2e^{-2}\), and \(\mathbb{P}(N_t=2)=2e^{-2}\), each obtained by substituting \(k=0,1,2\) and \(\theta=2\) into the probability mass function.
Worked Example: Changing the Time Unit
Events occur at rate \(\lambda=6\) per day. Find the mean, variance, standard deviation, and probability of no events during a period of \(t=\tfrac14\) day.
The parameter for this period is \(\theta=\lambda t=6\cdot\tfrac14=\tfrac32\). Therefore the mean and variance are both \(\tfrac32\). The standard deviation is \(\sqrt{\tfrac32}\). The probability of no events follows from the \(k=0\) probability:
Check the variance using the raw second moment. The second factorial moment is \((\tfrac32)^2=\tfrac94\), so \(\mathbb{E}[N_t^2]=\tfrac94+\tfrac32=\tfrac94+\tfrac64=\tfrac{15}4\). Consequently, \(\operatorname{Var}(N_t)=\tfrac{15}4-(\tfrac32)^2=\tfrac{15}4-\tfrac94=\tfrac64=\tfrac32\). Since the mean is positive, the coefficient of variation is \(\sqrt{\tfrac32}/\tfrac32=\sqrt{\tfrac23}\). This expresses the standard deviation relative to the average count, rather than in units of events.
Worked Example: Comparing Two Observation Durations
A process has rate \(\lambda=2\) events per hour. Compare the mean, variance, and coefficient of variation of the count over \(t_1=\tfrac12\) hour and \(t_2=2\) hours. The comparison concerns the distribution of the count at each fixed duration.
For the shorter duration, \(\theta_1=\lambda t_1=2\cdot\tfrac12=1\). Hence the mean and variance are both \(1\), and the standard deviation is \(\sqrt{1}=1\). The coefficient of variation is \(1/1=1\). The second-moment check gives \(\mathbb{E}[N_{t_1}(N_{t_1}-1)]=1^2=1\), then \(\mathbb{E}[N_{t_1}^2]=1+1=2\), and \(\operatorname{Var}(N_{t_1})=2-1^2=1\).
For the longer duration, \(\theta_2=\lambda t_2=2\cdot2=4\). Hence the mean and variance are both \(4\), the standard deviation is \(\sqrt4=2\), and the coefficient of variation is \(2/4=\tfrac12\). The second-moment check gives \(\mathbb{E}[N_{t_2}(N_{t_2}-1)]=4^2=16\), then \(\mathbb{E}[N_{t_2}^2]=16+4=20\), and \(\operatorname{Var}(N_{t_2})=20-4^2=20-16=4\). The longer interval has a larger standard deviation, \(2\) rather than \(1\), but a smaller coefficient of variation, \(\tfrac12\) rather than \(1\).
A Common Variance Error
A frequent mistake is to treat the second factorial moment as if it were the second raw moment. They are not equal: \(N_t^2=N_t(N_t-1)+N_t\). For example, when \(\theta=2\), the second factorial moment is \(4\), while the second raw moment is \(4+2=6\). A wrong calculation that substitutes the factorial moment directly into the variance formula gives \(4-2^2=0\). The correction is to add the mean first: \(\mathbb{E}[N_t^2]=4+2=6\), then \(\operatorname{Var}(N_t)=6-2^2=2\).
When checking a proposed answer, keep the parameter and the moment distinct: calculate \(\theta=\lambda t\) with consistent time units, then compare the stated mean and variance with \(\theta\). A variance that differs from the mean is not compatible with this Poisson model at the specified rate and time. A match is a useful consistency check, not a proof that the Poisson assumptions are appropriate.
Check Your Understanding
Use the Poisson probability mass function and the moment identities to answer each question. When asked to check a result, show the substitution.
- If \(\lambda=3\) per hour and \(t=\tfrac23\) hour, what are the parameter, mean, and variance?
- For a Poisson count with parameter \(\theta=3\), find \(\mathbb{E}[N_t(N_t-1)]\) and use it to compute \(\mathbb{E}[N_t^2]\).
- A count has mean \(5\) under a proposed Poisson model. What variance and standard deviation does that model require?
- Why does the variance calculation require \(\mathbb{E}[N_t^2]\), rather than only \(\mathbb{E}[N_t(N_t-1)]\)?
- For a positive parameter \(\theta\), express the coefficient of variation in terms of \(\theta\). What happens to it as \(\theta\) increases?