Tutorials › Stochastic Processes › Mean and Variance of a Poisson Count

The Poisson Process: Definitions and Equivalent Characterizations · Tutorial 383 of 994

Mean and Variance of a Poisson Count

Derive the mean and variance of a Poisson count, then use them to check calculations and interpret variability at different rates and times.

Intermediate 9 min read

What You'll Learn

  • Express the Poisson parameter as the rate multiplied by the observation time.
  • Derive the first and second factorial moments from the probability mass function.
  • Show why the mean and variance of a Poisson count both equal its parameter.
  • Use the second raw moment to check a variance calculation.
  • Interpret the standard deviation and coefficient of variation of a Poisson count.
  • Recognize when a reported variance is inconsistent with a Poisson model.

From the Poisson Probability Mass Function to Its Moments

A Poisson count is described by one parameter, but that parameter has two useful interpretations: it is both the average count and the variance of the count. These facts are not part of the definition; they follow from summing the probabilities in the Poisson distribution. The derivation also gives a practical check on calculations and a way to quantify how much counts typically fluctuate.

Let \((N_t)_{t\ge0}\) be a Poisson counting process on a probability space \((\Omega,\mathcal{F},\mathbb{P})\), with state space \(\{0,1,2,\ldots\}\) and continuous time \(t\ge0\). At a fixed time \(t\), suppose the rate is \(\lambda\ge0\), and write \(\theta=\lambda t\). The single-count distribution is

$$ \mathbb{P}(N_t=k)=e^{-\theta}\frac{\theta^k}{k!}, \qquad k=0,1,2,\ldots. $$

For \(\theta=0\), this distribution means \(\mathbb{P}(N_t=0)=1\) and \(\mathbb{P}(N_t=k)=0\) for \(k\ge1\). For \(\theta>0\), the displayed formula applies directly. In either case the count is finite almost surely and has finite first and second moments. We derive those moments below. No conditioning on a filtration is needed: each calculation concerns the distribution of the count at one fixed time.

Definition: For a random variable \(Y\) with finite second moment, its mean is \(\mathbb{E}[Y]\), and its variance is \(\operatorname{Var}(Y)=\mathbb{E}[Y^2]-(\mathbb{E}[Y])^2\). The second factorial moment of a nonnegative integer-valued variable is \(\mathbb{E}[Y(Y-1)]\). This differs from the second raw moment \(\mathbb{E}[Y^2]\), since \(Y^2=Y(Y-1)+Y\).

The factorial moment is convenient because multiplying the Poisson probability at \(k\) by \(k\), or by \(k(k-1)\), cancels part of the factorial in the denominator. The resulting sums are exponential series. We first establish both sums in a form that will give the mean and variance.

Proposition (Poisson factorial moments): If \(N_t\) has the Poisson distribution with parameter \(\theta=\lambda t\), then \(\mathbb{E}[N_t]=\theta\) and \(\mathbb{E}[N_t(N_t-1)]=\theta^2\).

Proof. If \(\theta=0\), then \(N_t=0\) almost surely, so both equalities hold. Suppose \(\theta>0\). Using the probability mass function and the fact that the \(k=0\) term contributes zero to the first moment,

$$ \begin{aligned} \mathbb{E}[N_t] &=\sum_{k=1}^{\infty}k e^{-\theta}\frac{\theta^k}{k!}\\ &=e^{-\theta}\theta\sum_{k=1}^{\infty}\frac{\theta^{k-1}}{(k-1)!}\\ &=e^{-\theta}\theta\sum_{r=0}^{\infty}\frac{\theta^r}{r!} =\theta. \end{aligned} $$

In the second line, \(k/k!=1/(k-1)!\), and in the third line we set \(r=k-1\). The exponential series sums to \(e^\theta\), which cancels the factor \(e^{-\theta}\). For the second factorial moment, the terms \(k=0,1\) vanish, and for \(k\ge2\), \(k(k-1)/k!=1/(k-2)!\). Therefore

$$ \begin{aligned} \mathbb{E}[N_t(N_t-1)] &=\sum_{k=2}^{\infty}k(k-1)e^{-\theta}\frac{\theta^k}{k!}\\ &=e^{-\theta}\theta^2\sum_{k=2}^{\infty}\frac{\theta^{k-2}}{(k-2)!}\\ &=e^{-\theta}\theta^2\sum_{r=0}^{\infty}\frac{\theta^r}{r!} =\theta^2. \end{aligned} $$

Both sums are finite, so the moments used in these calculations exist. This proves the proposition. \(\square\)

Theorem (Mean and variance of a Poisson count): For a Poisson count \(N_t\) with parameter \(\theta=\lambda t\), \(\mathbb{E}[N_t]=\theta\) and \(\operatorname{Var}(N_t)=\theta\), including the degenerate case \(\theta=0\).

Proof. The proposition gives \(\mathbb{E}[N_t]=\theta\) and \(\mathbb{E}[N_t(N_t-1)]=\theta^2\). Since \(N_t^2=N_t(N_t-1)+N_t\), taking expectations gives \(\mathbb{E}[N_t^2]=\theta^2+\theta\). Thus

$$ \operatorname{Var}(N_t) =\mathbb{E}[N_t^2]-(\mathbb{E}[N_t])^2 =(\theta^2+\theta)-\theta^2 =\theta. $$

When \(\theta=0\), the count is zero almost surely, so its mean and variance are both zero, as asserted. \(\square\)

What the Two Moments Tell You

Because \(\theta=\lambda t\), a larger rate or a longer observation time increases both the expected count and its variance in direct proportion. The standard deviation, the square root of the variance, is \(\sqrt{\lambda t}\). For \(\lambda t>0\), the coefficient of variation is the standard deviation divided by the mean, so it is \(1/\sqrt{\lambda t}\). Thus the standard deviation increases with the expected count, while the relative size of typical fluctuations decreases as the parameter grows. At \(\lambda t=0\), the count is constant; its coefficient of variation is not defined because its mean is zero.

The equality of mean and variance is a feature of the Poisson distribution, not a universal rule for counts. It is useful in two ways. First, the mean provides a quick check on a probability calculation or a proposed expected count. Second, comparing a count model’s variance with its mean helps assess whether the Poisson distribution is a plausible description. A discrepancy can flag a problem with the model or calculation, but agreement alone does not prove that the data follow a Poisson distribution.

Worked Example: A Count with Parameter Two

Suppose the rate is \(\lambda=\tfrac32\) events per hour and the observation time is \(t=\tfrac43\) hours. Find the mean and variance of \(N_t\), and check them using the second raw moment.

First compute the parameter using the stated rate and time:

$$ \theta=\lambda t=\frac32\cdot\frac43=2. $$

The theorem gives \(\mathbb{E}[N_t]=2\) and \(\operatorname{Var}(N_t)=2\). For an independent check, the second factorial moment is \(\theta^2=2^2=4\), so the second raw moment is

$$ \mathbb{E}[N_t^2] =\mathbb{E}[N_t(N_t-1)]+\mathbb{E}[N_t] =4+2=6. $$

Substituting this value and the mean into the variance formula gives \(\operatorname{Var}(N_t)=6-2^2=6-4=2\), agreeing with the theorem. As another check on the distribution, its first probabilities are \(\mathbb{P}(N_t=0)=e^{-2}\), \(\mathbb{P}(N_t=1)=2e^{-2}\), and \(\mathbb{P}(N_t=2)=2e^{-2}\), each obtained by substituting \(k=0,1,2\) and \(\theta=2\) into the probability mass function.

Worked Example: Changing the Time Unit

Events occur at rate \(\lambda=6\) per day. Find the mean, variance, standard deviation, and probability of no events during a period of \(t=\tfrac14\) day.

The parameter for this period is \(\theta=\lambda t=6\cdot\tfrac14=\tfrac32\). Therefore the mean and variance are both \(\tfrac32\). The standard deviation is \(\sqrt{\tfrac32}\). The probability of no events follows from the \(k=0\) probability:

$$ \mathbb{P}(N_t=0) =e^{-3/2}\frac{(3/2)^0}{0!} =e^{-3/2}. $$

Check the variance using the raw second moment. The second factorial moment is \((\tfrac32)^2=\tfrac94\), so \(\mathbb{E}[N_t^2]=\tfrac94+\tfrac32=\tfrac94+\tfrac64=\tfrac{15}4\). Consequently, \(\operatorname{Var}(N_t)=\tfrac{15}4-(\tfrac32)^2=\tfrac{15}4-\tfrac94=\tfrac64=\tfrac32\). Since the mean is positive, the coefficient of variation is \(\sqrt{\tfrac32}/\tfrac32=\sqrt{\tfrac23}\). This expresses the standard deviation relative to the average count, rather than in units of events.

Worked Example: Comparing Two Observation Durations

A process has rate \(\lambda=2\) events per hour. Compare the mean, variance, and coefficient of variation of the count over \(t_1=\tfrac12\) hour and \(t_2=2\) hours. The comparison concerns the distribution of the count at each fixed duration.

For the shorter duration, \(\theta_1=\lambda t_1=2\cdot\tfrac12=1\). Hence the mean and variance are both \(1\), and the standard deviation is \(\sqrt{1}=1\). The coefficient of variation is \(1/1=1\). The second-moment check gives \(\mathbb{E}[N_{t_1}(N_{t_1}-1)]=1^2=1\), then \(\mathbb{E}[N_{t_1}^2]=1+1=2\), and \(\operatorname{Var}(N_{t_1})=2-1^2=1\).

For the longer duration, \(\theta_2=\lambda t_2=2\cdot2=4\). Hence the mean and variance are both \(4\), the standard deviation is \(\sqrt4=2\), and the coefficient of variation is \(2/4=\tfrac12\). The second-moment check gives \(\mathbb{E}[N_{t_2}(N_{t_2}-1)]=4^2=16\), then \(\mathbb{E}[N_{t_2}^2]=16+4=20\), and \(\operatorname{Var}(N_{t_2})=20-4^2=20-16=4\). The longer interval has a larger standard deviation, \(2\) rather than \(1\), but a smaller coefficient of variation, \(\tfrac12\) rather than \(1\).

A Common Variance Error

A frequent mistake is to treat the second factorial moment as if it were the second raw moment. They are not equal: \(N_t^2=N_t(N_t-1)+N_t\). For example, when \(\theta=2\), the second factorial moment is \(4\), while the second raw moment is \(4+2=6\). A wrong calculation that substitutes the factorial moment directly into the variance formula gives \(4-2^2=0\). The correction is to add the mean first: \(\mathbb{E}[N_t^2]=4+2=6\), then \(\operatorname{Var}(N_t)=6-2^2=2\).

When checking a proposed answer, keep the parameter and the moment distinct: calculate \(\theta=\lambda t\) with consistent time units, then compare the stated mean and variance with \(\theta\). A variance that differs from the mean is not compatible with this Poisson model at the specified rate and time. A match is a useful consistency check, not a proof that the Poisson assumptions are appropriate.

Check Your Understanding

Use the Poisson probability mass function and the moment identities to answer each question. When asked to check a result, show the substitution.

  1. If \(\lambda=3\) per hour and \(t=\tfrac23\) hour, what are the parameter, mean, and variance?
  2. For a Poisson count with parameter \(\theta=3\), find \(\mathbb{E}[N_t(N_t-1)]\) and use it to compute \(\mathbb{E}[N_t^2]\).
  3. A count has mean \(5\) under a proposed Poisson model. What variance and standard deviation does that model require?
  4. Why does the variance calculation require \(\mathbb{E}[N_t^2]\), rather than only \(\mathbb{E}[N_t(N_t-1)]\)?
  5. For a positive parameter \(\theta\), express the coefficient of variation in terms of \(\theta\). What happens to it as \(\theta\) increases?