Tutorials › Generalized Linear Models › The Atom at Zero and Positive Outcomes

Power Variance Functions · Tutorial 619 of 981

The Atom at Zero and Positive Outcomes

See how the Poisson event count creates an atom at zero and makes positive responses a zero-truncated mixture of gamma sums.

Advanced 11 min read

What You'll Learn

  • Identify the Poisson and gamma parameters in the compound Poisson–gamma representation.
  • Derive the probability that a response equals zero.
  • Find the distribution of the event count conditional on a positive response.
  • Show why a sum of gamma amounts with a common scale is again gamma.
  • Express the positive-response distribution as a normalized gamma mixture.
  • Calculate conditional positive means and mixture probabilities.

Why Zero and Positive Responses Have Different Origins

In a compound Poisson–gamma model, a response is the total amount accumulated across a random number of events. If there are no events, the total is exactly zero. If there is at least one event, each event contributes a positive gamma amount, so the total is positive. This mechanism gives the response two distinct features: a point mass at zero and a continuous distribution over positive values.

The distinction matters when interpreting the model. The zero probability is determined by the chance of observing no events. A positive outcome, by contrast, combines uncertainty about the number of events with uncertainty about the amount contributed by each event. It is therefore generally a mixture of gamma distributions, not just one gamma distribution.

Model and Parameterization

Let \(N\) be a Poisson event count with mean \(\lambda>0\). Given the count, let \(Z_1,Z_2,\ldots\) be independent and identically distributed gamma amounts, independent of \(N\). Use the shape-scale convention: a gamma variable with shape \(a>0\) and scale \(\beta>0\) has density \(z^{a-1}e^{-z/\beta}/(\Gamma(a)\beta^a)\) for \(z>0\).

Definition: The compound Poisson–gamma response is \(Y=\sum_{j=1}^{N}Z_j\), with the empty sum defined as zero. In the Tweedie case considered here, \(1<p<2\), \(\mu>0\), and \(\phi>0\), and the parameters are \(\lambda=\mu^{2-p}/\{\phi(2-p)\}\), \(\alpha=(2-p)/(p-1)\), and \(\beta=\phi(p-1)\mu^{p-1}\), where each \(Z_j\) has gamma shape \(\alpha\) and scale \(\beta\).

These parameter formulas match the mean and variance of the Tweedie model. Indeed, for a gamma amount, \(E[Z_j]=\alpha\beta\) and \(E[Z_j^2]=\alpha(\alpha+1)\beta^2\). A compound Poisson sum has \(E[Y]=\lambda E[Z_j]\) and \(\operatorname{Var}(Y)=\lambda E[Z_j^2]\). Substitution gives \(E[Y]=\mu\) and \(\operatorname{Var}(Y)=\phi\mu^p\). We use the representation here to focus on the zero mass and positive outcomes.

Worked Example: Translating Tweedie Parameters

Take \(p=1.5\), \(\mu=4\), and \(\phi=2\). Find the corresponding event-count and gamma-amount parameters.

The shape is \(\alpha=(2-1.5)/(1.5-1)=0.5/0.5=1\). The scale is \(\beta=2(1.5-1)4^{1.5-1}=2(0.5)\sqrt{4}=2\). The Poisson mean is \(\lambda=4^{2-1.5}/\{2(2-1.5)\}=\sqrt{4}/1=2\).

Thus \(N\sim\operatorname{Poisson}(2)\), and each amount is exponential with shape \(1\) and scale \(2\). As a check, \(E[Y]=2(1)(2)=4=\mu\), and \(\operatorname{Var}(Y)=2(1)(2)(2^2)=16=2(4^{1.5})=\phi\mu^p\).

The Atom at Zero

The event \(Y=0\) is exactly the event of no arrivals. If \(N=0\), the sum is empty and equals zero. If \(N=k\geq 1\), then \(Y\) is a sum of \(k\) strictly positive gamma amounts, and is therefore strictly positive with probability one.

Theorem: In the compound Poisson–gamma model, \(P(Y=0)=e^{-\lambda}\). For every \(k\geq1\), conditional on \(N=k\), \(Y\) has a gamma distribution with shape \(k\alpha\) and scale \(\beta\). In particular, the distribution of \(Y\) on \((0,\infty)\) is continuous and has no further point masses.

Proof. A Poisson variable with mean \(\lambda\) satisfies \(P(N=0)=e^{-\lambda}\). When \(N=0\), the definition of the empty sum gives \(Y=0\). For any finite \(k\geq1\), every \(Z_j\) is positive with probability one, so \(\sum_{j=1}^k Z_j>0\) with probability one. Since a Poisson variable is finite with probability one, these facts show that \(Y=0\) if and only if \(N=0\), up to events of probability zero. Hence \(P(Y=0)=P(N=0)=e^{-\lambda}\).

To establish the conditional distribution, first note that the sum of two independent gamma variables with a common scale \(\beta\) has a gamma distribution with that scale and shape equal to the sum of their shapes. For shapes \(a,b>0\), the convolution density at \(y>0\) is \(\frac{e^{-y/\beta}}{\Gamma(a)\Gamma(b)\beta^{a+b}}\int_0^y x^{a-1}(y-x)^{b-1}\,dx\). Set \(u=x/y\); the integral becomes \(y^{a+b-1}\int_0^1 u^{a-1}(1-u)^{b-1}\,du=y^{a+b-1}\Gamma(a)\Gamma(b)/\Gamma(a+b)\), by the beta integral. The convolution is therefore the gamma density with shape \(a+b\) and scale \(\beta\). Applying this result repeatedly to \(k\) independent amounts gives shape \(k\alpha\) and scale \(\beta\). Each such conditional distribution has a density, so it assigns probability zero to any individual positive value. Mixing over the count preserves that property. \(\square\)

Worked Example: Calculating the Zero Probability

Use the parameters from the previous calculation, for which \(\lambda=2\). The chance of no events, and therefore of a zero response, is \(P(Y=0)=e^{-2}\approx0.1353\).

Consequently, the probability of a positive response is \(P(Y>0)=1-e^{-2}\approx0.8647\). The zero probability is not the probability that a gamma amount equals zero: a gamma amount is strictly positive with probability one. Zero occurs because the count of amounts is zero.

The Distribution Given a Positive Response

Because \(Y>0\) and \(N\geq1\) are equivalent up to probability-zero events, conditioning on a positive response amounts to conditioning the Poisson count to be nonzero. For \(k=1,2,\ldots\),

$$ P(N=k\mid Y>0) =\frac{P(N=k)}{P(N\geq1)} =\frac{e^{-\lambda}\lambda^k/k!}{1-e^{-\lambda}} =\frac{\lambda^k}{k!(e^\lambda-1)}. $$

These are the probabilities of a zero-truncated Poisson distribution. They are positive and sum to one, since \(\sum_{k=1}^{\infty}\lambda^k/k!=e^\lambda-1\). Given \(N=k\), the positive response has the gamma distribution established above. Thus the conditional distribution given \(Y>0\) is a mixture: choose \(k\) using the zero-truncated Poisson probabilities, then draw a gamma variable with shape \(k\alpha\) and scale \(\beta\).

Result: For \(y>0\), the conditional density of a positive response is \(f_{Y\mid Y>0}(y)=\sum_{k=1}^{\infty}\frac{\lambda^k}{k!(e^\lambda-1)}\frac{y^{k\alpha-1}e^{-y/\beta}}{\Gamma(k\alpha)\beta^{k\alpha}}\). This is a mixture over all positive event counts; its gamma component for count \(k\) has shape \(k\alpha\) and scale \(\beta\).

To see that this formula is a density, each gamma component integrates to one, and the mixture weights are nonnegative and sum to one. Equivalently, the unconditional density on \(y>0\) is the sum of the component densities weighted by \(P(N=k)\). Dividing by \(P(Y>0)=1-e^{-\lambda}\) gives the displayed conditional density. The sum and integral may be interchanged because all terms are nonnegative, by Tonelli’s theorem.

Worked Example: Conditional Event-Count Weights

For \(\lambda=2\), the positive-response probability is \(1-e^{-2}\). Conditional on a positive response, the chance that exactly one event occurred is \(P(N=1\mid Y>0)=2e^{-2}/(1-e^{-2})\approx0.3130\). The chance of exactly two events is \(P(N=2\mid Y>0)=2^2e^{-2}/\{2!(1-e^{-2})\}\approx0.3130\).

The two weights happen to be equal because the unconditioned Poisson probabilities at 1 and 2 are equal when \(\lambda=2\). In the mixture, the first component is gamma with shape \(1\) and scale \(2\), while the second is gamma with shape \(2\) and scale \(2\). Counts of three or more contribute additional gamma components; the two probabilities above are not the whole conditional distribution.

Conditional Means and Interpretation

Conditioning on a positive outcome changes the mean. Since \(Y=0\) whenever \(Y\) is not positive, \(E[Y]=P(Y>0)E[Y\mid Y>0]\). Using \(E[Y]=\mu\) and \(P(Y>0)=1-e^{-\lambda}\) gives \(E[Y\mid Y>0]=\mu/(1-e^{-\lambda})\). This is larger than the unconditional mean because the zero outcomes contribute nothing to \(E[Y]\).

Worked Example: Mean Amount Among Positive Responses

For \(p=1.5\), \(\mu=4\), and \(\phi=2\), we found \(\lambda=2\), \(\alpha=1\), and \(\beta=2\). The unconditional mean is \(4\). Therefore, \(E[Y\mid Y>0]=4/(1-e^{-2})\approx4/0.8647\approx4.626\).

The same value follows by first finding the expected number of events among positive cases. A Poisson count has \(E[N]=\lambda\), and its zero value contributes nothing, so \(E[N\mid N\geq1]=\lambda/(1-e^{-\lambda})=2/(1-e^{-2})\approx2.313\). Each event contributes an average amount \(\alpha\beta=2\), giving a conditional total mean of \(2(2.313)\approx4.626\), consistent with the calculation from \(E[Y]\).

Common Pitfall: Treating Positive Outcomes as One Gamma Distribution

A tempting shortcut is to say that, once the response is positive, it must have the gamma distribution of a single event amount. That is true only after additionally conditioning on \(N=1\). Given merely \(Y>0\), the event count can be \(1,2,3,\ldots\), and each count gives a different gamma shape. The correct conditional law is the zero-truncated Poisson mixture.

A related error is to use \(1-\lambda\) as the zero probability or as the probability of a positive response. The Poisson probability of zero is exactly \(e^{-\lambda}\); \(1-\lambda\) is not the Poisson probability of at least one event. For example, at \(\lambda=2\), \(1-\lambda=-1\) cannot even be a probability, whereas \(P(Y>0)=1-e^{-2}\approx0.8647\).

Key takeaway: The atom at zero is \(e^{-\lambda}\), caused by the zero-event case. Given a positive response, the event count follows a zero-truncated Poisson distribution, and the response is a mixture of gamma sums with shapes \(k\alpha\) and common scale \(\beta\).

Check Your Understanding

Use the compound Poisson–gamma representation to answer these questions.

  1. Why does \(Y=0\) occur if and only if \(N=0\), up to probability-zero events?
  2. For \(\lambda=1\), calculate \(P(Y=0)\) and \(P(Y>0)\).
  3. Given \(N=4\), what are the shape and scale parameters of the distribution of \(Y\)?
  4. Write the conditional probability \(P(N=k\mid Y>0)\) for a positive integer \(k\), and explain why these probabilities sum to one.
  5. Why is the distribution of \(Y\mid Y>0\) generally not the same as the distribution of one gamma amount \(Z_1\)?
Clinical Biostats