Tutorials › Generalized Linear Models › Quasi-Poisson Models for Counts

Quasi-Binomial and Quasi-Poisson · Tutorial 698 of 981

Quasi-Poisson Models for Counts

Learn to specify and interpret a quasi-Poisson log-link model, calculate fitted count means, and assess what its dispersion multiplier does—and does not—change.

Intermediate 9 min read

What You'll Learn

  • State the quasi-Poisson conditional mean and variance specification for count responses
  • Distinguish a working variance function from moments of an actual count distribution
  • Calculate fitted means from a log-link linear predictor
  • Interpret a log-link coefficient as a multiplicative change in the fitted mean
  • Compare quasi-Poisson and Poisson variances when the mean is held fixed
  • Recognize when a proposed mean and variance cannot belong to a nonnegative integer-valued response

Why Use a Quasi-Poisson Model?

A Poisson regression relates a count mean to predictors and, under the Poisson distribution, sets the conditional variance equal to that mean. Count data often vary more than this assumption allows. A quasi-Poisson model keeps a count mean model but allows its variance to be a multiple of the mean. This separates the model for the expected count from a simple adjustment to its variability.

The multiplier is useful only when interpreted carefully. A quasi-Poisson specification gives a mean and a variance relationship; it does not, by itself, specify a probability distribution for each response. Also, if the moments are claimed to come from an actual count distribution, they must be mathematically possible for a nonnegative integer-valued variable.

Mean, Variance, and the Log Link

Definition: For count responses \(Y_i\) and observed predictors \(x_i\), a quasi-Poisson mean–variance specification has \(E[Y_i\mid x_i]=\mu_i\) and \(\operatorname{Var}(Y_i\mid x_i)=\phi\mu_i\), where \(\mu_i>0\) and the common dispersion multiplier \(\phi>0\). These equations may be used as a working specification without asserting that a conditional count distribution with exactly these moments exists. If they are asserted as actual conditional moments, the chosen \(\mu_i\) and \(\phi\) must be compatible with a nonnegative integer-valued response.

With a log link and a linear predictor, the mean is modeled as \(\log(\mu_i)=x_i^\mathsf{T}\beta\), or equivalently \(\mu_i=\exp(x_i^\mathsf{T}\beta)\). Here \(x_i\) is the predictor vector for observation \(i\), \(\beta\) is the coefficient vector, and the exponential ensures a positive fitted mean. The response remains a count, but a mean or fitted mean need not be an integer.

The ordinary Poisson mean–variance relationship is the special case \(\phi=1\). Values \(\phi>1\) describe a variance larger than the Poisson variance at the same mean; \(0<\phi<1\) describe a smaller working variance. Neither choice alone supplies a full probability model.

Worked Example: Calculating Means From a Log-Link Model

Suppose the fitted model is \(\log(\mu_i)=0.2+0.5x_i\). Calculate the fitted means for \(x_i=0,1,2\).

For \(x_i=0\), the linear predictor is \(0.2+0.5(0)=0.2\), so \(\hat{\mu}_i=\exp(0.2)\approx1.2214\).

For \(x_i=1\), it is \(0.2+0.5(1)=0.7\), so \(\hat{\mu}_i=\exp(0.7)\approx2.0138\).

For \(x_i=2\), it is \(0.2+0.5(2)=1.2\), so \(\hat{\mu}_i=\exp(1.2)\approx3.3201\).

These are predicted conditional means, not predictions that the observed counts must equal. For example, \(2.0138\) is a valid fitted mean even though no individual response can be \(2.0138\).

What the Dispersion Multiplier Changes

At a fixed conditional mean, multiplying by \(\phi\) changes the specified variance, not the value of that mean. The following calculation makes the comparison precise.

Result: For a fixed \(\mu_i>0\), the quasi-Poisson variance is \(\phi\) times the Poisson variance. Its standard deviation is \(\sqrt{\phi}\) times the Poisson standard deviation.

Derivation. Under the Poisson mean–variance relationship, \(\operatorname{Var}(Y_i\mid x_i)=\mu_i\). Under the quasi-Poisson specification, \(\operatorname{Var}(Y_i\mid x_i)=\phi\mu_i\). Dividing the latter by the former gives the variance ratio \(\phi\). Taking square roots of the positive variances gives the standard-deviation ratio \(\sqrt{\phi\mu_i}/\sqrt{\mu_i}=\sqrt{\phi}\). The mean remains \(\mu_i\) in both comparisons. \(\square\)

This result concerns the variance relationship at a given mean. It does not say that multiplying \(\phi\) changes the mean equation, nor does it define a probability distribution. In an analysis, coefficient estimates and fitted means come from the specified mean model and its fitting procedure; \(\phi\) describes the variance scale in the quasi-Poisson specification.

Worked Example: Comparing Quasi-Poisson and Poisson Variability

Suppose two observations have fitted means \(2\) and \(8\), and a quasi-Poisson working variance uses \(\phi=2\). Calculate the variances and standard deviations, then compare them with the Poisson values.

For mean \(2\), the quasi-Poisson variance is \(2(2)=4\), giving standard deviation \(\sqrt{4}=2\). The Poisson variance is \(2\), with standard deviation \(\sqrt{2}\approx1.4142\).

For mean \(8\), the quasi-Poisson variance is \(2(8)=16\), giving standard deviation \(\sqrt{16}=4\). The Poisson variance is \(8\), with standard deviation \(\sqrt{8}\approx2.8284\).

In both cases the variance is twice the Poisson variance, while the standard deviation is \(\sqrt{2}\) times as large. The fitted means remain \(2\) and \(8\); only the specified variability around those means has been scaled.

A Feasibility Check for Actual Count Moments

For a nonnegative integer-valued response, not every positive mean and variance can occur together. In particular, a count with mean below one cannot have an arbitrarily small variance. This matters when the mean–variance equations are interpreted as actual conditional moments rather than as a working variance relationship.

Result: If \(Y\) is nonnegative integer-valued with finite mean \(\mu\), let \(k=\lfloor\mu\rfloor\), the greatest integer no larger than \(\mu\). Then \(\operatorname{Var}(Y)\geq(\mu-k)(k+1-\mu)\).

Proof. For every integer value \(y\), there is no integer strictly between \(k\) and \(k+1\), so \((y-k)(y-(k+1))\geq0\). Taking expectations and expanding gives \(E[Y^2]-(2k+1)\mu+k(k+1)\geq0\). Since \(E[Y^2]=\operatorname{Var}(Y)+\mu^2\), rearrangement yields \(\operatorname{Var}(Y)\geq(2k+1)\mu-k(k+1)-\mu^2=(\mu-k)(k+1-\mu)\). This proves the bound. \(\square\)

Consequently, if the quasi-Poisson equations are claimed to be actual moments, each observation’s mean and the common \(\phi\) must at least satisfy \(\phi\mu_i\geq(\mu_i-k_i)(k_i+1-\mu_i)\), where \(k_i=\lfloor\mu_i\rfloor\). This is a necessary condition, not a complete characterization of all feasible moment pairs. In particular, a violation proves that the proposed moments cannot come from a count distribution. A working quasi-likelihood variance function need not itself be an actual distribution, but its interpretation should then remain a variance specification rather than a claim about a fully specified count law.

Worked Example: Detecting an Impossible Moment Pair

Suppose a proposed actual count response has mean \(\mu=0.5\) and quasi-Poisson dispersion \(\phi=0.01\). Check whether these can be its moments.

Here \(k=\lfloor0.5\rfloor=0\). The integer-valued lower bound gives \(\operatorname{Var}(Y)\geq(0.5-0)(1-0.5)=0.25\).

But the proposed quasi-Poisson variance is \(\phi\mu=0.01(0.5)=0.005\), which is less than \(0.25\). Thus no nonnegative integer-valued response can have both the stated mean and variance. The equations could still be used as a working variance specification for an estimating procedure, but they cannot be described as the actual moments of such a count response.

Interpreting a Log-Link Coefficient

Exponentiating a coefficient gives a multiplicative comparison of fitted means. This follows directly from the log-link equation. If two predictor vectors differ only by one unit in a predictor whose coefficient is \(\beta_j\), their linear predictors differ by \(\beta_j\), and exponentiation makes the ratio of their means \(\exp(\beta_j)\). This interpretation is about the mean model; it does not depend on \(\phi\).

Worked Example: A Binary Predictor and Dispersion

Suppose the fitted model is \(\log(\mu_i)=\log(2)+\log(4)z_i\), where \(z_i\) is either \(0\) or \(1\). Let \(\phi=2\). Find each fitted mean, its quasi-Poisson variance, and the mean ratio.

At \(z_i=0\), \(\hat{\mu}_i=\exp(\log(2))=2\), so the specified variance is \(2(2)=4\).

At \(z_i=1\), \(\hat{\mu}_i=\exp(\log(2)+\log(4))=\exp(\log(8))=8\), so the specified variance is \(2(8)=16\).

The fitted mean ratio is \(8/2=4=\exp(\log(4))\). Thus the model’s mean for \(z_i=1\) is four times that for \(z_i=0\). The dispersion multiplier doubles each variance relative to its Poisson value but does not alter this fitted mean ratio.

Common Mistakes

  • Treating quasi-Poisson as a complete probability distribution. The mean and variance equations do not determine the probabilities of individual counts. Do not infer a probability mass function from them alone.
  • Assuming any positive \(\mu_i\) and \(\phi\) give possible count moments. If the equations are actual moments, integer-valuedness imposes constraints. Check feasibility; otherwise describe the variance as a working specification.
  • Multiplying the mean by \(\phi\). The quasi-Poisson variance is \(\phi\mu_i\), but the conditional mean remains \(\mu_i\).
  • Multiplying the standard deviation by \(\phi\). The variance scales by \(\phi\), so the standard deviation scales by \(\sqrt{\phi}\).
  • Reading a fitted mean as an observed count. A fitted mean can be noninteger; it is the model’s expected count, not a possible individual response value.

The central distinction is simple: the log-link equation describes how the expected count depends on predictors, while the quasi-Poisson variance function scales variability around that mean. When those equations are claimed as actual moments, count-valued feasibility must also be respected.

Check Your Understanding

Answer each question by using the mean equation, the variance relationship, or the count-moment feasibility check as appropriate.

  1. A fitted log-link model is \(\log(\mu_i)=0.3+0.4x_i\). Calculate the fitted mean at \(x_i=2\).
  2. At a fixed mean of \(5\), how does the quasi-Poisson variance with \(\phi=1.6\) compare with the Poisson variance? By what factor does the standard deviation change?
  3. For a log-link coefficient of \(\log(3)\) on a binary predictor, what is the fitted mean ratio between predictor values 1 and 0?
  4. Can a nonnegative integer-valued response have mean \(0.5\) and variance \(0.005\)? Use the integer-valued lower bound to justify your answer.
  5. Does specifying \(E[Y_i\mid x_i]=\mu_i\) and \(\operatorname{Var}(Y_i\mid x_i)=\phi\mu_i\) determine the conditional probability of observing each count? Explain.
Clinical Biostats