Tutorials › Generalized Linear Models › Interpreting Effects When Dispersion Changes

Quasi-Binomial and Quasi-Poisson · Tutorial 707 of 981

Interpreting Effects When Dispersion Changes

Translate quasi-GLM coefficients into odds and rate ratios, and distinguish the estimated effect from the uncertainty attached to it.

Intermediate 11 min read

What You'll Learn

  • Interpret a quasi-binomial logit coefficient as a conditional log odds ratio
  • Interpret a quasi-Poisson log-link coefficient as a conditional log rate ratio
  • Convert coefficient contrasts into odds ratios and rate ratios
  • Explain when quasi and ordinary GLMs have the same coefficient estimates
  • Track how a common dispersion factor changes standard errors and Wald inference
  • Distinguish changes in odds or rates from changes in probabilities or expected counts

Effects and uncertainty are different parts of a model

A regression coefficient describes how the model's mean changes with a predictor. Its interpretation comes from the mean structure and link function. In a quasi-binomial or quasi-Poisson model, a dispersion parameter also describes variability around that mean. When the dispersion is a common scalar, adjusting for it changes the estimated uncertainty of coefficients, but not the coefficient estimates themselves. Keeping these two roles separate is essential: the effect may be the same while the evidence about its precision changes.

For a quasi-binomial model, the logit link makes coefficients interpretable on the log-odds scale. For a quasi-Poisson model, the log link makes them interpretable on the log-mean, or log-rate, scale. Exponentiating a coefficient or a coefficient contrast gives a multiplicative effect. The interpretation is conditional on the other predictors in the linear predictor; it does not by itself describe a constant change in probability or count.

From coefficients to odds ratios and rate ratios

Definition: In a quasi-binomial model with a logit link, \( \operatorname{logit}(p_i)=\log\{p_i/(1-p_i)\}=x_i^\mathsf{T}\beta \), where \(p_i\) is the success probability for observation \(i\). For a predictor contrast that changes \(x_i^\mathsf{T}\beta\) by \(c\), holding the other terms fixed, the conditional odds ratio is \(\exp(c)\). In a quasi-Poisson model with a log link, \( \log(\mu_i)=x_i^\mathsf{T}\beta \), where \(\mu_i\) is the mean count. A contrast that changes the linear predictor by \(c\) multiplies the mean by \(\exp(c)\); when the mean is a rate for a fixed exposure, this is a rate ratio.

For a single predictor \(x_j\) with no interaction, increasing \(x_j\) by one unit changes the linear predictor by \(\beta_j\). Thus, \(\exp(\beta_j)\) is the odds ratio per unit increase in a quasi-binomial logit model, or the mean ratio per unit increase in a quasi-Poisson log-link model. A change of \(d\) units has linear-predictor contrast \(d\beta_j\), so its ratio is \(\exp(d\beta_j)\). For a contrast involving several predictors, replace \(d\beta_j\) with the corresponding change in the full linear predictor.

These are multiplicative interpretations. In the binomial case, an odds ratio is not a probability ratio or a difference in probabilities. In the Poisson case, a mean ratio is not a fixed difference in expected counts. The probability or expected-count difference depends on the starting covariate values as well as the coefficient contrast.

Worked Example: A Quasi-Binomial Treatment Coefficient

Suppose a quasi-binomial logit model for success has linear predictor \( \operatorname{logit}(p)=\beta_0+\beta_1 T+\beta_2 z \), where \(T=1\) indicates treatment and \(z\) is a covariate. The fitted treatment coefficient is \( \hat{\beta}_1=0.60 \). Find the treatment odds ratio at a fixed value of \(z\), and interpret it.

At fixed \(z\), changing \(T\) from 0 to 1 changes the linear predictor by \(0.60\). The fitted odds ratio is therefore

$$ \exp(0.60)=1.8221\ldots \approx 1.82. $$

The fitted odds of success under treatment are about 1.82 times the fitted odds without treatment, conditional on \(z\). Equivalently, they are about 82% higher, since \(1.82-1=0.82\). This does not mean the success probability is 82 percentage points higher: converting odds to probabilities also requires the baseline probability.

For instance, if the comparison probability without treatment were \(0.20\), its odds would be \(0.20/0.80=0.25\). Multiplying by 1.822 gives treatment odds \(0.4555\), corresponding to probability \(0.4555/(1+0.4555)\approx0.313\). The probability difference in this illustration is about \(0.113\), not \(0.82\).

Worked Example: A Two-Unit Predictor Contrast

In a quasi-binomial logit model, suppose a continuous predictor \(x\) has fitted coefficient \( \hat{\beta}_x=-0.25 \), with no interaction involving \(x\). Calculate the odds ratio for an increase of two units in \(x\).

The two-unit change alters the linear predictor by \(2(-0.25)=-0.50\). Therefore,

$$ \widehat{\mathrm{OR}}=\exp(-0.50)=0.6065\ldots \approx 0.61. $$

At fixed values of the other predictors, the odds for observations differing by two units in \(x\) are related by a factor of about 0.61. That is, the odds are about 39% lower for the observation with the larger \(x\), because \(1-0.6065\approx0.3935\). The one-unit odds ratio, \(\exp(-0.25)\approx0.78\), would answer a different contrast.

Worked Example: A Quasi-Poisson Rate Ratio

Suppose a quasi-Poisson model has log link and models a count mean per fixed unit of observation time. A predictor \(x\) has fitted coefficient \( \hat{\beta}_x=0.4055 \), with no interaction involving \(x\). Calculate the fitted rate ratio for a one-unit increase.

The linear predictor increases by \(0.4055\), so the mean rate is multiplied by

$$ \exp(0.4055)\approx1.500. $$

Thus, at fixed values of the other predictors, a one-unit increase in \(x\) corresponds to a fitted rate about 1.5 times as large, or 50% higher. If the comparison rate were 4 events per unit time, the corresponding fitted rate would be \(4(1.5)=6\). This is a rate comparison, not an assertion that every observation will have exactly two additional events.

Why the coefficient estimates can stay the same

The shared-coefficient result follows from the form of the quasi-score. Consider independent observations with mean \(\mu_i\), linear predictor \( \eta_i=x_i^\mathsf{T}\beta \), and variance \( \operatorname{Var}(Y_i)=\phi V(\mu_i) \), where \(\phi>0\) is a common dispersion parameter. For a differentiable link and mean function, the quasi-score for \(\beta\) is

$$ U(\beta)=\sum_i \frac{1}{\phi}\frac{d\mu_i}{d\eta_i} \frac{Y_i-\mu_i}{V(\mu_i)}x_i =\frac{1}{\phi}U_0(\beta). $$

Here \(U_0(\beta)\) is the same score equation with the common factor \(1/\phi\) removed. Since multiplication by a nonzero scalar does not change the zeros, the dispersion value does not change the set of solutions to the coefficient estimating equations.

Theorem: If the data, mean structure, link, and variance function are held fixed, and the quasi-variance is multiplied by one common positive scalar \(\phi\), the quasi-score for \(\beta\) is \(1/\phi\) times the score with \(\phi=1\). Consequently, the coefficient estimating equations have the same solutions for every such \(\phi\). This statement concerns the coefficient equations; it does not say that uncertainty estimates or inferential conclusions are unchanged.
1
Write the quasi-score.
For each observation the contribution is \( \phi^{-1}(d\mu_i/d\eta_i)(Y_i-\mu_i)x_i/V(\mu_i) \), under the stated scalar-dispersion variance model.
2
Factor out the common scalar.
Because \(\phi\) does not vary with \(i\) or \(\beta\), the sum equals \(U_0(\beta)/\phi\).
3
Compare roots.
Since \(\phi>0\), \(U(\beta)=0\) if and only if \(U_0(\beta)=0\). Thus the solution sets coincide. \(\square\)

For the two models in focus, this cancellation can be seen directly. In a grouped quasi-binomial model, let \(Y_i\) be the number of successes in \(m_i\) trials, with mean \(m_i p_i\), variance \(\phi m_i p_i(1-p_i)\), and logit \( \operatorname{logit}(p_i)=x_i^\mathsf{T}\beta \). Since \(d(m_i p_i)/d\eta_i=m_i p_i(1-p_i)\), its quasi-score contribution is \(x_i(Y_i-m_i p_i)/\phi\). In a quasi-Poisson model, \( \mu_i=\exp(x_i^\mathsf{T}\beta) \) and \( \operatorname{Var}(Y_i)=\phi\mu_i \). Its contribution is \(x_i(Y_i-\mu_i)/\phi\). In both cases the common factor changes the score's scale, not its roots.

Dispersion changes uncertainty, not the effect scale

Under the conventional model-based quasi-GLM covariance calculation, with design matrix \(X\) of full column rank, the estimated covariance matrix has the form \( \hat{\phi}(X^\mathsf{T}WX)^{-1} \), where \(W\) is the diagonal matrix of GLM weights evaluated at the fitted means. The weights depend on the mean and variance function, not on the common scalar dispersion. The coefficient estimates, and hence the exponentiated coefficient contrasts, are therefore unchanged by this scalar factor, while the covariance matrix is multiplied by \(\hat{\phi}\).

In particular, if a coefficient's unscaled standard error is \(s\), its scaled standard error is \(\sqrt{\hat{\phi}}s\). The point estimate still gives the same odds ratio or rate ratio. But a Wald statistic, confidence interval, or test based on that standard error will generally change. If dispersion is estimated rather than known, the estimated value is used in this scaling. The effective degrees of freedom or reference distribution used for a test can also matter; the key distinction here is that these affect uncertainty assessment, not the coefficient's link-scale meaning.

The covariance scaling follows directly from the matrix form. The matrix \(X^\mathsf{T}WX\) is unchanged when only the common dispersion multiplier changes, while its inverse is unchanged as well. Multiplying that inverse by \(\hat{\phi}\) therefore multiplies every variance and covariance by \(\hat{\phi}\). A standard error is the square root of a variance, so it is multiplied by \(\sqrt{\hat{\phi}}\). This is a statement about the conventional quasi-GLM covariance calculation, not a claim that every possible uncertainty procedure has this form.

Worked Example: Same Odds Ratio, Wider Uncertainty

A quasi-binomial fit estimates a treatment coefficient as \(\hat{\beta}_1=-0.40\). Suppose its unscaled standard error is \(0.20\), and the estimated dispersion is \(\hat{\phi}=4\). Compare the coefficient-based odds ratio and the approximate 95% Wald intervals with and without dispersion scaling, using \(1.96\) as the normal critical value.

The fitted odds ratio is the same in either calculation:

$$ \exp(-0.40)=0.6703\ldots \approx 0.67. $$

Without dispersion scaling, the standard error is \(0.20\). The coefficient interval is \( -0.40\pm1.96(0.20)=[-0.792,-0.008] \). Exponentiating its endpoints gives the odds-ratio interval \( [\exp(-0.792),\exp(-0.008)]\approx[0.453,0.992] \).

With \(\hat{\phi}=4\), the standard error becomes \( \sqrt{4}(0.20)=0.40 \). The coefficient interval is \( -0.40\pm1.96(0.40)=[-1.184,0.384] \), and the odds-ratio interval is \( [\exp(-1.184),\exp(0.384)]\approx[0.306,1.468] \). The estimated odds ratio remains about \(0.67\); its uncertainty is greater after scaling. In this illustrative normal-Wald calculation, the scaled interval includes 1, whereas the unscaled interval narrowly excludes it. The illustration shows why reporting only the exponentiated coefficient can hide an important change in inferential precision.

Common pitfall: treating a ratio as a probability or count difference

A frequent error is to say that a logit coefficient of \(0.60\) means the probability rises by 60%, or that a quasi-Poisson coefficient of \(0.4055\) means the count rises by \(0.4055\). Neither statement follows from the model. The logit coefficient is an additive change in log odds, and its exponential is an odds ratio. The log-link coefficient is an additive change in log mean, and its exponential is a mean ratio. The corresponding absolute changes depend on the starting probability or mean.

A second error is to say that increasing dispersion makes the odds ratio or rate ratio closer to 1. Under the common scalar-dispersion assumptions above, it does not change the estimated coefficient, so it does not change its exponentiation. It increases the model-based standard error when \(\hat{\phi}>1\), widening uncertainty intervals and often reducing the strength of evidence against a null contrast. This conclusion relies on the shared mean model and a common dispersion multiplier; if the mean structure, link, data, or variance weighting changes, the coefficient equations need not have the same solutions.

Key takeaway: Interpret effects from the link: exponentiated quasi-binomial logit contrasts are conditional odds ratios, and exponentiated quasi-Poisson log-link contrasts are conditional mean or rate ratios. A common dispersion adjustment preserves those coefficient-based effects while scaling their conventional model-based uncertainty.

Check Your Understanding

Use the link-scale contrast first, then exponentiate it.

  1. A quasi-binomial logit coefficient for \(x\) is \(0.30\). What is the fitted odds ratio for a three-unit increase in \(x\), holding other terms fixed?
  2. Why does an odds ratio of 1.5 not imply that the probability is 50 percentage points larger?
  3. In a quasi-Poisson log-link model, what does a coefficient of \(-0.20\) imply for the mean ratio associated with a one-unit increase?
  4. Under what condition does changing \(\phi\) leave the coefficient estimating equations unchanged?
  5. If the estimated dispersion is multiplied by four while the fitted means and weights are fixed, by what factor does the conventional model-based standard error change?
Clinical Biostats