Tutorials › Model-Informed Drug Development (MIDD) › Count Efficacy Outcomes and Exposure

Exposure-Response for Efficacy and Safety · Tutorial 195 of 596

Count Efficacy Outcomes and Exposure

Build and interpret exposure–response models for recurrent count outcomes, accounting for unequal follow-up and extra-Poisson variability.

Advanced 10 min read

What You'll Learn

  • Specify a Poisson exposure–response model for counts observed over unequal follow-up times.
  • Interpret exposure coefficients as conditional rate ratios, with the exposure scale stated.
  • Derive the negative-binomial variance from a gamma mixture of Poisson rates.
  • Calculate predicted counts and rates using a log-time offset.
  • Recognize overdispersion, excess zeros, and dependence as potential model failures.
  • Distinguish Poisson, negative-binomial, and alternative count-model approaches.

Why Model Efficacy Counts as Rates?

Some efficacy outcomes count how often a clinical event occurs: exacerbations, disease flares, or episodes requiring rescue treatment. These are recurrent counts, not simply whether an event occurred at least once. A person followed for eight weeks has more opportunity to accumulate events than a person followed for two weeks. A count model therefore needs to distinguish the event rate from the length of observation.

The models here describe the expected count conditional on recorded exposure and other included covariates. An exposure coefficient is a conditional association; interpreting it as a causal drug effect requires the relevant causal assumptions, not just a well-fitting count distribution. As in the earlier material on exposure metrics, exposure must also be defined on a meaningful scale for the clinical question.

Definition: A count outcome \(Y\) takes nonnegative integer values. Its rate is the expected number of events per unit of observation time. A log-time offset is the known term \(\log(T)\), where \(T\) is positive observation time; its coefficient is fixed at 1 so that the expected count is proportional to time, conditional on the modeled rate.

Poisson Exposure–Response Model

Let \(Y_{ij}\) be the count for person \(j\) during observation interval \(i\), \(T_{ij}\) the interval’s observed time in a chosen unit, and \(x_{ij}\) the exposure metric. A basic model is

$$ Y_{ij}\mid x_{ij},T_{ij}\sim \operatorname{Poisson}(\mu_{ij}),\qquad \log(\mu_{ij})=\log(T_{ij})+\beta_0+\beta_E x_{ij}+\boldsymbol{\gamma}^{\mathsf T}\mathbf{z}_{ij}. $$

Here, \(\mu_{ij}\) is the conditional expected count, \(\mathbf{z}_{ij}\) contains other modeled covariates, and \(\beta_0,\beta_E,\boldsymbol{\gamma}\) are coefficients. The term \(\log(T_{ij})\) is an offset, not an estimated covariate effect. Equivalently, the expected rate per unit time is

$$ \frac{\mu_{ij}}{T_{ij}} =\exp\!\left(\beta_0+\beta_E x_{ij}+\boldsymbol{\gamma}^{\mathsf T}\mathbf{z}_{ij}\right). $$

For a one-unit increase in exposure, holding the other modeled variables fixed, the rate ratio is \(\exp(\beta_E)\). If exposure is rescaled, the coefficient and its interpretation change accordingly. State the exposure unit when reporting a rate ratio. For an outcome such as exacerbation counts, a rate ratio below 1 means fewer expected events per unit time at higher exposure; it does not itself establish that exposure caused the reduction.

The Poisson model assumes that, conditional on the modeled variables, each count has mean \(\mu_{ij}\) and variance \(\mu_{ij}\). A common likelihood specification also treats the observations as conditionally independent. The offset assumes that the expected count grows in direct proportion to observation time, with the modeled rate otherwise constant within that interval. Intervals with zero observed time do not provide a rate and cannot be included by taking \(\log(0)\).

Worked Example: Interpreting an Exposure Rate Ratio

Suppose a hypothetical model for exacerbation counts uses weeks as the time unit and defines \(x\) in units of 10 exposure units. Its fitted rate equation is \(\log(\mu/T)=\log(0.30)-0.30x\). Predict counts for two people: A has \(x=2\) and four weeks of observation; B has \(x=4\) and six weeks.

For A, the fitted rate is \(0.30\exp(-0.30\times2)=0.1646\) exacerbations per week. Thus the expected count is \(4\times0.1646=0.6584\) exacerbations over four weeks.

For B, the fitted rate is \(0.30\exp(-0.30\times4)=0.09036\) exacerbations per week. The expected count is \(6\times0.09036=0.5422\) over six weeks. These are expected values, so they need not be integers.

The rate ratio for a one-unit increase in \(x\) is \(\exp(-0.30)=0.7408\): the model associates each additional 10 exposure units with a 25.9% lower exacerbation rate, conditional on the included variables. B’s expected total count is not a direct comparison of exposure effects because B also has longer observation time.

Why the Offset Matters

Fixing the coefficient of \(\log(T)\) at 1 states a specific assumption: doubling observation time doubles the expected count when the event rate is unchanged. It is usually appropriate when observation time represents opportunity to experience events and the rate is expected to be stable within the modeled interval. It is not a substitute for handling changing rates. If the rate changes over time, the interval may need to be divided or its predictors specified to represent that change.

Treating time as an ordinary covariate would estimate its coefficient rather than enforce proportionality. That can be useful if the scientific question is whether count accumulation scales with time in a non-proportional way, but it is not the standard rate model. Omitting time altogether instead compares expected counts as if every observation had equal duration.

Worked Example: Same Rate, Unequal Follow-Up

Use the rate equation from the previous example for two hypothetical participants, each with \(x=3\), but with two and eight weeks of observation. The fitted rate for either participant is

$$ 0.30\exp(-0.30\times3)=0.12197 \quad\text{exacerbations per week}. $$

With the offset, the expected counts are \(2\times0.12197=0.2439\) over two weeks and \(8\times0.12197=0.9758\) over eight weeks. The expected count is four times as large for the participant observed four times as long, while the estimated rate is the same.

Without the time term, the model would assign the same expected count to these participants if their other predictors were identical. That would misrepresent the unequal opportunity to experience events. The proportional-time assumption should still be checked clinically: it can fail, for example, if rates systematically rise during follow-up.

Negative-Binomial Counts and Overdispersion

Real count data may vary more than the Poisson model permits. Conditional heterogeneity between people or intervals can produce a variance greater than the mean, even when the average rate is modeled correctly. One standard approach is the negative-binomial model. The parameterization below uses \(\kappa>0\) as a dispersion parameter:

$$ \operatorname{E}(Y_{ij}\mid\cdot)=\mu_{ij},\qquad \operatorname{Var}(Y_{ij}\mid\cdot)=\mu_{ij}+\frac{\mu_{ij}^{2}}{\kappa}. $$

The log-mean equation can use the same exposure terms and offset as the Poisson model. The negative-binomial probability for a count \(y=0,1,2,\ldots\) is

$$ P(Y=y\mid\mu,\kappa)= \frac{\Gamma(y+\kappa)}{\Gamma(\kappa)y!} \left(\frac{\kappa}{\kappa+\mu}\right)^\kappa \left(\frac{\mu}{\kappa+\mu}\right)^y. $$

Here, \(\Gamma\) is the gamma function. Smaller \(\kappa\) allows greater extra-Poisson variability; as \(\kappa\) grows without bound, the variance approaches \(\mu\) and the model approaches Poisson. This parameterization is equivalent to mixing Poisson rates over a gamma distribution, which gives a direct explanation for the additional variance.

Justification: A Gamma–Poisson Mixture

To see the variance result, let the count \(Y\), conditional on a latent rate \(\Lambda\), follow a Poisson distribution with mean \(\Lambda\). Suppose \(\Lambda\) has a gamma distribution with shape \(\kappa\) and rate \(\kappa/\mu\). This gives \(\operatorname{E}(\Lambda)=\mu\) and \(\operatorname{Var}(\Lambda)=\mu^2/\kappa\). By the laws of total expectation and variance,

$$ \operatorname{E}(Y)=\operatorname{E}\{\operatorname{E}(Y\mid\Lambda)\} =\operatorname{E}(\Lambda)=\mu, $$
$$ \operatorname{Var}(Y) =\operatorname{E}\{\operatorname{Var}(Y\mid\Lambda)\} +\operatorname{Var}\{\operatorname{E}(Y\mid\Lambda)\} =\operatorname{E}(\Lambda)+\operatorname{Var}(\Lambda) =\mu+\frac{\mu^2}{\kappa}. $$

Thus, gamma variation in the latent rate adds variance beyond the conditional Poisson variance. The mixture motivates the negative-binomial distribution; it does not prove that gamma heterogeneity is the true biological mechanism in a particular study.

Worked Example: Quantifying Extra-Poisson Variability

For a hypothetical interval, suppose the fitted mean count is \(\mu=3\) exacerbations and the negative-binomial dispersion parameter is \(\kappa=2\). The variance is

$$ 3+\frac{3^2}{2}=7.5, \qquad \operatorname{SD}(Y)=\sqrt{7.5}=2.739. $$

A Poisson model with the same mean would have variance 3 and standard deviation \(\sqrt{3}=1.732\). The negative-binomial model therefore allows more spread around the same fitted mean.

The probability of zero events under this negative-binomial parameterization is \(P(Y=0)=(2/(2+3))^2=0.1600\). Under the Poisson model it would be \(\exp(-3)=0.04979\). This difference illustrates how overdispersion can raise the probability of zero counts as well as allow a heavier upper tail. It does not mean every observed excess of zeros is adequately explained by a negative-binomial model.

Estimation, Interpretation, and Model Checks

Model coefficients are commonly estimated by maximum likelihood. For a fitted exposure coefficient \(\hat{\beta}_E\), an approximate confidence interval can be formed on the log-rate-ratio scale as \(\hat{\beta}_E\pm1.96\,SE(\hat{\beta}_E)\), then exponentiated to give an interval for the rate ratio. This approximation relies on the estimate being sufficiently close to normally distributed; the interval describes uncertainty under the fitted model and its assumptions.

Worked Example: Rate Ratio and Confidence Interval

Suppose a hypothetical negative-binomial model estimates \(\hat{\beta}_E=-0.18\) per 10 exposure units, with \(SE(\hat{\beta}_E)=0.07\). The estimated rate ratio is \(\exp(-0.18)=0.8353\). The approximate 95% interval on the coefficient scale is

$$ -0.18\pm1.96(0.07)=[-0.3172,-0.0428]. $$

Exponentiating the endpoints gives a rate-ratio interval of \([\exp(-0.3172),\exp(-0.0428)]=[0.7282,0.9581]\). Under this model, each additional 10 exposure units is associated with an estimated 16.5% lower event rate; the interval corresponds to reductions of approximately 4.19% to 27.2%. Because the interval excludes 1, it is inconsistent with a zero coefficient at the approximate two-sided 5% level under the stated model. Causal interpretation still depends on the exposure–response assumptions.

Useful checks focus on whether the fitted distribution and rate structure represent the data. Compare observed counts with model-predicted counts across fitted-mean and exposure ranges; examine the frequency of zeros and the upper tail; and check whether observed counts scale plausibly with time. For a Poisson fit, the Pearson statistic divided by its residual degrees of freedom can give a rough indication of extra dispersion: values substantially above 1 merit investigation, not automatic replacement of the model. Also consider whether repeated intervals from the same person remain dependent after conditioning on included variables. A negative-binomial variance addresses extra variation in counts, but does not by itself remove arbitrary within-person correlation or repair a misspecified mean.

Choosing Among Count Models

ApproachWhat it modelsMain caution
Poisson regressionCount mean with variance equal to the mean; can include a log-time offset.Extra-Poisson variation can make model-based uncertainty too small and predicted tails too light.
Negative-binomial regressionThe same kind of log-mean relation, with variance \(\mu+\mu^2/\kappa\).Extra dispersion is not a general solution to dependence, excess structural zeros, or a wrong mean model.
Quasi-Poisson or robust variance approachCan adjust uncertainty for overdispersion while retaining a specified mean relation.Does not provide the same full count probability model for likelihood-based prediction.
Hurdle or zero-inflated modelSeparates a zero-generating process from a count process under additional assumptions.More complexity is justified only when the data-generating structure and scientific question support it.

These approaches answer related but not identical questions. If the objective includes predicting the full count distribution, the negative-binomial likelihood may be preferable to a variance adjustment alone. If the scientific process plausibly distinguishes people who can experience events from those who cannot during the interval, a separate zero process may be considered. Neither model selection nor an improved statistical fit establishes that an exposure coefficient is causal.

Common Pitfalls and Limitations

  • Comparing raw counts with unequal follow-up. A larger count may simply reflect longer observation. Include the time offset when proportional accumulation is appropriate, and report rates as well as expected counts.
  • Estimating the offset coefficient by accident. In a rate model, \(\log(T)\) has a fixed coefficient of 1. Estimating it changes the assumption about how event counts accumulate over time.
  • Assuming the negative binomial solves every fit problem. It allows a particular mean–variance relationship. It cannot automatically correct time-varying rates, omitted exposure confounders, within-person dependence, or an incorrect exposure metric.
  • Calling a rate ratio a causal effect. The coefficient is conditional on the model. Confounding, measurement error, selection, and other exposure–response assumptions still matter.

Both Poisson and negative-binomial models can be limited when event rates vary sharply over follow-up, observation time is informative, or individuals contribute correlated intervals. They also presume that the chosen covariates and exposure summary adequately describe the mean rate. Model-based predictions should therefore be reported with their time window, exposure scale, and assumptions made explicit.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. A Poisson model has \(\hat{\beta}_E=0.20\) per 5 exposure units. What is the rate ratio for a 5-unit increase?
  2. At an unchanged fitted rate of 0.4 events per week, what expected count does the offset model give over 3 weeks?
  3. For a negative-binomial mean of 4 and \(\kappa=4\), calculate the variance.
  4. Why can a negative-binomial model still be inadequate if the rate rises systematically during follow-up?

Solutions. (1) \(\exp(0.20)=1.221\), so the modeled rate is 22.1% higher per 5-unit increase, conditional on the other variables. (2) \(3\times0.4=1.2\) expected events. (3) \(4+4^2/4=8\). (4) The negative-binomial model changes the variance specification, but does not represent a time-varying mean rate unless that structure is explicitly modeled; the offset alone assumes proportional accumulation at a stable conditional rate.