Tutorials › Statistical Theory II - Mathematical Statistics and Statistical Inference › The Square-Root Transformation for Poisson Rates

Variance-Stabilizing Transformations and Inference · Tutorial 830 of 970

The Square-Root Transformation for Poisson Rates

Learn why the square-root scale stabilizes Poisson rate uncertainty and how to form, interpret, and check an approximate interval on the original rate scale.

Intermediate 9 min read

What You'll Learn

  • Derive the square-root variance stabilizer from the Poisson rate variance function
  • Relate the total count and exposure to the maximum likelihood rate estimate
  • Obtain the asymptotic normal approximation on the transformed scale
  • Construct and back-transform a two-sided approximate confidence interval
  • Handle a zero observed count without making an interior-parameter MLE claim
  • Recognize when a transformed interval may be unreliable in finite samples

Why a Poisson Rate Needs a Different Scale

A Poisson count has variance equal to its mean. Consequently, the variability of a rate estimate depends on the unknown rate itself: rates with larger values have larger standard errors. A transformation can make this changing uncertainty approximately constant, which gives a useful scale for normal approximation and interval construction.

For a Poisson rate, the resulting transformation is a square root. The derivation is simple, but its interpretation matters: the transformed estimate is approximately normal when the total exposure grows and the true rate is positive. It does not make every finite-sample Poisson distribution normal, especially when counts are small.

Poisson Counts and the Rate Estimate

Suppose independent counts \(X_1,\ldots,X_n\) are observed over known exposures \(t_1,\ldots,t_n\), where \(X_i\sim\operatorname{Pois}(t_i\lambda)\) and \(\lambda\geq 0\) is the rate per unit of exposure. Write \(T=\sum_{i=1}^n t_i\) for total exposure and \(Y=\sum_{i=1}^n X_i\) for the total count. Then \(Y\sim\operatorname{Pois}(T\lambda)\), and the rate estimate is \(\hat{\lambda}=Y/T\) when \(T>0\).

The likelihood, up to factors that do not depend on \(\lambda\), is \(L(\lambda)=e^{-T\lambda}\lambda^Y\). For \(Y>0\), differentiating the log-likelihood gives \(Y/\lambda-T=0\), so the maximum occurs at \(\hat{\lambda}=Y/T\). If \(Y=0\), the likelihood is \(e^{-T\lambda}\), which is maximized at \(\lambda=0\) when the parameter space includes zero. If instead the parameter space is restricted to \(\lambda>0\), the likelihood has a supremum as \(\lambda\) decreases to zero but no maximizer. The zero-count case must therefore be treated as a boundary estimate, not as an interior MLE.

Definition: A variance-stabilizing transformation for an estimator is a function \(g\) for which the variance of \(g(\hat{\lambda})\) is approximately constant, at least to the order of approximation under consideration. Here the relevant approximation is the first-order delta method, and the Poisson rate estimate has variance \(\operatorname{Var}(\hat{\lambda})=\lambda/T\).

Deriving the Square-Root Transformation

For a differentiable function \(g\), the first-order delta method approximates the variance of \(g(\hat{\lambda})\) by \(g'(\lambda)^2\operatorname{Var}(\hat{\lambda})\). To make this approximately independent of \(\lambda\), choose \(g\) so that \(g'(\lambda)^2\lambda\) is constant. Taking the positive root gives a differential equation whose solution is proportional to \(\sqrt{\lambda}\).

$$ \operatorname{Var}\{g(\hat{\lambda})\} \approx g'(\lambda)^2\frac{\lambda}{T}, \qquad g'(\lambda)^2\lambda=c \quad\Longrightarrow\quad g'(\lambda)=\frac{\sqrt{c}}{\sqrt{\lambda}}, \qquad g(\lambda)=2\sqrt{c}\sqrt{\lambda}+C. $$

The multiplicative constant and additive constant do not affect whether the variance is constant. The conventional choice \(g(\lambda)=2\sqrt{\lambda}\) makes the approximate variance equal to \(1/T\). Equivalently, \(\sqrt{\lambda}\) has approximate variance \(1/(4T)\). We use \(2\sqrt{\lambda}\) below because its standard error has the simple form \(1/\sqrt{T}\).

Result: For \(T\lambda\) growing with \(T\), the transformed rate estimate satisfies \( \sqrt{T}\{2\sqrt{\hat{\lambda}}-2\sqrt{\lambda}\}\xrightarrow{d}N(0,1) \) when \(\lambda>0\) is fixed. Thus \(2\sqrt{\hat{\lambda}}\) is approximately normal with mean \(2\sqrt{\lambda}\) and standard error \(1/\sqrt{T}\), to first order.

To justify the result, use \(Y\sim\operatorname{Pois}(T\lambda)\). For fixed \(\lambda>0\), the Poisson central limit theorem gives \((Y-T\lambda)/\sqrt{T\lambda}\xrightarrow{d}N(0,1)\) as \(T\) increases. Since \(\hat{\lambda}=Y/T\), the scalar delta method applied to \(g(u)=2\sqrt{u}\), whose derivative at \(\lambda\) is \(1/\sqrt{\lambda}\), yields

$$ \sqrt{T}\{g(\hat{\lambda})-g(\lambda)\} = \sqrt{T}\left\{\frac{\hat{\lambda}-\lambda}{\sqrt{\lambda}}+ o_p(|\hat{\lambda}-\lambda|)\right\} \xrightarrow{d}N(0,1). $$

The first-order term equals \((Y-T\lambda)/\sqrt{T\lambda}\), and the remainder is negligible by consistency of \(\hat{\lambda}\) and differentiability of \(g\) at the positive value \(\lambda\). This argument requires a fixed positive rate and increasing total exposure; it does not establish a normal limit at the boundary \(\lambda=0\). \(\square\)

Worked Example: Finding the Stabilizer From the Rate Variance

Suppose the rate estimate is based on total exposure \(T=16\), and its variance is \(\lambda/16\). Find a transformation with first-order variance \(1/16\).

For a differentiable transformation \(g\), the delta-method variance is approximately \(g'(\lambda)^2\lambda/16\). Setting this equal to \(1/16\) requires \(g'(\lambda)^2\lambda=1\). Taking the positive derivative gives \(g'(\lambda)=1/\sqrt{\lambda}\), so integration yields \(g(\lambda)=2\sqrt{\lambda}+C\). Choose \(C=0\).

Therefore the transformed estimate is \(2\sqrt{\hat{\lambda}}\), with approximate variance \(1/16\) and standard error \(1/4=0.25\). The same calculation works for any positive total exposure \(T\): the transformed variance is approximately \(1/T\).

Constructing and Back-Transforming the Interval

Let \(z_{1-\alpha/2}\) be the \(1-\alpha/2\) quantile of the standard normal distribution. On the transformed scale, the approximate two-sided confidence interval for \(2\sqrt{\lambda}\) is centered at \(2\sqrt{\hat{\lambda}}\), with margin \(z_{1-\alpha/2}/\sqrt{T}\). The map \(g(\lambda)=2\sqrt{\lambda}\) is increasing for \(\lambda\geq0\), so its limits can be inverted directly. A negative lower limit on the transformed scale is replaced by zero, since the parameter is nonnegative.

$$ \left[ \max\left\{0,\ 2\sqrt{\hat{\lambda}}-\frac{z_{1-\alpha/2}}{\sqrt{T}}\right\}, \quad 2\sqrt{\hat{\lambda}}+\frac{z_{1-\alpha/2}}{\sqrt{T}} \right] $$

Squaring each endpoint and dividing by four gives the interval on the rate scale:

$$ \left[ \frac{1}{4}\left\{\max\left(0,\ 2\sqrt{\hat{\lambda}}-\frac{z_{1-\alpha/2}}{\sqrt{T}}\right)\right\}^{2}, \quad \frac{1}{4}\left(2\sqrt{\hat{\lambda}}+\frac{z_{1-\alpha/2}}{\sqrt{T}}\right)^{2} \right]. $$

The interval is approximate, not an exact Poisson interval. Its asymptotic coverage follows from the transformed normal limit: the event that the true transformed parameter lies between the transformed limits is the event that the absolute value of the standardized transformed error is at most \(z_{1-\alpha/2}\). The limiting probability of this event is \(1-\alpha\). Since the transformation is increasing and the true rate is nonnegative, clipping a negative lower endpoint to zero does not remove the true parameter from the interval.

Worked Example: A 95% Interval With Moderate Counts

A process produces \(Y=18\) events over \(T=20\) units of exposure. Estimate the rate and construct the square-root 95% interval. Use \(z_{0.975}=1.96\).

The rate estimate is \(\hat{\lambda}=18/20=0.9\). The transformed estimate is \(2\sqrt{0.9}\approx1.89737\), and the transformed standard error is \(1/\sqrt{20}\approx0.22361\). The 95% margin is \(1.96/\sqrt{20}\approx0.43827\).

The transformed endpoints are \(1.89737-0.43827=1.45910\) and \(1.89737+0.43827=2.33564\). Both are nonnegative. Back-transforming gives

$$ \left[\frac{1.45910^2}{4},\frac{2.33564^2}{4}\right] \approx [0.5322,\ 1.3638]. $$

Thus the approximate 95% interval is about \(0.532\) to \(1.364\) events per exposure unit. The endpoints are not symmetric around \(0.9\), because squaring the symmetric transformed limits is nonlinear.

Worked Example: A Zero Count and a Boundary Estimate

Suppose \(Y=0\) events are observed over \(T=10\) units of exposure. Find the rate estimate and the square-root 95% interval.

With the parameter space \(\lambda\geq0\), the likelihood is \(e^{-10\lambda}\), so its maximum is at the boundary \(\hat{\lambda}=0\). The transformed center is \(2\sqrt{0}=0\), and the 95% margin is \(1.96/\sqrt{10}\approx0.61984\). The transformed interval, after respecting the nonnegative parameter space, is \([0,0.61984]\).

The rate-scale interval is therefore

$$ \left[0,\frac{0.61984^2}{4}\right] = \left[0,\frac{1.96^2}{4(10)}\right] = [0,0.09604]. $$

This is the formula produced by the transformed normal approximation, not a claim that the zero-count sampling distribution is normal. When expected counts are small, including in this example, asymptotic coverage can be poor; the interval should be interpreted with that limitation in mind.

Worked Example: Comparing With a Plug-In Wald Interval

Now suppose \(Y=3\) events are observed over \(T=25\) units of exposure. Compare the 95% square-root interval with the usual first-order Wald interval based on the estimated standard error of \(\hat{\lambda}\).

The estimate is \(\hat{\lambda}=3/25=0.12\). The plug-in standard error is \(\sqrt{\hat{\lambda}/T}=\sqrt{0.12/25}\approx0.06928\). The Wald limits are \(0.12\pm1.96(0.06928)\), or approximately \([-0.0158,0.2558]\). Since a rate cannot be negative, one might truncate the lower endpoint to zero, giving \([0,0.2558]\).

For the transformed interval, the center is \(2\sqrt{0.12}\approx0.69282\), and the margin is \(1.96/\sqrt{25}=0.392\). The transformed limits are \(0.30082\) and \(1.08482\). Squaring and dividing by four gives

$$ \left[\frac{0.30082^2}{4},\frac{1.08482^2}{4}\right] \approx[0.0226,\ 0.2942]. $$

The square-root interval is asymmetric and remains within the parameter space without truncating its rate-scale endpoints. It also differs from the truncated Wald interval; neither calculation alone guarantees accurate finite-sample coverage when the count is small.

Interpretation and Common Pitfalls

The square-root transformation is useful because it addresses the rate dependence of the first-order variance. It gives a natural approximate interval whose lower endpoint cannot be negative and whose uncertainty is measured on a scale with approximately constant variance. It is not a correction that makes every Poisson problem normal, nor is it an exact confidence procedure.

  • Using the untransformed standard error after transforming. The original-scale standard error \(\sqrt{\hat{\lambda}/T}\) is not the standard error of \(2\sqrt{\hat{\lambda}}\). On the transformed scale, the first-order standard error is \(1/\sqrt{T}\).
  • Forgetting the inverse transformation. The transformed endpoints are endpoints for \(2\sqrt{\lambda}\), not for \(\lambda\). Invert by squaring and dividing by four.
  • Claiming an interior MLE at zero counts. If \(\lambda>0\) is imposed, \(Y=0\) yields no attained maximum. Include \(\lambda=0\) to call zero the MLE, or describe it as the boundary supremum estimate under the restricted parameter space.
  • Assuming asymptotic validity ensures good small-sample coverage. The normal limit is for fixed \(\lambda>0\) with increasing exposure. A small observed count can be a warning that the approximation is rough.

A useful check is to verify units and scale: \(\hat{\lambda}\) is a rate, \(T\) is exposure, and the transformed-scale margin depends on \(T\) as \(1/\sqrt{T}\). After inversion, both interval endpoints are nonnegative and expressed in the same rate units as \(\hat{\lambda}\).

Check Your Understanding

Use the definitions and derivations above to answer the following questions.

  1. Starting from \(\operatorname{Var}(\hat{\lambda})=\lambda/T\), derive a transformation whose first-order transformed variance is \(1/T\).
  2. For \(Y=12\) events over \(T=30\) units, what is the rate estimate and the standard error on the \(2\sqrt{\lambda}\) scale?
  3. Why does a zero count produce a boundary MLE when the parameter space is \(\lambda\geq0\), but no MLE when the parameter space is \(\lambda>0\)?
  4. Write the back-transformation of a transformed lower endpoint \(a\geq0\) into a rate endpoint.
  5. State the asymptotic regime required for the transformed normal approximation and one reason to be cautious with a small count.
Clinical Biostats