Tutorials › Generalized Linear Models › Inverse-Gaussian Mean-Dispersion Representation

Exponential-Family Representation · Tutorial 35 of 981

Inverse-Gaussian Mean-Dispersion Representation

Learn to rewrite and check the inverse-Gaussian density in exponential-dispersion form, including its canonical parameter, log-partition function, and carrier term.

Beginner 10 min read

What You'll Learn

  • Expand the inverse-Gaussian density without losing its dispersion factors
  • Identify the canonical parameter and express the log-partition function in terms of it
  • Separate parameter-dependent terms from the carrier term
  • Distinguish the finite-mean parameter range from the boundary of the finite-normalizer domain
  • Check the factorization with numerical examples and a normalization argument

Why this representation matters

A probability density can look very different from the exponential-dispersion form used to organize generalized linear models. Rewriting a familiar density in that form is not just a change of notation: it makes clear which part depends on the response, which part carries the mean parameter, and where the dispersion parameter enters. Here we derive that representation for the inverse-Gaussian distribution, keeping track of the support and every normalization factor.

We use \(Y\) for the response, \(\mu>0\) for its mean parameter, and \(\phi>0\) for its dispersion. The inverse-Gaussian density is defined on \(y>0\). In the exponential-dispersion convention, we seek to write it as \(\exp\{[y\theta-b(\theta)]/\phi+c(y,\phi)\}\). The task is to identify each component from the density, rather than infer them by analogy with another distribution.

Definition: In this tutorial, the inverse-Gaussian distribution with mean parameter \(\mu>0\) and dispersion \(\phi>0\) has density $$ f(y;\mu,\phi)=\frac{1}{\sqrt{2\pi\phi y^3}}\exp\!\left\{-\frac{(y-\mu)^2}{2\phi\mu^2y}\right\},\qquad y>0. $$ It is zero for \(y\leq 0\). Its exponential-dispersion representation has the form $$ f(y;\theta,\phi)=\exp\!\left\{\frac{y\theta-b(\theta)}{\phi}+c(y,\phi)\right\}. $$ Here \(\theta\) is the canonical parameter, \(b(\theta)\) is the log-partition function, and \(c(y,\phi)\) is the carrier term.

Deriving the components

The essential step is to expand the quadratic expression in the exponent. Since \(y>0\) and \(\mu>0\), division by \(y\) and by \(\mu^2\) is valid:

$$ -\frac{(y-\mu)^2}{2\phi\mu^2y} =-\frac{y}{2\phi\mu^2}+\frac{1}{\phi\mu}-\frac{1}{2\phi y}. $$

The first two terms depend on the response through the term proportional to \(y\), and on the parameter through \(\mu\). To match the specified exponential-dispersion form, set \(\theta=-1/(2\mu^2)\). Then the response-dependent term is \(y\theta/\phi\). The remaining mean-dependent term must equal \(-b(\theta)/\phi\), so \(b(\theta)=-1/\mu\). Because \(-2\theta=1/\mu^2\) and \(\mu>0\), this is equivalently \(b(\theta)=-\sqrt{-2\theta}\).

The density prefactor and the remaining term involving \(y\) do not depend on \(\mu\), so they belong in the carrier. In particular, the factor \(1/\sqrt{2\pi\phi y^3}\) contributes its logarithm to \(c(y,\phi)\). This gives the following complete factorization.

Result: For \(\mu>0\) and \(\phi>0\), the inverse-Gaussian density has exponential-dispersion components $$ \theta=-\frac{1}{2\mu^2},\qquad b(\theta)=-\sqrt{-2\theta},\qquad c(y,\phi)=-\frac{1}{2\phi y}-\frac{1}{2}\log(2\pi\phi y^3),\quad y>0. $$ Thus \(\theta<0\) for every finite positive \(\mu\), and the representation is $$ f(y;\theta,\phi)=\exp\!\left\{\frac{y\theta+\sqrt{-2\theta}}{\phi}-\frac{1}{2\phi y}-\frac{1}{2}\log(2\pi\phi y^3)\right\},\qquad y>0. $$

The algebra can be checked by expanding the proposed representation back into the original density. Since \(\sqrt{-2\theta}=1/\mu\), its exponent apart from the logarithmic prefactor is

$$ \frac{y\theta+\sqrt{-2\theta}}{\phi}-\frac{1}{2\phi y} =-\frac{y}{2\phi\mu^2}+\frac{1}{\phi\mu}-\frac{1}{2\phi y} =-\frac{(y-\mu)^2}{2\phi\mu^2y}. $$

Also, exponentiating the carrier’s logarithmic term gives \((2\pi\phi y^3)^{-1/2}\). These two checks recover both the exponent and the prefactor of the stated density.

Worked Example: Factoring a Density at a Specific Mean

Take \(\mu=2\), \(\phi=1/2\), and evaluate the density at \(y=3/2\). First, the original density has prefactor $$ \frac{1}{\sqrt{2\pi(1/2)(3/2)^3}}=\sqrt{\frac{8}{27\pi}}. $$ Its exponent is $$ -\frac{(3/2-2)^2}{2(1/2)(2^2)(3/2)} =-\frac{1/4}{6}=-\frac{1}{24}. $$ Therefore \(f(3/2;2,1/2)=\sqrt{8/(27\pi)}\,e^{-1/24}\).

For the exponential-dispersion form, \(\theta=-1/(2\cdot 2^2)=-1/8\) and \(b(\theta)=-\sqrt{1/4}=-1/2\). The parameter-dependent term is $$ \frac{y\theta-b(\theta)}{\phi} =\frac{(3/2)(-1/8)+1/2}{1/2} =\frac{5}{8}. $$ The carrier at this response and dispersion is $$ c(3/2,1/2)=-\frac{1}{2(1/2)(3/2)}-\frac{1}{2}\log\!\left(2\pi(1/2)(3/2)^3\right) =-\frac{2}{3}-\frac{1}{2}\log(27\pi/8). $$ Adding the non-logarithmic exponent contributions gives \(5/8-2/3=-1/24\), and the exponential of the logarithmic contribution is \(\sqrt{8/(27\pi)}\). The representation therefore agrees exactly with the original density.

Parameter domain and normalization

The finite-mean inverse-Gaussian family has \(\theta<0\), since \(\theta=-1/(2\mu^2)\) and \(\mu\) is finite and positive. Conversely, every \(\theta<0\) determines a unique positive finite mean parameter:

$$ \mu=\frac{1}{\sqrt{-2\theta}}. $$

There is a boundary distinction worth making. If one asks for the largest set of \(\theta\) values for which the normalizing integral with this carrier is finite, the endpoint \(\theta=0\) is included. It gives a normalized boundary density, but not a member with finite \(\mu\): the inverse relation would require \(\mu\) to diverge. For \(\theta>0\), the integral diverges because the factor \(e^{y\theta/\phi}\) grows exponentially as \(y\) increases, whereas the carrier decreases only as a power of \(y\). Thus \(\theta<0\) is the parameter range corresponding to finite positive means, while \(\theta\leq 0\) is the finite-normalizer range for this carrier.

The factorization also has to integrate to one. The following calculation verifies the normalizer directly and shows why the square-root expression in \(b(\theta)\) is required. For \(a>0\) and \(d>0\), use the integral identity

$$ \int_0^\infty y^{-3/2}e^{-ay-d/y}\,dy =\sqrt{\frac{\pi}{d}}\,e^{-2\sqrt{ad}}. $$

To verify the identity, substitute \(y=d/t^2\). Reversing the bounds after substitution gives $$ \int_0^\infty y^{-3/2}e^{-ay-d/y}\,dy =\frac{2}{\sqrt d}J(\sqrt{ad}),\qquad J(r)=\int_0^\infty e^{-t^2-r^2/t^2}\,dt. $$ For \(r>0\), differentiation under the integral is valid on every compact interval of positive \(r\): the integrand and its derivative are bounded near \(t=0\) by a constant times a power of \(1/t\) times \(e^{-r_0^2/t^2}\), and near infinity by a polynomial times \(e^{-t^2}\), where \(r_0\) is the interval’s positive lower endpoint. Differentiating and then substituting \(u=r/t\) in the resulting integral gives

$$ J'(r)=-2r\int_0^\infty t^{-2}e^{-t^2-r^2/t^2}\,dt=-2J(r). $$

As \(r\) decreases to zero, dominated convergence applies because \(0\leq e^{-t^2-r^2/t^2}\leq e^{-t^2}\), an integrable function on \((0,\infty)\). Hence \(J(0+)=\int_0^\infty e^{-t^2}\,dt=\sqrt{\pi}/2\). Solving \(J'(r)=-2J(r)\) with this limit yields \(J(r)=(\sqrt{\pi}/2)e^{-2r}\), which proves the identity.

Now set \(a=-\theta/\phi\) and \(d=1/(2\phi)\), both positive when \(\theta<0\). The density in the proposed representation is $$ \frac{e^{\sqrt{-2\theta}/\phi}}{\sqrt{2\pi\phi}}\, y^{-3/2}\exp\!\left\{-\frac{-\theta}{\phi}y-\frac{1}{2\phi y}\right\}. $$ The integral identity says that the integral of the \(y\)-dependent factor \(y^{-3/2}\exp\{-ay-d/y\}\) is \(\sqrt{2\pi\phi}\exp\{-\sqrt{-2\theta}/\phi\}\). Multiplying by the displayed leading factor gives one. Therefore the proposed log-partition term does normalize the density for every \(\theta<0\).

What the domain check establishes: The log-partition function in this representation is \(b(\theta)=-\sqrt{-2\theta}\) on the finite-mean range \(\theta<0\). The integral check verifies normalization without treating an algebraic rearrangement alone as proof that the result is a density.

Worked checks and a common pitfall

Worked Example: Recovering the Mean Parameter from \(\theta\)

Suppose \(\theta=-2\) and \(\phi=3\). Since \(\theta=-1/(2\mu^2)\), solving for the positive mean parameter gives $$ \mu=\frac{1}{\sqrt{-2(-2)}}=\frac{1}{2}. $$ The log-partition value is \(b(-2)=-\sqrt{4}=-2\). At \(y=2\), the parameter-dependent part of the log density is $$ \frac{y\theta-b(\theta)}{\phi} =\frac{2(-2)-(-2)}{3}=-\frac{2}{3}. $$ The remaining exponent from the carrier is \(-1/(2\cdot3\cdot2)=-1/12\), and its logarithmic prefactor is \(-\tfrac12\log(2\pi\cdot3\cdot2^3)=-\tfrac12\log(48\pi)\). Thus the density is \(e^{-3/4}/\sqrt{48\pi}\). Direct substitution into the original density gives exponent \(-(2-1/2)^2/[2\cdot3\cdot(1/2)^2\cdot2]=-3/4\) and the same prefactor.

Worked Example: Checking the Carrier at a Small Response

Let \(\mu=1\), \(\phi=2\), and \(y=1/2\). The original density has prefactor $$ \frac{1}{\sqrt{2\pi(2)(1/2)^3}}=\sqrt{\frac{2}{\pi}}, $$ and exponent $$ -\frac{(1/2-1)^2}{2(2)(1^2)(1/2)}=-\frac{1}{8}. $$ For the representation, \(\theta=-1/2\), \(b(\theta)=-1\), and the parameter-dependent exponent is \([ (1/2)(-1/2)-(-1)]/2=3/8\). The carrier contributes \(-1/[2(2)(1/2)]=-1/2\) outside its logarithmic term, so the total non-logarithmic exponent is \(3/8-1/2=-1/8\). Its logarithmic prefactor is \(-\tfrac12\log(2\pi\cdot2\cdot(1/2)^3)=\tfrac12\log(2/\pi)\). The result is precisely \(\sqrt{2/\pi}\,e^{-1/8}\), as required.

A frequent mistake is to omit the dispersion factor when expanding the exponent. The constant term is \(1/(\phi\mu)\), not \(1/\mu\); omitting \(\phi\) prevents the expression from matching \(-b(\theta)/\phi\). Another mistake is to put \(-1/(2\phi y)\) into the log-partition function. That term depends on the observed response \(y\), so it belongs in the carrier, which may depend on \(y\) and \(\phi\) but not on the mean parameter. Finally, the factor \(y^{-3/2}\) in the density is part of the carrier’s logarithmic term; dropping it changes the density and destroys normalization.

1
Expand the exponent.
Separate the terms proportional to \(y\), depending on \(\mu\) alone, and depending on \(y\) alone.
2
Match the exponential-dispersion form.
Read off \(\theta=-1/(2\mu^2)\), then express the mean-only term as \(-b(\theta)/\phi\).
3
Collect the carrier.
Keep the response-dependent term \(-1/(2\phi y)\) and the density prefactor together in \(c(y,\phi)\).
4
Check both parts.
Expand the representation to recover the original exponent, then verify that the proposed density integrates to one.
Key takeaway: In the inverse-Gaussian mean-dispersion representation, \(\theta=-1/(2\mu^2)\), \(b(\theta)=-\sqrt{-2\theta}\), and \(c(y,\phi)=-1/(2\phi y)-\tfrac12\log(2\pi\phi y^3)\) for \(y>0\). Keeping the carrier distinct from the log-partition term is essential for a correct density.

Check Your Understanding

Use the density and representation in this tutorial to answer the following.

  1. Expand the inverse-Gaussian exponent and identify the term that determines \(\theta\).
  2. For \(\mu=3\), calculate \(\theta\) and \(b(\theta)\).
  3. Explain why \(-1/(2\phi y)\) belongs in the carrier rather than the log-partition function.
  4. For which values of \(\theta\) does this representation correspond to a finite positive mean \(\mu\)?
  5. What goes wrong with the density factorization if the term \(y^{-3/2}\) is omitted?
Clinical Biostats