Tutorials › Statistical Theory I - Probability and Distribution Theory › Exponential Rate and Scale Parameterizations

Uniform, Beta, and Gamma Laws · Tutorial 159 of 994

Exponential Rate and Scale Parameterizations

Learn to recognize either exponential parameterization, convert its parameter and units correctly, and derive the distribution’s basic functions.

Beginner 9 min read

What You'll Learn

  • Define exponential densities using a positive rate or a positive scale
  • Convert between rate and scale parameterizations
  • Identify the support and verify that the density integrates to one
  • Derive the CDF and survival function from the density
  • Track how the parameter’s units change when measurement units change

Two Parameters for the Same Exponential Distribution

An exponential model describes a continuous random variable that takes nonnegative values and has a density that decreases exponentially as the variable grows. The same family is commonly written using either a rate or a scale parameter. Both conventions describe the same distributions, but the parameters are reciprocals, not interchangeable names for the same number. Keeping track of which convention is in use is essential for interpreting a model and its units.

Throughout this tutorial, \(\lambda\) denotes a positive rate and \(\beta\) denotes a positive scale. The symbol \(\beta\) here is a scale parameter, not a shape parameter of a Beta distribution. We derive the density’s normalization, support, cumulative distribution function, and survival function directly from these definitions.

Definition: A random variable \(X\) has an exponential distribution with rate \(\lambda>0\), written \(X\sim\operatorname{Exponential}(\lambda)\), if its density is $$ f_X(x)= \begin{cases} \lambda e^{-\lambda x}, & x\geq 0,\\ 0, & x<0. \end{cases} $$ Equivalently, \(X\) has an exponential distribution with scale \(\beta>0\) if $$ f_X(x)= \begin{cases} \frac{1}{\beta}e^{-x/\beta}, & x\geq 0,\\ 0, & x<0. \end{cases} $$ The two parameterizations describe the same distribution when \(\beta=1/\lambda\), or, equivalently, \(\lambda=1/\beta\).

The rate has units of “inverse measurement units.” If \(X\) is measured in hours, \(\lambda\) is measured per hour. The scale has the same units as \(X\): in that example, \(\beta\) is measured in hours. The reciprocal relationship makes these units consistent: \(1/\lambda\) is measured in hours when \(\lambda\) is measured per hour.

Why the Density Is a Probability Density

A density must be nonnegative and integrate to one over its full range. For either parameterization, positivity follows from the positive parameter and the positive exponential function. Normalization can be checked directly in the rate form. For any \(\lambda>0\),

$$ \int_{-\infty}^{\infty} f_X(x)\,dx =\int_0^\infty \lambda e^{-\lambda x}\,dx =\left[-e^{-\lambda x}\right]_{0}^{\infty} =0-(-1)=1. $$

The boundary term at infinity is zero because \(\lambda>0\), so \(e^{-\lambda x}\to 0\) as \(x\to\infty\). In the scale form, \(\beta>0\) likewise gives

$$ \int_0^\infty \frac{1}{\beta}e^{-x/\beta}\,dx =\left[-e^{-x/\beta}\right]_{0}^{\infty} =1. $$

Thus each formula defines a probability density. The random variable has no probability concentrated at a single point: for any particular \(x\), \(P(X=x)=0\). Probabilities are obtained by integrating the density over intervals.

Result: The distributional support of an exponential random variable is \([0,\infty)\). It assigns probability zero to negative values, and every open interval lying strictly inside \((0,\infty)\) has positive probability. The density is positive at \(x=0\), but a single endpoint has probability zero.

Converting Between Rate and Scale

To see why the parameters are reciprocals, equate the two density formulas on \(x\geq 0\). The exponential terms agree when \(\lambda x=x/\beta\), which requires \(\lambda=1/\beta\). Their leading constants then agree as well, since \(1/\beta=\lambda\). Conversely, substituting \(\beta=1/\lambda\) into the scale density gives the rate density:

$$ \frac{1}{\beta}e^{-x/\beta} =\lambda e^{-\lambda x} \qquad\text{when }\beta=\frac{1}{\lambda}. $$

This conversion is one-to-one on positive parameter values. A rate of \(0.2\) per minute corresponds to a scale of \(5\) minutes; a scale of \(5\) minutes corresponds to a rate of \(0.2\) per minute. A common source of errors is to copy the numerical parameter from one convention into the other without taking its reciprocal.

Worked Example: Convert a Rate to a Scale

Suppose a waiting time \(X\), measured in hours, is exponential with rate \(\lambda=0.4\) per hour. Write its density in scale form, and evaluate the density at \(x=2\) hours.

The scale is the reciprocal of the rate: $$ \beta=\frac{1}{\lambda}=\frac{1}{0.4}=2.5\text{ hours}. $$

In rate form, the density is \(f_X(x)=0.4e^{-0.4x}\) for \(x\geq0\). In scale form it is $$ f_X(x)=\frac{1}{2.5}e^{-x/2.5},\qquad x\geq0. $$

At \(x=2\) hours, either expression gives the same value: $$ f_X(2)=0.4e^{-0.8}=\frac{1}{2.5}e^{-2/2.5} \approx 0.1797\text{ per hour}. $$ The units are inverse hours because this is a density for a variable measured in hours. A density value is not itself a probability.

Worked Example: Convert a Scale and Change Measurement Units

A duration \(T\) is exponential with scale \(\beta=6\) minutes. Give the rate and density in minutes, then express the same model using seconds.

In minutes, the rate is $$ \lambda=\frac{1}{\beta}=\frac{1}{6}\text{ per minute}, $$ so the density is \(f_T(t)=\frac{1}{6}e^{-t/6}\) for \(t\geq0\), with \(t\) measured in minutes.

Let \(U=60T\) be the duration in seconds. The scale in seconds is \(60(6)=360\) seconds, and the corresponding rate is \(1/360\) per second. Thus the density with respect to the variable \(u\), measured in seconds, is $$ f_U(u)=\frac{1}{360}e^{-u/360},\qquad u\geq0. $$

The reciprocal relation still holds: \((360\text{ seconds})(1/360\text{ per second})=1\). The numerical rate changes when the time unit changes; it is not correct to keep the value \(1/6\) and merely relabel it “per second.”

Deriving the CDF and Survival Function

For a real-valued random variable, the cumulative distribution function is \(F_X(x)=P(X\leq x)\). The survival function is \(S_X(x)=P(X>x)\). For an exponential variable, the support and density allow both functions to be derived by integration. These formulas also make the equivalence of the two parameterizations visible.

Theorem: If \(X\sim\operatorname{Exponential}(\lambda)\) with \(\lambda>0\), then $$ F_X(x)= \begin{cases} 0, & x<0,\\ 1-e^{-\lambda x}, & x\geq0, \end{cases} \qquad S_X(x)= \begin{cases} 1, & x<0,\\ e^{-\lambda x}, & x\geq0. \end{cases} $$ Equivalently, for scale \(\beta=1/\lambda>0\), replace \(\lambda x\) by \(x/\beta\).

Derivation. If \(x<0\), the event \(X\leq x\) is impossible because \(X\) is supported on \([0,\infty)\), so \(F_X(x)=0\). If \(x\geq0\), integrate the density from zero to \(x\):

$$ F_X(x)=P(X\leq x) =\int_0^x \lambda e^{-\lambda t}\,dt =\left[-e^{-\lambda t}\right]_0^x =1-e^{-\lambda x}. $$

The survival function is \(1-F_X(x)\), since the events \(X\leq x\) and \(X>x\) partition the sample space. Hence for \(x\geq0\),

$$ S_X(x)=1-F_X(x)=e^{-\lambda x}. $$

When \(x<0\), \(X>x\) always holds for a nonnegative \(X\), so \(S_X(x)=1\). At \(x=0\), the formulas give \(F_X(0)=0\) and \(S_X(0)=1\); this agrees with \(P(X=0)=0\). Replacing \(\lambda\) with \(1/\beta\) gives \(F_X(x)=1-e^{-x/\beta}\) and \(S_X(x)=e^{-x/\beta}\) for \(x\geq0\). \(\square\)

Worked Example: Read the CDF and Survival Formula From Either Convention

Let \(X\) be exponential with scale \(\beta=4\) days. Write its rate, CDF, and survival function, and evaluate both functions at \(x=3\) days.

The rate is \(\lambda=1/4\) per day. For \(x\geq0\), the CDF is $$ F_X(x)=1-e^{-x/4}, $$ and the survival function is $$ S_X(x)=e^{-x/4}. $$

At three days, $$ F_X(3)=1-e^{-3/4}\approx1-0.4724=0.5276, $$ while $$ S_X(3)=e^{-3/4}\approx0.4724. $$ Their sum is \(0.5276+0.4724=1\), as required by \(F_X(3)+S_X(3)=1\). The survival function here is the probability of exceeding three days; because the distribution is continuous, using “at least three days” gives the same probability.

Recognizing the Parameterization and Avoiding Pitfalls

A density written as \(c e^{-cx}\) on \(x\geq0\), where \(c>0\), uses \(c\) as a rate. A density written as \(\frac{1}{d}e^{-x/d}\) on \(x\geq0\), where \(d>0\), uses \(d\) as a scale. In each case, check both the coefficient and the exponent: a parameter’s role is determined by the entire density, not merely by its name.

Worked Example: Identify the Rate in a Given Density

Suppose $$ f_X(x)= \begin{cases} \frac{3}{4}e^{-3x/4}, & x\geq0,\\ 0, & x<0. \end{cases} $$ Identify the rate and scale, and write the CDF.

Compare the density with \(\lambda e^{-\lambda x}\). The coefficient is \(3/4\), and the exponent is \(-(3/4)x\), so both identify the rate as $$ \lambda=\frac{3}{4}. $$

The scale is the reciprocal: $$ \beta=\frac{1}{\lambda}=\frac{4}{3}. $$ The CDF is therefore $$ F_X(x)= \begin{cases} 0, & x<0,\\ 1-e^{-3x/4}, & x\geq0. \end{cases} $$ For a normalization check, the density integrates to $$ \int_0^\infty \frac{3}{4}e^{-3x/4}\,dx =\left[-e^{-3x/4}\right]_0^\infty =1. $$

Common mistake: Treating the rate and scale as if they were the same numerical parameter. For example, if a model is given a rate of \(0.4\) per hour, writing the scale as \(0.4\) hours is wrong. The correction is to take the reciprocal: the scale is \(1/0.4=2.5\) hours. A related error is to confuse a density value with a probability. At a point \(x\), \(f_X(x)\) has units inverse to those of \(X\), while a probability is dimensionless and comes from integrating the density over a range.

The distinction between rate and scale also helps check formulas. A larger rate makes the exponent \(-\lambda x\) decrease more rapidly as \(x\) grows; a smaller scale has the same effect because \(\lambda=1/\beta\). If a proposed conversion makes a larger rate correspond to a larger scale, the reciprocal has likely been reversed.

Key takeaway: The rate form is \(\lambda e^{-\lambda x}\), and the scale form is \(\beta^{-1}e^{-x/\beta}\), both on \(x\geq0\). The parameters obey \(\beta=1/\lambda\); the CDF on the support is \(1-e^{-\lambda x}\), and the survival function is \(e^{-\lambda x}\).

Check Your Understanding

Use the support, parameter definitions, and derived functions to answer the following.

  1. An exponential waiting time has rate \(0.25\) per minute. What is its scale, including units?
  2. Write the density and CDF for an exponential variable with scale \(8\) hours.
  3. Why does an exponential variable have probability zero of being negative, even though its density is positive at \(x=0\)?
  4. A density is \(5e^{-5x}\) for \(x\geq0\). Identify its rate and scale, including the appropriate units if \(x\) is measured in seconds.
  5. For \(x\geq0\), explain why the CDF and survival function derived here add to one.