Tutorials › Statistical Theory I - Probability and Distribution Theory › Geometric and Negative-Binomial Parameter Connections

Geometric and Count Distributions · Tutorial 141 of 994

Geometric and Negative-Binomial Parameter Connections

Learn how setting the negative-binomial success target to one recovers the geometric distribution, and how to translate its probabilities and moments between trial-count and failure-count conventions.

Beginner 9 min read

What You'll Learn

  • Distinguish the number of trials through the first success from the number of failures before it.
  • Match both geometric conventions to the negative-binomial model with one required success.
  • Translate negative-binomial failure counts into total trial counts.
  • Convert point probabilities and tail events between the two supports.
  • Check how means and variances change, or remain unchanged, under a shift of one.

One Waiting Time, Two Count Conventions

A geometric waiting time can be recorded in either of two natural ways: count the trial on which the first success occurs, or count only the failures that come before it. These are different random variables, even though they describe the same sequence of trials. The negative-binomial distribution uses the same distinction when it counts failures before a specified number of successes or the total trials needed to reach that number.

The key connection is simple but useful: the geometric distribution is the negative-binomial distribution with one required success. To use that connection correctly, keep track of what is counted, where the support begins, and which parameter is the success probability. A shift between counts changes the mean by one, but leaves the variance unchanged.

Definition: Let \(0<p<1\) be the probability of success on each independent trial, and let \(q=1-p\) be the probability of failure. Let \(T\) be the number of trials up to and including the first success, and let \(K\) be the number of failures before that success. Then \(T=K+1\), with \(T\in\{1,2,\ldots\}\) and \(K\in\{0,1,2,\ldots\}\).

The parameter \(p\) is the success probability, not the failure probability. For example, the event \(T=4\) requires three failures followed by a success. The event \(K=3\) describes exactly that same sequence, so \(T=4\) and \(K=3\) are two descriptions of one outcome.

Negative-Binomial Counts and Their Supports

For a positive integer \(r\), let \(W_r\) be the number of failures before the \(r\)th success. Let \(N_r\) be the total number of trials through and including that success. Since the \(r\) successes account for \(r\) of the trials, \(N_r=W_r+r\).

Definition: In the failures-before-successes convention, \(W_r\) has a negative-binomial distribution with success probability \(p\) and required number of successes \(r\) if \(P(W_r=w)=\binom{w+r-1}{r-1}p^r q^w\) for \(w=0,1,2,\ldots\). In the total-trials convention, \(N_r=W_r+r\), so \(P(N_r=n)=\binom{n-1}{r-1}p^r q^{n-r}\) for \(n=r,r+1,\ldots\).

The two probability mass functions describe the same model, with their arguments offset by \(r\). To see why the failures-count formula has its combinatorial factor, consider a sequence ending at the \(r\)th success and containing \(w\) failures. Its final trial must be a success. Among the first \(w+r-1\) trials, there must be \(r-1\) successes and \(w\) failures. There are \(\binom{w+r-1}{r-1}\) ways to place those earlier successes, and each resulting sequence has probability \(p^r q^w\). For the trials convention, substitute \(w=n-r\), giving the stated formula.

When \(r=1\), the \(r\)th success is simply the first success. The negative-binomial variables then satisfy \(W_1=K\) and \(N_1=T\). The correspondence is not an approximation or a limiting argument: it is an exact identity of models.

Worked Example: Matching the Geometric Masses

Suppose each trial succeeds with probability \(p=0.2\), so \(q=0.8\). Find the probability that the first success occurs on trial 4, expressing the event in both geometric conventions and as a negative-binomial probability.

In the trials convention, the first three trials must fail and the fourth must succeed: \(P(T=4)=q^3p=(0.8)^3(0.2)=0.512(0.2)=0.1024\).

In the failures convention, this is the event \(K=3\), so \(P(K=3)=q^3p=(0.8)^3(0.2)=0.1024\).

For the negative-binomial model with \(r=1\), the same event is \(W_1=3\), or equivalently \(N_1=4\). The mass functions give \(P(W_1=3)=\binom{3}{0}p q^3=1(0.2)(0.8)^3=0.1024\) and \(P(N_1=4)=\binom{3}{0}p q^3=0.1024\). All four expressions agree. Their different random-variable values reflect different counts, not different event probabilities.

The Exact Parameter and Support Connection

The equivalence can be checked directly from the negative-binomial mass functions. For \(r=1\), the number of ways to place the \(r-1=0\) earlier successes is one. Thus the failures count has mass \(p q^w\), and the total-trials count has mass \(p q^{n-1}\). These are precisely the two geometric mass functions, on their respective supports.

Theorem: For \(0<p<1\), if \(W_r\) counts failures before the \(r\)th success and \(N_r=W_r+r\) counts trials through that success, then \(W_1\) has the same distribution as \(K\), and \(N_1\) has the same distribution as \(T\). Their probability masses agree pointwise under \(n=w+1\).

Proof. The negative-binomial formula for \(W_r\), evaluated at \(r=1\), is \(P(W_1=w)=\binom{w}{0}p q^w=pq^w\), for every integer \(w\geq 0\). The geometric failure-count formula is \(P(K=w)=pq^w\) on the same support. Hence the two mass functions agree at every possible value.

For the trials count, \(N_1=W_1+1\), so \(N_1\) takes values \(n=1,2,\ldots\). Substituting \(r=1\) in its mass function gives \(P(N_1=n)=\binom{n-1}{0}p q^{n-1}=p q^{n-1}\). This is the geometric trials-count mass \(P(T=n)\). Equivalently, the support correspondence \(n=w+1\) pairs each \(W_1=w\) outcome with the same trial sequence as \(N_1=n\). Therefore the distributions agree in both conventions. \(\square\)

This theorem also explains why a formula can look different from one reference to another without describing a different distribution. A formula beginning with \(p q^{t-1}\) uses a trials count with support starting at 1. A formula beginning with \(p q^k\) uses a failures count with support starting at 0. The exponent records the number of failures before success.

QuantityGeometric: first-success trialsGeometric: failures before first successNegative-binomial when \(r=1\)
Random variable\(T\)\(K\)\(N_1=T\), \(W_1=K\)
Support\(1,2,\ldots\)\(0,1,2,\ldots\)\(N_1\geq1\), \(W_1\geq0\)
Mass at the indexed value\(P(T=t)=p q^{t-1}\)\(P(K=k)=p q^k\)\(P(N_1=n)=p q^{n-1}\), \(P(W_1=w)=p q^w\)
Mean\(1/p\)\(q/p\)\(E[N_1]=1/p\), \(E[W_1]=q/p\)
Variance\(q/p^2\)\(q/p^2\)\(\operatorname{Var}(N_1)=\operatorname{Var}(W_1)=q/p^2\)

Translating Means and Variances

For the geometric distribution with success probability \(p\), the first-success trial count has mean \(1/p\) and variance \(q/p^2\). The failures-before-first-success count has mean \(q/p\) and the same variance. These standard geometric moment formulas agree with the identity \(T=K+1\): adding one shifts every possible value and the mean by one, but does not change the variance.

More generally, for the negative-binomial counts defined above, \(E[W_r]=rq/p\), \(\operatorname{Var}(W_r)=rq/p^2\), \(E[N_r]=r/p\), and \(\operatorname{Var}(N_r)=rq/p^2\). The trials-count mean is larger by \(r\), because \(N_r=W_r+r\); the variances are equal. At \(r=1\), these formulas reduce to the geometric moments in the table.

Result: Under the one-success correspondence, \(E[T]=E[K]+1\), while \(\operatorname{Var}(T)=\operatorname{Var}(K)\). Specifically, \(E[T]=1/p\), \(E[K]=q/p\), and both variances equal \(q/p^2\).

Derivation. The variable identity \(T=K+1\) gives \(E[T]=E[K+1]=E[K]+1\), by linearity of expectation. Also, \(\operatorname{Var}(T)=\operatorname{Var}(K+1)=\operatorname{Var}(K)\), since subtracting the mean removes the added constant: \(T-E[T]=(K+1)-(E[K]+1)=K-E[K]\). Using the geometric moment formulas \(E[K]=q/p\) and \(\operatorname{Var}(K)=q/p^2\), we obtain \(E[T]=q/p+1=(q+p)/p=1/p\), because \(q+p=1\), and \(\operatorname{Var}(T)=q/p^2\). This verifies both the shift in the means and the invariance of the variance. \(\square\)

Worked Example: Translating Negative-Binomial Moments

Suppose \(p=0.4\), so \(q=0.6\), and the target is \(r=3\) successes. Translate between the number of failures \(W_3\) and the total number of trials \(N_3\), including their means and variances.

The variables are related by \(N_3=W_3+3\). For example, \(W_3=2\) means two failures occurred before the third success, so the process used \(N_3=2+3=5\) trials.

The probability of this outcome in the failures convention is \(P(W_3=2)=\binom{2+3-1}{3-1}(0.4)^3(0.6)^2 =\binom{4}{2}(0.064)(0.36)=6(0.02304)=0.13824\). The matching trials-count probability is \(P(N_3=5)=\binom{5-1}{3-1}(0.4)^3(0.6)^{5-3} =\binom{4}{2}(0.064)(0.36)=0.13824\).

The means are \(E[W_3]=rq/p=3(0.6)/0.4=4.5\) failures and \(E[N_3]=r/p=3/0.4=7.5\) trials. Their difference is 3, as required by \(N_3=W_3+3\). The variance in either convention is \(rq/p^2=3(0.6)/(0.4)^2=1.8/0.16=11.25\). The count changes by a constant, so its variance does not change.

Translating Tail Events

Point probabilities are not the only quantities affected by the support shift. Events must be translated as well. For the first-success count, \(T>m\) means that the first \(m\) trials are all failures. For the failures count, \(K\geq m\) means exactly the same thing. Thus, for every integer \(m\geq0\), \(P(T>m)=P(K\geq m)=q^m\).

Worked Example: Converting a Waiting-Time Tail

A device passes an inspection with probability \(p=0.25\) on each independent inspection. Find the probability that at least four failures occur before the first pass, and express the same event using the trials count.

Here \(q=1-0.25=0.75\). The event \(K\geq4\) means the first four inspections all fail. Therefore \(P(K\geq4)=q^4=(0.75)^4=0.31640625\).

In trials-count language, those first four failures mean that the first pass has not occurred by trial 4. The same event is \(T>4\), so \(P(T>4)=q^4=0.31640625\). The event \(T\geq4\) would be different: it includes a first pass on trial 4 and has probability \(q^3=0.421875\). The strict and non-strict inequalities matter because the supports are integer-valued.

Common Mistake: Shifting the Support but Not the Formula

A frequent error is to use \(p q^t\) for the probability that the first success occurs on trial \(t\). That formula assigns the wrong exponent: a success on trial \(t\) requires \(t-1\) failures, not \(t\). The correct trials-count mass is \(P(T=t)=p q^{t-1}\) for \(t=1,2,\ldots\). The formula \(P(K=k)=p q^k\) is also correct, but only when \(k\) counts failures and ranges from 0 upward.

A related mistake is to report \(E[K]=1/p\). That is the mean number of trials through the first success, \(E[T]\), not the mean number of failures before it. Because \(T=K+1\), the correct failures-count mean is \(E[K]=1/p-1=q/p\). The variances, unlike the means, are equal.

Key takeaway: For one required success, negative-binomial failures count equals geometric failures count, and negative-binomial total trials equals geometric first-success trials. Match the support and event first; then use the corresponding probability formula. The trials count is one greater than the failures count, so its mean is one greater and its variance is unchanged.

Check Your Understanding

Use the count convention stated in each question, and be explicit about the support.

  1. For success probability \(p\), write the mass \(P(T=6)\) when \(T\) counts trials through the first success. What is the corresponding value of the failures count \(K\)?
  2. For a negative-binomial model with \(r=1\), explain why the mass at \(W_1=4\) equals the geometric mass at \(K=4\).
  3. If \(E[T]=8\) for a geometric first-success trials count, what are \(p\), \(E[K]\), and \(\operatorname{Var}(K)\)?
  4. Translate the event \(K\geq 5\) into a statement about \(T\), and give its probability in terms of \(q\).
  5. For general \(r\), if \(E[W_r]=6\), what is \(E[N_r]\), and why do \(W_r\) and \(N_r\) have the same variance?