Tutorials › Statistical Methods for Single-Cell RNA Sequencing › Capture Efficiency As Binomial Thinning

Noise Models and Dropout · Tutorial 67 of 700

Capture Efficiency As Binomial Thinning

Learn how independent capture changes count distributions, and how to calculate the resulting means, variances, and non-detection probabilities.

Intermediate 10 min read

What You'll Learn

  • Define binomial thinning for molecule counts and state its assumptions.
  • Derive the probability-generating-function transformation under thinning.
  • Show why a thinned Poisson count remains Poisson.
  • Show how thinning transforms a negative binomial count while preserving its dispersion parameter.
  • Calculate how capture changes expected counts, variances, and zero probabilities.
  • Distinguish ordinary thinning zeros from extra zero inflation and identify model limitations.

Why Capture Efficiency Changes Counts

A molecule can be present in a cell yet fail to be captured and sequenced. Even if every molecule has the same chance of capture, the observed count will therefore vary around the number present. A useful model treats capture as a separate sampling step: first a latent molecule count is generated, then each molecule is independently retained with probability \(q\). Here \(q\), between 0 and 1, is the capture probability.

This is binomial thinning. It connects a model for the number of molecules available to a model for the count actually observed. The connection is important because thinning changes the mean and variance in specific ways; it does not, by itself, imply an additional class of structural zeros.

Definition: Let \(X\) be a nonnegative integer-valued latent count. Under binomial thinning with capture probability \(q\), the observed count \(Y\), conditional on \(X=x\), has distribution \(Y\mid X=x\sim\operatorname{Binomial}(x,q)\). Equivalently, each of the \(x\) molecules is independently captured with probability \(q\), and \(Y\) is the number captured.

The model assumes a fixed \(q\) for the counts under consideration, independent capture outcomes across molecules, no captured molecules that were not in \(X\), and no molecule counted more than once. The latent count \(X\) may itself vary across cells according to a Poisson or negative binomial distribution. The capture step is then applied to that count.

General Consequences of Thinning

Given \(X=x\), a binomial count has conditional mean \(qx\) and conditional variance \(q(1-q)x\). Averaging over the latent count gives the unconditional mean and variance of \(Y\):

$$ E[Y]=qE[X], \qquad \operatorname{Var}(Y)=q(1-q)E[X]+q^2\operatorname{Var}(X). $$

The mean is reduced in proportion to capture probability. The variance has two contributions: variation in which molecules are captured, represented by \(q(1-q)E[X]\), and retained variation in the latent count, represented by \(q^2\operatorname{Var}(X)\). These expressions follow from the laws of total expectation and total variance:

$$ E[Y]=E\{E[Y\mid X]\}=E[qX]=qE[X], $$ $$ \operatorname{Var}(Y) =E\{\operatorname{Var}(Y\mid X)\} +\operatorname{Var}\{E[Y\mid X]\} =q(1-q)E[X]+q^2\operatorname{Var}(X). $$

The same result can be expressed using a probability-generating function. For a nonnegative integer-valued random variable \(X\), define \(G_X(s)=E[s^X]\). Conditional on \(X\), the generating function of \(Y\) is \((1-q+qs)^X\). Thus,

$$ G_Y(s)=E[(1-q+qs)^X]=G_X(1-q+qs). $$

Substituting a model's generating function into this identity shows whether its distributional form is preserved by thinning.

Worked Example: Thinning a Poisson Count

Suppose, hypothetically, the number of molecules available for a gene in a cell is \(X\sim\operatorname{Poisson}(4)\), and each molecule is captured independently with probability \(q=0.30\). The fixed capture probability and independent molecule-level outcomes satisfy the thinning assumptions.

The Poisson generating function is \(G_X(s)=\exp\{4(s-1)\}\). Applying the thinning identity,

$$ G_Y(s)=G_X(1-0.30+0.30s) =\exp\{4(0.30s-0.30)\} =\exp\{1.20(s-1)\}. $$

This is the generating function of a Poisson random variable with mean \(1.20\). Therefore \(Y\sim\operatorname{Poisson}(1.20)\). Its expected captured count is \(q\lambda=0.30(4)=1.20\), and its variance is also \(1.20\).

The probability of observing zero is \(P(Y=0)=\exp(-1.20)\approx 0.3012\). The probability of observing exactly two is

$$ P(Y=2)=\exp(-1.20)\frac{(1.20)^2}{2!} =\exp(-1.20)\frac{1.44}{2} \approx 0.2169. $$

These are probabilities under the stated hypothetical model, not observed frequencies. In particular, a zero can arise because none of the available molecules were captured; no separate structural-zero mechanism is needed to produce it.

Thinning a Negative Binomial Count

Use the mean-dispersion parameterization of the negative binomial: \(X\) has mean \(\mu\), dispersion \(\phi>0\), and variance \(\mu+\phi\mu^2\). One construction is a Poisson count with a gamma-distributed rate: conditional on a rate \(\Lambda\), \(X\mid\Lambda\sim\operatorname{Poisson}(\Lambda)\), with \(\Lambda\sim\operatorname{Gamma}(1/\phi,\text{scale}=\mu\phi)\). The gamma distribution has mean \(\mu\phi/\phi=\mu\) and variance \(\mu^2\phi\), giving the stated negative binomial mean and variance.

Conditional on \(\Lambda\), independent thinning of a Poisson count with probability \(q\) gives a Poisson count with rate \(q\Lambda\). Since multiplying a gamma random variable by \(q\) multiplies its scale by \(q\) while leaving its shape unchanged, \(q\Lambda\) has gamma shape \(1/\phi\) and scale \(q\mu\phi\). Consequently, the thinned count is negative binomial with mean \(q\mu\) and the same dispersion \(\phi\). The generating-function calculation gives the same result directly.

$$ G_X(s)=\{1+\phi\mu(1-s)\}^{-1/\phi}, $$ $$ G_Y(s)=G_X(1-q+qs) =\{1+\phi q\mu(1-s)\}^{-1/\phi}. $$

The second expression is the negative binomial generating function with mean \(q\mu\) and dispersion \(\phi\). Thus its variance and zero probability are

$$ E[Y]=q\mu,\qquad \operatorname{Var}(Y)=q\mu+\phi(q\mu)^2,\qquad P(Y=0)=\{1+\phi q\mu\}^{-1/\phi}. $$

The dispersion is unchanged under this model, but the mean-dependent variance changes. It would be incorrect to multiply the original variance by \(q\): the thinning variance formula includes both the added molecule-sampling variation and the scaled latent variation.

Worked Example: Thinning a Negative Binomial Count

Suppose, hypothetically, a gene's latent count follows a negative binomial distribution with mean \(\mu=5\) and dispersion \(\phi=0.40\). Molecules are captured independently with fixed probability \(q=0.60\). These assumptions specify both the latent count model and the capture step.

The thinned count remains negative binomial, with mean \(q\mu=0.60(5)=3.00\) and dispersion \(0.40\). Its variance is

$$ \operatorname{Var}(Y)=3.00+0.40(3.00)^2 =3.00+3.60=6.60. $$

For comparison, the latent variance was \(5+0.40(5)^2=15.0\). The observed variance is not \(0.60(15.0)=9.00\); the correct value follows from the transformed mean and unchanged dispersion.

The probability of a zero captured count is

$$ P(Y=0)=\{1+0.40(3.00)\}^{-1/0.40} =2.20^{-2.50} \approx 0.1393. $$

So under this hypothetical model, about 13.9% of counts are expected to be zero. This probability includes zeros produced by the latent negative binomial variation and by molecule-level failure to capture.

Conditional Non-Detection and a Second Example

For a fixed latent count \(X=x\), the probability of non-detection is the probability that all \(x\) molecules fail capture: \(P(Y=0\mid X=x)=(1-q)^x\). This conditional probability depends on the latent count: it is 1 when \(x=0\), and decreases as \(x\) increases when \(0<q\leq 1\). Averaging over \(X\) gives the marginal zero probability \(P(Y=0)=E[(1-q)^X]=G_X(1-q)\). This identity makes clear why the observed zero rate depends on both capture efficiency and the distribution of latent counts.

Worked Example: Non-Detection at a Fixed Latent Count

Imagine a hypothetical cell with exactly \(x=3\) available molecules and capture probability \(q=0.70\). The independent, equal-probability capture assumption means \(Y\mid X=3\sim\operatorname{Binomial}(3,0.70)\).

The probability of detecting none is

$$ P(Y=0\mid X=3)=(1-0.70)^3=0.30^3=0.0270. $$

The probability of detecting exactly two is

$$ P(Y=2\mid X=3) ={3\choose 2}(0.70)^2(0.30) =3(0.49)(0.30)=0.441. $$

These probabilities are conditional on exactly three molecules being available. They are not the same as marginal probabilities across cells whose latent counts vary; those require averaging over the distribution of \(X\).

Diagnostics, Alternatives, and Limits

Thinning is a sampling model, so its assumptions should be considered alongside its predictions. If \(q\) is known or controlled in a hypothetical dilution or capture experiment, the expected mean should scale as \(q\), while the distributional formulas above predict the variance and zero rate. Systematic disagreement across comparable samples can indicate that the fixed-\(q\), independent-capture model is inadequate. For example, capture probabilities might differ across cells, or capture outcomes might not be independent. A single excess-zero comparison does not identify which assumption failed.

Binomial thinning is distinct from two common alternatives. Deterministically multiplying a count by \(q\) would produce fractional values in general and omit the random molecule-to-molecule sampling step. A zero-inflated model instead adds a separate probability of a structural zero to a count distribution. Thinning can already produce many zeros, especially when counts are small or capture is inefficient; adding a zero-inflation component should not be justified merely by observing zeros.

The model also has limits. It assumes the same capture probability for each molecule being modeled, and it does not account for false counts, molecule duplication, or other sources of measurement error. When the probability varies across cells, a single fixed-\(q\) marginal distribution may no longer describe the observed counts; analyzing that variation is a separate modeling problem. The present result isolates what independent capture alone does to a count distribution.

Key takeaway: Independent capture with fixed probability \(q\) transforms a Poisson mean \(\lambda\) to \(q\lambda\), and transforms a negative binomial mean \(\mu\) to \(q\mu\) while preserving its dispersion \(\phi\). Both models can produce observed zeros through thinning alone.

Check Your Understanding

Work through the questions, then compare your answers with the solutions.

  1. If \(X\sim\operatorname{Poisson}(8)\) and \(q=0.25\), what is the distribution and mean of the observed count?
  2. A negative binomial count has mean \(10\), dispersion \(0.20\), and capture probability \(0.50\). Find the thinned mean and variance.
  3. For fixed latent count \(X=2\) and capture probability \(q=0.80\), find the probability of observing zero.
  4. Why is multiplying the original negative binomial variance by \(q\) generally incorrect?
  5. Does observing a zero establish that the latent count was zero? Explain.

Solutions. (1) Poisson thinning gives \(Y\sim\operatorname{Poisson}(0.25(8))=\operatorname{Poisson}(2)\), with mean 2. (2) The thinned mean is \(0.50(10)=5\), and the variance is \(5+0.20(5)^2=10\). (3) \(P(Y=0\mid X=2)=(1-0.80)^2=0.0400\). (4) Variance includes both \(q(1-q)E[X]\) from capture sampling and \(q^2\operatorname{Var}(X)\) from latent variation, so it is not generally \(q\operatorname{Var}(X)\). (5) No. A positive latent count can yield an observed zero when every molecule fails to be captured; under the model that conditional probability is \((1-q)^X\).

Clinical Biostats