Tutorials › Stochastic Differential Equations in Pharmacokinetics › Averaging Replicate Assays Reduces Measurement Noise

Process Noise Versus Observation Error · Tutorial 9 of 100

Averaging Replicate Assays Reduces Measurement Noise

Learn when replicate assays reduce measurement noise, how much variance averaging removes, and why shared concentration variability remains.

Intermediate 10 min read

What You'll Learn

  • State the assumptions under which replicate assay errors average down.
  • Derive the conditional and marginal variance of a replicate mean.
  • Distinguish reduced assay noise from unchanged variation in latent concentration.
  • Use replicate differences to diagnose independent assay error.
  • Recognize how shared batch effects limit the benefit of averaging.
  • Estimate assay-error variance from repeated measurements.

Why Replicates Help—and What They Do Not Average Away

Suppose several assays are performed on the same specimen at the same sampling time. They share the specimen's latent concentration, but each assay can have its own measurement error. Averaging the results can reduce the part of their scatter caused by independent assay errors. It cannot average away differences in the underlying concentrations across patients, times, or latent concentration paths: all replicates on one specimen share the same concentration.

This distinction matters when interpreting concentration-time data. A smaller spread among replicate measurements does not imply that the underlying pharmacokinetic process has become less variable. It means that repeated measurements have made the observation of a shared latent state less noisy, subject to assumptions about the assay errors. The calculations below separate those two sources explicitly.

Definition: For one specimen with latent concentration \(X\), an additive replicate-assay model with \(m\) replicates is \(Y_j=X+\varepsilon_j\), for \(j=1,\ldots,m\). Here \(Y_j\) is the \(j\)th measured concentration and \(\varepsilon_j\) is its assay error. The replicate mean is \(\bar Y=m^{-1}\sum_{j=1}^m Y_j\). The standard independent-error assumptions are \(E[\varepsilon_j]=0\), \(\operatorname{Var}(\varepsilon_j)=\sigma_a^2<\infty\), errors are mutually independent, and the errors are independent of \(X\).

The independence assumption is about the errors after conditioning on the shared specimen, not about the observed measurements. Even when assay errors are independent, the \(Y_j\) values are not independent: all contain \(X\). The latent concentration may itself vary across specimens or sampling times. Treating \(X\) as random describes that variation, or a distribution of uncertainty about the latent concentration; the same calculations can also be read conditionally on a fixed but unknown specimen concentration.

Deriving the Variance Reduction

Write the replicate mean as the shared concentration plus the mean assay error. Conditional on \(X\), the concentration is fixed, so only the errors contribute to the conditional variance.

$$ \bar Y=X+\bar\varepsilon,\qquad \bar\varepsilon=\frac{1}{m}\sum_{j=1}^m\varepsilon_j. $$
Result: Under the independent-error assumptions, \(E[\bar Y\mid X]=X\) and \(\operatorname{Var}(\bar Y\mid X)=\sigma_a^2/m\). If \(X\) has finite variance and is independent of the assay errors, then $$ \operatorname{Var}(\bar Y)=\operatorname{Var}(X)+\frac{\sigma_a^2}{m}. $$ Averaging reduces the assay-error contribution by a factor of \(m\), but the contribution \(\operatorname{Var}(X)\) from the shared latent concentration is not divided by \(m\).

To derive the conditional result, linearity of expectation gives \(E[\bar Y\mid X]=X+m^{-1}\sum_j E[\varepsilon_j\mid X]=X\). Independence of the errors from \(X\) gives \(E[\varepsilon_j\mid X]=0\), and their conditional variances are \(\sigma_a^2\). Therefore, mutual independence makes every conditional covariance between distinct errors zero, so

$$ \operatorname{Var}(\bar Y\mid X) =\frac{1}{m^2}\left(\sum_{j=1}^m\sigma_a^2+ 2\sum_{j<k}\operatorname{Cov}(\varepsilon_j,\varepsilon_k\mid X)\right) =\frac{m\sigma_a^2}{m^2} =\frac{\sigma_a^2}{m}. $$

For the marginal result, use the law of total variance, which states that \(\operatorname{Var}(Z)=E[\operatorname{Var}(Z\mid X)]+\operatorname{Var}(E[Z\mid X])\) when \(Z\) has finite second moment. Substitution gives

$$ \operatorname{Var}(\bar Y) =E\left[\frac{\sigma_a^2}{m}\right]+\operatorname{Var}(X) =\frac{\sigma_a^2}{m}+\operatorname{Var}(X). $$

This proof also clarifies a useful nuance. Averaging does not reduce the across-specimen variance of the latent concentrations in this decomposition. But the replicate mean is a more precise observation of the concentration for a particular specimen: its conditional measurement-error variance is smaller. In an inferential analysis, that additional precision can improve estimation of the specimen's concentration; it does not mean the latent concentration itself changed.

Worked Example: Separating the Two Variance Contributions

Suppose the latent concentration across specimens has variance \(16\;(\mathrm{mg/L})^2\), and each assay error has variance \(9\;(\mathrm{mg/L})^2\). Compare one assay with the mean of four independent assays of each specimen.

For one assay, the marginal variance is \(16+9=25\;(\mathrm{mg/L})^2\). For four assays, the mean's assay-error variance is \(9/4=2.25\;(\mathrm{mg/L})^2\), so its marginal variance is \(16+2.25=18.25\;(\mathrm{mg/L})^2\). The corresponding standard deviations are \(5\;\mathrm{mg/L}\) and \(\sqrt{18.25}\approx4.27\;\mathrm{mg/L}\).

The assay-noise part has fallen from \(9\) to \(2.25\), exactly a factor of four. The latent-concentration part remains \(16\). Dividing the entire variance \(25\) by four would give \(6.25\), which incorrectly treats the four measurements as if they came from four independent latent concentrations.

What Replicate Differences Reveal

The shared concentration cancels when two replicates are subtracted. This makes within-specimen differences informative about assay error, while also explaining why the replicates' observed values remain correlated across specimens.

Result: Under the independent-error model, for distinct replicates \(j\) and \(k\), \(\operatorname{Cov}(Y_j,Y_k)=\operatorname{Var}(X)\) and \(\operatorname{Var}(Y_j-Y_k)=2\sigma_a^2\).

For the covariance, expand \(Y_j=X+\varepsilon_j\) and \(Y_k=X+\varepsilon_k\). Independence and zero error means make the cross-covariances involving \(X\) zero, and independence of the two errors makes their covariance zero. Thus \(\operatorname{Cov}(Y_j,Y_k)=\operatorname{Var}(X)\). For the difference, \(Y_j-Y_k=\varepsilon_j-\varepsilon_k\), so

$$ \operatorname{Var}(Y_j-Y_k) =\operatorname{Var}(\varepsilon_j)+\operatorname{Var}(\varepsilon_k) -2\operatorname{Cov}(\varepsilon_j,\varepsilon_k) =2\sigma_a^2. $$

These identities hold when the model assumptions hold and the relevant variances are finite. In observed data, unusually large differences, or differences that vary systematically with concentration, can indicate that the constant-variance independent-error model is inadequate. Replicate differences do not reveal the shared concentration itself: the shared component cancels by construction.

Worked Example: Estimating Assay Variance From Replicates

Four assays on the same specimen report \(11, 13, 12,\) and \(14\;\mathrm{mg/L}\). Calculate their mean and sample variance, and interpret the variance estimate under the independent, equal-variance error model.

The mean is \(\bar Y=(11+13+12+14)/4=50/4=12.5\;\mathrm{mg/L}\). The deviations from the mean are \(-1.5, 0.5, -0.5,\) and \(1.5\;\mathrm{mg/L}\). Their squared values sum to \(2.25+0.25+0.25+2.25=5\;(\mathrm{mg/L})^2\). The sample variance is therefore \(s^2=5/(4-1)=5/3\approx1.67\;(\mathrm{mg/L})^2\).

With the specimen concentration held fixed, this sample variance estimates the assay-error variance \(\sigma_a^2\); it is not an estimate of the across-specimen variance of latent concentrations. Substituting it into the variance reduction formula gives an estimated assay-error variance for the mean of \(s^2/4\approx0.417\;(\mathrm{mg/L})^2\). This estimate is uncertain because it is based on only four replicates.

The sample-variance calculation has a direct justification. With \(Y_j=X+\varepsilon_j\), subtracting \(\bar Y\) removes \(X\), so \(\sum_j(Y_j-\bar Y)^2=\sum_j(\varepsilon_j-\bar\varepsilon)^2=\sum_j\varepsilon_j^2-m\bar\varepsilon^2\). Taking expectations, the first term has expectation \(m\sigma_a^2\), and \(E[\bar\varepsilon^2]=\operatorname{Var}(\bar\varepsilon)=\sigma_a^2/m\). Hence the expected sum of squares is \(m\sigma_a^2-m(\sigma_a^2/m)=(m-1)\sigma_a^2\). Dividing by \(m-1\) gives \(E[s^2]=\sigma_a^2\). This unbiasedness relies on independent errors with a common finite variance and a shared concentration across the replicates.

When Replicates Share More Than the Concentration

The factor-of-\(m\) reduction applies only to the independent part of the assay error. Replicates may share a batch, calibration, specimen preparation, or other source of error. Such a shared error behaves like another common component: averaging the replicate-specific noise does not remove it.

Worked Example: A Shared Batch Effect Limits Averaging

Suppose each assay error has the form \(\varepsilon_j=B+U_j\), where \(B\) is a shared, mean-zero batch effect with variance \(4\;(\mathrm{mg/L})^2\), and the independent, mean-zero replicate errors \(U_j\) each have variance \(9\;(\mathrm{mg/L})^2\). Assume \(B\), the \(U_j\), and \(X\) are mutually independent. Find the assay-error variance for one reading and for the mean of three readings.

For one reading, \(\operatorname{Var}(\varepsilon_j)=\operatorname{Var}(B)+\operatorname{Var}(U_j)=4+9=13\;(\mathrm{mg/L})^2\). For the mean of three readings, \(\bar\varepsilon=B+(U_1+U_2+U_3)/3\). Thus its variance is \(4+9/3=7\;(\mathrm{mg/L})^2\): the replicate-specific component falls from \(9\) to \(3\), but the shared batch component remains \(4\).

For example, if \(\operatorname{Var}(X)=25\;(\mathrm{mg/L})^2\), the total variance of one observed reading is \(25+13=38\;(\mathrm{mg/L})^2\); for the three-reading mean it is \(25+7=32\;(\mathrm{mg/L})^2\). Dividing \(13\) by three would incorrectly discard the shared batch variance.

A practical diagnostic is to examine whether replicates were genuinely independent measurements. Repeating an assay on the same plate may not remove a plate-level effect. A new specimen, in contrast, generally does not constitute a replicate of the same latent concentration: it can bring new biological or sampling variation. Also check whether error is approximately additive and has stable variance over the concentration range. If variability grows with concentration, or errors are naturally proportional, a constant additive variance model may be unsuitable; one may need a scale-appropriate model, such as an additive error model for log concentrations.

Choosing What to Average

Averaging replicate assays is appropriate when the scientific target is the shared specimen concentration and the replicates are comparable measurements with sufficiently independent errors. Retaining the individual replicates instead can be useful when the purpose is to estimate assay precision, detect outliers, identify batch patterns, or fit a model that explicitly represents replicate-level error. Both approaches rely on identifying which sources of variability are shared and which are independent.

Increasing the number of independent replicates reduces the independent assay component in proportion to \(1/m\), not the total variance in that proportion. Its benefit therefore has diminishing returns when \(\operatorname{Var}(X)\) or a shared assay component is large. For example, taking many repeats on one specimen cannot substitute for collecting information from additional specimens when the goal is to characterize variation in latent concentrations across specimens.

Common mistake: “There are \(m\) readings, so the variance of their mean is the variance of one reading divided by \(m\).” This is wrong when the readings share \(X\). Under the independent-error model, the correct marginal variance is \(\operatorname{Var}(X)+\sigma_a^2/m\), not \((\operatorname{Var}(X)+\sigma_a^2)/m\). Divide only the independent error contribution; retain any component common to all replicates.

The conclusion is limited by the measurement model. Bias shared across assays does not disappear under averaging. Correlated errors reduce the variance benefit, unequal error variances change the optimal weighting, and a changed specimen may no longer share exactly the same latent concentration. Replicate counts alone cannot establish independence: assay design and residual patterns matter.

Check Your Understanding

Answer each question, then compare with the solutions.

  1. Suppose \(\operatorname{Var}(X)=10\) and each independent assay error has variance \(8\). What is the variance of the mean of four assays?
  2. Why is the variance of the mean not generally \(\operatorname{Var}(Y_1)/m\) when all replicates use the same specimen?
  3. Two independent-error replicates have difference variance \(18\). What is the implied assay-error variance?
  4. If each error has an independent component with variance \(6\) and a shared batch component with variance \(2\), what is the assay-error variance of the mean of three replicates?

Solutions. (1) The variance is \(10+8/4=12\). (2) The replicates share \(X\), so its variance is common to every reading and does not average down; the total is \(\operatorname{Var}(X)+\sigma_a^2/m\). (3) Since the difference variance is \(2\sigma_a^2\), \(18=2\sigma_a^2\), giving \(\sigma_a^2=9\). (4) The shared component remains \(2\), while the independent component becomes \(6/3=2\), so the assay-error variance is \(4\).

Clinical Biostats