Tutorials › Stochastic Differential Equations in Pharmacokinetics › Dense Sampling: What Becomes Visible and What Does Not

Process Noise Versus Observation Error · Tutorial 7 of 100

Dense Sampling: What Becomes Visible and What Does Not

Learn how dense sampling can estimate a changing latent concentration state while independent assay noise remains in individual readings.

Intermediate 10 min read

What You'll Learn

  • Explain why dense observations can resolve temporal state trends without removing assay error.
  • Derive the variance of adjacent observed concentration changes under independent measurement error.
  • State conditions under which a local average estimates the latent state at a fixed time.
  • Use a stationary OU covariance example to distinguish state covariance from assay variance.
  • Recognize when sampling density is insufficient to assign a particular fluctuation to either source.
  • Identify diagnostics and limitations of dense-sampling interpretations.

What Dense Sampling Adds

A concentration-time record is not the latent pharmacokinetic state itself. Write the observation at time \(t_i\) as \(Y_i=X(t_i)+\epsilon_i\), where \(X(t)\) is the changing concentration state and \(\epsilon_i\) is measurement error. Dense sampling gives many nearby observations of the evolving state, but it does not make the error in any one assay vanish. The central question is therefore not whether a dense record looks smoother, but which features of the record can be attributed to a time-varying state and which remain uncertain because of observation error.

The useful gain is temporal information: nearby measurements can collectively indicate the local level and movement of a continuous state. At the same time, a single observed jump between adjacent measurements can be dominated by two independent assay errors. A high sampling frequency is not, by itself, a label attached to each observed fluctuation.

Definition: In the observation model \(Y_i=X(t_i)+\epsilon_i\), \(X(t_i)\) is the latent state at the sampling time, and \(\epsilon_i\) is the observation error. For the results below, assume the errors have mean zero, variance \(\tau^2<\infty\), are mutually independent, and are independent of the state process. A dense design over a fixed interval has maximum gap between successive sampling times tending to zero.

Why Adjacent Changes Can Be Misleading

Suppose the state has locally diffusive variation: over a short interval of length \(\Delta\), its increment has variance approximately \(q\Delta\), where \(q\) is the local process-variation rate. Assume the state increment has mean zero for this calculation; a deterministic mean change can be added separately. The observed increment is

$$ Y_{i+1}-Y_i = \{X(t_{i+1})-X(t_i)\} + (\epsilon_{i+1}-\epsilon_i). $$

The two terms are independent under the assumptions, and the error difference has variance \(2\tau^2\). Thus, if the state increment variance is \(q\Delta\),

$$ \operatorname{Var}(Y_{i+1}-Y_i)=q\Delta+2\tau^2. $$

As sampling becomes denser, \(q\Delta\) shrinks while \(2\tau^2\) does not. Consequently, the raw changes between immediately adjacent observations can become increasingly dominated by assay error, even while the full sequence contains more information about the underlying trajectory. This distinction is essential: adjacent differences focus on a very short time scale, whereas estimation of the local state can use a neighborhood of observations.

Worked Example: Adjacent Changes at Two Sampling Intervals

Suppose the local process-variation rate is \(q=0.04\) concentration-squared per hour and the independent assay-error standard deviation is \(\tau=0.20\) concentration units. Then \(\tau^2=0.04\), and the assay contribution to the variance of an adjacent difference is \(2\tau^2=0.08\).

At an interval of \(\Delta=0.10\) hour, the process contribution is \(q\Delta=0.04(0.10)=0.004\). The total variance is \(0.004+0.08=0.084\), of which the assay contribution is \(0.08/0.084\approx0.952\), or about 95.2%.

At \(\Delta=0.001\) hour, the process contribution is \(0.04(0.001)=0.00004\). The total variance is \(0.00004+0.08=0.08004\), of which the assay contribution is \(0.08/0.08004\approx0.9995\), or about 99.95%.

Thus, the more closely spaced pair has a less informative raw difference about local process variation. This does not mean the denser data are useless: many neighboring observations can be considered together to estimate the state level, subject to the smoothness and error assumptions.

Local Estimation of a Continuous State

A simple way to express how dense sampling can reveal a state value is to average observations in a shrinking time window around a fixed time \(t\). The window must shrink so that it does not blend together state values from a substantial time span. At the same time, it must contain an increasing number of observations so that independent assay errors average out. The following result makes those requirements precise.

Theorem: Let \(X(t)\) have almost surely continuous paths near a fixed interior time \(t\). Observe \(Y_{i,n}=X(t_{i,n})+\epsilon_{i,n}\) on a regular grid with spacing \(\delta_n\to0\). Assume the errors are independent of \(X\), mutually independent, have mean zero, and have common finite variance \(\tau^2\). Let \(h_n\to0\) and \(\delta_n/h_n\to0\). If \(I_n=\{i:|t_{i,n}-t|\le h_n\}\) and \(m_n=|I_n|\), then the local average \(\bar{Y}_n(t)=m_n^{-1}\sum_{i\in I_n}Y_{i,n}\) converges in probability to \(X(t)\).

Proof. Decompose the estimation error into a state component and an assay-error component:

$$ \bar{Y}_n(t)-X(t) = \frac{1}{m_n}\sum_{i\in I_n}\{X(t_{i,n})-X(t)\} + \frac{1}{m_n}\sum_{i\in I_n}\epsilon_{i,n}. $$

For the first term, every included time satisfies \(|t_{i,n}-t|\le h_n\). Hence its absolute value is at most \(\sup_{|s-t|\le h_n}|X(s)-X(t)|\), which tends to zero almost surely by continuity at \(t\) and \(h_n\to0\). For a regular grid, the number \(m_n\) of points in the window tends to infinity because \(h_n/\delta_n\to\infty\). Independence and the common variance assumption give

$$ \operatorname{Var}\left(\frac{1}{m_n}\sum_{i\in I_n}\epsilon_{i,n}\right) = \frac{\tau^2}{m_n}\longrightarrow0. $$

Chebyshev’s inequality therefore implies that the second term converges in probability to zero. The first term also converges in probability to zero because it converges almost surely to zero. Their sum converges in probability to zero, proving the claim. \(\square\)

This is a consistency result at a fixed time, not a promise that every fluctuation in a finite record can be assigned correctly. The shrinking window balances two errors: a wide window can smooth over real temporal change, while a narrow window may contain too few observations to reduce assay noise. The theorem guarantees convergence under its assumptions; it does not supply an optimal window width for a particular data set.

Worked Example: A Local Window and Its Assay Precision

Suppose measurements are taken every \(0.01\) hour, the assay-error standard deviation is \(\tau=0.30\), and a local estimate uses the 21 observations at \(t-0.10,t-0.09,\ldots,t,\ldots,t+0.09,t+0.10\). The window extends \(h=0.10\) hour on either side of \(t\).

The average of these 21 independent assay errors has variance \(\tau^2/21=0.09/21\approx0.00429\), so its standard deviation is \(\sqrt{0.00429}\approx0.0655\). This quantifies the assay-error component of the local average, not its total error: the state can change within the window.

For scale, if the local process-variation rate is \(q=0.04\) concentration-squared per hour, then the variance of a state change over \(0.10\) hour is approximately \(q h=0.004\), with standard deviation \(\sqrt{0.004}\approx0.0632\). The similarity of these two scales warns that temporal smoothing across this window may matter as much as the residual assay variation. Reducing the window would lessen temporal blurring but use fewer observations; increasing it would reduce the assay component but combine state values over a longer interval.

Covariance Can Show What a Single Reading Cannot

At one sampling time, the observation is a sum of state and error. Its variance alone generally cannot determine how much comes from each source. Information across time can help because the state may be correlated across nearby times while independent assay errors are not. For example, suppose the state is stationary with covariance \(\operatorname{Cov}(X(t),X(t+s))=v\exp(-\lambda|s|)\), where \(v>0\) and \(\lambda>0\). With independent assay error of variance \(\tau^2\), the observation variance is \(v+\tau^2\), whereas the covariance between distinct observations separated by lag \(s>0\) is \(v\exp(-\lambda s)\). The assay contribution appears in the variance but not in this nonzero-lag covariance.

Worked Example: Interpreting a Dense OU-Type Covariance Pattern

Consider the stationary covariance pattern \(v\exp(-\lambda |s|)\) with \(v=0.16\), \(\lambda=0.5\) per hour, and independent assay-error variance \(\tau^2=0.09\). At a nonzero lag of \(s=0.20\) hour, the state covariance is

$$ 0.16\exp\{-0.5(0.20)\}=0.16\exp(-0.10)\approx0.16(0.90484)=0.14477. $$

The covariance of two distinct observations at this lag is also approximately \(0.14477\), since their independent errors have zero covariance. The marginal observation variance is \(0.16+0.09=0.25\), so the corresponding observation correlation is \(0.14477/0.25\approx0.579\).

As the positive lag approaches zero, the state covariance approaches \(0.16\), not \(0.25\). The difference between the marginal variance and this limiting nonzero-lag covariance is \(0.25-0.16=0.09\), matching the assay-error variance in this model. In actual data, estimated covariances are noisy and the assumed covariance form must be checked; dense sampling supplies close lags but does not make a finite-sample estimate exact.

What Dense Sampling Does Not Identify

A single observed deviation cannot generally be classified as process variation or assay error from its size alone. At one time, for example, a normally distributed observation with variance 1 could be represented by independent state and error components with variances 0.8 and 0.2, or by components with variances 0.3 and 0.7. Both decompositions have the same marginal variance. Temporal dependence, repeated information, and scientifically defensible model assumptions are needed to distinguish the sources.

Even when a model separates their variance patterns, it estimates distributions or parameters; it does not turn each measured point into a known state value plus a known error value. A local estimate can make the state near a time more precise, but any particular assay error remains unobserved. Nor does a dense design resolve arbitrarily rapid state changes: the usable temporal resolution depends on the state dynamics, assay precision, and the time scale over which observations can be meaningfully smoothed.

The covariance interpretation also depends on the assumptions. If assay errors are serially correlated, their covariance can persist across nearby times and imitate state dependence. If error variance changes with concentration, a constant \(\tau^2\) is inadequate. If the state is not continuous, the local averaging result need not estimate its value at a jump. A dense sampling schedule cannot repair a misspecified observation model.

Practical Comparisons and Diagnostics

Sparse sampling can leave too few observations at nearby lags to characterize temporal dependence. Dense sampling supplies that local information, but interpreting every adjacent difference as a state change is a poor alternative: under independent assay error, the difference contains two error terms and retains variance \(2\tau^2\) even as the time interval shrinks. Local smoothing targets the state level instead, while covariance-based modeling uses dependence across lags to separate components under a specified model. These approaches answer related but different questions; none makes assumptions unnecessary.

Several checks help reveal when an interpretation is failing:

  • Compare the variability of adjacent differences across sampling intervals. If very short-interval differences remain highly variable, that is consistent with an error contribution that does not shrink with the interval, though it is not by itself proof of independent assay error.
  • Inspect estimated covariance across several nonzero lags, not just one. A proposed state covariance pattern should explain the observed decay or persistence across those lags.
  • Repeat state estimation with more than one plausible window width. Large changes in the estimated trajectory indicate a resolution-versus-noise trade-off that should be reported rather than hidden.
  • Check whether the assumed assay errors are plausibly independent and have stable variance. Correlated or concentration-dependent errors can distort the apparent temporal pattern.

The main limitation is that dense sampling improves temporal information only within the chosen observation and state models. It does not identify a unique decomposition from the observed curve without assumptions, and arbitrarily fine sampling can make raw adjacent changes less—not more—informative about process variation.

Key takeaway: Dense measurements can estimate a continuous state more precisely by combining nearby observations and can reveal temporal dependence across lags. Independent assay error remains in each measurement, and sampling density alone cannot label an individual fluctuation as process noise or observation error.

Check Your Understanding

Answer each question, then compare with the solutions.

  1. If the state increment variance is \(q\Delta\) and independent assay errors have variance \(\tau^2\), what is the variance of an observed adjacent difference?
  2. For local averaging around a fixed time, why must the window shrink and the number of observations in it grow?
  3. In the stationary covariance example, why does assay-error variance contribute to observation variance but not the covariance between distinct observations?
  4. Does a dense sampling schedule identify the assay error in each individual reading? Explain.

Solutions. (1) The two independent assay errors enter as \(\epsilon_{i+1}-\epsilon_i\), with variance \(2\tau^2\); adding the independent state increment gives \(q\Delta+2\tau^2\). (2) A shrinking window limits temporal blurring, while an increasing number of observations makes the variance of the averaged independent errors, \(\tau^2/m_n\), tend to zero. (3) Distinct assay errors are independent, so their covariance is zero; each observation’s own error still contributes \(\tau^2\) to its variance. (4) No. Dense data can support an estimate of the latent state under assumptions, but an individual reading is still a state value plus an unobserved error, and the design alone does not reveal that error realization.

Clinical Biostats