Tutorials › Quantitative Systems Pharmacology (QSP) › Incorporating Censored and Below-Quantification Data

Calibrating to Multiple Data Sources · Tutorial 580 of 799

Incorporating Censored and Below-Quantification Data

Learn to use the probability of a censored assay result in a QSP calibration likelihood, and to recognize why replacing it with a fixed value can distort inference.

Advanced 12 min read

What You'll Learn

  • Write likelihood contributions for below- and above-quantification results under a specified observation-error model.
  • Distinguish a censored event from an exact measurement and from a truncated observation.
  • Calculate and interpret censored likelihood contributions in assay units.
  • Compare censored likelihoods with fixed-value substitution and identify the shortcuts’ limitations.
  • Diagnose threshold, distributional, and dependence assumptions that can invalidate a censored-data likelihood.

What a Censored Assay Result Tells the Model

An assay may establish that a biomarker concentration is below its lower limit of quantification (LLOQ) without providing a reliable numerical measurement. Similarly, an instrument may report that a result exceeds its upper limit of quantification (ULOQ), without specifying how far above the limit it lies. These are not exact observations at the limits. They are observations of events: the measurement fell below a threshold or above one.

In QSP calibration, the model predicts a quantity that is linked to the assay through an observation model. The likelihood should represent what the assay actually reported. For a censored record, that means using the probability of the observed event under the model, rather than pretending that the limit or a substituted value was measured exactly.

Definition: A measurement is left-censored at a known threshold \(L\) when the reported information is \(Y<L\), such as a result below the LLOQ. It is right-censored at a known threshold \(U\) when the reported information is \(Y>U\), such as a result above the ULOQ. Here \(Y\) is the assay-scale measurement, and the threshold and measurement must use the same units.

Likelihood Contributions Under Normal Assay Error

Suppose the QSP model, together with its observation model, predicts mean measurement \(m_i(\theta)\) for record \(i\), where \(\theta\) denotes the model parameters. Assume that, conditional on the model and any relevant covariates, the assay measurement follows \(Y_i\sim N(m_i(\theta),\sigma_i^2)\). The standard deviation \(\sigma_i\) describes assay-scale error in the same units as \(Y_i\). This tutorial uses the normal observation model for clarity; the same event-probability principle applies with other specified measurement distributions.

The assumptions for the simple formulas are that the threshold is known, the recorded censoring category accurately describes the measurement relative to that threshold, and the conditional measurement distribution is correctly specified. When multiplying contributions across records, also assume conditional independence. If replicate errors are correlated, their joint likelihood must account for that dependence rather than multiplying marginal contributions as if the replicates were independent.

For an exact observation \(y_i\), the contribution is the normal density evaluated at \(y_i\). For a below-threshold record, integrate that density over all values compatible with the report. For an above-threshold record, integrate over the corresponding upper tail.

$$ \begin{aligned} \mathcal{L}_{i,\mathrm{exact}}(\theta) &= \frac{1}{\sigma_i}\phi\!\left(\frac{y_i-m_i(\theta)}{\sigma_i}\right),\\ \mathcal{L}_{i,\mathrm{below}}(\theta) &= P(Y_i<L_i\mid\theta) = \Phi\!\left(\frac{L_i-m_i(\theta)}{\sigma_i}\right),\\ \mathcal{L}_{i,\mathrm{above}}(\theta) &= P(Y_i>U_i\mid\theta) = 1-\Phi\!\left(\frac{U_i-m_i(\theta)}{\sigma_i}\right). \end{aligned} $$

Here \(\phi\) and \(\Phi\) are the standard normal density and cumulative distribution function. An exact continuous measurement contributes a density, not the probability of observing exactly one point (which is zero for a continuous distribution). A censored category contributes a probability, obtained by integrating the density over the reported range. The distinction is important: densities have inverse-measurement units, while event probabilities are dimensionless.

For conditionally independent records, the likelihood is the product of the appropriate contribution for each record. Equivalently, the log likelihood is the sum of their logarithms. An interval-censored record, reported only as \(A<Y_i<B\), contributes \(\Phi((B-m_i(\theta))/\sigma_i)-\Phi((A-m_i(\theta))/\sigma_i)\). These formulas use the model prediction and assay error on the scale where the normal assumption is made.

Worked Example: A Result Below the LLOQ

Suppose a hypothetical biomarker assay has LLOQ \(L=5\) ng/mL. At a particular time, the model predicts an assay-scale mean \(m(\theta)=4\) ng/mL, and the assay-error standard deviation is \(\sigma=2\) ng/mL. The record says “below LLOQ,” not that the concentration equals 5 ng/mL.

Under the normal observation model, the likelihood contribution is the probability of a measurement below 5 ng/mL:

$$ \mathcal{L}_{\mathrm{below}}(\theta) = \Phi\!\left(\frac{L-m(\theta)}{\sigma}\right) = \Phi\!\left(\frac{5-4}{2}\right) = \Phi(0.5) \approx 0.6915. $$

Thus, at this parameter value, the model assigns about a 69.15% probability to a below-LLOQ report. This is the likelihood contribution for the recorded category. It is not a claim that the unobserved measurement was 4 ng/mL; 4 ng/mL is the model’s conditional mean.

Worked Example: A Result Above the ULOQ

Suppose a hypothetical assay has ULOQ \(U=11\) ng/mL. The model predicts a mean of 8 ng/mL, with assay-error standard deviation 2 ng/mL. The report is “above ULOQ.”

The probability of that report is the upper-tail probability:

$$ \begin{aligned} \mathcal{L}_{\mathrm{above}}(\theta) &= 1-\Phi\!\left(\frac{U-m(\theta)}{\sigma}\right)\\ &= 1-\Phi\!\left(\frac{11-8}{2}\right)\\ &= 1-\Phi(1.5)\\ &\approx 1-0.9331928 = 0.0668072 \approx 0.06681. \end{aligned} $$

The model assigns about a 6.681% probability to a measurement above 11 ng/mL. As the predicted mean rises, this upper-tail probability rises. The calculation uses the event \(Y>11\), not an invented exact measurement such as 11 ng/mL.

Why Substitution Is Not the Same Likelihood

A common shortcut replaces a censored result with a fixed value, such as zero, half the LLOQ, or the LLOQ itself, and then treats that value as an exact observation. This changes the information represented by the record. The censored report establishes only which side of a threshold the measurement fell on; substitution asserts a particular numerical value and, under a continuous observation model, gives that artificial value an exact-data density contribution.

The difference can be seen directly for the below-LLOQ example. With \(L=5\) ng/mL and \(\sigma=2\) ng/mL, compare candidate means of 4 and 6 ng/mL. The censored probabilities are \(\Phi(0.5)\approx0.6915\) and \(\Phi(-0.5)\approx0.3085\), respectively. If instead the result is replaced by \(L/2=2.5\) ng/mL and treated as exact, the normal density contributions are different quantities:

$$ \begin{aligned} f(2.5\mid m=4,\sigma=2) &= \frac{1}{2\sqrt{2\pi}} \exp\!\left(-\frac{(2.5-4)^2}{2(2^2)}\right) \approx 0.1505\ \mathrm{(ng/mL)^{-1}},\\ f(2.5\mid m=6,\sigma=2) &= \frac{1}{2\sqrt{2\pi}} \exp\!\left(-\frac{(2.5-6)^2}{2(2^2)}\right) \approx 0.04314\ \mathrm{(ng/mL)^{-1}}. \end{aligned} $$

The density ratio is about \(0.1505/0.04314=3.49\), whereas the ratio of the censored probabilities is about \(0.6915/0.3085=2.24\). The substitution has therefore changed the relative support for these two candidate means, as well as replacing a dimensionless event probability with a density. The issue is not that half the LLOQ is always too high or too low; the issue is that the chosen value is not what the assay observed.

Worked Example: How Substitution Can Move an Estimate

Consider a hypothetical one-record calibration with a mean parameter \(\mu\geq0\), known assay-error standard deviation \(\sigma=2\) ng/mL, and a report \(Y<5\) ng/mL. The nonnegative constraint is included to represent a quantity that cannot be negative.

The correct likelihood is \(\Phi((5-\mu)/2)\). It decreases as \(\mu\) increases, so over \(\mu\geq0\) it is maximized at the boundary \(\hat{\mu}=0\) ng/mL. The maximum likelihood contribution is \(\Phi(2.5)\approx0.9938\).

If the report is replaced by \(L/2=2.5\) ng/mL and treated as an exact normal observation, the likelihood is proportional to \(\exp(-(2.5-\mu)^2/8)\). This is maximized at \(\hat{\mu}=2.5\) ng/mL, not at 0 ng/mL. The two estimates differ because the substituted analysis answers a different question: it fits an exact value of 2.5 ng/mL, whereas the censored likelihood fits the event \(Y<5\) ng/mL.

Implementation, Diagnostics, and Limitations

In a calibration implementation, retain each record’s status—exact, below threshold, or above threshold—and use the matching contribution at each parameter value. If \(\sigma_i\) varies by assay, concentration, or record, use that record-specific error model consistently in both the exact and censored contributions. If the observation model is specified on a transformed scale, express the threshold on that scale too. For example, a lognormal measurement model applies normal-error formulas to \(\log(Y_i)\) and the corresponding log threshold; it does not justify applying a normal model to the original scale automatically.

Check the data-processing and model assumptions before interpreting an optimization result. Verify units and threshold values for each assay, and confirm that “below” and “above” flags refer to the intended LLOQ and ULOQ. A numerical value recorded at the threshold might mean an exact measurement, rounding, or a censored report; those cases should not be conflated. Also check whether samples outside the quantification range were retained as censored records. If they were discarded and only samples inside a range were included, the data are truncated rather than merely censored: the likelihood must account for the selection condition.

Censored records do not have ordinary point residuals, because their exact values are unknown. Useful checks include comparing observed counts below and above limits with the model-implied probabilities, examining whether censoring is concentrated in particular conditions or time ranges, and checking whether fitted means and assay errors place plausible probability mass on the reported side of each threshold. A large number of censored records can leave parameters weakly informed: many different predicted means may yield similar event probabilities, especially when the predictions lie far into the same tail.

In computation, extreme tail probabilities may underflow numerically to zero. Evaluate log cumulative probabilities using stable log-CDF or log-survival-function routines rather than taking the logarithm of a rounded probability. A zero contribution caused only by numerical underflow can disrupt optimization even when the mathematical likelihood is positive. Conversely, stable computation does not repair a misspecified error distribution or an incorrectly entered threshold.

Substitution is simple but imposes an artificial exact value; discarding censored records avoids that artificial value but discards the information that the measurement crossed a threshold. The censored likelihood uses that directional information while respecting its uncertainty. It is still only as reliable as its observation model and assumptions. If the probability of a result being missing or censored depends on unrecorded factors beyond the stated measurement process, or if the assay error distribution is poorly specified, an appropriate model of that mechanism or distribution may be needed. When censored replicates are correlated, their joint probability is required; multiplying marginal tail probabilities would overstate the information as though each replicate were conditionally independent.

Key takeaway: A below- or above-quantification report contributes the probability of the reported event under the observation model. It does not contribute the density of an invented replacement value.

Check Your Understanding

For each problem, identify the appropriate likelihood contribution and compare it with the information the assay actually provides.

  1. A hypothetical assay reports \(Y<12\) units. The model mean is 10 units and \(\sigma=4\) units. What is the below-threshold likelihood contribution?
  2. An assay reports \(Y>18\) units. The model mean is 24 units and \(\sigma=4\) units. What is the above-threshold likelihood contribution?
  3. Under a normal observation model with mean 10 units and \(\sigma=2\) units, an assay reports \(8<Y<12\) units. Write and evaluate the likelihood contribution.
  4. Why is replacing a result below the LLOQ with half the LLOQ not equivalent to using a censored-data likelihood?
  5. What changes if a data set includes only measurements within the assay range, while out-of-range samples are omitted entirely?

Solutions. (1) The standardized threshold is \((12-10)/4=0.5\), so the contribution is \(\Phi(0.5)\approx0.6915\). (2) The contribution is \(1-\Phi((18-24)/4)=1-\Phi(-1.5)=\Phi(1.5)\approx0.9332\). (3) The contribution is \(\Phi((12-10)/2)-\Phi((8-10)/2)=\Phi(1)-\Phi(-1)\approx0.8413-0.1587=0.6826\), or about 0.6827 with unrounded CDF values. (4) Half-LLOQ substitution asserts an exact numerical value and uses its density; censoring contributes the probability of falling below the LLOQ. (5) Omission based on whether a result falls within the range is truncation or selection, so the likelihood must account for the probability of inclusion rather than treating the retained observations as an unselected sample.

Clinical Biostats