Tutorials › Nonlinear Mixed-Effects Models (NLME) › Avoiding Log Transformation of Substituted BQL Values

Below-Quantification-Limit Observations · Tutorial 312 of 797

Avoiding Log Transformation of Substituted BQL Values

See how BQL records contribute probabilities—not densities at substituted values—to a nonlinear mixed-effects likelihood.

Advanced 12 min read

What You'll Learn

  • Distinguish a BQL event from a quantified concentration and from a missing observation.
  • Derive the BQL likelihood contribution under a lognormal observation model.
  • Explain why logging a substituted BQL value creates an artificial point observation.
  • Calculate and compare event probabilities and substituted-point densities.
  • Account for shared subject random effects when there are repeated BQL samples.
  • Identify diagnostics that can reveal problems with substitution-based analyses.

Why a BQL record is not a small measured concentration

A below-quantification-limit (BQL) record says that a concentration fell below an assay’s lower limit of quantification (LLOQ). It does not say that the concentration equalled zero, half the LLOQ, or any other chosen replacement value. This distinction matters especially when the observation model is lognormal: logging a replacement turns an inequality into an apparently exact number, changing the information supplied to the likelihood.

The correct contribution for a BQL observation is the probability of falling below the LLOQ under the model. That probability is evaluated on the concentration scale, or equivalently as a cumulative probability after a monotone log transformation. It is not the density evaluated at a substituted concentration.

Definition: Let \(Y_{ij}\) be the latent concentration for subject \(i\) at observation time \(j\), and let \(L_{ij}>0\) be its LLOQ. A quantified record supplies an observed concentration \(y_{ij}\) and contributes its observation density at \(y_{ij}\). A BQL record supplies the event \(Y_{ij}<L_{ij}\) and contributes \(P(Y_{ij}<L_{ij}\mid\text{model})\). The symbol \(Y_{ij}\) denotes the concentration generated by the model, whether or not its exact value is reported.

The distinction is between a point and a region. A quantified value such as \(y_{ij}=1.4\) mg/L identifies a point at which a density is evaluated. A BQL report with LLOQ \(1.0\) mg/L identifies the whole interval \(0<Y_{ij}<1.0\) mg/L. Substitution selects one point from that interval without evidence that it was the actual concentration.

The probability-scale contribution under a lognormal model

Suppose, conditional on a subject’s random effects, the observation model is

$$ \log Y_{ij}=\log \mu_{ij}+\epsilon_{ij}, \qquad \epsilon_{ij}\sim N(0,\sigma^2), $$

where \(\mu_{ij}>0\) is the model-predicted median concentration and \(\sigma\) is the residual standard deviation on the log scale. This specifies a lognormal concentration distribution. It assumes that the residual is normal on the log scale with the stated variance; a BQL result is interpreted as censoring at the known LLOQ, not as a separate exact concentration.

Because the logarithm is strictly increasing for positive concentrations, \(Y_{ij}<L_{ij}\) is equivalent to \(\log Y_{ij}<\log L_{ij}\). Standardizing the normal variable gives the conditional BQL probability:

$$ \begin{aligned} P(Y_{ij}<L_{ij}\mid \eta_i) &=P\left(\log Y_{ij}<\log L_{ij}\mid\eta_i\right)\\ &=\Phi\left(\frac{\log L_{ij}-\log\mu_{ij}(\eta_i)}{\sigma}\right), \end{aligned} $$

Here \(\eta_i\) denotes the subject-specific random effects, and \(\Phi\) is the standard normal cumulative distribution function. The conditional mean structure may depend on time, dose, fixed effects, and \(\eta_i\); the formula applies once that structure and the residual model are specified. A quantified observation instead has conditional density

$$ f_Y(y_{ij}\mid\eta_i) =\frac{1}{y_{ij}\sigma\sqrt{2\pi}} \exp\left[-\frac{\{\log y_{ij}-\log\mu_{ij}(\eta_i)\}^2}{2\sigma^2}\right], \qquad y_{ij}>0. $$

This is a density per concentration unit. If the likelihood is expressed using the log-concentration \(z=\log y\), its density is the normal density per log-concentration unit. The two density forms are related by the change-of-variables factor \(1/y\). For BQL data, however, the relevant quantity is a probability, so no point-density Jacobian is needed.

Worked Example: A BQL Probability for a Lognormal Observation

Consider a hypothetical sample with LLOQ \(L=1.0\) mg/L, model-predicted median \(\mu=2.0\) mg/L, and log-scale residual standard deviation \(\sigma=0.50\). Calculate the probability of a BQL result under the model.

The standardized threshold is

$$ \frac{\log L-\log\mu}{\sigma} =\frac{\log(1.0)-\log(2.0)}{0.50} =\frac{-0.6931}{0.50} =-1.3862. $$

Therefore,

$$ P(Y<1.0\text{ mg/L})=\Phi(-1.3862)\approx 0.0828. $$

The model assigns about an 8.28% probability to a BQL result at this observation. If the record is BQL, its likelihood contribution is approximately \(0.0828\), conditional on the stated model values. It is not a density at \(0.5\) mg/L, even if an analyst chooses half the LLOQ as a replacement.

Why substitution followed by logging changes the likelihood

Suppose a BQL concentration is replaced by \(c^*\), such as \(L/2\), and then transformed to \(\log c^*\). A conventional point-observation likelihood treats that number as if the measured concentration were exactly \(c^*\). The resulting contribution is a density at \(c^*\), or a normal density at \(\log c^*\) if the analysis is written on the log scale. Neither is the probability of the event \(Y<L\).

This replacement changes more than the numerical value used in a calculation. It imposes a false observation: it locates the censored value at a particular point and gives it the precision of an exact observation. The chosen replacement can therefore alter parameter estimates, residual patterns, and uncertainty. Logging does not restore the information lost by replacing an inequality with a point.

Worked Example: Event Probability Versus Substituted-Point Density

Use the hypothetical LLOQ \(L=1.0\) mg/L and \(\sigma=0.50\) from above. Compare two models: Model A has median \(\mu_A=0.50\) mg/L, and Model B has median \(\mu_B=2.0\) mg/L. First compare the likelihood contributions for a BQL event.

For Model A, the standardized threshold is \(\{\log(1)-\log(0.50)\}/0.50=1.3862\), so \(P(Y<1\mid A)=\Phi(1.3862)\approx0.9172\). For Model B, it is \(-1.3862\), so \(P(Y<1\mid B)=\Phi(-1.3862)\approx0.0828\). Thus, the event-probability ratio, calculated from the unrounded CDF values, is approximately 11.07. This compares how well each model predicts the observed event \(Y<1\).

Now suppose the BQL result is replaced by \(c^*=L/2=0.50\) mg/L. Its logged value is \(\log(0.50)=-0.6931\). Under Model A, the log-scale normal density at that value is

$$ f_Z(-0.6931\mid A) =\frac{1}{0.50\sqrt{2\pi}} \exp\left[-\frac{(-0.6931-(-0.6931))^2}{2(0.50)^2}\right] \approx 0.7979 $$

per log-concentration unit. Under Model B, the corresponding density is

$$ \begin{aligned} f_Z(-0.6931\mid B) &=\frac{1}{0.50\sqrt{2\pi}} \exp\left[-\frac{(-0.6931-0.6931)^2}{2(0.50)^2}\right]\\ &=\frac{1}{0.50\sqrt{2\pi}}\exp(-3.8431) \approx 0.01710 \end{aligned} $$

per log-concentration unit. The substituted-point density ratio is therefore approximately \(0.7979/0.01710=46.7\), not the event-probability ratio of about 11.07. Both calculations use the same two models, but they answer different questions: one evaluates a density at an invented point, while the other evaluates the probability of the reported BQL event. In concentration units, each point density also includes the factor \(1/c^*\); because the same \(c^*\) is used in both models, that factor cancels in this ratio.

Including subject random effects

In a nonlinear mixed-effects model, observations from the same subject share random effects. The appropriate subject likelihood first forms contributions conditional on \(\eta_i\), then integrates over the random-effects distribution. If quantified and BQL observations are conditionally independent given \(\eta_i\), a subject’s conditional likelihood is the product of density contributions for quantified records and CDF contributions for BQL records. The marginal subject likelihood is the expectation of that product over \(\eta_i\).

$$ L_i =\int \left\{\prod_{j\in Q_i}f_Y(y_{ij}\mid\eta_i)\right\} \left\{\prod_{j\in B_i} \Phi\left(\frac{\log L_{ij}-\log\mu_{ij}(\eta_i)}{\sigma}\right)\right\} p(\eta_i)\,d\eta_i . $$

Here \(Q_i\) and \(B_i\) are the sets of quantified and BQL records for subject \(i\), respectively, and \(p(\eta_i)\) is the random-effects density. Conditional independence is an assumption of this expression; if the observation errors have a different dependence structure, the appropriate joint conditional probability or density must be used. Crucially, the integral is over the product of conditional contributions. Shared random effects generally make repeated observations dependent after integration.

Worked Example: Two BQL Samples Share a Random Effect

For a compact hypothetical calculation, let a subject have a random effect \(\eta\) that takes values \(-0.50\) and \(+0.50\) with probability \(1/2\) each. Let the two observations have LLOQ \(1\) mg/L, conditional log-concentration mean \(\eta\), and independent conditional residuals with \(\sigma=0.40\). This two-point random-effects distribution is used only to make the integration arithmetic explicit.

At either observation, conditional on \(\eta=-0.50\), the BQL probability is \(\Phi\{(0-(-0.50))/0.40\}=\Phi(1.25)\approx0.8944\). Conditional on \(\eta=+0.50\), it is \(\Phi(-1.25)\approx0.1056\). The marginal probability of BQL at one observation is therefore \((0.8944+0.1056)/2=0.5000\).

For two BQL records from the same subject, conditional independence gives the probability of both BQL at \(\eta=-0.50\) as \(0.8944^2\), and at \(\eta=+0.50\) as \(0.1056^2\). Integrating the conditional joint probability gives

$$ P(\text{both BQL}) =\frac{\Phi(1.25)^2+\Phi(-1.25)^2}{2} \approx 0.4055. $$

Multiplying the two marginal probabilities would instead give \(0.5000^2=0.2500\), which is not the joint probability. The shared random effect makes the two BQL outcomes associated marginally. The example also shows why the correct mixed-effects calculation integrates the conditional likelihood, rather than replacing each BQL result with a value and treating all observations as exact.

Practical checks and common pitfalls

The probability-scale method relies on a clearly specified observation model and threshold. Check that the LLOQ is correct for each record, that the concentration distribution has support above zero when a log model is used, and that the residual distribution and conditional-dependence assumptions are appropriate. If the assay reports a different censoring event, such as a value below a limit that varies by sample, use that event and its corresponding threshold. A record known only to be BQL is not automatically a missing-at-random observation; its likelihood contains information through the threshold event.

Useful diagnostics include comparing observed and model-predicted BQL frequencies across time, dose, and relevant subgroups; checking whether BQL records cluster in regions where the model predicts very few; and inspecting whether residual or prediction summaries improperly treat substituted values as exact. Predictions for the frequency of BQL samples should be calculated from the model’s event probabilities, not by counting replacement values as if they were observed concentrations. A mismatch can indicate problems in the structural model, residual model, random-effects distribution, assay thresholds, or data handling.

The main alternative is substitution-based analysis: replace each BQL value with a fixed amount and fit an ordinary observation likelihood. It can be easy to implement, but its result depends on the chosen replacement and it does not represent censoring in the likelihood. A censored likelihood instead retains the actual event and can use the observation model’s probability for that event. It requires a suitable probability calculation and, in a mixed-effects model, integration over random effects. That computational requirement is not a reason to interpret a substituted point as measured data.

Common mistake: “The sample was BQL, so I can set it to half the LLOQ, take its logarithm, and fit the lognormal model; the log transformation makes the replacement reasonable.” The correction is that \(\log(L/2)\) is still an invented point. The record supplies \(Y<L\), whose contribution is \(P(Y<L\mid\eta_i)\), followed by the appropriate random-effects integration. A point density at \(L/2\) answers a different question.

Substitution may also fail at the most basic mathematical level: replacing a BQL value by zero makes \(\log(0)\) undefined. Replacing it by a positive number avoids that computational problem but not the inferential one. More generally, censoring likelihoods depend on the assumed model below the LLOQ; if that model is misspecified or the data contain assay features not represented in it, the resulting probabilities may still be unreliable. Probability-scale treatment correctly represents the stated censoring event, but it does not guarantee that every model assumption is true.

Key takeaway: A BQL record is an inequality, not a concentration value. Under a lognormal observation model, use the normal probability below the logged LLOQ, conditional on random effects, and integrate the resulting subject likelihood over those effects.

Check Your Understanding

Answer each question using the distinction between an event probability and a point density.

  1. For \(\log Y=\log\mu+\epsilon\), with \(\epsilon\sim N(0,\sigma^2)\), write the conditional likelihood contribution of a BQL record with LLOQ \(L\).
  2. A hypothetical sample has LLOQ \(2\) mg/L, median \(1\) mg/L, and log-scale residual standard deviation \(0.50\). What is its model-predicted BQL probability?
  3. Why is the density at \(L/2\) not the likelihood contribution for the statement \(Y<L\)?
  4. Why can the probability of two BQL records for one subject differ from the product of their marginal BQL probabilities?

Solutions. (1) The contribution conditional on \(\eta_i\) is \(\Phi\{[\log L-\log\mu_{ij}(\eta_i)]/\sigma\}\). (2) The standardized threshold is \(\{\log(2)-\log(1)\}/0.50=0.6931/0.50=1.3862\), so the BQL probability is \(\Phi(1.3862)\approx0.9172\). (3) The density at \(L/2\) treats that chosen value as an exact point observation, whereas \(Y<L\) describes an interval whose likelihood contribution is the probability integrated over that interval. (4) Repeated records share the subject’s random effects. Their conditional probabilities are multiplied first and then integrated over the shared effects; in general, this is not equal to multiplying separately integrated marginal probabilities.