Tutorials › Nonlinear Mixed-Effects Models (NLME) › Applying the LLOQ on Original and Log Scales

Below-Quantification-Limit Observations · Tutorial 285 of 797

Applying the LLOQ on Original and Log Scales

Translate the LLOQ consistently between concentration and log-concentration scales, then use the model’s residual-error assumptions to formulate and interpret below-limit probabilities.

Advanced 12 min read

What You'll Learn

  • Convert an LLOQ to the matching log threshold using the model’s logarithm base and concentration units
  • Express a below-LLOQ record as the correct left-censoring event on either scale
  • Calculate conditional below-LLOQ probabilities under a log-scale normal residual model
  • Distinguish log-scale residual error from additive error on the original concentration scale
  • Identify unit, logarithm-base, and population-averaging mistakes in censoring calculations

Why the Scale of the LLOQ Matters

An assay reports a below-quantification-limit result in concentration units, but an NLME model may describe the response on a log-concentration scale. The laboratory threshold does not change when the response is transformed; its numerical representation does. The censoring event must therefore be translated using the same logarithm and units as the modeled response. Otherwise, a correctly implemented model can assign the observation the wrong probability.

The essential operation is simple: because the logarithm is strictly increasing, a concentration below the LLOQ is also a log concentration below the logarithm of the LLOQ. The important details are keeping the logarithm base, concentration units, and residual-error model consistent.

Definition: Let \(C\) be a positive concentration and \(L>0\) the assay’s lower limit of quantification (LLOQ), both expressed in the same units. For a logarithm with base \(b>1\) and a fixed reference concentration \(C_{\mathrm{ref}}\) in those units, define \(Z=\log_b(C/C_{\mathrm{ref}})\) and \(z_L=\log_b(L/C_{\mathrm{ref}})\). Then the below-LLOQ event \(C<L\) is exactly the event \(Z<z_L\). In the common natural-log convention, \(b=e\) and \(Z=\ln(C/C_{\mathrm{ref}})\).

Writing the ratio to a reference concentration makes the logarithm’s argument dimensionless. In practice, a model may write \(\ln C\) as shorthand for the logarithm of the numerical concentration in a specified unit. That convention is valid only if the same unit is used for the response, model prediction, and transformed LLOQ. Changing units shifts the numerical log values, so a model and its threshold must be shifted together.

Translating the Censoring Event

For a continuous assay response, a report of “below LLOQ” means the underlying concentration falls below the assay threshold. On the original scale, the event is \(C<L\). On a log scale, it is \(Z<z_L\), where \(z_L\) is calculated with the model’s exact logarithm convention. If the reporting rule instead includes equality, it may be written \(C\leq L\). Under a continuous residual distribution, the probability of exactly \(C=L\) is zero, so these versions have the same probability. Rounding or a discrete reporting mechanism may require more careful treatment.

This event translation does not itself specify a probability model. That comes from the assumed residual error. For example, if the modeled log response conditional on subject-level random effects is normal, the probability of a BQL record is a normal cumulative probability evaluated at the transformed threshold. If the model instead uses additive normal residual error on the original concentration scale, the probability is evaluated using \(L\), not \(\log L\). The threshold is translated to the scale of the modeled response; the error distribution is not changed by that translation.

Worked Example: Converting an LLOQ Across Units

Suppose an assay has \(L=0.050\) mg/L. The model uses the natural logarithm of concentration expressed relative to \(C_{\mathrm{ref}}=1\) mg/L. Find the log-scale threshold, then express the same threshold when concentration is recorded in µg/L.

With concentration in mg/L, the transformed threshold is

$$ z_L=\ln\left(\frac{0.050\ \mathrm{mg/L}}{1\ \mathrm{mg/L}}\right)=\ln(0.050)=-2.996. $$

The same physical threshold is \(50\) µg/L. With \(C_{\mathrm{ref}}=1\) µg/L, its numerical log threshold is

$$ z_L=\ln\left(\frac{50\ \mathrm{\mu g/L}}{1\ \mathrm{\mu g/L}}\right)=\ln(50)=3.912. $$

These numbers are not contradictory: the concentration unit changed, and the reference concentration changed with it. A model fitted to log concentrations in mg/L cannot be compared directly with the threshold \(3.912\) from the µg/L convention. The response, model predictions, and threshold must all use one consistent convention.

Below-LLOQ Probabilities Under a Log-Scale Model

Suppose the response is modeled as log concentration and, conditional on the subject’s random effects, the observation follows a normal residual model:

$$ Z_{ij}\mid \eta_i \sim N\!\left(m_{ij}(\eta_i,\theta),\sigma^2\right). $$

Here \(Z_{ij}\) is the log concentration for subject \(i\) at observation \(j\), \(m_{ij}(\eta_i,\theta)\) is its conditional model mean on the log scale, \(\eta_i\) denotes the subject-level random effects, \(\theta\) denotes the population model parameters, and \(\sigma\) is the residual standard deviation on the log scale. Under these assumptions, the probability of a BQL observation conditional on \(\eta_i\) is

$$ P(C_{ij}<L\mid\eta_i) =P(Z_{ij}<z_L\mid\eta_i) =\Phi\left(\frac{z_L-m_{ij}(\eta_i,\theta)}{\sigma}\right), $$

where \(\Phi\) is the standard normal cumulative distribution function. This is a conditional probability: it refers to the model prediction for the specified subject-level random effects. A population-average probability generally requires averaging these conditional probabilities over the random-effects distribution. It is not, in general, obtained by setting every random effect to zero and treating that single conditional probability as the population average.

Worked Example: Calculating a Conditional BQL Probability

Assume the model uses natural-log concentration in mg/L, the LLOQ is \(0.050\) mg/L, and a subject’s conditional log-scale mean at a sampling time is \(m_{ij}=\ln(0.080)=-2.526\). Let the residual standard deviation on the log scale be \(\sigma=0.350\). Calculate the probability that this observation is below the LLOQ, conditional on this subject’s random effects.

The log-scale LLOQ is \(z_L=\ln(0.050)=-2.996\). The standardized threshold is

$$ \frac{z_L-m_{ij}}{\sigma} =\frac{-2.996-(-2.526)}{0.350} =\frac{-0.470}{0.350} =-1.343. $$

Therefore,

$$ P(C_{ij}<0.050\ \mathrm{mg/L}\mid\eta_i) =\Phi(-1.343)\approx 0.0897. $$

Under the stated conditional log-scale normal model, the probability of a BQL result for this observation is about \(9.0\%\). This is a model-based probability, not a statement that the recorded BQL value has a particular unobserved concentration.

The Residual Model Determines the Probability

Applying the right threshold does not make different residual-error models equivalent. Consider an additive normal model on the original concentration scale:

$$ C_{ij}\mid\eta_i \sim N\!\left(F_{ij}(\eta_i,\theta),\sigma_C^2\right). $$

Here \(F_{ij}\) is the conditional mean concentration and \(\sigma_C\) is the residual standard deviation in concentration units. Its below-LLOQ probability is

$$ P(C_{ij}<L\mid\eta_i) =\Phi\left(\frac{L-F_{ij}(\eta_i,\theta)}{\sigma_C}\right). $$

This formula uses the original-scale LLOQ \(L\). It is not the log-scale formula with \(L\) substituted for \(z_L\). Conversely, in a log-scale model, the threshold used in the normal probability calculation is \(z_L\), not \(L\). The two models encode different distributions and can produce different BQL probabilities.

Worked Example: Same Threshold, Different Residual Models

Use \(L=0.050\) mg/L and a conditional concentration prediction of \(0.080\) mg/L. First suppose the model has additive normal residual error with \(\sigma_C=0.020\) mg/L. Then suppose it instead has normal residual error on the natural-log scale, with conditional log mean \(\ln(0.080)\) and log-scale standard deviation \(0.350\). Calculate both probabilities.

For the additive model, all quantities are on the concentration scale:

$$ P(C<L\mid\eta_i) =\Phi\left(\frac{0.050-0.080}{0.020}\right) =\Phi(-1.500) \approx 0.0668. $$

For the log-scale model, use \(z_L=\ln(0.050)=-2.996\) and \(m_{ij}=\ln(0.080)=-2.526\):

$$ P(C<L\mid\eta_i) =\Phi\left(\frac{-2.996-(-2.526)}{0.350}\right) =\Phi(-1.343) \approx 0.0897. $$

The two probabilities differ because the assumed residual distributions differ, not because the assay threshold changed. The additive normal model also assigns some probability to negative concentrations; that may be a practical limitation when concentrations must be positive. A log-scale normal model instead implies a lognormal concentration distribution.

Logarithm Bases, Likelihoods, and Interpretation

A model using base-10 logs must use a base-10 threshold. For example, if \(L=0.20\) mg/L and \(C_{\mathrm{ref}}=1\) mg/L, then \(z_L=\log_{10}(0.20)=-0.6990\). Pairing that threshold with a natural-log response would be a scale error. If the same response is represented using natural logs instead, then \(\ln(0.20)=-1.609\), and the model’s mean and residual standard deviation must also be expressed on that natural-log scale.

For a natural-log response \(Z=\ln(C/C_{\mathrm{ref}})\), changing to base-10 logs gives \(Z_{10}=Z/\ln(10)\). Thus the model mean and residual standard deviation also divide by \(\ln(10)\). A threshold cannot be converted in isolation while leaving the model’s parameters on their original scale.

There is also a distinction between the mean of log concentration and the log of mean concentration. Under the conditional normal model above, the conditional median concentration is \(C_{\mathrm{ref}}\exp(m_{ij})\), while the conditional arithmetic mean concentration is \(C_{\mathrm{ref}}\exp(m_{ij}+\sigma^2/2)\). In general, the model’s log-scale mean \(m_{ij}\) is not the logarithm of its arithmetic mean concentration. The BQL probability formula uses the log-scale mean and variance specified by the residual model; it should not silently replace \(m_{ij}\) with the log of an arithmetic mean.

For a quantified observation, a lognormal model can be expressed as a density on either the log or concentration scale. If \(Z=\ln(C/C_{\mathrm{ref}})\), the change of variables gives \(f_C(c)=f_Z(\ln(c/C_{\mathrm{ref}}))/c\). The factor \(1/c\) is the density Jacobian. For a BQL observation, the contribution is a cumulative probability, \(P(C<L)=P(Z<z_L)\), so the threshold is translated and no density Jacobian is applied to that probability.

Key result: Under a continuous log-scale residual model, the censored probability is evaluated at the transformed LLOQ using the log-scale model mean and standard deviation. The recorded BQL status contributes information that the response lies below the threshold; it does not provide an exact response value.

Checks, Alternatives, and Common Pitfalls

Before using a transformed threshold, verify that the recorded LLOQ and model response share the same concentration units and logarithm base. Then check that the residual standard deviation is on the response scale used in the probability calculation. A log-scale standard deviation is not in mg/L, and an original-scale standard deviation is not directly usable with a log threshold.

A useful diagnostic is to compare observed BQL frequencies with probabilities predicted under the fitted model, at comparable times or prediction ranges. A marked discrepancy can indicate a scale mismatch, an incorrect residual-error assumption, or a model that poorly describes concentrations near the assay limit. Such a comparison is a diagnostic, not proof that one specific component is at fault. Also verify that the model’s implied response and the assay’s reporting rule correspond to the same measurement process.

The principal alternatives differ in the assumed response scale and error structure, not in the physical meaning of “below the LLOQ.” An original-scale additive-error model uses the threshold \(L\) and an original-scale residual distribution. A log-scale normal-error model uses \(z_L\) and implies a lognormal concentration distribution. A proportional-error model on the original scale requires its own probability calculation under its specified error distribution. None should be selected merely to make a threshold calculation convenient.

  • Scale mixing: Using \(L\) in a log-scale normal CDF mixes concentration units with log units. Use \(z_L\).
  • Base mixing: Using \(\ln L\) for a base-10 model, or vice versa, changes the censoring event numerically. Match the model’s base.
  • Unit mixing: Taking a log of a threshold in one unit while predictions use another introduces an additive shift. Convert both the threshold and model representation consistently.
  • Wrong error model: Transforming \(L\) does not turn an original-scale additive-error model into a log-scale model. Use the probability formula implied by the stated residual distribution.
  • Typical-subject shortcut: A conditional probability at \(\eta_i=0\) is not generally the population-average BQL probability. The latter averages over subject-level random effects.
1
State the modeled response.
Identify whether the model response is concentration or a specified log concentration, and record its units and logarithm base.
2
Transform the assay limit if needed.
For a log response, compute \(z_L=\log_b(L/C_{\mathrm{ref}})\) using the same convention as the model.
3
Use the matching residual distribution.
Calculate the probability of falling below \(L\) or \(z_L\) according to the response scale and error model actually assumed.
4
Interpret the result at the right level.
Distinguish a probability conditional on specified random effects from a probability averaged over the population distribution.

Check Your Understanding

Answer each question, then compare with the solutions below.

  1. A natural-log model uses concentration in mg/L and has an LLOQ of \(0.10\) mg/L. What is the log-scale threshold?
  2. A base-10 model uses \(C_{\mathrm{ref}}=1\) mg/L and has an LLOQ of \(0.20\) mg/L. State the correct censored event on the modeled scale.
  3. Why is a conditional BQL probability evaluated at \(\eta_i=0\) not necessarily the population-average BQL probability?
  4. For an additive normal model on the original scale, which threshold belongs in the normal CDF: \(L\) or \(\log L\)?

Solutions. (1) \(z_L=\ln(0.10)=-2.303\), so the event is \(Z< -2.303\). (2) \(z_L=\log_{10}(0.20)=-0.6990\), and the event is \(Z< -0.6990\). (3) The value at \(\eta_i=0\) is conditional on a typical random-effect value; the population probability averages conditional probabilities over the random-effects distribution, and that average need not equal the value at zero. (4) Use \(L\), because both the modeled response and its additive residual error are on the original concentration scale.