Tutorials › Nonlinear Mixed-Effects Models (NLME) › Diagnosing Bias From BQL Handling

Below-Quantification-Limit Observations · Tutorial 307 of 797

Diagnosing Bias From BQL Handling

Use changes in fitted parameters and concentration-time profiles to identify patterns consistent with BQL deletion or substitution, while distinguishing warning signs from proof of bias.

Advanced 10 min read

What You'll Learn

  • Define what a censored-likelihood fit contributes for a BQL record.
  • Explain why deleting or substituting BQL observations can change fitted parameters.
  • Compare parameter shifts and predicted profiles across analysis methods.
  • Calculate relative changes in estimates and concentrations in hypothetical examples.
  • Recognize when method differences are weak evidence or may reflect model problems.
  • Describe assumptions and practical limitations of a bias diagnosis.

What a Change in Estimates Can—and Cannot—Tell You

A BQL record says that a concentration was below a known quantification limit; it does not say that the concentration equalled zero or any particular replacement value. If an analysis deletes that record or assigns it a fixed value, the fitted model can change because the record’s information has been discarded or altered. A useful diagnostic is therefore to compare parameter estimates and predicted concentration-time profiles from that analysis with results from a censored-likelihood analysis that uses the BQL status.

The comparison is a diagnostic of patterns consistent with bias, not a direct measurement of bias. A parameter shift may also reflect limited information, model misspecification, instability, or differences in implementation. The comparison is most interpretable when all analyses use the same subjects, quantified observations, structural model, random-effects structure, residual-error model, covariates, and estimation settings, changing only how BQL records are handled.

Definition: For subject \(i\) at time \(t_{ij}\), let the model-predicted concentration be \(f(t_{ij};\theta,\eta_i)\), where \(\theta\) denotes population parameters and \(\eta_i\) denotes subject-specific random effects. A record is BQL when its unobserved concentration is known only to be below the assay limit \(L_{ij}\). A censored-likelihood analysis uses the probability of that event; a deletion rule omits the record, and a substitution rule assigns it a fixed value.

The term M-method can refer to different operational rules. In this tutorial, it means a BQL-handling approach that deletes records, substitutes fixed values, or otherwise does not use the BQL event as a censored probability. Always identify the actual rule used before interpreting a method comparison. In particular, deletion and substitution need not have the same consequences.

Why the Censored Likelihood Is the Comparator

Suppose that, conditional on \(\eta_i\), a concentration \(Y_{ij}\) has cumulative distribution function \(F_{ij}(y\mid\theta,\eta_i)\). For a quantified result \(y_{ij}\), the likelihood uses its observation density. For a BQL record, the relevant information is the event \(Y_{ij}<L_{ij}\), whose conditional likelihood contribution is

$$ P(Y_{ij}<L_{ij}\mid\theta,\eta_i) =F_{ij}(L_{ij}\mid\theta,\eta_i). $$

For example, if the observation model is lognormal, then \(\log Y_{ij}\) is normally distributed conditional on the model parameters and random effects. The BQL contribution is the normal probability that \(\log Y_{ij}<\log L_{ij}\), not the density evaluated at \(L_{ij}/2\). In a mixed-effects likelihood, the contributions are combined across records and subjects while accounting for the distribution of the random effects.

A substitution instead treats a chosen value—perhaps \(L_{ij}/2\)—as if it were an observed concentration. Deletion uses neither the event probability nor a concentration value for that record. Both approaches can discard information about where a model’s predicted distribution lies relative to the limit. Their effect depends on the timing and frequency of BQL records, the residual model, and how model parameters jointly determine the profile.

Why Deletion and Substitution Can Shift a Profile

A simple derivation shows why deleting BQL values can affect a fit. Consider a log-concentration \(Z\sim N(\mu,\sigma^2)\) and a log-limit \(\ell=\log L\). If values below \(\ell\) are deleted, the retained values follow a truncated distribution. With \(a=(\ell-\mu)/\sigma\), its mean is

$$ E(Z\mid Z\geq \ell) =\mu+\sigma\frac{\phi(a)}{1-\Phi(a)} >\mu, $$

where \(\phi\) and \(\Phi\) are the standard normal density and cumulative distribution function. The inequality holds because \(\sigma>0\), \(\phi(a)>0\), and \(1-\Phi(a)>0\). Thus the retained values tend to be higher than the unconditional mean at that time. In a declining profile, deletion often removes more late, low concentrations and can make the apparent decline shallower. This is a direction to watch for, not a guaranteed direction for every fitted NLME parameter: correlations, nonlinear parameterization, and the pattern of available samples can alter the result.

Substitution can create a different pattern. Replacing several BQL values with the same positive number can create an artificial plateau near that number. A fitted model may then predict concentrations that decline too slowly at late times or shift parameters controlling disposition. If the replacement is zero, log-scale analyses may be undefined, and even on the original scale zero is not the information conveyed by a BQL result. These mechanisms motivate checking both estimates and predictions rather than interpreting a parameter shift in isolation.

Worked Example: A Late-Phase Plateau After Substitution

Hypothetical data. A one-compartment terminal profile is summarized by \(C(t)=C_0e^{-kt}\), with time in hours and concentration in mg/L. The assay limit is \(4\) mg/L. Quantified concentrations are \(16\) mg/L at 1 hour and \(8\) mg/L at 3 hours; records at 5 and 7 hours are BQL. For a simple illustration, use the two quantified points to calculate the terminal rate constant, then compare the implications of substituting \(L/2\) for both BQL values.

The quantified observations give \(k=\{\log(16)-\log(8)\}/(3-1)=\log(2)/2=0.3466\ \text{h}^{-1}\). The corresponding 1-hour prediction is \(C_0=16e^{0.3466}=22.63\) mg/L. This profile predicts \(C(5)=16e^{-4k}=16e^{-2\log(2)}=4\) mg/L and \(C(7)=16e^{-6k}=16e^{-3\log(2)}=2\) mg/L; the 5-hour prediction equals the \(4\) mg/L limit, and only the 7-hour prediction is below it.

If each BQL record is substituted by \(L/2=2\) mg/L, the two late records are treated as quantified values at 2 mg/L. The concentration at 7 hours is then represented as 2 rather than as an unknown value below 4. The replacement equals this particular model’s \(2\) mg/L prediction at 7 hours and is below its \(4\) mg/L prediction at 5 hours, so these comparisons do not show the substitutions pulling this profile upward. A full NLME fit may respond in ways that depend on the data and model; this constructed example does not establish a unique parameter response.

Diagnostic interpretation. If a fit using \(L/2\) produces a flatter late profile than the censored-likelihood fit, and the substituted values are above the censored fit’s predictions, that pattern is consistent with upward substitution bias in the terminal phase. It is not proof: the full fitted result must also be checked for changes in other parameters and uncertainty.

Comparing Estimates and Predictions in Practice

A practical comparison starts with a prespecified censored-likelihood analysis and one clearly defined M-method analysis. For each, record the same population parameter estimates, their uncertainty, and model-predicted concentrations at clinically relevant times. A relative parameter change can be summarized as \((\hat\theta_{\mathrm{M}}-\hat\theta_{\mathrm{cens}})/\hat\theta_{\mathrm{cens}}\times100\%\), provided the censored estimate is not near zero and the parameter scale makes a percentage meaningful. For a profile, report absolute differences in concentration with units as well as relative differences when appropriate.

Consider the following hypothetical NLME fits. Both use the same structural model and quantified observations; only BQL handling differs. The reported clearance and volume are positive, so percentage comparisons are interpretable.

AnalysisClearance (L/h)Volume (L)Predicted concentration at 24 h (mg/L)
Censored likelihood5.0050.01.20
Delete BQL records4.0050.01.80
Substitute \(L/2\)3.5050.02.10

Worked Example: Quantifying a Deletion-Associated Shift

Hypothetical fit results. Using the table above, compare deletion with censored likelihood. The clearance change is \((4.00-5.00)/5.00\times100\%=-20.0\%\). The 24-hour predicted concentration changes by \(1.80-1.20=0.600\) mg/L, or \((0.600/1.20)\times100\%=50.0\%\).

The deletion fit therefore has a 20.0% lower clearance estimate and a 50.0% higher predicted concentration at 24 hours than the censored fit. If BQL observations are concentrated late in the profile, this lower-clearance, higher-late-concentration pattern is consistent with deletion removing evidence about low terminal concentrations. It does not establish that deletion caused the entire change; uncertainty, convergence, and the data’s information content still matter.

Worked Example: Comparing Substitution With Deletion

Hypothetical fit results. Compare the substitution estimates with the deletion estimates in the table. Clearance changes by \((3.50-4.00)/4.00\times100\%=-12.5\%\). The 24-hour prediction changes by \(2.10-1.80=0.300\) mg/L, or \((0.300/1.80)\times100\%=16.7\%\).

In this constructed comparison, substitution produces a further reduction in estimated clearance and a higher late predicted concentration than deletion. This ordering is consistent with the substituted values pulling the late profile upward more strongly than simply omitting those records. It is not a general ranking: another replacement rule, limit, sampling schedule, or error model could produce a different shift.

Assumptions, Diagnostics, and Limits

Interpret method differences as evidence about BQL handling only when the comparison is controlled. The censoring limit and BQL status must be correctly recorded; the observation model must describe the quantified values and the censoring mechanism; and the compared fits must otherwise use the same model and data. In particular, if a different residual-error model or random-effects structure is used in one fit, the parameter shift cannot be attributed specifically to BQL handling.

Useful checks include the following:

  • Map BQL records in time. A concentration of BQL records in the terminal phase makes changes in terminal predictions especially relevant; BQL records at other times may affect different profile features.
  • Compare the full profile, not just one parameter. Inspect predictions at times with quantified and BQL records, and note whether changes are concentrated where the handling methods differ.
  • Check estimate uncertainty and stability. Small or poorly identified data sets can yield substantial parameter changes across fits even when no single handling rule is the sole explanation.
  • Check numerical fit quality. Failed convergence, boundary estimates, or markedly different optimization behavior weaken a direct interpretation of the comparison.
  • Check whether the change is coherent. A parameter shift that accompanies a profile change in the time region containing many BQL records is more suggestive than an isolated shift with little predicted-profile change.

The comparison has important limitations. A censored likelihood is not automatically correct if its structural or residual model is wrong, or if the assay limit has been misrecorded. Likewise, agreement between two methods does not show that either is unbiased: the data may contain too little information to distinguish their consequences. A large difference is a warning to investigate, not a formal test of bias. This diagnostic also does not, by itself, select a preferred method or resolve identifiability when most samples are BQL.

Common pitfall: “The deletion estimate is lower than the censored-likelihood estimate, so deletion must always underestimate this parameter.” This conclusion overgeneralizes one comparison. The direction and size of a shift depend on the parameterization, timing and frequency of BQL records, residual model, and relationships among parameters. Instead, describe the observed shift, check whether the predicted-profile change occurs where BQL records occur, and treat the pattern as evidence consistent with—not proof of—a handling effect.

Choosing the Right Interpretation

Deletion and substitution alter the information used by the fit in distinct ways, while a censored likelihood directly represents the event that a concentration fell below the limit. The main comparison is therefore not “which estimate changed?” alone. Ask whether parameter changes and profile changes are coherent with the BQL pattern, whether the analysis conditions were held constant, and whether uncertainty and fit stability support the comparison.

A concise report should name the handling rule, give the censored and M-method estimates with units, quantify important differences, and describe the predicted-profile changes in context. Use language such as “consistent with a flatter late profile under substitution,” rather than claiming that a single comparison proves bias. That distinction keeps a useful diagnostic from being mistaken for a definitive causal explanation.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. A censored fit estimates clearance at 8.0 L/h and a deletion fit estimates 6.0 L/h. What is the relative change from the censored estimate, and what can be concluded?
  2. Why is a BQL record not correctly represented by evaluating the observation density at \(L/2\)?
  3. Suppose substitution raises predicted concentrations mainly at late times, where most records are BQL. What pattern might this be consistent with, and why is it not proof?
  4. Two analyses differ in both BQL handling and residual-error model. Can their estimate difference be attributed specifically to BQL handling? Explain.
  5. What does agreement between deletion and censored-likelihood estimates establish?

Solutions. 1. The change is \((6.0-8.0)/8.0\times100\%=-25.0\%\). It is a 25.0% lower estimate under deletion, a pattern to investigate, not proof that deletion caused the whole difference. 2. BQL states an event, \(Y<L\), so the likelihood contribution is the probability \(P(Y<L)\); \(L/2\) is an invented point value and does not encode the event probability. 3. It is consistent with substitution pulling the late profile upward, potentially flattening the decline; other model or data features could also explain it. 4. No. The residual model is a second changed analysis feature, so the effects cannot be separated by that comparison. 5. It establishes only that these two fits give similar estimates for this data and setup; it does not prove either estimate is unbiased or that the data are informative enough to distinguish methods.