What a Change in Estimates Can—and Cannot—Tell You
A BQL record says that a concentration was below a known quantification limit; it does not say that the concentration equalled zero or any particular replacement value. If an analysis deletes that record or assigns it a fixed value, the fitted model can change because the record’s information has been discarded or altered. A useful diagnostic is therefore to compare parameter estimates and predicted concentration-time profiles from that analysis with results from a censored-likelihood analysis that uses the BQL status.
The comparison is a diagnostic of patterns consistent with bias, not a direct measurement of bias. A parameter shift may also reflect limited information, model misspecification, instability, or differences in implementation. The comparison is most interpretable when all analyses use the same subjects, quantified observations, structural model, random-effects structure, residual-error model, covariates, and estimation settings, changing only how BQL records are handled.
The term M-method can refer to different operational rules. In this tutorial, it means a BQL-handling approach that deletes records, substitutes fixed values, or otherwise does not use the BQL event as a censored probability. Always identify the actual rule used before interpreting a method comparison. In particular, deletion and substitution need not have the same consequences.
Why the Censored Likelihood Is the Comparator
Suppose that, conditional on \(\eta_i\), a concentration \(Y_{ij}\) has cumulative distribution function \(F_{ij}(y\mid\theta,\eta_i)\). For a quantified result \(y_{ij}\), the likelihood uses its observation density. For a BQL record, the relevant information is the event \(Y_{ij}<L_{ij}\), whose conditional likelihood contribution is
For example, if the observation model is lognormal, then \(\log Y_{ij}\) is normally distributed conditional on the model parameters and random effects. The BQL contribution is the normal probability that \(\log Y_{ij}<\log L_{ij}\), not the density evaluated at \(L_{ij}/2\). In a mixed-effects likelihood, the contributions are combined across records and subjects while accounting for the distribution of the random effects.
A substitution instead treats a chosen value—perhaps \(L_{ij}/2\)—as if it were an observed concentration. Deletion uses neither the event probability nor a concentration value for that record. Both approaches can discard information about where a model’s predicted distribution lies relative to the limit. Their effect depends on the timing and frequency of BQL records, the residual model, and how model parameters jointly determine the profile.
Why Deletion and Substitution Can Shift a Profile
A simple derivation shows why deleting BQL values can affect a fit. Consider a log-concentration \(Z\sim N(\mu,\sigma^2)\) and a log-limit \(\ell=\log L\). If values below \(\ell\) are deleted, the retained values follow a truncated distribution. With \(a=(\ell-\mu)/\sigma\), its mean is
where \(\phi\) and \(\Phi\) are the standard normal density and cumulative distribution function. The inequality holds because \(\sigma>0\), \(\phi(a)>0\), and \(1-\Phi(a)>0\). Thus the retained values tend to be higher than the unconditional mean at that time. In a declining profile, deletion often removes more late, low concentrations and can make the apparent decline shallower. This is a direction to watch for, not a guaranteed direction for every fitted NLME parameter: correlations, nonlinear parameterization, and the pattern of available samples can alter the result.
Substitution can create a different pattern. Replacing several BQL values with the same positive number can create an artificial plateau near that number. A fitted model may then predict concentrations that decline too slowly at late times or shift parameters controlling disposition. If the replacement is zero, log-scale analyses may be undefined, and even on the original scale zero is not the information conveyed by a BQL result. These mechanisms motivate checking both estimates and predictions rather than interpreting a parameter shift in isolation.
Worked Example: A Late-Phase Plateau After Substitution
Hypothetical data. A one-compartment terminal profile is summarized by \(C(t)=C_0e^{-kt}\), with time in hours and concentration in mg/L. The assay limit is \(4\) mg/L. Quantified concentrations are \(16\) mg/L at 1 hour and \(8\) mg/L at 3 hours; records at 5 and 7 hours are BQL. For a simple illustration, use the two quantified points to calculate the terminal rate constant, then compare the implications of substituting \(L/2\) for both BQL values.
The quantified observations give \(k=\{\log(16)-\log(8)\}/(3-1)=\log(2)/2=0.3466\ \text{h}^{-1}\). The corresponding 1-hour prediction is \(C_0=16e^{0.3466}=22.63\) mg/L. This profile predicts \(C(5)=16e^{-4k}=16e^{-2\log(2)}=4\) mg/L and \(C(7)=16e^{-6k}=16e^{-3\log(2)}=2\) mg/L; the 5-hour prediction equals the \(4\) mg/L limit, and only the 7-hour prediction is below it.
If each BQL record is substituted by \(L/2=2\) mg/L, the two late records are treated as quantified values at 2 mg/L. The concentration at 7 hours is then represented as 2 rather than as an unknown value below 4. The replacement equals this particular model’s \(2\) mg/L prediction at 7 hours and is below its \(4\) mg/L prediction at 5 hours, so these comparisons do not show the substitutions pulling this profile upward. A full NLME fit may respond in ways that depend on the data and model; this constructed example does not establish a unique parameter response.
Diagnostic interpretation. If a fit using \(L/2\) produces a flatter late profile than the censored-likelihood fit, and the substituted values are above the censored fit’s predictions, that pattern is consistent with upward substitution bias in the terminal phase. It is not proof: the full fitted result must also be checked for changes in other parameters and uncertainty.
Comparing Estimates and Predictions in Practice
A practical comparison starts with a prespecified censored-likelihood analysis and one clearly defined M-method analysis. For each, record the same population parameter estimates, their uncertainty, and model-predicted concentrations at clinically relevant times. A relative parameter change can be summarized as \((\hat\theta_{\mathrm{M}}-\hat\theta_{\mathrm{cens}})/\hat\theta_{\mathrm{cens}}\times100\%\), provided the censored estimate is not near zero and the parameter scale makes a percentage meaningful. For a profile, report absolute differences in concentration with units as well as relative differences when appropriate.
Consider the following hypothetical NLME fits. Both use the same structural model and quantified observations; only BQL handling differs. The reported clearance and volume are positive, so percentage comparisons are interpretable.
| Analysis | Clearance (L/h) | Volume (L) | Predicted concentration at 24 h (mg/L) |
|---|---|---|---|
| Censored likelihood | 5.00 | 50.0 | 1.20 |
| Delete BQL records | 4.00 | 50.0 | 1.80 |
| Substitute \(L/2\) | 3.50 | 50.0 | 2.10 |
Worked Example: Quantifying a Deletion-Associated Shift
Hypothetical fit results. Using the table above, compare deletion with censored likelihood. The clearance change is \((4.00-5.00)/5.00\times100\%=-20.0\%\). The 24-hour predicted concentration changes by \(1.80-1.20=0.600\) mg/L, or \((0.600/1.20)\times100\%=50.0\%\).
The deletion fit therefore has a 20.0% lower clearance estimate and a 50.0% higher predicted concentration at 24 hours than the censored fit. If BQL observations are concentrated late in the profile, this lower-clearance, higher-late-concentration pattern is consistent with deletion removing evidence about low terminal concentrations. It does not establish that deletion caused the entire change; uncertainty, convergence, and the data’s information content still matter.
Worked Example: Comparing Substitution With Deletion
Hypothetical fit results. Compare the substitution estimates with the deletion estimates in the table. Clearance changes by \((3.50-4.00)/4.00\times100\%=-12.5\%\). The 24-hour prediction changes by \(2.10-1.80=0.300\) mg/L, or \((0.300/1.80)\times100\%=16.7\%\).
In this constructed comparison, substitution produces a further reduction in estimated clearance and a higher late predicted concentration than deletion. This ordering is consistent with the substituted values pulling the late profile upward more strongly than simply omitting those records. It is not a general ranking: another replacement rule, limit, sampling schedule, or error model could produce a different shift.
Assumptions, Diagnostics, and Limits
Interpret method differences as evidence about BQL handling only when the comparison is controlled. The censoring limit and BQL status must be correctly recorded; the observation model must describe the quantified values and the censoring mechanism; and the compared fits must otherwise use the same model and data. In particular, if a different residual-error model or random-effects structure is used in one fit, the parameter shift cannot be attributed specifically to BQL handling.
Useful checks include the following:
- Map BQL records in time. A concentration of BQL records in the terminal phase makes changes in terminal predictions especially relevant; BQL records at other times may affect different profile features.
- Compare the full profile, not just one parameter. Inspect predictions at times with quantified and BQL records, and note whether changes are concentrated where the handling methods differ.
- Check estimate uncertainty and stability. Small or poorly identified data sets can yield substantial parameter changes across fits even when no single handling rule is the sole explanation.
- Check numerical fit quality. Failed convergence, boundary estimates, or markedly different optimization behavior weaken a direct interpretation of the comparison.
- Check whether the change is coherent. A parameter shift that accompanies a profile change in the time region containing many BQL records is more suggestive than an isolated shift with little predicted-profile change.
The comparison has important limitations. A censored likelihood is not automatically correct if its structural or residual model is wrong, or if the assay limit has been misrecorded. Likewise, agreement between two methods does not show that either is unbiased: the data may contain too little information to distinguish their consequences. A large difference is a warning to investigate, not a formal test of bias. This diagnostic also does not, by itself, select a preferred method or resolve identifiability when most samples are BQL.
Choosing the Right Interpretation
Deletion and substitution alter the information used by the fit in distinct ways, while a censored likelihood directly represents the event that a concentration fell below the limit. The main comparison is therefore not “which estimate changed?” alone. Ask whether parameter changes and profile changes are coherent with the BQL pattern, whether the analysis conditions were held constant, and whether uncertainty and fit stability support the comparison.
A concise report should name the handling rule, give the censored and M-method estimates with units, quantify important differences, and describe the predicted-profile changes in context. Use language such as “consistent with a flatter late profile under substitution,” rather than claiming that a single comparison proves bias. That distinction keeps a useful diagnostic from being mistaken for a definitive causal explanation.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions.
- A censored fit estimates clearance at 8.0 L/h and a deletion fit estimates 6.0 L/h. What is the relative change from the censored estimate, and what can be concluded?
- Why is a BQL record not correctly represented by evaluating the observation density at \(L/2\)?
- Suppose substitution raises predicted concentrations mainly at late times, where most records are BQL. What pattern might this be consistent with, and why is it not proof?
- Two analyses differ in both BQL handling and residual-error model. Can their estimate difference be attributed specifically to BQL handling? Explain.
- What does agreement between deletion and censored-likelihood estimates establish?
Solutions. 1. The change is \((6.0-8.0)/8.0\times100\%=-25.0\%\). It is a 25.0% lower estimate under deletion, a pattern to investigate, not proof that deletion caused the whole difference. 2. BQL states an event, \(Y<L\), so the likelihood contribution is the probability \(P(Y<L)\); \(L/2\) is an invented point value and does not encode the event probability. 3. It is consistent with substitution pulling the late profile upward, potentially flattening the decline; other model or data features could also explain it. 4. No. The residual model is a second changed analysis feature, so the effects cannot be separated by that comparison. 5. It establishes only that these two fits give similar estimates for this data and setup; it does not prove either estimate is unbiased or that the data are informative enough to distinguish methods.