Tutorials › Nonlinear Mixed-Effects Models (NLME) › Identifiability When Most Samples Are BQL

Below-Quantification-Limit Observations · Tutorial 306 of 797

Identifiability When Most Samples Are BQL

Learn to recognize when many BQL observations leave disposition parameters weakly identified, and how to tell limited data information from a numerical optimization problem.

Advanced 12 min read

What You'll Learn

  • Explain why BQL records often provide less information about disposition parameters than quantified concentrations.
  • Calculate likelihood contributions for BQL observations under an additive residual-error model.
  • Identify parameter combinations that remain compatible with sparse quantified data.
  • Use profile likelihoods, curvature, and repeated fits to investigate weak identification.
  • Distinguish a flat likelihood from evidence that an optimizer has failed.
  • Recognize how sampling times and assay limits affect parameter information.

Why Extensive Censoring Can Leave Parameters Uncertain

A BQL record is not a measured concentration at zero or at the assay limit. It tells us that the underlying assay result fell below a threshold. When most samples are BQL, the data may therefore give a clear indication that concentrations are low without indicating how low. That distinction can matter greatly for disposition parameters such as clearance and volume.

The issue is not simply the proportion of BQL records. Information also depends on when samples were taken, the assay’s lower limit of quantification (LLOQ), residual variability, and whether the quantified concentrations distinguish the parameters of interest. A dataset with many late BQL records may still estimate an early exposure parameter well, while providing little information about the terminal decline.

Definition: A parameter is structurally identifiable if, in the idealized model and with sufficiently informative error-free observations, distinct parameter values imply distinct observable distributions. It is practically identifiable when the available data estimate it with useful precision. Practical identifiability can be poor even when structural identifiability holds. With extensive censoring, a range of parameter values may give nearly the same likelihood; the data then provide weak practical identification.

A PK Model and a Censored-Data Likelihood

Consider a one-compartment model after an intravenous bolus dose \(D\). For individual \(i\), let \(CL_i\) be clearance and \(V_i\) be volume of distribution. The predicted concentration at time \(t\) is

$$ f_i(t)=\frac{D}{V_i}\exp\left(-\frac{CL_i}{V_i}t\right). $$

A basic NLME parameterization allows individual disposition parameters to vary around population values: \(CL_i=CL_{\text{pop}}\exp(\eta_{CL,i})\) and \(V_i=V_{\text{pop}}\exp(\eta_{V,i})\), with the random effects modeled jointly, commonly as a mean-zero normal vector with covariance matrix \(\Omega\). For the calculations below, we condition on an individual’s parameters; estimating population parameters also requires accounting for the random-effects distribution.

Suppose the observation model has additive normal residual error, \(Y_{ij}=f_i(t_{ij})+\epsilon_{ij}\), where \(\epsilon_{ij}\sim N(0,\sigma^2)\). Assume the residual errors are independent conditional on the model parameters, the LLOQ is known, and a BQL record means precisely \(Y_{ij}<L\), where \(L\) is the LLOQ. A quantified value contributes its normal density; a BQL observation contributes a probability:

$$ P(Y_{ij}<L\mid f_i(t_{ij}))= \Phi\left(\frac{L-f_i(t_{ij})}{\sigma}\right). $$

Here \(\Phi\) is the standard normal cumulative distribution function. This probability can be informative when the predicted concentration is near the LLOQ. If the prediction is far below the LLOQ, however, the BQL probability is close to one for many different predictions, so that record may contribute little information about the parameters.

Worked Example: Comparing BQL Information at Two Sampling Times

Suppose a hypothetical subject receives \(D=100\) mg, has \(V=20\) L and \(CL=8\) L/h, and has additive residual standard deviation \(\sigma=0.020\) mg/L. The LLOQ is \(L=0.050\) mg/L. Compare the BQL probability at 12 and 24 hours with the probability under \(CL=9\) L/h, holding the other quantities fixed.

At 12 hours under \(CL=8\) L/h, the prediction is

$$ f(12)=\frac{100}{20}\exp\left(-\frac{8}{20}\times12\right) =5\exp(-4.8)=0.04115\ \text{mg/L}. $$

The standardized distance from the prediction to the LLOQ is \(z=(0.050-0.04115)/0.020=0.4425\), so the probability of a BQL result is approximately \(\Phi(0.4425)=0.671\). Under \(CL=9\) L/h, \(f(12)=5\exp(-5.4)=0.02258\) mg/L and \(P(Y<L)=\Phi((0.050-0.02258)/0.020)=\Phi(1.371)\approx0.915\). Thus, a BQL result at 12 hours favors the larger clearance in this comparison, although it does not establish that this clearance is correct.

At 24 hours, the predictions are \(5\exp(-9.6)=0.0003386\) mg/L for \(CL=8\) L/h and \(5\exp(-10.8)=0.0001020\) mg/L for \(CL=9\) L/h. The corresponding BQL probabilities are approximately \(\Phi(2.4831)=0.9935\) and \(\Phi(2.4949)=0.9937\). Either parameter value almost certainly produces a BQL record under this model, so one such observation barely distinguishes them.

Why the Information Can Collapse

The change in a BQL probability as a parameter changes makes the information loss precise. Let \(\theta\) be a scalar parameter, let \(f=f(\theta)\), and write \(p(\theta)=P(Y<L)=\Phi(z)\), where \(z=(L-f(\theta))/\sigma\). Differentiating gives

$$ \frac{dp}{d\theta} = -\frac{\phi(z)}{\sigma}\frac{df}{d\theta}, \qquad I(\theta)=\frac{(dp/d\theta)^2}{p(1-p)} = \frac{\phi(z)^2}{\sigma^2p(1-p)} \left(\frac{df}{d\theta}\right)^2 . $$

Here \(\phi\) is the standard normal density, and \(I(\theta)\) is the Bernoulli Fisher information in the censored indicator for this one observation. The expression follows because the indicator is Bernoulli with success probability \(p\): its score is \((B-p)(dp/d\theta)/[p(1-p)]\), whose expected squared value is the displayed information. When \(f\) lies far below \(L\), \(p\) approaches one and the probability changes very little for reasonable changes in \(f\); the information tends to zero. This explains why many deep-terminal BQL records can add little information about the rate of decline.

The argument applies to a single observation conditional on the parameters. With multiple conditionally independent observations, their log-likelihood contributions add. In an NLME model, population likelihood contributions also account for the distribution of individual random effects, rather than treating estimated individual effects as fixed known values.

Worked Example: Many Deep BQL Records May Add Little

Continue with the hypothetical model above. Suppose 18 independent samples are taken at 24 hours, all recorded as BQL. At \(CL=8\) L/h, each has BQL probability about 0.9935; at \(CL=9\) L/h, it is about 0.9937. Under conditional independence, the likelihood ratio for these records, comparing \(CL=8\) with \(CL=9\), is approximately

$$ \frac{0.9935^{18}}{0.9937^{18}} = \left(\frac{0.9935}{0.9937}\right)^{18} \approx 0.996. $$

These records provide almost no relative likelihood separation between the two clearances. The calculation does not mean that all BQL data are uninformative: a BQL result close to the LLOQ, as in the 12-hour comparison, can distinguish predictions more strongly. It shows why the timing and predicted concentration relative to the LLOQ matter as much as the BQL count.

What the Simulated Dataset Can and Cannot Identify

Consider a hypothetical simulated dataset with 12 subjects, each sampled at 6, 15, 21, 27, 33, and 39 hours after a 100 mg IV bolus. Suppose 12 of the 72 records are quantified at 6 hours and the remaining 60 are BQL. For a representative subject with \(V=20\) L and \(CL=8\) L/h, the predicted 6-hour concentration is \(5\exp(-2.4)=0.4536\) mg/L, while the 15-hour prediction is \(5\exp(-6)=0.01239\) mg/L. With an LLOQ of 0.050 mg/L, the later predictions are below the assay limit. This pattern can plausibly arise under the stated model, but it leaves little direct information about the exact concentrations in the late phase.

A useful geometric check is to first ignore residual error and consider only whether the model prediction is below the LLOQ. At 15 hours, the condition is

$$ 5\exp\left(-\frac{CL}{20}\times15\right)<0.050 \quad\Longleftrightarrow\quad CL>\frac{20}{15}\ln(100)=6.140\ \text{L/h}. $$

This is an approximate threshold illustration, not the actual normal-error likelihood: with residual error, BQL probability changes smoothly rather than switching at a sharp boundary. Still, it shows the basic limitation. A BQL result can rule against some predictions, but once predictions are sufficiently low, it does not say whether the concentration was slightly below the LLOQ or orders of magnitude below it.

There is also a parameter-separation problem. The curve depends on the amplitude \(D/V\) and the elimination rate \(CL/V\). One quantified concentration at one time supplies only one concentration constraint on these two quantities. For example, the 6-hour prediction of 0.4536 mg/L is produced by \(V=20\) L and \(CL=8\) L/h. It is also produced at that time by \(V=25\) L and \(CL\approx9.070\) L/h, since \(4\exp[-(9.070/25)\times6]\approx0.4536\). These parameter pairs predict different curves elsewhere, but when most later records only establish that the concentration is below the LLOQ, those records may not distinguish the curves sufficiently. In a population model, the same concern can extend to population parameters and random-effects variability.

Worked Example: Reading a Broad Profile as Weak Identification

Suppose a profile-likelihood calculation for \(CL_{\text{pop}}\), with other model components re-estimated at each fixed value, yields nearly the same objective function for clearances from 7 to 10 L/h. This is a hypothetical diagnostic summary, not a claim about the dataset above. If the minimum is at 8.2 L/h and the objective-function increases at 7 and 10 L/h are only 0.08 and 0.11, respectively, those small changes indicate a broad, weakly informative profile. They do not support reporting 8.2 L/h as a precisely determined clearance merely because it is the optimizer’s preferred value.

The practical interpretation is that values across much of this range fit nearly as well under the fitted model. The profile should be examined alongside parameter correlations and uncertainty estimates, and the conclusions should reflect the weak precision. A flat profile is evidence about the information in the data-model combination; it is not, by itself, evidence of a software error.

Weak Identification or Optimizer Failure?

An optimizer can stop at a poor solution, but a successfully converged optimizer cannot create information that the data do not contain. The distinction matters: changing algorithms may resolve a numerical failure, while it cannot make a broad likelihood profile narrow. Evaluate both the numerical behavior and the shape of the likelihood.

1
Check the fit status.
Review convergence messages, gradient magnitude, parameter bounds, and whether estimates are stuck at bounds. A non-negligible gradient or an implausible boundary solution warrants further numerical investigation.
2
Repeat from different starting values.
If fits reach substantially different objective-function values or parameter estimates, optimization may be unreliable or the likelihood may have multiple regions that need investigation. Agreement in objective function but variation along a broad parameter ridge is compatible with weak identification.
3
Inspect profile likelihood and curvature.
Fix a parameter over a plausible grid and re-optimize the others. A broad, shallow profile or nearly singular local curvature indicates limited precision; a poor fit that improves materially with alternate starts points more strongly to optimizer failure.
4
Check model and data support.
Confirm the dose, time units, LLOQ coding, residual-error model, and parameterization. Then ask whether quantified observations occur at times that separate amplitude from decline. Correct computation cannot overcome a design that contains little information about the requested parameter.

These signs are not individually decisive. Flat profiles can make standard errors unstable, and numerical problems can occur in a weakly identified model. Report the evidence: convergence behavior, sensitivity to starting values, profile shape, and the resulting uncertainty. Do not label every imprecise estimate an optimizer failure, or every converged estimate well identified.

Design Implications, Alternatives, and Limits

For disposition parameters, the most useful response to weak information is often to improve the information content of sampling and measurement. Sampling at times that capture both the concentration scale and the decline can help distinguish \(D/V\) from \(CL/V\); choosing an assay with a lower LLOQ can make later concentrations quantifiable. These are design considerations, not guarantees: parameter separation still depends on the model and the full pattern of observations.

A likelihood that uses quantified values and BQL probabilities retains more of the recorded information than replacing BQL values with an invented concentration. Earlier material on M1–M7 distinguishes approaches to BQL records; for identifiability, the essential point is that the assumed likelihood must correspond to what the record actually says. Substitution changes the data supplied to the model and can alter apparent parameter precision as well as estimates. Conversely, a correctly specified censored likelihood cannot recover an unobserved concentration below the LLOQ or ensure precise estimates when most records are uninformative.

Practical identification depends on assumptions. Misspecified residual error, an incorrect structural model, inaccurate assay limits, or dependence not represented in the likelihood can make profiles misleading. The simple calculations here use additive normal error and condition on individual parameters; a lognormal observation model or integrated NLME likelihood changes the calculation, although the general principle remains: when the probability of a BQL result is nearly unchanged across parameter values, that observation offers little discrimination. The analysis also concerns parameter information, not whether a particular method of handling BQL data produces bias.

Key takeaway: A high BQL fraction does not automatically make every parameter unidentifiable. Weak identification arises when plausible parameter values produce nearly the same distribution of observed quantified and censored records. Use likelihood profiles and numerical checks together to separate this data limitation from optimizer failure.

Check Your Understanding

Answer each question, then compare with the brief solutions.

  1. Why can a BQL result be informative near the LLOQ but contribute little when the predicted concentration is far below it?
  2. Under the one-compartment bolus model, which two parameter combinations determine the concentration curve’s amplitude and decline rate?
  3. For \(V=20\) L, \(D=100\) mg, an LLOQ of 0.050 mg/L, and a 15-hour sample, calculate the approximate clearance threshold for a predicted concentration below the LLOQ, ignoring residual error.
  4. How would you interpret a broad profile likelihood when repeated optimizations reach similar objective-function values?
  5. Name one numerical sign of possible optimizer failure and one sign of weak practical identification.

Solutions. (1) Near the LLOQ, changing the prediction changes the probability of a BQL result appreciably; far below it, that probability is already near one for many predictions. (2) The amplitude is \(D/V\), and the exponential decline rate is \(CL/V\). (3) Solve \(5\exp[-(CL/20)15]<0.050\), giving \(CL>(20/15)\ln(100)=6.140\) L/h. (4) The data support a range of parameter values similarly well, so practical precision is weak; the optimizer’s single minimum is not evidence of a precise estimate. (5) A substantial gradient or different objective-function values from different starts suggests numerical trouble; a broad, shallow profile suggests weak identification.