Tutorials › Nonlinear Mixed-Effects Models (NLME) › Testing Saturable Against Linear Elimination

Nonlinear Elimination and Time-Varying Clearance · Tutorial 332 of 797

Testing Saturable Against Linear Elimination

Learn when linear and saturable elimination models can be compared with likelihood-ratio tests, and how to interpret AIC, BIC, boundary tests, and bootstrap results.

Advanced 11 min read

What You'll Learn

  • Distinguish direct comparisons of linear and Michaelis–Menten models from genuinely nested comparisons.
  • Use the low-concentration limit to understand why linear elimination is not an ordinary finite-parameter special case of pure Michaelis–Menten elimination.
  • Calculate and interpret AIC and BIC for competing NLME models.
  • Identify why a saturable pathway’s zero-capacity boundary makes the usual likelihood-ratio reference distribution unreliable.
  • Apply a boundary-mixture test when its assumptions hold, and explain when a parametric bootstrap is preferable.

Why the comparison needs care

A Michaelis–Menten elimination model can describe concentration-dependent clearance, while a linear model describes elimination proportional to concentration. Comparing the models is not simply a matter of fitting both and applying a standard likelihood-ratio test. That test requires a particular relationship between the models and regular parameter behavior. Here, both can fail: a pure linear model is a limiting approximation to a pure Michaelis–Menten model, not generally a finite-parameter special case, and a saturable pathway added to a linear model has parameters on a boundary under the linear null.

A sound comparison therefore begins by stating exactly which models are being compared. Information criteria can compare models that are not nested, subject to their assumptions and limitations. A likelihood-ratio test is appropriate only when its nesting and reference-distribution conditions are justified.

Definition: Let \(C\) be concentration. A linear elimination rate is \(CL\,C\), where \(CL>0\) is clearance. A pure Michaelis–Menten elimination rate is \(V_{\max}C/(K_m+C)\), where \(V_{\max}>0\) is the maximum elimination rate and \(K_m>0\) is the concentration at which that rate is half of \(V_{\max}\). A parallel model has rate \(CL\,C+V_{\max}C/(K_m+C)\). In an NLME comparison, each structural rate is embedded in the same specified observation, residual-error, and random-effects framework unless the comparison explicitly changes one of those components.

What is nested, and what is not?

At concentrations small relative to \(K_m\), the Michaelis–Menten rate is approximately linear:

$$ \frac{V_{\max}C}{K_m+C} = \frac{V_{\max}}{K_m}C\frac{1}{1+C/K_m} \approx \frac{V_{\max}}{K_m}C \qquad (C/K_m\ll 1). $$

Thus, at low concentrations the ratio \(V_{\max}/K_m\) behaves like a clearance. This explains why the pure Michaelis–Menten model may resemble linear elimination over a restricted concentration range. It does not make the linear model a regular, finite-parameter special case of the pure Michaelis–Menten model: approaching the linear limit while keeping \(V_{\max}/K_m\) fixed requires \(K_m\) and \(V_{\max}\) to grow together. A conventional likelihood-ratio test between these two pure models is therefore not justified by ordinary nested-model theory.

The parallel model provides a different comparison. The linear-only model is obtained by setting \(V_{\max}=0\). But \(V_{\max}\) is constrained to be nonnegative, so the null value is on the boundary. Moreover, when \(V_{\max}=0\), the rate no longer depends on \(K_m\): \(K_m\) is unidentified under the null. These features prevent the usual chi-square likelihood-ratio reference distribution from being assumed automatically.

Likelihood-ratio statistic: For nested models fitted by maximum likelihood to the same data, let \(\ell_0\) and \(\ell_1\) be the maximized log likelihoods under the null and alternative, respectively. The statistic is \(D=2(\ell_1-\ell_0)\). Under regularity conditions, including an interior null parameter and identifiable parameters, \(D\) has an asymptotic chi-square distribution with degrees of freedom equal to the difference in the number of free parameters. A boundary or unidentified parameter can invalidate that reference distribution.

Requirements for a fair model comparison

For likelihood-based comparisons, the models should use the same observations and the same likelihood definition. In an NLME analysis, that means keeping the observation records, residual-error specification, random-effects structure, handling of below-quantification observations, and other modeling choices aligned unless their change is part of the stated comparison. Likelihoods from different data or incompatible likelihood calculations cannot be compared as though they came from the same experiment.

For comparisons of fixed effects or structural models, use maximum likelihood rather than restricted maximum likelihood. The random-effects distribution and the residual model must be specified well enough for the likelihood to be meaningful; convergence to a numerical optimum should also be checked. A likelihood value from a run that failed to converge, or from a solution at an unintended parameter constraint, is not reliable evidence for either model.

Information criteria are useful for comparing nonnested models. For maximized log likelihood \(\ell\), \(k\) estimated parameters, and \(n\) independent sampling units, the standard forms are:

$$ AIC=-2\ell+2k, \qquad BIC=-2\ell+k\ln(n). $$

Smaller values indicate a better trade-off between fit and the criterion’s parameter penalty among the candidate models being compared; they do not establish that a model is true. In clustered NLME data, the appropriate BIC sample size depends on the asymptotic convention and software implementation. State whether \(n\) denotes subjects or records, and use the same convention for every candidate. Count all estimated parameters consistently, including residual and random-effects parameters.

Worked Example: Comparing Pure Linear and Pure Michaelis–Menten Models

Suppose 40 hypothetical subjects contribute data to the same analysis. The linear model has maximized \(-2\ell=242.8\) and \(k=8\); the pure Michaelis–Menten model has \(-2\ell=237.6\) and \(k=9\). Assume the fits converged, use maximum likelihood, and use \(n=40\) subjects for BIC. These are nonnested structural models, so compare them with information criteria rather than an ordinary likelihood-ratio test.

For AIC, the calculations are:

$$ AIC_L=242.8+2(8)=258.8, \qquad AIC_{MM}=237.6+2(9)=255.6. $$

AIC is lower by \(258.8-255.6=3.2\) units for the Michaelis–Menten model. This is a modest criterion-based preference, not a test that proves saturation.

For BIC, \(\ln(40)\approx3.688879\), so:

$$ BIC_L=242.8+8(3.688879)=272.3110\approx272.3, $$ $$ BIC_{MM}=237.6+9(3.688879)=270.7999\approx270.8. $$

BIC favors the Michaelis–Menten model by approximately \(272.3110-270.7999=1.5111\), or 1.5 units. The preference is modest. Neither criterion supplies a p-value, and both comparisons depend on the stated parameter counts and BIC sample-size convention.

Boundary tests and their limits

When a single nonnegative parameter is tested at zero and all other parameters remain identifiable and interior, a common asymptotic reference distribution is a mixture: one-half probability at zero and one-half probability on a chi-square distribution with one degree of freedom. This is not the usual chi-square distribution. The mixture accounts for the fact that, under the null, random score fluctuations in the direction of a constrained parameter can improve the alternative fit only when they point into the allowed region.

That simple mixture does not automatically apply to the parallel linear-plus-saturable model when \(K_m\) is estimated. Under the null \(V_{\max}=0\), \(K_m\) is unidentified, so the alternative contains a nuisance parameter that has no defined null value. The asymptotic distribution can then depend on the search over \(K_m\) and on the design and likelihood. Simply counting “one extra parameter” and comparing \(D\) to \(\chi^2_1\), or applying the one-boundary-parameter mixture without checking the unidentified parameter, can produce an unjustified p-value.

Worked Example: A Valid One-Parameter Boundary Test

Suppose \(K_m\) was fixed in advance from external information, and the only added parameter is \(V_{\max}\geq0\) in a saturable pathway. Assume the other parameters are identifiable and interior under the null, and all regularity conditions for the one-boundary-parameter approximation hold. In a hypothetical fit, the maximized log likelihoods are \(\ell_0=-120.0\) for the linear model and \(\ell_1=-118.0\) for the alternative.

The likelihood-ratio statistic is:

$$ D=2\{\ell_1-\ell_0\} =2\{-118.0-(-120.0)\} =4.00. $$

Under the specified boundary-mixture approximation, the p-value is half the upper-tail probability for \(\chi^2_1\):

$$ p=\tfrac12P(\chi^2_1\geq4.00) =\tfrac12\{2[1-\Phi(2.00)]\} \approx\tfrac12(0.0455) =0.0228. $$

At a 0.05 significance level, this result is evidence against the linear-only null in favor of the added pathway, under the stated model and approximation. The result does not demonstrate that the mechanism is biologically correct. The calculation is not automatically valid when \(K_m\) is estimated and unidentified under the null.

Parametric bootstrap when the reference law is uncertain

A parametric bootstrap can calibrate the likelihood-ratio statistic under a specified null model when standard asymptotic reference distributions are doubtful. Fit the null model, simulate new data under it while retaining the study design and the assumed random-effects and residual-error structure, then refit both null and alternative models to each simulated data set. The simulated statistics approximate the null distribution, including the fitting procedure and parameter constraints. This approach requires credible null-model simulation and reliable refitting; it does not repair a misspecified model.

Worked Example: Bootstrap Calibration With an Estimated \(K_m\)

Suppose the linear-only model is the null and the alternative adds \(V_{\max}\geq0\) and estimates \(K_m>0\). The observed statistic is \(D_{\mathrm{obs}}=5.10\). In a hypothetical parametric bootstrap with \(B=999\) simulated data sets, the null and alternative are refitted each time, and 31 simulated statistics are at least 5.10.

Using the finite-simulation correction, the estimated bootstrap p-value is:

$$ \hat p_{\mathrm{boot}} = \frac{1+\#\{D_b\geq D_{\mathrm{obs}}\}}{B+1} = \frac{1+31}{999+1} =0.032. $$

The estimated Monte Carlo standard error is approximately \(\sqrt{0.032(1-0.032)/1000}=0.00557\). Thus the bootstrap evidence is below 0.05 in this hypothetical analysis, but its Monte Carlo uncertainty is not negligible. A larger number of simulations would improve precision. The result is conditional on the null model and simulation assumptions, and the full fitting procedure—including the search over \(K_m\)—must be repeated in every bootstrap replicate.

Diagnostics, alternatives, and limitations

Before interpreting any comparison, check that both fits reached stable solutions and that their likelihoods are comparable. Examine parameter estimates, uncertainty, boundary hits, and sensitivity to starting values. A nominally better likelihood from a poorly converged alternative is not persuasive. If the estimated \(K_m\) is extremely large relative to observed concentrations, the data may provide little separation from an approximately linear rate; a large or unstable estimate can also signal weak identification rather than strong evidence for a particular saturation scale.

The main alternatives answer different questions. AIC and BIC compare relative fit with different complexity penalties and can compare nonnested models, but they do not provide a conventional null-hypothesis p-value. A standard likelihood-ratio test is attractive for regular nested models, but is inappropriate for pure linear versus pure Michaelis–Menten models and may be miscalibrated for a boundary model with unidentified \(K_m\). A boundary-mixture test is useful for a single constrained parameter only when the nuisance parameters remain identifiable under the null. A parametric bootstrap can reflect a more complicated null distribution, at the cost of computation and dependence on the assumed data-generating model.

No one criterion resolves poor design, weak concentration coverage, or misspecification. A comparison summarizes evidence within the candidate models and likelihood assumptions; it does not by itself establish the mechanism of elimination. Do not select a saturable model solely because it has a larger maximized likelihood: the larger alternative is expected to fit at least as well. Consider the penalty, uncertainty, parameter behavior, and whether the observed data can distinguish the models.

Common pitfall: “The Michaelis–Menten fit has a higher likelihood, so a standard one-degree-of-freedom likelihood-ratio test proves saturation.” This is wrong when comparing the pure linear and pure Michaelis–Menten models because they are not ordinary nested models. It is also wrong for a linear model versus a parallel saturable model if the usual reference distribution ignores the \(V_{\max}=0\) boundary or the fact that \(K_m\) is unidentified under the null. First establish the model relationship; then choose a justified test or information criterion.

Check Your Understanding

Answer each question, then compare your reasoning with the solutions.

  1. Why is pure linear elimination not generally a regular finite-parameter special case of pure Michaelis–Menten elimination?
  2. A model comparison gives \(D=3.84\) for a single nonnegative added parameter with all other parameters identifiable under the null. Under the one-boundary-parameter mixture, what is the approximate p-value?
  3. For the information-criterion example above, state the BIC values and which model has the lower BIC.
  4. In a parallel linear-plus-saturable model, why does estimating \(K_m\) complicate a likelihood-ratio test of \(V_{\max}=0\)?

Solutions. (1) The linear approximation keeps \(V_{\max}/K_m\) fixed while \(K_m\) and \(V_{\max}\) grow; the limit is not attained at ordinary finite Michaelis–Menten parameter values. (2) The mixture p-value is \(\tfrac12P(\chi^2_1\geq3.84)\approx\tfrac12(0.0500)=0.0250\). (3) \(BIC_L\approx272.3\) and \(BIC_{MM}\approx270.8\); the Michaelis–Menten model has the lower BIC by about 1.5 units. (4) Under \(V_{\max}=0\), the rate does not depend on \(K_m\), so \(K_m\) is unidentified under the null and the usual simple chi-square or one-parameter mixture reference may not apply.