Purpose and Scope of a Worked Review
An independent review asks whether an analysis implements its stated model, uses the intended inputs, and produces output that is internally coherent and adequately diagnosed. It is not simply a second reading of the final parameter table. A reviewer should be able to trace the chain from the analysis question and data through model equations and software settings to estimates, diagnostics, and documented resolution of findings.
This worked review uses a hypothetical analysis of a single intravenous bolus dose under a one-compartment model with first-order elimination. The scope is deliberately bounded: it checks the declared model and its implementation; it does not establish that the model is clinically adequate for every purpose or replace a full scientific assessment. A hand calculation of one-compartment predictions and independent test cases are useful review tools, as are the earlier material on benchmark runs and review-finding resolution.
Model and Review Assumptions
The concentration equation follows from the model’s assumptions. After an instantaneous intravenous dose, the initial concentration is \(D_i/V_i\). During elimination, the amount in the compartment decreases at rate \(CL_i C_i(t)\); since amount equals \(V_iC_i(t)\) and \(V_i\) is constant, \(dC_i(t)/dt=-(CL_i/V_i)C_i(t)\). Separating variables and integrating from zero to \(t\) gives \(\ln[C_i(t)/C_i(0)]=-(CL_i/V_i)t\), and hence the stated exponential prediction.
The lognormal individual-parameter specification keeps clearance and volume positive. In this example, \((\eta_{CL,i},\eta_{V,i})\) is bivariate normal with mean zero and covariance matrix \(\Omega\); its diagonal entries are the between-individual variances on the log scale. The observation model is combined additive and proportional error: \(C_{ij}^{obs}=C_{ij}^{pred}(1+\epsilon_{prop,ij})+\epsilon_{add,ij}\), with independent mean-zero residual terms of variances \(\sigma_{prop}^2\) and \(\sigma_{add}^2\). These choices are assumptions to check against the analysis specification, not conclusions that follow automatically from the data.
A meaningful review also checks the conditions under which the implementation is intended to apply: doses are recorded as intravenous boluses, concentrations and dose units are compatible, times are elapsed times in the units used by the rate constant, and records are associated with the correct individual and occasion. The model assumes one well-mixed compartment and first-order elimination over the modeled range. If the data or scientific question require a different structure, successful execution alone does not validate this model.
Start With Inputs and the Prediction Code
Before considering estimates, trace the inputs that can change a prediction. Verify the data version and analysis population, dose records, observation times, concentration units, missing or excluded records, and the mapping of records to individuals. Confirm the parameterization and error model in the written specification match the executable model. Also inspect whether the estimation run used the intended initial values, parameter bounds, estimation method, and software settings. These checks make discrepancies interpretable: a result cannot be reviewed independently if its inputs or run identity are unclear.
Worked Example: Hand-Checking a Predicted Concentration
Suppose a hypothetical individual receives a 100 mg intravenous bolus. For this check, set \(CL_i=5.00\) L/h and \(V_i=50.0\) L, and evaluate the prediction at 4.00 h. These values imply a starting concentration of \(100/50.0=2.00\) mg/L and an elimination rate constant of \(5.00/50.0=0.100\) h\(^{-1}\). The declared model gives
The units in the exponent cancel, and the prediction has concentration units. A reviewer compares this hand calculation with an independent test case or model output at the same inputs. Agreement to a reasonable numerical tolerance supports this part of the implementation; it does not verify the data pipeline, population model, or estimation procedure. A mismatch should be traced to a specific cause, such as dose scaling, time origin, parameter units, or the implemented equation.
Worked Example: Finding a Time-Unit Mismatch
A hypothetical data file stores the time of an observation as 120 minutes after a 100 mg bolus. The model expects time in hours and uses \(CL=5.00\) L/h and \(V=50.0\) L. The correct elapsed time is \(120/60=2.00\) h, so the expected concentration is
If the value 120 is passed directly as hours, the implementation instead evaluates \(2.00\exp[-(0.100)(120)]=0.00001229\) mg/L. The result is about 133,000 times smaller than the correctly evaluated prediction. This is not a plausible rounding difference: it is evidence to investigate a time-unit or conversion error. The review finding should identify the record or code path, expected conversion, and consequence, then be rechecked against the corrected input and an independent test case.
Inspecting Estimation Output
Once the input and prediction checks pass, review whether the estimation output is consistent with the requested analysis. Check that the run completed as intended, the objective function and parameter estimates are finite, and the reported estimates are within declared bounds. Inspect standard errors or other uncertainty measures, correlations, and warnings. Convergence messages are relevant but not sufficient: a nominal convergence flag does not prove that the solution is stable, identifiable, or scientifically appropriate.
For a positive estimate \(\hat{\theta}\) with reported standard error \(SE(\hat{\theta})\), the relative standard error is \(100\,SE(\hat{\theta})/\hat{\theta}\) percent. It is a scale-relative summary of estimated uncertainty, not a test that the parameter is correct. Large relative standard errors, extreme parameter correlations, or estimates near bounds can indicate weak information or an unstable fit. They merit investigation in context; none alone identifies a unique cause. For variance parameters, check the parameterization carefully: a reported variance is not the same quantity as its square root, the standard deviation.
Worked Example: Checking Parameter Uncertainty and Bounds
Consider a hypothetical run with \(TVCL=5.10\) L/h and \(SE(TVCL)=0.612\) L/h. Its relative standard error is
The units cancel, so this is a percentage. Suppose the same output reports \(TVV=48.0\) L with \(SE(TVV)=7.20\) L; then \(RSE(TVV)=100(7.20/48.0)=15.0\%\). If the specified bounds were \(TVCL\in[0.10,20]\) L/h and \(TVV\in[1,200]\) L, both estimates are inside the bounds and not especially close to either endpoint. That check is reassuring but does not establish precision or model adequacy. The reviewer should also inspect the reported uncertainty, covariance information, convergence diagnostics, and relevant plots. A large RSE would prompt a documented assessment rather than an automatic declaration that the estimate is invalid.
Diagnostics and Resolution of Findings
Diagnostics test whether the fitted model’s predictions and residuals show patterns inconsistent with its assumptions. Review the diagnostic plots and summaries appropriate to the analysis, including observed concentrations against predictions and residuals against time or predictions. Examine patterns across individuals or other relevant groups when the design and data permit. A systematic trend can indicate a time, dose, data, or model-structure problem; an isolated unusual observation may instead require a record-level check. A diagnostic plot is evidence for investigation, not proof of a particular cause.
In the specified combined-error model, the conditional residual variance at a predicted concentration \(C^{pred}\) is \(\sigma_{add}^2+(\sigma_{prop}C^{pred})^2\), assuming independent residual terms. Thus a residual standardized using this variance is on a scale that accounts for both error components. The reviewer should confirm the software’s residual definition before interpreting a plotted value, because different residual types need not have the same scale. Do not infer a specific failure merely from a large residual: first verify the record, prediction, and residual calculation.
Worked Example: Checking a Residual Against the Declared Error Model
Suppose a hypothetical fitted run reports \(\sigma_{add}=0.120\) mg/L and \(\sigma_{prop}=0.0800\), and predicts \(1.683\) mg/L for one record. The observed concentration is \(1.700\) mg/L, giving an observed-minus-predicted residual of \(0.0170\) mg/L. Under the stated independent combined-error model, the residual standard deviation at that prediction is
The corresponding standardized residual is \(0.0170/0.1803=0.0943\). This one small residual is consistent with a close prediction for this record, but says little by itself about the fit as a whole. Review the pattern across records and check that the reported residual uses this same calculation before drawing conclusions.
When a finding is raised, make it specific enough to test: state the observed discrepancy, where it occurs, why it matters, and what evidence would resolve it. After a correction, rerun the relevant independent check and verify that the revised output comes from the intended code and data version. A corrected hand-check does not by itself establish that a changed estimation run is reproducible; compare run identity, settings, and outputs as appropriate. Record unresolved limitations distinctly from findings that have been resolved.
Identify the analysis question, model specification, data version, executable, and estimation run. If any is ambiguous, resolve that ambiguity before judging results.
Check records, units, model equations, parameter mappings, and independent prediction test cases against the declared specification.
Inspect completion status, parameter values and uncertainty, bounds, warnings, and diagnostic patterns. Separate evidence from hypotheses about its cause.
For each finding, record the correction or rationale, rerun the relevant check, and state whether the evidence supports closure or leaves a limitation.
Choosing the Review Approach and Recognizing Limits
A hand calculation is transparent and effective for checking an equation, units, and a small number of points. Independent test cases extend that check across boundary values and known inputs. Benchmark runs help detect unintended changes relative to a previously reviewed run, but agreement with a benchmark cannot establish that both runs are correct. Diagnostic plots evaluate patterns in the fitted analysis, while a second full estimation may provide an additional comparison but can reproduce a shared data or specification error. These approaches answer different questions and are most useful in combination.
A bounded review cannot prove that the chosen model is the unique or true description of pharmacokinetics. The one-compartment assumptions may be inadequate, sparse sampling may limit information, and an apparently stable estimation result may still be sensitive to modeling choices. Nor does a successful fit establish causal interpretation or clinical suitability. State what was checked, what passed, what remains uncertain, and what was outside the review scope. The common mistake is to equate a convergence message or plausible parameter values with a validated analysis; the correction is to require evidence from inputs, implementation checks, estimation output, diagnostics, and resolution records.
Check Your Understanding
Answer each question, then compare with the concise solutions below.
- For an intravenous bolus model, what units must \(CL/V\) and \(t\) have for the exponent to be dimensionless?
- A run reports an estimate inside its bounds and a convergence flag. Why is that not enough to conclude the analysis is adequately reviewed?
- At a predicted concentration of 2.00 mg/L, with \(\sigma_{add}=0.100\) mg/L and \(\sigma_{prop}=0.0500\), calculate the residual standard deviation under the independent combined-error model.
- What is the correct response when a diagnostic plot shows a time trend in residuals?
- Why can agreement with a benchmark run fail to show that the current analysis is correct?
Solutions. (1) \(CL/V\) must have units of inverse time, such as h\(^{-1}\), and \(t\) must be in hours, so their product is dimensionless. (2) The flag and bound check do not verify data, units, implementation, uncertainty, or diagnostic behavior; inspect these independently. (3) \(\sqrt{0.100^2+(0.0500\times2.00)^2}=\sqrt{0.0200}=0.1414\) mg/L. (4) Verify records, time units, prediction and residual definitions, then investigate the pattern and document evidence; the trend alone does not establish its cause. (5) The benchmark may share the same defect or incorrect assumptions, so use independent checks rather than treating agreement as proof.