Why the Criterion Must Match the Scientific Question
A sampling schedule can be robust in one sense and poor in another. A schedule may keep the overall uncertainty region small while leaving one parameter direction imprecise; another may protect the least-informed direction but sacrifice precision elsewhere. The choice between robust D-, A-, and E-optimality is therefore not a contest for one universally best design. It is a choice about what kind of precision matters scientifically, and how performance should be protected when PK parameters are uncertain.
The comparison below uses a one-compartment intravenous bolus model and a finite set of plausible parameter scenarios. It uses a worst-case aggregation across scenarios for all three criteria, so that differences arise from the precision objective rather than from mixing different definitions of robustness. Other aggregations, such as averaging performance over scenarios, answer a different question.
Model, Information, and Robust Criteria
Suppose concentration follows a one-compartment model after an intravenous bolus dose \(D\):
Here \(CL\) is clearance, \(V\) is volume of distribution, and \(t\) is time after dosing. For the worked calculations, assume measured log concentrations satisfy \(z_j=\log C(t_j)+\epsilon_j\), where the errors are independent and \(\epsilon_j\sim N(0,\sigma^2)\) with known, constant variance. Assume the dose is known, the model is correctly specified, sampling times are fixed in advance, and there are no censoring or missing-data complications. This is a local-information calculation: the Fisher information is evaluated at a specified parameter value or scenario.
Use \(\theta=(\log CL,\log V)\) as the parameter vector. This gives dimensionless parameter coordinates and makes information-based comparisons easier to interpret than comparisons in mixed physical units. Define \(k=CL/V\). The gradient of the expected log concentration is
For a schedule \(d\) with times \(t_1,\ldots,t_m\), the local Fisher information matrix under a scenario \(s\) is
This expression assumes independent observations with the stated common variance. Correlated errors or a different residual model require a corresponding information calculation. A nonsingular \(F_s(d)\) is required for the inverse-information precision summaries below; singularity means at least one parameter combination is not locally identifiable from that schedule in that scenario.
The scenario set represents the parameter values at which the candidate schedule is evaluated. The worst-case aggregation makes the design’s score depend on its least favorable scenario under the relevant measure. Robustness here is therefore conditional on the chosen scenarios; it does not guarantee good performance outside them.
What the Three Criteria Protect
Under the usual local normal approximation, the covariance of an estimator is approximated by \(F_s(d)^{-1}\). This connects the criteria to different aspects of uncertainty. D-optimality uses the determinant of information: in two parameters, \(\det F\) summarizes the area of the information ellipse, and larger values correspond to a smaller approximate joint confidence-ellipsoid volume. Taking the logarithm is convenient because it preserves rankings and turns products of eigenvalues into sums.
A-optimality uses the trace of the inverse information matrix. For the unweighted criterion, this is the sum of the approximate variances of the coordinates in \(\theta\). It favors reducing total marginal variance, but it does not require that the single weakest direction be as precise as possible. A weighted version, \(\operatorname{tr}\{W F^{-1}\}\), can assign more importance to selected parameter combinations when the weight matrix \(W\) is defined in advance.
E-optimality focuses on the smallest eigenvalue of information. Since the largest eigenvalue of \(F^{-1}\) is \(1/\lambda_{\min}(F)\), maximizing the smallest information eigenvalue protects the least-informed linear combination of the parameter coordinates. This is useful when a weakly identified direction is especially concerning, but it can give less attention to improving already well-informed directions.
A short derivation makes the distinction between D and E explicit. Let the positive eigenvalues of a two-parameter information matrix be \(\lambda_1\) and \(\lambda_2\). Then \(\det(F)=\lambda_1\lambda_2\), while \(\lambda_{\min}(F)=\min(\lambda_1,\lambda_2)\). Thus determinant rewards the product of both information eigenvalues, whereas E-optimality rewards only the smaller one. The trace of inverse information is \(1/\lambda_1+1/\lambda_2\), which penalizes large variance contributions from either direction. These summaries can rank schedules differently because they are not interchangeable measures of precision.
Worked Example: Calculating Information at Two PK Sampling Times
Consider hypothetical values \(CL=5\) L/h, \(V=20\) L, \(\sigma=0.10\) log-concentration units, and samples at \(t_1=1\) h and \(t_2=4\) h after a known IV bolus. These assumptions specify a local calculation at one parameter point; they do not describe a real study.
First, \(k=CL/V=5/20=0.25\) h\(^{-1}\). The two sensitivity vectors are \(h(1)=(-0.25,-0.75)^{\mathsf T}\) and \(h(4)=(-1,0)^{\mathsf T}\). Since \(1/\sigma^2=1/0.10^2=100\),
The determinant is \(106.25(56.25)-18.75^2=5{,}625\), which is positive, so this information matrix is nonsingular. The example shows how sample times contribute different sensitivity directions. A time with \(kt=1\) has zero sensitivity to \(\log V\) under this log-concentration model, while the earlier sample contributes information about both coordinates.
Comparing Robust Scores
The next hypothetical comparison uses information matrices already expressed in the same scaled coordinates. The diagonal matrices simplify the arithmetic; they are illustrative local information summaries, not claims about particular sampling times. Each candidate is evaluated in two scenarios, and the robust score is calculated over the less favorable scenario for that criterion.
Worked Example: Three Criteria, Three Preferred Designs
Suppose three candidate schedules, X, Y, and Z, have the following hypothetical information matrices in scenarios 1 and 2:
For D-optimality, compare the minimum determinant. The scenario determinants for X are \(100(4.5)=450\) and \(90(4)=360\), so its worst-case determinant is 360. For Y they are 100 and 81, giving 81. For Z they are 400 and 315, giving 315. Thus robust D-optimality selects X, since \(360>315>81\).
For A-optimality, calculate the trace of the inverse in each scenario and take the largest value for each schedule. For a diagonal matrix \(\operatorname{diag}(a,b)\), the trace of the inverse is \(1/a+1/b\). The worst-case losses are \(1/90+1/4=0.2611\) for X, \(1/9+1/9=0.2222\) for Y, and \(1/45+1/7=0.1651\) for Z. Because lower is better, robust A-optimality selects Z.
For E-optimality, take the smallest eigenvalue in each scenario and then the minimum across scenarios. The robust scores are 4 for X, 9 for Y, and 7 for Z. The largest score is 9, so robust E-optimality selects Y. The resulting choices differ: X optimizes worst-case joint information volume, Z reduces worst-case total marginal variance, and Y protects the weakest information direction.
Let the Estimand Set the Precision Objective
A scientific question may focus on one parameter rather than on the joint precision of all model parameters. For a linear combination \(c^{\mathsf T}\theta\), the approximate variance is \(c^{\mathsf T}F^{-1}c\). If the target is specifically \(\log CL\), then \(c=(1,0)^{\mathsf T}\); if the target is \(\log V\), then \(c=(0,1)^{\mathsf T}\). A targeted variance criterion can be more directly aligned with the question than D-, A-, or E-optimality.
Worked Example: Choosing a Criterion for the Target Parameter
Use the matrices from the previous comparison and suppose the primary objective is precise estimation of \(\log CL\), the first coordinate. In the less favorable scenario, the approximate variances for \(\log CL\) are \(1/90=0.01111\) for X, \(1/9=0.1111\) for Y, and \(1/45=0.02222\) for Z. Thus X has the smallest worst-case variance for this particular target, even though the robust A- and E-optimal choices were Z and Y.
If instead the primary target is \(\log V\), the worst-case variances are \(1/4=0.25\) for X, \(1/9=0.1111\) for Y, and \(1/7=0.1429\) for Z. In that case Y is preferred among these candidates. These are variances on the log-parameter scale; approximate standard errors are their square roots. For example, X’s worst-case standard error for \(\log CL\) is \(\sqrt{0.01111}=0.1054\), dimensionless on the log scale. This calculation makes clear why naming the scientific target matters before selecting an optimality criterion.
Diagnostics, Scaling, and Limitations
Before interpreting a ranking, check that every candidate is evaluated using the same residual-error assumptions, parameter coordinates, scenario set, and treatment of nuisance parameters. Inspect eigenvalues or condition numbers for near-singularity: a very small eigenvalue indicates a poorly informed direction, and the inverse may then be numerically unstable. Also verify that any reported determinant is positive and that its logarithm is defined. If the information is singular in any scenario, inverse-based A-optimality is undefined there; in practice, the design fails to provide finite local variance in at least one direction.
Parameter scaling is especially important for A- and E-optimality. Changing the units or rescaling a parameter changes the numerical trace of \(F^{-1}\) and the eigenvalues of \(F\), and can therefore change their rankings. Log parameters provide a consistent dimensionless representation for the example, but they do not make all possible parameterizations equivalent. D-optimal rankings are invariant to a fixed nonsingular linear reparameterization up to a common determinant multiplier, which cancels when comparing designs in the same coordinates. A and E do not generally have that invariance. If a weighted A criterion or standardized E criterion is used, state the scaling or weights explicitly and use them consistently across scenarios and candidate schedules.
The scenario-based worst-case scores also have limitations. A finite scenario set can miss parameter combinations where a design performs poorly, and a single extreme scenario can dominate a worst-case score. These criteria do not account for scenario probabilities; an expected-utility design would be appropriate for a probability-weighted objective instead. Nor do local Fisher-information criteria guarantee finite-sample estimator performance when the model is strongly nonlinear, the information approximation is poor, or the likelihood is irregular. The information approximation and model diagnostics remain relevant.
A common mistake is to say that D-optimality is automatically best because it uses the whole information matrix, or to call E-optimality best because it protects the weakest direction. Neither conclusion follows without a scientific objective. The correction is to state what uncertainty matters: joint uncertainty volume, aggregate parameter variance, the least-informed combination, or a specific estimand. Then use the corresponding criterion and verify that its scaling and robustness aggregation match the intended interpretation.
Check Your Understanding
Answer each question, then compare your reasoning with the solutions below.
- For a diagonal information matrix \(\operatorname{diag}(16,4)\), calculate the determinant, the trace of the inverse, and the minimum eigenvalue. What precision feature does each summarize?
- Candidate A has a worst-case determinant of 120 and candidate B has a worst-case determinant of 100. Which is preferred by robust D-optimality, and does that ranking by itself establish which has the smaller variance for a specified parameter?
- Why can a robust E-optimal design differ from a robust A-optimal design, even when they use the same scenarios?
- If an information matrix is singular in one scenario, what happens to the inverse-based A criterion, and what does the singularity mean?
- For a scientific objective focused only on \(c^{\mathsf T}\theta\), what approximate variance should be considered?
Solutions. (1) The determinant is \(16(4)=64\); the trace of the inverse is \(1/16+1/4=0.3125\); the minimum eigenvalue is 4. These summarize joint information volume, summed coordinate variances, and weakest-direction information, respectively. (2) D-optimality prefers A because 120 exceeds 100. This does not by itself establish which has smaller variance for a particular parameter, because determinant combines information across directions. (3) E-optimality maximizes the weakest information direction, whereas A-optimality minimizes the sum of variances. Schedules can trade strong information in one direction against weaker information in another, changing these summaries differently. (4) The inverse does not exist, so the A criterion is undefined (or treated as infinite loss); the schedule fails to identify at least one parameter direction locally in that scenario. (5) Use \(c^{\mathsf T}F^{-1}c\), evaluated for each scenario and aggregated according to the stated robustness objective.