Why Optimize for a Particular Contrast?
A design that estimates every model parameter reasonably well need not be the best design for the question that matters. In pharmacometrics, the target may be a particular parameter, a difference between parameters, or another linear combination, such as \(c^\top\theta\). The precision of that target depends on the whole information matrix: uncertainty and correlation in parameters that are not named in the contrast can still affect its variance.
c-optimality focuses the design criterion on one specified contrast. It is therefore not a general measure of how much information a design provides about all parameters. It ranks designs according to the variance they are expected to achieve for the target, under a specified model and its information assumptions.
The components of \(c\) specify the target. For example, \(c=(1,0,\ldots,0)^\top\) targets the first parameter, while \(c=(1,-1,0,\ldots,0)^\top\) targets the difference between the first and second parameters. Multiplying all components of \(c\) by the same constant multiplies the criterion by the square of that constant, but does not change which design minimizes it.
Why This Is a Variance Criterion
Suppose the model is locally regular at the parameter value of interest, the observations are independent under the assumed model, and the information matrix is nonsingular. Under these conditions, the estimator \(\hat{\theta}\) has the usual large-sample covariance approximation \(I(\xi)^{-1}\). In a linear model with the corresponding variance assumptions, the covariance expression can be exact. The variance of a linear combination follows directly from the covariance matrix.
To see the first equality, write the contrast error as \(c^\top(\hat{\theta}-\theta)\). The variance of any linear transformation \(A Z\) is \(A\operatorname{Cov}(Z)A^\top\); taking \(A=c^\top\) gives \(c^\top\operatorname{Cov}(\hat{\theta})c\). Substitution of the inverse-information covariance approximation gives the c-criterion. Its square root is the approximate standard error of the estimated contrast.
If a design is represented by proportions of observations at candidate settings, its information matrix is often a per-observation or normalized matrix \(M(\xi)\). With \(n\) independent observations and the same per-observation information structure, \(I(\xi)=nM(\xi)\). Thus the approximate contrast variance is \(c^\top M(\xi)^{-1}c/n\). If a common observation variance \(\sigma^2\) has been factored out of the information matrix, the variance is instead \(\sigma^2 c^\top M(\xi)^{-1}c/n\). Keep this scale factor explicit when comparing numerical criteria with variances in the data's units.
Worked Example: Comparing Two Information Matrices
Consider two hypothetical candidate designs for a model with \(\theta=(\theta_1,\theta_2)^\top\). Their total information matrices are \(I_A=\begin{pmatrix}4&1\\1&2\end{pmatrix}\) and \(I_B=\begin{pmatrix}3&0\\0&3\end{pmatrix}\). Suppose the scientific target is the sum \(\theta_1+\theta_2\), so \(c=(1,1)^\top\). Both matrices are positive definite: their determinants are 7 and 9, respectively, and their leading diagonal entries are positive.
For design A, the inverse is \(I_A^{-1}=\frac{1}{7}\begin{pmatrix}2&-1\\-1&4\end{pmatrix}\). Therefore,
For design B, \(I_B^{-1}=\frac{1}{3}\begin{pmatrix}1&0\\0&1\end{pmatrix}\), giving \(c^\top I_B^{-1}c=1/3+1/3=0.6667\). Under the information-based covariance approximation, design A has the smaller variance for the specified sum, and so is preferred for this target. The approximate standard errors are \(\sqrt{4/7}\approx0.7559\) and \(\sqrt{2/3}\approx0.8165\), in the units of \(\theta_1+\theta_2\).
The off-diagonal terms matter: in design A the parameters are correlated, and the covariance contributes to the variance of their sum. This comparison is about this contrast only; a different \(c\) could reverse the ranking.
Optimizing an Allocation for a Contrast
A simple allocation problem makes the targeted nature of the criterion explicit. Suppose there are two possible observation types. One provides information only about \(\theta_1\), and the other only about \(\theta_2\), with equal information per observation. Let \(w\) be the fraction allocated to the first type and \(1-w\) the fraction allocated to the second. For a total of \(n\) observations with common variance \(\sigma^2\), the normalized information matrix is \(M(w)=\operatorname{diag}(w,1-w)\). The design is full rank when \(0<w<1\).
Worked Example: Best Allocation for the Sum of Two Parameters
Continue with the target \(c^\top\theta=\theta_1+\theta_2\). For \(0<w<1\), \(M(w)^{-1}=\operatorname{diag}(1/w,1/(1-w))\). The variance criterion, including its scale factor, is
It is enough to minimize \(g(w)=1/w+1/(1-w)\). Its derivative is \(g'(w)=-1/w^2+1/(1-w)^2\). Setting this to zero gives \(w^2=(1-w)^2\); since \(0<w<1\), this implies \(w=1/2\). The second derivative, \(g''(w)=2/w^3+2/(1-w)^3\), is positive throughout the interval, so this stationary point is the unique minimum. At \(w=1/2\), \(g(w)=2+2=4\), and the approximate variance is \(4\sigma^2/n\).
For comparison, allocating \(w=0.4\) gives \(g(0.4)=1/0.4+1/0.6=2.5+1.6667=4.1667\), a larger variance. As either allocation fraction approaches zero, one term in \(g(w)\) diverges. Almost ignoring one parameter is costly when the target gives both parameters nonzero weight.
The equal allocation follows from this particular information structure and contrast; it is not a general rule. If one parameter were more influential in the target, or if observation types supplied different amounts or patterns of information, the minimizing allocation could differ. The relevant calculation is always based on the information matrix and the specified \(c\).
A Regression Example: The Target Changes the Design
Consider a hypothetical linear model \(Y=\beta_0+\beta_1 x+\varepsilon\), with independent errors of mean zero and common variance \(\sigma^2\). Assume the design points satisfy \(-1\leq x\leq1\). For a design distribution \(\xi\), define \(E_\xi(x)\) and \(E_\xi(x^2)\) as the weighted averages of the design points and their squares. The normalized information matrix, with the common variance factored out, is \(M(\xi)=\begin{pmatrix}1&E_\xi(x)\\E_\xi(x)&E_\xi(x^2)\end{pmatrix}\). It is nonsingular when the design has positive spread in \(x\).
Worked Example: Choosing Settings to Estimate the Slope
Suppose the target is the slope, so \(c=(0,1)^\top\). For a nonsingular design, the inverse of \(M\) has lower-right entry \(1/[E_\xi(x^2)-E_\xi(x)^2]\). Consequently,
This follows by inverting the two-by-two matrix: its determinant is \(E_\xi(x^2)-E_\xi(x)^2\), and the lower-right entry of its inverse is \(1\) divided by that determinant. The approximate slope variance is therefore \(\sigma^2/[n\operatorname{Var}_\xi(x)]\).
Because \(-1\leq x\leq1\), \(x^2\leq1\), so \(E_\xi(x^2)\leq1\). Also \(\operatorname{Var}_\xi(x)=E_\xi(x^2)-E_\xi(x)^2\leq E_\xi(x^2)\leq1\). The largest possible design variance is 1, attained by allocating half the observations to \(x=-1\) and half to \(x=1\): this gives \(E_\xi(x)=0\) and \(E_\xi(x^2)=1\). The minimum slope criterion is thus 1, and the approximate slope variance is \(\sigma^2/n\).
A design with weights 0.25, 0.50, and 0.25 at \(x=-1,0,1\) has \(E_\xi(x)=0\) and \(E_\xi(x^2)=0.5\). Its criterion is \(1/0.5=2\), and its slope variance is \(2\sigma^2/n\). The endpoint design is twice as precise in variance for the slope under this model and range. This conclusion concerns slope precision, not every possible target in the regression.
Assumptions, Diagnostics, and Limitations
The criterion is meaningful only relative to a model, a target, and a set of allowable design choices. In model-based design, information may depend on parameter values; the comparison then applies to the nominal values used to calculate it. The covariance interpretation also relies on appropriate regularity and model assumptions. If the model is misspecified, observations are dependent when independence was assumed, or variability is incorrectly represented, the inverse information matrix may not describe the estimator's actual covariance.
Before trusting a calculation, check that the contrast is specified in the parameterization actually used, the information matrix corresponds to the proposed design and observation model, and the matrix is nonsingular for the stated inverse. Verify that the resulting criterion is positive and that its units are squared units of the contrast. In numerical work, inspect whether the matrix is nearly singular: an unstable inverse can make the calculated criterion unreliable. A small value is not automatically evidence of a good practical design if it is driven by unrealistic nominal parameters or assumptions.
The ordinary formula assumes an estimable contrast with nonsingular information. If the full parameter vector is not identifiable, the inverse does not exist, so this formula cannot be applied as written. In some settings a contrast may still be estimable even when all parameters are not; such cases require an explicit estimability argument and an appropriate generalized-inverse treatment. They should not be handled by silently substituting an arbitrary inverse.
c-optimality differs from criteria that summarize uncertainty across all parameters or emphasize the weakest direction. It answers a narrower question: which allowed design minimizes uncertainty for this particular linear target? This focus is valuable when a scientific decision depends on one contrast, but it is also a limitation: the resulting design may perform poorly for other parameters or targets. Prediction-variance criteria address different targets and should not be substituted without checking what quantity is being optimized.
Check Your Understanding
Try each question, then compare your reasoning with the solutions below.
- For \(c=(1,-1)^\top\), what parameter quantity is targeted?
- If \(I^{-1}=\begin{pmatrix}2&0.5\\0.5&1\end{pmatrix}\) and \(c=(1,1)^\top\), calculate the criterion.
- In the two-type allocation example, why is a design with \(w=0\) not covered by the inverse-matrix formula?
- For a slope target in the regression example, what feature of the design determines the criterion?
Solutions. (1) The target is \(\theta_1-\theta_2\), because \(c^\top\theta=\theta_1-\theta_2\). (2) The criterion is \(c^\top I^{-1}c=2+0.5+0.5+1=4\), in squared units of the sum. (3) At \(w=0\), the first parameter receives no information, so the normalized information matrix is singular and has no ordinary inverse. The target involving both parameters also cannot be estimated with finite variance under this setup. (4) It is the design variance of \(x\): the criterion is \(1/\operatorname{Var}_\xi(x)\), so settings spread farther apart improve slope precision under the stated model and range.