Why uncertainty in a curve is not just uncertainty in its parameters
An Emax fit estimates parameters, but many scientific questions concern quantities calculated from them: the expected response at a particular concentration, or the concentration needed to reach a specified response. These derived quantities inherit uncertainty from every estimated parameter. The effect of that uncertainty depends on the model’s local sensitivity to each parameter and on how parameter estimates covary.
This tutorial uses the stimulatory Emax model with a Hill coefficient \(h\). The same uncertainty calculations apply to an inhibitory model after writing its response function and differentiating it. The focus is on uncertainty in the estimated mean curve and derived quantities—not on residual diagnostics or model selection.
Response prediction and its gradient
Write the direct-effect model as
where \(C\) is concentration, \(E_0\) is baseline response, \(E_{\max}\) is the maximum increment above baseline, \(EC_{50}\) is the concentration producing half that increment, and \(h>0\) is the Hill coefficient. For a response prediction, define \(f(C)=C^h/(EC_{50}^h+C^h)\). If \(h\) is estimated, use the parameter vector \(\boldsymbol{\theta}=(E_0,E_{\max},EC_{50},h)^\mathsf{T}\); if it is fixed, omit it from the vector and covariance matrix.
The gradient describes how a small change in each parameter changes the predicted response. Its components are
The third component is the derivative with respect to \(EC_{50}\), and the fourth is the derivative with respect to \(h\). In particular, the Hill-coefficient derivative is zero at \(C=EC_{50}\), since the log ratio is then zero. This does not imply that the entire prediction is known precisely there: uncertainty in \(E_0\), \(E_{\max}\), and their covariance can still contribute.
How the delta approximation works
The method uses a first-order Taylor expansion around the true parameter vector. For a small estimation error \(\widehat{\boldsymbol{\theta}}-\boldsymbol{\theta}\),
If the parameter estimator is approximately unbiased with covariance matrix \(\boldsymbol{\Sigma}\), the variance of the linear term is
Replacing the unknown parameters and covariance with their estimates gives the delta-method variance estimate. The approximation is most credible when parameter estimates are reasonably precise, the derived function is smooth near the estimates, and the likelihood is not strongly asymmetric or truncated by a parameter boundary. A normal-based pointwise interval is the estimate plus or minus \(1.96\) standard errors for an approximate 95% interval. It describes uncertainty in the estimated mean response at that concentration; it is not a prediction interval for a future individual observation.
Worked Example: Uncertainty in a Predicted Response
Consider hypothetical estimates \(E_0=20\) response units, \(E_{\max}=100\) response units, and \(EC_{50}=10\) mg/L, with \(h=1\) fixed. At \(C=40\) mg/L, suppose the estimated covariance matrix for \((E_0,E_{\max},EC_{50})\), in matching squared units, is
The fitted response is \(20+100(40/(10+40))=100\) response units. With \(h=1\), the gradient components are \(1\), \(C/(EC_{50}+C)=0.8\), and \(-E_{\max}C/(EC_{50}+C)^2=-1.6\). Therefore,
The covariance between \(E_0\) and \(E_{\max}\), and the covariance between \(E_{\max}\) and \(EC_{50}\), both affect the result. The standard error is \(\sqrt{37.80}=6.148\) response units. The approximate 95% pointwise interval is \(100\pm1.96(6.148)\), or 87.95 to 112.05 response units. This interval concerns the fitted mean at 40 mg/L under the model and covariance approximation.
Concentrations producing a specified response
A derived target concentration is meaningful only if the target lies within the model’s attainable response range. For the increasing Emax model, a target \(R^*\) must satisfy \(E_0<R^*<E_0+E_{\max}\). Define \(q=R^*-E_0\), the target increment above baseline. Solving the model equation for concentration gives
This expression is smooth only away from the limiting responses. Its gradient, when \(h\) is estimated, is
The entries correspond to \(E_0,E_{\max},EC_{50},h\). When \(h\) is fixed, omit the final entry. Notice that the derivatives involving \(E_0\) and \(E_{\max}\) can become large near the response limits: a small parameter change can then produce a large change in the concentration needed to approach the target.
Worked Example: Uncertainty in a Target Concentration
Suppose a hypothetical model has \(E_0=10\) response units, \(E_{\max}=80\) response units, \(EC_{50}=4\) mg/L, and fixed \(h=1\). We seek the concentration producing \(R^*=50\) response units. Thus \(q=50-10=40\), and
Suppose the estimated variances of \(E_0,E_{\max},EC_{50}\) are respectively \(4\ \text{(response units)}^2\), \(100\ \text{(response units)}^2\), and \(0.25\ \text{(mg/L)}^2\), and suppose their estimated covariances are zero. The gradient is \((-0.200\ \text{mg/L per response unit},-0.100\ \text{mg/L per response unit},1)\). Therefore,
The standard error is \(\sqrt{1.410}=1.187\) mg/L. The approximate 95% interval is \(4\pm1.96(1.187)\), or 1.673 to 6.327 mg/L. This wide interval relative to the estimate signals substantial uncertainty in the target concentration, even though the point estimate is straightforward to calculate.
Uncertainty changes across the concentration range
A single parameter covariance matrix induces a different prediction variance at each concentration because the gradient changes along the curve. The resulting intervals are pointwise: each one approximates coverage at its specified concentration. A collection of 95% pointwise intervals is not automatically a 95% simultaneous confidence band for the whole curve.
Worked Example: Comparing Pointwise Uncertainty Along the Curve
Use the hypothetical estimates \(E_0=20\) response units, \(E_{\max}=100\) response units, \(EC_{50}=10\) mg/L, with \(h=1\) fixed. For illustration, suppose the parameter covariance matrix is diagonal with variances \(9,64,1\), respectively, in the appropriate squared units. The response variance at a concentration \(C\) is
At \(C=1\) mg/L, \(f=1/11\) and the \(EC_{50}\) gradient is \(-100/121\). The fitted response is 29.09 response units, and the variance is \(9+64/121+10000/14641=10.212\), giving \(SE=3.196\) response units. The approximate pointwise interval is 22.83 to 35.35 response units.
At \(C=10\) mg/L, \(f=0.5\) and the gradient is \(-2.5\). The prediction is 70 response units; the variance is \(9+64(0.5)^2+(-2.5)^2=31.25\), so \(SE=5.590\). The interval is 59.04 to 80.96 response units.
At \(C=100\) mg/L, \(f=10/11\) and the gradient is \(-100/121\). The prediction is 110.91 response units; the variance is \(9+64(100/121)^2+(100/121)^2=53.396\), so \(SE=7.307\). The interval is 96.59 to 125.23 response units. In this example, uncertainty grows toward high concentrations because uncertainty in \(E_{\max}\) contributes increasingly to the prediction.
Assumptions, alternatives, and failure modes
The delta method is a local approximation, not a guarantee that the derived estimate has a normal distribution. It relies on a usable covariance estimate for the fitted parameters and a sufficiently smooth derived function near the estimate. It can be unreliable when parameters are weakly identified, estimates are near constraints, the target approaches the model’s attainable limits, or parameter uncertainty is large enough that the first-order Taylor approximation is poor. For example, a symmetric normal interval for a positive concentration can extend below zero, or an interval for a response can extend beyond plausible values.
The covariance terms must be retained unless independence is genuinely justified. In general, for gradient components \(g_i\), the variance is \(\sum_i g_i^2\widehat{\mathrm{Var}}(\hat{\theta}_i)+2\sum_{i<j}g_i g_j\widehat{\mathrm{Cov}}(\hat{\theta}_i,\hat{\theta}_j)\). Omitting the second sum can either overstate or understate uncertainty. The first worked example shows why covariance cannot be discarded simply because each parameter has a reported standard error.
A common mistake is to report the uncertainty of \(EC_{50}\) as if it were the uncertainty of every predicted response, or to use only the uncertainty of \(E_{\max}\) for a target concentration. The correction is to define the quantity of interest, differentiate it with respect to every estimated parameter, and propagate the full covariance matrix. Another mistake is to interpret a mean-response interval as an interval for future observations. A future observation also varies because of residual error; that additional variability is not included here.
Alternatives are useful when the local approximation is questionable. A parametric bootstrap can simulate datasets under the fitted model, refit the model to each simulated dataset, and recalculate the derived quantity, thereby representing nonlinear and asymmetric uncertainty when the simulation model is adequate. Profile likelihood can assess uncertainty for a derived quantity by constraining that quantity and evaluating the likelihood; it can be informative under weak identification, though it requires an appropriate likelihood and careful computation. These approaches do not remove dependence on model assumptions. When estimates are near parameter boundaries or the target is near a response limit, report the instability clearly rather than treating a symmetric delta interval as definitive.
Check Your Understanding
Answer each question using the definitions and calculations above. Brief solutions follow.
- For a prediction at a fixed concentration, what three ingredients are needed for a delta-method standard error?
- With \(h=1\), why can uncertainty in \(E_{\max}\) have little effect on a prediction at a very low concentration?
- For an increasing Emax model, what condition must a target response satisfy to yield a finite positive target concentration?
- Why is it generally incorrect to calculate a derived standard error from parameter standard errors alone while ignoring their covariances?
- What extra source of variability is absent from a pointwise interval for the fitted mean response?
Solutions. (1) The gradient of the prediction, the estimated parameter covariance matrix, and the delta-method quadratic form \(\nabla g^\mathsf{T}\widehat{\boldsymbol{\Sigma}}\nabla g\). (2) At low concentration, the fraction \(C/(EC_{50}+C)\) is small, so the derivative with respect to \(E_{\max}\) is small. (3) It must satisfy \(E_0<R^*<E_0+E_{\max}\). (4) Covariance terms contribute cross-products to the variance and can increase or decrease it. (5) Residual variability among future observations is not included.