Tutorials › Econometrics (Graduate) › Quasi-Likelihood Inference Under Spatial Misspecification

Spatial and Network Econometrics · Tutorial 941 of 952

Quasi-Likelihood Inference Under Spatial Misspecification

Learn how to construct and interpret sandwich uncertainty for spatial quasi-maximum-likelihood estimates, and when that uncertainty does not protect against residual spatial dependence.

Advanced 11 min read

What You'll Learn

  • State the spatial autoregressive model and assumptions that support quasi-maximum-likelihood inference.
  • Derive the score for the spatial autoregressive parameter and explain the role of the log-determinant term.
  • Define the Hessian and score-variance components of the sandwich covariance.
  • Distinguish Gaussian-likelihood estimation from Gaussian-based standard errors.
  • Recognize why nonnormality robustness does not by itself accommodate spatially correlated disturbances.
  • Interpret sandwich standard errors and confidence intervals in the model’s units.

Why Quasi-Likelihood Inference Needs a Sandwich

Likelihood estimation for a spatial autoregressive model uses the spatial structure to account for simultaneous feedback. In practice, its Gaussian likelihood is often used even when the disturbances are not normally distributed. This is quasi-maximum likelihood: the Gaussian objective is an estimation criterion, not necessarily a complete description of the disturbance distribution.

That distinction matters for uncertainty. If the model’s conditional mean and spatial structure are correctly specified, Gaussian quasi-maximum likelihood can remain consistent under nonnormal innovations, subject to regularity conditions. But the Gaussian likelihood’s curvature alone generally does not give the correct sampling variance. Sandwich inference replaces that curvature-only variance with one that also accounts for the actual variance of the score.

Definition: A quasi-maximum-likelihood estimator maximizes a likelihood-shaped criterion even when the assumed probability distribution need not be the true distribution. A sandwich covariance combines the inverse curvature of the criterion with the covariance of its score. It allows the score variance to differ from the curvature implied by a fully correct likelihood.

Model and Assumptions

Consider the spatial autoregressive (SAR) model

$$ y=\rho Wy+X\beta+u, \qquad A(\rho)y=X\beta+u, \qquad A(\rho)=I-\rho W. $$

Here \(y\) is an \(n\)-vector of outcomes, \(X\) is an \(n\times k\) matrix of exogenous regressors, \(\beta\) is a \(k\)-vector, \(W\) is the specified spatial-weights matrix, and \(\rho\) is the spatial-lag coefficient. The disturbance vector is \(u\). The model requires \(A(\rho)\) to be invertible over the parameter space under consideration.

For the distributional-robustness result discussed here, assume the conditional mean is correctly specified, \(E(u\mid X,W)=0\), and the innovations have common variance \(\sigma^2\). Assume also that the innovations are independent across spatial units, although they need not be normally distributed, and have finite fourth moments. The regressors are exogenous, and standard large-sample regularity conditions hold: the relevant parameters are interior, the model is identified, the normalized Hessian has a nonsingular limit, and the spatial design does not become unstable as \(n\) grows. These conditions are important: nonnormality is allowed, but unexplained spatial correlation in \(u\) is not.

The Gaussian quasi-log-likelihood, up to constants that do not affect its maximizer, is

$$ \ell_n(\beta,\rho,\sigma^2) = \log|A(\rho)| -\frac{n}{2}\log(\sigma^2) -\frac{e'e}{2\sigma^2}, \qquad e=A(\rho)y-X\beta. $$

The determinant term is essential: it accounts for the change of variables from \(y\) to the spatial innovations \(e\). Omitting it changes the likelihood and, in general, the estimate of \(\rho\).

Score, Curvature, and Score Variance

Let \(\eta=(\beta',\rho,\sigma^2)'\) collect the parameters, and let \(s_n(\eta)=\partial\ell_n(\eta)/\partial\eta\) be the full-sample score. Writing \(e=A(\rho)y-X\beta\), the score components are

$$ s_\beta=\frac{X'e}{\sigma^2}, \qquad s_\rho=-\operatorname{tr}\!\left(A(\rho)^{-1}W\right) +\frac{e'Wy}{\sigma^2}, \qquad s_{\sigma^2}=-\frac{n}{2\sigma^2}+\frac{e'e}{2\sigma^4}. $$

For example, \(\partial e/\partial\rho=-Wy\), so differentiating \(-e'e/(2\sigma^2)\) with respect to \(\rho\) gives \(e'Wy/\sigma^2\). Differentiating \(\log|A(\rho)|\) gives \(-\operatorname{tr}(A(\rho)^{-1}W)\). At the true parameter, the expectation of the \(\rho\)-score is zero under the stated assumptions. In particular, when \(y=A^{-1}(X\beta+u)\), the disturbance part satisfies

$$ E\!\left(u'WA^{-1}u\mid X,W\right) = \sigma^2\operatorname{tr}(WA^{-1}) = \sigma^2\operatorname{tr}(A^{-1}W). $$

This cancels the expected log-determinant contribution. The calculation illustrates why the spatial score is not merely a collection of independent observation-level regression scores: it contains a quadratic form in the full disturbance vector.

Define the expected negative Hessian \(H_n=-E[\partial s_n(\eta_0)/\partial\eta']\) and the score covariance \(J_n=\operatorname{Var}(s_n(\eta_0))\), evaluated at the true parameter \(\eta_0\). Under the regularity conditions,

$$ \operatorname{Var}(\hat\eta) \ \approx\ H_n^{-1}J_nH_n^{-1}. $$

Both \(H_n\) and \(J_n\) typically grow with \(n\), so this expression has the scale of a parameter covariance. Equivalently, if \(H_n/n\) and \(J_n/n\) converge to \(H\) and \(J\), then \(\sqrt n(\hat\eta-\eta_0)\) has limiting covariance \(H^{-1}JH^{-1}\). When the Gaussian likelihood is correctly specified, the information identity gives \(J=H\). Under nonnormal innovations, that identity need not hold; using only the inverse Hessian can therefore give incorrect standard errors.

Key result: For spatial quasi-maximum likelihood, sandwich inference uses both the criterion’s curvature and the actual score covariance. Distributional robustness means that nonnormal innovations can be allowed while retaining a correctly specified conditional mean and the assumed spatial disturbance structure. It does not mean that any form of spatial misspecification is harmless.

Worked Examples

Worked Example: A Heteroskedasticity-Style Sandwich Calculation

A simple regression through the origin, \(y_i=\beta x_i+u_i\), illustrates the arithmetic behind a sandwich variance. This is an illustration of the score-variance principle, not a spatial SAR fit. Suppose the hypothetical data are \(x=(1,1,2,2)\) and \(y=(4.1,3.1,7.2,4.2)\).

The least-squares estimate is

$$ \hat\beta=\frac{\sum_i x_i y_i}{\sum_i x_i^2} =\frac{4.1+3.1+14.4+8.4}{1+1+4+4} =\frac{30}{10}=3. $$

The residuals are therefore \(\hat u=(1.1,0.1,1.2,-1.8)\). They satisfy the through-origin least-squares condition \(\sum_i x_i\hat u_i=1.1+0.1+2.4-3.6=0\). The HC0 sandwich variance is

$$ \widehat{\operatorname{Var}}_{\text{sand}}(\hat\beta) = \frac{\sum_i x_i^2\hat u_i^2}{(\sum_i x_i^2)^2} = \frac{1.21+0.01+4(1.44)+4(3.24)}{10^2} = \frac{19.94}{100} =0.1994. $$

Thus the sandwich standard error is \(\sqrt{0.1994}\approx0.4465\). The calculation separates the inverse curvature, \(1/\sum_i x_i^2\), from the empirical score variance, \(\sum_i x_i^2\hat u_i^2\). In a spatial likelihood, the same principle applies, but the spatial parameter’s score includes the determinant and quadratic-form terms shown above; its score covariance must account for those terms.

Worked Example: Using a Sandwich for Two Spatial Parameters

Suppose a hypothetical SAR fit estimates a regression coefficient and \(\rho\), and that the estimated normalized negative Hessian and score covariance for these two parameters are

$$ \hat H= \begin{pmatrix}2&0\\0&4\end{pmatrix}, \qquad \hat J= \begin{pmatrix}6&1\\1&20\end{pmatrix}. $$

These are normalized matrices, so for \(n=100\) the estimated covariance is \(n^{-1}\hat H^{-1}\hat J\hat H^{-1}\). First, \(\hat H^{-1}=\begin{pmatrix}0.5&0\\0&0.25\end{pmatrix}\). Therefore,

$$ \hat H^{-1}\hat J\hat H^{-1} = \begin{pmatrix}1.5&0.125\\0.125&1.25\end{pmatrix}, \qquad \widehat{\operatorname{Var}}(\hat\eta) = \begin{pmatrix}0.015&0.00125\\0.00125&0.0125\end{pmatrix}. $$

The standard errors are \(\sqrt{0.015}\approx0.1225\) for the regression coefficient and \(\sqrt{0.0125}\approx0.1118\) for \(\rho\). If the coefficient estimate is \(0.30\), a large-sample 95% Wald interval is \(0.30\pm1.96(0.1225)=[0.0599,0.5401]\), in the units of the outcome per unit of that regressor. This procedure does not assert a 95% probability that the fixed coefficient lies in this particular interval. Its repeated-sampling coverage is approximately 95% under the stated model and asymptotic conditions.

What Is Robust, and What Is Not?

Under nonnormal but independent innovations with mean zero and common variance, the Gaussian criterion can estimate the model parameters consistently while the sandwich adjusts the estimated covariance for the difference between the score variance and the Gaussian curvature. In the SAR case, estimating the score variance requires care. The \(\rho\)-score involves \(Wy\) and a quadratic form in disturbances, so spatially connected observations enter it together. A valid estimate of \(J_n\) must account for the resulting score covariance, including the relevant fourth-moment contribution. Simply treating every row of the full spatial score as an independent observation, or applying an ordinary regression HC formula to all SAR parameters, does not automatically do this.

The distinction from residual spatial dependence is fundamental. If \(E(uu'\mid X,W)\) is not \(\sigma^2 I\), then the innovations are spatially correlated or otherwise have a non-spherical covariance. The independence-based score covariance is no longer the right \(J_n\). A sandwich formula is not automatically robust to that misspecification: it works only when its “meat” consistently estimates the score covariance that actually arises. Accounting for residual spatial dependence requires a dependence-aware covariance method or a correctly specified disturbance structure; it is not achieved merely by allowing nonnormal marginal distributions.

Worked Example: Diagnosing the Kind of Misspecification

Consider two hypothetical data-generating cases for a fitted SAR model. In Case A, the innovations are independent across locations, have mean zero and variance \(\sigma^2\), but have a skewed, nonnormal distribution with finite fourth moment. In Case B, the innovations have mean zero and the same marginal variance, but nearby locations have correlated disturbances.

Case A. The Gaussian likelihood is not the true distribution, but the conditional mean and assumed independence structure remain appropriate. Subject to the regularity conditions, quasi-maximum likelihood can remain consistent, and a sandwich that correctly estimates the score covariance can provide valid large-sample standard errors.

Case B. The disturbance covariance is not \(\sigma^2 I\). The independence-based calculation of the score covariance is therefore misspecified, even if the marginal distributions happen to be Gaussian. Calling the standard errors “sandwich” does not repair this problem unless the meat is constructed to capture that spatial score dependence.

The relevant diagnostic question is not simply “Are the errors normal?” It is also “Does the covariance model used for the score variance reflect the dependence remaining in the disturbances?”

Practical Inference and Common Pitfalls

A Wald statistic for a scalar component \(\eta_j\) is \(z=(\hat\eta_j-\eta_{j,0})/\widehat{SE}(\hat\eta_j)\). Under the null and the relevant large-sample conditions, it is approximately standard normal. For example, a two-sided test at level \(\alpha=0.05\) rejects when \(|z|>1.96\). For a vector restriction, use the corresponding Wald quadratic form with the sandwich covariance of the restricted parameter vector. These are asymptotic procedures; small samples or weak identification can make their approximation poor.

In implementation, form the full score and Hessian for the SAR quasi-likelihood, estimate the score covariance under the intended disturbance assumptions, assemble the sandwich, and report the appropriate parameter block. If \(\sigma^2\) is estimated, retaining it as a nuisance parameter in the joint calculation accounts for its estimation; the final covariance for \(\beta\) and \(\rho\) is obtained from the corresponding block. State whether the reported covariance assumes independent innovations or allows a specified form of dependence.

  • Using only inverse curvature. The inverse Hessian is justified by the information identity under a correctly specified likelihood. Under nonnormality, use the score-variance component as well.
  • Assuming “robust” means robust to all misspecification. Distributional robustness to nonnormal innovations does not automatically cover spatial correlation in the disturbances, an incorrect mean, or an incorrect \(W\).
  • Dropping the log-determinant. The determinant contributes directly to the \(\rho\)-score and is part of the spatial likelihood.
  • Applying an observation-wise formula without checking the score structure. Spatial feedback makes the likelihood score involve multiple locations. The covariance calculation must preserve the relevant dependence among score contributions.
Takeaway: Gaussian quasi-maximum likelihood can support inference under nonnormal innovations when the spatial conditional-mean model and disturbance dependence assumptions are valid. The sandwich corrects the mismatch between score variance and likelihood curvature; it does not, by itself, correct residual spatial dependence.

Check Your Understanding

Answer each question using the model and distinctions developed above.

  1. Why does the score for \(\rho\) contain both a trace term and a term involving \(e'Wy\)?
  2. What are \(H_n\) and \(J_n\) in the sandwich covariance, and when do they coincide in the normalized limit?
  3. Under what assumptions can Gaussian quasi-maximum likelihood remain consistent when the innovations are nonnormal?
  4. Why is it not enough to apply an ordinary observation-wise heteroskedasticity-robust formula to every SAR parameter?
  5. How does independent nonnormality differ from spatial correlation in the disturbances for purposes of standard-error construction?
Clinical Biostats