Why a Spatial Lag Is a Simultaneous Relationship
When an outcome in one location depends on outcomes in nearby locations, those neighboring outcomes may themselves depend on the first location’s outcome. The resulting feedback is not a sequence in which one unit’s outcome is fixed before the others are determined. Instead, all outcomes are jointly determined. This distinction matters because the spatially lagged outcome is then generally correlated with the structural disturbance, even if the observed regressors are exogenous.
Let there be \(n\) spatial units. The known \(n\times n\) matrix \(W\) records the chosen spatial weights: its entry \(w_{ij}\) describes the weight assigned to unit \(j\) in the spatial lag for unit \(i\). The vector \(y\) contains the outcomes, \(X\) is an \(n\times k\) matrix of regressors, \(\beta\) is a \(k\)-vector of coefficients, and \(\varepsilon\) is the vector of structural disturbances. The scalar \(\rho\) measures the strength and direction of dependence on the spatially lagged outcome.
A common specification has \(w_{ii}=0\), so a unit does not receive a direct weight on its own outcome. This does not remove feedback: unit \(i\) can affect a neighbor whose outcome then contributes to the spatial lag for unit \(i\). Whether weights are row-standardized or otherwise normalized depends on how \(W\) was constructed. Here \(W\) is treated as fixed and known; the algebra does not require a particular normalization.
Solving the Simultaneous System
Move the spatial-lag term to the left-hand side. If the matrix \(I-\rho W\) is nonsingular, the simultaneous equations have the unique solution
This expression is an algebraic solution conditional on nonsingularity; it does not by itself establish that a chosen specification is stable or appropriate. The solution shows that every outcome can depend on the covariates and disturbances across the system, not only on those of the same unit. For the disturbance component, define \(A=(I-\rho W)^{-1}\), so that \(y=AX\beta+A\varepsilon\). The spatial lag is consequently \(Wy=WAX\beta+WA\varepsilon\).
Worked Example: Solving a Two-Unit Feedback System
Consider two hypothetical units with \(W=\begin{pmatrix}0&1\\1&0\end{pmatrix}\), \(\rho=0.4\), and \(X\beta+\varepsilon=(2.5,0.8)'\). The unit-level equations are \(y_1=0.4y_2+2.5\) and \(y_2=0.4y_1+0.8\). Each unit’s outcome depends on the other unit’s outcome.
Substitute the second equation into the first: $$ y_1=0.4(0.4y_1+0.8)+2.5 =0.16y_1+0.32+2.5. $$ Therefore \(0.84y_1=2.82\), so \(y_1=2.82/0.84=3.357\) (to four significant figures). Then $$ y_2=0.4(3.357)+0.8=2.143. $$
The solution can also be checked in the original equations: \(0.4(2.143)+2.5=3.357\), and \(0.4(3.357)+0.8=2.143\), up to rounding. These are jointly determined values, rather than outcomes obtained by treating either neighbor’s outcome as fixed in advance.
Why the Spatial Lag Is Endogenous
To make the source of endogeneity explicit, suppose the disturbances satisfy the conditional exogeneity condition \(E[\varepsilon\mid X,W]=0\). For a simple covariance calculation, also suppose
This covariance assumption means that, conditional on \(X\) and \(W\), disturbances have the same variance and zero covariance across distinct units. It does not require normality. Since \(A\), \(W\), and \(X\) are fixed conditional on \(X,W\), the solution gives \(Wy=WAX\beta+WA\varepsilon\). The first term is fixed under that conditioning, while the second transmits disturbances into the spatial lag. In particular,
Thus the spatial lag will generally be correlated with the disturbance vector. For the usual regression moment involving the spatial-lag regressor, the corresponding conditional expected cross-product is
The equality follows by writing \(Wy\) as its conditional mean plus \(WA\varepsilon\): the fixed conditional-mean term has zero expected product with \(\varepsilon\), and \(E[\varepsilon'(WA)'\varepsilon\mid X,W]=\sigma^2\operatorname{tr}((WA)')=\sigma^2\operatorname{tr}(WA)\). For a standard zero-diagonal weights matrix and nonzero feedback, this trace is typically nonzero. The exact covariance depends on \(W\) and \(\rho\), so “generally endogenous” does not mean that every conceivable configuration must produce a nonzero moment.
Worked Example: Calculating the Feedback-Induced Covariance
Use the two-unit weights matrix \(W=\begin{pmatrix}0&1\\1&0\end{pmatrix}\), with \(\rho=0.4\), and suppose \(\operatorname{Var}(\varepsilon\mid X,W)=\sigma^2I\). Here
Multiplying by \(W\) gives $$ WA=\frac{1}{0.84} \begin{pmatrix}0.4&1\\1&0.4\end{pmatrix} = \begin{pmatrix}0.4762&1.1905\\1.1905&0.4762\end{pmatrix}. $$ Consequently, $$ \operatorname{Cov}(Wy,\varepsilon\mid X,W) =\sigma^2 \begin{pmatrix}0.4762&1.1905\\1.1905&0.4762\end{pmatrix}. $$ The diagonal entries show that each unit’s spatial lag is correlated with its own structural disturbance after simultaneous feedback is accounted for. For the cross-product moment, \(\operatorname{tr}(WA)=0.4762+0.4762=0.9524\), so \(E[(Wy)'\varepsilon\mid X,W]=0.9524\sigma^2\), which is nonzero.
The feedback pathway is visible in the off-diagonal weights. A disturbance at one unit changes its outcome, that outcome enters the other unit’s spatial lag, and the other unit’s outcome feeds back into the first unit’s spatial lag. Exogeneity of the disturbances does not prevent this dependence; it is created by the simultaneous equation itself.
Exogenous Regressors Do Not Make \(Wy\) Exogenous
The condition \(E[\varepsilon\mid X,W]=0\) says that the structural disturbances have conditional mean zero given the observed regressors and the weights matrix. It supports the claim that the included covariates are exogenous under the model. But \(Wy\) is not simply another observed covariate: it contains outcomes generated by the system, including outcomes affected by \(\varepsilon\). The condition on \(X\) therefore does not imply \(E[(Wy)'\varepsilon\mid X,W]=0\).
A short comparison makes the role of feedback clear. With the two-unit matrix above, if \(\rho=0\), then \(A=I\) and \(WA=W\). Because \(W\) has zero diagonal, \(\operatorname{tr}(WA)=\operatorname{tr}(W)=0\): under the stipulated uncorrelated disturbances, each unit’s spatial lag has no same-unit disturbance component in this no-feedback case. At \(\rho=0.4\), however, the calculation above gives \(\operatorname{tr}(WA)=0.9524\). Feedback creates a route back to the unit’s own disturbance. This comparison concerns the expected regression cross-product; it does not claim that every finite sample has a zero cross-product when \(\rho=0\).
Worked Example: Comparing No Feedback With Feedback
Keep \(W=\begin{pmatrix}0&1\\1&0\end{pmatrix}\), and compare the expected cross-product \(E[(Wy)'\varepsilon\mid X,W]\) at \(\rho=0\) and \(\rho=0.4\), assuming the same conditional disturbance covariance \(\sigma^2I\).
At \(\rho=0\), \(A=I\), so \(WA=W\). Its diagonal entries are both zero, giving $$ E[(Wy)'\varepsilon\mid X,W] =\sigma^2\operatorname{tr}(W) =\sigma^2(0+0)=0. $$ At \(\rho=0.4\), the previous calculation gives \(\operatorname{tr}(WA)=0.9524\), and hence $$ E[(Wy)'\varepsilon\mid X,W] =0.9524\sigma^2. $$
The difference arises even though the assumptions about \(X\), \(W\), and the disturbance covariance have not changed. It is the nonzero spatial feedback coefficient that introduces the return path linking a unit’s disturbance to its own spatially lagged outcome.
Common Pitfall and Practical Importance
Incorrect reasoning: “The regressors \(X\) are exogenous and the disturbance has mean zero, so every right-hand-side variable is uncorrelated with the disturbance. Therefore ordinary regression of \(y\) on \(Wy\) and \(X\) is justified by exogeneity.”
Correction: Exogeneity of \(X\) does not extend automatically to \(Wy\). The latter is constructed from \(y\), which itself contains \(\varepsilon\) through the simultaneous system. Under the stated homoskedastic, uncorrelated-disturbance assumptions, \(\operatorname{Cov}(Wy,\varepsilon\mid X,W)=\sigma^2W(I-\rho W)^{-1}\); its diagonal feedback terms, and typically the associated cross-product moment, are nonzero. A regression method must account for this endogeneity rather than treating \(Wy\) as an exogenous covariate.
The key modeling distinction is between spatially patterned outcomes and simultaneous outcome feedback. The model \(y=\rho Wy+X\beta+\varepsilon\) specifically says that neighboring outcomes enter the outcome equation. Its solution makes the feedback structure explicit and shows why the spatial-lag regressor requires special econometric treatment. This is separate from the question of whether disturbances themselves are spatially correlated: here the disturbance covariance was taken to be \(\sigma^2I\), yet feedback alone generated endogeneity in \(Wy\).
Check Your Understanding
Answer using the model and assumptions stated in the tutorial.
- Write the unit-level equation for unit \(i\) in terms of the weights \(w_{ij}\), and explain why the model is simultaneous.
- What condition allows the expression \(y=(I-\rho W)^{-1}(X\beta+\varepsilon)\) to define a unique solution?
- Under conditional disturbance covariance \(\sigma^2 I\), what is \(\operatorname{Cov}(Wy,\varepsilon\mid X,W)\)?
- In the two-unit example, why does \(\operatorname{tr}(WA)\) equal zero when \(\rho=0\), but not when \(\rho=0.4\)?
- Why does \(E[\varepsilon\mid X,W]=0\) not establish that \(Wy\) is exogenous?