Why Reshape the Instrument Set?
In difference-GMM, lagged levels of an outcome can instrument its first difference when the model’s moment conditions make those levels orthogonal to the differenced error. As the number of periods grows, using every eligible lag at every equation date can create a large set of instruments. Two direct ways to control that set are to collapse the instrument matrix and to restrict the eligible lag distances.
These operations are related but not interchangeable. Collapsing combines time-specific instruments that share a lag distance into a common column. Restricting a lag set removes instruments at selected distances, and therefore removes their associated moments. Neither operation, by itself, proves that the retained instruments are valid or that the estimator is well behaved. The goal is to state clearly which moment conditions the estimator uses, rather than to maximize the instrument count.
Setup and Instrument-Matrix Definitions
Consider the dynamic-panel model \(y_{it}=\rho y_{i,t-1}+\eta_i+\varepsilon_{it}\), where \(i\) indexes units and \(t\) indexes time. First differencing removes the time-invariant component \(\eta_i\), giving \(\Delta y_{it}=\rho\Delta y_{i,t-1}+\Delta\varepsilon_{it}\). For this tutorial, focus on the lagged dependent variable as the endogenous regressor and on its lagged levels as instruments.
For an equation dated \(t\), define the lag distance \(d=t-j\) for an instrument \(y_{ij}\). Under the standard difference-GMM timing conditions, \(y_{ij}\) is eligible for the differenced equation at \(t\) when \(j\leq t-2\), or equivalently \(d\geq2\). With data beginning at period 1, the available distances also satisfy \(d\leq t-1\). These are validity conditions, not just a convenient way to index columns: the chosen levels must be orthogonal to \(\Delta\varepsilon_{it}\).
For example, a lag-distance set \(2\) through \(L\) means that an equation at \(t\) can use \(y_{i,t-2},\ldots,y_{i,t-L}\), subject to the observed panel boundary. For unbalanced panels, availability is determined separately for each unit and date. Instrument counts below refer to the balanced, single-endogenous-regressor case; adding other instrumented regressors or included exogenous instruments changes the total.
Worked Example: Uncollapsed and Collapsed Matrices
Worked Example: Uncollapsed and Collapsed Matrices
Suppose a hypothetical balanced panel has periods 1 through 5. Use the differenced equations dated \(t=3,4,5\), and include every eligible lagged level of \(y\). At \(t=3\), only \(y_{i1}\) is eligible; at \(t=4\), \(y_{i1}\) and \(y_{i2}\) are eligible; at \(t=5\), \(y_{i1},y_{i2},y_{i3}\) are eligible. Thus the uncollapsed matrix has \(1+2+3=6\) columns.
In the following display, each row corresponds to a differenced equation, and a zero means that the column’s date-specific instrument is not used in that equation. The labels above the entries define the six separate columns.
The pair in a column label is (equation date, instrument date). For the collapsed matrix, group entries by \(d=t-j\). Here the available distances are \(2,3,4\). For instance, distance 2 supplies \(y_{i1}\) at \(t=3\), \(y_{i2}\) at \(t=4\), and \(y_{i3}\) at \(t=5\). The result has three columns:
The uncollapsed count is 6; the collapsed count is 3. Collapsing does not make the data values identical or average them within a unit. It creates a shared instrument column whose entries vary across equation dates. In the sample moment vector, that shared column pools the corresponding date-specific contributions.
Counting Instruments and Restricting Lag Distances
With periods 1 through \(T\), equations dated \(3,\ldots,T\), and all eligible lagged levels, the uncollapsed count is the sum of the number of available lags at each date. At date \(t\), this number is \(t-2\). The collapsed matrix instead has one column for each available distance, \(2,\ldots,T-1\).
If the retained lag distances are \(a,\ldots,b\), where \(2\leq a\leq b\), then the collapsed count is \(b-a+1\), provided each distance is available in at least one equation. The uncollapsed count is date-specific: at equation date \(t\), retain the distances in \(a,\ldots,b\) that also satisfy \(d\leq t-1\). Thus early equations may contribute fewer columns than later equations. Restriction and collapse can be combined: first select the lag distances, then use one collapsed column for each selected distance.
Worked Example: Counting a Restricted Lag Window
Suppose a hypothetical balanced panel has \(T=8\), and the estimator retains lag distances 2, 3, and 4. There are six differenced equations, dated 3 through 8. The number of selected distances available at each date is:
Therefore, the restricted uncollapsed count is \(1+2+3+3+3+3=15\). With collapsing, the same lag window produces three columns, one for each of distances 2, 3, and 4. For comparison, using all eligible lags without collapsing gives \((8-2)(8-1)/2=21\) columns; collapsing all eligible lags gives \(8-2=6\) columns. The restriction has removed the longer distances, while collapsing has pooled date-specific instruments within each retained distance.
These are counts for the lagged outcome alone. If the model also includes instruments for other regressors, the total count must include those columns as well. In practice, report the instrument count for the full estimation matrix, not just the part illustrated here.
What Happens to the Moment Conditions?
Let \(g_{t,d}(\rho)\) denote the sample moment contribution for an instrument at distance \(d\) in the equation dated \(t\). In an uncollapsed specification, the date-specific moment conditions are kept as separate components. Collapsing distance \(d\) replaces those components with their pooled sum, over dates where that distance is available:
This expression describes the moment aggregation induced by a shared column. It is not generally equivalent to retaining every date-specific moment: several separate restrictions have been replaced by one pooled restriction. By contrast, restricting the lag window removes the moment components associated with omitted distances altogether. The retained moments still need their original orthogonality assumptions.
Worked Example: Comparing Illustrative GMM Estimates
Worked Example: Comparing Illustrative GMM Estimates
Consider a simplified hypothetical one-parameter GMM calculation. Suppose three date-specific sample moments are \(g(\rho)=m-q\rho\), with \(m=(1.8,1.1,1.2)'\) and \(q=(2,1,1)'\). For illustration, use the identity weighting matrix. The estimate minimizes the sum of squared moments, so it equals \((q'q)^{-1}q'm\). This example isolates how aggregation or exclusion of moments can affect an estimate; it is not a claim about a real panel or a substitute for calculating the moments from data.
With all three moments retained separately, the estimate is:
Now suppose the three contributions correspond to a common lag-distance column and are pooled by collapsing. The pooled moment has \(m_{\mathrm{coll}}=1.8+1.1+1.2=4.1\) and \(q_{\mathrm{coll}}=2+1+1=4\). With one moment and identity weighting, the estimate that minimizes its squared value is \(m_{\mathrm{coll}}/q_{\mathrm{coll}}\):
Alternatively, suppose the third moment is excluded by a lag restriction, leaving \(m=(1.8,1.1)'\) and \(q=(2,1)'\). Then:
The three estimates differ because the GMM objective uses different moment vectors. In applied work, weighting matrices and sample moment values are more complex, so there is no general rule that collapsing or restriction must move the estimate in a particular direction. These calculations also do not establish that any specification is preferable: the moment validity assumptions and the substantive specification must still be justified.
Construction and Reporting
A transparent implementation begins by defining the equation dates and the eligible lag distances, then mapping each instrument to its column. A useful workflow is:
Identify the differenced equations and the timing assumptions that justify each candidate lagged level as an instrument.
Specify the minimum and maximum lag distances included. Apply availability rules at each equation date and, in an unbalanced panel, for each unit.
If collapsing, map eligible instruments with the same distance to a common column. If not, retain separate date-specific columns.
Count all instrument columns, including those for other regressors and included exogenous variables, and report the lag window and whether the matrix is collapsed.
The starting assumptions matter. For the lagged outcome, the standard moment conditions require that the eligible lagged levels be orthogonal to the differenced disturbance. If serial dependence or the assumed timing structure undermines that orthogonality, fewer columns do not repair the invalid moments that remain. Conversely, a lag restriction can remove some questionable moments only when the retained distances are justified; it is not an automatic validity test.
Common Mistake and Why the Choice Matters
A common mistake is to say that collapsing “keeps all the same moment conditions but writes them more compactly.” That is generally false. Separate uncollapsed columns encode separate date-specific moments; a collapsed column pools their contributions and imposes a different, lower-dimensional set of restrictions. Another mistake is to assume that reducing the instrument count guarantees more reliable estimates. Reduction addresses the size and structure of the instrument set, not every source of misspecification or weak identification.
For interpretation, report enough detail to make the instrument construction reproducible: the lag range, whether the matrix is collapsed, the total number of instruments, and which regressor blocks contribute instruments. When estimates change across constructions, that difference is informative about dependence on the chosen moments, but it is not itself proof that one result is correct. The choice should be substantively defensible and made with the underlying orthogonality conditions in view.
Check Your Understanding
Answer each question by referring to equation dates, lag distances, and moment conditions.
- For a panel observed from period 1 through period 6, how many lagged-outcome columns are in the fully uncollapsed and fully collapsed difference-GMM matrices?
- For \(T=7\), equations dated 3 through 7, and lag distances 2 through 3, calculate the restricted uncollapsed instrument count and the collapsed count.
- Explain why a collapsed column for lag distance 2 pools moment contributions rather than preserving each date-specific moment as a separate restriction.
- Can collapsing establish that the retained lagged levels are valid instruments? State what must justify their validity.
- In the illustrative GMM calculation, why can the estimate from a collapsed matrix differ from the estimate using all date-specific moments, even if the pooled instrument is formed from those moments?