Why Tetrads Appear in a One-Factor Model
A factor model explains covariation among measured variables through shared latent variation. With one common factor, every pair of distinct variables shares covariance through the same scalar source. This imposes exact algebraic restrictions on their covariances, even though each variable may also have its own specific variance. These restrictions are called tetrad constraints: they compare products of covariances among four distinct variables.
The important feature is that a tetrad uses only off-diagonal covariances. The specific variances affect the diagonal of the covariance matrix, but under diagonal specific covariance they do not contribute to covariances between different variables.
Model and Tetrad Definition
Let \(X=(X_1,\ldots,X_p)'\) be a random vector with finite second moments. A one-factor model with diagonal specific covariance has the form
where \(\mu\) is a mean vector, \(\lambda=(\lambda_1,\ldots,\lambda_p)'\) is the loading vector, \(F\) is a scalar common factor, and \(\varepsilon\) is the vector of specific components. Assume \(E[F]=0\), \(E[\varepsilon]=0\), \(\operatorname{Var}(F)=\phi>0\), \(\operatorname{Cov}(F,\varepsilon)=0\), and \(\operatorname{Cov}(\varepsilon)=\Psi\), where \(\Psi\) is diagonal. Write \(\Sigma=\operatorname{Cov}(X)\) and let \(\sigma_{ij}\) denote its \((i,j)\) entry.
For example, one commonly written tetrad difference is \(\sigma_{ij}\sigma_{kl}-\sigma_{ik}\sigma_{jl}\). The choice of pairing matters when writing a particular difference, but the model requires equality for all three pairings. Four distinct indices are essential: these equalities are not asserted for expressions that use a diagonal entry such as \(\sigma_{ii}\).
Deriving the Tetrad Constraints
Proof. Centering \(X\) removes \(\mu\). For any \(i\), the centered variable is \(\lambda_i F+\varepsilon_i\). Therefore
The two factor-specific covariances are zero by the model assumptions. Since \(\Psi\) is diagonal, \(\operatorname{Cov}(\varepsilon_i,\varepsilon_j)=0\) whenever \(i\ne j\). Thus, for distinct indices, \(\sigma_{ij}=\phi\lambda_i\lambda_j\). Applying this expression to each covariance product gives
All three products are equal, so their pairwise differences vanish. \(\square\)
This derivation also shows why the factor scale does not change the constraints. If the factor is rescaled, its variance and the loadings change, but each off-diagonal covariance still has the form \(\phi\lambda_i\lambda_j\); the same common factor appears in each product and cancels from the equality. In particular, setting the factor variance to one is not required for tetrad constraints.
Worked Example: Checking a Four-Variable Model
Let \(\phi=2\), \(\lambda=(1,2,-1,3)'\), and \(\Psi=\operatorname{diag}(1,2,3,4)\). The covariance matrix is \(\Sigma=2\lambda\lambda'+\Psi\), or
For the four indices \(1,2,3,4\), the three products are
Thus both independent differences formed by subtracting one of these products from another are zero. The negative products are not a problem: the loadings have mixed signs, and the tetrad equality concerns equality of products, not their positivity.
Reading and Using the Equalities
A tetrad constraint is an equality among products, not a statement that each covariance is zero or that the covariance matrix itself has rank one. The diagonal entries include the specific variances, so the full covariance matrix generally is not a rank-one matrix. Instead, the one-factor structure governs the off-diagonal covariances: each is a product of a loading for one variable, a loading for the other, and the factor variance.
The same equalities hold if the variables are standardized, provided their variances are positive. Define the correlation \(\rho_{ij}=\sigma_{ij}/\sqrt{\sigma_{ii}\sigma_{jj}}\). For four distinct indices, the denominator in each paired product is the same:
Each denominator is \(\sqrt{\sigma_{ii}\sigma_{jj}\sigma_{kk}\sigma_{ll}}\), because multiplication is commutative. The covariance-product equalities therefore imply the corresponding correlation-product equalities. This is a consequence of the tetrad equations, not an additional assumption about the scale of the variables.
Worked Example: Verifying Two Tetrads in a Five-Variable Matrix
Consider the model with \(\phi=1\), \(\lambda=(1,-2,0.5,3,-1)'\), and \(\Psi=\operatorname{diag}(2,1,3,2,4)\). It gives
For indices \(1,2,3,4\), calculate each pairing:
For indices \(1,3,4,5\), the products are
Both sets of products agree. The diagonal entries, including \(3\) for variable 1 and \(5\) for variable 5, are not used in either calculation. Their values reflect the addition of specific variances and do not enter these tetrads.
A Nonzero Tetrad Rules Out the Model
Because the theorem gives a necessary condition, a single nonzero tetrad is enough to show that a proposed covariance matrix cannot come from a one-factor model with diagonal specific covariance. This is a direct algebraic check. In contrast, observing zero tetrads does not, by itself, establish that all requirements for a valid model representation are met. The equalities should not be treated as a complete feasibility or identification result.
Worked Example: Detecting a Violation
Consider the symmetric matrix
It is a valid positive-definite covariance matrix: each diagonal entry is greater than the sum of the absolute off-diagonal entries in its row (the off-diagonal sums are \(0.9,0.8,1.0,0.7\)). Strict diagonal dominance of a symmetric matrix with positive diagonal entries ensures positive definiteness.
Now evaluate one tetrad difference:
The difference is not zero. Therefore \(S\) cannot be the covariance matrix of a one-factor model with diagonal specific covariance. Positive definiteness alone does not guarantee the one-factor restrictions; this matrix has the former property but violates the latter.
Common Pitfalls and Practical Importance
Tetrads are useful because they turn a structural assumption about latent common variation into observable restrictions on a covariance matrix. They can reveal incompatibility before attempting to interpret a factor solution. Their simplicity, however, makes it important to use the right entries and to state clearly what a successful check does and does not establish.
- Using a diagonal covariance. The equation \(\sigma_{ij}=\phi\lambda_i\lambda_j\) was derived for \(i\ne j\). Substituting \(\sigma_{ii}\) would include the specific variance, so the same cancellation argument would not apply.
- Using fewer than four distinct variables. A tetrad compares covariances among four distinct indices. Repeating an index can introduce a diagonal entry and does not give the stated constraint.
- Concluding the whole matrix has rank one. The off-diagonal entries have a one-factor product form, but the diagonal specific variances remain. The full covariance matrix need not have rank one.
- Treating zero tetrads as proof of a valid model. Vanishing tetrad differences are necessary under the stated assumptions. They do not alone verify every condition needed for an admissible factor-model representation.
- Ignoring signs. Loadings and covariances may be negative. The correct check is equality of the paired products, with their signs retained.
Check Your Understanding
Use the model assumptions and calculations in this tutorial to answer the following questions.
- Why does diagonal specific covariance imply that \(\operatorname{Cov}(\varepsilon_i,\varepsilon_j)=0\) for distinct \(i\) and \(j\)?
- For four distinct indices, write the three covariance products that must agree under a one-factor model.
- If \(\sigma_{12}\sigma_{34}=8\) and \(\sigma_{13}\sigma_{24}=8\), what additional product must equal 8?
- Why can the diagonal entries of the covariance matrix not be substituted into a tetrad equation?
- A covariance matrix has one tetrad difference equal to \(-0.04\). What conclusion follows about a one-factor model with diagonal specific covariance?
- Does finding several zero tetrad differences alone prove that a covariance matrix has a valid one-factor representation? Explain.