Tutorials › Linear Algebra › Rank of a Transpose

Fundamental Subspaces and Rank · Tutorial 353 of 1000

Rank of a Transpose

Learn why transposition preserves rank and how to check the result by row reduction on rectangular matrices.

Intermediate 10 min read

What You'll Learn

  • Relate the column space of a transpose to the row space of the original matrix.
  • Deduce equality of the ranks of a matrix and its transpose.
  • Calculate and check ranks for rectangular matrices using row reduction.
  • Use row rank and column rank to bound the rank by both matrix dimensions.
  • Avoid confusing a matrix’s number of rows with its rank.

Rank and Transposition

The rank of a matrix measures how many independent directions its columns span. Transposing a matrix turns its rows into columns, so understanding the rank of a transpose requires connecting the row space of the original matrix to its column space. The key fact is that these spaces have the same dimension. This lets us conclude that transposition changes the shape of a matrix but not its rank.

Let \(\mathbf{A}\in\mathbb{R}^{m\times n}\). Its column space, \(\operatorname{Col}\mathbf{A}\), is the subspace of \(\mathbb{R}^m\) spanned by its columns. Its row space can be viewed as a subspace of \(\mathbb{R}^n\): we treat each row as a column vector by transposing it before taking the span. The rank of \(\mathbf{A}\) is the dimension of its column space. The row rank is the dimension of its row space.

Definition: For a matrix \(\mathbf{A}\), its rank is \(\operatorname{rank}\mathbf{A}=\dim(\operatorname{Col}\mathbf{A})\). Its row rank is the dimension of the subspace spanned by its rows, with each row regarded as a vector in the appropriate coordinate space. The Row-Rank/Column-Rank Theorem states that, for every real matrix, its row rank equals its column rank.

The Row-Rank/Column-Rank Theorem was established in the earlier material on row rank and column rank. In particular, it applies to rectangular matrices; it does not require a matrix to be square. We will use it to deduce the rank-of-a-transpose result. First, the relation between the two spaces can be stated precisely.

Lemma: If \(\mathbf{A}\in\mathbb{R}^{m\times n}\), then \(\operatorname{Col}(\mathbf{A}^{\top})\) is the span of the transposes of the rows of \(\mathbf{A}\). Consequently, \(\dim(\operatorname{Col}(\mathbf{A}^{\top}))\) is the row rank of \(\mathbf{A}\).

Proof. Write the rows of \(\mathbf{A}\) as \(\mathbf{r}_1^{\top},\dots,\mathbf{r}_m^{\top}\), where each \(\mathbf{r}_i\) is a column vector in \(\mathbb{R}^n\). By the definition of transpose, the columns of \(\mathbf{A}^{\top}\) are precisely \(\mathbf{r}_1,\dots,\mathbf{r}_m\). Therefore \(\operatorname{Col}(\mathbf{A}^{\top})=\operatorname{span}\{\mathbf{r}_1,\dots,\mathbf{r}_m\}\), which is the row space of \(\mathbf{A}\) under our column-vector convention. Taking dimensions gives the stated equality. \(\square\)

The Rank-of-a-Transpose Theorem

Theorem: For every \(\mathbf{A}\in\mathbb{R}^{m\times n}\), \(\operatorname{rank}(\mathbf{A}^{\top})=\operatorname{rank}\mathbf{A}\).

Proof. By definition, \(\operatorname{rank}(\mathbf{A}^{\top})=\dim(\operatorname{Col}(\mathbf{A}^{\top}))\). By the lemma, this is the row rank of \(\mathbf{A}\). The Row-Rank/Column-Rank Theorem says that the row rank of \(\mathbf{A}\) equals its column rank, which by definition is \(\operatorname{rank}\mathbf{A}\). Combining these equalities gives \(\operatorname{rank}(\mathbf{A}^{\top})=\operatorname{rank}\mathbf{A}\). \(\square\)

The theorem compares dimensions of spaces, not the shapes of the matrices. If \(\mathbf{A}\) is \(m\times n\), then \(\mathbf{A}^{\top}\) is \(n\times m\), but both have the same rank. In a row-reduction calculation, the number of pivots gives the rank. One may row-reduce either matrix to compute that common number; the pivot positions themselves need not correspond, because the two matrices have different sizes and different entries.

Checking the Result on Rectangular Matrices

Worked Example: A \(2\times3\) Matrix of Rank Two

Find the ranks of \(\mathbf{A}\) and \(\mathbf{A}^{\top}\) for

$$ \mathbf{A}= \begin{bmatrix} 1&2&0\\ 0&1&1 \end{bmatrix}. $$

Subtract \(2R_2\) from \(R_1\):

$$ \begin{bmatrix} 1&2&0\\ 0&1&1 \end{bmatrix} \underset{R_1\to R_1-2R_2}{\sim} \begin{bmatrix} 1&0&-2\\ 0&1&1 \end{bmatrix}. $$

There are two pivots, so \(\operatorname{rank}\mathbf{A}=2\). Transposing the original matrix gives

$$ \mathbf{A}^{\top}= \begin{bmatrix} 1&0\\ 2&1\\ 0&1 \end{bmatrix}. $$

Subtract \(2R_1\) from \(R_2\), then subtract the new \(R_2\) from \(R_3\):

$$ \begin{bmatrix} 1&0\\ 2&1\\ 0&1 \end{bmatrix} \underset{R_2\to R_2-2R_1}{\sim} \begin{bmatrix} 1&0\\ 0&1\\ 0&1 \end{bmatrix} \underset{R_3\to R_3-R_2}{\sim} \begin{bmatrix} 1&0\\ 0&1\\ 0&0 \end{bmatrix}. $$

There are again two pivots, so \(\operatorname{rank}(\mathbf{A}^{\top})=2\). As a direct check on \(\mathbf{A}\), its columns are \((1,0)^{\top}\), \((2,1)^{\top}\), and \((0,1)^{\top}\). The first two are independent: if \(a(1,0)^{\top}+b(2,1)^{\top}=\mathbf{0}\), the second coordinate gives \(b=0\), and then the first gives \(a=0\). Also, \((0,1)^{\top}=(2,1)^{\top}-2(1,0)^{\top}\), so the third column adds no new direction. Thus the column space has dimension two, agreeing with both row-reduction calculations.

Worked Example: A \(3\times2\) Matrix of Rank One

Calculate the ranks of the matrix and its transpose:

$$ \mathbf{B}= \begin{bmatrix} 1&2\\ 2&4\\ -1&-2 \end{bmatrix}, \qquad \mathbf{B}^{\top}= \begin{bmatrix} 1&2&-1\\ 2&4&-2 \end{bmatrix}. $$

For \(\mathbf{B}\), replace \(R_2\) by \(R_2-2R_1\) and \(R_3\) by \(R_3+R_1\):

$$ \begin{bmatrix} 1&2\\ 2&4\\ -1&-2 \end{bmatrix} \underset{\substack{R_2\to R_2-2R_1\\R_3\to R_3+R_1}}{\sim} \begin{bmatrix} 1&2\\ 0&0\\ 0&0 \end{bmatrix}. $$

Only one pivot remains, so \(\operatorname{rank}\mathbf{B}=1\). For the transpose, replace \(R_2\) by \(R_2-2R_1\):

$$ \begin{bmatrix} 1&2&-1\\ 2&4&-2 \end{bmatrix} \underset{R_2\to R_2-2R_1}{\sim} \begin{bmatrix} 1&2&-1\\ 0&0&0 \end{bmatrix}. $$

There is one pivot, so \(\operatorname{rank}(\mathbf{B}^{\top})=1\). To check the result from the columns, the second column of \(\mathbf{B}\) is twice the first, and the first is nonzero. Hence its column space has dimension exactly one. The two columns of \(\mathbf{B}^{\top}\) are \((1,2)^{\top}\) and \((2,4)^{\top}\); the second is twice the first, while the first is nonzero. Its column space also has dimension exactly one.

Worked Example: Full Column Rank in a \(3\times2\) Matrix

Find the rank of \(\mathbf{C}\) and its transpose, where

$$ \mathbf{C}= \begin{bmatrix} 1&2\\ 0&1\\ 1&3 \end{bmatrix}, \qquad \mathbf{C}^{\top}= \begin{bmatrix} 1&0&1\\ 2&1&3 \end{bmatrix}. $$

For \(\mathbf{C}\), subtract \(R_1\) from \(R_3\), then subtract the new \(R_2\) from \(R_3\). Finally, subtract \(2R_2\) from \(R_1\):

$$ \begin{bmatrix} 1&2\\ 0&1\\ 1&3 \end{bmatrix} \underset{R_3\to R_3-R_1}{\sim} \begin{bmatrix} 1&2\\ 0&1\\ 0&1 \end{bmatrix} \underset{R_3\to R_3-R_2}{\sim} \begin{bmatrix} 1&2\\ 0&1\\ 0&0 \end{bmatrix} \underset{R_1\to R_1-2R_2}{\sim} \begin{bmatrix} 1&0\\ 0&1\\ 0&0 \end{bmatrix}. $$

There are two pivots, so \(\operatorname{rank}\mathbf{C}=2\). For the transpose, subtract \(2R_1\) from \(R_2\):

$$ \begin{bmatrix} 1&0&1\\ 2&1&3 \end{bmatrix} \underset{R_2\to R_2-2R_1}{\sim} \begin{bmatrix} 1&0&1\\ 0&1&1 \end{bmatrix}. $$

It also has two pivots, so \(\operatorname{rank}(\mathbf{C}^{\top})=2\). The original columns \((1,0,1)^{\top}\) and \((2,1,3)^{\top}\) are independent: if their linear combination with coefficients \(a,b\) is zero, the second coordinate gives \(b=0\), and then the first gives \(a=0\). The rows of \(\mathbf{C}\), viewed as columns, are \((1,2)^{\top}\), \((0,1)^{\top}\), and \((1,3)^{\top}\); the third is the sum of the first two, while the first two are independent. These checks confirm rank two on both sides.

Rank Is Bounded by Both Dimensions

The equality of row rank and column rank also gives a useful bound that applies to every rectangular matrix. A matrix with \(m\) rows cannot have more than \(m\) independent columns, and its \(n\) rows cannot span a space of dimension greater than \(n\). Therefore the rank is limited by whichever dimension is smaller.

Theorem: If \(\mathbf{A}\in\mathbb{R}^{m\times n}\), then \(0\leq\operatorname{rank}\mathbf{A}\leq\min(m,n)\).

Proof. The column space is a subspace of \(\mathbb{R}^m\), so its dimension is at most \(m\). To see this bound, a basis of the column space is an independent list in \(\mathbb{R}^m\); placing its vectors as columns gives a matrix with a pivot in every column, so the number of basis vectors cannot exceed the number \(m\) of rows. Thus \(\operatorname{rank}\mathbf{A}\leq m\). The row space is a subspace of \(\mathbb{R}^n\), so the same argument gives that its dimension is at most \(n\). By the Row-Rank/Column-Rank Theorem, that dimension is \(\operatorname{rank}\mathbf{A}\), hence \(\operatorname{rank}\mathbf{A}\leq n\) as well. A dimension is nonnegative, so combining the three inequalities gives the result. \(\square\)

For a nonzero \(m\times n\) matrix, the rank may reach \(\min(m,n)\), but it cannot exceed it. In the previous example, \(\mathbf{C}\) has two columns and three rows, and its rank is \(2=\min(3,2)\). Its transpose has three columns and two rows, with the same maximum possible rank, \(2\). This is one reason it matters to distinguish rank from the number of rows or columns: rectangular matrices can have either dimension larger than their rank.

Common Pitfall: Counting Rows as Rank

A frequent mistake is to count the rows of the transpose and call that number its rank. For the first worked example, \(\mathbf{A}^{\top}\) has three rows. The incorrect calculation is “\(\operatorname{rank}(\mathbf{A}^{\top})=3\), because it has three rows.” But three rows only place an upper bound on rank; they do not guarantee three independent directions. In fact, row reduction gives

$$ \begin{bmatrix} 1&0\\ 2&1\\ 0&1 \end{bmatrix} \underset{R_2\to R_2-2R_1}{\sim} \begin{bmatrix} 1&0\\ 0&1\\ 0&1 \end{bmatrix} \underset{R_3\to R_3-R_2}{\sim} \begin{bmatrix} 1&0\\ 0&1\\ 0&0 \end{bmatrix}. $$

There are only two pivots, so the corrected result is \(\operatorname{rank}(\mathbf{A}^{\top})=2\). The theorem gives the same conclusion from \(\operatorname{rank}\mathbf{A}=2\). In general, row counts and column counts give bounds; pivots or the dimensions of the corresponding spaces determine the actual rank.

What to Carry Forward

The rank-of-a-transpose theorem follows from two facts: the columns of \(\mathbf{A}^{\top}\) are the rows of \(\mathbf{A}\), and the row rank of a matrix equals its column rank. The first identifies the relevant spaces; the second equates their dimensions with rank. No square-matrix assumption is needed, and no special case is needed when the rank is zero. The zero matrix, for example, has only zero columns and rows, so both it and its transpose have rank zero.

When checking a calculation, keep track of the ambient spaces as well as the number of pivots. The columns of an \(m\times n\) matrix lie in \(\mathbb{R}^m\), whereas the columns of its transpose lie in \(\mathbb{R}^n\). Their spans may live in different spaces and have different vectors, yet the theorem guarantees equal dimensions. That distinction—different spaces, equal dimension—is the central point of the result.

Check Your Understanding

Use the row-space and column-space relationship to justify your answers, not just the matrix shapes.

  1. If \(\mathbf{A}\) is \(4\times2\) and has rank \(1\), what is the rank of \(\mathbf{A}^{\top}\)? What are the dimensions of the two matrices?
  2. For \(\mathbf{D}=\begin{bmatrix}1&0&2\\0&1&-1\end{bmatrix}\), row-reduce \(\mathbf{D}\) and \(\mathbf{D}^{\top}\), then compare their ranks.
  3. Explain why the columns of \(\mathbf{A}^{\top}\) are the rows of \(\mathbf{A}\), after the rows are regarded as column vectors.
  4. What upper bound does the rank theorem give for a \(3\times5\) matrix? Explain why both matrix dimensions matter.
  5. A student claims that every \(2\times4\) matrix has rank \(2\). Give a reason this claim is false and state the correct general bound.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon