Tutorials › Linear Algebra › Span as a Set of Linear Combinations

Span and the Column Space View · Tutorial 136 of 1000

Span as a Set of Linear Combinations

Learn to describe the full set generated by a finite list of vectors, including the special cases of no generators and zero generators.

Beginner 9 min read

What You'll Learn

  • Define the span of a finite list of vectors in \(\mathbb{R}^n\).
  • Use scalar parameters to describe every vector in a span.
  • Compute spans generated by one or several vectors in \(\mathbb{R}^2\) and \(\mathbb{R}^3\).
  • Distinguish an empty list of generators from a list containing zero vectors.
  • Prove basic properties of spans directly from the definition.

Span Collects All Linear Combinations

A list of vectors does not generate only the vectors written in the list. It also generates every vector that can be made by multiplying those vectors by scalars and adding the results. For example, starting with \((1,2)\), we can form \((3,6)\) by multiplying by \(3\), or \((-1,-2)\) by multiplying by \(-1\). The span records all such possibilities at once.

Throughout this tutorial the vectors lie in \(\mathbb{R}^n\), and the scalars are real numbers. A linear combination of a finite list \(\mathbf{v}_1,\dots,\mathbf{v}_p\) is an expression \(c_1\mathbf{v}_1+\cdots+c_p\mathbf{v}_p\), where each \(c_i\in\mathbb{R}\). The coefficients may be chosen independently. In particular, they are not required to be \(1\), and they may be zero or negative.

Definition: For a finite list \(\mathbf{v}_1,\dots,\mathbf{v}_p\) in \(\mathbb{R}^n\), its span is the set of all linear combinations of the listed vectors: $$ \operatorname{span}\{\mathbf{v}_1,\dots,\mathbf{v}_p\} = \{c_1\mathbf{v}_1+\cdots+c_p\mathbf{v}_p : c_1,\dots,c_p\in\mathbb{R}\}. $$ The list may contain repeated vectors or zero vectors. For the empty list, the sum has no terms and is defined to be \(\mathbf{0}\); accordingly, \(\operatorname{span}\{\}=\{\mathbf{0}\}\).

The braces in the span notation name the generators; the definition is about a list of generators and the combinations formed from it. The result is a set, not a list: if different coefficient choices produce the same vector, that vector appears only once in the set. To describe a span in practice, we let the coefficients vary over all real values and simplify the resulting vector expression.

Computing Spans with Parameters

Worked Example: One Generator in R²

Describe \(\operatorname{span}\{(2,-1)\}\) as a set of vectors.

A linear combination of this one-vector list has one coefficient, say \(t\in\mathbb{R}\). Multiply each coordinate by \(t\):

$$ t(2,-1)=(2t,-t). $$

As \(t\) ranges over all real numbers, this gives the full span:

$$ \operatorname{span}\{(2,-1)\} = \{(2t,-t):t\in\mathbb{R}\}. $$

For instance, \(t=0\) gives \((0,0)\), \(t=1\) gives \((2,-1)\), and \(t=-2\) gives \((-4,2)\). These are examples from the span; allowing every real \(t\) describes all of it.

Check: every vector in the displayed set has the form \(t(2,-1)\), so it is a linear combination of the generator. Conversely, every linear combination of the one-vector list has exactly that form.

Worked Example: Two Generators in R³

Describe the span of \(\mathbf{v}_1=(1,0,1)\) and \(\mathbf{v}_2=(0,2,0)\).

Choose arbitrary real coefficients \(a\) and \(b\). The general linear combination is

$$ a(1,0,1)+b(0,2,0) =(a,0,a)+(0,2b,0) =(a,2b,a). $$

Therefore the span is

$$ \operatorname{span}\{(1,0,1),(0,2,0)\} = \{(a,2b,a):a,b\in\mathbb{R}\}. $$

The parameters are independent: \(a\) may be any real number, and \(b\) may also be any real number. For example, \(a=3\) and \(b=-1\) produce \((3,-2,3)\), and the calculation back in terms of the generators is \(3(1,0,1)-1(0,2,0)=(3,-2,3)\).

Check: for every choice of \(a,b\), the vector \((a,2b,a)\) equals \(a\mathbf{v}_1+b\mathbf{v}_2\). In the other direction, the definition says every vector in the span is such a combination, and the coordinate calculation shows every such combination has the stated form.

Worked Example: A Repeated Direction and a Zero Generator

Describe the span of \((1,2)\), \((2,4)\), and \((0,0)\) in \(\mathbb{R}^2\).

Let \(a,b,c\in\mathbb{R}\) be the coefficients. The general combination is

$$ \begin{aligned} a(1,2)+b(2,4)+c(0,0) &=(a,2a)+(2b,4b)+(0,0)\\ &=(a+2b,\,2a+4b)\\ &=(a+2b,\,2(a+2b)). \end{aligned} $$

Set \(t=a+2b\). Since \(a\) and \(b\) are arbitrary real numbers, \(t\) is real, and the combination has the form \((t,2t)\). Also, every real value of \(t\) can occur: choose \(a=t\), \(b=0\), and \(c=0\). Hence

$$ \operatorname{span}\{(1,2),(2,4),(0,0)\} = \{(t,2t):t\in\mathbb{R}\}. $$

The second generator contributes \(2b(1,2)\), so it does not create a new type of combination. The zero generator contributes nothing, regardless of the value of \(c\).

Check: each vector \((t,2t)\) equals \(t(1,2)+0(2,4)+0(0,0)\), so it belongs to the span. Conversely, the calculation above shows that every combination of the three generators is \((t,2t)\) for \(t=a+2b\).

The Empty List and Zero Vectors

The empty-list convention is important because it makes the definition precise even when there are no generators. There is exactly one sum with no terms, and by convention its value is the zero vector. Thus the span of the empty list is the set containing the zero vector—not the empty set.

Worked Example: Empty and Zero Lists

Compare the span of the empty list in \(\mathbb{R}^3\) with the span of the list \(\mathbf{0},\mathbf{0}\).

For the empty list, there are no coefficients to choose and the empty sum is \(\mathbf{0}\):

$$ \operatorname{span}\{\}=\{(0,0,0)\}. $$

For the list containing two zero vectors, a linear combination has the form \(a(0,0,0)+b(0,0,0)\). For all \(a,b\in\mathbb{R}\), this is \((0,0,0)\), so

$$ \operatorname{span}\{(0,0,0),(0,0,0)\} =\{(0,0,0)\}. $$

Check: the empty list produces the zero vector by the empty-sum convention. The two-vector list produces the same vector because each summand is zero. In both cases the zero vector is produced, and no other vector is produced.

More generally, the span of any list consisting only of zero vectors is \(\{\mathbf{0}\}\). Every linear combination of such a list is zero. If the list is nonempty, choosing all coefficients zero also gives zero; if it is empty, the empty-sum convention gives zero. In either case, zero is the only possible result.

Basic Properties from the Definition

Two useful facts follow directly from what span means: every listed vector belongs to the span, and combining vectors already in a span produces another vector in that span. The second fact says that once a set contains all the combinations of a list, further linear combinations of those results do not produce anything outside that set.

Theorem: For any finite list \(\mathbf{v}_1,\dots,\mathbf{v}_p\) in \(\mathbb{R}^n\), its span contains \(\mathbf{0}\) and every listed vector. If \(p=0\), the statement about listed vectors has no instances.

Proof. If \(p=0\), the definition gives \(\operatorname{span}\{\}=\{\mathbf{0}\}\), so the span contains \(\mathbf{0}\), and there are no listed vectors to check. Now suppose \(p\geq 1\). Choosing every coefficient equal to zero gives \(0\mathbf{v}_1+\cdots+0\mathbf{v}_p=\mathbf{0}\), so \(\mathbf{0}\) is in the span. For any index \(k\) with \(1\leq k\leq p\), choose coefficient \(1\) on \(\mathbf{v}_k\) and \(0\) on every other vector. The resulting linear combination is \(\mathbf{v}_k\), so \(\mathbf{v}_k\) belongs to the span. \(\square\)

Theorem: Let \(S=\operatorname{span}\{\mathbf{v}_1,\dots,\mathbf{v}_p\}\). For any finite list \(\mathbf{x}_1,\dots,\mathbf{x}_q\) from \(S\) and any real coefficients \(d_1,\dots,d_q\), the combination \(d_1\mathbf{x}_1+\cdots+d_q\mathbf{x}_q\) belongs to \(S\). When \(q=0\), this combination means the empty sum \(\mathbf{0}\).

Proof. If \(q=0\), the combination is \(\mathbf{0}\), which belongs to \(S\) by the preceding theorem. Suppose \(q\geq1\). Because each \(\mathbf{x}_j\) lies in \(S\), the definition of span gives real numbers \(c_{1j},\dots,c_{pj}\) such that \(\mathbf{x}_j=\sum_{i=1}^{p}c_{ij}\mathbf{v}_i\). Substitute these expressions into the combination and collect the coefficient of each \(\mathbf{v}_i\): $$ \sum_{j=1}^{q}d_j\mathbf{x}_j = \sum_{j=1}^{q}d_j\left(\sum_{i=1}^{p}c_{ij}\mathbf{v}_i\right) = \sum_{i=1}^{p}\left(\sum_{j=1}^{q}d_jc_{ij}\right)\mathbf{v}_i. $$ Each coefficient \(\sum_{j=1}^{q}d_jc_{ij}\) is real, so the final expression is a linear combination of the original list \(\mathbf{v}_1,\dots,\mathbf{v}_p\). It therefore belongs to \(S\). If \(p=0\), then \(S=\{\mathbf{0}\}\); every \(\mathbf{x}_j\) equals zero, and the combination is zero, so the conclusion still holds. \(\square\)

This closure property explains why it is enough to describe a span using arbitrary coefficients on the original generators. First making some combinations and then combining those results cannot enlarge the set: the final vector can always be written directly as a combination of the original list.

A Smallest-Set Characterization

There is another way to understand the word “span.” Consider a set \(U\subseteq\mathbb{R}^n\) that contains each generator and is closed under finite linear combinations, including the empty combination. Then \(U\) must contain every vector in the span, because every such vector is a combination of the generators.

Theorem: Let \(U\subseteq\mathbb{R}^n\) contain \(\mathbf{v}_1,\dots,\mathbf{v}_p\), and suppose every finite linear combination of elements of \(U\), including the empty combination, belongs to \(U\). Then \(\operatorname{span}\{\mathbf{v}_1,\dots,\mathbf{v}_p\}\subseteq U\).

Proof. Take any \(\mathbf{x}\in\operatorname{span}\{\mathbf{v}_1,\dots,\mathbf{v}_p\}\). By the definition of span, \(\mathbf{x}=c_1\mathbf{v}_1+\cdots+c_p\mathbf{v}_p\) for real coefficients \(c_1,\dots,c_p\). Each \(\mathbf{v}_i\) lies in \(U\) by assumption, so this finite linear combination of elements of \(U\) lies in \(U\). Therefore \(\mathbf{x}\in U\). If \(p=0\), the span contains only \(\mathbf{0}\); the empty-combination condition gives \(\mathbf{0}\in U\), so the same inclusion holds. \(\square\)

The theorem does not say that every set containing the generators must contain their span. It needs the additional condition that the set is closed under finite linear combinations. Under that condition, the span is contained in every such set: it includes exactly the vectors forced by allowing all combinations of the given generators.

Common Mistake: Listing Generators Instead of Combinations

A frequent error is to report the generators themselves as the span. For example, a wrong calculation is \(\operatorname{span}\{(1,0),(0,1)\}=\{(1,0),(0,1)\}\). That right-hand side contains only two vectors and leaves out combinations such as \(2(1,0)-3(0,1)=(2,-3)\). The correction is to allow arbitrary coefficients:

$$ a(1,0)+b(0,1)=(a,b), \qquad \operatorname{span}\{(1,0),(0,1)\} = \{(a,b):a,b\in\mathbb{R}\}. $$

The mistake is to confuse the list of inputs with the set of all outputs permitted by the definition. A reliable check is to write a general coefficient for every listed vector before simplifying. For a list of \(p\) generators, use \(p\) real coefficients; for the empty list, use the empty-sum convention.

Span is useful because it gives a precise description of what a collection of vectors can produce through addition and scalar multiplication. In later work, questions about whether a vector can be assembled from given columns will be expressed using this definition. For now, the essential skill is to state the full set with freely varying coefficients and to check that the parameter description represents exactly the allowed combinations.

Check Your Understanding

For each question, begin with the general linear combination and use arbitrary real coefficients.

  1. Write \(\operatorname{span}\{(3,1)\}\) as a parameterized set in \(\mathbb{R}^2\).
  2. Describe \(\operatorname{span}\{(1,0,0),(0,0,2)\}\) as a set in \(\mathbb{R}^3\).
  3. Find the span of \((1,-1)\), \((2,-2)\), and \((0,0)\) in \(\mathbb{R}^2\).
  4. What is the span of the empty list in \(\mathbb{R}^2\)? State the empty-sum convention involved.
  5. Prove directly from the definition that each generator belongs to the span when the list is nonempty.

Test yourself: Linear Algebra final exam practice

Ready to check what you know? Work a full-length practice final, then open the complete worked solutions.

Want all 1,114 practice problems?

This tutorial covers one topic. Calc Pass covers the full Calculus AB & BC curriculum (the core of Calculus I and II): full review, every practice question, and step-by-step solutions to each one.

QR code to download the Calc Pass app

Get the Calc Pass App

Scan to download and practice on the go, with instant scoring.

Calc Pass Volume 1: 1,114 Practice Questions book cover

Vol. 1: 1,114 Questions

The complete practice question bank, organized by AB & BC topic.

View on Amazon
Calc Pass Volume 2: Solutions Manual book cover

Vol. 2: Solutions Manual

Fully worked solutions to every question in Volume 1.

View on Amazon