Tutorials › Real Analysis › Fixed Points of Recursive Sequences

Sequences · Tutorial 228 of 1000

Fixed Points of Recursive Sequences

See how fixed points can bound recursive iterates, identify their limits, and clarify the difference between an equilibrium and a convergent iteration.

Intermediate 10 min read

What You'll Learn

  • Define a fixed point of a recursive rule and distinguish it from a limit of its iterates
  • Prove a fixed point exists using endpoint inequalities and the Intermediate Value Theorem
  • Show how monotone iteration selects the least or greatest fixed point on one side of its starting value
  • Use fixed-point comparisons to bound every term of an iteration
  • Recognize why the existence of a fixed point does not guarantee convergence

Fixed Points as Equilibria of a Recursion

For a recursive sequence \(a_{n+1}=f(a_n)\), a fixed point of \(f\) is a value that the rule leaves unchanged. If an iteration starts at that value, every term remains there. But an arbitrary starting value need not produce a sequence that converges to a fixed point: convergence depends on how the rule moves nearby points, not just on the solutions of an equation.

Definition: A fixed point of a function \(f\) is a number \(p\) in the domain of \(f\) such that \(f(p)=p\). For the recursion \(a_{n+1}=f(a_n)\), if \(a_0=p\) is a fixed point, then \(a_n=p\) for every \(n\in\mathbb{N}_0\).

The last statement follows by induction: \(a_0=p\), and if \(a_n=p\), then \(a_{n+1}=f(p)=p\). A fixed point is therefore an equilibrium for the recursive rule. It is not automatically the limit of an iteration started elsewhere.

Earlier in this course, the theorem A Continuous Recursive Limit Is a Fixed Point established a useful necessary condition: if \(a_n\to L\) and \(f\) is continuous at \(L\), then \(f(L)=L\). This tutorial develops two further ideas. Endpoint inequalities can ensure that a continuous function has a fixed point, and a monotone iteration can select a particular fixed point relative to its starting value.

Endpoint Inequalities Guarantee a Fixed Point

To find a fixed point, rewrite \(f(x)=x\) as \(f(x)-x=0\). If the continuous function \(f(x)-x\) is nonnegative at one endpoint of an interval and nonpositive at the other, the Intermediate Value Theorem guarantees a zero between them. This argument establishes existence, but not uniqueness.

Theorem (Fixed Point from Endpoint Inequalities): Let \(A\leq B\), and let \(f:[A,B]\to\mathbb{R}\) be continuous. If \(f(A)\geq A\) and \(f(B)\leq B\), then \(f\) has a fixed point in \([A,B]\).

Proof. Define \(g(x)=f(x)-x\) for \(x\in[A,B]\). Since \(f\) and the identity function are continuous, \(g\) is continuous. The endpoint conditions give

$$ g(A)=f(A)-A\geq0, \qquad g(B)=f(B)-B\leq0. $$

If \(A<B\), the Intermediate Value Theorem gives a point \(p\in[A,B]\) with \(g(p)=0\). Thus \(f(p)-p=0\), so \(f(p)=p\). If \(A=B\), the two endpoint conditions give \(f(A)\geq A\) and \(f(A)\leq A\), hence \(f(A)=A\), which is already a fixed point. In either case, a fixed point belongs to \([A,B]\). \(\square\)

Worked Example: Bracketing a Fixed Point

Consider \(f(x)=1-\frac{x}{2}\) on \([0,1]\). This function is continuous, and its endpoint values satisfy

$$ f(0)=1\geq0, \qquad f(1)=\frac12\leq1. $$

The endpoint theorem guarantees a fixed point in \([0,1]\). Solving the equation identifies it:

$$ 1-\frac{x}{2}=x \quad\Longleftrightarrow\quad 1=\frac{3x}{2} \quad\Longleftrightarrow\quad x=\frac23. $$

Substitution verifies the result: \(f(2/3)=1-(2/3)/2=1-1/3=2/3\). In this example the fixed point is unique, but the endpoint theorem itself does not assert uniqueness. Nor does it say that an iteration from every initial value converges to the fixed point.

Monotone Iteration Selects a Fixed Point

A fixed point can also help control the terms of a recursive sequence. Suppose \(f\) is nondecreasing, meaning that \(x\leq y\) implies \(f(x)\leq f(y)\). If \(p\) is a fixed point and the initial value satisfies \(a_0\leq p\), then the iterates cannot pass above \(p\): whenever \(a_n\leq p\), order preservation gives \(a_{n+1}=f(a_n)\leq f(p)=p\). A corresponding statement holds below a fixed point when \(a_0\geq p\).

Theorem (Fixed-Point Selection by Monotone Iteration): Let \(J=[A,B]\), let \(f:J\to J\) be nondecreasing, and define \(a_{n+1}=f(a_n)\) from \(a_0\in J\). Suppose \(f\) is continuous on \(J\). If \(a_1\geq a_0\), then the iteration converges to the least fixed point of \(f\) in \([a_0,B]\). If \(a_1\leq a_0\), then it converges to the greatest fixed point of \(f\) in \([A,a_0]\).

Proof. First suppose \(a_1\geq a_0\). We show that the iteration is nondecreasing. The first inequality holds by assumption. If \(a_n\geq a_{n-1}\), then the fact that \(f\) is nondecreasing gives

$$ a_{n+1}=f(a_n)\geq f(a_{n-1})=a_n. $$

Induction proves \(a_{n+1}\geq a_n\) for every \(n\). Since every term lies in \(J\), the sequence is bounded above by \(B\). The Monotone Convergence Theorem therefore gives a finite limit \(L\in[a_0,B]\). By the theorem A Continuous Recursive Limit Is a Fixed Point, \(f(L)=L\).

Now let \(p\in[a_0,B]\) be any fixed point of \(f\). We prove \(a_n\leq p\) for every \(n\). The initial inequality \(a_0\leq p\) holds. If \(a_n\leq p\), then, because \(f\) is nondecreasing,

$$ a_{n+1}=f(a_n)\leq f(p)=p. $$

Thus induction gives \(a_n\leq p\) for all \(n\). Taking the limit yields \(L\leq p\). Since \(L\) is itself a fixed point in \([a_0,B]\) and is no greater than any fixed point there, it is the least such fixed point.

For the other case, suppose \(a_1\leq a_0\). If \(a_n\leq a_{n-1}\), then order preservation gives \(a_{n+1}=f(a_n)\leq f(a_{n-1})=a_n\). Hence the sequence is nonincreasing. It is bounded below by \(A\), so the Monotone Convergence Theorem gives a limit \(L\in[A,a_0]\), and continuity again implies \(f(L)=L\). If \(p\in[A,a_0]\) is any fixed point, then \(a_0\geq p\); induction using \(a_n\geq p\) gives \(a_{n+1}=f(a_n)\geq f(p)=p\). Thus \(a_n\geq p\) for every \(n\), and \(L\geq p\). Therefore \(L\) is the greatest fixed point in \([A,a_0]\). \(\square\)

The theorem describes more than the existence of a limit. It identifies which fixed point the iteration reaches when there may be several. The initial direction determines whether the limit is the least fixed point above the starting value or the greatest fixed point below it. The hypotheses matter: the interval keeps the iterates bounded, monotonicity of \(f\) preserves comparisons, and continuity allows the limit to satisfy the fixed-point equation.

Worked Example: Iteration from Below Selects the Upper Fixed Point

Let \(f(x)=\sqrt{x}\) on \(J=[0,1]\), and start at \(a_0=1/4\). The function maps \([0,1]\) into itself, is continuous, and is nondecreasing. Also,

$$ a_1=f(1/4)=1/2\geq1/4=a_0. $$

The fixed-point equation is \(\sqrt{x}=x\). Since \(x\geq0\), squaring gives \(x=x^2\), so \(x(1-x)=0\). The fixed points in \([0,1]\) are \(0\) and \(1\). Of these, only \(1\) belongs to \([a_0,1]=[1/4,1]\). The fixed-point selection theorem says that the increasing iteration converges to the least fixed point in that interval, namely \(1\).

The first terms illustrate the direction of the iteration:

$$ a_0=\frac14,\qquad a_1=\frac12,\qquad a_2=\sqrt{\frac12}. $$

Since \(\sqrt{1/2}>1/2\), the second step also increases. More generally, \(\sqrt{x}\geq x\) for \(0\leq x\leq1\): both sides are nonnegative, and \(x\geq x^2\) on this interval. The theorem establishes convergence to \(1\), even though the rule has another fixed point at \(0\).

Worked Example: Iteration from Above Selects the Lower Fixed Point

Now take \(f(x)=x^2\) on \([0,1]\), with \(a_0=1/2\). The function is continuous, maps the interval into itself, and is nondecreasing. Its fixed points satisfy \(x^2=x\), so they are \(0\) and \(1\). The first iterate is

$$ a_1=f(1/2)=1/4\leq1/2=a_0. $$

The decreasing case of the selection theorem applies. In \([0,a_0]=[0,1/2]\), the only fixed point is \(0\), so the iteration converges to \(0\). Indeed, for \(x\in[0,1]\), \(x^2\leq x\); this verifies directly that each step is nonincreasing. Starting instead at the fixed point \(1\) would keep every term equal to \(1\). The same rule can therefore lead to different fixed-point limits from different initial values.

A Fixed Point Does Not Ensure Convergence

A fixed-point equation describes where a single application of the rule leaves a value unchanged. It does not, by itself, tell us what repeated applications do to other values. The next example has a fixed point but also has an iteration that does not converge.

Worked Example: A Fixed Point Alongside a Nonconvergent Iteration

Let \(f(x)=1-x\) on \([0,1]\). Solving \(f(x)=x\) gives \(1-x=x\), hence the fixed point is \(p=1/2\). But if \(a_0=0\), the recursion gives

$$ a_0=0,\qquad a_1=1,\qquad a_2=0,\qquad a_3=1,\qquad\ldots $$

The even-indexed subsequence is constantly \(0\), while the odd-indexed subsequence is constantly \(1\). They converge to distinct limits, so the theorem Distinct Subsequence Limits Obstruct Convergence shows that the full sequence diverges. The fixed point \(1/2\) exists, but this iteration does not approach it.

This example also shows why the hypotheses in the selection theorem cannot be dropped casually: \(f(x)=1-x\) is decreasing, not nondecreasing, and the iteration is not monotone. A fixed point can be found by solving an equation, but predicting an iteration requires additional information about the rule and the starting value. In particular, do not infer convergence merely from continuity or from the existence of a fixed point.

A useful order of analysis is to identify candidate fixed points, check whether the rule preserves an interval, and examine the direction of the first step. If the rule is nondecreasing and the iteration begins by moving upward or downward, the fixed-point selection theorem can locate its limit among all fixed points on the relevant side of the starting value. If the iteration is already known to converge and the rule is continuous at the limit, the continuous recursive limit theorem then supplies the fixed-point equation.

Check Your Understanding

Use the definitions and results in this tutorial to answer the following questions.

  1. Why does starting a recursion at a fixed point produce a constant sequence?
  2. Which endpoint inequalities allow the Intermediate Value Theorem to establish a fixed point on \([A,B]\)?
  3. In the increasing case of the fixed-point selection theorem, why can no fixed point \(p\geq a_0\) be smaller than the limit?
  4. For \(f(x)=x^2\) on \([0,1]\) with \(a_0=1/2\), which fixed point does the iteration select, and why?
  5. How does the recursion \(a_{n+1}=1-a_n\) with \(a_0=0\) show that a fixed point does not guarantee convergence?