Tutorials › Real Analysis › Applications to Differential Equations

Contraction Mappings · Tutorial 760 of 1000

Applications to Differential Equations

Learn how an initial-value problem becomes a contraction on a space of continuous functions, yielding a local solution and a convergent iteration.

Advanced 10 min read

What You'll Learn

  • Formulate an initial-value problem as a fixed-point equation for continuous functions.
  • Prove that the space of continuous functions on a closed interval is complete in the uniform metric.
  • Verify that the integral operator preserves a closed ball of functions.
  • Use a uniform Lipschitz condition in the dependent variable to prove contraction.
  • Apply the existence and uniqueness theorem to three initial-value problems.
  • Interpret Picard iteration as successive approximations to the solution.

From an Initial-Value Problem to a Fixed Point

The contraction method for equations also applies to differential equations, but the unknown is now an entire function rather than a number. Consider an initial-value problem

$$ y'(t)=f(t,y(t)),\qquad y(t_0)=y_0. $$

A continuously differentiable solution must satisfy the corresponding integral equation

$$ y(t)=y_0+\int_{t_0}^{t} f(s,y(s))\,ds. $$

Conversely, if a continuous function satisfies this integral equation and \(f\) is continuous along its graph, the Fundamental Theorem of Calculus implies that the function is continuously differentiable and solves the initial-value problem. We can therefore define an operator on functions by

$$ (Tu)(t)=y_0+\int_{t_0}^{t} f(s,u(s))\,ds. $$

A fixed point of \(T\) is exactly a solution of the integral equation. The aim is to choose an interval and a set of functions so that \(T\) maps that set into itself and is a contraction. The Contraction Mapping Theorem then gives a unique fixed point and convergence of successive applications of \(T\).

The Uniform Metric on Continuous Functions

Let \(J=[t_0-h,t_0+h]\), where \(h>0\). Write \(C(J)\) for the set of continuous real-valued functions on \(J\), and equip it with the uniform metric

$$ d_\infty(u,v)=\sup_{t\in J}|u(t)-v(t)|. $$

The supremum is finite because a continuous function on a closed bounded interval is bounded. The key fact is that this metric space is complete. We give the proof because completeness is what permits the contraction theorem to produce a solution.

Theorem (Completeness of \(C(J)\)): If \(J\) is a closed bounded interval, then \(C(J)\), equipped with the uniform metric \(d_\infty\), is complete.

Proof. Let \((u_n)\) be a Cauchy sequence in \(C(J)\). For each fixed \(t\in J\),

$$ |u_n(t)-u_m(t)|\leq d_\infty(u_n,u_m). $$

The Cauchy property in the uniform metric therefore makes \((u_n(t))\) a Cauchy sequence of real numbers. Since \(\mathbb{R}\) is complete, it has a limit; define \(u(t)=\lim_{n\to\infty}u_n(t)\).

We next show that \(u_n\) converges uniformly to \(u\). Given \(\varepsilon>0\), choose \(N\) such that \(d_\infty(u_n,u_m)<\varepsilon\) whenever \(n,m\geq N\). Fix \(n\geq N\) and \(t\in J\). Letting \(m\) tend to infinity in \(|u_n(t)-u_m(t)|<\varepsilon\) gives \(|u_n(t)-u(t)|\leq\varepsilon\). Since this holds for every \(t\in J\), \(d_\infty(u_n,u)\leq\varepsilon\) for every \(n\geq N\). Applying the argument with any smaller positive tolerance shows \(d_\infty(u_n,u)\to0\).

It remains to check that \(u\) is continuous. Fix \(t\in J\) and \(\varepsilon>0\). Choose \(n\) such that \(d_\infty(u_n,u)<\varepsilon/3\). By continuity of \(u_n\) at \(t\), there is a \(\delta>0\) such that \(|u_n(s)-u_n(t)|<\varepsilon/3\) whenever \(s\in J\) and \(|s-t|<\delta\). For such \(s\),

$$ |u(s)-u(t)| \leq |u(s)-u_n(s)|+|u_n(s)-u_n(t)|+|u_n(t)-u(t)| <\varepsilon. $$

Thus \(u\) is continuous, so \(u\in C(J)\), and the Cauchy sequence converges to \(u\) in \(C(J)\). This proves completeness. \(\square\)

A closed ball in \(C(J)\) is also complete: a convergent sequence in the ball has its limit in the ball, since uniform convergence preserves the defining bound. We will use the ball centered at the constant function \(y_0\),

$$ \mathcal{B}=\{u\in C(J):\sup_{t\in J}|u(t)-y_0|\leq b\}, $$

where \(b>0\). Its functions stay within distance \(b\) of the initial value, so a bound on \(f\) over that range can control the integral operator.

A Local Existence and Uniqueness Theorem

Assume \(f\) is continuous on the rectangle

$$ R=[t_0-a,t_0+a]\times[y_0-b,y_0+b], $$

where \(a,b>0\). Suppose there are finite constants \(M\geq0\) and \(L\geq0\) such that throughout this rectangle,

$$ |f(t,y)|\leq M,\qquad |f(t,y)-f(t,z)|\leq L|y-z| $$

whenever \(y,z\in[y_0-b,y_0+b]\) and \(t\in[t_0-a,t_0+a]\). The second condition is a uniform Lipschitz condition in the dependent variable. Choose \(h>0\) so that

$$ h\leq a,\qquad Mh\leq b,\qquad Lh<1. $$

Such an \(h\) can be chosen because \(a,b>0\) and \(M,L\) are finite; if either \(M\) or \(L\) is zero, its corresponding restriction imposes no obstacle. On \(J=[t_0-h,t_0+h]\), define \(T\) by the integral formula above.

Theorem (Local Existence and Uniqueness for an Initial-Value Problem): Under these assumptions, there is a unique continuously differentiable function \(y:J\to[y_0-b,y_0+b]\) satisfying \(y'(t)=f(t,y(t))\) and \(y(t_0)=y_0\). Starting with any \(u_0\in\mathcal{B}\) and defining \(u_{n+1}=Tu_n\), the sequence converges uniformly on \(J\) to \(y\).

Proof. First, \(T\) is well defined on \(\mathcal{B}\). For \(u\in\mathcal{B}\), the point \((s,u(s))\) lies in \(R\) for each \(s\in J\), and continuity of \(f\) makes \(s\mapsto f(s,u(s))\) continuous. Consequently \(Tu\) is continuous. For every \(t\in J\), using the bound on \(f\),

$$ |(Tu)(t)-y_0| =\left|\int_{t_0}^{t} f(s,u(s))\,ds\right| \leq M|t-t_0| \leq Mh \leq b. $$

The estimate holds whether \(t\) is to the left or the right of \(t_0\), since the absolute value of an oriented integral is bounded by the integral of the absolute value. Thus \(Tu\in\mathcal{B}\).

Next take \(u,v\in\mathcal{B}\). The Lipschitz condition gives, for every \(t\in J\),

$$ |(Tu)(t)-(Tv)(t)| \leq \int_{\min(t,t_0)}^{\max(t,t_0)} L|u(s)-v(s)|\,ds \leq Lh\,d_\infty(u,v). $$

Taking the supremum over \(t\) yields \(d_\infty(Tu,Tv)\leq Lh\,d_\infty(u,v)\). Since \(Lh<1\), \(T\) is a contraction on \(\mathcal{B}\). The completeness theorem for \(C(J)\) and closedness of \(\mathcal{B}\) show that \(\mathcal{B}\) is a nonempty complete metric space; it is nonempty because it contains the constant function \(y_0\). The Contraction Mapping Theorem now gives a unique fixed point \(y\in\mathcal{B}\), and iteration from any \(u_0\in\mathcal{B}\) converges uniformly to \(y\).

The fixed-point identity says \(y(t)=y_0+\int_{t_0}^t f(s,y(s))\,ds\). The integrand is continuous, so the Fundamental Theorem of Calculus gives \(y'(t)=f(t,y(t))\), and setting \(t=t_0\) gives \(y(t_0)=y_0\).

Finally, any other continuously differentiable solution on \(J\) whose values lie in \([y_0-b,y_0+b]\) satisfies the same integral equation, by the Fundamental Theorem of Calculus, and belongs to \(\mathcal{B}\). It is therefore another fixed point of \(T\), so it must equal \(y\). This proves the stated uniqueness. \(\square\)

The theorem is local: the interval length is selected using bounds in a rectangle around the initial data. It does not claim that a solution exists for all time. The successive functions \(u_{n+1}=Tu_n\) are called Picard iterates, or successive approximations. Their uniform convergence follows from the contraction theorem, not merely from a formal repeated substitution into the differential equation.

Worked Examples: Applying the Theorem

Worked Example: The Equation \(y'=t+y\), \(y(0)=1\)

Take \(t_0=0\), \(y_0=1\), \(a=1/2\), and \(b=1\). On the rectangle \([-1/2,1/2]\times[0,2]\), the function \(f(t,y)=t+y\) satisfies

$$ |f(t,y)|=|t+y|\leq |t|+|y|\leq\frac12+2=\frac52. $$

Also, \(|f(t,y)-f(t,z)|=|y-z|\), so \(L=1\) is valid. Choose \(h=1/4\). Then \(h\leq a\), \(Mh=(5/2)(1/4)=5/8\leq1=b\), and \(Lh=1/4<1\). The theorem gives a unique solution on \([-1/4,1/4]\) taking values in \([0,2]\).

For the constant starting function \(u_0(t)=1\), the first Picard iterate is

$$ u_1(t)=1+\int_0^t(s+1)\,ds =1+t+\frac{t^2}{2}. $$

For example, \(u_1(1/4)=1+1/4+1/32=41/32\), while \(u_1(-1/4)=1-1/4+1/32=25/32\). These are values of the first approximation; the theorem guarantees that repeated iteration converges uniformly to the solution.

Worked Example: The Equation \(y'=y^2\), \(y(0)=1\)

Consider the rectangle \([-1/2,1/2]\times[1/2,3/2]\). There, \(|f(t,y)|=y^2\leq9/4\). For \(y,z\) in the indicated range,

$$ |y^2-z^2|=|y-z||y+z|\leq3|y-z|. $$

Thus \(M=9/4\) and \(L=3\) work. With \(h=1/8\), we have \(h\leq1/2\), \(Mh=9/32\leq b=1/2\), and \(Lh=3/8<1\). There is a unique solution on \([-1/8,1/8]\) whose values remain in \([1/2,3/2]\).

Starting with \(u_0(t)=1\), one iteration gives

$$ u_1(t)=1+\int_0^t 1^2\,ds=1+t. $$

On this interval, \(7/8\leq u_1(t)\leq9/8\), so these first-iterate values lie within the chosen dependent-variable range. The theorem applies to the whole sequence of iterates, ensuring that they converge uniformly to the unique local solution.

Worked Example: The Equation \(y'=-2y+\sin t\), \(y(0)=0\)

Use the rectangle \([-1/4,1/4]\times[-1,1]\), so \(a=1/4\) and \(b=1\). Since \(|\sin t|\leq |t|\),

$$ |-2y+\sin t|\leq2|y|+|\sin t|\leq2+\frac14=\frac94. $$

Moreover, \(|(-2y+\sin t)-(-2z+\sin t)|=2|y-z|\), so \(L=2\). Take \(h=1/4\). Then \(Mh=9/16\leq1\) and \(Lh=1/2<1\); the time restriction is satisfied with equality. The theorem gives a unique solution on the full interval \([-1/4,1/4]\), taking values in \([-1,1]\).

With \(u_0(t)=0\), the first iterate is

$$ u_1(t)=\int_0^t \sin s\,ds=1-\cos t. $$

The integral identity holds for negative \(t\) as well, since an antiderivative of \(\sin s\) is \(-\cos s\). This example shows that the theorem does not require the initial approximation itself to solve the differential equation; it only needs to belong to the complete ball on which the operator is a contraction.

What the Bounds Do—and Do Not—Establish

The two estimates have different roles. The bound \(M\) controls how far a function can move from its initial value during one application of the integral operator. It ensures that the operator preserves the chosen ball. The Lipschitz constant \(L\) controls how much the operator changes when its input function changes. The strict inequality \(Lh<1\) ensures contraction. A bound on \(f\) alone does not establish uniqueness, and a Lipschitz estimate alone does not show that the operator maps the chosen ball into itself.

The interval must also be chosen consistently with both estimates. A smaller interval can make \(Lh<1\) hold and can keep the integral displacement within the allowed range \(b\). However, this argument only establishes the solution on the interval for which all the hypotheses have been verified. It should not be read as a global existence claim.

Once the hypotheses hold, the contraction theorem supplies more than existence: the solution is the unique fixed point in the ball, and Picard iteration from any function in that ball converges uniformly to it. This is the function-space version of using a contraction to solve an equation. Here the unknown is a trajectory, and the integral operator encodes both the differential equation and the initial value.

Check Your Understanding

Use the fixed-point formulation and local theorem to answer the following questions.

  1. Why does a fixed point of the integral operator give a continuously differentiable solution of the initial-value problem?
  2. In the local theorem, which bound ensures that the integral operator maps the function ball into itself?
  3. Which hypothesis makes the integral operator a contraction, and why must its resulting constant be strictly less than one?
  4. Why is the closed ball of continuous functions complete in the uniform metric?
  5. In the example \(y'=y^2\), \(y(0)=1\), what are the values of \(M\), \(L\), and \(Lh\) for the stated choice \(h=1/8\)?