Ordinary Differential Equations/Preliminaries from calculus

In this section, we shall do some preparations that will come in handy later, when we need them in order to prove existence/uniqueness theorems. This is since those do rely heavily on some techniques from calculus, which may not usually be taught within a calculus course. Hence this section.

We shall begin with very useful estimation inequalities, called Gronwall's inequalities or inequalities of Gronwall type. These allow us, if we are given one type of estimation (involving an integral with a product of functions), to conclude another type of estimation (involving the exponential function).

Gronwall's inequalities

Proof:

We define a new function by

$r(t):=M+\underset{t_0}{\overset{t}{\int }}f(s)h(s)ds$.

By the fundamental theorem of calculus, we immediately obtain

$r^{\prime }(t)=f(t)h(t)\le h(t)(M+\underset{t_0}{\overset{t}{\int }}f(s)h(s)ds)=h(t)r(t)$,

where the inequality follows from the assumption on $f$. From this follows that

$r^{\prime }(t)-h(t)r(t)\le 0$.

We may now multiply both sides of the equation by $e^{-\underset{t_0}{\overset{t}{\int }}h(s)ds}$ and use the equation

$(r(t)e^{-\underset{t_0}{\overset{t}{\int }}h(s)ds})=r^{\prime }(t)e^{-\underset{t_0}{\overset{t}{\int }}h(s)ds}+r(t)((-h(t))\cdot e^{-\underset{t_0}{\overset{t}{\int }}h(s)ds})=(r^{\prime }(t)-h(t)r(t))e^{-\underset{t_0}{\overset{t}{\int }}h(s)ds}$ (by the product and chain rules)

to justify

$(r(t)e^{-\underset{t_0}{\overset{t}{\int }}h(s)ds})\le 0$.

Hence, the function

$t\mapsto r(t)e^{-\underset{t_0}{\overset{t}{\int }}h(s)ds}$

is non-increasing. Furthermore, if we set $t=t_0$ in that function, we obtain

$r(t_0)e^0=M$.

Hence,

$r(t)e^{-\underset{t_0}{\overset{t}{\int }}h(s)ds}\le r(0)=M\iff r(t)\le M{e}^{\underset{t_0}{\overset{t}{\int }}h(s)ds}$.

From $f(t)\le r(t)$ (assumption) follows the claim.$◻$

This result was for functions extending from $t_0$ to the right. An analogous result holds for functions extending from $t_0$ to the left:

Note that this time we are not integrating from $t_0$ to $t$, but from $t$ to $t_0$. This is more natural either, since this means we are integrating in positive direction.

Proof 1:

We rewrite the proof of theorem 12.1 for our purposes.

This time, we set

$r(t)=M+\underset{t}{\overset{t_0}{\int }}f(s)h(s)ds$,

reversing the order of integration in contrast to the last proof.

Once again, we get $r^{\prime }(t)\ge -h(t)r(t)\iff r^{\prime }(t)+h(t)r(t)\ge 0$. This time we use

$(r(t)e^{-\underset{t}{\overset{t_0}{\int }}h(s)ds})=r^{\prime }(t)e^{-\underset{t}{\overset{t_0}{\int }}h(s)ds}+h(t)r(t)e^{-\underset{t}{\overset{t_0}{\int }}h(s)ds}$

and multiply $r^{\prime }(t)+h(t)r(t)\ge 0$ by $e^{-\underset{t}{\overset{t_0}{\int }}h(s)ds}$ to obtain

$(r(t)e^{-\underset{t}{\overset{t_0}{\int }}h(s)ds})\ge 0$,

which is why

$t\mapsto r(t)e^{-\underset{t}{\overset{t_0}{\int }}h(s)ds}$

is non-decreasing. Now inserting $t_0$ in the thus defined function gives

$r(t_0)e^0=M$,

and thus for $t\le t_0$

$r(t)e^{-\underset{t}{\overset{t_0}{\int }}h(s)ds}\le M\iff r(t)\le M{e}^{\underset{t}{\overset{t_0}{\int }}h(s)ds}$.$◻$

Proof 2:

We prove the theorem from theorem 12.1. Indeed, for $t\ge t_0$ we set $\tilde{f}(t):=f(-t)$ and $\tilde{h}(t):=h(-t)$. Then we have

$\tilde{f}(t)\le M+\underset{-t}{\overset{t_0}{\int }}f(s)h(s)ds=M+\underset{t_0}{\overset{t}{\int }}\tilde{f}(s)\tilde{h}(s)ds$

by the substitution $s\mapsto -s$. Hence, we obtain by theorem 12.1, that

$\tilde{f}(t)\le M{e}^{\underset{t_0}{\overset{t}{\int }}\tilde{h}(s)ds}$

for $t\ge t_0$. Therefore, if now $t\le t_0$,

$f(t)=\tilde{f}(-t)\le M{e}^{\underset{t_0}{\overset{-t}{\int }}\tilde{h}(s)ds}=M{e}^{\underset{-t}{\overset{t_0}{\int }}h(s)ds}$.$◻$

The Arzelà–Ascoli theorem

Proof:

Let $(x_n{)}_{n\in \mathbb{N}}$ be an enumeration of the set $[a,b]\cap \mathbb{Q}$. The set $\{f_n(x_1)|n\in \mathbb{N}\}$ is bounded, and hence has a convergent subsequence $(f_{k_{1,n}}(x_1){)}_{n\in \mathbb{N}}$ due to the Heine–Borel theorem. Now the sequence $(f_{k_{1,n}}(z_2){)}_{n\in \mathbb{N}}$ also has a convergent subsequence $(f_{k_{2,n}}(x_2){)}_{n\in \mathbb{N}}$, and successively we may define $f_{k_{m,n}}$ in that way.

Set $f_{l_m}:=f_{k_{m,m}}$ for all $m\in \mathbb{N}$. We claim that the sequence $(f_{l_m}{)}_{m\in \mathbb{N}}$ is uniformly convergent. Indeed, let $ϵ>0$ be arbitrary and let $\delta$ such that $|x-y|<\delta \Rightarrow \mathrm{\forall }n\in \mathbb{N}:|f_n(x)-f_n(y)|<ϵ/3$.

Let $N_1\in \mathbb{N}$ be sufficiently large that if we order $a,x_1,\dots ,x_{N_1},b$ ascendingly, the maximum difference between successive elements is less than $\delta$ (possible since $\mathbb{Q}$ is dense in $ℝ$).

Let $N_2\in \mathbb{N}$ be sufficiently large that for all $n\in \{1,\dots ,N_1\}$ and $k\ge 1$ $|f_{l_{N_2+k}}(x_n)-f_{l_{N_2}}(x_n)|<ϵ/3$.

Set $N:=\max \{N_1,N_2\}$, and let $k\ge N$. Let $y\in [a,b]$ be arbitrary. Choose $x_n$ such that $|x_n-y|<\delta$ (possible due to the choice of $N_1$). Due to the choice of $\delta$, the choice of $N_2$ and the triangle inequality we get

$|f_{l_{N+k}}(y)-f_{l_N}(y)|\le |f_{l_{N+k}}(y)-f_{l_{N+k}}(x_n)|+|f_{l_{N+k}}(x_n)-f_{l_N}(x_n)|+|f_{l_N}(x_n)-f_{l_N}(y)|<ϵ/3+ϵ/3+ϵ/3=ϵ$.

Hence, we have a Cauchy sequence, which converges due to the completeness of $𝒞([a,b])$.$◻$

Convergence considerations

In this section, we shall prove two or three more or less elementary results from analysis, which aren't particular exciting, but useful preparations for the work to come.

Proof: Let $ϵ>0$ be arbitrary. Since $g$ is a continuous function defined on a compact set, it is even uniformly continuous (this is due to the Heine–Cantor theorem). This means that we may pick $\delta >0$ such that $\Vert x-y\Vert <\delta \Rightarrow \Vert g(x)-g(y)\Vert <ϵ$ for all $x,y\in K$. Since $f_n\to f$ uniformly, we may pick $N\in \mathbb{N}$ such that for all $k\ge N$ and $t\in [a,b]$, $\Vert f_k(t)-f(t)\Vert <\delta$. Then we have for $k\ge N$ and $t\in [a,b]$ that

$\Vert g\circ f_k(t)-g\circ f(t)\Vert <ϵ$.$◻$

The next result is very similar; it is an extension of the former theorem making $g$ time-dependent.

Proof:

First, we note that the set $[a,b]\times K$ is compact. This can be seen either by noting that this set is still bounded and closed, or by noting that for a sequence in this space, we may first choose a convergent subsequence of the "induced" sequence of $K$ and then a convergent subsequence of what's left in $[a,b]$ (or the other way round).

Thus, the function $g$ is uniformly continuous as before. Hence, we may choose $\delta >0$ such that $|t-s|+\Vert x-y\Vert <\delta$ implies $\Vert g(t,x)-g(s,y)\Vert <ϵ$ (note that $|\cdot |+\Vert \cdot \Vert$ is a norm on $[a,b]\times K$ and since this space is still finite-dimensional, all norms there are equivalent; at least to the norm with respect to which continuity is measured).

Since $f_n\to f$ uniformly, we may pick $N\in \mathbb{N}$ such that for all $k\ge N$ and $t\in [a,b]$, $\Vert f_k(t)-f(t)\Vert <\delta$. Then for $k\ge N$ and all $t\in [a,b]$, we have

$\Vert g(t,f_n(t))-g(t,f(t))\Vert <ϵ$.$◻$

Banach's fixed-point theorem

We shall later give two proofs of the Picard-Lindelöf existence of solutions theorem; one can be given using the machinery above, whereas a different one rests upon the following result by Stefan Banach.

Proof:

First, we prove uniqueness of the fixed point. Assume $x,y$ are both fixed points. Then

$d(x,y)=d(f(x),f(y))\le \lambda d(x,y)\Rightarrow (1-\lambda )d(x,y)=0$.

Since $0\le \lambda <1$, this implies $d(x,y)=0\Rightarrow x=y$.

Now we prove existence and simultaneously the claim about the convergence of the sequence $y,f(y),f(f(y)),f(f(f(y))),\dots$. For notation, we thus set $z_0:=y$ and if $z_n$ is already defined, we set $z_{n+1}=f(z_n)$. Then the sequence $(z_n{)}_{n\in \mathbb{N}}$ is nothing else but the sequence $y,f(y),f(f(y)),f(f(f(y))),\dots$.

Let $n\ge 0$. We claim that

$d(z_{n+1},z_n)\le {\lambda }^{n}d(z_1,z_0)$.

Indeed, this follows by induction on $n$. The case $n=0$ is trivial, and if the claim is true for $n$, then $d(z_{n+2},z_{n+1})=d(f(z_{n+1}),f(z_n))\le \lambda d(z_{n+1},z_n)\le \lambda \cdot {\lambda }^{n}d(z_1,z_0)$.

Hence, by the triangle inequality,

$\begin{array}{cc}d(z_{n+m},z_n)& \le \sum _{j=n+1}^{n+m}d(z_j,z_{j-1})\\ & \le \sum _{j=n+1}^{n+m}{\lambda }^{j-1}d(z_1,z_0)\\ & \le \sum _{j=n+1}^{\mathrm{\infty }}{\lambda }^{j-1}d(z_1,z_0)\\ & =d(z_1,z_0){\lambda }^n\frac{1}{1-\lambda }\end{array}$.

The latter expression goes to zero as $n\to \mathrm{\infty }$ and hence we are dealing with a Cauchy sequence. As we are in a complete metric space, it converges to a limit $x$. This limit further is a fixed point, as the continuity of $f$ ($f$ is Lipschitz continuous with constant $\lambda$) implies

$x=\underset{n\to \mathrm{\infty }}{\lim }{z}_n=\underset{n\to \mathrm{\infty }}{\lim }f(z_{n-1})=f(\underset{n\to \mathrm{\infty }}{\lim }{z}_{n-1})=f(x)$.$◻$