Extreme value theorem

Extreme value theorem This article is about the calculus concept. For the statistical concept, see Fisher–Tippett–Gnedenko theorem. This article includes a list of general references, but it lacks sufficient corresponding inline citations. Please help to improve this article by introducing more precise citations. (June 2012) (Learn how and when to remove this template message) A continuous function {displaystyle f(x)} on the closed interval {displaystyle [a,b]} showing the absolute max (red) and the absolute min (blue).

In calculus, the extreme value theorem states that if a real-valued function {displaystyle f} is continuous on the closed interval {displaystyle [a,b]} , then {displaystyle f} must attain a maximum and a minimum, each at least once. That is, there exist numbers {displaystyle c} and {displaystyle d} in {displaystyle [a,b]} such that: {displaystyle f(c)geq f(x)geq f(d)quad forall xin [a,b]} The extreme value theorem is more specific than the related boundedness theorem, which states merely that a continuous function {displaystyle f} on the closed interval {displaystyle [a,b]} is bounded on that interval; that is, there exist real numbers {displaystyle m} and {displaystyle M} such that: {displaystyle mleq f(x)leq Mquad forall xin [a,b].} This does not say that {displaystyle M} and {displaystyle m} are necessarily the maximum and minimum values of {displaystyle f} on the interval {displaystyle [a,b],} which is what the extreme value theorem stipulates must also be the case.

The extreme value theorem is used to prove Rolle's theorem. In a formulation due to Karl Weierstrass, this theorem states that a continuous function from a non-empty compact space to a subset of the real numbers attains a maximum and a minimum.

Contents 1 History 2 Functions to which the theorem does not apply 3 Generalization to metric and topological spaces 4 Proving the theorems 4.1 Proof of the boundedness theorem 4.2 Alternative proof 4.3 Proof of the extreme value theorem 4.4 Alternative proof of the extreme value theorem 4.5 Proof using the hyperreals 4.6 Proof from first principles 5 Extension to semi-continuous functions 6 References 7 Further reading 8 External links History The extreme value theorem was originally proven by Bernard Bolzano in the 1830s in a work Function Theory but the work remained unpublished until 1930. Bolzano's proof consisted of showing that a continuous function on a closed interval was bounded, and then showing that the function attained a maximum and a minimum value. Both proofs involved what is known today as the Bolzano–Weierstrass theorem.[1] The result was also discovered later by Weierstrass in 1860.[citation needed] Functions to which the theorem does not apply The following examples show why the function domain must be closed and bounded in order for the theorem to apply. Each fails to attain a maximum on the given interval.

{displaystyle f(x)=x} defined over {displaystyle [0,infty )} is not bounded from above. {displaystyle f(x)={frac {x}{1+x}}} defined over {displaystyle [0,infty )} is bounded but does not attain its least upper bound {displaystyle 1} . {displaystyle f(x)={frac {1}{x}}} defined over {displaystyle (0,1]} is not bounded from above. {displaystyle f(x)=1-x} defined over {displaystyle (0,1]} is bounded but never attains its least upper bound {displaystyle 1} .

Defining {displaystyle f(0)=0} in the last two examples shows that both theorems require continuity on {displaystyle [a,b]} .

Generalization to metric and topological spaces When moving from the real line {displaystyle mathbb {R} } to metric spaces and general topological spaces, the appropriate generalization of a closed bounded interval is a compact set. A set {displaystyle K} is said to be compact if it has the following property: from every collection of open sets {displaystyle U_{alpha }} such that {textstyle bigcup U_{alpha }supset K} , a finite subcollection {displaystyle U_{alpha _{1}},ldots ,U_{alpha _{n}}} can be chosen such that {textstyle bigcup _{i=1}^{n}U_{alpha _{i}}supset K} . This is usually stated in short as "every open cover of {displaystyle K} has a finite subcover". The Heine–Borel theorem asserts that a subset of the real line is compact if and only if it is both closed and bounded. Correspondingly, a metric space has the Heine–Borel property if every closed and bounded set is also compact.

The concept of a continuous function can likewise be generalized. Given topological spaces {displaystyle V, W} , a function {displaystyle f:Vto W} is said to be continuous if for every open set {displaystyle Usubset W} , {displaystyle f^{-1}(U)subset V} is also open. Given these definitions, continuous functions can be shown to preserve compactness:[2] Theorem. If {displaystyle V, W} are topological spaces, {displaystyle f:Vto W} is a continuous function, and {displaystyle Ksubset V} is compact, then {displaystyle f(K)subset W} is also compact.

In particular, if {displaystyle W=mathbb {R} } , then this theorem implies that {displaystyle f(K)} is closed and bounded for any compact set {displaystyle K} , which in turn implies that {displaystyle f} attains its supremum and infimum on any (nonempty) compact set {displaystyle K} . Thus, we have the following generalization of the extreme value theorem:[2] Theorem. If {displaystyle K} is a compact set and {displaystyle f:Kto mathbb {R} } is a continuous function, then {displaystyle f} is bounded and there exist {displaystyle p,qin K} such that {textstyle f(p)=sup _{xin K}f(x)} and {textstyle f(q)=inf _{xin K}f(x)} .

Slightly more generally, this is also true for an upper semicontinuous function. (see compact space#Functions and compact spaces).

Proving the theorems We look at the proof for the upper bound and the maximum of {displaystyle f} . By applying these results to the function {displaystyle -f} , the existence of the lower bound and the result for the minimum of {displaystyle f} follows. Also note that everything in the proof is done within the context of the real numbers.

We first prove the boundedness theorem, which is a step in the proof of the extreme value theorem. The basic steps involved in the proof of the extreme value theorem are: Prove the boundedness theorem. Find a sequence so that its image converges to the supremum of {displaystyle f} . Show that there exists a subsequence that converges to a point in the domain. Use continuity to show that the image of the subsequence converges to the supremum. Proof of the boundedness theorem Statement   If {displaystyle f(x)} is continuous on {displaystyle [a,b]} then it is bounded on {displaystyle [a,b]} Suppose the function {displaystyle f} is not bounded above on the interval {displaystyle [a,b]} . Then, for every natural number {displaystyle n} , there exists an {displaystyle x_{n}in [a,b]} such that {displaystyle f(x_{n})>n} . This defines a sequence {displaystyle (x_{n})_{nin mathbb {N} }} . Because {displaystyle [a,b]} is bounded, the Bolzano–Weierstrass theorem implies that there exists a convergent subsequence {displaystyle (x_{n_{k}})_{kin mathbb {N} }} of {displaystyle ({x_{n}})} . Denote its limit by {displaystyle x} . As {displaystyle [a,b]} is closed, it contains {displaystyle x} . Because {displaystyle f} is continuous at {displaystyle x} , we know that {displaystyle f(x_{{n}_{k}})} converges to the real number {displaystyle f(x)} (as {displaystyle f} is sequentially continuous at {displaystyle x} ). But {displaystyle f(x_{{n}_{k}})>n_{k}geq k} for every {displaystyle k} , which implies that {displaystyle f(x_{{n}_{k}})} diverges to {displaystyle +infty } , a contradiction. Therefore, {displaystyle f} is bounded above on {displaystyle [a,b]} .  {displaystyle Box } Alternative proof Statement   If {displaystyle f(x)} is continuous on {displaystyle [a,b]} then it is bounded on {displaystyle [a,b]} Proof    Consider the set {displaystyle B} of points {displaystyle p} in {displaystyle [a,b]} such that {displaystyle f(x)} is bounded on {displaystyle [a,p]} . We note that {displaystyle a} is one such point, for {displaystyle f(x)} is bounded on {displaystyle [a,a]} by the value {displaystyle f(a)} . If {displaystyle e>a} is another point, then all points between {displaystyle a} and {displaystyle e} also belong to {displaystyle B} . In other words {displaystyle B} is an interval closed at its left end by {displaystyle a} .

Now {displaystyle f} is continuous on the right at {displaystyle a} , hence there exists {displaystyle delta >0} such that {displaystyle |f(x)-f(a)|<1} for all {displaystyle x} in {displaystyle [a,a+delta ]} . Thus {displaystyle f} is bounded by {displaystyle f(a)-1} and {displaystyle f(a)+1} on the interval {displaystyle [a,a+delta ]} so that all these points belong to {displaystyle B} . So far, we know that {displaystyle B} is an interval of non-zero length, closed at its left end by {displaystyle a} . Next, {displaystyle B} is bounded above by {displaystyle b} . Hence the set {displaystyle B} has a supremum in {displaystyle [a,b]}  ; let us call it {displaystyle s} . From the non-zero length of {displaystyle B} we can deduce that {displaystyle s>a} .

Suppose {displaystyle s0} such that {displaystyle |f(x)-f(s)|<1} for all {displaystyle x} in {displaystyle [s-delta ,s+delta ]} so that {displaystyle f} is bounded on this interval. But it follows from the supremacy of {displaystyle s} that there exists a point belonging to {displaystyle B} , {displaystyle e} say, which is greater than {displaystyle s-delta /2} . Thus {displaystyle f} is bounded on {displaystyle [a,e]} which overlaps {displaystyle [s-delta ,s+delta ]} so that {displaystyle f} is bounded on {displaystyle [a,s+delta ]} . This however contradicts the supremacy of {displaystyle s} . We must therefore have {displaystyle s=b} . Now {displaystyle f} is continuous on the left at {displaystyle s} , hence there exists {displaystyle delta >0} such that {displaystyle |f(x)-f(s)|<1} for all {displaystyle x} in {displaystyle [s-delta ,s]} so that {displaystyle f} is bounded on this interval. But it follows from the supremacy of {displaystyle s} that there exists a point belonging to {displaystyle B} , {displaystyle e} say, which is greater than {displaystyle s-delta /2} . Thus {displaystyle f} is bounded on {displaystyle [a,e]} which overlaps {displaystyle [s-delta ,s]} so that {displaystyle f} is bounded on {displaystyle [a,s]} .  ∎ Proof of the extreme value theorem By the boundedness theorem, f is bounded from above, hence, by the Dedekind-completeness of the real numbers, the least upper bound (supremum) M of f exists. It is necessary to find a point d in [a, b] such that M = f(d). Let n be a natural number. As M is the least upper bound, M – 1/n is not an upper bound for f. Therefore, there exists dn in [a, b] so that M – 1/n < f(dn). This defines a sequence {dn}. Since M is an upper bound for f, we have M – 1/n < f(dn) ≤ M for all n. Therefore, the sequence {f(dn)} converges to M. The Bolzano–Weierstrass theorem tells us that there exists a subsequence { {displaystyle d_{n_{k}}} }, which converges to some d and, as [a, b] is closed, d is in [a, b]. Since f is continuous at d, the sequence {f( {displaystyle d_{n_{k}}} )} converges to f(d). But {f(dnk)} is a subsequence of {f(dn)} that converges to M, so M = f(d). Therefore, f attains its supremum M at d. ∎ Alternative proof of the extreme value theorem The set {y ∈ R : y = f(x) for some x ∈ [a,b]} is a bounded set. Hence, its least upper bound exists by least upper bound property of the real numbers. Let M = sup(f(x)) on [a, b]. If there is no point x on [a, b] so that f(x) = M ,then f(x) < M on [a, b]. Therefore, 1/(M − f(x)) is continuous on [a, b]. However, to every positive number ε, there is always some x in [a, b] such that M − f(x) < ε because M is the least upper bound. Hence, 1/(M − f(x)) > 1/ε, which means that 1/(M − f(x)) is not bounded. Since every continuous function on a [a, b] is bounded, this contradicts the conclusion that 1/(M − f(x)) was continuous on [a, b]. Therefore, there must be a point x in [a, b] such that f(x) = M. ∎ Proof using the hyperreals In the setting of non-standard calculus, let N  be an infinite hyperinteger. The interval [0, 1] has a natural hyperreal extension. Consider its partition into N subintervals of equal infinitesimal length 1/N, with partition points xi = i /N as i "runs" from 0 to N. The function ƒ  is also naturally extended to a function ƒ* defined on the hyperreals between 0 and 1. Note that in the standard setting (when N  is finite), a point with the maximal value of ƒ can always be chosen among the N+1 points xi, by induction. Hence, by the transfer principle, there is a hyperinteger i0 such that 0 ≤ i0 ≤ N and {displaystyle f^{*}(x_{i_{0}})geq f^{*}(x_{i})}   for all i = 0, ..., N. Consider the real point {displaystyle c=mathbf {st} (x_{i_{0}})} where st is the standard part function. An arbitrary real point x lies in a suitable sub-interval of the partition, namely {displaystyle xin [x_{i},x_{i+1}]} , so that  st(xi) = x. Applying st to the inequality {displaystyle f^{*}(x_{i_{0}})geq f^{*}(x_{i})} , we obtain {displaystyle mathbf {st} (f^{*}(x_{i_{0}}))geq mathbf {st} (f^{*}(x_{i}))} . By continuity of ƒ  we have {displaystyle mathbf {st} (f^{*}(x_{i_{0}}))=f(mathbf {st} (x_{i_{0}}))=f(c)} .

Hence ƒ(c) ≥ ƒ(x), for all real x, proving c to be a maximum of ƒ.[3] Proof from first principles Statement      If {displaystyle f(x)} is continuous on {displaystyle [a,b]} then it attains its supremum on {displaystyle [a,b]} Proof      By the Boundedness Theorem, {displaystyle f(x)} is bounded above on {displaystyle [a,b]} and by the completeness property of the real numbers has a supremum in {displaystyle [a,b]} . Let us call it {displaystyle M} , or {displaystyle M[a,b]} . It is clear that the restriction of {displaystyle f} to the subinterval {displaystyle [a,x]} where {displaystyle xleq b} has a supremum {displaystyle M[a,x]} which is less than or equal to {displaystyle M} , and that {displaystyle M[a,x]} increases from {displaystyle f(a)} to {displaystyle M} as {displaystyle x} increases from {displaystyle a} to {displaystyle b} .

If {displaystyle f(a)=M} then we are done. Suppose therefore that {displaystyle f(a)a} is another point in {displaystyle L} then all points between {displaystyle a} and {displaystyle e} also belong to {displaystyle L} because {displaystyle M[a,x]} is monotonic increasing. Hence {displaystyle L} is a non-empty interval, closed at its left end by {displaystyle a} .

Now {displaystyle f} is continuous on the right at {displaystyle a} , hence there exists {displaystyle delta >0} such that {displaystyle |f(x)-f(a)|a} . We will show that {displaystyle s} is the point we are seeking i.e. the point where {displaystyle f} attains its supremum, or in other words {displaystyle f(s)=M} .

Suppose the contrary viz. {displaystyle f(s)0} such that {displaystyle |f(x)-f(s)|0} such that {displaystyle |f(x)-f(s)|

Si quieres conocer otros artículos parecidos a Extreme value theorem puedes visitar la categoría Theorems in calculus.