4. Mean values and applications of derivatives

A derivative gives local slope, but a theorem is needed to convert local information into a conclusion over an interval.

Real closed sets: the sequence criterion and the open complement

Work on the real line in the usual classical set-theoretic setting, with countable witness selections available. A set $U$ is open when every $y$ in $U$ has some $r>0$ with $(y-r,y+r)$ contained in $U$. We use the Archimedean consequence that $1/n$ tends to zero. For every $K$ subset of the real line, the following conditions are equivalent:

1. Every sequence of points of $K$ that converges in the real line has its limit in $K$.
2. The complement of $K$ is open.

Proof of 2 implies 1. Suppose $x_n$ belongs to $K$ and $x_n$ tends to $x$. If $x$ were outside $K$, openness would give $r>0$ with $(x-r,x+r)$ disjoint from $K$. Convergence gives a threshold after which $|x_n-x|<r$, contradicting $x_n$ in $K$. Therefore $x$ belongs to $K$.

Proof of 1 implies 2. Fix $y$ outside $K$. If no positive-radius interval around $y$ avoided $K$, then for every positive integer $n$ there would be a point $x_n$ in $K$ with $|x_n-y|<1/n$. Choose these witnesses as a sequence. Given $\varepsilon>0$, choose $N$ with $1/N<\varepsilon$. For $n\ge N$, $|x_n-y|<1/n\le1/N<\varepsilon$, so $x_n$ tends to $y$. Condition 1 would force $y$ into $K$, a contradiction. Hence some interval around $y$ avoids $K$. This holds for every point of the complement, proving it open. The witness-sequence step uses the stated classical setting; this proof is not offered as a theorem about choice-free foundations. If $K$ is empty there is no sequence in $K$, and its complement is the whole open line. If $K$ is the whole line, its empty complement is open vacuously. Both edge cases also satisfy the equivalence.

Learning goals and definitions

A set $K\subseteq\mathbb R$ is compact if every family of open sets whose union contains $K$ has a finite subfamily still covering $K$. A set is closed if it contains all limits of convergent sequences of its points, equivalently if its complement is open. Sequential compactness means every sequence in $K$ has a subsequence converging to a member of $K$.

The empty set is compact, closed and bounded, and sequentially compact vacuously. In proofs using a selected point or an infinite sequence, treat that case separately. We may assume the real completeness property and its nested-interval and Bolzano–Weierstrass consequences from the earlier sequence units.

Theorem: Heine–Borel in the real line

For $K\subseteq\mathbb R$, the following are equivalent: compactness by open covers; closedness and boundedness; sequential compactness.

Compact implies closed and bounded. The intervals $(-n,n)$, $n\ge1$, cover $\mathbb R$, hence $K$. A finite subcover gives a bound. To show closedness, take $y\notin K$. For each $x\in K$, the interval $B(x,|x-y|/2)$ avoids $y$. A finite subfamily covers $K$. Let $\delta$ be the minimum of their positive half-distances to $y$. Every point in the chosen interval centered at $x$ has distance from $y$ strictly greater than $|x-y|/2\ge\delta$. Thus $B(y,\delta)$ misses $K$, showing its complement open. If $K$ is empty this is immediate.

Closed and bounded implies compact. Enclose nonempty $K$ in a closed bounded interval $I_0$. Suppose an open cover of $K$ has no finite subcover. Bisect $I_0$. At least one closed half meets $K$ in a set not finitely coverable; otherwise two finite collections would cover $K$. Choose such a half and repeat. We obtain nested closed intervals $I_n$ with lengths tending to zero, and $K\cap I_n$ not finitely coverable. Each intersection is nonempty; choose $x_n\in K\cap I_n$. The nested-interval property gives a unique common point $p$, and $x_n\to p$ because both lie in $I_n$. Closedness gives $p\in K$. Some member $O$ of the cover contains $p$, and openness gives a ball around $p$ inside $O$. For large $n$, the whole interval $I_n$ lies in that ball, so $O$ alone covers $K\cap I_n$, a contradiction.

Closed and bounded implies sequentially compact. Every sequence in $K$ is bounded, so Bolzano–Weierstrass supplies a convergent subsequence. Closedness retains its limit in $K$.

Sequentially compact implies closed and bounded. If unbounded, choose $x_n\in K$ with $|x_n|>n$; no subsequence can converge to a finite real number, a contradiction. If $p$ is a limit of points in $K$, choose $x_n\in K$ with $|x_n-p|<1/n$. A subsequence converges to a point of $K$ by sequential compactness, but it also converges to $p$; uniqueness of real limits gives $p\in K$. Thus $K$ is closed. This completes all implications.

Fix an integer $n\ge1$ and the Euclidean norm on $\mathbb R^n$. A set is bounded if it lies in some finite-radius ball, closed if its complement is open, and compact if every cover by open subsets of $\mathbb R^n$ has a finite subcover. We use real completeness, including the nested closed interval property.

Heine–Borel in finite-dimensional Euclidean space

Theorem. A set $K\subseteq\mathbb R^n$ is compact if and only if it is closed and bounded. The empty set satisfies all three properties.

Compact implies bounded. The open balls $B(0,m)$, $m\ge1$ an integer, cover $K$. A finite subcover puts $K$ inside the largest of these balls.

Compact implies closed. Suppose $K\ne\varnothing$ and $y\notin K$. The balls $B(x,\|x-y\|/2)$, $x\in K$, cover $K$. Choose a finite subcover with centers $x_1,\ldots,x_r$ and set $\delta=\min_i\|x_i-y\|/2>0$. If $z$ lies in the ball centered at $x_i$, the triangle inequality gives $\|z-y\|>\|x_i-y\|/2\ge\delta$. Hence $B(y,\delta)$ misses $K$, so the complement is open.

Closed and bounded implies compact. Let nonempty $K$ be closed and bounded. Enclose it in a closed cube $Q_0=[-M,M]^n$ with $M>0$. Suppose an open cover of $K$ has no finite subcover. Divide each coordinate interval into two closed halves. The resulting $2^n$ closed subcubes cover $Q_0$. At least one subcube has intersection with $K$ that is not finitely coverable by the given family; otherwise the finite union of the finite subcovers would cover $K$. Select such a subcube and repeat. This produces nested closed cubes $Q_j$ with side length $2M/2^j$ and $K\cap Q_j$ not finitely coverable, hence nonempty.

For each coordinate, the nested interval property gives a common coordinate value. Together these give $p\in\bigcap_jQ_j$. Every pair of points in $Q_j$ has distance at most $2M\sqrt n/2^j$, so the intersection contains only $p$. Choose $x_j\in K\cap Q_j$. Then $\|x_j-p\|\le2M\sqrt n/2^j\to0$. A closed set contains such a limit: if $p$ were in its open complement, a ball around $p$ would eventually contain $x_j$ outside $K$, a contradiction. Thus $p\in K$.

One member $O$ of the cover contains $p$, and openness gives $B(p,\varepsilon)\subseteq O$ for some $\varepsilon>0$. For sufficiently large $j$, every point of $Q_j$ is within $\varepsilon$ of $p$, so $O$ alone covers $K\cap Q_j$. This contradicts the selection of $Q_j$. Therefore every open cover has a finite subcover. The number $2^n$ is finite; replacing it by infinitely many subpieces would invalidate this argument.

Continuous images and extreme values

Theorem. If $K\subseteq\mathbb R^n$ is compact and $F:K\to\mathbb R^m$ is continuous relative to $K$, then $F(K)$ is compact. In particular, a continuous $f:K\to\mathbb R$ on nonempty compact $K$ is bounded and attains its maximum and minimum.

Proof. An open cover $(O_i)$ of $F(K)$ pulls back to relatively open sets $F^{-1}(O_i)=K\cap U_i$, with $U_i$ open in $\mathbb R^n$. These $U_i$ cover $K$, so finitely many suffice. Their corresponding $O_i$ cover $F(K)$, proving compactness. For scalar $f$, the image is nonempty, closed and bounded by the theorem already proved in dimension one. Let $a=\sup f(K)$. For each $j\ge1$, the definition of supremum supplies $y_j\in f(K)$ with $a-1/j<y_j\le a$. Then $y_j\to a$, and closedness places $a$ in the image. Thus the maximum is attained. Applying the same argument to $-f$ gives the minimum. This proves existence, not a formula for the maximizing input.

Worked example: the sphere needed for the real spectral theorem. The sphere $S^{n-1}=\{x\in\mathbb R^n:\|x\|=1\}$ is nonempty because it contains $e_1$, and it is bounded. The reverse triangle inequality $|\|x\|-\|y\||\le\|x-y\|$ proves norm continuity, so $S^{n-1}$ is closed as the inverse image of the closed set $\{1\}$. Heine–Borel makes it compact. For a real matrix $A$, the polynomial $x\mapsto x^TAx$ is continuous, so its restriction to the sphere attains both extrema. Symmetry of $A$ is not needed for this existence claim; it is needed in the subsequent spectral argument and the gradient formula $\nabla(x^TAx)=2Ax$.

Exercises

P01. Explain why the compactness assertion fails for the open unit ball even though that ball is bounded.

P02. Which step of the cube proof fails if $K$ is not closed? Give an example.

P03. For $A=\operatorname{diag}(2,5)$ on the unit circle, find the extreme values of $x^TAx$ and every point where equality holds. Distinguish the existence theorem from the calculation.

Full solutions

P01. The open unit ball is not closed: $(1-1/j)e_1$ lies in it for $j\ge2$ and converges to $e_1$ outside it. A compact set would be closed by the proved necessity, so the ball is not compact. Boundedness alone is insufficient.

P02. The limit of $x_j\in K$ may be outside $K$, at a point $p$, so no member of the cover need contain $p$. Explicitly take $K=(0,1)$, the cover $O_m=(1/m,2)$ for integers $m\ge2$, and the nested closed intervals $Q_j=[0,2^{-j}]$ for integers $j\ge0$. These open intervals cover $K$, but any finite collection has a positive smallest left endpoint and therefore fails to cover $K\cap Q_j$. The intervals $Q_j$ have common point zero, which is outside $K$; consequently no member of the cover contains $0$. This is exactly where the closed-set proof can fail.

P03. Writing $x=(u,v)^T$ with $u^2+v^2=1$ gives $x^TAx=2u^2+5v^2=2+3v^2$. The minimum is two, attained exactly at $(\pm1,0)^T$, and the maximum is five, attained exactly at $(0,\pm1)^T$. Compactness and continuity guarantee that extrema exist; the displayed identity determines their values and all equality cases.

Fermat's necessary condition. At a differentiable interior local maximum or minimum, $f'(a)=0$.

Proof. At a local maximum, sufficiently small positive increments give nonpositive difference quotients and negative increments give nonnegative ones. A two-sided derivative can satisfy both sign limits only by being zero. Negating the function treats a minimum. $\square$

The interior hypothesis matters: $f(x)=x$ on $[0,1]$ has extrema at endpoints despite derivative 1. The converse fails: $x^3$ has zero derivative at zero but no extremum there.

Rolle's theorem. If $a<b$, $f$ is continuous on $[a,b]$, differentiable on $(a,b)$ and $f(a)=f(b)$, then $f'(c)=0$ for some $c\in(a,b)$.

Proof. The extreme-value theorem supplies maximum and minimum. If the function is constant, every interior point works. Otherwise a value differs from the equal endpoint values, so either a maximum or a minimum occurs in the interior. Fermat's condition applies there. $\square$

Mean value theorem. Under the same continuity and differentiability hypotheses but without equal endpoint values, some $c\in(a,b)$ satisfies $f(b)-f(a)=f'(c)(b-a)$.

Subtract the secant line $f(a)+[f(b)-f(a)](x-a)/(b-a)$ from $f$ and apply Rolle. This proves the theorem without assuming $f'$ is continuous. Consequences include: derivative zero on an interval makes the function constant; nonnegative derivative makes it nondecreasing; and $|f'|\le M$ on an interval gives $|f(y)-f(x)|\le M|y-x|$ for points in it. An interval-wide derivative bound cannot be inferred from one derivative value.

Thus if $f'>0$ on an interval, $f$ is strictly increasing there; if $f'=0$ everywhere on an interval, $f$ is constant there.

A critical point in the interior of the domain is a point where $f'=0$ or $f'$ does not exist. A differentiable interior local extremum must have derivative zero, but the converse fails: $x^3$ has zero derivative at zero and no local extremum there. A derivative changing from positive to negative gives a local maximum; a change from negative to positive gives a local minimum. If $f'(c)=0$ and $f''(c)>0$, there is a local minimum; if $f''(c)<0$, a local maximum. If $f''(c)=0$, this test is inconclusive. Positive second derivative on an interval implies convexity there; a sign change of the second derivative indicates an inflection point when the curve is continuous there.

Worked example

Global optimisation on a closed interval

Find the maximum and minimum of $f(x)=x^3-3x$ on $[-2,2]$. Continuity guarantees both exist. The interior critical points solve $3x^2-3=0$, giving $x=\pm1$. Compare $f(-2)=-2$, $f(-1)=2$, $f(1)=-2$, and $f(2)=2$. Thus the minimum is $-2$ and the maximum is $2$, each attained at two points. Checking only critical points would omit necessary endpoint candidates.

Worked example

Related rates

If the radius of a sphere grows at $dr/dt=2$ centimetres per second, then $V=4\pi r^3/3$ gives $dV/dt=4\pi r^2(dr/dt)$ by the chain rule. At $r=3$ centimetres, the volume increases at $72\pi$ cubic centimetres per second. Differentiate the relationship before substituting the instant's values.

For curve sketching, find the domain and intercepts, then one-sided behaviour at domain boundaries, asymptotes where their defining limits exist, critical points and derivative signs, and curvature. A vertical asymptote at $x=a$ requires at least one one-sided limit to be infinite. A horizontal asymptote $y=L$ requires $f(x)\to L$ as $x\to\infty$ or as $x\to-\infty$. These are independent of whether the graph crosses the line elsewhere.

Worked example

An inequality from a derivative bound

For $x>0$, let $h(x)=x-1-\ln x$. Then $h'(x)=1-1/x$: negative on $(0,1)$ and positive on $(1,\infty)$. The mean value theorem makes $h$ decrease toward $1$ and increase after $1$, so its global minimum is $h(1)=0$. Consequently $\ln x\le x-1$ for all $x>0$, with equality only at $x=1$.

A stationary point has $f'=0$, whereas a critical point may also be a point where the derivative fails to exist. For instance $|x|$ has a minimum at zero even though it is not stationary there. A sketch based solely on stationary points can miss corners and domain endpoints. On an open domain, a supremum need not be attained: $f(x)=x$ on $(0,1)$ has supremum $1$ but no maximum.

Choosing a method

For a global extremum on a closed interval compare endpoints and all interior critical candidates. On an unbounded or open domain an extremum need not exist, so analyse boundary limits and justify attainment. For inequalities, apply the mean value theorem to an appropriate auxiliary function or prove its derivative has a sign. Related rates require consistent units and a relation valid as quantities change.

Exercises

1. Show $\sin x<x$ for $0<x<\pi/2$.
2. A rectangle has perimeter $20$. Find the largest possible area, allowing nonnegative side lengths.
3. Find all stationary points of $f(x)=x^3-3x$ and classify them locally.

Full solutions

1. Let $g(x)=x-\sin x$. For $0<x<\pi/2$, $g'(x)=1-\cos x>0$. The mean value theorem implies $g(x)>g(0)=0$.
2. If sides are $x$ and $10-x$ with $x\in[0,10]$, area is $A(x)=x(10-x)$. It is continuous, and $A'(x)=10-2x$ vanishes only at $5$. Comparing $A(0)=A(10)=0$ and $A(5)=25$ gives maximum $25$, attained by a square.
3. $f'(x)=3x^2-3$ vanishes at $x=\pm1$. As $f''(x)=6x$, the second derivative test gives a local maximum at $-1$ with value $2$ and a local minimum at $1$ with value $-2$.

Connection

Mean-value reasoning also controls error in Taylor approximations. Optimisation uses the same derivative rules as related rates, but asks a different question: where is a value largest or smallest?

Proofs supporting the methods used in this note

Finite real limit laws and geometric sequences: the missing proofs

Work over the ordered real numbers, with the Archimedean property, positive-integer induction and the usual absolute-value triangle inequality. A sequence converges to a finite real $L$ when every $\varepsilon>0$ admits an $N$ that works for every $n\ge N$.

Uniqueness, boundedness and subsequences. If $a_n\to L,M$ and $L\ne M$, require both errors below $|L-M|/3$ at the same sufficiently large index. The triangle inequality gives $|L-M|<2|L-M|/3$, a contradiction. For boundedness, require $|a_n-L|<1$ in the tail, and take a maximum of $|L|+1$ and the finitely many initial absolute values. For a subsequence $n_1<n_2<\cdots$, induction gives $n_k\ge k$; hence every tail threshold for the original sequence also works eventually for the subsequence.

Sum, scalar and product. If $a_n\to a$, $b_n\to b$, choose both input errors below $\varepsilon/2$; then

$$|(a_n+b_n)-(a+b)|\le |a_n-a|+|b_n-b|<\varepsilon.$$

For a fixed scalar $c\ne0$ use input tolerance $\varepsilon/|c|$; $c=0$ is immediate. Choose $B\ge1$ bounding all $|b_n|$. Require

$$|a_n-a|<\frac{\varepsilon}{2B},\qquad |b_n-b|<\frac{\varepsilon}{2(|a|+1)}.$$

The common later threshold gives $|a_nb_n-ab|\le B|a_n-a|+|a||b_n-b|<\varepsilon$.

Reciprocal and quotient. If $b\ne0$, first require $|b_n-b|<|b|/2$, ensuring $|b_n|>|b|/2$ and nonzero denominators. Then

$$\left|\frac1{b_n}-\frac1b\right|\le\frac{2|b_n-b|}{|b|^2}.$$

Requiring also $|b_n-b|<\varepsilon|b|^2/2$ proves reciprocal convergence. The product law now proves $a_n/b_n\to a/b$. Any undefined initial quotients may be omitted; convergence is a tail assertion.

Order and squeeze. If $a_n\le b_n$ eventually and $a_n\to a$, $b_n\to b$, then $a\le b$: otherwise errors below $(a-b)/3$ would force $a_n>b_n$. If $a_n\le z_n\le b_n$ eventually and both outer limits are $L$, require both errors below $\varepsilon$. Then $L-\varepsilon<z_n<L+\varepsilon$, proving $z_n\to L$. This proof does not require a previously known limit of $z_n$.

For the corresponding function-limit laws, fix a common allowed approach domain $D\subseteq\mathbb R$ and an accumulation point $a$ of $D$: every punctured neighborhood of $a$ contains a point of $D$. Let $f,g:D\to\mathbb R$ have the stated finite relative-domain limits at $a$. Replace each tail threshold in the displayed estimates by a punctured-domain radius, and take the minimum of finitely many positive radii. For the product proof only local boundedness is needed: $g(x)\to b$ gives $|g(x)|\le|b|+1$ on a sufficiently small punctured $D$-neighborhood, even if $g$ is unbounded elsewhere on $D$. The same estimates prove sum, scalar, product, reciprocal and quotient laws with their stated nonzero limiting-denominator condition; the same order and squeeze estimates apply on the common approach domain. Accumulation supplies actual points when proving uniqueness or excluding an incompatible order of limiting values.

For composition let $B\subseteq\mathbb R$, let $b\in B$, and let $F:B\to\mathbb R$ be continuous at $b$ relative to $B$. Suppose $g:D\to\mathbb R$ tends to $b$ and $g(x)\in B$ throughout some sufficiently small punctured $D$-neighborhood of $a$. Given $\varepsilon>0$, continuity supplies $\eta>0$ such that $u\in B$ and $|u-b|<\eta$ imply $|F(u)-F(b)|<\varepsilon$. The limit of $g$ and the composition-domain condition supply a common positive radius forcing both conditions for every allowed approaching $x$. Thus $F(g(x))\to F(b)$. This includes inputs with $g(x)=b$ and does not divide by an inner increment.

Geometric classification. Bernoulli's bound $(1+t)^n\ge1+nt$ for $t\ge0$ follows by induction: multiply the case $n$ by the positive $1+t$ and retain the nonnegative remainder $nt^2$. If $0<q<1$, set $t=q^{-1}-1>0$. Thus

$$0<q^n\le\frac1{1+nt}\longrightarrow0.$$

For any requested tolerance, the Archimedean property supplies $N$ making the right side smaller. Hence $r^n\to0$ for $0<|r|<1$ by $|r^n|=|r|^n$; $r=0$ gives zero for every positive index. At $r=1$ the sequence is constantly one. At $r=-1$, the even and odd subsequences are one and minus one, so uniqueness and subsequence inheritance exclude convergence. If $r>1$, Bernoulli with $t=r-1$ gives $r^n\ge1+nt\to+\infty$. If $r<-1$, $|r^n|\to+\infty$ by the same argument, contradicting boundedness of any convergent real sequence. These cases exhaust all real ratios.

Subsequences

Definition

Subsequence

A subsequence of $(x_n)$ is $(x_{n_k})$ where $n_1<n_2<\cdots$ are positive integers. If $x_n\to L$, then every subsequence converges to $L$ because $n_k\ge k$ and therefore eventually lies beyond any prescribed index.

Theorem

Bolzano–Weierstrass

Every bounded real sequence has a convergent subsequence.

Proof

Nested-interval proof

Place every term in a closed bounded interval $I_1$. Bisect it. At least one half contains infinitely many terms; choose that half as $I_2$. Continue, obtaining nested closed intervals $I_k$ of lengths tending to zero, each containing infinitely many terms. Choose indices $n_k$ strictly increasing with $x_{n_k}\in I_k$; this is possible because each interval contains infinitely many terms. Completeness gives a common point $L$ in all intervals: the supremum of their left endpoints lies in each interval because every left endpoint is at most every right endpoint. Since $x_{n_k},L\in I_k$, their distance is at most the interval length and tends to zero.

The conclusion is about a subsequence, not necessarily the whole sequence. For example, $(-1)^n$ has constant subsequences converging to $1$ and $-1$, but does not converge.

Fix an integer $n\ge1$ and the Euclidean norm on $\mathbb R^n$. A set is bounded if it lies in some finite-radius ball, closed if its complement is open, and compact if every cover by open subsets of $\mathbb R^n$ has a finite subcover. We use real completeness, including the nested closed interval property.

Heine–Borel in finite-dimensional Euclidean space

Theorem. A set $K\subseteq\mathbb R^n$ is compact if and only if it is closed and bounded. The empty set satisfies all three properties.

Compact implies bounded. The open balls $B(0,m)$, $m\ge1$ an integer, cover $K$. A finite subcover puts $K$ inside the largest of these balls.

Compact implies closed. Suppose $K\ne\varnothing$ and $y\notin K$. The balls $B(x,\|x-y\|/2)$, $x\in K$, cover $K$. Choose a finite subcover with centers $x_1,\ldots,x_r$ and set $\delta=\min_i\|x_i-y\|/2>0$. If $z$ lies in the ball centered at $x_i$, the triangle inequality gives $\|z-y\|>\|x_i-y\|/2\ge\delta$. Hence $B(y,\delta)$ misses $K$, so the complement is open.

Closed and bounded implies compact. Let nonempty $K$ be closed and bounded. Enclose it in a closed cube $Q_0=[-M,M]^n$ with $M>0$. Suppose an open cover of $K$ has no finite subcover. Divide each coordinate interval into two closed halves. The resulting $2^n$ closed subcubes cover $Q_0$. At least one subcube has intersection with $K$ that is not finitely coverable by the given family; otherwise the finite union of the finite subcovers would cover $K$. Select such a subcube and repeat. This produces nested closed cubes $Q_j$ with side length $2M/2^j$ and $K\cap Q_j$ not finitely coverable, hence nonempty.

For each coordinate, the nested interval property gives a common coordinate value. Together these give $p\in\bigcap_jQ_j$. Every pair of points in $Q_j$ has distance at most $2M\sqrt n/2^j$, so the intersection contains only $p$. Choose $x_j\in K\cap Q_j$. Then $\|x_j-p\|\le2M\sqrt n/2^j\to0$. A closed set contains such a limit: if $p$ were in its open complement, a ball around $p$ would eventually contain $x_j$ outside $K$, a contradiction. Thus $p\in K$.

One member $O$ of the cover contains $p$, and openness gives $B(p,\varepsilon)\subseteq O$ for some $\varepsilon>0$. For sufficiently large $j$, every point of $Q_j$ is within $\varepsilon$ of $p$, so $O$ alone covers $K\cap Q_j$. This contradicts the selection of $Q_j$. Therefore every open cover has a finite subcover. The number $2^n$ is finite; replacing it by infinitely many subpieces would invalidate this argument.

Continuous images and extreme values

Theorem. If $K\subseteq\mathbb R^n$ is compact and $F:K\to\mathbb R^m$ is continuous relative to $K$, then $F(K)$ is compact. In particular, a continuous $f:K\to\mathbb R$ on nonempty compact $K$ is bounded and attains its maximum and minimum.

Proof. An open cover $(O_i)$ of $F(K)$ pulls back to relatively open sets $F^{-1}(O_i)=K\cap U_i$, with $U_i$ open in $\mathbb R^n$. These $U_i$ cover $K$, so finitely many suffice. Their corresponding $O_i$ cover $F(K)$, proving compactness. For scalar $f$, the image is nonempty, closed and bounded by the theorem already proved in dimension one. Let $a=\sup f(K)$. For each $j\ge1$, the definition of supremum supplies $y_j\in f(K)$ with $a-1/j<y_j\le a$. Then $y_j\to a$, and closedness places $a$ in the image. Thus the maximum is attained. Applying the same argument to $-f$ gives the minimum. This proves existence, not a formula for the maximizing input.

The second-derivative test with only pointwise second differentiability

Let $f$ be differentiable on an open interval around $c$, suppose $f'(c)=0$, and suppose $f'$ is differentiable at $c$. If $f''(c)>0$, then $c$ is a strict local minimum. No continuity of $f''$ on a neighborhood is assumed.

Put $k=f''(c)>0$. By its definition there is $\delta>0$ within that open interval such that

$$\frac{f'(c+h)-f'(c)}h>k/2>0\qquad(0<|h|<\delta).$$

Because $f'(c)=0$, this makes $f'(c+h)<0$ for negative $h$ and $f'(c+h)>0$ for positive $h$. If $c<x<c+\delta$, the mean value theorem on $[c,x]$ gives $f(x)-f(c)=f'(\xi)(x-c)>0$. If $c-\delta<x<c$, its version on $[x,c]$ gives $f(c)-f(x)=f'(\xi)(c-x)<0$, again $f(x)>f(c)$. This proves the strict minimum. The theorem applies because differentiability supplies continuity on these closed subintervals. Apply the same result to $-f$ when $f''(c)<0$ to obtain a strict local maximum. When $f''(c)=0$ there is no conclusion: $x^4$, $-x^4$ and $x^3$ at zero have respectively a minimum, a maximum and no extremum, while all have first and second derivatives zero there. The stationarity and interior-neighborhood conditions are essential; positivity of $f''(c)$ alone is not sufficient, as $f(x)=x+x^2$ at zero shows.