Loading…
Loading…
1. Marginal Analysis, Optimization, and Numerical Roots
This chapter assumes the algebra, functions, logarithms, and rudiments of calculus appropriate to a preparatory mathematics course. We review the derivative's meaning before applying it to marginal quantities, continuous optimization, and numerical equations. You will learn to distinguish local tests from global conclusions, continuous optima from feasible integer decisions, and a numerical estimate from a verified error bound.
At an interior point , the derivative is
if this finite limit exists. Differentiability is equivalently a local expansion
The term approximates a finite change; it does not usually equal it. If is cost, then is marginal cost, measured in cost units per quantity unit. The average cost , defined for , is a different function.
Worked example 1: marginal versus next-unit cost. Let . Then . At , marginal cost is , while the exact cost of increasing output from to is
The extra is the quadratic remainder for a unit change. For a smaller change , the exact difference is .
We use the familiar derivative rules: on a suitable domain; ; for ; the sum, product, quotient and chain rules. Differentiation must retain the original domain. For instance, differentiating a logarithmic expression does not make its nonpositive arguments admissible.
The rational numbers support the familiar ordered arithmetic, yet the set has no rational least upper bound. The real number system adds a completeness property: bounded nonempty sets have least upper bounds. This is the source of many existence results later in analysis, not simply another rule for manipulating inequalities.
Definition
For a nonempty , is an upper bound if for every . A number is if it is an upper bound and for every upper bound . A maximum is an element of that is also an upper bound. The maximum, when it exists, is the supremum; a supremum need not belong to . Lower bounds, infimum and minimum are defined by reversing inequalities.
Theorem
Every nonempty subset of that is bounded above has a real supremum. Equivalently, every nonempty subset bounded below has a real infimum, via .
For example, although is not a maximum of that set. Conversely, and it is a maximum. The empty set and an unbounded-above set do not have a real supremum under this definition.
Theorem
An upper bound of a nonempty set is if and only if, for every , there exists such that .
Proof
If and no element exceeds , then is a smaller upper bound, contradiction. Conversely, suppose is an upper bound and the approximation property holds. If another upper bound were smaller than , choose . The property gives , contradicting that is an upper bound. Thus is the least upper bound.
Worked example
Let . Every element is less than , so is an upper bound. Given , choose by the Archimedean property below. Then . Thus . No element equals , so has no maximum. An upper-bound calculation alone would not prove leastness: is also an upper bound.
Theorem
For every real there exists a positive integer . Consequently, for every there is such that .
Proof
If the positive integers were bounded above, completeness would give . Since is not an upper bound, some satisfies . But and , contradicting that bounds the set. Apply this to to obtain the second statement.
Between any real numbers there is a rational number. Indeed choose with ; the Archimedean property and the integer-part property yield an integer with , so . The integer-part property follows from the unboundedness of integers in both directions and the well-ordering of the natural numbers. An irrational also lies between and : choose a rational with ; then is irrational and lies in the interval. Thus density does not say rationals and irrationals are equal sets.
Worked example
For , every element exceeds . Given , choose to obtain . Therefore is the infimum, but not a minimum. The maximum is , attained at .
Definition
A sequence converges to if for every there exists such that for every , . Write . The index may depend on but must work for all later indices.
To negate convergence to , there must be some such that for every there is an with . A few early terms do not affect convergence; a recurring failure arbitrarily late does.
Worked example
For , guess . Since
choose . Then every gives . The guess is motivation; the inequality and quantified choice establish the proof.
Theorem
A convergent real sequence has a unique limit and is bounded. If and , then , , and when and the quotient is defined eventually. If eventually and both outer sequences converge to , then .
Proof
If and , then for any , sufficiently late terms satisfy both and . The triangle inequality yields . Since this holds for every positive , . For boundedness choose so that for . The finite initial terms and the bound for the tail together give a finite bound for the whole sequence.
The converse of boundedness is false: is bounded but does not converge. If it converged to , its even subsequence would converge to and its odd subsequence to , violating uniqueness.
Proof
A convergent sequence is bounded, say . Write
Both terms tend to zero. For the quotient, implies eventually; this keeps the denominator away from zero and gives .
Definition
A subsequence of is where are positive integers. If , then every subsequence converges to because and therefore eventually lies beyond any prescribed index.
Theorem
Every bounded real sequence has a convergent subsequence.
Proof
Place every term in a closed bounded interval . Bisect it. At least one half contains infinitely many terms; choose that half as . Continue, obtaining nested closed intervals of lengths tending to zero, each containing infinitely many terms. Choose indices strictly increasing with ; this is possible because each interval contains infinitely many terms. Completeness gives a common point in all intervals: the supremum of their left endpoints lies in each interval because every left endpoint is at most every right endpoint. Since , their distance is at most the interval length and tends to zero.
The conclusion is about a subsequence, not necessarily the whole sequence. For example, has constant subsequences converging to and , but does not converge.
Work on the real line in the usual classical set-theoretic setting, with countable witness selections available. A set is open when every in has some with contained in . We use the Archimedean consequence that tends to zero. For every subset of the real line, the following conditions are equivalent:
Proof of 2 implies 1. Suppose belongs to and tends to . If were outside , openness would give with disjoint from . Convergence gives a threshold after which , contradicting in . Therefore belongs to .
Proof of 1 implies 2. Fix outside . If no positive-radius interval around avoided , then for every positive integer there would be a point in with . Choose these witnesses as a sequence. Given , choose with . For , , so tends to . Condition 1 would force into , a contradiction. Hence some interval around avoids . This holds for every point of the complement, proving it open. The witness-sequence step uses the stated classical setting; this proof is not offered as a theorem about choice-free foundations. If is empty there is no sequence in , and its complement is the whole open line. If is the whole line, its empty complement is open vacuously. Both edge cases also satisfy the equivalence.
A set is compact if every family of open sets whose union contains has a finite subfamily still covering . A set is closed if it contains all limits of convergent sequences of its points, equivalently if its complement is open. Sequential compactness means every sequence in has a subsequence converging to a member of .
The empty set is compact, closed and bounded, and sequentially compact vacuously. In proofs using a selected point or an infinite sequence, treat that case separately. We may assume the real completeness property and its nested-interval and Bolzano–Weierstrass consequences from the earlier sequence units.
For , the following are equivalent: compactness by open covers; closedness and boundedness; sequential compactness.
Compact implies closed and bounded. The intervals , , cover , hence . A finite subcover gives a bound. To show closedness, take . For each , the interval avoids . A finite subfamily covers . Let be the minimum of their positive half-distances to . Every point in the chosen interval centered at has distance from strictly greater than . Thus misses , showing its complement open. If is empty this is immediate.
Closed and bounded implies compact. Enclose nonempty in a closed bounded interval . Suppose an open cover of has no finite subcover. Bisect . At least one closed half meets in a set not finitely coverable; otherwise two finite collections would cover . Choose such a half and repeat. We obtain nested closed intervals with lengths tending to zero, and not finitely coverable. Each intersection is nonempty; choose . The nested-interval property gives a unique common point , and because both lie in . Closedness gives . Some member of the cover contains , and openness gives a ball around inside . For large , the whole interval lies in that ball, so alone covers , a contradiction.
Closed and bounded implies sequentially compact. Every sequence in is bounded, so Bolzano–Weierstrass supplies a convergent subsequence. Closedness retains its limit in .
Sequentially compact implies closed and bounded. If unbounded, choose with ; no subsequence can converge to a finite real number, a contradiction. If is a limit of points in , choose with . A subsequence converges to a point of by sequential compactness, but it also converges to ; uniqueness of real limits gives . Thus is closed. This completes all implications.
A set is compact if every open cover has a finite subcover. In , Heine–Borel says this is equivalent to being closed and bounded; it is also equivalent to every sequence in having a subsequence converging to a point of . The closedness requirement keeps the subsequential limit in the set; boundedness permits extraction. We use the sequential form in the proofs below.
Theorem
If is nonempty and compact and is continuous, then is bounded and attains both a maximum and a minimum on .
Proof
If were unbounded above, choose with . A subsequence exists; continuity would give , contradicting divergence to infinity. The same reasoning applied to gives boundedness below. Let . Choose with . A convergent subsequence tends to some , and continuity implies . Apply the argument to for a minimum.
Worked example
The continuous function on is bounded but has no maximum or minimum: and are not in the domain. The set is bounded but not closed, hence not compact. On , both endpoints are present and the extrema are attained. Compactness is a sufficient global hypothesis, not a condition required for every individual function to attain extrema.
Fermat's necessary condition. At a differentiable interior local maximum or minimum, .
Proof. At a local maximum, sufficiently small positive increments give nonpositive difference quotients and negative increments give nonnegative ones. A two-sided derivative can satisfy both sign limits only by being zero. Negating the function treats a minimum.
The interior hypothesis matters: on has extrema at endpoints despite derivative 1. The converse fails: has zero derivative at zero but no extremum there.
Rolle's theorem. If , is continuous on , differentiable on and , then for some .
Proof. The extreme-value theorem supplies maximum and minimum. If the function is constant, every interior point works. Otherwise a value differs from the equal endpoint values, so either a maximum or a minimum occurs in the interior. Fermat's condition applies there.
Mean value theorem. Under the same continuity and differentiability hypotheses but without equal endpoint values, some satisfies .
Subtract the secant line from and apply Rolle. This proves the theorem without assuming is continuous. Consequences include: derivative zero on an interval makes the function constant; nonnegative derivative makes it nondecreasing; and on an interval gives for points in it. An interval-wide derivative bound cannot be inferred from one derivative value.
It follows that throughout an interval implies strict increase, and implies strict decrease. A bound on a segment gives . These are interval conclusions from local derivative information; the theorem cannot be applied across a missing domain point.
If throughout an interval, is constant there.
This is a necessary condition, not a sufficient one. The function has derivative zero at zero but no local maximum or minimum there. Nondifferentiable points and endpoints must also be considered; neither is covered by Fermat's interior differentiable condition.
To find them when there are finitely many candidate points:
A first-derivative sign change from positive to negative proves a local maximum; negative to positive proves a local minimum. If has two continuous derivatives near a stationary point, proves a strict local minimum and a strict local maximum. The condition is inconclusive. For example, , , and have different extremum behaviour despite the same zero first and second derivatives at zero.
Worked example 2: constrained profit. Suppose price is and cost is , with . Profit is
Its derivative is , positive below and negative above. The stationary point is feasible, and , while and . Thus the global maximum on this interval is at . If capacity restricts , profit is increasing throughout the feasible interval and the maximum is instead .
If quantities must be integers, the continuous optimum need not be feasible. Here completing the square gives , so both and maximize integer profit, with value . Rounding is justified here by the exact quadratic shape, not by a universal rule that every continuous optimum should be rounded.
For positive differentiable demand at positive price , define the signed relative response . When demand decreases, it is customary to report the nonnegative price elasticity
For a small price change, . This is a first-order statement. It does not predict exact finite percentage changes.
Revenue as a function of price is , so
Under the stated positivity assumptions, revenue increases locally with price if and decreases locally if .
Worked example 3: a power demand model. Let for . Then , so at every price. Revenue is , which decreases with price, exactly as the elasticity test predicts.
Let real continuous satisfy on . The intermediate value theorem guarantees at least one root. Bisection evaluates the midpoint, keeps the half retaining the sign change, and repeats. After halvings the interval width is ; its midpoint is within of some root in that interval. Uniqueness requires an additional assumption such as strict monotonicity.
For , if , stop.
Worked example 4: begin a bracketed calculation. For , and . The derivative proves a unique root. At , , so the first bracket is . At , , giving . Its midpoint is already within of the root. Further bisections reduce the guaranteed error whether or not the exact root has a convenient formula.
The sign calculation must be reliable. With approximate arithmetic, an uncertain value near zero is not a certified positive or negative sign; increase precision or use an interval bound before claiming a rigorous bracket.
At an iterate where , the tangent line is
Its zero defines Newton's proposal
This often converges rapidly near a simple root, but may fail with a poor starting point, a zero derivative, or an iterate outside the domain. A small step alone does not prove closeness to a root. Preserve a bracket or establish an error bound where a reliable numerical conclusion is required.
Worked example 5: square root and a residual bound. For starting at ,
A second step gives . The root and the iterate lie in , where . By the mean value theorem,
This converts a residual into an error guarantee under a verified lower derivative bound. In general, by itself is not an error estimate: multiplying the whole equation by a tiny constant changes residuals without moving its roots.
Foundation
Core
Synthesis
Marginal quantities are derivatives, not exact next-unit changes. An optimum requires domain and endpoint checks; a stationary point alone is insufficient. Elasticity compares relative rates and depends on an explicit sign convention. Bisection maintains a root bracket and a transparent error bound. Newton's method provides useful iterates but needs safeguards or analysis before convergence and accuracy can be claimed.
This section can be read on its own.