© 2026 NeckPinch · www.neckpinch.com · All rights reserved.
Course 2Book 2A: Numbers, Limits and the IntegralChapter 6
Sequences
Limits, lim sup and lim inf, monotone convergence and Bolzano–Weierstrass.
Read with Tao, Analysis I, chapter "Limits of sequences" (convergence and limit laws, the extended real number system, suprema and infima of sequences, lim sup, lim inf and limit points, some standard limits, subsequences, real exponentiation part II).
With the real numbers built and the logic of quantifiers in hand, we can finally say what it means for a sequence to converge, and prove the theorems that make limits usable. Three results from this chapter recur all the way to Perelman:
- Completeness: a sequence of real numbers converges exactly when it is Cauchy. This is the property that the construction of 2A.4 The Real Numbers was designed to give.
- Monotone convergence: a monotone, bounded sequence converges. A quantity that only ever increases, and can't increase forever, must settle down. Perelman's proof is driven by quantities of exactly this kind.
- Bolzano–Weierstrass: every bounded sequence has a convergent subsequence. This is the first compactness theorem of the guidebook, and the engine of the contradiction–compactness template of 2A.5 Quantifiers and the Shape of a Proof.
Between them sit the tools for sequences that don't converge, and , which describe their long-run upper and lower envelopes.
By the end of this chapter you will be able to:
- prove that a sequence converges, or that it doesn't, directly from the definition;
- use the limit laws, the squeeze theorem and the standard limits;
- prove and apply the monotone convergence theorem;
- compute and , and use them to characterise convergence;
- prove Bolzano–Weierstrass, and use it to show that Cauchy sequences of reals converge.
Convergence
A sequence of real numbers converges to a real number if for every there is an such that for all . We then write or , and call the limit. A sequence that converges to no real number diverges.
In quantifier form, . As a game (2A.5 Quantifiers and the Shape of a Proof): the adversary names a tolerance, you name a point beyond which every term stays within that tolerance of . The only difference from the Cauchy condition is that the terms are compared to a fixed instead of to each other.
Control engineers describe how quickly a system (a cruise control, a thermostat, a hard-disk head, a drone's attitude controller) reaches its target with a figure called the settling time. The usual definition is the time after which the response reaches and stays within 2% of its final value. That is the convergence definition with equal to 2% of the final value. The settling time is the of the game, and the word "stays" is the . A response that dips inside the band and then overshoots back out has not settled. Some specifications use 5% instead, which is the same idea with a different .
A sequence converges to at most one real number.
Proof. Suppose and . Let . For large enough, both and , so . As was arbitrary, (2A.5 Quantifiers and the Shape of a Proof).
If , then is Cauchy, and hence bounded.
Proof. Given , choose with for . Then for , . Boundedness follows as in 2A.4 The Real Numbers.
The converse, that every Cauchy sequence of real numbers converges, is the completeness of . We prove it at the end of the chapter with Bolzano–Weierstrass. Before that, one link to 2A.4 The Real Numbers: the formal limits used to build the reals are genuine limits.
If is a Cauchy sequence of rationals, then in .
This is the exercise "terms approach their formal limit" in 2A.4 The Real Numbers. From now on we write throughout.
Limit laws
Suppose and . Then:
- and for every real ;
- ;
- if , then for all large , and ;
- if for all large , then .
Proof (Parts 2 and 4). (2) Write . The sequence is bounded, say by , and we may take and . Given , take with and for . Then .
(4) Suppose and let . For large , and , so , contradicting .
Part (4) says that limits preserve non-strict inequalities but not strict ones: for every , but the limit is . In the many estimates of later courses, a strict inequality that holds along a sequence typically survives only as in the limit.
If for all large , and and , then .
Some standard limits
These are used so often that they are worth having as named facts.
- for every rational .
- if ; the sequence diverges if or .
- for every .
Proof (Part 2, for 0 < x < 1). Write with . By the binomial expansion (or Bernoulli's inequality, proved by induction in Exercise 6.19), . So , and the squeeze theorem with part 1 gives .
The proof of (2) is a model for many estimates: to show something tends to zero, bound it by something you already know tends to zero.
Monotone sequences
A sequence is increasing if for every , decreasing if for every , and monotone if it is one or the other. It is bounded above if some has for all .
An increasing sequence that is bounded above converges, and its limit is . Likewise, a decreasing sequence bounded below converges to .
Proof. Let , which exists by the least upper bound property (2A.4 The Real Numbers). Let . Since is not an upper bound, some term . Since the sequence is increasing, for every ; and because is an upper bound. So for all .
This is where the least upper bound property earns its keep: it supplies the limit. Over the rationals the theorem is false. The decimal truncations of are increasing and bounded, but have no rational limit.
Lend at an annual interest rate of , compounded times a year: after one year you have . Compounding more often helps: , , , . Does it grow without bound? Jacob Bernoulli asked exactly this question in 1683, about continuous compounding.
The sequence increases. By the binomial theorem,
Going from to , each bracket increases and an extra non-negative term is added, so .
It is bounded. Each bracket is at most , so , using .
By Theorem 6.9 the sequence converges. Its limit is the number . Continuous compounding at multiplies money by , not by infinity.
"Monotone and bounded, therefore convergent" is the logical skeleton of Perelman's approach. His -entropy (12A.3 The 𝓦-Entropy) and reduced volume (12A.5 Reduced Distance and Reduced Volume) are quantities that can only move in one direction along a Ricci flow and are bounded, so they converge. The real power comes from a second fact. Each monotonicity formula says how fast the quantity changes, and the rate is a sum of squares that vanishes only on very special geometries (solitons). So in the limit, where the quantity has stopped changing, the geometry must be one of those special ones. Bounded monotone convergence identifies the limit; the equality case identifies what it looks like. You will see the same two-step argument in miniature for entropy along the heat equation (6A.10 Entropy, Information and Diffusion).
The extended reals, suprema and infima
Unbounded sequences are often best described as heading to or . To handle this cleanly, extend the real line by two symbols.
The extended real line is ordered by for every real . Every subset of has a supremum and an infimum in : if has no real upper bound, and , by convention.
The symbols are not real numbers, and is left undefined. But they let statements such as "" (for every , eventually ) and "" be made without exceptions.
lim sup and lim inf
A sequence like doesn't converge, but its long-run behaviour is easy to describe: the terms near the end come arbitrarily close to and to , and to nothing else. The precise tool is the upper and lower envelope of the tail.
For a sequence , let and , the largest and smallest values of the tail from on (in ). Then
As grows, the tail gets smaller, so decreases and increases. By monotone convergence (in ) both always have limits. So, unlike , and always exist.
Let be a sequence of reals.
- .
- If is finite, then for every : eventually , and infinitely often . (Similarly for .)
- converges to if and only if (with finite).
Proof (Part 3). If , then for every the tails eventually lie in , so for large , and both envelopes converge to . Conversely, if both envelopes converge to , then for , and the squeeze theorem gives .
Part (2) gives the practical reading: is the smallest level that the sequence eventually stays below, even allowing any small margin. In engineering terms it is the long-run peak. For a damped vibration it is the amplitude the oscillation settles to, and for a noisy measurement it is the level that noise excursions keep approaching.
A real is a limit point of if for every and every there is some with : the sequence returns arbitrarily close to infinitely often.
Finite and are always limit points, the largest and the smallest (Exercise 6.21). For the limit points are exactly and .
Subsequences and Bolzano–Weierstrass
A subsequence of is a sequence where . That is, it keeps infinitely many terms of the original sequence, in their original order, and drops the rest.
If , every subsequence converges to too. The converse fails: has the subsequences and , which converge to different limits. In fact, is a limit point of exactly when some subsequence converges to (Exercise 6.21). The central theorem says that a bounded sequence always has at least one such subsequence.
Every bounded sequence of real numbers has a convergent subsequence.
Proof (By repeated halving). Let all terms lie in . Split the interval in half. At least one half contains for infinitely many (the two halves together contain every term, and there are infinitely many terms). Call that half . Split it again, and choose a half that contains infinitely many terms. Continuing, we get nested intervals with , each containing for infinitely many .
Now choose indices: with ; then with , which is possible since infinitely many indices qualify; and so on, with . For , both and lie in , so they differ by at most . The subsequence is therefore Cauchy.
To finish without assuming completeness of , notice that the left endpoints increase and are bounded, so by Theorem 6.9 they converge to some . Since and , the squeeze theorem gives .
The proof of Bolzano–Weierstrass is also an algorithm. To solve for a continuous with , evaluate at the midpoint and keep the half on which changes sign. After steps the root is confined to an interval of length . For on , 52 halvings shrink the interval to , about , which is the spacing of double-precision numbers in (2A.4 The Real Numbers). By then the machine can't represent a smaller interval. Bisection is slow compared with Newton's method but cannot fail, which is why robust root-finders, such as Brent's method (1973), fall back on it whenever faster steps misbehave.
Completeness of the real numbers
A sequence of real numbers converges if and only if it is Cauchy.
Proof. Convergent implies Cauchy is Proposition 6.3. Conversely, let be Cauchy. It is bounded, so by Bolzano–Weierstrass some subsequence converges to some . We show the whole sequence converges to . Let . Choose with for , and then some with and . For every , .
The proof follows a pattern worth recognising: compactness produces a convergent subsequence, and an extra property (here, being Cauchy) upgrades it to convergence of the whole sequence. The same two-step pattern recurs later. Compactness theorems for Ricci flows (11B.3 Compactness of Ricci Flows) produce a convergent subsequence of rescaled flows, and a separate uniqueness argument upgrades it to convergence of the whole family.
Bolzano–Weierstrass is the first compactness theorem in the guidebook. It says that bounded sets of reals can't "escape": any sequence in them has a part that settles down. It is the ingredient behind step 3 of the contradiction–compactness template (2A.5 Quantifiers and the Shape of a Proof). The first use comes in 2A.9 Continuous Functions, where it shows that a continuous function on a closed interval attains its maximum. Each later course needs a version of it for bigger spaces: of points (2B.3 Compactness), of functions (2B.5 Uniform Convergence and Arzelà–Ascoli), of manifolds (9B.4 Convergence of Manifolds) and of Ricci flows (11B.3 Compactness of Ricci Flows). In infinite-dimensional spaces it fails in its naive form, and recovering some version of it is one of the main themes of functional analysis (4A.1 Banach Spaces and Bounded Operators, 4A.6 Weak Convergence and the Direct Method).
Real exponentiation
With limits available, powers for irrational can be defined. For and real , choose any sequence of rationals , and set
For this to be a definition, two things must hold: the limit must exist, and it must not depend on the sequence chosen. Both follow from the estimate for rationals in a bounded range, where depends on and the range (Exercise 6.24). The first gives Cauchy, hence convergent; the second gives well-definedness, by interleaving two sequences. The familiar laws and pass to the limit. The exponential and logarithm functions, properly constructed from power series, come in 2B.6 Power Series, Exponentials and Bump Functions.
Convergent sequences have unique limits and obey the limit laws. Monotone bounded sequences converge, to their supremum or infimum. Every sequence has a and , and converges exactly when they agree. Every bounded sequence has a convergent subsequence, and as a consequence is complete. The next chapter, 2A.7 Series, applies all of this to infinite sums.
Exercises
Prove directly from Definition 6.1 that . Find an explicit .
Solution
. Given , take .
Prove by induction that for every real and every natural number . Where is needed?
Solution
Base case: . Step: if , multiply by (this is where is used, so the inequality doesn't reverse): .
Show that .
Hint
Write with . Then for , so .
Show that (a) is a limit point of if and only if some subsequence converges to ; (b) a finite is a limit point, and no limit point is larger.
Call a peak of if for every . Show that if there are infinitely many peaks they give a decreasing subsequence, and if there are finitely many, one can build an increasing subsequence. Deduce Bolzano–Weierstrass again, from Theorem 6.9.
Find and of: (a) ; (b) ; (c) .
Solution
(a) The values cycle through , so and . (b) , . (c) Both are : the terms are for odd and for even , so the sequence converges to .
Let and let be rationals in . Show that , and that for rational (hint: for , apply the AM–GM inequality to copies of and copies of ). Deduce that is well defined for real .
Let be a bounded sequence such that every convergent subsequence has limit . Prove that , by contradiction: if not, there is and a subsequence staying at least away from ; apply Bolzano–Weierstrass to it. Identify the five steps of the template of 2A.5 Quantifiers and the Shape of a Proof in your proof. This "every convergent subsequence has the same limit, so the whole sequence converges" step is exactly how uniqueness of a limit object is used later in the route.
Solution
Suppose . By negation (2A.5 Quantifiers and the Shape of a Proof) there is such that for infinitely many : these form a subsequence (steps 1–2). It is bounded, so by Bolzano–Weierstrass it has a further subsequence converging to some (step 4; no normalisation is needed here, so step 3 is empty). That further subsequence is a convergent subsequence of , so . But all its terms satisfy , so by the limit laws (step 5): contradiction.
© 2026 NeckPinch (www.neckpinch.com). All content in the guidebook (text, mathematics, figures and exercises) is protected by copyright. All rights reserved. No part may be copied, republished or redistributed without written permission.