Cauchy Sequences

Here is an awkward feature of the definition of convergence: to verify a_n \to L you must already know L — every estimate is a comparison against it. But in analysis the limit is very often the thing you are trying to construct. You sum a series, iterate Newton's method, take successive decimal approximations — and you want to certify "this settles down" before you have any name for where it settles.

The Cauchy criterion is exactly that certificate. It never mentions a limit. Instead it asks that the terms huddle together among themselves, ever more tightly: a sequence (a_n) is Cauchy when

\forall\, \varepsilon > 0\ \ \exists\, N \in \mathbb{N}\ \ \forall\, m, n \ge N:\quad |a_m - a_n| < \varepsilon.

Read it quantifier by quantifier, because one detail carries all the weight. For every tolerance \varepsilon there is a cutoff N beyond which — and here is the detail — two indices are quantified, not one. The condition |a_m - a_n| < \varepsilon must hold for every pair m, n \ge N: the millionth term against the billionth, the billionth against the trillionth, any tail term against any other. The whole tail collapses into a single window of width \varepsilon.

Set the two definitions side by side and the shift in viewpoint is plain:

\underbrace{n \ge N \Rightarrow |a_n - L| < \varepsilon}_{\text{convergence: term vs.\ a known }L} \qquad\text{versus}\qquad \underbrace{m, n \ge N \Rightarrow |a_m - a_n| < \varepsilon}_{\text{Cauchy: term vs.\ term, no }L\text{ anywhere}}

Convergence is an external condition — it measures the sequence against a landmark outside itself. Cauchy is an internal one — the sequence is judged only by its own mutual distances. The headline result of this page is that in \mathbb{R} the two are exactly equivalent — and that this equivalence is not a triviality but a restatement of what makes \mathbb{R} special.

Worked example: a_n = \tfrac1n is Cauchy, straight from the definition

Before any theorems, drive the definition once by hand. Claim: a_n = \tfrac1n is Cauchy — and we will prove it without ever mentioning the limit 0.

Scratch work. Take any m, n \ge N. Both \tfrac1m and \tfrac1n lie in the interval \left(0, \tfrac1N\right], and two numbers in an interval of length \tfrac1N can differ by at most \tfrac1N:

\left|\frac1m - \frac1n\right| \le \max\!\left(\frac1m, \frac1n\right) \le \frac1N.

So it suffices to force \tfrac1N < \varepsilon, i.e. N > \tfrac1\varepsilon — and the Archimedean property hands us such an N.

The proof, cleanly. Let \varepsilon > 0. Choose N \in \mathbb{N} with N > \tfrac1\varepsilon. Then for all m, n \ge N,

\left|\frac1m - \frac1n\right| \le \frac1N < \varepsilon,

so (\tfrac1n) is Cauchy. \blacksquare Notice the shape of the argument: bound |a_m - a_n| by something that depends only on N, then make that something small. That template — "trap the whole tail in a shrinking box" — is how nearly every direct Cauchy proof runs, and at no point did the number 0 appear.

Convergent \Rightarrow Cauchy

One direction is easy and holds everywhere. If the terms approach a single limit, they must approach each other: two people walking to the same lamppost end up standing next to one another. The engine is the triangle inequality, run with an \tfrac\varepsilon2 + \tfrac\varepsilon2 split.

Step 1 — convergence, but aimed at \tfrac\varepsilon2. Suppose a_n \to L. Convergence holds for every tolerance, so apply it to the half-tolerance \tfrac\varepsilon2: there is an N with

n \ge N \ \Longrightarrow\ |a_n - L| < \tfrac{\varepsilon}{2}.

Step 2 — compare two tail terms via the limit. Take any m, n \ge N. Insert and remove L — a zero — then apply the triangle inequality:

|a_m - a_n| = |(a_m - L) + (L - a_n)| \le |a_m - L| + |a_n - L|.

Step 3 — add the two halves. Both m and n exceed N, so each term on the right is below \tfrac\varepsilon2:

|a_m - a_n| < \tfrac{\varepsilon}{2} + \tfrac{\varepsilon}{2} = \varepsilon.

That is the Cauchy condition. So every convergent sequence is Cauchy — and notice we never used any special feature of \mathbb{R}; this half is true in \mathbb{Q}, in any metric space, anywhere distances make sense. \blacksquare

Cauchy \Rightarrow convergent (in \mathbb{R})

The reverse is the deep direction, and it is where completeness enters. It is false in \mathbb{Q} (see the hole-detector vignette below) and true in \mathbb{R}. The argument runs in three moves.

Step 1 — a Cauchy sequence is bounded. Apply the Cauchy condition with \varepsilon = 1: past some N, all terms sit within 1 of a_N, hence inside the bounded window (a_N - 1,\ a_N + 1); the finitely many earlier terms are bounded too. So the whole sequence is bounded — the same head/tail argument as for convergent sequences.

Step 2 — extract a convergent subsequence. Being bounded, by Bolzano–Weierstrass the sequence has a subsequence a_{n_k} \to L for some L \in \mathbb{R}. This is precisely the step completeness powers — L exists because \mathbb{R} has no gaps.

Step 3 — promote the subsequence to the whole sequence. A Cauchy sequence with a convergent subsequence converges (to the same limit). Given \varepsilon > 0, choose N so that m, n \ge N \Rightarrow |a_m - a_n| < \tfrac\varepsilon2, and pick a subsequence index n_k \ge N with |a_{n_k} - L| < \tfrac\varepsilon2. Then for all n \ge N,

|a_n - L| \le |a_n - a_{n_k}| + |a_{n_k} - L| < \tfrac{\varepsilon}{2} + \tfrac{\varepsilon}{2} = \varepsilon.

So a_n \to L. The bunching of the tail, anchored to the subsequence's limit, drags the entire sequence to L. \blacksquare

The theorem's third bullet quietly redefines the star of the previous page. "Every bounded set has a supremum", "every bounded monotone sequence converges", "every Cauchy sequence converges" — over an Archimedean ordered field these are three faces of one property, completeness. The Cauchy formulation is the most portable of the three: it never mentions order, so it survives the journey to \mathbb{C}, to \mathbb{R}^n, to spaces of functions — which is why it is the version analysts carry everywhere.

Watch the tail bunch within \varepsilon

Below is the Cauchy sequence a_n = 2 + \tfrac{\sin n}{n} (it converges to 2, but pretend you don't know that). Drag \varepsilon to set a window (L - \varepsilon,\ L + \varepsilon); the tail eventually enters — and never leaves — that window. Past that cutoff N, every pair of terms differs by less than 2\varepsilon: the Cauchy condition, on screen.

Two things to notice as you play. First, shrink \varepsilon and the cutoff slides right — a tighter huddle takes longer to form — but a cutoff always exists: that is the \forall\varepsilon\,\exists N of the definition. Second, the early terms wander well outside the band and the sequence is Cauchy anyway: like convergence, the Cauchy property is a statement about tails. Changing the first million terms of a sequence changes nothing.

The single most common misreading of the definition: checking only neighbouring terms. The condition |a_{n+1} - a_n| \to 0 looks like bunching, but it is far weaker than Cauchy — the definition demands |a_m - a_n| < \varepsilon for all pairs m, n \ge N, not just pairs one step apart.

The classic counterexample is the sequence of harmonic partial sums H_n = 1 + \tfrac12 + \tfrac13 + \cdots + \tfrac1n. Consecutive steps shrink beautifully: |H_{n+1} - H_n| = \tfrac1{n+1} \to 0. Yet compare terms a stretch apart:

H_{2n} - H_n = \frac{1}{n+1} + \frac{1}{n+2} + \cdots + \frac{1}{2n} \ \ge\ n \cdot \frac{1}{2n} = \frac12.

So for \varepsilon = \tfrac12 no cutoff can ever work: however far out you go, the pair (n, 2n) violates the condition. Not Cauchy — and indeed H_n \to \infty. A cheaper example: a_n = \sqrt{n} has |a_{n+1} - a_n| = \tfrac{1}{\sqrt{n+1} + \sqrt{n}} \to 0 yet marches off to infinity. Tiny steps can still cross an unbounded distance, if there are enough of them. When you write a Cauchy proof, make sure your bound handles arbitrary m, n \ge N — a bound on |a_{n+1} - a_n| alone proves nothing.

The "Cauchy \Rightarrow convergent" direction fails over \mathbb{Q}, and that failure is the gap we met in the real number system. Define rationals by the decimal expansion of \sqrt{2}:

a_1 = 1.4,\quad a_2 = 1.41,\quad a_3 = 1.414,\quad a_4 = 1.4142,\ \dots

Every a_n is rational (a terminating decimal). The sequence is Cauchy: for m, n \ge N the terms agree in their first N decimal places, so |a_m - a_n| \le 10^{-N} — the terms bunch arbitrarily tightly, and the argument runs entirely inside \mathbb{Q}. Yet its only possible limit is \sqrt{2}, which is irrational. So within \mathbb{Q} the sequence is Cauchy but has no limit — it converges toward a hole.

Sit with the moral for a moment, because it is subtle: the very same list of numbers is convergent when read in \mathbb{R} and merely-Cauchy when read in \mathbb{Q}. Being Cauchy is a property of the sequence; converging is a property of the sequence and the space together. That is why "Cauchy" is the right diagnostic tool: a Cauchy sequence that fails to converge isn't a defective sequence — it is a working hole detector, pointing at a place where the space is missing a point. A space with nothing left to detect — every Cauchy sequence converges — is called complete.

Once you see Cauchy sequences as hole detectors, an audacious idea suggests itself: if a Cauchy sequence of rationals points at a missing number, why not define the missing number to be the sequence pointing at it? This is Cantor's 1872 construction of the reals, and it actually works.

Start with \mathbb{Q} alone. Consider all Cauchy sequences of rationals. Call two of them equivalent when they chase the same target — precisely, when a_n - b_n \to 0 (a statement checkable inside \mathbb{Q}, no limits needed). A real number is, by definition, an equivalence class of such sequences: \sqrt2 is the class containing 1, 1.4, 1.41, 1.414, \dots — along with the continued-fraction convergents 1, \tfrac32, \tfrac75, \tfrac{17}{12}, \dots and every other rational sequence homing in on the same hole. Arithmetic is done termwise ([a_n] + [b_n] = [a_n + b_n]), each rational q embeds as the constant sequence q, q, q, \dots, and one can prove the resulting field is complete: every hole has been filled by the very sequences that detected it.

In this light a decimal expansion is just a canonical representative: writing \pi = 3.14159\ldots literally hands you the Cauchy sequence 3,\ 3.1,\ 3.14,\ 3.141,\ \dots — a number is the sequence of its approximations, dressed up. And Cantor's recipe is portable in a way Dedekind's order-based cuts are not: "complete every Cauchy sequence" makes sense in any metric space, and running it on other starting points yields whole new worlds — complete function spaces, and (taking distance on \mathbb{Q} to measure divisibility by a prime p instead of size) the exotic p-adic numbers, a different completion of the same \mathbb{Q}.