Cauchy Sequences
Here is an awkward feature of the definition of
convergence:
to verify a_n \to L you must already know
L — every estimate is a comparison against it. But in analysis the
limit is very often the thing you are trying to construct. You sum a series, iterate
Newton's method, take successive decimal approximations — and you want to certify
"this settles down" before you have any name for where it settles.
The Cauchy criterion is exactly that certificate. It never mentions a limit.
Instead it asks that the terms huddle together among themselves, ever more tightly: a
sequence (a_n) is Cauchy when
\forall\, \varepsilon > 0\ \ \exists\, N \in \mathbb{N}\ \ \forall\, m, n \ge N:\quad |a_m - a_n| < \varepsilon.
Read it quantifier by quantifier, because one detail carries all the weight. For every
tolerance \varepsilon there is a cutoff
N beyond which — and here is the detail —
two indices are quantified, not one. The condition
|a_m - a_n| < \varepsilon must hold for every pair
m, n \ge N: the millionth term against the billionth, the billionth
against the trillionth, any tail term against any other. The whole tail collapses into a single
window of width \varepsilon.
Set the two definitions side by side and the shift in viewpoint is plain:
\underbrace{n \ge N \Rightarrow |a_n - L| < \varepsilon}_{\text{convergence: term vs.\ a known }L}
\qquad\text{versus}\qquad
\underbrace{m, n \ge N \Rightarrow |a_m - a_n| < \varepsilon}_{\text{Cauchy: term vs.\ term, no }L\text{ anywhere}}
Convergence is an external condition — it measures the sequence against a landmark
outside itself. Cauchy is an internal one — the sequence is judged only by its own
mutual distances. The headline result of this page is that in
\mathbb{R} the two are exactly equivalent — and that this
equivalence is not a triviality but a restatement of what makes
\mathbb{R} special.
Worked example: a_n = \tfrac1n is Cauchy, straight from the definition
Before any theorems, drive the definition once by hand. Claim:
a_n = \tfrac1n is Cauchy — and we will prove it without ever
mentioning the limit 0.
Scratch work. Take any m, n \ge N. Both
\tfrac1m and \tfrac1n lie in the interval
\left(0, \tfrac1N\right], and two numbers in an interval of length
\tfrac1N can differ by at most \tfrac1N:
\left|\frac1m - \frac1n\right| \le \max\!\left(\frac1m, \frac1n\right) \le \frac1N.
So it suffices to force \tfrac1N < \varepsilon, i.e.
N > \tfrac1\varepsilon — and the Archimedean property hands us such
an N.
The proof, cleanly. Let \varepsilon > 0. Choose
N \in \mathbb{N} with N > \tfrac1\varepsilon.
Then for all m, n \ge N,
\left|\frac1m - \frac1n\right| \le \frac1N < \varepsilon,
so (\tfrac1n) is Cauchy. \blacksquare
Notice the shape of the argument: bound |a_m - a_n| by something
that depends only on N, then make that something small.
That template — "trap the whole tail in a shrinking box" — is how nearly every direct Cauchy
proof runs, and at no point did the number 0 appear.
Convergent \Rightarrow Cauchy
One direction is easy and holds everywhere. If the terms approach a single limit, they must
approach each other: two people walking to the same lamppost end up standing next to
one another. The engine is the triangle inequality, run with an
\tfrac\varepsilon2 + \tfrac\varepsilon2 split.
Step 1 — convergence, but aimed at \tfrac\varepsilon2.
Suppose a_n \to L. Convergence holds for every tolerance, so apply
it to the half-tolerance \tfrac\varepsilon2: there is an
N with
n \ge N \ \Longrightarrow\ |a_n - L| < \tfrac{\varepsilon}{2}.
Step 2 — compare two tail terms via the limit. Take any
m, n \ge N. Insert and remove L — a zero
— then apply the triangle inequality:
|a_m - a_n| = |(a_m - L) + (L - a_n)| \le |a_m - L| + |a_n - L|.
Step 3 — add the two halves. Both m and
n exceed N, so each term on the right is
below \tfrac\varepsilon2:
|a_m - a_n| < \tfrac{\varepsilon}{2} + \tfrac{\varepsilon}{2} = \varepsilon.
That is the Cauchy condition. So every convergent sequence is Cauchy — and notice we never
used any special feature of \mathbb{R}; this half is true in
\mathbb{Q}, in any metric space, anywhere distances make sense.
\blacksquare
Cauchy \Rightarrow convergent (in \mathbb{R})
The reverse is the deep direction, and it is where completeness enters. It
is false in \mathbb{Q} (see the hole-detector vignette
below) and true in \mathbb{R}. The argument runs in three moves.
Step 1 — a Cauchy sequence is bounded. Apply the Cauchy condition with
\varepsilon = 1: past some N, all terms
sit within 1 of a_N, hence inside the
bounded window (a_N - 1,\ a_N + 1); the finitely many earlier terms
are bounded too. So the whole sequence is bounded — the same head/tail argument as for
convergent sequences.
Step 2 — extract a convergent subsequence. Being bounded, by
Bolzano–Weierstrass
the sequence has a subsequence a_{n_k} \to L for some
L \in \mathbb{R}. This is precisely the step completeness powers —
L exists because \mathbb{R} has no gaps.
Step 3 — promote the subsequence to the whole sequence. A Cauchy sequence
with a convergent subsequence converges (to the same limit). Given
\varepsilon > 0, choose N so that
m, n \ge N \Rightarrow |a_m - a_n| < \tfrac\varepsilon2, and pick
a subsequence index n_k \ge N with
|a_{n_k} - L| < \tfrac\varepsilon2. Then for all
n \ge N,
|a_n - L| \le |a_n - a_{n_k}| + |a_{n_k} - L| < \tfrac{\varepsilon}{2} + \tfrac{\varepsilon}{2} = \varepsilon.
So a_n \to L. The bunching of the tail, anchored to the
subsequence's limit, drags the entire sequence to L.
\blacksquare
-
Always: every convergent sequence is
Cauchy (triangle inequality with
\tfrac\varepsilon2 + \tfrac\varepsilon2). This holds in any
ordered field, indeed in any metric space.
-
In \mathbb{R}: every Cauchy
sequence converges — so in \mathbb{R},
Cauchy \Leftrightarrow convergent. This direction
needs completeness (via Bolzano–Weierstrass) and is exactly what fails in
\mathbb{Q}.
-
A space in which every Cauchy sequence converges is called complete;
the theorem says \mathbb{R} is complete, an equivalent
restatement of the least-upper-bound axiom.
The theorem's third bullet quietly redefines the star of the previous page. "Every bounded set
has a supremum", "every bounded monotone sequence converges", "every Cauchy sequence
converges" — over an Archimedean ordered field these are three faces of one property,
completeness. The Cauchy formulation is the most portable of the three: it never mentions
order, so it survives the journey to \mathbb{C}, to
\mathbb{R}^n, to spaces of functions — which is why it is the
version analysts carry everywhere.
Watch the tail bunch within \varepsilon
Below is the Cauchy sequence a_n = 2 + \tfrac{\sin n}{n} (it
converges to 2, but pretend you don't know that). Drag
\varepsilon to set a window
(L - \varepsilon,\ L + \varepsilon); the tail eventually enters — and
never leaves — that window. Past that cutoff N,
every pair of terms differs by less than 2\varepsilon: the
Cauchy condition, on screen.
Two things to notice as you play. First, shrink \varepsilon and the
cutoff slides right — a tighter huddle takes longer to form — but a cutoff always
exists: that is the \forall\varepsilon\,\exists N of the definition.
Second, the early terms wander well outside the band and the sequence is Cauchy anyway: like
convergence, the Cauchy property is a statement about tails. Changing the first
million terms of a sequence changes nothing.
The single most common misreading of the definition: checking only
neighbouring terms. The condition
|a_{n+1} - a_n| \to 0 looks like bunching, but it is far weaker
than Cauchy — the definition demands |a_m - a_n| < \varepsilon
for all pairs m, n \ge N, not just pairs one
step apart.
The classic counterexample is the sequence of harmonic partial sums
H_n = 1 + \tfrac12 + \tfrac13 + \cdots + \tfrac1n. Consecutive
steps shrink beautifully: |H_{n+1} - H_n| = \tfrac1{n+1} \to 0.
Yet compare terms a stretch apart:
H_{2n} - H_n = \frac{1}{n+1} + \frac{1}{n+2} + \cdots + \frac{1}{2n} \ \ge\ n \cdot \frac{1}{2n} = \frac12.
So for \varepsilon = \tfrac12 no cutoff can ever work: however
far out you go, the pair (n, 2n) violates the condition. Not
Cauchy — and indeed H_n \to \infty. A cheaper example:
a_n = \sqrt{n} has
|a_{n+1} - a_n| = \tfrac{1}{\sqrt{n+1} + \sqrt{n}} \to 0 yet
marches off to infinity. Tiny steps can still cross an unbounded distance, if there are
enough of them. When you write a Cauchy proof, make sure your bound handles
arbitrary m, n \ge N — a bound on
|a_{n+1} - a_n| alone proves nothing.
The "Cauchy \Rightarrow convergent" direction fails over
\mathbb{Q}, and that failure is the gap we met in
the real number system.
Define rationals by the decimal expansion of \sqrt{2}:
a_1 = 1.4,\quad a_2 = 1.41,\quad a_3 = 1.414,\quad a_4 = 1.4142,\ \dots
Every a_n is rational (a terminating decimal). The sequence is
Cauchy: for m, n \ge N the terms agree in their first
N decimal places, so
|a_m - a_n| \le 10^{-N} — the terms bunch arbitrarily tightly,
and the argument runs entirely inside \mathbb{Q}. Yet its only
possible limit is \sqrt{2}, which is
irrational.
So within \mathbb{Q} the sequence is Cauchy but has
no limit — it converges toward a hole.
Sit with the moral for a moment, because it is subtle: the very same list of numbers is
convergent when read in \mathbb{R} and merely-Cauchy when read in
\mathbb{Q}. Being Cauchy is a property of the
sequence; converging is a property of the sequence and the space
together. That is why "Cauchy" is the right diagnostic tool: a Cauchy sequence that
fails to converge isn't a defective sequence — it is a working hole detector,
pointing at a place where the space is missing a point. A space with nothing left to detect —
every Cauchy sequence converges — is called complete.
Once you see Cauchy sequences as hole detectors, an audacious idea suggests itself: if a
Cauchy sequence of rationals points at a missing number, why not define the missing
number to be the sequence pointing at it? This is Cantor's 1872
construction of the reals, and it actually works.
Start with \mathbb{Q} alone. Consider all Cauchy sequences of
rationals. Call two of them equivalent when they chase the same target — precisely,
when a_n - b_n \to 0 (a statement checkable inside
\mathbb{Q}, no limits needed). A real number is,
by definition, an equivalence class of such sequences: \sqrt2
is the class containing 1, 1.4, 1.41, 1.414, \dots —
along with the continued-fraction convergents
1, \tfrac32, \tfrac75, \tfrac{17}{12}, \dots and every other
rational sequence homing in on the same hole. Arithmetic is done termwise
([a_n] + [b_n] = [a_n + b_n]), each rational
q embeds as the constant sequence
q, q, q, \dots, and one can prove the resulting field is
complete: every hole has been filled by the very sequences that detected it.
In this light a decimal expansion is just a canonical representative: writing
\pi = 3.14159\ldots literally hands you the Cauchy sequence
3,\ 3.1,\ 3.14,\ 3.141,\ \dots — a number is the
sequence of its approximations, dressed up. And Cantor's recipe is portable in a way
Dedekind's order-based cuts are not:
"complete every Cauchy sequence" makes sense in any metric space, and running it on other
starting points yields whole new worlds — complete function spaces, and (taking distance on
\mathbb{Q} to measure divisibility by a prime
p instead of size) the exotic p-adic numbers, a
different completion of the same \mathbb{Q}.