Hilbert Spaces
An inner-product
space already gives you everything geometric — length, angle, orthogonality, projection —
for vectors, functions, whatever obeys the axioms. But there is one more property, invisible in finite
dimensions and absolutely decisive in infinite ones, that separates a merely useful space
from the pristine arena where analysis and quantum mechanics actually live. That property is
completeness, and an inner-product space that has it earns a special name: a
Hilbert space.
The one-line definition to keep in your pocket: a Hilbert space is an inner-product space
with no holes — every sequence that ought to converge really does converge, to a
limit that is still inside the space. That "no holes" clause is doing enormous work, and this page is
about why. It is the difference between the rationals (full of gaps) and the real numbers (a seamless
line), lifted up to spaces of infinitely many dimensions.
The problem with infinity
In finitely many dimensions life is easy: \mathbb{R}^n with the dot
product is already complete, so there is nothing to worry about. The trouble starts when a space has
infinitely many dimensions — which is precisely the situation for spaces of
functions, where you might need an endless supply of independent building blocks (think of all the
frequencies \sin x, \sin 2x, \sin 3x, \ldots).
In such a space you constantly build things as limits: a function is approximated by longer
and longer sums, a state by better and better estimates. For that to be safe, the limit has to
exist, and it has to still be a legal member of the space. If it can escape — if a sequence
of perfectly good vectors marches steadily toward something that isn't there — your space has a hole,
and the geometry springs a leak.
Completeness: no sequence left behind
The precise tool for "ought to converge" is the
Cauchy sequence. A
sequence v_1, v_2, v_3, \ldots is Cauchy if its terms get
arbitrarily close to each other — for any tolerance \varepsilon > 0
there is a point beyond which every pair of terms is within \varepsilon:
\lVert v_m - v_n\rVert < \varepsilon \quad\text{for all sufficiently large } m, n.
The beauty of the Cauchy condition is that it only mentions the terms themselves — you can check it
without knowing the limit in advance. A space is complete when this internal
bunching-up is enough to guarantee an actual limit inside the space:
-
A Hilbert space \mathcal H is an inner-product space
that is complete: every Cauchy sequence in
\mathcal H converges to a limit that also lies in
\mathcal H.
-
Equivalently, \mathcal H has no holes — there is no
"missing point" that a sequence of its vectors can approach without ever reaching.
-
Every finite-dimensional inner-product space is automatically complete; completeness is only a
genuine new demand when the dimension is infinite.
The rational-number analogy
You have already met an incomplete space and a complete one, back on the number line. The
rationals \mathbb{Q} are riddled with holes. Consider
the sequence
1,\; 1.4,\; 1.41,\; 1.414,\; 1.4142,\; \ldots
Every term is a perfectly good fraction, and the terms crowd together — it is Cauchy. Yet its limit
is \sqrt 2, which is not rational. The sequence heads straight for
a gap in \mathbb{Q} and falls through it. The real numbers
\mathbb{R} are exactly the repair: you fill in every such limit, and the
result is complete — the seamless line. A Hilbert space is this same completion idea, done
for whole spaces of functions or states instead of single numbers. Where an inner-product space might
have gaps, its Hilbert-space completion plugs them all.
Why quantum mechanics needs completeness
Here is the reason a physicist cares. In an infinite-dimensional space you build the object you want
as a series — a limit of partial sums. A quantum state is written as an infinite superposition over
an orthonormal basis; a wavefunction is reconstructed from its Fourier components term by term. Each
partial sum is a legitimate vector, and the partial sums form a Cauchy sequence. Only in a
complete space is the limit guaranteed to be a state that exists. Without completeness, you
could write down a convergent-looking superposition whose "sum" is not actually a member of your
space — and the whole edifice of expansions, measurements, and probabilities would rest on sand.
The slider below adds more and more terms of a Fourier series. Watch the wiggly partial sum
S_n(x) home in on the smooth target curve. Each partial sum is a finite,
harmless trigonometric polynomial; the terms bunch together (Cauchy); and because the relevant space
is complete, the limit they close in on is a genuine member of it. That guarantee is what
makes "sum up infinitely many pieces" a safe operation.
A faint target function and the partial sum of its Fourier series. Adding terms (slide right) pulls the
partial sum ever closer to the target — a Cauchy sequence of vectors converging, safely, to a limit
inside a complete (Hilbert) space.
The two headline examples
Almost every Hilbert space you meet is one of two prototypes, or is built from them.
1. Square-summable sequences, \ell^2. Its vectors are
infinite lists of numbers (x_1, x_2, x_3, \ldots) whose squares add up to
something finite, \sum_i |x_i|^2 < \infty. The inner product is the obvious
infinite dot product \langle x, y\rangle = \sum_i \overline{x_i}\,y_i. This
is the natural home of a state expressed by its coordinates in a countable orthonormal
basis.
2. Square-integrable functions, L^2[a,b]. Its vectors are
functions with \int_a^b |f(x)|^2\,dx < \infty (finite "energy"), and the
inner product is the integral \langle f, g\rangle = \int_a^b \overline{f(x)}\,g(x)\,dx
you already know. This is the home of the wavefunction
\psi(x): the condition \int |\psi|^2\,dx = 1 that
makes total probability equal to one is literally the statement that \psi
is a unit vector in L^2.
Remarkably, these two are secretly the same space: choosing an orthonormal basis of
L^2 (say the Fourier modes) turns each function into its list of
coordinates, a member of \ell^2. Every separable infinite-dimensional
Hilbert space is isomorphic to \ell^2 — there is, up to relabelling, only
one.
Worked example — is this sequence Cauchy, and where does it live?
Take the sequence of vectors in \ell^2 that switches on one coordinate at
a time with shrinking weight:
v_n = \left(1, \tfrac12, \tfrac13, \ldots, \tfrac1n, 0, 0, \ldots\right).
The gap between the m-th and n-th terms
(m > n) is
\lVert v_m - v_n\rVert^2 = \sum_{k=n+1}^{m} \frac{1}{k^2}.
Because \sum 1/k^2 converges (to
\pi^2/6), that tail can be made as small as we like by taking
n large — so the sequence is Cauchy. Since
\ell^2 is complete, the limit exists in
\ell^2: it is the full list
\left(1, \tfrac12, \tfrac13, \ldots\right), whose squared norm
\sum 1/k^2 = \pi^2/6 is finite, so it is a legal vector. No hole; the
completion catches it. (Try the same construction with the harmonic weights
1/\sqrt{k} and the tail \sum 1/k diverges — the
sequence is not Cauchy and never settles.)
David Hilbert (1862–1943) was the towering German mathematician of the turn of the twentieth century,
the man whose 1900 list of 23 problems set the agenda for a hundred years of research. The spaces bear
his name because they crystallised out of his work (and that of his student Erhard Schmidt) on
integral equations, where infinite systems of coordinates first demanded a rigorous notion of
"length" and "convergence." The tidy axiomatic definition we use today was written down by John
von Neumann in the late 1920s — and he did it expressly to give the brand-new quantum mechanics a
firm mathematical floor to stand on. When Heisenberg's matrices and Schrödinger's waves turned out to
be two descriptions of the same physics, the reason was that both are just different orthonormal-basis
views of vectors in one Hilbert space.
Cauchy is not the same as "the terms go to zero." A sequence can have consecutive
terms that get closer and closer and still not be Cauchy. The classic trap is the harmonic
series: the partial sums 1 + \tfrac12 + \tfrac13 + \cdots + \tfrac1n have
steps 1/n \to 0, yet the sums march off to infinity and never bunch up.
Cauchy demands that all pairs v_m, v_n beyond some point are
close, not merely neighbours — a much stronger requirement.
And the second warning: completeness is a property of the space, not of the sequence.
The very same Cauchy sequence 1, 1.4, 1.41, \ldots converges in
\mathbb{R} but fails to converge in \mathbb{Q}.
Nothing about the sequence changed — what changed is whether the destination is included. "Is it a
Hilbert space?" is therefore always a question about which limit-points the space bothers to contain.