Forward and Inverse Problems

Point a camera at the night sky and you can compute, ahead of time, exactly where every pixel of starlight will land — given the lens, the exposure, the atmosphere. That prediction is easy, mechanical, reliable. But now flip the question. You are handed a blurry photograph and asked: what did the sharp scene look like before the lens smeared it? Suddenly the problem is treacherous — and it is the very same problem that lets a CT scanner see a tumour, an oil company map rock a mile underground, and a geophysicist chart the molten heart of the Earth.

This split — the easy direction and the hard direction — is one of the great organizing ideas of applied mathematics. Predicting the effect from a known cause is the forward problem. Reconstructing the hidden cause from the observed effect is the inverse problem. Nature runs forward for free; scientists get paid to run it backward.

The two directions, precisely

Every measurement is the end of a chain of cause and effect. The forward problem walks that chain forwards: from a complete description of the world — the model m (the parameters: densities, positions, the sharp image) — predict what an instrument will record — the data d. We write the forward map as

d = G(m).

The forward map G is a simulation: it encodes the physics, and given m it hands you d with no ambiguity. Solve the differential equations, add up the contributions, blur the picture — turn the crank and out comes a prediction.

The inverse problem is the scientist's real task: you have the data d and want the model m that produced it. You must undo the forward map — recover the cause from the effect.

m = G^{-1}(d) \quad\text{(if only it were this simple).}

Reconstruct the body from its X-ray shadows, the seabed from sonar echoes, the sharp image from the blurred one, the underground density from the gravity you measure at the surface. When G happens to be a matrix, this whole enterprise collapses into a single linear system — the workhorse formulation you will meet next in the linear inverse problem.

Worked examples: which way is the arrow pointing?

The single most useful skill early on is simply spotting the direction. In each pair below, the forward problem is the honest simulation; the inverse problem is the one worth a Nobel Prize.

Notice the pattern: the forward problem is a function evaluation and the inverse is an equation to be solved — and equations, unlike evaluations, can have zero solutions, one solution, or infinitely many.

Why running the chain backwards is hard

Forward problems are usually well-behaved: plug in m, turn the crank, out comes d. Inverse problems fight back in three ways, all of which we will meet:

The deep reason behind all three is that the forward map usually smooths and loses information. Blurring averages neighbouring pixels together; gravity blends the pull of deep rock with shallow rock; an X-ray records only a sum along its path. Averaging is a one-way street — once you have added things up, you cannot always tell what you added. So the inverse must un-average, and un-averaging is exactly the operation that amplifies the tiny wiggles of measurement noise. That tension — smoothing forward, amplifying backward — is pursued in ill-posed problems and noise.

The simplest taste of non-uniqueness: a forward map that is not one-to-one. If d = m^2, then a single measured d has two possible causes, m = \pm\sqrt{d} — the data alone cannot choose between them.

One datum, two causes

The curve is a forward map d = G(m) = m^2; the horizontal line is a measured data value d. Slide it: wherever the line crosses the curve is a model consistent with the data — and it almost always crosses twice. That ambiguity, in far subtler forms, is what regularization and priors will later resolve.

It is tempting to declare an inverse problem "solved" the moment a formula for G^{-1} exists on paper. Beware: solvable in principle is not solvable in practice.

The forward map may destroy so much information that vast families of very different causes produce data that is nearly identical — differing only by amounts smaller than your measurement noise. Your instrument literally cannot tell them apart. The clean inversion formula, fed real (noisy) data, then latches onto the noise and returns a confident, precise, and completely wrong answer. A million-dollar reconstruction algorithm that hallucinates tumours is worse than useless. The existence of an inverse is a mathematical fact; the reliability of the inverse against noise is an entirely separate — and far harder — question, and it is what the rest of this subject is really about.

Nobody has ever drilled more than about 12 km down — a scratch on a 6371 km ball. So how do we know the Earth has a solid inner core sloshing inside a liquid outer core? We solved an inverse problem. Every large earthquake sends waves rippling right through the planet, and seismometers worldwide record exactly when each wave arrives. The forward problem is easy: given the interior structure, predict the arrival times. Geophysicists ran it backward — adjusting the interior until the predicted arrivals matched the real ones — and out popped a cross-section of a world no one can visit. This is seismic tomography, and it revealed the core, the mantle's hidden plumes, and the graveyards of ancient sunken tectonic plates.

The medical version won a Nobel Prize in 1979: Cormack and Hounsfield showed how to reconstruct a 2-D slice of the body from X-ray shadows taken all around it — the same "assemble a picture from its projections" inverse problem, just with X-rays instead of earthquakes. The CT scanner it produced reshaped medicine. The moral: the inverse problem is not an obscure curiosity — it is the instrument through which we see the things we cannot reach.