© 2026 NeckPinch · www.neckpinch.com · All rights reserved.
Course 6Book 6A: The Heat Equation and Its RelativesChapter 4
Fourier Methods and Scale Space
Fourier's own method on the circle and the line, smoothing as the decay of high frequencies, and the heat equation as the mathematics of blurring images.
Read with Stein and Shakarchi, Fourier Analysis: An Introduction, chapter 4 (applications of Fourier series, including the heat equation on the circle) and chapter 6 (the Fourier transform on and the heat equation there), and with Lindeberg's Scale-Space Theory in Computer Vision (1994), chapters 1–2, for the image-processing side. The Fourier transform itself is 4A.6 The Fourier Transform; Fourier series on the ring are 2B.7 Fourier Series and the First Heat Equation.
In this chapter · 10 sections
- 4.1Frequencies decay independently
- 4.2Smoothing is the decay of high frequencies
- 4.3The circle and the torus: two formulas for one kernel
- 4.4Intervals: sines, cosines and boundary conditions
- 4.5Fractional and anomalous diffusion
- 4.6Scale space: the heat equation in computer vision
- 4.7Nonlinear diffusion: smoothing that respects edges
- 4.8The Ricci flow, seen from the Fourier side
- 4.9History
- 4.10Exercises
- ↗Free resources
6A.3 The Heat Equation on ℝⁿ solved the heat equation on by one formula, convolution with the heat kernel. This chapter looks at the same solutions from the other side, the side of frequencies. On the Fourier side the heat equation is diagonal: each frequency decays by itself, at the rate , independently of all the others. Almost every property of the heat flow becomes a one-line statement about the multiplier : smoothing is the decay of high frequencies, the approach to equilibrium on a compact space is the decay of the lowest nonzero frequency, backward ill-posedness is the explosion of high frequencies, and the parabolic scaling , is the statement that is the only combination that matters.
The second half of the chapter is about a use of the heat equation that most people meet every day without knowing it. Blurring a digital photograph by a Gaussian is running the heat equation for a time proportional to the square of the blur radius, and in the 1980s computer vision built on this a whole theory, scale space, in which an image is replaced by the family of all its heat-flow smoothings. The maximum principle of 6A.5 Maximum Principles becomes a design requirement ("blurring must not create new features"), the Gaussian turns out to be the only kernel that satisfies it, and the failures of linear smoothing at edges led to nonlinear diffusions that are close relatives of the geometric flows of 6A.10 Curve Shortening and the First Geometric Flows, including flows by curvature. The chapter ends by reading the Ricci flow in the same Fourier terms: its linearisation is a heat equation for the metric, apart from the directions that diffeomorphisms move, which is the frequency-side picture of DeTurck's trick.
By the end of this chapter you will be able to:
- solve the heat equation on and on the torus with the Fourier transform and Fourier series, and read off smoothing, decay and uniqueness from the multiplier ;
- prove the Sobolev smoothing estimate and explain the exponent;
- write the heat kernel of the circle and of the torus in two ways, as a Fourier series and as a periodised Gaussian, and explain why they agree;
- solve the heat equation on an interval with Dirichlet or Neumann conditions by sine and cosine series, and compute the rate of approach to equilibrium;
- describe fractional and anomalous diffusion as Fourier multipliers, and where they occur;
- explain linear scale space, the causality axiom, why the Gaussian is forced, and the Laplacian-of-Gaussian and difference-of-Gaussians detectors;
- describe the Perona–Malik equation, total variation flow and curvature-based image smoothing, and their relation to the maximum principle and to geometric flows;
- explain, on the Fourier side, why the Ricci flow is a heat equation for the metric except in the gauge directions.
Frequencies decay independently
With the normalisation of 4A.6 The Fourier Transform, differentiation becomes multiplication: and . Transforming the heat equation in gives, for each , the ordinary differential equation , whose solution is
6A.3 The Heat Equation on ℝⁿ inverted this to find the heat kernel: the inverse transform of a Gaussian is a Gaussian, and multiplication on the Fourier side is convolution on the space side. Here we stay on the Fourier side and ask what the multiplier says.
The heat semigroup is a Fourier multiplier. Write for the solution at time . Then with . Three properties of translate into three properties of the flow.
- , so by Plancherel : the flow does not increase the norm. It is a contraction.
- : the semigroup law , which on the space side is .
- as for each , and dominated convergence gives in : the flow starts where it should.
Energy and uniqueness. By Plancherel, , which is nonincreasing in , and
the energy identity of 6A.3 The Heat Equation on ℝⁿ in Fourier form. A solution in with has for all ; this is uniqueness among solutions, without any growth condition at infinity beyond square integrability. (Tychonoff's nonunique solution of 6A.3 The Heat Equation on ℝⁿ is not square integrable at positive times: it grows faster than any Gaussian, and its Fourier transform does not exist as a function.)
Smoothing is the decay of high frequencies
On the Fourier side, smoothness is decay: a function has derivatives in exactly when (4A.10 Sobolev Spaces). Define the homogeneous Sobolev seminorms
so that and .
For there is such that every solution with satisfies
One may take .
Proof. Write . Then
The bracket is , with the supremum of over , attained at . Integrate over .
The exponent is the parabolic counting that recurs throughout the book: one space derivative costs a factor , the square root of the time, because time scales like length squared. 6A.3 The Heat Equation on ℝⁿ proved the pointwise version, , by differentiating the kernel. Shi's estimates for the Ricci flow (11A.5 Shi's Derivative Estimates) are the same statement for the curvature tensor, , proved by the maximum principle because the Ricci flow has no Fourier transform; but the exponent is the one the multiplier gives.
Why backward is hopeless. Running the equation backward multiplies frequency by . Unless decays faster than every Gaussian, the result is not in for any ; and even when it is, an error of size at frequency grows to . This is the frequency-side form of the ill-posedness proved in 6A.1 What a PDE Is, and the reason the conjugate heat equation in Perelman's work is always solved backward in time, from a final condition, where for it the problem is well posed (9B.7 The Heat Equation on a Manifold).
The circle and the torus: two formulas for one kernel
On the circle , 2B.7 Fourier Series and the First Heat Equation solved the heat equation by Fourier series, as Fourier himself did:
Exchanging the sum and the integral writes with the heat kernel of the circle
On the other hand, the circle is the line modulo translations by integers, and a solution of the heat equation on that is periodic is a solution on . Periodising the Gaussian gives a second formula:
The two agree by the Poisson summation formula for a Schwartz function (4A.6 The Fourier Transform), applied to the Gaussian , whose transform is .
The two formulas are good at opposite ends of time. For small the Gaussian sum is dominated by its term: the kernel is nearly the Euclidean one, because heat has not yet had time to feel that the space closes up. For large the Fourier sum is dominated by and :
so heat equilibrates to its mean at the rate , the rate of the first nonzero eigenvalue of on the circle. The same duality between short-time geometry and long-time spectrum governs the heat kernel of any closed manifold (9B.7 The Heat Equation on a Manifold): the small-time expansion of the heat trace sees volume and curvature, the large-time behaviour sees the spectral gap. The identity between the two formulas, the Jacobi theta identity, is the simplest instance of a deep link between heat kernels and number theory.
On the torus everything factorises: , and the spectral gap is still , attained by the frequencies . Flat tori of other shapes, for a lattice , have kernels , and their spectra are , with the dual lattice. Two flat tori with the same spectrum are said to be isospectral; Milnor found in 1964 two sixteen-dimensional flat tori that are isospectral but not isometric, the first answer, in the negative, to the question "can one hear the shape of a drum?" in a closed setting (9B.7 The Heat Equation on a Manifold).
Intervals: sines, cosines and boundary conditions
On an interval the boundary conditions select which frequencies are allowed.
- Dirichlet ( at both ends, the ends held at temperature zero). The eigenfunctions of are , , with eigenvalues , and
Every solution decays to zero, at the rate of the first mode.
- Neumann ( at both ends, insulated ends, 6A.1 What a PDE Is). The eigenfunctions are , , and the mode is the constant, which does not decay: , the mean, conserved because no heat leaves. The approach is at the rate again.
The method is the odd and even reflection of the circle: extending oddly about and periodically with period produces a function on a circle of length whose series contains only sines, and the flow preserves oddness, so it vanishes at and for all time. In both cases the time to equilibrate is of order : doubling the length of a rod quadruples the time it takes to even out. This is Einstein's law of 6A.3 The Heat Equation on ℝⁿ again, read off from the lowest eigenvalue.
For a general bounded domain the eigenfunctions of the Dirichlet Laplacian are no longer explicit, but they exist and form an orthonormal basis of (the spectral theorem for the compact inverse, 4A.8 Compact Operators and Spectra, 6B.15 Spectral Theory and Heat Trace Asymptotics), and the solution is the same kind of series. The first eigenfunction is positive (6A.6 Weak Solutions and Elliptic Regularity), and solutions become proportional to it for large time: a hot object of any shape cools, after a while, in the shape of its first eigenfunction.
Fractional and anomalous diffusion
Replacing the multiplier by , , defines the fractional heat equation . Its kernel is the density of a symmetric -stable Lévy process, a random motion with occasional long jumps; it is positive (by a theorem of Bochner, since is positive definite for ), but has heavy tails, decaying like instead of like a Gaussian. Its scaling is instead of : superdiffusion. The case is the Poisson kernel of the half-space, : the harmonic extension of to the upper half-space, evaluated at height (6A.2 Harmonic Functions).
Anomalous diffusion is observed: tracer particles in turbulent flows, the foraging paths of some animals, and the spread of some contaminants in heterogeneous porous media have been modelled with Lévy-type processes and fractional equations, though how well such models fit is debated case by case. None of this enters the Ricci flow, whose diffusion is genuinely second order; but it shows that what makes the heat equation special is the exponent , which is the only exponent compatible with locality (a differential operator) and with positivity of the kernel at the same time.
Scale space: the heat equation in computer vision
A digital image is a function on a grid, sampled from an intensity on a plane region. To find its features (edges, blobs, corners) at all sizes at once, Andrew Witkin (1983) and Jan Koenderink (1984) proposed replacing by the whole family of its smoothings
the scale-space representation: solves the heat equation with , and the scale parameter corresponds to a blur radius , the standard deviation of the Gaussian . Fine structure lives at small , coarse structure at large , and moving from fine to coarse is running the heat equation.
Why the Gaussian. Koenderink asked what a smoothing should satisfy to deserve the name, and listed requirements: it should be linear, shift-invariant and rotation-invariant; it should form a semigroup in the scale parameter (smoothing by then by is smoothing by ); and it should satisfy causality: going to a coarser scale must never create new structure. For level sets, causality means that a new local maximum cannot appear as increases, and Koenderink observed that this is exactly what a parabolic maximum principle provides: if satisfies , then at a spatial maximum , so , and maxima can only decrease (6A.5 Maximum Principles). Requiring causality for every image forces the generator of the semigroup to be a second-order elliptic operator, and the symmetry requirements make it the Laplacian: the heat equation is the only linear scale space. Babaud, Witkin, Baudin and Duda (1986) proved the one-dimensional form precisely: among smoothing kernels, the Gaussian is the only one for which the number of zero crossings of the second derivative (inflection points of the signal) never increases with scale.
There is a subtlety that the maximum principle makes precise. In one dimension the heat flow cannot create new local extrema of the signal (a consequence of the maximum principle applied to , which also solves the heat equation, combined with the fact that the number of sign changes of a solution of the one-dimensional heat equation does not increase, a theorem going back to Sturm). In two dimensions new local extrema can appear under Gaussian smoothing: Lifshitz and Pizer (1990) gave examples. Causality survives in the weaker form that matters: no new level curve can appear from nothing, because a closed level curve enclosing a new maximum would need at that maximum.
Detectors from derivatives. Features are defined through derivatives of , and the scale is chosen by normalising them. David Marr and Ellen Hildreth (1980) located edges at the zero crossings of , the Laplacian of Gaussian, motivated in part by the centre–surround receptive fields of retinal ganglion cells. Since , the Laplacian of Gaussian is approximately the difference of two Gaussians at nearby scales,
which is cheap to compute: the heat equation itself tells you that blurring twice and subtracting gives the Laplacian. David Lowe's SIFT detector (2004), used for years in image matching, panorama stitching and robot navigation, finds keypoints as extrema of the difference of Gaussians across both space and scale. Blob detection with the scale-normalised Laplacian (Lindeberg) selects, for each blob, the scale at which is extremal, and that scale is proportional to the square of the blob's size: parabolic scaling, again.
Nonlinear diffusion: smoothing that respects edges
Linear scale space blurs edges as much as noise, because the Laplacian is isotropic: it does not know which way an edge runs. In 1990 Pietro Perona and Jitendra Malik proposed letting the diffusion coefficient depend on the image itself,
so that diffusion is strong where the gradient is small (inside regions, removing noise) and weak where it is large (across edges, preserving them). Writing the equation in a frame aligned with the gradient shows what it does: along the level curves the diffusion coefficient is , but across them it is , which is negative for . So the equation is a forward heat equation along edges and a backward heat equation across steep ones. That sharpens edges, which is what was wanted, but it also makes the problem ill-posed in the sense of 6A.1 What a PDE Is: small perturbations can grow, and the continuous equation has no well-behaved solutions in general (it develops "staircasing" under discretisation). Catté, Lions, Morel and Coll (1992) regularised it by computing the coefficient from a Gaussian-smoothed gradient, which restores well-posedness.
Two other lines of work keep the maximum principle intact.
- Total variation flow. Leonid Rudin, Stanley Osher and Emad Fatemi (1992) denoised images by minimising the total variation plus a fidelity term. Its gradient flow, , is degenerate but not backward: it is the gradient flow of a convex functional (6A.11 Calculus of Variations and Gradient Flows), preserves the maximum principle, and allows jumps in , which is why it keeps edges sharp. The quantity is the curvature of the level sets of .
- Curvature motion of level sets. Luis Alvarez, Pierre-Louis Lions and Jean-Michel Morel (1992), and Alvarez, Guichard, Lions and Morel's axiomatic study (1993), showed that the image smoothings that are contrast-invariant (unchanged by relabelling the grey levels monotonically) and satisfy the scale-space axioms are generated by equations of the form , where is the curvature of the level curves. The simplest, , moves every level curve by the curve shortening flow of 6A.10 Curve Shortening and the First Geometric Flows; the affine-invariant one, , is the affine curve shortening of Sapiro and Tannenbaum. Such equations are fully nonlinear and degenerate; their solutions are defined as viscosity solutions (6C.9 Hamilton–Jacobi Equations and Viscosity Solutions).
So the practical demand of smoothing images without destroying them leads, by a short chain of reasoning, to the same geometric flows that this book develops as mathematics: the heat equation, curvature flows of curves, and the maximum principle as the organising idea.
The "Gaussian blur" filter of image software is a discrete heat flow: convolution with a sampled Gaussian of standard deviation pixels, which is the heat equation run for time . Because the Gaussian factorises, , a two-dimensional blur is done as two one-dimensional ones, rows then columns, which is the product formula for the heat kernel of 6A.3 The Heat Equation on ℝⁿ. And because of the semigroup law, a large blur can be built from repeated small ones, adding like variances. Real optical defocus is not Gaussian (an out-of-focus lens blurs a point into a disc, whose Fourier transform has zeros), which is why deblurring photographs is harder than inverting a heat flow, and why the backward heat equation of 6A.1 What a PDE Is is the textbook model of an ill-posed inverse problem.
The Ricci flow, seen from the Fourier side
The Ricci flow has no Fourier transform, but its linearisation at a flat metric does, and that linearisation explains the role of every tool of Book 11A. Linearise at the Euclidean metric: write with small, and keep terms linear in . The variation formula of 11A.2 How Curvature Evolves gives
Transform in : with a symmetric matrix for each frequency,
The matrix in brackets is the symbol of the linearised Ricci operator (11A.4 Short-Time Existence and Uniqueness, 6C.12 Quasilinear Parabolic Systems). On most symmetric matrices it acts like , so those components decay like the heat equation. But on the matrices , for any vector , the bracket vanishes (Exercise 4.6): these components do not decay at all. They are the infinitesimal changes of coordinates, the Fourier transforms of the Lie derivatives , and the Ricci flow cannot see them because a diffeomorphism changes nothing geometric. DeTurck's trick (11A.4 Short-Time Existence and Uniqueness) adds a Lie-derivative term , with built from first derivatives of , whose symbol is exactly what is missing in these directions: the symbol of the modified flow is times the identity on all symmetric matrices, and the modified flow is a genuine heat equation for the metric. Short-time existence of the Ricci flow is, at the level of frequencies, the statement that after fixing coordinates every component of the metric diffuses.
The other Fourier fact that runs through Perelman's work is the Gaussian itself. The Gaussian is the fixed point of the Fourier transform (up to scaling), the heat kernel, the extremal function of the log-Sobolev inequality (6A.12 Entropy, Information and Diffusion), and the density at which Perelman's entropy vanishes on flat space (12A.3 The 𝓦-Entropy). That one function plays all these roles is not a coincidence: they are all expressions of the fact that is both the heat multiplier and a Gaussian.
6A.5 Maximum Principles proves the maximum principles that make scale space causal and the Ricci flow controllable. 6A.12 Entropy, Information and Diffusion meets the Gaussian again as the extremal of the log-Sobolev inequality. 6C.12 Quasilinear Parabolic Systems uses the symbol to prove short-time existence for parabolic systems, and 11A.4 Short-Time Existence and Uniqueness applies it, with DeTurck's trick, to the Ricci flow. 11A.12 Ricci Flow on Surfaces meets discrete conformal flows on surfaces, used in geometry processing like the diffusions of this chapter.
History
Joseph Fourier solved the heat equation by trigonometric series in his memoir of 1807 and in Théorie analytique de la chaleur (1822). Poisson's summation formula dates from the 1820s and Jacobi's theta identity from 1828. Bochner characterised positive-definite functions in 1932, and Lévy introduced stable laws in the 1920s. Marr and Hildreth's theory of edge detection appeared in 1980, Witkin's scale-space filtering in 1983 and Koenderink's "The structure of images" in 1984; Babaud, Witkin, Baudin and Duda proved the uniqueness of the Gaussian kernel in 1986. Perona and Malik introduced anisotropic diffusion in 1990, Rudin, Osher and Fatemi total variation denoising in 1992, and Alvarez, Lions and Morel curvature-based smoothing in 1992. Lowe's SIFT descriptor was published in 2004. Milnor's isospectral tori appeared in 1964.
On the Fourier side the heat equation is : a contraction, a semigroup, with energy identity and uniqueness among solutions. Smoothing is decay of high frequencies, , the parabolic counting behind Shi's estimates; backward flow multiplies by and explodes. On the circle the kernel is a Fourier series and a periodised Gaussian at once (Poisson summation), equilibrating at the rate of the spectral gap; on intervals, Dirichlet and Neumann conditions select sines and cosines, and equilibration takes a time of order . Fractional multipliers give heavy-tailed, superdiffusive kernels. In computer vision the heat flow is linear scale space, forced by causality, the maximum principle as a design rule; Laplacian-of-Gaussian and difference-of-Gaussians detectors come from . Perona–Malik is backward across edges and ill-posed; total variation flow and curvature motion of level sets keep the maximum principle and lead to curve shortening. The linearised Ricci flow's symbol is except on the gauge directions , which DeTurck's trick damps. 6A.5 Maximum Principles develops the maximum principle.
Exercises
Let solve the heat equation on with initial data of mean zero. Show that , and that equality holds for all exactly when is a combination of the modes .
Solution
By Parseval on the torus, , since (mean zero). For , , so each term is at most , and . Equality for some forces whenever , that is, is supported on the frequencies , the modes ; conversely those modes decay exactly at the rate .
Show that the constant in Proposition 4.1 is sharp: for and any , find data with arbitrarily close to . (Hint: concentrate near a sphere with .)
Solution
If is supported in a thin shell , then on that shell , so . With this is , and choosing , where attains its maximum , gives the bound up to an error that vanishes as .
Using the two formulas for the heat kernel of the circle, show that as and as . Deduce the identity for .
Solution
Gaussian form at : . Fourier form: . Equating the two forms with : , Jacobi's identity for the theta function , which says .
Solve on with and . Find the limit as and the rate of approach, and check that is constant.
Solution
The cosine coefficients of on : , and for , , which is for odd and for even . So . As , , the mean, at the rate of the mode. for all , since each cosine with integrates to zero; directly, .
Show that the matrix vanishes when for any vector , and that it equals when is trace-free and . Interpret the two cases.
Solution
For : and . Then , which cancels exactly: the symbol is zero. These are the Fourier transforms of , infinitesimal diffeomorphisms, which the Ricci flow does not damp. If is trace-free with (transverse, trace-free: the "physical" part), the last three terms vanish and the symbol is : these components evolve by the heat equation. (For gravitational waves, the analogous transverse trace-free part is what propagates.)
(a) Show that uniformly, and compute in two dimensions. (b) For a blob (a Gaussian of variance parameter ), show that the scale-normalised Laplacian of its scale space is extremal at . So the selected scale equals the blob's own scale.
Solution
(a) By Taylor's theorem in and : , uniformly in for bounded away from . In two dimensions and : negative in the centre, positive outside, the "Mexican hat". (b) by the semigroup law, so , and . Its derivative in vanishes where , at , where is largest.
Free resources for this chapter
Chosen for what this chapter covers, and all free to read. Links checked Oct 16, 2026.
- Notes Lectures 16–18: Introduction to the Fourier transform; Fourier inversion and Plancherel’s theoremMIT OpenCourseWare 18.152 Introduction to PDEs (Fall 2011)The Fourier transform, inversion and Plancherel, with the heat equation as an application.
- Reference Poisson summation formulaWikipediaWhy the circle’s heat kernel is both a Fourier series and a periodised Gaussian.
- Reference Scale spaceWikipediaLinear scale space, its axioms and the uniqueness of the Gaussian kernel.
- Reference Anisotropic diffusionWikipediaThe Perona–Malik equation and its regularisations.
- Reference Total variation denoisingWikipediaThe Rudin–Osher–Fatemi model.
© 2026 NeckPinch (www.neckpinch.com). All content in the guidebook (text, mathematics, figures and exercises) is protected by copyright. All rights reserved. No part may be copied, republished or redistributed without written permission.