Book 6A

© 2026 NeckPinch · www.neckpinch.com · All rights reserved.

Course 6Book 6A: The Heat Equation and Its RelativesChapter 4

Fourier Methods and Scale Space

Fourier's own method on the circle and the line, smoothing as the decay of high frequencies, and the heat equation as the mathematics of blurring images.

40 min read · Updated Oct 23, 2026

Read with Stein and Shakarchi, Fourier Analysis: An Introduction, chapter 4 (applications of Fourier series, including the heat equation on the circle) and chapter 6 (the Fourier transform on Rd\mathbb{R}^d and the heat equation there), and with Lindeberg's Scale-Space Theory in Computer Vision (1994), chapters 1–2, for the image-processing side. The Fourier transform itself is 4A.6 The Fourier Transform; Fourier series on the ring are 2B.7 Fourier Series and the First Heat Equation.

In this chapter · 10 sections
  1. 4.1Frequencies decay independently
  2. 4.2Smoothing is the decay of high frequencies
  3. 4.3The circle and the torus: two formulas for one kernel
  4. 4.4Intervals: sines, cosines and boundary conditions
  5. 4.5Fractional and anomalous diffusion
  6. 4.6Scale space: the heat equation in computer vision
  7. 4.7Nonlinear diffusion: smoothing that respects edges
  8. 4.8The Ricci flow, seen from the Fourier side
  9. 4.9History
  10. 4.10Exercises
  11. ↗Free resources

6A.3 The Heat Equation on ℝⁿ solved the heat equation on Rn\mathbb{R}^n by one formula, convolution with the heat kernel. This chapter looks at the same solutions from the other side, the side of frequencies. On the Fourier side the heat equation is diagonal: each frequency ξ\xi decays by itself, at the rate 4π2∣ξ∣24\pi^2|\xi|^2, independently of all the others. Almost every property of the heat flow becomes a one-line statement about the multiplier e−4π2t∣ξ∣2e^{-4\pi^2t|\xi|^2}: smoothing is the decay of high frequencies, the approach to equilibrium on a compact space is the decay of the lowest nonzero frequency, backward ill-posedness is the explosion of high frequencies, and the parabolic scaling x↦λxx \mapsto \lambda x, t↦λ2tt \mapsto \lambda^2t is the statement that t∣ξ∣2t|\xi|^2 is the only combination that matters.

The second half of the chapter is about a use of the heat equation that most people meet every day without knowing it. Blurring a digital photograph by a Gaussian is running the heat equation for a time proportional to the square of the blur radius, and in the 1980s computer vision built on this a whole theory, scale space, in which an image is replaced by the family of all its heat-flow smoothings. The maximum principle of 6A.5 Maximum Principles becomes a design requirement ("blurring must not create new features"), the Gaussian turns out to be the only kernel that satisfies it, and the failures of linear smoothing at edges led to nonlinear diffusions that are close relatives of the geometric flows of 6A.10 Curve Shortening and the First Geometric Flows, including flows by curvature. The chapter ends by reading the Ricci flow in the same Fourier terms: its linearisation is a heat equation for the metric, apart from the directions that diffeomorphisms move, which is the frequency-side picture of DeTurck's trick.

By the end of this chapter you will be able to:

  • solve the heat equation on Rn\mathbb{R}^n and on the torus with the Fourier transform and Fourier series, and read off smoothing, decay and uniqueness from the multiplier e−4π2t∣ξ∣2e^{-4\pi^2t|\xi|^2};
  • prove the Sobolev smoothing estimate ∥u(t)∥H˙s≤Cst−(s−r)/2∥g∥H˙r\|u(t)\|_{\dot H^s} \leq C_st^{-(s - r)/2}\|g\|_{\dot H^r} and explain the exponent;
  • write the heat kernel of the circle and of the torus in two ways, as a Fourier series and as a periodised Gaussian, and explain why they agree;
  • solve the heat equation on an interval with Dirichlet or Neumann conditions by sine and cosine series, and compute the rate of approach to equilibrium;
  • describe fractional and anomalous diffusion as Fourier multipliers, and where they occur;
  • explain linear scale space, the causality axiom, why the Gaussian is forced, and the Laplacian-of-Gaussian and difference-of-Gaussians detectors;
  • describe the Perona–Malik equation, total variation flow and curvature-based image smoothing, and their relation to the maximum principle and to geometric flows;
  • explain, on the Fourier side, why the Ricci flow is a heat equation for the metric except in the gauge directions.

Frequencies decay independently

With the normalisation g^(ξ)=∫g(x)e−2πix⋅ξ dx\hat g(\xi) = \int g(x)e^{-2\pi ix\cdot\xi}\,dx of 4A.6 The Fourier Transform, differentiation becomes multiplication: ∂jg^(ξ)=2πiξjg^(ξ)\widehat{\partial_jg}(\xi) = 2\pi i\xi_j\hat g(\xi) and Δg^(ξ)=−4π2∣ξ∣2g^(ξ)\widehat{\Delta g}(\xi) = -4\pi^2|\xi|^2\hat g(\xi). Transforming the heat equation ut=Δuu_t = \Delta u in xx gives, for each ξ\xi, the ordinary differential equation ∂tu^(ξ,t)=−4π2∣ξ∣2u^(ξ,t)\partial_t\hat u(\xi, t) = -4\pi^2|\xi|^2\hat u(\xi, t), whose solution is

u^(ξ,t)=e−4π2t∣ξ∣2g^(ξ).\hat u(\xi, t) = e^{-4\pi^2t|\xi|^2}\hat g(\xi).

6A.3 The Heat Equation on ℝⁿ inverted this to find the heat kernel: the inverse transform of a Gaussian is a Gaussian, and multiplication on the Fourier side is convolution on the space side. Here we stay on the Fourier side and ask what the multiplier says.

The heat semigroup is a Fourier multiplier. Write etΔge^{t\Delta}g for the solution at time tt. Then etΔg^=mtg^\widehat{e^{t\Delta}g} = m_t\hat g with mt(ξ)=e−4π2t∣ξ∣2m_t(\xi) = e^{-4\pi^2t|\xi|^2}. Three properties of mtm_t translate into three properties of the flow.

  • 0<mt≤10 < m_t \leq 1, so by Plancherel ∥etΔg∥L2≤∥g∥L2\|e^{t\Delta}g\|_{L^2} \leq \|g\|_{L^2}: the flow does not increase the L2L^2 norm. It is a contraction.
  • mtms=mt+sm_tm_s = m_{t+s}: the semigroup law etΔesΔ=e(t+s)Δe^{t\Delta}e^{s\Delta} = e^{(t+s)\Delta}, which on the space side is Φ(⋅,t)∗Φ(⋅,s)=Φ(⋅,t+s)\Phi(\cdot, t)*\Phi(\cdot, s) = \Phi(\cdot, t + s).
  • mt(ξ)→1m_t(\xi) \to 1 as t→0t \to 0 for each ξ\xi, and dominated convergence gives etΔg→ge^{t\Delta}g \to g in L2L^2: the flow starts where it should.

Energy and uniqueness. By Plancherel, ∫∣u(x,t)∣2 dx=∫e−8π2t∣ξ∣2∣g^(ξ)∣2 dξ\int|u(x, t)|^2\,dx = \int e^{-8\pi^2t|\xi|^2}|\hat g(\xi)|^2\,d\xi, which is nonincreasing in tt, and

ddt∫∣u∣2 dx=−8π2∫∣ξ∣2e−8π2t∣ξ∣2∣g^∣2 dξ=−2∫∣∇u∣2 dx,\frac{d}{dt}\int|u|^2\,dx = -8\pi^2\int|\xi|^2e^{-8\pi^2t|\xi|^2}|\hat g|^2\,d\xi = -2\int|\nabla u|^2\,dx,

the energy identity of 6A.3 The Heat Equation on ℝⁿ in Fourier form. A solution in L2L^2 with g=0g = 0 has u^=0\hat u = 0 for all tt; this is uniqueness among L2L^2 solutions, without any growth condition at infinity beyond square integrability. (Tychonoff's nonunique solution of 6A.3 The Heat Equation on ℝⁿ is not square integrable at positive times: it grows faster than any Gaussian, and its Fourier transform does not exist as a function.)

Smoothing is the decay of high frequencies

On the Fourier side, smoothness is decay: a function has ss derivatives in L2L^2 exactly when ∣ξ∣sg^∈L2|\xi|^s\hat g \in L^2 (4A.10 Sobolev Spaces). Define the homogeneous Sobolev seminorms

∥g∥H˙s2=∫(2π∣ξ∣)2s∣g^(ξ)∣2 dξ,\|g\|_{\dot H^s}^2 = \int(2\pi|\xi|)^{2s}|\hat g(\xi)|^2\,d\xi,

so that ∥g∥H˙1=∥∇g∥L2\|g\|_{\dot H^1} = \|\nabla g\|_{L^2} and ∥g∥H˙2=∥Δg∥L2\|g\|_{\dot H^2} = \|\Delta g\|_{L^2}.

Proposition 4.1 Sobolev smoothing

For s≥r≥0s \geq r \geq 0 there is Cs,rC_{s,r} such that every solution u=etΔgu = e^{t\Delta}g with g∈H˙rg \in \dot H^r satisfies

∥u(t)∥H˙s≤Cs,r t−(s−r)/2 ∥g∥H˙r(t>0).\|u(t)\|_{\dot H^s} \leq C_{s,r}\,t^{-(s - r)/2}\,\|g\|_{\dot H^r}\qquad (t > 0).

One may take Cs,r=sup⁡y>0y(s−r)/2e−y=(s−r2e)(s−r)/2C_{s,r} = \sup_{y > 0}y^{(s-r)/2}e^{-y} = \big(\frac{s - r}{2e}\big)^{(s-r)/2}.

Proof. Write a=4π2∣ξ∣2a = 4\pi^2|\xi|^2. Then

(2π∣ξ∣)2se−2at∣g^∣2=((2π∣ξ∣)2(s−r)e−2at)(2π∣ξ∣)2r∣g^∣2=((at)s−re−2at)t−(s−r)(2π∣ξ∣)2r∣g^∣2.(2\pi|\xi|)^{2s}e^{-2at}|\hat g|^2 = \big((2\pi|\xi|)^{2(s-r)}e^{-2at}\big)(2\pi|\xi|)^{2r}|\hat g|^2 = \Big((at)^{s-r}e^{-2at}\Big)t^{-(s-r)}(2\pi|\xi|)^{2r}|\hat g|^2.

The bracket is ((at)(s−r)/2e−at)2≤Cs,r2\big((at)^{(s-r)/2}e^{-at}\big)^2 \leq C_{s,r}^2, with Cs,rC_{s,r} the supremum of y(s−r)/2e−yy^{(s-r)/2}e^{-y} over y>0y > 0, attained at y=s−r2y = \frac{s - r}{2}. Integrate over ξ\xi.

The exponent s−r2\frac{s - r}{2} is the parabolic counting that recurs throughout the book: one space derivative costs a factor t−1/2t^{-1/2}, the square root of the time, because time scales like length squared. 6A.3 The Heat Equation on ℝⁿ proved the pointwise version, ∣∇ku∣≤Ct−k/2sup⁡∣g∣|\nabla^ku| \leq Ct^{-k/2}\sup|g|, by differentiating the kernel. Shi's estimates for the Ricci flow (11A.5 Shi's Derivative Estimates) are the same statement for the curvature tensor, ∣∇kRm⁡∣≤CkKt−k/2|\nabla^k\operatorname{Rm}| \leq C_kKt^{-k/2}, proved by the maximum principle because the Ricci flow has no Fourier transform; but the exponent is the one the multiplier gives.

Why backward is hopeless. Running the equation backward multiplies frequency ξ\xi by e+4π2t∣ξ∣2e^{+4\pi^2t|\xi|^2}. Unless g^\hat g decays faster than every Gaussian, the result is not in L2L^2 for any t>0t > 0; and even when it is, an error of size ε\varepsilon at frequency ∣ξ∣=N|\xi| = N grows to εe4π2tN2\varepsilon e^{4\pi^2tN^2}. This is the frequency-side form of the ill-posedness proved in 6A.1 What a PDE Is, and the reason the conjugate heat equation in Perelman's work is always solved backward in time, from a final condition, where for it the problem is well posed (9B.7 The Heat Equation on a Manifold).

The circle and the torus: two formulas for one kernel

On the circle T=R/Z\mathbb{T} = \mathbb{R}/\mathbb{Z}, 2B.7 Fourier Series and the First Heat Equation solved the heat equation by Fourier series, as Fourier himself did:

u(x,t)=∑k∈Ze−4π2k2tg^(k)e2πikx,g^(k)=∫01g(y)e−2πiky dy.u(x, t) = \sum_{k \in \mathbb{Z}}e^{-4\pi^2k^2t}\hat g(k)e^{2\pi ikx}, \qquad \hat g(k) = \int_0^1g(y)e^{-2\pi iky}\,dy.

Exchanging the sum and the integral writes u=pt∗gu = p_t*g with the heat kernel of the circle

pt(x)=∑k∈Ze−4π2k2te2πikx.p_t(x) = \sum_{k \in \mathbb{Z}}e^{-4\pi^2k^2t}e^{2\pi ikx}.

On the other hand, the circle is the line modulo translations by integers, and a solution of the heat equation on R\mathbb{R} that is periodic is a solution on T\mathbb{T}. Periodising the Gaussian gives a second formula:

pt(x)=∑m∈Z14πte−(x+m)2/4t.p_t(x) = \sum_{m \in \mathbb{Z}}\frac{1}{\sqrt{4\pi t}}e^{-(x + m)^2/4t}.

The two agree by the Poisson summation formula ∑mf(x+m)=∑kf^(k)e2πikx\sum_mf(x + m) = \sum_k\hat f(k)e^{2\pi ikx} for a Schwartz function ff (4A.6 The Fourier Transform), applied to the Gaussian f=Φ(⋅,t)f = \Phi(\cdot, t), whose transform is e−4π2tξ2e^{-4\pi^2t\xi^2}.

The two formulas are good at opposite ends of time. For small tt the Gaussian sum is dominated by its m=0m = 0 term: the kernel is nearly the Euclidean one, because heat has not yet had time to feel that the space closes up. For large tt the Fourier sum is dominated by k=0k = 0 and k=±1k = \pm1:

pt(x)=1+2e−4π2tcos⁡2πx+O(e−16π2t),p_t(x) = 1 + 2e^{-4\pi^2t}\cos2\pi x + O(e^{-16\pi^2t}),

so heat equilibrates to its mean at the rate e−4π2te^{-4\pi^2t}, the rate of the first nonzero eigenvalue λ1=4π2\lambda_1 = 4\pi^2 of −Δ-\Delta on the circle. The same duality between short-time geometry and long-time spectrum governs the heat kernel of any closed manifold (9B.7 The Heat Equation on a Manifold): the small-time expansion of the heat trace sees volume and curvature, the large-time behaviour sees the spectral gap. The identity between the two formulas, the Jacobi theta identity, is the simplest instance of a deep link between heat kernels and number theory.

On the torus Tn=Rn/Zn\mathbb{T}^n = \mathbb{R}^n/\mathbb{Z}^n everything factorises: pt(x)=∏jpt(1)(xj)p_t(x) = \prod_jp_t^{(1)}(x_j), and the spectral gap is still 4π24\pi^2, attained by the frequencies ±ej\pm e_j. Flat tori of other shapes, Rn/Λ\mathbb{R}^n/\Lambda for a lattice Λ\Lambda, have kernels ∑ℓ∈ΛΦ(x+ℓ,t)\sum_{\ell \in \Lambda}\Phi(x + \ell, t), and their spectra are {4π2∣ξ∣2:ξ∈Λ∗}\{4\pi^2|\xi|^2 : \xi \in \Lambda^*\}, with Λ∗\Lambda^* the dual lattice. Two flat tori with the same spectrum are said to be isospectral; Milnor found in 1964 two sixteen-dimensional flat tori that are isospectral but not isometric, the first answer, in the negative, to the question "can one hear the shape of a drum?" in a closed setting (9B.7 The Heat Equation on a Manifold).

Intervals: sines, cosines and boundary conditions

On an interval [0,L][0, L] the boundary conditions select which frequencies are allowed.

  • Dirichlet (u=0u = 0 at both ends, the ends held at temperature zero). The eigenfunctions of −∂x2-\partial_x^2 are sin⁡kπxL\sin\frac{k\pi x}{L}, k≥1k \geq 1, with eigenvalues k2π2L2\frac{k^2\pi^2}{L^2}, and
u(x,t)=∑k≥1bke−k2π2t/L2sin⁡kπxL,bk=2L∫0Lg(y)sin⁡kπyL dy.u(x, t) = \sum_{k \geq 1}b_ke^{-k^2\pi^2t/L^2}\sin\frac{k\pi x}{L}, \qquad b_k = \frac2L\int_0^Lg(y)\sin\frac{k\pi y}{L}\,dy.

Every solution decays to zero, at the rate e−π2t/L2e^{-\pi^2t/L^2} of the first mode.

  • Neumann (ux=0u_x = 0 at both ends, insulated ends, 6A.1 What a PDE Is). The eigenfunctions are cos⁡kπxL\cos\frac{k\pi x}{L}, k≥0k \geq 0, and the k=0k = 0 mode is the constant, which does not decay: u→1L∫0Lgu \to \frac1L\int_0^Lg, the mean, conserved because no heat leaves. The approach is at the rate e−π2t/L2e^{-\pi^2t/L^2} again.

The method is the odd and even reflection of the circle: extending gg oddly about 00 and periodically with period 2L2L produces a function on a circle of length 2L2L whose series contains only sines, and the flow preserves oddness, so it vanishes at 00 and LL for all time. In both cases the time to equilibrate is of order L2π2\frac{L^2}{\pi^2}: doubling the length of a rod quadruples the time it takes to even out. This is Einstein's law ⟨x2⟩∼t\langle x^2\rangle \sim t of 6A.3 The Heat Equation on ℝⁿ again, read off from the lowest eigenvalue.

For a general bounded domain the eigenfunctions of the Dirichlet Laplacian are no longer explicit, but they exist and form an orthonormal basis of L2L^2 (the spectral theorem for the compact inverse, 4A.8 Compact Operators and Spectra, 6B.15 Spectral Theory and Heat Trace Asymptotics), and the solution is the same kind of series. The first eigenfunction is positive (6A.6 Weak Solutions and Elliptic Regularity), and solutions become proportional to it for large time: a hot object of any shape cools, after a while, in the shape of its first eigenfunction.

Fractional and anomalous diffusion

Replacing the multiplier e−4π2t∣ξ∣2e^{-4\pi^2t|\xi|^2} by e−t(2π∣ξ∣)αe^{-t(2\pi|\xi|)^\alpha}, 0<α<20 < \alpha < 2, defines the fractional heat equation ut=−(−Δ)α/2uu_t = -(-\Delta)^{\alpha/2}u. Its kernel is the density of a symmetric α\alpha-stable Lévy process, a random motion with occasional long jumps; it is positive (by a theorem of Bochner, since e−∣ξ∣αe^{-|\xi|^\alpha} is positive definite for α≤2\alpha \leq 2), but has heavy tails, decaying like ∣x∣−n−α|x|^{-n-\alpha} instead of like a Gaussian. Its scaling is x∼t1/αx \sim t^{1/\alpha} instead of x∼t1/2x \sim t^{1/2}: superdiffusion. The case α=1\alpha = 1 is the Poisson kernel of the half-space, c t(t2+∣x∣2)(n+1)/2\frac{c\,t}{(t^2 + |x|^2)^{(n+1)/2}}: the harmonic extension of gg to the upper half-space, evaluated at height tt (6A.2 Harmonic Functions).

Anomalous diffusion is observed: tracer particles in turbulent flows, the foraging paths of some animals, and the spread of some contaminants in heterogeneous porous media have been modelled with Lévy-type processes and fractional equations, though how well such models fit is debated case by case. None of this enters the Ricci flow, whose diffusion is genuinely second order; but it shows that what makes the heat equation special is the exponent 22, which is the only exponent compatible with locality (a differential operator) and with positivity of the kernel at the same time.

Scale space: the heat equation in computer vision

A digital image is a function gg on a grid, sampled from an intensity on a plane region. To find its features (edges, blobs, corners) at all sizes at once, Andrew Witkin (1983) and Jan Koenderink (1984) proposed replacing gg by the whole family of its smoothings

L(x,t)=(Φ(⋅,t)∗g)(x),L(x, t) = (\Phi(\cdot, t)*g)(x),

the scale-space representation: LL solves the heat equation with L(⋅,0)=gL(\cdot, 0) = g, and the scale parameter tt corresponds to a blur radius σ=2t\sigma = \sqrt{2t}, the standard deviation of the Gaussian Φ(⋅,t)\Phi(\cdot, t). Fine structure lives at small tt, coarse structure at large tt, and moving from fine to coarse is running the heat equation.

Why the Gaussian. Koenderink asked what a smoothing should satisfy to deserve the name, and listed requirements: it should be linear, shift-invariant and rotation-invariant; it should form a semigroup in the scale parameter (smoothing by tt then by ss is smoothing by t+st + s); and it should satisfy causality: going to a coarser scale must never create new structure. For level sets, causality means that a new local maximum cannot appear as tt increases, and Koenderink observed that this is exactly what a parabolic maximum principle provides: if LL satisfies Lt=ΔLL_t = \Delta L, then at a spatial maximum ΔL≤0\Delta L \leq 0, so Lt≤0L_t \leq 0, and maxima can only decrease (6A.5 Maximum Principles). Requiring causality for every image forces the generator of the semigroup to be a second-order elliptic operator, and the symmetry requirements make it the Laplacian: the heat equation is the only linear scale space. Babaud, Witkin, Baudin and Duda (1986) proved the one-dimensional form precisely: among smoothing kernels, the Gaussian is the only one for which the number of zero crossings of the second derivative (inflection points of the signal) never increases with scale.

There is a subtlety that the maximum principle makes precise. In one dimension the heat flow cannot create new local extrema of the signal (a consequence of the maximum principle applied to LxL_x, which also solves the heat equation, combined with the fact that the number of sign changes of a solution of the one-dimensional heat equation does not increase, a theorem going back to Sturm). In two dimensions new local extrema can appear under Gaussian smoothing: Lifshitz and Pizer (1990) gave examples. Causality survives in the weaker form that matters: no new level curve can appear from nothing, because a closed level curve enclosing a new maximum would need Lt>0L_t > 0 at that maximum.

Detectors from derivatives. Features are defined through derivatives of LL, and the scale is chosen by normalising them. David Marr and Ellen Hildreth (1980) located edges at the zero crossings of ΔL=Δ(Φ∗g)=(ΔΦ)∗g\Delta L = \Delta(\Phi*g) = (\Delta\Phi)*g, the Laplacian of Gaussian, motivated in part by the centre–surround receptive fields of retinal ganglion cells. Since ∂tΦ=ΔΦ\partial_t\Phi = \Delta\Phi, the Laplacian of Gaussian is approximately the difference of two Gaussians at nearby scales,

Φ(⋅,t+δ)−Φ(⋅,t)≈δ ΔΦ(⋅,t),\Phi(\cdot, t + \delta) - \Phi(\cdot, t) \approx \delta\,\Delta\Phi(\cdot, t),

which is cheap to compute: the heat equation itself tells you that blurring twice and subtracting gives the Laplacian. David Lowe's SIFT detector (2004), used for years in image matching, panorama stitching and robot navigation, finds keypoints as extrema of the difference of Gaussians across both space and scale. Blob detection with the scale-normalised Laplacian tΔLt\Delta L (Lindeberg) selects, for each blob, the scale at which tΔLt\Delta L is extremal, and that scale is proportional to the square of the blob's size: parabolic scaling, again.

Nonlinear diffusion: smoothing that respects edges

Linear scale space blurs edges as much as noise, because the Laplacian is isotropic: it does not know which way an edge runs. In 1990 Pietro Perona and Jitendra Malik proposed letting the diffusion coefficient depend on the image itself,

ut=div⁡(c(∣∇u∣)∇u),c(s)=11+s2/K2,u_t = \operatorname{div}\big(c(|\nabla u|)\nabla u\big), \qquad c(s) = \frac{1}{1 + s^2/K^2},

so that diffusion is strong where the gradient is small (inside regions, removing noise) and weak where it is large (across edges, preserving them). Writing the equation in a frame aligned with the gradient shows what it does: along the level curves the diffusion coefficient is c(∣∇u∣)>0c(|\nabla u|) > 0, but across them it is dds(sc(s))\frac{d}{ds}\big(sc(s)\big), which is negative for s>Ks > K. So the equation is a forward heat equation along edges and a backward heat equation across steep ones. That sharpens edges, which is what was wanted, but it also makes the problem ill-posed in the sense of 6A.1 What a PDE Is: small perturbations can grow, and the continuous equation has no well-behaved solutions in general (it develops "staircasing" under discretisation). Catté, Lions, Morel and Coll (1992) regularised it by computing the coefficient from a Gaussian-smoothed gradient, which restores well-posedness.

Two other lines of work keep the maximum principle intact.

  • Total variation flow. Leonid Rudin, Stanley Osher and Emad Fatemi (1992) denoised images by minimising the total variation ∫∣∇u∣\int|\nabla u| plus a fidelity term. Its gradient flow, ut=div⁡∇u∣∇u∣u_t = \operatorname{div}\frac{\nabla u}{|\nabla u|}, is degenerate but not backward: it is the gradient flow of a convex functional (6A.11 Calculus of Variations and Gradient Flows), preserves the maximum principle, and allows jumps in uu, which is why it keeps edges sharp. The quantity div⁡∇u∣∇u∣\operatorname{div}\frac{\nabla u}{|\nabla u|} is the curvature of the level sets of uu.
  • Curvature motion of level sets. Luis Alvarez, Pierre-Louis Lions and Jean-Michel Morel (1992), and Alvarez, Guichard, Lions and Morel's axiomatic study (1993), showed that the image smoothings that are contrast-invariant (unchanged by relabelling the grey levels monotonically) and satisfy the scale-space axioms are generated by equations of the form ut=∣∇u∣F(κ,t)u_t = |\nabla u|F(\kappa, t), where κ\kappa is the curvature of the level curves. The simplest, ut=∣∇u∣κu_t = |\nabla u|\kappa, moves every level curve by the curve shortening flow of 6A.10 Curve Shortening and the First Geometric Flows; the affine-invariant one, ut=∣∇u∣κ1/3u_t = |\nabla u|\kappa^{1/3}, is the affine curve shortening of Sapiro and Tannenbaum. Such equations are fully nonlinear and degenerate; their solutions are defined as viscosity solutions (6C.9 Hamilton–Jacobi Equations and Viscosity Solutions).

So the practical demand of smoothing images without destroying them leads, by a short chain of reasoning, to the same geometric flows that this book develops as mathematics: the heat equation, curvature flows of curves, and the maximum principle as the organising idea.

In the world In use Blurring in a camera and in a phone

The "Gaussian blur" filter of image software is a discrete heat flow: convolution with a sampled Gaussian of standard deviation σ\sigma pixels, which is the heat equation run for time t=σ22t = \frac{\sigma^2}{2}. Because the Gaussian factorises, e−(x2+y2)/2σ2=e−x2/2σ2e−y2/2σ2e^{-(x^2 + y^2)/2\sigma^2} = e^{-x^2/2\sigma^2}e^{-y^2/2\sigma^2}, a two-dimensional blur is done as two one-dimensional ones, rows then columns, which is the product formula for the heat kernel of 6A.3 The Heat Equation on ℝⁿ. And because of the semigroup law, a large blur can be built from repeated small ones, σ2\sigma^2 adding like variances. Real optical defocus is not Gaussian (an out-of-focus lens blurs a point into a disc, whose Fourier transform has zeros), which is why deblurring photographs is harder than inverting a heat flow, and why the backward heat equation of 6A.1 What a PDE Is is the textbook model of an ill-posed inverse problem.

The Ricci flow, seen from the Fourier side

The Ricci flow has no Fourier transform, but its linearisation at a flat metric does, and that linearisation explains the role of every tool of Book 11A. Linearise ∂tg=−2Ric⁡(g)\partial_tg = -2\operatorname{Ric}(g) at the Euclidean metric: write g=δ+hg = \delta + h with hh small, and keep terms linear in hh. The variation formula of 11A.2 How Curvature Evolves gives

∂thjk=Δhjk+∂j∂ktr⁡h−∂m∂jhkm−∂m∂khjm.\partial_th_{jk} = \Delta h_{jk} + \partial_j\partial_k\operatorname{tr}h - \partial^m\partial_jh_{km} - \partial^m\partial_kh_{jm}.

Transform in xx: with h^(ξ)\hat h(\xi) a symmetric matrix for each frequency,

∂th^=−4π2(∣ξ∣2h^+(tr⁡h^) ξξT−ξ(h^ξ)T−(h^ξ)ξT).\partial_t\hat h = -4\pi^2\Big(|\xi|^2\hat h + (\operatorname{tr}\hat h)\,\xi\xi^T - \xi(\hat h\xi)^T - (\hat h\xi)\xi^T\Big).

The matrix in brackets is the symbol of the linearised Ricci operator (11A.4 Short-Time Existence and Uniqueness, 6C.12 Quasilinear Parabolic Systems). On most symmetric matrices it acts like ∣ξ∣2|\xi|^2, so those components decay like the heat equation. But on the matrices h^=ξvT+vξT\hat h = \xi v^T + v\xi^T, for any vector vv, the bracket vanishes (Exercise 4.6): these components do not decay at all. They are the infinitesimal changes of coordinates, the Fourier transforms of the Lie derivatives ∂jXk+∂kXj\partial_jX_k + \partial_kX_j, and the Ricci flow cannot see them because a diffeomorphism changes nothing geometric. DeTurck's trick (11A.4 Short-Time Existence and Uniqueness) adds a Lie-derivative term LWg\mathcal L_Wg, with WW built from first derivatives of gg, whose symbol is exactly what is missing in these directions: the symbol of the modified flow is ∣ξ∣2|\xi|^2 times the identity on all symmetric matrices, and the modified flow is a genuine heat equation for the metric. Short-time existence of the Ricci flow is, at the level of frequencies, the statement that after fixing coordinates every component of the metric diffuses.

The other Fourier fact that runs through Perelman's work is the Gaussian itself. The Gaussian is the fixed point of the Fourier transform (up to scaling), the heat kernel, the extremal function of the log-Sobolev inequality (6A.12 Entropy, Information and Diffusion), and the density (4πτ)−n/2e−∣x∣2/4τ(4\pi\tau)^{-n/2}e^{-|x|^2/4\tau} at which Perelman's entropy W\mathcal W vanishes on flat space (12A.3 The 𝓦-Entropy). That one function plays all these roles is not a coincidence: they are all expressions of the fact that e−4π2t∣ξ∣2e^{-4\pi^2t|\xi|^2} is both the heat multiplier and a Gaussian.

Where this goes Where this goes

6A.5 Maximum Principles proves the maximum principles that make scale space causal and the Ricci flow controllable. 6A.12 Entropy, Information and Diffusion meets the Gaussian again as the extremal of the log-Sobolev inequality. 6C.12 Quasilinear Parabolic Systems uses the symbol to prove short-time existence for parabolic systems, and 11A.4 Short-Time Existence and Uniqueness applies it, with DeTurck's trick, to the Ricci flow. 11A.12 Ricci Flow on Surfaces meets discrete conformal flows on surfaces, used in geometry processing like the diffusions of this chapter.

History

Joseph Fourier solved the heat equation by trigonometric series in his memoir of 1807 and in Théorie analytique de la chaleur (1822). Poisson's summation formula dates from the 1820s and Jacobi's theta identity from 1828. Bochner characterised positive-definite functions in 1932, and Lévy introduced stable laws in the 1920s. Marr and Hildreth's theory of edge detection appeared in 1980, Witkin's scale-space filtering in 1983 and Koenderink's "The structure of images" in 1984; Babaud, Witkin, Baudin and Duda proved the uniqueness of the Gaussian kernel in 1986. Perona and Malik introduced anisotropic diffusion in 1990, Rudin, Osher and Fatemi total variation denoising in 1992, and Alvarez, Lions and Morel curvature-based smoothing in 1992. Lowe's SIFT descriptor was published in 2004. Milnor's isospectral tori appeared in 1964.

Recall Where we stand

On the Fourier side the heat equation is u^(ξ,t)=e−4π2t∣ξ∣2g^(ξ)\hat u(\xi, t) = e^{-4\pi^2t|\xi|^2}\hat g(\xi): a contraction, a semigroup, with energy identity and uniqueness among L2L^2 solutions. Smoothing is decay of high frequencies, ∥u(t)∥H˙s≤Ct−(s−r)/2∥g∥H˙r\|u(t)\|_{\dot H^s} \leq Ct^{-(s-r)/2}\|g\|_{\dot H^r}, the parabolic counting behind Shi's estimates; backward flow multiplies by e+4π2t∣ξ∣2e^{+4\pi^2t|\xi|^2} and explodes. On the circle the kernel is a Fourier series and a periodised Gaussian at once (Poisson summation), equilibrating at the rate of the spectral gap; on intervals, Dirichlet and Neumann conditions select sines and cosines, and equilibration takes a time of order L2L^2. Fractional multipliers give heavy-tailed, superdiffusive kernels. In computer vision the heat flow is linear scale space, forced by causality, the maximum principle as a design rule; Laplacian-of-Gaussian and difference-of-Gaussians detectors come from ∂tΦ=ΔΦ\partial_t\Phi = \Delta\Phi. Perona–Malik is backward across edges and ill-posed; total variation flow and curvature motion of level sets keep the maximum principle and lead to curve shortening. The linearised Ricci flow's symbol is ∣ξ∣2|\xi|^2 except on the gauge directions ξvT+vξT\xi v^T + v\xi^T, which DeTurck's trick damps. 6A.5 Maximum Principles develops the maximum principle.

Exercises

Exercise 4.2 Decay on the torus

Let uu solve the heat equation on Tn=Rn/Zn\mathbb{T}^n = \mathbb{R}^n/\mathbb{Z}^n with initial data gg of mean zero. Show that ∥u(t)∥L2≤e−4π2t∥g∥L2\|u(t)\|_{L^2} \leq e^{-4\pi^2t}\|g\|_{L^2}, and that equality holds for all tt exactly when gg is a combination of the modes e±2πixje^{\pm2\pi ix_j}.

Solution

By Parseval on the torus, ∥u(t)∥2=∑k≠0e−8π2t∣k∣2∣g^(k)∣2\|u(t)\|^2 = \sum_{k \neq 0}e^{-8\pi^2t|k|^2}|\hat g(k)|^2, since g^(0)=0\hat g(0) = 0 (mean zero). For k∈Zn∖{0}k \in \mathbb{Z}^n\setminus\{0\}, ∣k∣2≥1|k|^2 \geq 1, so each term is at most e−8π2t∣g^(k)∣2e^{-8\pi^2t}|\hat g(k)|^2, and ∥u(t)∥2≤e−8π2t∥g∥2\|u(t)\|^2 \leq e^{-8\pi^2t}\|g\|^2. Equality for some t>0t > 0 forces g^(k)=0\hat g(k) = 0 whenever ∣k∣2>1|k|^2 > 1, that is, gg is supported on the frequencies ±ej\pm e_j, the modes e±2πixje^{\pm2\pi ix_j}; conversely those modes decay exactly at the rate e−4π2te^{-4\pi^2t}.

Exercise 4.3 The constant in Sobolev smoothing

Show that the constant in Proposition 4.1 is sharp: for s>rs > r and any t>0t > 0, find data gg with ∥etΔg∥H˙s\|e^{t\Delta}g\|_{\dot H^s} arbitrarily close to Cs,rt−(s−r)/2∥g∥H˙rC_{s,r}t^{-(s-r)/2}\|g\|_{\dot H^r}. (Hint: concentrate g^\hat g near a sphere ∣ξ∣=ρ|\xi| = \rho with 4π2ρ2t=s−r24\pi^2\rho^2t = \frac{s - r}{2}.)

Solution

If g^\hat g is supported in a thin shell ρ≤∣ξ∣≤ρ+δ\rho \leq |\xi| \leq \rho + \delta, then on that shell (2π∣ξ∣)2se−8π2t∣ξ∣2≈(2πρ)2(s−r)e−8π2tρ2(2π∣ξ∣)2r(2\pi|\xi|)^{2s}e^{-8\pi^2t|\xi|^2} \approx (2\pi\rho)^{2(s-r)}e^{-8\pi^2t\rho^2}(2\pi|\xi|)^{2r}, so ∥etΔg∥H˙s2≈(2πρ)2(s−r)e−8π2tρ2∥g∥H˙r2\|e^{t\Delta}g\|_{\dot H^s}^2 \approx (2\pi\rho)^{2(s-r)}e^{-8\pi^2t\rho^2}\|g\|_{\dot H^r}^2. With y=4π2ρ2ty = 4\pi^2\rho^2t this is (y(s−r)/2e−y)2t−(s−r)∥g∥H˙r2\big(y^{(s-r)/2}e^{-y}\big)^2t^{-(s-r)}\|g\|^2_{\dot H^r}, and choosing y=s−r2y = \frac{s - r}{2}, where y(s−r)/2e−yy^{(s-r)/2}e^{-y} attains its maximum Cs,rC_{s,r}, gives the bound up to an error that vanishes as δ→0\delta \to 0.

Exercise 4.4 The circle kernel at small and large times

Using the two formulas for the heat kernel of the circle, show that pt(0)=14πt(1+O(e−1/4t))p_t(0) = \frac{1}{\sqrt{4\pi t}}(1 + O(e^{-1/4t})) as t→0t \to 0 and pt(0)=1+2e−4π2t+O(e−16π2t)p_t(0) = 1 + 2e^{-4\pi^2t} + O(e^{-16\pi^2t}) as t→∞t \to \infty. Deduce the identity ∑ke−πk2s=s−1/2∑me−πm2/s\sum_ke^{-\pi k^2s} = s^{-1/2}\sum_me^{-\pi m^2/s} for s>0s > 0.

Solution

Gaussian form at x=0x = 0: pt(0)=(4πt)−1/2∑me−m2/4t=(4πt)−1/2(1+2e−1/4t+…)p_t(0) = (4\pi t)^{-1/2}\sum_me^{-m^2/4t} = (4\pi t)^{-1/2}(1 + 2e^{-1/4t} + \ldots). Fourier form: pt(0)=∑ke−4π2k2t=1+2e−4π2t+2e−16π2t+…p_t(0) = \sum_ke^{-4\pi^2k^2t} = 1 + 2e^{-4\pi^2t} + 2e^{-16\pi^2t} + \ldots. Equating the two forms with 4πt=s4\pi t = s: ∑ke−πk2s=s−1/2∑me−πm2/s\sum_ke^{-\pi k^2s} = s^{-1/2}\sum_me^{-\pi m^2/s}, Jacobi's identity for the theta function θ(s)=∑e−πk2s\theta(s) = \sum e^{-\pi k^2s}, which says θ(s)=s−1/2θ(1/s)\theta(s) = s^{-1/2}\theta(1/s).

Exercise 4.5 The insulated rod

Solve ut=uxxu_t = u_{xx} on [0,1][0, 1] with ux(0,t)=ux(1,t)=0u_x(0, t) = u_x(1, t) = 0 and u(x,0)=xu(x, 0) = x. Find the limit as t→∞t \to \infty and the rate of approach, and check that ∫01u dx\int_0^1u\,dx is constant.

Solution

The cosine coefficients of xx on [0,1][0, 1]: a0=∫01x dx=12a_0 = \int_0^1x\,dx = \frac12, and for k≥1k \geq 1, ak=2∫01xcos⁡kπx dx=2((−1)k−1)k2π2a_k = 2\int_0^1x\cos k\pi x\,dx = \frac{2((-1)^k - 1)}{k^2\pi^2}, which is −4k2π2-\frac{4}{k^2\pi^2} for odd kk and 00 for even kk. So u(x,t)=12−∑k odd4k2π2e−k2π2tcos⁡kπxu(x, t) = \frac12 - \sum_{k\text{ odd}}\frac{4}{k^2\pi^2}e^{-k^2\pi^2t}\cos k\pi x. As t→∞t \to \infty, u→12u \to \frac12, the mean, at the rate e−π2te^{-\pi^2t} of the k=1k = 1 mode. ∫01u dx=12\int_0^1u\,dx = \frac12 for all tt, since each cosine with k≥1k \geq 1 integrates to zero; directly, ddt∫u=∫uxx=ux∣01=0\frac{d}{dt}\int u = \int u_{xx} = u_x\big|_0^1 = 0.

Exercise 4.6 The gauge directions

Show that the matrix σ(ξ)h^=∣ξ∣2h^+(tr⁡h^)ξξT−ξ(h^ξ)T−(h^ξ)ξT\sigma(\xi)\hat h = |\xi|^2\hat h + (\operatorname{tr}\hat h)\xi\xi^T - \xi(\hat h\xi)^T - (\hat h\xi)\xi^T vanishes when h^=ξvT+vξT\hat h = \xi v^T + v\xi^T for any vector vv, and that it equals ∣ξ∣2h^|\xi|^2\hat h when h^\hat h is trace-free and h^ξ=0\hat h\xi = 0. Interpret the two cases.

Solution

For h^=ξvT+vξT\hat h = \xi v^T + v\xi^T: tr⁡h^=2ξ⋅v\operatorname{tr}\hat h = 2\xi\cdot v and h^ξ=∣ξ∣2v+(v⋅ξ)ξ\hat h\xi = |\xi|^2v + (v\cdot\xi)\xi. Then ξ(h^ξ)T+(h^ξ)ξT=∣ξ∣2(ξvT+vξT)+2(v⋅ξ)ξξT\xi(\hat h\xi)^T + (\hat h\xi)\xi^T = |\xi|^2(\xi v^T + v\xi^T) + 2(v\cdot\xi)\xi\xi^T, which cancels ∣ξ∣2h^+2(ξ⋅v)ξξT|\xi|^2\hat h + 2(\xi\cdot v)\xi\xi^T exactly: the symbol is zero. These are the Fourier transforms of LXg\mathcal L_Xg, infinitesimal diffeomorphisms, which the Ricci flow does not damp. If h^\hat h is trace-free with h^ξ=0\hat h\xi = 0 (transverse, trace-free: the "physical" part), the last three terms vanish and the symbol is ∣ξ∣2h^|\xi|^2\hat h: these components evolve by the heat equation. (For gravitational waves, the analogous transverse trace-free part is what propagates.)

Exercise 4.7 Rehearsal: difference of Gaussians

(a) Show that Φ(⋅,t+δ)−Φ(⋅,t)=δΔΦ(⋅,t)+O(δ2)\Phi(\cdot, t + \delta) - \Phi(\cdot, t) = \delta\Delta\Phi(\cdot, t) + O(\delta^2) uniformly, and compute ΔΦ\Delta\Phi in two dimensions. (b) For a blob g=Φ(⋅,a)g = \Phi(\cdot, a) (a Gaussian of variance parameter aa), show that the scale-normalised Laplacian t ΔL(0,t)t\,\Delta L(0, t) of its scale space is extremal at t=at = a. So the selected scale equals the blob's own scale.

Solution

(a) By Taylor's theorem in tt and ∂tΦ=ΔΦ\partial_t\Phi = \Delta\Phi: Φ(t+δ)−Φ(t)=δ∂tΦ(t)+δ22∂t2Φ(t+θδ)=δΔΦ(t)+O(δ2)\Phi(t + \delta) - \Phi(t) = \delta\partial_t\Phi(t) + \frac{\delta^2}{2}\partial_t^2\Phi(t + \theta\delta) = \delta\Delta\Phi(t) + O(\delta^2), uniformly in xx for tt bounded away from 00. In two dimensions Φ=14πte−r2/4t\Phi = \frac{1}{4\pi t}e^{-r^2/4t} and ΔΦ=∂tΦ=14πt(r24t2−1t)e−r2/4t\Delta\Phi = \partial_t\Phi = \frac{1}{4\pi t}\big(\frac{r^2}{4t^2} - \frac1t\big)e^{-r^2/4t}: negative in the centre, positive outside, the "Mexican hat". (b) L(⋅,t)=Φ(⋅,a)∗Φ(⋅,t)=Φ(⋅,a+t)L(\cdot, t) = \Phi(\cdot, a)*\Phi(\cdot, t) = \Phi(\cdot, a + t) by the semigroup law, so ΔL(0,t)=∂sΦ(0,s)∣s=a+t=−14π(a+t)2\Delta L(0, t) = \partial_s\Phi(0, s)|_{s=a+t} = -\frac{1}{4\pi(a + t)^2}, and tΔL(0,t)=−t4π(a+t)2t\Delta L(0, t) = -\frac{t}{4\pi(a + t)^2}. Its derivative in tt vanishes where (a+t)−2t=0(a + t) - 2t = 0, at t=at = a, where ∣tΔL∣|t\Delta L| is largest.

Free resources for this chapter

Chosen for what this chapter covers, and all free to read. Links checked Oct 16, 2026.

© 2026 NeckPinch (www.neckpinch.com). All content in the guidebook (text, mathematics, figures and exercises) is protected by copyright. All rights reserved. No part may be copied, republished or redistributed without written permission.