Small Group Tutorials

Here to help students catch up, keep up, and move ahead. Book a consultation here.

Fourier Series and Harmonic Analysis | Orthonormal Expansions, Convolution, Parseval and Frequency Structure

Fourier analysis asks a structural question: how much of a function can be understood by decomposing it into pure oscillations?

On a periodic domain, the complex exponentials form an orthonormal system. Fourier coefficients become Hilbert-space coordinates. Partial sums become orthogonal projections. Parseval becomes Pythagoras. Convolution becomes multiplication of frequency coefficients. Smoothness appears as high-frequency decay. But convergence has several distinct meanings—L², pointwise, uniform and Cesàro—and confusing them is one of the subject’s most common errors.

This guide owns R27.04. It develops periodic Fourier series as the first harmonic-analysis model, then builds the bridges toward integral transforms, distributions, PDEs and signal analysis without replacing their later or specialist owners.

Prerequisites: Hilbert Spaces and Orthogonal Projection, Series and Convergence, and integration.

Reading route: periodic L² space → exponential basis → Fourier coefficients → partial sums → Bessel and Parseval → convolution → Dirichlet kernel → convergence distinctions → Gibbs phenomenon → Cesàro means → Fejér kernel → translation and differentiation → coefficient decay → harmonic extension → heat/wave bridges → harmonic-analysis viewpoint → verification → practice and solutions.

1. The circle is the natural periodic domain

A 2π-periodic function on R can be regarded as a function on the circle T=R/(2πZ).

This quotient viewpoint removes the artificial distinction between x=−π and x=π. The periodic endpoint is one geometric point.

We work first in L²(T), where square-integrable periodic functions form a Hilbert space.

2. Choose one normalization and keep it consistent

Use the normalized inner product

⟨f,g⟩=(1/2π)∫_{−π}^{π} f(x)overline{g(x)}dx.

Then the exponentials

e_n(x)=e^{inx}, n∈Z,

have norm one and are mutually orthogonal.

Other textbooks distribute factors of 2π differently. The mathematics is equivalent, but formulas must not mix normalizations halfway through a calculation.

3. Orthogonality comes from exact cancellation over a period

For m,n∈Z,

⟨e_n,e_m⟩=(1/2π)∫_{−π}^{π}e^{i(n−m)x}dx=δ_{nm}.

When n≠m, the oscillation completes an integer number of cycles and integrates to zero.

Frequency separation is therefore a Hilbert-space orthogonality statement.

4. Fourier coefficients are inner-product coordinates

For f∈L²(T), define

f̂(n)=⟨f,e_n⟩=(1/2π)∫_{−π}^{π}f(x)e^{−inx}dx.

The formal Fourier series is

Σ_{n∈Z} f̂(n)e^{inx}.

The word “formal” matters until a convergence mode has been specified and proved.

5. Real sine–cosine coefficients are the same information

For real-valued f, one may instead write

a₀/2+Σ_{n≥1}[a_n cos(nx)+b_n sin(nx)].

The real and complex coefficient systems are linearly equivalent.

Complex exponentials simplify algebra because differentiation, translation and convolution become especially transparent.

6. Partial sums are orthogonal projections

Define the symmetric partial sum

S_Nf(x)=Σ_{|n|≤N}f̂(n)e^{inx}.

This is exactly the orthogonal projection of f onto the finite-dimensional subspace spanned by frequencies −N,…,N.

Therefore S_Nf is the best L² approximation to f among trigonometric polynomials using only those frequencies.

7. Bessel’s inequality bounds coefficient energy

For every f∈L²(T),

Σ_{n∈Z}|f̂(n)|²≤||f||²₂.

This follows from the Hilbert-space Bessel inequality applied to the orthonormal exponentials.

Square integrability therefore forces Fourier coefficients to form an ℓ² sequence.

8. Completeness upgrades Bessel to Parseval

The exponentials {e^{inx}}_{n∈Z} form a complete orthonormal basis of L²(T). Hence

||f||²₂=Σ_{n∈Z}|f̂(n)|².

This is Parseval’s identity in the chosen normalization.

Moreover S_Nf→f in L².

9. L² convergence is an energy statement, not pointwise convergence

S_Nf→f in L² means

∫|S_Nf−f|²→0.

It does not say S_Nf(x)→f(x) at every x, or uniformly in x.

A convergence theorem is incomplete unless the norm or pointwise mode is stated.

10. Parseval turns function energy into frequency energy

In physical or signal language, ||f||²₂ is total quadratic energy and |f̂(n)|² is energy assigned to frequency n.

Parseval says the decomposition preserves that quadratic total exactly.

The interpretation depends on the application’s units and model, but the Hilbert identity itself is exact.

11. The Dirichlet kernel rewrites partial sums as convolution

Define

D_N(x)=Σ_{|n|≤N}e^{inx}=sin((N+1/2)x)/sin(x/2)

away from multiples of 2π, with the continuous limiting value at zero.

Then

S_Nf=f*D_N

using normalized periodic convolution.

12. Periodic convolution averages shifted copies

With normalized convention, define

(f*g)(x)=(1/2π)∫_{−π}^{π}f(x−t)g(t)dt.

Convolution is commutative for suitable scalar functions, associative under standard integrability hypotheses, and translation invariant.

13. Fourier coefficients turn convolution into multiplication

Under the chosen normalized convolution,

widehat{f*g}(n)=f̂(n)ĝ(n).

This is one of harmonic analysis’s central algebraic simplifications: a nonlocal integral operation in physical space becomes pointwise multiplication in frequency space.

14. Multiplication of functions becomes convolution of coefficients

When summability conditions justify rearrangement,

widehat{fg}(n)=Σ_k f̂(k)ĝ(n−k).

Thus frequency mixing is coefficient convolution.

This duality—convolution ↔ multiplication—is a recurring structural principle across Fourier transforms, probability and signal processing.

15. Translation becomes a phase factor

If τ_a f(x)=f(x−a), then

widehat{τ_af}(n)=e^{−ina}f̂(n).

A shift does not change coefficient magnitudes, only their phases.

This explains why translation preserves L² energy while rotating frequency phases.

16. Differentiation multiplies frequency n by in

If f is regular enough and periodic boundary terms match, integration by parts gives

widehat{f’}(n)=in f̂(n).

Each derivative magnifies high frequencies by |n|.

Conversely, rapid coefficient decay is associated with smoothness.

17. Smoothness produces high-frequency decay

If f has k sufficiently regular periodic derivatives, repeated integration by parts gives estimates of the form

|f̂(n)|=O(|n|^{-k}).

Stronger smoothness can give faster decay; analytic continuation into a complex strip can produce exponential decay.

Exact statements depend on the chosen regularity class and domain.

18. Coefficient decay can quantify Sobolev regularity

Periodic Sobolev norms can be expressed through weighted Fourier coefficients:

Σ_{n∈Z}(1+n²)^s|f̂(n)|².

This preview shows how differentiability and frequency decay are linked quantitatively.

R27.06 owns distributions and weak formulations; this section is only the bridge.

19. Pointwise convergence needs additional hypotheses

For a sufficiently regular piecewise smooth periodic function, classical Dirichlet-type theorems give convergence at x to

[f(x^-)+f(x^+)]/2.

At continuity points this is f(x). At jump points it is the midpoint of the two one-sided limits.

This is not a theorem for every L² function at every point.

20. Uniform convergence is stronger than pointwise convergence

Uniform convergence requires

sup_x|S_Nf(x)−f(x)|→0.

It preserves continuity of the limit and permits more operations to pass through the limit.

Continuity of f alone does not guarantee uniform convergence of its ordinary Fourier partial sums.

21. The Dirichlet kernel explains why ordinary partial sums can misbehave

D_N oscillates and its L¹ norm grows with N rather than remaining uniformly controlled.

Thus S_N is not a uniformly benign averaging operator on continuous functions.

The kernel’s sign changes permit cancellation and overshoot rather than positive averaging.

22. Gibbs phenomenon persists near jump discontinuities

Near a jump, Fourier partial sums develop oscillatory overshoot and undershoot.

As N grows, the oscillation region narrows, but the relative overshoot does not vanish in height.

This does not contradict L² convergence because the region carrying the error becomes small.

23. Cesàro means average the partial sums

Define

σ_Nf=(1/(N+1))Σ_{k=0}^N S_kf.

These are the Cesàro or Fejér means.

Averaging replaces the oscillatory Dirichlet kernel with the nonnegative Fejér kernel.

24. The Fejér kernel is a positive approximate identity

One standard form is

K_N(x)=1/(N+1)·(sin((N+1)x/2)/sin(x/2))²

with normalization adjusted so its periodic average is one.

K_N≥0, concentrates near zero as N grows, and has total normalized mass one.

25. Fejér’s theorem gives robust convergence for continuous functions

If f is continuous and periodic, its Fejér means σ_Nf converge uniformly to f.

For L² functions, Fejér means also converge in L².

This is an important lesson: averaging a sequence of approximations can converge more reliably than the approximations themselves.

26. Fourier series solve the periodic heat equation mode by mode

For u_t=κu_xx on the circle, write

u(x,t)=Σ_n c_n(t)e^{inx}.

Since ∂_{xx}e^{inx}=−n²e^{inx}, each coefficient solves

c_n'(t)=−κn²c_n(t),

so c_n(t)=c_n(0)e^{−κn²t}.

High frequencies decay fastest: diffusion is frequency-dependent smoothing.

27. Fourier series solve the periodic wave equation with different time dynamics

For u_tt=c²u_xx, each frequency coefficient satisfies

c_n”(t)+(cn)²c_n(t)=0.

Thus each mode oscillates rather than decays.

The same spatial basis diagonalises two PDEs, while the time law reveals the physics.

R28 and R34 own the full differential-equation and physical-model routes.

28. The Poisson kernel gives harmonic extension from boundary Fourier modes

If boundary data on the unit circle has coefficients f̂(n), the harmonic extension into the disk has the form

u(re^{iθ})=Σ_{n∈Z} r^{|n|}f̂(n)e^{inθ}.

The factor r^{|n|} suppresses high frequencies inside the disk.

This is the frequency version of the Poisson-kernel construction in Conformal Mapping and Potential Theory.

29. Harmonic analysis generalises “frequency” beyond the circle

On the circle, the elementary frequencies e^{inx} are characters of a compact abelian group.

On R, the analogous characters e^{iξx} lead to the Fourier transform. On finite abelian groups, characters give discrete Fourier transforms. On nonabelian groups, irreducible representations replace scalar characters and frequency becomes matrix-valued.

This broader viewpoint links R27 to BTT’s representation-theory estate without merging their ownership.

30. Frequency localization and time localization compete

A sharply localized impulse requires many frequencies. A pure frequency e^{inx} is completely delocalized around the circle.

This qualitative trade-off develops into uncertainty principles for Fourier transforms.

R27.05 will own the transform and inversion framework on noncompact domains.

31. Numerical Fourier work needs aliasing and truncation checks

A finite grid cannot distinguish all frequencies. Sampling a continuous periodic signal at too low a rate can make high frequencies masquerade as lower ones.

Separately, truncating a Fourier series discards high-frequency coefficients.

Aliasing is a sampling error; truncation is a representation approximation. They should not be conflated.

The specialist signal-processing route remains Signal Processing, Sampling, Filtering, Noise and Fourier Analysis.

32. A useful verification strategy compares physical and frequency domains

For a computed trigonometric approximation:

  • check coefficient symmetry for real-valued data;
  • verify Parseval energy approximately;
  • reconstruct at several N values;
  • inspect known jump locations for Gibbs behaviour;
  • compare differentiation in physical space with multiplication by in in coefficient space;
  • check convolution by both direct integration and coefficient multiplication when feasible.

33. Common theorem-boundary errors

  • L² convergence is not the same as pointwise or uniform convergence.
  • Continuity alone does not guarantee uniform convergence of ordinary Fourier partial sums.
  • Parseval requires completeness of the orthonormal exponential system, not merely orthogonality.
  • Differentiating a Fourier series term by term requires sufficient regularity or a weak/distributional interpretation.
  • Convolution formulas depend on normalization; factors of 2π must be consistent.
  • Fejér convergence concerns averaged partial sums, not necessarily the raw partial sums.
  • Gibbs overshoot does not contradict L² convergence.
  • Sampling aliasing and Fourier-series truncation are different errors.

34. A dependable Fourier workflow

State the domain, periodicity and normalization first. Choose the function space and the convergence claim before manipulating the series.

Compute coefficients as Hilbert coordinates. Use Bessel or Parseval for energy control. Use convolution kernels to study partial sums. If raw partial sums behave badly, distinguish whether a stronger hypothesis is missing or whether Cesàro averaging is the correct theorem.

For derivatives, PDEs or numerical work, verify that the frequency-domain operation corresponds to a justified physical-space operation and record the approximation or regularity error separately.

35. Independent practice: twenty questions

  1. Write the normalized L²(T) inner product used here.
  2. Why are e^{inx} and e^{imx} orthogonal for n≠m?
  3. Define f̂(n).
  4. Write the symmetric partial sum S_Nf.
  5. What geometric object is S_Nf in Hilbert space?
  6. State Bessel’s inequality.
  7. State Parseval’s identity.
  8. What exactly does S_Nf→f in L² mean?
  9. Define periodic convolution in the chosen normalization.
  10. What is widehat{f*g}(n)?
  11. How does translation by a affect f̂(n)?
  12. How does differentiation affect f̂(n)?
  13. What is the Dirichlet kernel?
  14. At a jump, what value is predicted by a classical Dirichlet convergence theorem under suitable hypotheses?
  15. What is Gibbs phenomenon?
  16. Define the Fejér mean σ_Nf.
  17. Why is the Fejér kernel more stable as an averaging kernel than the Dirichlet kernel?
  18. How does the periodic heat equation change the nth Fourier coefficient?
  19. How does harmonic extension into the disk change the nth boundary mode?
  20. Distinguish aliasing from Fourier truncation.

36. Worked solutions and checks

1. ⟨f,g⟩=(1/2π)∫_{−π}^{π}f overline{g}.

2. Their product gives e^{i(n−m)x}, whose integral over a full period is zero when n−m is a nonzero integer.

3. f̂(n)=(1/2π)∫f(x)e^{-inx}dx.

4. S_Nf=Σ_{|n|≤N}f̂(n)e^{inx}.

5. The orthogonal projection onto frequencies −N,…,N.

6. Σ|f̂(n)|²≤||f||²₂.

7. ||f||²₂=Σ|f̂(n)|² because the exponentials form a complete orthonormal basis.

8. The integral of |S_Nf−f|² tends to zero; it does not by itself assert pointwise or uniform convergence.

9. (f*g)(x)=(1/2π)∫f(x−t)g(t)dt.

10. f̂(n)ĝ(n).

11. It multiplies the nth coefficient by e^{-ina}.

12. Under sufficient regularity, widehat{f’}(n)=in f̂(n).

13. D_N=Σ_{|n|≤N}e^{inx}=sin((N+1/2)x)/sin(x/2), with limiting interpretation at multiples of 2π.

14. The midpoint [f(x^-)+f(x^+)]/2.

15. Persistent oscillatory overshoot/undershoot near a jump whose width shrinks but relative peak height does not disappear.

16. σ_N=(1/(N+1))Σ_{k=0}^N S_k.

17. It is nonnegative, normalized and increasingly concentrated near zero, so it behaves as a positive approximate identity.

18. It multiplies c_n(0) by e^{-κn²t}.

19. It multiplies the nth boundary coefficient by r^{|n|}.

20. Aliasing comes from insufficient sampling resolution; truncation comes from discarding frequencies in an approximation.

37. Where Batch 01 hands off

R27.01–R27.04 now establish the first functional/harmonic/operator route: complete normed spaces → Hilbert geometry and projection → operators and spectra → Fourier decomposition and harmonic structure.

R27.05–R27.08 remain distinct pending Atlas cells: integral transforms and inversion, distributions and weak formulations, integral equations and operator methods, and nonlinear/advanced analysis. This publication batch is not yet an Atlas “Complete for v1” certification.

Sources and further study

MIT OpenCourseWare 18.102 Introduction to Functional Analysis — Lecture Notes and Readings develops orthonormal bases, Fourier series, the Dirichlet and Fejér kernels, Fejér’s theorem and L² convergence. For the later transform bridge, continue to R27.05 rather than treating periodic Fourier series as the whole Fourier theory.

Return to the BTT Mathematics Hub.