The relevant chapters are Chapters 4 , 5 , 9, which discuss Hilbert spaces (hence Fourier series), Banach spaces, and the Fourier transform, respectively.
chapters 1-3 focus on the lebesgue integral and $l^p $spaces, but i'm not sure how much of that you'll actually need.