Use proper FFT, no matter the cost

Actually, the cost matters. The current implementation takes non-neglible
time despite using VFP and being calculated in single precision.