move from FFT based method for convolution to a direct convolution

Since h is likely to be so small, it makes sense to do a direct
convolution.