TST: signal: loosen some error tolerances in the filter tests.  Closes gh-3412.

With these tolerances, the tests that failed in gh-3412 now pass.

@endolith: I think you created these tests.  Those error tolerances were pretty tight.  Do you have a reason to expect such high accuracy?  If so, I have some more debugging to do with my setup.