Terminate the poller and the fetcher synchronously.

Perhaps a fix for the issue described in #1406.

@mperham see any issues here? I'm still not a celluloid pro so it's possible this is not good, but all the tests pass.