Exit the status poller cleanly, so we never block process exit