Only exit the worker runloop if we're actually dead, not if we're reconnecting