Stop listening for exit if idle.