Demote itself when shutting down gracefully