Don't remove already removed users on services unload when we're shutting down the IRCd