Don't recursively remove the setup directory if the user goes to admin before setup