Remove folder for a bit