Rollback and remove some files