Remove all files that are now ignored