Remove files that need to be ignored