Remove cached versions of files that should be ignored