Add support for ignoring specific files in set