Remove ignored directories/files