Delete ignored directories