remove the ignored directories