Walk ignored directories

Because content inside the directories might be excluded from ignores