Remove nonexistent directory from ignores.