Don't try to remove absent dirs