Fix #696: Ignore un-listable dirs in directory traverser