One threading crawler
Not working version of multithread-crawler
First dirty version of crawler. TODO: std::shared_set, directories, refactotring
Bug version of crawler. TODO: modify shared_queue
Crawler
Crawler version 1
Working Crawler