Webcrawler written in C/C++ using libcurl