A C# multithreaded crawler library