GitHub repository: Coveo/abot
Primary language: C#
Description: C# web crawler built for speed and flexibility. Please star this project! +1