GitHub repository: JaCraig/Spidey
Primary language: C#
Created: 2017-09-27T12:30:00Z
Description: A multi threaded web crawler library that is generic enough to allow different engines to be swapped in.