GitHub repository: kgretzky/dcrawl
Primary language: Go
Created: 2017-08-14T15:24:52Z
Description: Simple, but smart, multi-threaded web crawler for randomly gathering huge lists of unique domain names.