GitHub repository: sylvainroussy/collector-http
Primary language: Java
Description: Norconex HTTP Collector is a flexible web crawler for collecting, parsing, and manipulating data from the Internet (or Intranet) to various data repositories such as search engines.