GitHub repository: ohtwadi/collector-http
Primary language: Java
Description: Norconex Web Crawler (or spider) is a flexible web crawler for collecting, parsing, and manipulating data from the Internet (or Intranet) to various data repositories such as search engines.