GitHub repository: transducens/linguacrawl
Primary language: Python
Created: 2020-02-27T09:59:04Z
Description: Crawling engine that crawls a set of top-level domains looking for documents in a list of languages