GitHub repository: williamjulianvicary/crawl
Primary language: Jupyter Notebook
Description: A concurrent crawler that minimizes memory use. Output suitable for use with BigQuery.