GitHub repository: vectara/web-crawler
Primary language: Python
Description: Lightweight indexer/crawler to get web content into Vectara