GitHub repository: AnubhavUjjawal/distributed-web-crawler
Primary language: Python
Description: This is a distributed web crawler made from scratch in python. It has not been fully completed till now.