This repo contains all experiments i have done with web crawlers i have written in Python