Contains code for a basic web crawler written in python. Will be improved with time