Cleaned & commented main.py.
Changed user agent for requests
Cleaned & commented crawler.py