add crawler.py (A simple webpage crawler).
update requirements.txt
fix bugs in crawler.py