Fix key error bug and refactor main function
Merge branch 'master' of github.com:AdamCanady/CS257-Crawler

Conflicts:
	crawler.py

Fix key error bug and refactor main function