Added config file to store passwords, committing an example config file and ignoring the real one.
Removed because I never used the file and it clashed with importing the Requests HTTP library.
Converted make_http_request to use the Requests HTTP library.
Switched to Requests HTTP library, adding authentication and session support.
Moved definition of skip_list to __init__ in Crawler to facilitate testing.
Re-enabled proper lookup of absolute_url; added some suffixes to list that's skipped, and added early skipping of URLs containing certain strings.