Use case statement in #should_be_visited?
Assignment to local variable unnecessary in
#links_for
Remove unnecessary check if it is an URI

Kernel.URI is doing this by itself
Simplify #url_tracker and #redis
Remove begin block from HTTP#fetch_pages
Minor changes to HTTP#fetch_pages
Simplify PolipusCrawler.crawl
Add AUTHORS
Merge pull request #17 from tmaier/code-style

Minor changes to code style
http gzip content fix
better support for ruby 2.1.1
Adding gzip_enable as option