Crawling is now 2x faster, connections are reused whenever the same host is requested (which should most of the time when crawling a single domain). This is thanks to urllib3.
Merge branch 'master' of github.com:david-haber/gocrawl