Added tests for http layer, initial tests for collect and crawl phase