Refactor some generic http methods from GoogleScholarCrawler to Crawler