Refactor and tunning of search result crawling.