Updated readme with web crawl/performance section