only crawl pages with a Content-Type of text/html