filter out pages with no html (either error with crawl itself or with loader)