only do link scraping for html pages