Better URL scraping method. Add retry on fail.