Crawler: process urls