Spider for crawling sites