Improvements on crawling