implemented crawling