add some crawling functions