add some functions for working with crawl