Added crawling function to client