update the crawler