Updated the crawler status.