update crawling progress