revise the online crawling algorithm, there still are bugs