add configure feature:
1. control crawl duration on fly
2. ..