optimize crawler and new crawl db