merge crawl and db update into one file