everything is tested and working stably

still need to move data_crawl to functions.