remove useless code from crawler.cpp