fix some bugs in crawler