added test cases for crawler