created tests to crawler
added todos