test case for `crawler.py`
Raise CrawlError when something goes wrong.