Commented out code removal
Refactor out emit method to improve readability
Rename CrawlerException to CrawlRejectException which better describes its purpose