Crawler

Crawler with exception handling and logging.
Piping optimized.