Added error handling when using the crawler to avoid fatal errors
Merge pull request #40 from stof/error_handling

Added error handling when using the crawler to avoid fatal errors