added throws declaration to crawl method, error handled externally