Cleaned up the Crawl manager, now properly commented