refactoring crawler.clj