Multithreaded crawler built in Clojure