I made this crawler for educational purposes. It uses Akka Actors in Scala