ArchiveCrawler is now a Generator.
Added sleep timer after every url request (configurable now in other.config)