github.com/rapidclock/web-octopus (go): A concurent web crawler library written in Go.
Keywords: concurrent|concurrent-web-crawler|crawler|golang|golang-library|web-crawler|webcrawler