github.com/allentom/youcrawl (go): web crawl framework in golang
Keywords: golang|spider-framework