github.com/andeya/pholcus (go): Pholcus is a distributed high-concurrency crawler software written in pure golang
Keywords: crowler|spider