com.github.xbynet:crawler-core (maven):  A simple and flexible web crawler framework for java. 
Keywords: crawler|httpclient|java|jsoup|spider