added parallelized HTTP gets by the use of grequests, drastically overhauling the majority of how the worker gets pages, changed how the worker talks about what work it is doing; it no longer prints urls as it visits them, instead gives stats about how many urls were visited and found et cetere for each parallel GET.

Signed-off-by: mep <miethpo@gmail.com>