convert to spaces
fix previous merge
removing server part of the crawler
making the address to be crawled an optional paramter
fix indexing links loop
implements multiple connections and set it to 10
fix minor implementation bugs
use one phantom instance for each crawl url
Adds DG Brand Site to README file
Merge remote-tracking branch 'hems/dev' into dev
Merge remote-tracking branch 'hems/replacing-phantomjs-bridge' into dev
Merge remote-tracking branch 'hems/patch-1' into dev
Recompiling.