Replace Net::Http with Typhoeus
Print out intermediate results instead of waiting until the end
Extract in batches to make use of Typhoeus.hydra