sunlightlabs/scrapelib — pull request #26 by twneale (2014-09-21 03:53:47+00:00)
Title: Added gzip'ing of scrape FileCache get, sets.

'Sup dudes, I'll stop bothering you soon, I promise.

So I was scraping the CFR and my cache had 15G in it, and I tested gzip'ing all the files, and that shrank it down to 850MB. Alrightee then! This looked easy to add, to I took a whack.