Webdevdata/webdevdata.org — pull request #7 by yoavweiss (2013-04-29 18:18:15+00:00)
Title: HTML downloading script

Got a script (2 actually) that downloads the Alexa CSV, cleans it up and starts downloading the HTMLs using a multi-threaded pool (so timeouts will be less painful)
It saves the HTML with a "txt" extension and also saves the headers.