codefordc/dc-campaign-finance-wrangler — pull request #3 by cojennin (2014-09-22 08:50:44+00:00)
Title: Wrangling with S3

This is largely an experimental branch (not something that can be merged into master yet, if ever). The main reason for this pull request is just to generate feedback.

As an alternative to GitHub, I'm proposing using [Amazon's S3](https://aws.amazon.com/s3/) which provides a free tier of 20,000 GET requests and 2,000 PUT requests a month as a data store for the output this repo produces.

An example of the output after executing the __init__.py of this branch [here](https://s3.amazonaws.com/ofc-contributions/). This is a list of csv files that can be programmatically accessed both by python and javascript.

I'm going to continue modifying this so that the json side of the wrangling can also leverage S3 (and be programmatically accessed by javascript and python as well).

I'd like to explore adding some sane defaults for folks who don't have S3 (like falling back to using the filesystem) and see if any alternatives might prove to be a better option for storing data in the long run.