snowplow/snowplow — pull request #46 by mtibben (2012-09-26 08:11:36+00:00)
Title: [wip] Use a processing bucket

Hey Alexander,

I've been hacking on your ETL script.

I've added a processing bucket, because I want to be able to know exactly what files were processed in a job. The way it's currently working, I can't be sure whether a file has been processed or not.

I've also added some code for archiving.

I'll be working further on this, but thought I'd give you a heads up, so I can get any ideas from you. If you have any feedback, let me know!

Michael