shermozle/SnowCannon — pull request #19 by alexanderdean (2012-08-19 12:01:27+00:00)
Title: Refactoring around configuration and event sinks

Summary of changes:

1. Broke out configuration into separate file
2. Broke out S3 event sink behaviour into separate file
3. Added stdout-based event sink
4. Stubbed configuration for Fluentd (http://fluentd.org/) event sink

The rationale for adding an stdout sink:

1. Useful for getting started and debugging
2. Some sysadmins will wrap SnowCannon in a daemontools/supervisord or equivalent and use that monitoring tool to manage logs via stdout

The rationale for stubbing Fluentd support and moving the S3 sink into a standalone module:

* Better separation of concerns between collector and uploader
* Using Fluentd, SnowCannon should be more performant (as not also running gzips and S3 uploads)
* Fluentd supports many more storage destinations than just S3 - see http://fluentd.org/plugin/
* Using Fluentd, SnowCannon cannot be crashed by unexpected AWS/gzip behaviour