addthis/hydra — pull request #121 by abramsm (2014-09-24 17:50:22+00:00)
Title: add module to output data directly to HDFS

It would be nice to be able to use hydra as a system to process data streams and emit them to HDFS storage. This branch enables that functionality. It likely added a ton of transitive hadoop dependencies so it may be desirable to make this an optional module. Basic job config looks like:

factory:{
type:"hdfs",
hdfsURL:"hdfs://lhn00.clearspring.local:8020",
dir:"split",
},