- Removed all dependencies to scalding
- Added a pure mapreduce WordCount example
- Renamed the ProjectBuild scala file
- Run the job using the Hadoop ToolRunner.
- Allow the user to pass the job class name from the command line
- Support for Generic Options
- Added a Callback feature for the jobs
Removed an unused import (GenericOptionsParser)
- Added avro in the dependencies
- Removed some useless mergeStrategies in the BuildSettings
- Fixed the build (excluded apache.hadoop's avro jar because it conflicts with the version 1.7.5 from the explicit deps)
- Added the Camus2KafkaJob class (WiP)
Added a new MapRed class that uses the old mapred.* api
Works with text output
Use the BytesWritable class to pass the record to the reducer
Read the schema from HDFS
- Use the -D param=value syntax for the config instead of the command lineargs array
- Refactored the code, added some comments
Forgot the zk host parameter
Code cleanup
- Removed a deprecated call to .parse()
- Changed some parameters
Publishing to Kafka is working