Checking in the first working version for Kafka-0.8
Removing break to report all counts
Checking in the latest changes
Checking in the latest changes
Checking in th left out changes
Checking in the latest changes
Adding some parameters in the example properties file
Changing the incorrect pom.xml file
Adding more file extensions to gitignore
Checking in the latest code
Update CamusJob.java
Update pom.xml

Un-commenting the generation of the avro record files
Update KafkaReader.java

Camus has a issues and failing while comparing the Checksum of the message once partition ID is used to persists the message. The issues is with the way Camus read the messages from Kafka using EtlRecordReader.java and KafkaReader.java class. If the message is persisted with partition ID, Kafka basically persists the partition ID along with the message. But when Camus compute the checksum, it only takes the payload, not the complete message (i.e. message with Partition Key). Thus the checksum is failing.
Update EtlRecordReader.java

Camus has a issues and failing while comparing the Checksum of the message once partition ID is used to persists the message. The issues is with the way Camus read the messages from Kafka using EtlRecordReader.java and KafkaReader.java class. If the message is persisted with partition ID, Kafka basically persists the partition ID along with the message. But when Camus compute the checksum, it only takes the payload, not the complete message (i.e. message with Partition Key). Thus the checksum is failing.
Update EtlRecordReader.java
Merge pull request #14 from dibbhatt/patch-1

Merge code to fix checksum error when a custom partitioner is used on the Producer side.
Kafka serializes the partitionId when a custom partitioner is used, null in case of default.
Fixing bug encountered when having only one message returned by a fetch request
Adding RegEx support for whitelist topics
Adding RegEx support for whitelist topics
Add support for other serialization formats. You'll have to implement the RecordWriterProvider interface and specify the implementation by setting the etl.record.writer.provider.class property in your camus properties file, e.g.

etl.record.writer.provider.class=com.jivesoftware.jive.platform.kafka.camus.JSONRecordWriterProvider