Made linesPerFile configurable
Made configurator more sensible
STREAMS-166 | Modified the S3PeristReader to check for object summaries in the listing response. If there are any object summaries then we can assume that the path is pointing to a directory and we need to iterate through all files that it contains.
writer should work without metadata
updater should work without metadata
general cleanup of configurator
changed how index, type, id get set to allow for absent metadata
Utility Processors to
 - populate datum from metadata
 - populate datum from metadata in document field
more consistent logging / exception handling
added support for file: and hdfs: schemes
reader and writer are not internally consistent - removing timestamp read from wrong field for testing
"scheme": "file" works :)
will submit another PR for STREAMS-167 which will allow timestamps and metadata reading from a previously written hdfs stream.
license / javadoc headers
STREAMS-176 | Added ability to override functions that could prove useful to downstream developers
STREAMS-174 | Lock the parent pom to the 0.1-incubating version
STREAMS-174 | Remove an unused property that refers to a SNAPSHOT version
STREAMS-174 | Converge HDFS to the release version
STREAMS-174 | Change google4j to the latest release and update the mechanism for fetching e-mails to a mechanism supported in that release
STREAMS-174 | Use the maven-enforcer-plugin to fail builds if snapshot dependencies are used
refactored to move duplicated code to new protected methods in ElasticsearchPersistWriter
Merge branch 'STREAMS-164'
addresses failing test in streams-processor-urls
STREAMS-178 | Modified the behavior of the LinkResolverProcessor's unwind method. Duplicate unwound links are now consolidated into a unique set of links
STREAMS-178 | Removed commented out code