kenfar/DataGristle — Issue #10: Support Avro Files
Author: kenfar
Created: 2011-10-31 05:15:04+00:00
State: open
Labels: Feature Request, Medium Priority

Avro (quick link to python reference: http://www.harshj.com/2010/04/25/writing-and-reading-avro-data-files-using-python/) would be a great complement to csv processing.

Because Avro has built-in metadata, a big chunk of what gristle_determinator does would be unnecessary (primarily in identification of the file structure, names & types). However, the data analysis part of gristle_determinator would still be useful, as would separate data analysis tools like gristle_viewer, etc.

Hopefully, this would be implemented in such a way that the gristle tools would allow avro & non-avro files to be combined, compared, etc.