Introduce thrift format for ingest

Definitely some questions around this - opening it up for discussion
Oh yeah, is there a better way to create the sequence files on disk so I don't need to expose these methods?