Introduce thrift format for ingest

Definitely some questions around this - opening it up for discussion
This whole test is really confusing and suspicious. There is / should be no scoobi involved with ingestion. I think we need to maybe step back and just write a good ingestion spec and get rid of this one.