Berlin Buzzwords 2018: Owen O'Malley – Fast Access To Your Complex Data #bbuzz
Channel: Plain Schwarz
Date: 13/06/2018

Owen O'Malley talking about "Fast Access To Your Complex Data - Avro, JSON, ORC, and Parquet".

The landscape for storing your big data is quite complex, with several competing formats and different implementations of each format. Understanding your use of the data is critical for picking the format. Depending on your use case, the different formats perform very differently. Although you can use a hammer to drive a screw, it isn’t fast or easy to do so.

The use cases that we’ve examined are:
- Reading all of the columns
- Reading a few of the columns
- Filtering using a filter predicate
- Writing the data

While previous work has compared the size and speed from Apache Hive, this presentation will present benchmarks from Apache Spark including the new work that radically improves the performance of Spark on ORC. This presentation will also include tips and suggestions to optimize the performance of your application while reading and writing the data.

Read more:
https://2018.berlinbuzzwords.de/18/session/fast-access-your-complex-data-avro-json-orc-and-parquet

About Owen O'Malley:
https://2018.berlinbuzzwords.de/users/owen-omalley

Website: https://berlinbuzzwords.de/
Twitter: https://twitter.com/berlinbuzzwords
LinkedIn: https://www.linkedin.com/showcase/berlin-buzzwords/ 
Reddit: https://www.reddit.com/r/berlinbuzzwords/