Berlin Buzzwords 2019: David Moravek–Apache Beam pipelines at 100TB+ scale using Apache Spark #bbuzz
Channel: Plain Schwarz
Date: 2019-06-20

At Seznam.cz, we are building a successful search engine, that is used and loved by millions. Selecting the best possible content from the infinite internet, that satisfies our users needs, requires processing of massive data volumes every single day.

This talk will focus on our long-term journey of scaling Apache Beam to handle 100TB+ scale data pipeline with exponential data skew, using Apache Spark runner.

Read more:
https://2019.berlinbuzzwords.de/19/session/apache-beam-pipelines-100tb-scale-using-apache-spark

About David Moravek:
https://2019.berlinbuzzwords.de/users/david-moravek

Website: https://berlinbuzzwords.de/
Twitter: https://twitter.com/berlinbuzzwords
LinkedIn: https://www.linkedin.com/showcase/berlin-buzzwords/ 
Reddit: https://www.reddit.com/r/berlinbuzzwords/