Beam Summit 2022 - Playing the Long Game: Transforming Ricardo's Data Infrastructure w/ Apache Beam
Channel: Apache Beam
Date: 2022-08-03

Session presented by Tobias Kaymak at Beam Summit 2022.

Microservices focus on decoupling domains and are the antithesis of data integrations where the data across domains need to be aggregated and analyzed together. In this session, Tobias, Senior Data Engineer at Ricardo, talks about using Apache Beam for building real-time data pipelines in a decoupled & scalable way to derive key operational metrics and build notification systems. Lessons learned, wins & pitfalls on utilizing domain events as the source are covered here.