Beam Summit 2022 - Collibra’s Telemetry Backbone - OpenTelemetry and Apache Beam
Channel: Apache Beam
Date: 2022-08-03

Session presented by Alex Van Boxel at Beam Summit 2022

At a certain time, when you’re a company that’s building out a successful SaaS platform there comes a time when classic observability tools don’t cut it anymore. Or they don’t scale as well as you grow or they become too expensive. That’s why the SRE team started to look at observability as a big data problem: In combination with a specification for telemetry (OpenTelemetry) and big data tools like Apache Beam they build the Telemetry Backbone, the streaming hub for all of Collibra’s telemetry data. Alex, Principal Architect at Collibra tells us this story and how Apache Beam is an important factor in its success.