OpAMP in Action: User Configurable Observability Pipelines - Srikanth Chekuri, SigNoz
Channel: CNCF [Cloud Native Computing Foundation]
Date: 2024-03-28

Don't miss out! Join us at our next Flagship Conference: KubeCon + CloudNativeCon North America in Salt Lake City from November 12 - 15, 2024. Connect with our current graduated, incubating, and sandbox projects as the community gathers to further the education and advancement of cloud native computing. Learn more at https://kubecon.io

OpAMP in Action: User Configurable Observability Pipelines - Srikanth Chekuri, SigNoz

The current observability pipelines using OpenTelemetry Collector cannot be configured dynamically. This means that the user cannot change the pipeline configuration without restarting the collector. This is a problem for users who want to change the pipeline configuration based on the data they are receiving. For example, a user might want to change the sampling rate of a trace exporter based on the number of traces they are receiving or they might want to parse unstructured logs into structured logs for further processing. This is not possible with the current static pipelines. In this talk, we'll discuss - How we use OpAMP to build user configurable observability pipelines. - The problems we faced with the existing static pipelines and how we leveraged OpAMP to solve them. - How we exploited the flexibility of OTEL Collector components to build a preview pipeline that allows users to preview their pipeline configuration before deploying it. - Show all of this in action with a demo