Observability at Scale: How Open Systems Collects Telemetry from Over 10'000 Edge D... Joel Verezhak
Channel: CNCF [Cloud Native Computing Foundation]
Date: 2023-04-20

Observability at Scale: How Open Systems Collects Telemetry from Over 10'000 Edge Devices Worldwide - Joel Verezhak, Open Systems AG

As a SASE provider, our mission is to manage network operations for our customers, providing 24/7 support and expert insight through the Mission Control portal. To achieve this, it is vital that we are able to observe our fleet of over 10'000 edge devices around the globe in real-time, and be alerted as soon as problems arise. This is a challenging prospect from the outset, without considering the additional hurdles presented by remote, unstable connections, and international compliance. In this talk, we will share how we started our Observability journey using Thanos and Loki to collect over 100 million metrics and 5 TiB of logs per day (and counting!) from around the world. We will highlight the unique challenges we faced and how we overcame them, as well as the benefits of using Thanos and Loki in this context. This presentation will be of interest to anyone looking to push the limits of cloud-native technologies, or who may be interested in exploring the potential of Thanos and Loki for monitoring large distributed systems. Attendees will come away with new insights into the deployment of these technologies. and the importance of Observability in achieving uninterrupted service for customers.