Rapidly Scaling for Breaking News with Karpenter and KEDA - Mel Cone & Deepak Goel
Channel: CNCF [Cloud Native Computing Foundation]
Date: 22/11/2023

Don't miss out! Join us at our next Flagship Conference: KubeCon + CloudNativeCon Europe in Paris from March 19-22, 2024. Connect with our current graduated, incubating, and sandbox projects as the community gathers to further the education and advancement of cloud native computing. Learn more at https://kubecon.io

Rapidly Scaling for Breaking News with Karpenter and KEDA - Mel Cone & Deepak Goel, The New York Times

Scaling is hard, but have you ever tried scaling for breaking news? Whether for a hot headline or the latest crossword, The New York Times may need to double the number of nodes in our Kubernetes clusters in under two minutes. Traffic spikes from breaking news alerts occur without warning, last only a few minutes, and at their peak serve more than 100k requests per second. In this talk, we’ll explore how The New York Times multi-tenant EKS clusters scale using Karpenter and KEDA, taking into account that traffic to our unified HTTP ingress is oftentimes the biggest bottleneck. We’ll discuss the design decisions we made while considering flexibility, maintainability, and cost savings.