Cloud-Agnostic Approach to Bin-Packing Pods in Managed Kubernetes in AWS, GCP and Azure
Channel: CNCF [Cloud Native Computing Foundation]
Date: 2024-03-21

Don't miss out! Join us at our next Flagship Conference: KubeCon + CloudNativeCon North America in Salt Lake City from November 12 - 15, 2024. Connect with our current graduated, incubating, and sandbox projects as the community gathers to further the education and advancement of cloud native computing. Learn more at https://kubecon.io

Cloud-Agnostic Approach to Bin-Packing Pods in Managed Kubernetes in AWS, GCP and Azure - Vinay Suryadevara & Jianfei Hu, ClickHouse Cloud

This session will provide a unified approach to optimizing resource utilization via bin-packing pods and reducing costs in Kubernetes across AWS, GCP, and Azure. We will delve into the concept of bin-packing pods and its application in Kubernetes through the kube-scheduler's scoring policies. These policies prioritize nodes with higher utilization ratios for pod scheduling, enhancing cluster utilization and enabling the cluster autoscaler to remove underutilized nodes. We will explore the practical implementation of these strategies in different CSPs, demonstrating how to handle system utility workloads and over-provisioning for smoother scale-ups. We will also cover the current state of native support for bin-packing in managed k8s - EKS, GKE and AKS, providing insights into how to overcome these challenges. We will explore how, at ClickHouse Cloud, we saved millions of dollars on our Kubernetes infrastructure by employing a custom scheduler for efficient bin-packing of pods.