Conquering Challenges in Building TiCDC: A High-Performance Change Data Capture Ser... Charles Zheng
Channel: CNCF [Cloud Native Computing Foundation]
Date: 22/11/2023

Don't miss out! Join us at our next Flagship Conference: KubeCon + CloudNativeCon Europe in Paris from March 19-22, 2024. Connect with our current graduated, incubating, and sandbox projects as the community gathers to further the education and advancement of cloud native computing. Learn more at https://kubecon.io

Conquering Challenges in Building TiCDC: A High-Performance Change Data Capture Service for TiKV - Charles Zheng, Netflix

Building a Change Data Capture (CDC) service for TiKV poses unique challenges. Our talk discusses the creation of TiCDC, showcasing how we ensured scalability through a distributed structure, and reduced latency by monitoring TiKV's change log directly. We'll reveal how extensible interfaces were designed for varied downstream applications and how event order was maintained, considering DML-DDL relationships. This presentation will provide a comprehensive understanding of the intricacies and successes involved in creating a powerful CDC service for a highly scalable storage system.