Yingjun Wu - Joining Dozens of Data Streams in Distributed Stream Processing Systems
Channel: Plain Schwarz
Date: 2023-06-20

As real-time data processing becomes increasingly essential, organizations face the challenge of efficiently joining and correlating data from multiple streams to gain valuable insights using distributed stream processing systems. This talk will explore the techniques and best practices for joining dozens of data streams, focusing on different joining mechanisms, such as binary joins and delta joins, as well as their pros and cons. Attendees will gain an understanding of various stream join techniques, learn how to optimize performance in distributed environments and apply lessons from industry experiences. Furthermore, the talk will discuss leveraging decoupled compute-storage architecture to reduce join costs. This knowledge will enable participants to harness the full potential of their data, creating efficient and powerful distributed stream processing solutions for their organizations.

Speaker: Yingjun Wu

More: https://2023.berlinbuzzwords.de/sessions/?id=UNYQ83

Web: https://2023.berlinbuzzwords.de/
Fediverse: https://floss.social/@berlinbuzzwords
Linkedin: https://www.linkedin.com/showcase/13978964/
Twitter: https://twitter.com/berlinbuzzwords