Deep insight into Shopee's data integration module refactor by Apache SeaTunnel
Tags: bigdata, dataintegration, datasynchronization, opensource
Published: 2022-09-02 07:18:27

SeaTunnel is collaborating with the leading e-commerce Shopee to have a deep tech talk with the technical experts from Shopee Singapore to share the optimization practice of SeaTunnel in Shopee.

The performance optimization of data integration facilitates enterprises to maximize the data value. It eliminates the problems such as the inconsistent caliber of various systems, complex data interaction, and lack of a unified data integration platform.

SeaTunnel is a rising star in the data integration space, It's a data integration platform that runs on Spark and Flink, supports a variety of data sources, and equips with a rich plug-in system.

Join us on 24 September 2022,14:00 PM GMT+8 to get a knowledgeable Tech Talk with Shopee engineers, SeaTunnel core developers, and contributors, as they will comprehensively discuss the data integration implementation techniques, and hands-on experiences using SeaTunnel in the e-commerce industry.


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/jjcaz58kf2wtgxnei1kt.jpg)

- Schedule: Sat, 24 September 2022 | 14:00 PM GMT+8
- Format of the event: live online
- Sign up now (free): zoom link

**Click the link to enter the SeaTunnel Meetup**

https://bit.ly/3KAqGmJ

**Scan to get the Slack channel link**

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ypd0j6qllxct9nshydnc.png)

Learn and gain new knowledge about SeaTunnel by registering yourself through: https://seatunnel.apache.org/

# Agenda
**14:00 ~ 14:05**

Opening

**14:05 ~ 14:45**

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/yhg5lewgpmywt18v1byy.jpeg)
Speaker: Yang Wang, Shopee Data Engineer
Topic: Practice of Apache SeaTunnel in Shopee

**Summary:**
Introduce the process and ideas of introducing SeaTunnel into Shopee, and show how to use SeaTunnel right out of the box, how to use SeaTunnel to refactor existing modules, and SeaTunnel servitization in the platform by instances.

**14:50 ~ 15:30**

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/25bqwoozlhucctlwf73q.jpeg)
Speaker: William GUO, Apache Foundation Member
Apache Projects in Modern Data Stack

**Summary:**
Help the audience to quickly understand the latest features of the new generation of Modern Data Stack: "de-specialization", "de-centralization", "extremely fast experience", "use as needed", sharing and explaining what is MDS( Modern Data Stack) and how to use the Apache open source project to implement MDS.

**15:30 ~ 16:10**

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/hao2vpmgqat3stu9j3tv.jpeg)
Speaker: Jiayi Jin, Shopee Data Expert
Integration Practice of SeaTunnel x Druid in Shopee

**Summary:**
Introducing how Shopee uses SeaTunnel to help Druid business build Pipelines more quickly, shorten business delivery cycles, and improve iteration efficiency

**16:10 ~ 16:50**

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/h7a956o5gy8qs24kdp0s.jpeg)
Speaker: Jia Fan, Apache SeaTunnel PPMC
Make data integration easy by SeaTunnel

**Summary:**
Introduce what SeaTunnel is and how to use it, as well as its advantages over traditional data synchronization. A quick guide by referring to use cases to help you know and experience SeaTunnel, and help new users quickly implement SeaTunnel in the production environment.

Apache SeaTunnel(Incubating) is a distributed, high-performance, easily scalable, data integration platform for massive data (offline & real-time) synchronization and transformation. On December 9, 2021, SeaTunnel was officially voted as an Apache incubator project with unanimous votes by the world's top open source organization, Apache Software Foundation!

The Meetup is monthly held by the SeaTunnel community, which is mainly for the developers in the data synchronization space. Through the practice sharing of front-line engineers, it aims to help the community developers to improve their professional skills and knowledge and creates greater value for the community around the globe.

The series meetups have been held successfully 6 times, attracting more than 7000+ technology-enthusiastic attendees.