Position: Data Engineer/Python Software Engineer
Category: Python
English level: fluent
Years of experience: 6

Implemented a complex stream processing project from scratch. It's consist of two main parts: 1) AWS DMS task to collect changes from database in realtime and push them to a Kafka topic; 2) Apache Flink stream processing job to filter, aggregate and apply events as small batches to a target database.
Supported and improved existing ETL pipelines including requests to a third-party API providers on a daily basis, added new data source for the pipeline which uses PySpark for processing, Refactored and improved stability of big pipeline which queries internal resources and push the data to third-party API provider, Managed a team of Python Developers (10+ team members): onboarding, mentoring, reviewing.