Position: Python Developer in ML/Data project
Company: DataRoot Labs
Experience required: 3y
Category: Python
English level: upper
Published: 2023-08-01T00:00:00+03:00

In this role, you will be working in a team related to ML and Data Engineering domain. In short, it is an environment for developing ML models. Based on Kubeflow, it is possible to explore data, do preprocessing, and train models using Kubeflow pipelines. 

The project consists of two parts. First, is data synchronization using Apache Beam pipelines streaming data from external sources like Kafka or MinIO buckets into the Trino database. Second, is a Kubeflow environment for ML engineers to create pipelines for data processing and model training. 

The goal of the project is to integrate with the existing client’s infrastructure and expose the data to ML engineers so they can create models based on it. We are looking for an additional senior person to work on this project.


**Responsibilities:**
- Design and develop new product features and improve existing functionality with senior engineers. From product kickoff to fully working feature.
- Stabilize and refactor the codebase to rally the product 
- Test components and fix bugs
- Transfer knowledge to the client’s team to help them build a great product
- Write and support jobs using SQL, Python
- Build and improve data gathering and evaluation pipelines

**Knowledge & Experience Requirements:**
- 3+ Years as a software engineer in Python.
- Proficiency in the Python ecosystem. 
- In-depth knowledge of Apache Beam, Apache Flink, Apache Spark, Apache Kafka, 
- Great understanding of Cloud native technologies, such as Kubernetes, Kubeflow and Kserve.
- Experience with Trino (Presto) and MinIO (S3).
- Strong verbal and written communication skills in English.

**Benefits:**
- Startup culture, a strong product-oriented team that consists of Senior specialists.
- Opportunity to leverage your engineering skills for fellow engineers and shape the future of data engineering.
- Working with the newest technical equipment (MacBook Pro 16″).
- 20 working days of annual vacation leave.
- English courses, educational events & conferences are covered by the company upon request.
- Premium medical insurance covered by the company.