Position: Data engineer / ML (PySpark, Hadoop, Conda, Hive)
Company: Teiva Systems
Experience required: 3y
Category: Data Science
English level: upper
Published: 2021-09-01T00:00:00+03:00

**Project description, what stage?**

Our client **(Retail Customer, Data Science (Sherlock))** is responsible for developing and maintaining the Machine Learning (ML) platform in close cooperation with the Data Science team. We face the challenges of sales optimization/prediction, the solution of which is of great financial importance. Among others: we predict sales, discounts, plan stocking on shelves, and generate recommendations for products.

**Required skills & stack of technologies on the project**

Python, PySpark, Hadoop, Conda, Hive, Jenkins, Git

**Team structure**

The team is divided into several smaller 2-3 person subgroups.

**Main responsibilities & tasks**

The daily tasks are based on helping to implement/review the Spark code in data processing (features) for the ML model, creating a new version of the platform (production serving of the model, automating the selection of the best parameters), and improving the automatic implementation of the code in production.

**3 interview stages**

**Contract duration** - 12 months +