Position: Senior/Staff Data Engineer
Company: Grid Dynamics
Experience required: 3y
Category: Data Engineer
English level: upper
Published: 2023-01-01T00:00:00+02:00

We are looking for a Senior/Staff Data Engineer to join our new project.

**Project description**
The project is about creating an analytical application about customers for internal users. 
The idea is to create recommendations for every customer to give him useful information that helps to prevent him from canceling.
Applications consist of several parts:
- data loading (reading data about users and their actions from different sources) - done via SQL, scripts are run using Python or bash
- data preprocessing (filtering text, lemmatizing, creating parts that can be used in vectorization, for example, ngrams)
- text vectorization (using a pre-trained model getting vectors for every text part)
- vector classification (pre-trained model and logic about predictions)
- ranking of possible output options (calculation similarity between processed text and possible output options )

**Details on the tech stack**
Python (pandas, sqlalchemy, NumPy), SQL, , Terraform, AWS (key-value storage AWS S3). No Spark, 3 DB types (all SQL): Oracle, Postgres, SQL Server

**Tasks**
Creating  data pipelines for use in the application