Position: Data Engineer
Company: ITRex Group
Experience required: 3y
Category: Data Science
English level: intermediate
Published: 2020-08-01T00:00:00+03:00

**About the project:**
Our client is one of the largest American multinational retail corporations that operates a chain of hypermarkets and stores.
Our team is building a solution for data consolidation from the company’s various sources. The main strategic goal is to create a single point of contact solution for operating with standardized, normalized, and cleaned data for any user.

**Stack of technologies on the project:** Python, Kafka, Kubernetes, Helm, Airflow, Databricks, Pyspark (+ streaming), Cassandra, Delta lake, Data lake, Azure ( app func, storage, event hub, keyvault, k8s), Azure dev ops ( triggering pipeline, using project management part), Gremlin, Graph database (janusgraph), Elastic search, LDAP, restApi, DB.

**Responsibilities:**
Implementation of new and support existent ETL pipelines, Data Marts, participation in meetings.

**Must have:**
- Python
- RDBS (Relational Databases)
- Databricks (Pyspark (+ streaming))
- English level: Intermediate+

**One or two from the list below have:**
- Elastic search — experience
- Cassandra — experience
- Airflow
- Kafka
- Kubernetes, Docker

**Will be a plus experience with such technologies as:**
- Helm
- Delta lake
- Data lake
- Azure ( app func, storage, event hub, keyvault, k8s)
- Azure dev ops ( triggering pipeline, using project management part)
- Gremlin
- Graph database ( janusgraph)
- LDAP
- restApi

**We offer:**
- Work with really interesting projects;
- Flexible work schedule;
- Friendly and engaging professional team;
- Environment open for professional growth;
- Compensation of sports;
- Medical service;
- PlayStation console and other relaxing activities;
- Regular corporate events;
- Nice office with a beautiful kitchen and a delicious buffet at the business center.