Position: Data Engineer
Category: Data Engineer
English level: upper
Years of experience: 5


• May 2021 - present. Data engineer. NDA.
Building/enhancement/development/maintaining of ETL pipelines, new data sources integration into existing DWH. Interacting with data analytics team for requirements gathering and defining. Initial data analysis using Spark/Python/SQL. Implementing automated data quality control. Main technologies: Spark/PySpark, AWS, Apache Airflow.

• February 2020 - April 2021. Data engineer. NDA. Building ETL pipelines, integrating new data sources(API/scraping), data validation and quality check automatization. Architecture planning, requirements defining. Legacy code refactoring. Main technologies: Spark, Airflow, Databricks, Python.

 • December 2018 - February 2020.
Python developer. NDA. Development of analytical system(data crawling, testing, servers managing). Integration of new data sources. Requirements defining, mentoring and interviewing. Implementation of distributed crawling system. Main technologies: Kafka, MySQL, Python3, Selenium.

 • July 2018 – December 2018. Python developer. NDA.
Development of procurement’s system backend(API endpoints, data validation, autotests, unit tests) using Python, Redis, pyramid, Coach DB.

 • September 2017 – July 2018. Python developer. NDA. Game stimulator development  (multitenant functional, registration procedure, permissions system, notifications system) using Python 3 and Django/DRF. Product deployment on client’s servers.