Position: Data Engineer
Category: Data Engineer
English level: upper
Years of experience: 3


Experienced Software Data Engineer with machine learning skills. Skilled in development, building and maintaining ETL pipelines using Python, designing data architecture, and SQL performance tuning. Also, I am engaged in developing pet projects which can be found on my GitHub, as well as studying new technologies and ML for NLP tasks.

Experiences:
– Development of data acquisition pipelines for retrieving data from source systems and development of data transformation pipelines using Databricks with defined Lakehouse architecture
– Report performance optimization: query optimization, data migration, incremental update configuration 
– R&D: Trend analyzing system, Interactive map of the full-scale invasion 
– Development of data infrastructure (data migration to Synapse, defining data model) and ETL pipelines for the retail clients
– Data analysis and demand forecasting functionality for retail clients 
– Development of a custom instrument for monitoring Azure resources using a microservices architecture with Python Azure Function for custom monitoring of Azure resources

Skills: 
Azure (Databricks, ADLS, Data Factory, Functions, Log Analytics, Key Vault, Synapse Analytics, ML Service)
Python, Apache Spark (PySpark, Scala)
SQL (creating and performance tuning of SQL queries, views, stored procedures, and functions) 
Machine learning (developing time series forecasting models, NLP)