Position: Middle Data Engineer
Category: Data Engineer
English level: upper
Years of experience: 1.5


My current responsibilities include:
• Troubleshooting and resolving technical issues within data processing systems, including performance tuning and optimization of Spark applications and SQL queries. 
• Collaborating with development and data teams to understand data requirements, implement data transformations, and review code quality 
• Developing efficient code within Databricks Notebooks to support data processing and analysis tasks 
• Creating delta tables using data from multiple sources 
• Engaging in Spark development to create scalable and reliable data processing applications 
• Optimizing ADF pipelines 
• Addressing and resolved bug fixes 
• Crafting SQL queries to extract, analyze, and manipulate data from various databases 
• Conducting research to identify, evaluate, and implement potential solutions

Technologies:
• Apache Spark 
• Databricks 
• Microsoft Azure Cloud 
• Azure Data Factory 
• SQL 
• Scala/Python 
• Grafana

My previous experience contains the following responsibilities and technologies:
Responsibilities:
• Created delta tables using data from multiple zones 
• Developed code in Databricks Notebooks 
• Spark and Python development 
• Worked with ADF pipelines 
• Performed different bugfixes 
• Created SQL queries 
• Searched for possible solutions 
• Implemented Python tool to parse existing codebase and build data lineage based on SQL code 
• Implemented tool for interactive visualization of SQL data lineage 
• Implemented unit tests.

Technologies:
• Apache Spark 
• Databricks 
• Microsoft Azure Cloud 
• Azure Data Factory 
• SQL 
• Python

I am dedicated to advancing as a proficient big data engineer by continuously enhancing my technical skills in data processing, distributed systems, and cloud platforms. Through hands-on experience in real-world projects and active engagement with industry trends, I aspire to contribute effectively to large-scale data processing.