Position: Data Engineer
Category: Data Engineer
English level: fluent
Years of experience: 2

• Databricks certified data engineer associate;
• Microsoft certified data engineer associate;
• English - C1;
• Exceptionally great feedback from the past projects;
I'm a Microsoft and Databricks certified data engineer passionate about delivering efficient and innovative data solutions. I have hands-on production experience working with Python, SQL, Spark, and Docker, and proficient in utilizing Cloud Platform services, such as Databricks, Google BigQuery, Google Composer, Google Dataproc, Azure DevOps, etc. I enjoy designing and building data pipelines and systems that deliver valuable insights. As a dedicated problem solver, I thrive in collaborative environments and am skilled in working with teams to develop effective data-driven solutions. In terms of my interpersonal skills, I would consider teamwork, discipline, willingness to help, and stress resistance my main strengths.

The current projects domain - Retail & Distribution, implies me following responsibilities:
• Contribute to the project by collaborating with a team using the Scrum framework and Jira dashboard;
• Gather requirements from customers;
• Support the architecture development and configuration-driven generic ELT/ETL framework. Develop Delta extension features;
• Model data sources and layers for efficient storage and retrieval;
• Develop an orchestration system for sources with inner and outer dependencies using Google Composer;
• Cover code with thorough unit and integration tests to ensure high quality;
• Document knowledge on the Confluence.

From the most challenging tasks that I have faced, I can point out 3 of the most interesting:
• Development of release reprocessing dag, that uses graph structures to set complex dependencies between multiple sources;
• Creation of data layer logic in multihop architecture;
• Development of an advanced multisource filtering engine that outputs data to SCD2.

As a data engineer, my desirable project would be one that challenges me to leverage my technical skills and creativity to develop robust and scalable data infrastructure solutions. Ultimately, my ideal project would allow me to work collaboratively with a team of skilled professionals and make a meaningful impact on the organization's data-driven initiatives.