Position: Big Data Engineer
Category: Data Engineer
English level: intermediate
Years of experience: 3

In one of project I have optimised data pipeline and reduce time to process data in 4x. I have good experience with relative new tool - DataHub. Recently I have gotten AWS Certified Data Analytics - Specialty (03.02.2022-03.02.2025)
1. Creating Data Platform with using DataHub as the metadata storage and visualisation.

Responsibilities:
- Collect metadata and fill DataHub, build data lineage.
- Creating and maintaining airflow pipelines to fill RedShift data warehouse and datalake.
- Develop IaC using Terraform

2. Creating airflow pipelines to fill RedShift data warehouse and datalake.
Responsibilities:
- Creating and maintaining airflow pipelines to fill RedShift data warehouse and datalake.
- Creating AWS Glue job
- Debugging and bug fixing

3. ETL systems. Data analysis and conversion. Creating Data Marts based on the data.
Responsibilities:
- Creating serverless aplication on AWS (AWS Lambda, AWS Glue)
- Increased code quality(integrated sonar, decomposition complex area of codes) 
- Rump-up of new members.
- Creating stage table using AWS Crawler.
- Covering with tests
4. Large enterprise project with microservice architectureintended to optimize calculating the rebates, chargeback and
other types of fees that are used in the USA marketing. The
complex platform for business data management and
analysis aim is to assists customers in the delivery of managed services for the health care industry.

Responsibilities:
- Increase code quality(added docstrings, integrated sonar,decomposition some complex area of codes).
- Implement inside tools for parsing title of commit and sync with JIRA ticket between different release.
- Fix bugs and noted root causes of bugs.