Position: Data Engineer
Category: Data Engineer
English level: upper
Years of experience: 3

Set up Apache Airflow server on Celery Executor and 3 workers on remote VMs.

I facilitated the implementation of Apache Kafka for Change Data Capture (CDC). Before my involvement, data was extracted from databases using batch processing.

I successfully carried out the integration of a data lake with a data warehouse (DWH), a task that had not been undertaken prior to my involvement.

Set up Grafana for Airflow & Kafka monitoring.

Developed telegram bot for pipelines and services monitoring.

I presented at a meetup with the topic 'DWH Architecture'.
Data Engineer:

Worked on Oracle based DWH using Airflow, PL/SQL, Kafka.

Implemented Kafka (Debezium, Confluent Connector) for CDC. Before me, data from PostgreSQL databases were fetched in batches. 

Set up Apache Airflow server on Celery Executor and 3 workers on remote VMs.

Developed telegram bot for pipelines and services monitoring.

I presented at a meetup with the topic 'DWH Architecture'.

Junior Data Engineer:

I've transitioned the legacy pipelines from Informatica to Airflow.

I've also developed a predictive model for the Monthly Active Users (MAU) of the application.

Junior BI analytic:

Designed dashboards for senior management highlighting key performance indicators.

I also tested the new Data Warehouse (DWH).