Position: Data Engineer, Python dev.
Category: Data Engineer
English level: fluent
Years of experience: 3

-- PostgreSQL, Clickhouse, MySQL, Snowflake, BigQuery, Redshift, Airbyte, DBT

-- Modeling relational databases (ER modeling, Relational schema, Normal forms), data modeling 3NF/Dimensional (Star/Snowflake)

-- Python, Django, FastApi, Pandas

-- k8s(Helm), Docker, Git (GitHub, Actions), Airflow, Metabase, Nginx, AWS/GCP 

-- Hadoop(MapReduce), PySpark(Datarbicks), TableFormats (Iceberg, Delta table), FileFormat(Avro,Parquet,ORC), Storage(S3,ADLS,GCS,HDFS)
TOP SKILLS:
-- PostgreSQL, Clickhouse, MySQL, Snowflake, BigQuery, Redshift, Airbyte, DBT, Dagster
--  Modeling relational databases (ER modeling, Relational schema, Normal forms), data modeling 3NF/Dimensional (Star/Snowflake,DataVault)
--  Python, Django, FastApi, Pandas
--  Metabase, Looker, Tableau
--  K8s(Helm), Docker, Git (GitHub, Actions), Airflow, Nginx, ElasticSearch, 
--  AZURE(Synapse, data factory, adls…)
--  GCP(Dataflow, PubSub, DataProc, Instance, GCS, BigQuery, …)
--  AWS(Glue, S3, EC2, Lambda, ElasticBeanstalk, IAM, VPC…)
--  Hadoop(MapReduce)Streaming, PySpark(Datarbicks), TableFormats (Iceberg, Delta table), FileFormat(Avro,Parquet,ORC), Storage(S3,ADLS,GCS)



---- September 2022 till now _ Itransition
---- Data Engineer role
1. Converting BigQuery queries to Snowflake after two companies merged
2. Doing ELT(dbt) with Snowflake-tasks, and for some SQL using Airflow. It depends on which team has 
created a ticket. 
3. Preparing semantic layer for Looker, so that Bi engineers(including me) can build dashboards 
and do some aggregations.
4. Building Looker reports and attaching them to business-related boards.
Python, Apache Airflow, GCP/AWS, Snowflake/BigQuery, Looker(LookML), SQL, DBT


---- September 2021 — September 2022 _ EPAM Systems
---- Python Engineer role
Extracting and data validation for RSS feeds.
Extending functionalities of existing lambdas.
Python, AWS(Lambda), S3, Elastic Beanstalk, VPC, EC2


---- August 2020 — September 2021 _ AlifTech
---- Data Engineer role
- Improved initially working with MySQL Tableau performance by replacing it with MongoDB.
- Wrote data pipelines using Apache Airflow (including data retrieving from several MySQL 
instances, processing them on Pandas, and storing them into MongoDB as data warehouse).
- Automated daily manual jobs with Airflow including sending daily reports to other departments.
- Automated ML model builds by refactoring code into Airflow DAGs and Tasks.
Airflow, python, pandas, FastAPI, Tableau