Position: Senior Data Engineer
Category: Data Engineer
English level: upper
Years of experience: 11

NRT data processing
Event Driven data processing in AWS
• AWS Certified Data Analytics – Specialty
• Experience in working with AWS (S3, Lambda, StepFunctions, SNS, SQS, KMS, SSN, DynamoDB, CloudFormation, CloudWatch, Kinesis, Glue, Athena, Redshift)
• Experience in working with Qubole (Hive, Presto, Spark)
• Development of ETL: Prefect 2.0, Airflow (MWAA 2.0), dbt (Data Build Tool), IBM DatatStage, Informatica, MS SSIS;
• Database design and implementation: Oracle, MS SQL, Teradata, DB2, Hadoop Hive, Snowflake;
• SQL-tuning;
• ETL performance tuning;
• Development of Oracle PL/SQL, Microsoft T-SQL, Teradata SQL PL program units;
• Experience developing on Python;
• Experience using bash & PowerShell scripting;
• CI/CD tools: Jenkins, GitHub Actions, Terraform
• Debugging & Unit Testing;
• Experience with Git, SVN, Perforce; TFS;
• Troubleshooting, problem solving.

===========================================
Senior Big Data Developer
EPAM Systems · Contract
Jun 2021 - Present
Customer: EF Tours

AWS services used for data lake hydration using DMS, S3, Glue, Lambdas, Step Functions etc.
Data loading into Snowflake (Cloud Data Warehouse)

Projects pipeline:
- Implement tooling for task orchestration and data transformations using AWS Managed Airflow, dbt (Data Build Tool).
- Ingest and process additional data flows into Snowflake
- Near real-time replication to hydrate data lake and Snowflake DWH

Tech stack: 
- AWS: Lambda, StepFunctions, S3, SQS, SNS, DynamoDB, DMS, KMS, SSM, Athena, CloudWatch;
- Snowflake
- DBT (Data Build Tool)
- Prefect
- Fivetran
- Rivery
- Python
- Terraform
- GitHub Actions
- Docker
AWS
Snowflake
dbt
Python
FiveTran / Rivery