Position: Senior Data Engineer (Scala)
Category: Scala
English level: upper
Years of experience: 9


I have extensive experience with BigData and cloud, especially in performance tuning and optimizing data pipelines.
E.g. on my current project in last 2 years:
I built all the infrastructure for Aiflow(MWAA) + EMR in AWS.
Rewritten and optimized all data pipelines.
Which resulted in cost savings on AWS infrastructure more than 20k USD per month.
Wrote the POC and moved all configs we have to Vault. Configured and introduced a staging environment (before we had only prod).
Wrote a POC to sync data from GCP(BigQuery) to AWS.

Used technologies:
• Scala, Python, Java
• AWS (S3, Redshift, EC2, EMR, MWAA, Lambda, RDS, SQS, Athena, Glue)
• GCP (BigQuery, GCS, PubSub)
• Akka, Play
• Cats, Cats Effect, Shapeless
• ScalaTest, ScalaMock, Mockito, Cucumber
• Sbt, Maven, Gradle
• Postgres, Cassandra, MongoDb, Oracle, SqlLite, MSSQL
• Spark, DeltaLake, Presto, Druid, Hive, Impala, Zookeeper
• Etcd, Vault
• TeamCity, Jenkins
• Kafka, RabbitMQ
• ELK, Grafana, Prometheus, Graphite
• Ansible, Terraform
• Airflow, Luigi
• Docker, Kubernetes
For last 3 years working in startups