Position: Data Engineer
Category: Data Engineer
English level: intermediate
Years of experience: 6


I'm a Data Engineer with a total of 6 years of
experience in software development in the banking domain and 
2 years of experience in Data Engineering.
Technical stack: 
- Apache Spark, Pyspark, Apache Nifi, Airflow, Kafka
- Python (Flask), Scala (Akka), Java
- Kubernetes, Docker, Hadoop
- MongoDB, PostgreSQL, BigQuery, Minio

Last workplace responsibilities: 
- As part of a team of 4 data engineers, worked to provide data to 2 data scientists.
- Developed ETL pipelines using Apache Nifi, and Apache Spark, and orchestrated them using Apache Airflow. Thanks to this, data scientists quickly received data for further analytics and model building, reducing the time to provide results to the business
- Automated the deployment of ETL pipelines using GitLab CI/CD, which made it possible to quickly fix errors and deploy new ETL pipelines.
- Built a GPU model training environment for a chatbot development project using Gitlab CI/CD and Docker and then Kubernetes. This allowed data scientists to quickly deploy changes to the chatbot model.
- Integrated the chatbot with internal banking systems, and developed plug-ins for it in Python. Also engaged in debugging various issues, working with colleagues from other departments. Thus, I identified critical errors in other bank systems that affected the work of the chatbot.
I am looking for a Data Engineer or a Backend Engineer position, I want to work with Apache Spark, Python, Scala, or Java, both on-premise and clouds. I don't want to work with reporting.