Position: Senior Data Engineer
Category: Data Engineer
English level: upper
Years of experience: 9


I have been working in IT for more than 9 years. My primary language is Java, but I also have good experience working with Scala and Python and know that languages at the intermediate level. During the first four years of my career, I worked as a software engineer where I worked in a large distributed team with big monolithic applications, developing REST API, and working a bit with UI technologies. Also, I act as a mentor for newcomers and do technical leadership for a small team of people. Then I switched to the data engineer role, where I have extensively worked on building data lakes from scratch, extending spark to accelerate its query execution with custom accelerators that were written in C++. That includes extending the spark catalyst rule-based engine and extending the tungsten code generator to generate C++ code and C++ code integration to the scala/java codebase. In data lakes, I mostly worked with batch-processing jobs based on the spark, but I also have a bit of experience working with stream-processing pipelines. In addition, worked a lot in spark job optimization.