Position: Juniot Software Engineer
Category: Data Engineer
English level: upper
Years of experience: 1.5


EPAM SYSTEMS - REFI-TSCA(Scala Support Group). LSEG acquisition of Refinitiv
means that it can provide the breadth and depth of financial data and
best-in-class analytics that customers expect – driving innovation
and growth across global markets with its high-performance
solutions – from trading, to market surveillance, to wealth solutions
and more.
.Responsibilities 
 Took an active part in modification of existing pipelines as well
as in developing new ones
 Took part in Fundamental Review of Trading Book(FRTB) as
well as in calculation of Benchmarks
 Worked with Hive managed and external tables - gained
experience with Spring Boot - writing unit tests
EPAM SYSTEMS
EPMD-ISKL. Aim of the project is to gain experience in production
like tasks that included simulation of ETL process that included
implementing and orchestrating multiple Spark jobs. Multiple batch
and streaming jobs were implemented to clean, transform and load raw
data into data warehouse. As data warehouse solution Hive was used.
Hortonworks Data Platform was used as run all needed software. Also
to get familiar with different Hadoop file formats (ORC, AVRO,
PARQUET) and understanding of difference among them. Using of
SQL and Dataframe/Dataset approaches for transformation and
dropping duplicates. Designing customer Kafka producers/consumers
Get familiar with Spark Structured Streaming and obtain knowledge of
processing real time data
Responsibilities 
 Developed ETL batch and streaming Spark job, covered with unit
tests
 Worked with Hive managed and external tables
 Implemented solution for tracking already processed files
 Gained experience working with Kafka API and managing offsets

EPAM UNIVERSITY PROGRAM
Project: "Web-store" . Consist with two part Console application
and Web application. The aim of the project is to get familiar
modern Java application design approaches such as three tier
application approach and design patterns. Console application
consist of own container implementation for storing domain entities
with unit tests and provide the ability to manipulate (CRUD
operations) of domain type objects using reflection and annotations.
Also to get familiar with design of multi-threaded programs and
HTTP and TCP servers using sockets.
Responsibilities