Position: Junior BigData Engineer (Java/Scala, Spark, Kafka)
Company: Avenga
Experience required: 1y
Category: Scala
English level: intermediate
Published: 2021-02-01T00:00:00+02:00

Avenga is a global IT and digital transformation champion. Together, we are more than
2500 professionals with over 20 years of experience. We deliver strategy, customer experience, solution engineering, managed services and software products. Our mission is to shake up the conventional IT market.
Avenga is looking for a Strong Junior/Middle BigData Engineer to join our Lviv team on a full-time basis. So if you are a passionate and competent BigData Engineer  , join the Avenga team to perform feats on our Avenga's R&D project. Solution of  R&D department to clearly distinguish budget of existing activities directed to innovations and create repeatable effective workflow for new innovative initiatives across whole company. System gather and analysis Dota2 matches for anomaly detection in order to predict meta, nerfs and buffs to heroes and items. Match result prediction based on picks ! 

Requirements:
At least 0,5+ years of experience as a BigData engineer;
Hands-on experience with Java 11+/Scala;
Data pipeline using Spark Scala;
Load disparate data sets by leveraging Kafka consumers;
Understanding of Docker concepts;
Build reusable code, with the ability to scale with very large data volumes;
Good Understanding of Big Data technologies like Kafka, Apache Spark, Scala,Cassandra
English - Intermediate.


Responsibilities:
Working with Apache Spark ML module;
Building and automation of Spark pipelines;
Migrating from Mongo to Cassandra.


Technologies stack on the project: Java11+, Micronaut, MongoDB, Kafka, Protobuff, docker.