Position: Scala/Big Data Software Engineer
Company: Avenga
Experience required: 2y
Category: Scala
English level: upper
Published: 2021-11-01T00:00:00+02:00

Scala/Big Data Software Engineer

Avenga is a global IT and digital transformation champion. Together, we are more than 2500 professionals with over 20 years of experience. We deliver strategy, customer experience, solution engineering, managed services and software products. Our mission is to shake up the conventional IT market.

Now, as we grow fast and smart, Avenga is looking for a Scala/Big Data Developer to join our team on a full-time basis. Our client is one among largest Healthcare companies in the USA. We expect the successful candidate to demonstrate high motivation and ability to solve complex problems and achieve set goals.

Skills and requirements:

At least 2-3 years of a relevant experience;
Good knowledge and Hands-on Scala Programming;
Proficiency in Spark Scala for technical development and implementation;
Data pipeline using Spark Scala;
Load disparate data sets by leveraging Kafka consumers;
Good Understanding of Big Data technologies like Hadoop, Spark, Scala, Hive, HBase, Pig, Cascading;
Ability to utilize Hive, Spark, Cassandra, Mesos and  Kafka;
Good knowledge on Hive and HiveQL;
Good Hands on in Hadoop stack (MapReduce, Hive, Sqoop, Oozie);
Experience with AWS components and services, particularly EMR, S3, and Lambda;
Good understanding of file formats including JSON, Parquet, Avro, and others;
Experience with open source technologies such as Cassandra;
Experience with messaging and complex event-processing systems such as Kafka and Storm;
Extensive hands on Data frame and Dataset operations of Spark;
Excellent in writing shell scripts;
Experience with application architecture in a big data environment;
Experience with AWS technologies or equivalent cloud stack As a hands-on engineer, influence all architecture decisions; 
Build reusable code, with the ability to scale with very large data volumes;
Data Migration/ETL knowledge is desirable;
Knowledge on Cassandra Architecture and CQL is desirable; 
Knowledge on Java Programming is desirable;
English - Upper-Intermediate