Position: Big Data Engineer with Java
Company: GlobalLogic
Experience required: 1y
Category: Java
English level: upper
Published: 2021-09-01T00:00:00+03:00

Its products allow to build data integration process, migrate data safely, process a big amount of data, cleanse data and check its quality.

Now we are seeking for a Big Data Engineer to join our team. Working in a fast paced environment collaborating with a team of very talented people, you will contribute to the enhancements of the Big Data Studio product, especially in terms of support of the latest Big Data ecosystems (HDFS/YARN, Hive, Hbase, Spark...), regularly delivered by our Hadoop vendor partners (Cloudera, Hortonworks). 


Job Description:
Above 2 years of experience with Java Core;
Knowledge of distributed systems programming;
Good knowledge and experience with Hadoop and Spark ecosystem;
Experience with NoSQL databases;
Knowledge in Unix system administration is appreciated;
Version control (Git);
Experience working in Agile/Iterative/Scrum development experience; 
Ability to communicate effectively and clearly in English, both verbally and in writing.

Job Responsibilities:
Development of connectors to support latest Hadoop distributions (Cloudera CDH, Hortonworks HDP) and their related Hadoop ecosystems (HDFS, Hive, Hbase, Sqoop, Spark);
Development of integration tests to validate that the developed components run flawlessly on the newly supported Hadoop system. This task can require the setup of Hadoop clusters in different configurations (via Virtual machines or Docker images) and support of a secure setup (Kerberos, SSL, High-availability daemons);
Active coordination and collaboration with Big Data development and QA teams (in France and China).