Position: Java Big-data Engineer
Company: GlobalLogic
Experience required: 3y
Category: Java
English level: upper
Published: 2022-06-01T00:00:00+03:00

**Job Description**
What we’re looking for:
3+ years in a Big-data Engineer role;
Sound knowledge of Hadoop Architecture and distributed data environments;
Excellent functional knowledge and experience with big data components such as Kafka, Spark,Hadoop, Hbase, Hive;
Experience in optimizing hadoop/hive settings for maximum throughput (includes compaction; hive metadata; TeZ Containerization;);
Experience in shell scripting, have knowledge of scripting languages such as Python and be exposed to programming languages such as Java;
Knowledge of Table definitions, file formats, UDF, Data Layout (Partitions and Buckets);
Monitor Cluster performance, resource usage, backup and mirroring, provisioning and automation (Administration);
ProdOps experience on Storm/Kafka. 
AWS/Cloud: Sound knowledge of Cloud basics: S3, EMR. Need experience in identifying opportunities to improve processes, operations and automation using IaC;
Experience ingesting data from multiple data sources such as REST API, SFTP flat files, Streaming data using Apache Storm, Kafka Streams or others etc.

**English: **Upper-intermediate, both verbal and written.

**Job Responsibilities**
Participate in developing high load MapReduce platform hosted on-premise and AWS.
Participate in architectural decision making on on-premise migration to AWS EMR
Be ready to assist in integration of new data streaming sources  (like REST API, SFTP flat files)
Direct communication with the customer
**Project Description**
Our client delivers personalized experiences, cross-channel messaging and loyalty programs that add value to the customer relationships. The the product enables marketers to rapidly scale and meet the demands of the modern consumer. Marketers can easily deploy targeted and triggered cross-channel campaigns, compile data from multiple sources, and strategically promote desired customer behaviors - effectively increasing revenue and enhancing customer experiences.

**Keyskills - Must Have**
Big Data, Kafka, Spark, Hadoop, Hive
**Keyskills - Nice to Have**
Python, Java AWS, Hbase, Storm