Position: Big Data Engineer Senior/Lead
Company: Symphony Solutions
Category: Data Engineer
Experience required: 5y
English level: upper
Published: 2022-06-01T00:00:00+03:00

Critical Requirements for the role:
- Kafka, Spark, Hadoop, Hbase, Hive
- Ability to work by CDT – US Time

Job Requirements
- 3+ years in a Big-data Engineer role; 
- Sound knowledge of Hadoop Architecture and distributed data environments; 
- Excellent functional knowledge and experience with big data components such as Kafka, Spark, Hadoop, Hbase, Hive; 
-Experience in optimizing Hadoop/hive settings for maximum throughput (includes compaction; hive metadata; TeZ Containerization;); 
- Experience in shell scripting, have knowledge of scripting languages such as Python, and be exposed to programming languages such as Java; 
- Knowledge of Table definitions, file formats, UDF, Data Layout (Partitions and Buckets); 
- Monitor Cluster performance, resource usage, backup and mirroring, provisioning, and automation (Administration); 
- ProdOps experience on Storm/Kafka. 
- Experience in analyzing MapReduce jobs logs and error handling; 
- AWS/Cloud: Sound knowledge of Cloud basics: S3, EMR. Need experience in identifying opportunities to improve processes, operations, and automation using IaC; 
- Experience ingesting data from multiple data sources such as REST API, SFTP flat files, Streaming data using Apache Storm, Kafka Streams, or others etc. 

Will be a plus: 
- Degree in Computer Science, IT, or similar field; a Master’s is a plus; 
- Data engineering certification (e.g AWS Certified Big Data – Specialty); 
- Experience with Agile methodology.

Selection process steps:
English check (Upper-intermediate, both verbal and written)
Customer Interview