Position: Big Data with Hadoop
Company: Grid Dynamics
Experience required: 2y
Category: DevOps
English level: intermediate
Published: 2022-08-01T00:00:00+03:00

**Project from a Fortune 500 client in the retail industry. A high level of expertise and really challenging tasks await you on the project.
**

**Requirements:**
The Hadoop Admin (CDP/HDF) Cloud - MSAzure will be responsible for the implementation and ongoing Administration of Hadoop Bigdata infrastructure.
The Cloud Hadoop Admin will support, implement and maintain BigData infrastructure and will be responsible for end to end Hadoop cluster administration.

**Job Duties:**
- Responsible for the implementation and ongoing administration of Hadoop infrastructure initiatives.
- Working with data delivery teams to set up new Hadoop users.
- This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Kafka, Spark and MapReduce  access for the new users.
- Cluster maintenance as well as creation and removal of nodes using Hadoop Management Admin tools.
- Sound knowledge in Ranger, Nifi, Kafka, Atlas, Hive, Storm, pig, spark, Elastic Search, Solr, Kyvos, Hbase etc and other - bigdata tools.
- Performance tuning of Hadoop clusters and Hadoop Map Reduce routines.
- Screen Hadoop cluster job performances and capacity planning
- Monitor Hadoop cluster connectivity and security
- Manage and review Hadoop log files, File system management and monitoring
- HDFS support and maintenance
- should be able to deploy Hadoop cluster running on the Cloud(MS-Azure/AWS), add and remove nodes, keep track of jobs, monitor critical parts of the cluster, configure name-node high availability, schedule and configure it and take backups.
- Good knowledge of Linux as Hadoop runs on Linux.
Must Have Skills
Must know Hadoop and bigdata infrastructure
Expert in Hadoop administration with knowledge of Hortonworks/Cloudera or Mapr Bigdata management tools
Expert in implementing and troubleshooting hive, spark, pig, storm, Kafka, Nifi, Atlas, Kyvos, Elastic Search, Solr, Splunk, HBase applications.

We offer:
~ Opportunity to work on promising projects;
~ Work in a highly motivated and purposeful team;
~ Flexible schedule;
~ Opportunities for professional development.
~ More details in the interview :)