Position: Senior Big Data DevOps Engineer
Company: EPAM
Category: DevOps
Experience required: 5y
English level: intermediate

You will work on continuous integration process improvements to make deploys consistently successful, fast, simpler to maintain as well as streamlining/automating content migration from Prod to DEV/QA environments. This is a great opportunity to join early and influence the technology selection, design, and have ownership of the infrastructure.

This position is a part of the new innovative program EPAM Anywhere, which gives an opportunity to work remotely in multidisciplinary teams on global projects that define the future – of technology, collaboration, and learning. 

Join us and take the best of two worlds: full-time employment and remote work.

Please note that even though you are applying for this position, you may be offered other projects to join within EPAM Anywhere.

Responsibilities
- Design, build and maintain highly available production systems
- Integrate solutions with other applications and platforms outside the framework
- Provide consulting services to application teams looking to build Cloud-based applications
- Design and implement build, deployment, and configuration management systems
- Analyze, organize, and provide in-depth code reviews to improve applications dynamically and ensure the timely completion of projectsPerform script updates due to changes in requirements or implementations
- Design, implement and improve monitoring and alerting system
Troubleshoot production issues and coordinate with the development team to streamline code deployment
- Optimize system performance, availability and scalability
- Assist in production support
- Collaborate with team members to improve developed tools, systems and procedures, and data security
- Brainstorm for new ideas and ways to improve development delivery
- Create Infrastructure diagrams
- Create Procedures and Plocies
- Manage the Data DevOPs team
- Write the project documentation and conduct knowledge transfers

Requirements
- 6 years of professional experience
- 4 years hands-on experience with a variety of Amazon AWS services
- Intermediate skill in one cloud platform: GCP, Azure
- Solid Linux/Unix systems administration background
- General network administration related knowledge and skills
- Expert in infrastructure troubleshooting, performance tuning, optimization and bottleneck problem analysis
- 3 years of hands-on experience with Python
- 3 years of hands-on experience in one scripting language: Bash, Perl, Groovy;Expert in Hadoop HDFS and YARN
- Advanced skill in one of Hadoop distributions(Cloudera, Hortonworks)
- Advanced skill in Hadoop managing tools(Ambari, Cloudera Manager)
- Advanced skill in HUE, Hive, Spark
- Advanced skill in Hadoop Security;Expert in Kafka
- Advanced skill in ElasticSearch
- Solid experience in managing production infrastructure with Terraform, AWS CloudFormation, etc.
- Expert in one configuration management tool: Chef, Puppet, Ansible or similar
- Advanced skill in one build automation tool: Jenkins, TeamCity, Bamboo, GoCD, etc.
- Solid knowledge of Monitoring Best Practices
- Advanced skill in one monitoring tool and dashboard: Zabbix, Nagios, DataDog, Prometheus, Grafana, etc.
- Solid knowledge of Security Best Practices;Expert in one Authentication and Authorization protocols: LDAP, Kerberos, SAML, etc.
- Solid organizational, analytical and problem solving skills
- Ability to present and communicate the architecture in a visual form
- English language – ability to direct communicate with customer. B2+ level is required
- Bachelor’s degree in Computer Science or a related technical field, or equivalent work experience

Project technologies and tools:
Operating Systems: Debian/Ubuntu, RedHat/Centos, Windows

We offer
- Competitive compensation depending on experience and skills
- Work in enterprise-level projects on a long-term basis
- Full-time remote work (you can work from anywhere you are)
- Unlimited access to learning courses (LinkedIn learning, EPAM training courses, English regular classes, Internal Library)
- Community of 36,700+ industry’s top professionals