Position: DataOps Engineer
Company: N-IX
Category: Data Engineer
Experience required: 2y
English level: intermediate
Published: 2021-11-01T00:00:00+02:00

**N-iX** is looking for an experienced **DataOps Engineer** to join the global team behind a mobility company that aims to democratize vehicle ownership and financing on the entire continent.

**About the role:**
You will join a team of 5 Data professionals and Build a Data Lake platform from scratch using cutting-edge technologies. You will also be involved in developing new data pipelines, ingesting, and data orchestration.
The Data Team is a brand-new function that’s been created with data at the heart and minds of growing the business to be a data-led company. We want to hear from experienced and creative data analysts who want to use their skills to improve people’s lives and help us democratize mobility thru fintech.

This role is suitable for beginner DevOps or ETL Engineer interested in switching to DataOps direction.
 
**Responsibilities:**

Work within the global tech team, using your expertise to build highly automated provisioning, monitoring, and operational capabilities for data
Support the ongoing growth, design, and expansion of our data platform across a wide variety of data sources, enabling large scale support across an array of streaming, near real-time, and research workflows
Provide development of scripting for the cloud platform components and service with CI/CD tooling and services as needed. This scripting may span Jenkins, CloudFormation, shell scripting, Terraform, and ansible as required by the platform
Provide exceptionally strong skills in version management and using repositories such as git for ETL, SQL, and other scripting versioning and deployment management
Provide ownership and execution of product installation and configuration to prescribed landscape/architecture and best practices for the product. Configure services to meet functional and non-functional requirements, including security compliance
Develop data pipelines as required using AWS services
Conduct maintenance of ETL code, data quality, reliability, and performance including but not limited to process monitoring, data validation, and data refresh
Provide support to data analysts and data scientists with planned and ad hoc data requests, access, and extracts of data contained in a variety of SQL database systems including Aurora
Continuously improve automation, processes and service reliability, availability, and performance across the cloud data and application platform

**Requirements:**

Experience in data pipelines design and development with  AWS Glue, Streamsets, or equivalent ETL tools 
Ability to create and orchestrate complex and efficient data pipelines across relational, NoSQL, and other data sources including data APIs and streaming data
Strong experience in maintaining ‘as a service’ model for data pipelines, databases, CI/CD tooling
Excellent troubleshooting and performance optimization skills for ETL platform administration, integration, and performance monitoring
Code maintenance, version control, and documentation
Experience in building ETL pipelines in AWS Glue
Experience in developing RESTful web services for data APIs
Strong experience with DataOps principles for automation, lean ops, and Agile
BS or MS in Computer Science or related fields
English level – upper-intermediate or higher

**Nice to have:**

Experience with containerization and container orchestration technologies, like Docker, Kubernetes, and Argo is a plus
Python experience
Experienced with Python libraries for web scraping such as beautiful soup and scrapy
We offer:

**​Flexible working hours**
​A competitive salary and good compensation package
​Best hardware
​A masseur and a corporate doctor
​Healthcare and sport benefits
​An inspiring and comfy office

**Professional growth:**

Challenging tasks and innovative projects
​Meetups and events for professional development
​An individual development plan
​Mentorship program

**Fun:**

​Corporate events and outstanding parties
​Exciting team buildings
​Memorable anniversary presents
​A fun zone where you can play video games, foosball, ping pong, and more