Position: Data Engineering Manager
Company: Supernova Development
Category: Data Engineer
Experience required: 5y
English level: upper
Published: 2022-01-01T00:00:00+02:00

Job Description
We are looking for an extraordinary and dynamic Data Engineering Manager to be part of its Engineering team. You must have a good record of architecting scalable solutions, hiring and mentoring talented teams and working with product managers to build great products . You must be highly analytical and a good problem solver. You will be part of a highly energetic and innovative team that believes nothing is impossible with some creativity and hard work.

Responsibilities

● Own the overall solution design and implementation of the core infrastructure for backend systems. This includes requirement analysis, scope discussion, design, architecture, implementation, delivery and resolving production issues related to engineering. The core back end system is a large scale data platform that ingests data, applies ML models and streams the output to Data lake and serving layer. As of today we ingest 2 Bn data points every day, which needs to scale to handling 200 Bn data points every single day.
● End-end backend engineering infra charter includes Dev ops, Global deployment, Security and compliances according to latest practices.
● Ability to guide the team in debugging production issues and write best-of-the breed code.
● Drive “engineering excellence” (defects, productivity through automation, performance of
products etc) through clearly defined metrics.
● Stay current with the latest tools, technology ideas and methodologies; share knowledge by
clearly articulating results and ideas to key decision makers.
● Hiring, mentoring and retaining a very talented team.

Requirements

● 8-12 years of strong experience in product development.
● Experience in Big Data technologies like Hadoop, Spark is must (At Least 3-4 years of experience).
● Good to have exposure to no sql (cassandra, hdfs) databases, Elastic search, Kafka (2-3 years preferred).
● Experience with DAG based data processing is highly desirable.
● Excellent track record of designing and delivering System architecture, implementation and deployment of successful solutions in a customer facing role.
● Fluency in Java, Spring, REST Services.
● Strong understanding of non-functional requirements like security, test automation etc.
● Exposure to Agile development methodologies.
● Ability to hire, mentor and retain best-of-the-breed engineers.
● Strong in problem solving and analytical skills.
● Ability to influence decision making through data and be metric driven.
● Ability to collaborate across teams and strong interpersonal skills.
● SAAS experience is a plus.