Position: Lead Data Engineer
Company: MatcHR
Category: Data Science
Experience required: 5y
English level: upper
Published: 2021-04-01T00:00:00+03:00

You design and implement data architecture and modeling solutions that are built for the future and are aligned with the vision of the other engineering teams. Your solutions support our BI, data science, machine learning, and other data needs within the company. Whilst this is a tech lead role, it is expected that you will be hands-on and have deep knowledge and expertise across the software engineering and data science lifecycle. You work with an amazing team of data engineers, data scientists, and analysts and you’ll help us elevate their skills to the next level.

**What you'll be doing**

Responsible for the technical delivery of our next generation of Cloud and Machine Learning solutions
Build tools to understand how data is flowing throughout our data pipelines
Take data-oriented projects from start to finish, including requirements, scope, architecture, development, releases and maintenance
Drive code quality throughout the data team
Design best practices for data processing throughout the company
Actively contribute to the adoption of strong software architecture, development of best practices and, new technologies

**What you'll bring:**

5+ years experience with responsibilities in a technology team (stakeholder communication, mentoring junior members, code reviews, etc)
Proven experience delivering big data and machine learning solutions in a cloud environment 
Strong development background creating pipelines and complex data transformations and manipulations using Python
Experience with containerization and automation solutions in cloud environments (e.g. docker/Kubernetes, terraform, airflow, etc.)
Knowledge of distributed data processing frameworks such as Spark/Dataflow
Background in ETL and data processing, know how to transform data to meet business goals
Expertise in streaming concepts with experience with technology such as Pubsub, Kafka, Kinesis, etc.