Position: Lead Data Engineer
Company: Opinov8
Category: Lead
Experience required: 5y
English level: upper
Published: 2021-01-01T00:00:00+02:00

**WE BUILD**
We are looking for Lead Data Engineer to help us build and lead the team for the world’s premier market intelligence platform, and it’s all about data. Helping us design, implement and scale data within the client platform, understanding challenges, coming up with the data architecture to help us scale into the future achieving 10x growth and beyond. You will also work closely with our Backend and Frontend teams to support them with linking our data API’s into the back and frontend of our systems. You will be analytical and data driven in your role, working as part of a cross functional data engineering team of around 6 individuals to help drive your finished product.

Current "Tech Stack" includes, but is not limited to:
Google Cloud Platform;
PostgreSQL;
Bash;
Python;
Flyway;
Oracle;
Groovy;
Spock Framework for testing.

**BEING PART OF THE TEAM**
Lead team of about 5-6 developers;
Scaling our existing data processes, focusing on quality every step of the way;
Provide guidance on technology, library and tooling choices to the team;
Wary of things like scope creep, over-engineering and ‘skipping unit tests for now’;
Learning our business domain;
Good software engineering principles and practice;
Solving business problems whilst avoiding technical complexity;
Collaborating with our teams consisting of data scientists and machine learning engineers, UX specialists, product specialists, and SREs.

**POWER YOU BRING**
6 years or more of software development experience;
Experience in successful team leading;
Working together, be that pairing, or wider team collaboration;
A belief in the agile principles, not just a single "Agile Process";
Willingness to use the appropriate tool for the job, not just the latest "hot" technology;
Sharing your knowledge and experience with others;
Good (current) knowledge of SQL and at least two other programming languages;
Experience in collaborative design of software systems including contracts, integration points and database schema;
The ability to Test-Drive software with automated tests.

Nice to have:
Build and design large scale real-time and batch data pipelines;
Distributed microservice based applications at scale;
Docker and Kubernetes to run your amazing code;
Wearing a Scrum Master hat from time to time;
Experience with cloud technologies such as GCP, AWS.