Position: Data Engineer
Company: opinov8
Category: Data Science
Experience required: 2y
English level: upper
Published: 2021-11-01T00:00:00+02:00

We are looking for Data Engineer to help us build the team for the world’s premier market intelligence platform, and it’s all about data.
The technology team is delivering multiple projects, including a new data platform, a specialized oil tracking application, and a new infrastructure and platform approach. Making many improvements to the existing systems to better support the company. 
Focus is on Typescript, Node JS, NextJs, React, and serverless deployments.

**BEING PART OF THE TEAM**
• Scaling our existing data processes, focusing on quality every step of the way;
• Provide guidance on technology, library and tooling choices to the team, wary of things like scope creep, over-engineering and ‘skipping unit tests for now’;
• Solving business problems whilst avoiding technical complexity;
• Collaborating with our teams consisting of data scientists and machine learning engineers, UX specialists, product specialists, and SREs;
• Automating data analysts scripts, re-architecting data infrastructure;
• Working with data analysts to productize code, jobs/scripts ingestion;
• Scrapping data from multiple sources and loading them into a time-series database.

**POWER YOU BRING**
• Good Cloud awareness (AWS, Azure, Google Cloud);
• Good skills with ECS/Fargate, API Gateway, Lambda, RDS (read replication, load balancing);
• Good skills with GCP Cloud Functions / Composer etc;
• Good skills with Python for data/development - taking analyst code + making it run well, extend concepts, generalize, etc;
• Good skills with Postgres