Position: Senior Data Engineer
Company: opinov8
Category: Data Science
Experience required: 5y
English level: upper
Published: 2021-12-01T00:00:00+02:00

The data is presented to clients in the form of reports, data sets and news alerts, which are delivered via web platform.
The technology team is delivering multiple projects, including a new data platform, a specialized oil tracking application, and a new infrastructure and platform approach. Making many improvements to the existing systems to better support the company. Focus is on Typescript, Node JS, NextJs, React, and serverless deployments.


BEING PART OF THE TEAM
Scaling our existing data processes, focusing on quality every step of the way;
Provide guidance on technology, library and tooling choices to the team, wary of things like scope creep, over-engineering and ‘skipping unit tests for now’;
Solving business problems whilst avoiding technical complexity;
Collaborating with our teams consisting of data scientists and machine learning engineers, UX specialists, product specialists, and SREs;
Automating data analysts scripts, re-architecting data infrastructure;
Working with data analysts to productize code, jobs/scripts ingestion;
Scrapping data from multiple sources and loading them into a time-series database.

POWER YOU BRING
English language, both written and spoken, good enough to freely communicate with the teams and clients on a daily basis.
Very good Cloud awareness (AWS, GCP)
Solid skills with ECS/Fargate, API Gateway, Lambda, RDS (read replication, load balancing);
Solid skills with GCP Cloud Functions / Composer etc;
Good skills with Airflow;
Solid skills with Python for data/development - taking analyst code + making it run well, extend concepts, generalize, etc;
Solid skills with Postgres (overall understanding, performance tuning, data modeling, best practices, etc)