Position: Data Engineer
Company: GeeksForLess
Experience required: 5y
Category: Data Engineer
English level: upper
Published: 2023-04-01T00:00:00+03:00

Project duration: 3 months 
Full Time 40h/w
Working schedule: 10.00 - 18.00
Remote/ possibility to visit the office in Amsterdam once a week is a big plus
Location: EU, Netherlands, Amsterdam  

We're searching for a Data Engineer with experience with bigdata and business intelligence. The candidate will:
- Design and deliver a fact table that will support the calculation of business metrics,
- Write an oozie workflow using hadoop, to schedule the above mentioned table’s update, using one querying/scripting language (hive query language, pyspark..)
- Documentation about the project: how to maintain the system, extend it, data flow diagram.

**Requirements:**
- Knowledge of Big Data, particularly Hadoop
- Knowledge of one querying language (hive dialect of SQL) or pyspark
- Knowledge of version control systems (preferably Git)
- Knowledge of scheduling with oozie
 -Knowledge of data warehousing with Hive
- Experience with working with Business Intelligence data pipelines
- Experience with working with big data
- Years of relevant Job Knowledge
Broad Job Knowledge (3 - 5 years)

**Key Responsibilities:**
- Rapidly developing next-generation scalable, flexible, and high-performance data pipelines;
- Solving issues with data and data pipelines, prioritizing based on customer impact, and building solutions that prevent them from happening again (root cause);
- End-to-end ownership of data quality in our core datasets and data pipelines;
- Experimenting with new tools and technologies to meet business requirements regarding performance, scaling, and data quality;
- Providing tools that enhance Data Quality company wide;
- Developing integrations between multiple applications and services, both on premise and in the cloud;
- Contributing to self-organizing tools that help the analytics community discover data, assess quality, explore usage, and find peers with relevant expertise;
- Building effective monitoring of data, and jumping in to handle outages.
- This role may require to be on an on-call rotation