Position: Data Engineer
Company: GBSFO
Experience required: 1y
Category: Data Engineer
English level: upper
Published: 2022-11-01T00:00:00+02:00

The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys building and especially optimizing data systems. The Data Engineer will support our data scientists on new initiatives and will ensure an optimal data delivery architecture and scalability.

🫡 Responsibilities for Data Engineer 

● At least 1 year and + of commercial experience;
● Create and maintain an optimal data pipeline architecture. 
● Assemble large, complex data sets that meet functional / non-functional business requirements. 
● Improve architecture for optimal data ETL from a wide variety of data sources using SQL and Spark technologies. 
● Optimize SQL queries and schema to support a responsive UI.
● Work with data experts to strive for greater functionality in our data systems. 

🎯 Required  Skills:

● Big data technologies including Spark, Hive, Hadoop, Yarn running on AWS;
● An SQL Guru, in particular PSQL, optimizing queries and schemas;
● Data pipeline and workflow management tools like Airflow;
● Python fluency, Pandas; 
● Gitlab.

🇬🇧 Language: English (Upper-Intermediate)

🙌 Benefits:
● Competitive salary;
● Friendly team;
● Long term working relationship.