Position: Data Engineer
Company: AboutHR recruiting agency
Experience required: 3y
Category: Data Engineer
English level: upper
Published: 2022-02-01T00:00:00+02:00

We are looking for an experienced Data Engineer to join our growing global team of Data Scientists and Engineers, supporting innovative solutions whose impact can transform our business.

As a Data Engineer, you will be responsible in developing and maintaining Python APIs in collaboration with the Technical Lead Team, and the Data Scientists. Your main task will be to write effective and scalable code for the API to be able to process big datasets (e.g. weather, satellite imagery). You will have the opportunity to work with multiple clouds (i.e. Microsoft Azure and Google Cloud Platform).

Technical stack:
Microsoft Azure: SQL database, Azure Datalake, Azure Virtual machines, Azure DevOps (for code repo and CI/CD).
Pycharm as IDE for Python Development.
Databricks for Data visualization.

Main responsibilities:
• Write scalable and efficient Python code and pipelines
• Develop and maintain existing and new custom Python packages
• Participate in implementing integrations requested by Data Scientists and Research Analysts
• Deploy updates and fixes
• Implement tests to ensure proper functioning
• Develop user guides and support internal users

Qualifications:
• Master's degree in computer science or similar
• 3+ years of relevant work experience
• Experience with Microsoft Azure and/or GCP (as a plus)
• Experience in working with data lakes and relational databases
• Interest in writing and maintaining high-quality, efficient and scalable code
• Strong problem solving, quantitative and analytical abilities
• Product development mindset
• Oral and written communication skills to translate complex problems into solutions
• Good level of English
• Strong plus:
◦ Experience with Google Earth Engine (both JavaScript and Python)
◦ Experience in the commodity sector, preferably in the agriculture industry