Position: Data Engineer
Company: Wht.agency
Category: Data Engineer
Experience required: 3y
English level: upper

We are looking for Data Engineer for our client in Germany.Initially, this is a project for 3 months. Further extension is possible

Description
The following services shall be provided by a Data Engineer:

•  Implementation of batch and real-time data pipelines for the provisioning of data to create and update our search indexes 

•  Implementation of microservices providing search functionalities as REST APIs for our con-sumers, considering performance requirements

•  Deployment of the microservices in the productive cloud environment, considering scalability and high availability requirements

•  Implementation of batch data pipelines for the preparation, provisioning, and versioning of training data for the machine learning models

•  Consulting the data scientists in the development of algorithms and machine learning models for search result personalization

Requirements
• SQL, Python 3.7.+ Docker, Git (required)

• Kubernetes (required)

• Cloud Experience (required) 

• Elasticsearch (required)

• Python (AsyncIO)

• Argo CD, Gitlab CI/CD (should have)

• BigQuery (should have)

• Terraform (nice to have)