Position: Big data engineer
Company: Data Science UA
Category: Data Engineer
Experience required: 3y
English level: intermediate
Published: 2021-12-01T00:00:00+02:00

Looking for a talented Big Data engineer to join top talent team of software developers and data scientists, reshaping the future world of email/messaging detection. Take a role in the development and implementation of data platform, working together with their data scientists on a next-generation detection solution.

Responsibilities
- Design and build next-generation data architecture.
- Create scalable designs and implement new distributed systems for data storage, processing, and accessibility.
- Work closely with our data scientists to support feature extraction and analysis.
- Deploy and serve ML models to our detection pipelines.

Requirements
- At least BSc in computer science (or equivalent)
- Proven experience as Data Engineer with two or more of the following programming languages: Java, Scala, Python, Go.
- Experience in building large-scale distributed systems in the cloud, dockers, and Kubernetes.
- Experience in building data stream pipelines using big data frameworks such as Spark, Kafka, Elastic, mlflow, SageMaker, Databricks etc.
A “get it done” attitude with CI/CD concepts.
- Data modeling for a variety storage system NoSQL DBs and RDBMS
Must be able to prioritize and handle multiple tasks and changing priorities.
- Good interpersonal and problem-solving skills.