Position: Data Engineer
Company: DRL
Category: Python
Experience required: 3y
English level: upper
Published: 2020-12-01T00:00:00+02:00

It is a cutting-edge Data Engineering platform that orchestrates ML creation and data processing within organizations and provides visibility to data scientists and engineers involved in the process. The platform streamlines the integration, productization, and testing of ML pipelines, thus enabling the different stakeholders to work together on ML projects in an efficient and frictionless way.

**Responsibilities**
- Building complex pipelines aimed to process Large data sets using a variety of orchestration tools (such as Airflow, Luigi, Azkaban and etc’). Load and extract data from a variety of data sources such as S3, API, snowflake, Redshift, Presto, and etc’.
- Oversee the design, building, and launching of new data science models and data pipelines in production.
- Collaborate with internal and external stakeholders in order to understand their data engineering needs, implement it in your pipeline, and convey it to the engineering teams.
- Own Databand's internal pipelines, demo environments, and staging environments pipelines and data quality.

**Knowledge & Experience Requirements**
- 3+ years of experience in designing database models and working with SQL and NoSQL databases such as Redshift, Snowflake, Elastichsearch, Presto, Spark.
- 3+ of writing ETLs in OOP languages such as Python or Java.
- Good knowledge in at least one orchestration platform such as Luigi, Airflow, Azkaban, Oozie, or others.  
- Mastering SQL including complex queries.
- Solid knowledge of container orchestration tools Kubernetes, Docker, and cloud platforms.
- Ability to rapidly learn new technologies and use them in production. 
- Getting things done - solve problems in a creative way with a startup mentality to empower fellow engineers.

**Benefits**
- Startup culture, a strong product-oriented team that consists of Tech Leads and Senior specialists.
- Opportunity to be part of the big story that shapes the future and is already changing the present.
- Working in a multi-cloud environment.
- Advanced-Data Engineering technologies.
- Business travels to visit the Israel team (Post Covid).
- Working with the newest technical equipment.
- 20 working days off annual vacation leave.
- Premium medical insurance covered by the company.