Position: Sr. Data Engineer
Company: Blackbird Lab
Category: Data Science
Experience required: 5y
English level: upper
Published: 2021-09-01T00:00:00+03:00

About the project:
We’re starting a content project that is aimed to collect & analyze data about auto sales in Canada. In scope of this project, we will build a data pipeline from ground up, scrape popular Canadian automotive websites and build RESTful API-as-a-service for collected data. We have designed our data stack to be built on top of Apache Kafka, Spark and S3. Scraping is not in scope of data role, but we will be doing using Ruby and Selenium. You will have a great opportunity to implement data stack from scratch and propose your own solution.

Requirements:
5+ years of commercial experience as a software engineer
2+ years of working with data platforms such as Spark or Hadoop
Strong knowledge of Python or Scala in data processing
Good knowledge of data formats like Avro and Parquet
Good spoken English is a must

Will be a plus:
Experience working with data processing languages such as pySpark, Hive
Experience with Apache Kafka

We offer:
Adequate management & Friendly team that helps you achieve results
Condition package: competitive salary, performance-based reviews, 18 working days of paid vacation; medical insurance; individual English training; flexible working schedule
Co-working office in Kyiv that you visit when you want