Position: Data Engineer with Scraping skills
Company: Rails Reactor
Experience required: 3y
Category: Python
English level: upper
Published: 2020-04-01T00:00:00+03:00

Requirements:
— A clear understanding of ETL and data curation
— Strong experience and understanding of relational and distributed databases (including internals) (e.g. PostgreSQL, MySQL, Cassandra, etc.)
— Experience with scraping systems (Scrapy)
— Proven experience with Spark/PySpark, AirFlow
— Strong experience with AWS
— Strong expertise in Python, SQL
— Experience with continuous integration, test automation, and deployment
— Experience with data monitoring and tracing in distributed and service-oriented systems
— Experience in distributed systems design and best practices
— Understanding of integration with BI tools
— Advanced / fluent written and spoken English

Responsibilities:
— Work with the Data Engineering team to design the new data platform
— Closely work with the data scraping pipelines
— Manage and guide software engineers during the development
— Systematically work on formalizing business processes, customer acquisition lifecycles, and the overall data framework
— Actively participate in the development

We offer multiple benefits, that include:
— Challenging work in an international professional environment
— The long-standing team as this is for a long term project
— Competitive salary
— Flexible work-from-home & remote work policy
— Mastering English language with a native speaker
— 40-hours working week with flexible working hours
— PE accounting and support
— 20 paid vacation days per year
— 14 paid sick leaves per year
— Collaborative friendly team environment