Position: Middle Python Developer for Big Data project 483 + Welcome Bonus
Company: MR Lab
Experience required: 1y
Category: Python
English level: intermediate
Published: 2021-11-01T00:00:00+02:00

Requirements:
Proficiency in Python
1.5+ years experience building, maintaining, and supporting complex data flows with structural and unstructural data 
Experience working with distributed applications
Ability to use SQL for data profiling and data validation 
English level - Intermediate

Nice to have :
PySpark
Hands-on experience working with HDFS / or HIVE / or SQOOP
Understanding of AWS ecosystem and services such as EMR and S3
Familiarity with Apache Kafka and Apache Airflow
Experience in Unix commands and scripting
Experience and understanding of Continuous Integration and Continuous Delivery (CI/CD)
Understanding in performance tuning in distributed computing environments (such as Hadoop cluster or EMR)

Company offers:
Vacation is 20 working days / till 20 working days per year for sick leaves
Full payment of taxes
English courses
Flexible work schedule
Friendly environment
Medical insurance
Opportunity for career growth

About Our Customer:
The customer is an American company based in Chicago. It accelerates digital transformation for the insurance and automotive industries with AI, IoT and workflow solutions.
 
The сustomer’s company was ranked #17 in the Top 100 Digital Companies in Chicago in 2020 by Built in Chicago, an online community for digital technology entrepreneurs in Chicago, and was named one of Forbes best mid-sized companies to work for in 2019 – an important accolade and retention tool for the 2,600+ full-time company employees (alongside 350 dedicated contractors).
 
The сompany’s corporate headquarters is in downtown Chicago in the historic Merchandise Mart — a certified LEED (Leadership in Energy and Environmental Design) building that is also known to be a technology hub within the broader metro.

About the Project:
The customer has been working on the next generation analytics platform since 2018. The customer is currently working on Hortonworks and plans to move to Amazon EMR/Hadoop in 2021. The platform is where all the data is collected into one data lake so they can then perform next-generation analytics.

Project Advantages:
Cross-product analytics
Analytics for every new product the customer has. The analytics team's products are how the customer’s company sells the products' value to clients
Quarterly business review meetings use data to explain how the product is helping clients in their business
You'll get to work with a cross-functional team
You will learn the customer’s business

Project Tech Stack: 
Technologies used are all open source Hadoop, Hive, PySpark, Airflow, Kafka to name a few

Project Stage: 
Active Development