Position: Data Engineer (Python), Data Warehouse
Company: A-HR
Experience required: 3y
Category: Data Engineer
English level: upper
Published: 2022-06-01T00:00:00+03:00

Responsibilities:
- Design, run, and maintain scalable data pipelines and related data warehouse for client's e-commerce platform, ERP, 3PLs and their 3rd party services
- Partner with designers, product managers, and engineers to ensure the system is robust and dependable
- Mentor your colleagues and help them through the process, including code reviews
- Catch bugs and monitor data quality so that the production data is accurate and accessible to key stakeholders and business processes
- Review and upgrade client's technology, data structures, and practices

Requirements
- 5+ years of software development experience
- 4+ years of experience building data pipelines with Python
- 4+ years of experience with distributed data storage systems/formats & data stores like Snowflake or - - - Redshift (or other Big data systems)
- 2+ years of experience building Kafka based pipelines to stream messages with good exposure to handling failure scenarios
- Proficiency in MS Dynamics
- Excellent understanding of relational databases, including SQL
- Ability to work with and process large datasets
- Familiarity with batch processing/real-time systems using technologies such as Spark, MapReduce, NoSQL, Hive, etc.
- Strong knowledge of Java or Groovy
- Prior experience with a major cloud provider such as AWS or Azure
- Ability to work independently and come up with thoughts to improve processes
Good spoken English

Nice to have:
- Proficiency in Linux/Unix
- Experience with Scala and Airflow
- Exposure to Continuous Integration/Continuous Deployment & Test Driven Development
- Experience with Boomi will be a plus (or eager to learn)