Position: BigData Engineer #10059
Company: Lohika
Category: Python
Experience required: 2y
English level: upper
Published: 2021-08-01T00:00:00+03:00

The goal of the project is building brand new solution that will help apparel and department store retailers optimally plan and execute prices & promotions through a season.

MAIN TASKS AND RESPONSIBILITIES:
Develop, deliver and operate scalable, high-performance data processing software: Solution ETL, Forecasting Baseline as part of ETL, load to Solution DB (Snowflake)
Work proactively on the system architecture.
Ensure high quality development standards (unit/integration tests, etc.)
Collaboration with the product management team to incorporate the needs of our customers.

EDUCATION, SKILLS AND EXPERIENCE:
MUST HAVE:
2+ years with BigData technologies and tools.
2+ years of Python development experience (Python, Pyspark)
Hands-on experience with Spark
Handling scalability issues, pipeline/cluster optimization
Experience with clouds (Azure/AWS preferred)
Computer Science education or equivalent working experience
Good English (oral & written) and communication skills in general

WOULD BE A PLUS:
Azure Databricks experience
Snowflake experience
DevOps experience for Big Data solutions.