Position: Lead Big Data Engineer (Python+Azure) for Polish Software Company
Company: Chevaldore
Experience required: 5y
Category: Data Engineer
English level: upper
Published: 2023-02-01T00:00:00+02:00

- Remote work (on the territory of Poland, work from abroad is not permitted) 
- Working hours: 10.00-18.00 with occasional calls in later hours 
- Main tech stack: Azure, Azure Databricks, Python and PySpark, Apache Spark, Event Hubs/Kafka 
- Industry: mining 
- Budget: 25.000 – 35.000 PLN +VAT B2B 
- Level of English required: strong intermediate or higher 

**About project:**
Mining industry. Work on developing several web applications and dashboards for different categories of users simultaneously and support migration from GCP to Azure platform. The destination of all our products is: simplification, time and resource saving, and for some of them – safety of miners. 

**We are looking for:**
A strong problem-solver Lead Big Data Engineer, professional in: 
- Azure Data Factory 
- Databricks or HD Insight or Synapse Analytics 
- Azure SQL DW (SQL Dedicated Pool) 
- Azure Blob Storage and Azure Data Lake 
- Azure SQL DB/Azure SQL MI/SQL Server 
- Azure Functions 
- Apache Spark 
- Event Hubs or similar (Kafka) 
- Azure Stream Analytics or similar (Flink, Storm) 

**What will make you stand out:** 
- Azure Cosmos DB 
- MPP systems: Azure SQL DW (Synapse), GCP BigQuery, Impala, AWS Redshift 
- ETL/ELT process design and implementation 
- Airflow 
- End-to-end architecture of BigData solutions 

**The candidate will be working with:** 
- Modern technologies, products based on DevOps, ML and Big Data 
- Architects on the new infrastructure architecture vision 
- Set up highly available, fault-tolerant and secure infrastructure in Azure cloud 
- Migration of existing products from GCP to Azure, optimizing for availability, scalability, security, and cost 
- Remote teams located in Ukraine, Poland, Canada.