Position: Data Engineer (Azure), Asset Management Solutions
Company: DataArt
Experience required: 5y
Category: Data Engineer
English level: intermediate
Published: 2022-07-01T00:00:00+03:00

DataArt specialists were engaged to help build a new cloud-based data management and analytics platform.

This project will allow you to work with top-notch data management technologies and architecture approaches.

TECHNOLOGY STACK
The main technologies are — Azure Data Platform (Azure SQL, Azure Data Factory, Azure Storage, Azure Functions); Python/Scala. DataArt fully owns the stack and architecture ensuring the use of the latest best practices.

Requirements
-5+ years of engineering experience
-2+ years working with data in the cloud, ideally using Azure
-Experience working with the Azure Data Platform (Azure SQL, Azure Data Factory, Azure Storage, Azure Functions)
-Expertise in SQL and comfortable designing, writing, and maintaining complex SQL-based ETL
-Experience building batch and micro-batch data pipelines; ETL design, implementation, and maintenance
-Experience in writing Python code
-Experience working with Git
-Spoken English

Nice to have
-Understanding of data warehouse layers, approaches to load data into such layers, and relevant algorithms
-Experience in designing a data platform architecture with relation to the infrastructure
-Experience with schema design and data modeling, and analytical skills to -QA the data and identify gaps and inconsistencies
-Experience supporting Business Intelligence teams and products
-Experience in parallel computing