Position: Senior Data Engineer
Company: Luxoft
Category: Data Engineer
Experience required: 5y
English level: upper
Published: 2022-02-01T00:00:00+02:00

**Project Description**
This is a collaboration with the Tax and Accounting group within the Client. The mission of this engagement is to improve reliability, availability and performance of a product suite.

**Responsibilities**
The team member joining to this position will work in the Data Lake Initiative:
- Participate and collaborate with team members to review the use cases for data pipelines.
- Design and develop highly optimized and reliable enterprise level data pipelines to move data to data warehouse in real-time.
- Review and analyze existing business process, identify any gaps, and recommend improvements.
- Design and develop modern real-time solutions with Scala, Spark, Azure Databricks.
- Partner with business users and data scientists to build and deploy machine learning models.
- Improve data governance and operational excellence.
- Develop data expertise and take ownership of data quality for the newly developed pipelines.
- Adhere to company coding standards and best practices.
- Conduct code reviews and create technical solution document.

**Skills**
**Must have**
- 6+ years of experience as a Data Engineer
- Hadoop, Azure Databricks, Stream Analytics, Eventhub,/Kafka, SQL Server, T-SQL
- Azure data factory, Azure data lake, Azure SQL DB, Azure DW/Synapse

**Nice to have**
- Power BI, Azure ML, Python, Scala

**Languages**
English: B2 Upper Intermediate