Position: Data Engineer
Company: Digicode
Category: Data Engineer
Experience required: 3y
English level: upper
Published: 2022-11-01T00:00:00+02:00

USA health-care project which supply medical equipment for hospice care is looking for Data Engineer.
Part-time involvement is OK.

**Main requirements**
- Hands-on experience in Azure stack (Azure Data Lake, Azure Data Factory, Azure Databricks)  
- Good understanding of Azure Databricks platform and can build data analytics solutions to support the required performance & scale
- Experience in building ETL / data warehouse transformation processes
- Direct experience of building data pipelines using Azure Data Factory 
- Demonstrating analytical and problem-solving skills, particularly those that apply to a big data environment
- Good Understanding of Modern Data Warehouse/Lambda Architecture, Data warehousing concepts
- Proficient in a source code control system such as GIT
- Ability to code
- Microsoft Azure Big Data Architecture certification is an advantage

**Functions**
- Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory, Azure Databricks)
- Designing and implementing highly performant data ingestion pipelines from multiple sources using Azure Databricks
- Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times (for example, integration with HCHB (external), PowerBI (internal))
- Working with event based / streaming technologies to ingest and process data
- Working with other members of the project team to support delivery of additional project components (API interfaces, Search)