Position: Data Engineer
Company: sphereinc.com
Category: Data Science
Experience required: 3y
English level: upper
Published: 2021-07-01T00:00:00+03:00

Location: Remotely
Type: Hire
Start Date: ASAP​

Responsibilities include but are not limited to:

-Develop and unit test ETL ELT data pipelines using ADF V2 and other components like Azure SQL, Azure SQL DW, ADLS, Gen2 etc. Data pipelines on AWS is a plus;
-Maintain and manage code with Azure DevOps;
-Implement secure integration with data sources using Azure Key Vault ---Managed Identity Private Links etc;
-Create data pipeline involving diverse systems such Azure SQL, DB Azure SQL, DW ADLS, Gen2 Azure Databricks. On premise compute, as well as data pipelines on AWS;
-Status reporting weekly and monthly basis, document functional and technical design.

Requirements:

-Experience with ETL tools (5+);
-Experience with Azure Data Factory, Azure Data Lake;
-Experience with Azure SQL DB;
-Experience with Power BI/SQL and SSRS (preferred);
-Experience in programming with .NET, Python or Scala Spark (preferred);
-Written and spoken English.