Position: Cloud Data Lead (EDW/DL/ETL) IRC119658
Company: GlobalLogic
Experience required: 5y
Category: Java
English level: intermediate
Published: 2021-06-01T00:00:00+03:00

Description:
The client is an industrial asset disposition and management company, that sells heavy industrial equipment and trucks through auctions and other transactional channels. The program consisting of 20+ engineers will include Architecture, Platform and Data Management teams working from offshore and nearshore locations augmenting the existing onsite engineering team. 

Requirements:
We are looking for an experienced Data Engineer able to lead a small team contributing to a project of modernization of the client’s Data Warehousing.

The requirements for this position are the following:

Good understanding of data processing frameworks, pipeline orchestration technologies, data storage engines and tools

Experience with the cloud services for distributed data processing and scalable data pipelines, ETL, and data warehousing. Preference will be given to experience with GCP services such as: BigQuery, Cloud Storage, Cloud Data Fusion, Cloud Functions 

Well versed in traditional DWH solution with great Stored Procedure knowledge

Deep familiarity with SQL and various DBMS

Good scripting skills in a modern programming language (such as Python, Java, Scala, C#, etc.)

Ability to work with client’s high-level requirements, perform interpretation, analysis, implementation of the requirements, as well as demonstration of resulted solution

Ability to lead a small data warehousing team

Working with Agile methodology, being able to act as a Scrum Master

Good spoken and written English (at least Upper-Intermediate)

Will be a plus:

Experience with data streaming via Apache Kafka or similar services (AWS Kinesis, GCP PubSub)

Experience with BI data visualization tools like Tableau

 

Preferences:
IntelliJ IDEA, Jenkins Pipelines, PostgreSQL, Apache Kafka, Tableau, SQL Server-SSIS, SQL Server – SSAS, SQL Server-SSRS

Responsibilities:
Provide technical leadership, guidance and coordination to the Data Team

Design and development of data management related solutions

Create and maintain optimal data pipeline architecture; build data pipelines to pull data from different source systems; integrate, consolidate, transform, and cleanse data according to business rules, and structure and for use by analytics applications

Review business requirements; map reports, data subjects, and entities to source systems and artifacts in the Enterprise Data Warehouse (EDW) and/or Data Lake (DL)

Document requirements and business rules into appropriate technical specifications

Plan and implement enhancements to the EDW and DL environments on a regular release cycle

Present technical solutions to various stakeholders

Develop and maintain sufficient support documentation to facilitate day-to-day support of the EDW and DL environments